Evaluation of lifestyle interventions to treat elevated cardiometabolic risk in primary care (E-LITE): a randomized controlled trial
© Ma et al; licensee BioMed Central Ltd. 2009
Received: 2 October 2009
Accepted: 12 November 2009
Published: 12 November 2009
Efficacy research has shown that intensive individual lifestyle intervention lowers the risk for developing type 2 diabetes mellitus and the metabolic syndrome. Translational research is needed to test real-world models of lifestyle interventions in primary care settings.
E-LITE is a three-arm randomized controlled clinical trial aimed at testing the feasibility and potential effectiveness of two lifestyle interventions: information technology-assisted self-management, either alone or in combination with care management by a dietitian and exercise counselor, in comparison to usual care. Overweight or obese adults with pre-diabetes and/or metabolic syndrome (n = 240) recruited from a community-based primary care clinic are randomly assigned to one of three treatment conditions. Treatment will last 15 months and involves a three-month intensive treatment phase followed by a 12-month maintenance phase. Follow-up assessment occurs at three, six, and 15 months. The primary outcome is change in body mass index. The target sample size will provide 80% power for detecting a net difference of half a standard deviation in body mass index at 15 months between either of the self-management or care management interventions and usual care at a two-sided α level of 0.05, assuming up to a 20% rate of loss to 15-month follow-up.
Secondary outcomes include glycemic control, additional cardiovascular risk factors, and health-related quality of life. Potential mediators (e.g., treatment adherence, caloric intake, physical activity level) and moderators (e.g., age, gender, race/ethnicity, baseline mental status) of the intervention's effect on weight change also will be examined.
This study will provide objective evidence on the extent of reductions in body mass index and related cardiometabolic risk factors from two lifestyle intervention programs of varying intensity that could be implemented as part of routine health care.
Diabetes mellitus affects nearly 24 million Americans (8% of the U.S. population), and type 2 diabetes accounts for about 90% to 95% of all diagnosed cases of diabetes [1, 2]. The prevalence of diagnosed type 2 diabetes increased six-fold in the latter half of the past century [1, 2]. This dramatic increase is largely attributed to the epidemics of obesity and physical inactivity . About two-thirds of U.S. adults are overweight or obese , and 57 million people are estimated to have pre-diabetes -- a condition characterized by blood glucose levels that are higher than normal but not yet high enough to be diagnosed as diabetes. Overweight or obese individuals with pre-diabetes are at high risk for progression to diabetes. A vast majority of these individuals also have an increased risk of cardiovascular disease (CVD) because of concomitant risk factors, such as abdominal obesity, atherogenic dyslipidemia, and elevated blood pressure. The constellation of these common CVD risk factors is known as the metabolic syndrome .
The Diabetes Prevention Program (DPP) has demonstrated that an intensive lifestyle intervention focused on lifestyle changes and weight reduction can successfully prevent or delay the onset of type 2 diabetes and the metabolic syndrome in overweight or obese adults with pre-diabetes . The DPP intervention required frequent, face-to-face, individual counseling . Despite evidence of potential cost-effectiveness of the DPP intervention [8, 9], the substantial resources required for its implementation are a significant barrier to widespread dissemination. A wide range of research has been underway related to translation of the DPP into real world settings, such as studies that assess cost-effective and generalizable methods of delivering evidence-based lifestyle modifications in small groups and over the Internet, as well as methods to sustain behavior change and weight loss [10–12].
Recently, the 16 "core curriculum" individual counseling sessions of the DPP intervention have been adapted for delivery in a 12 session group-based program called Group Lifestyle Balance (GLB)™ , and preliminary evaluations of the program have suggested potential effectiveness [14, 15]. Past studies have shown that group interventions are similar in efficacy to individual interventions for weight loss [16, 17] and may markedly improve intervention cost-effectiveness [8, 9]. The Internet is another alternative mode of delivery of lifestyle interventions. Several randomized controlled trials have demonstrated the efficacy of Internet-based lifestyle interventions in overweight or obese individuals [18–20], including those at risk for type 2 diabetes .
To date, few studies have rigorously tested the feasibility and effectiveness of group- and Internet-based lifestyle interventions for weight management and risk reduction in primary care settings. Weight loss in overweight or obese patients with associated risk factors is of high priority for clinical care settings given the growing prevalence of obesity-related complications, and preventative health care is a major primary care goal. However, obesity and risk factor management has thus far been largely a failure in primary care settings throughout the United States [22, 23]. Research is needed to translate efficacious lifestyle interventions into primary care practice, and in the process, evaluate their cost-effectiveness, generalizability, and sustainability.
The present study aims to evaluate the feasibility and potential effectiveness of two lifestyle interventions, information technology-assisted self-management alone (the SM intervention) or SM combined with care management by a dietitian and exercise counselor (the CM intervention), in comparison to usual care (UC). The primary hypothesis for each intervention (SM and CM) is that intervention participants will achieve greater reductions in body mass index (BMI) than UC participants at 15 months. Secondary research goals include comparing the effects of each intervention to UC on changes in glycemic control (fasting blood glucose and hemoglobin A1c), additional cardiovascular risk factors (serum lipids, blood pressure, waist circumference, and C-reactive protein [CRP]), health-related quality of life and psychosocial well-being. Differences between CM and SM intervention effects on weight loss and secondary outcomes also will be examined. Potential mediators (e.g., treatment adherence, caloric intake, physical activity level) and moderators (e.g., age, gender, race/ethnicity, baseline mental status) of the intervention effects on weight change and secondary outcomes will be explored. Additionally, process measures will be evaluated to assess the extent of participation of patients in each intervention and the potential reach, adoption, implementation and maintenance of the interventions in primary care practice.
E-LITE is a randomized controlled clinical trial in which overweight or obese adults with an increased risk for CVD and diabetes are equally randomized to one of three arms: UC (control), SM, or CM. All procedures and materials were approved by the Palo Alto Medical Foundation Research Institute's Institutional Review Board.
Participant inclusion and exclusion criteria
1. Ethnicity: All ethnic groups;
2. Gender: Men and Women;
3. Age (as of date of enrollment):
a). Lower age limit: 18 years;
b). Upper age limit: NONE (only exclude for cause, e.g. diseases, functional limitations detailed below);
4. Body mass index ≥ 25.0 kg/m2;
5.Having pre-diabetes and/or metabolic syndrome based on the following criteria:
a). Pre-diabetes: fasting plasma glucose between 100 and 125 mg/dL;
b). Metabolic syndrome: Three or more of the following:
--Waist circumference ≥ 40 inches in men; ≥ 35 inches in women (if in Asian American ≥ 35 inches in men; ≥ 31 inches in women);
--Triglycerides ≥ 150 mg/dL;
--High-density lipoprotein cholesterol (HDL-C) < 40 mg/dL in men; < 50 mg/dL in women;
--Systolic blood pressure ≥ 130 mm Hg or diastolic blood pressure ≥ 85 mm Hg;
--Fasting plasma glucose between 100 and 125 mg/dL.
6. Having a primary care physician (PCP);
7. Able and willing to enroll and provide written, informed consent, i.e., to: 1) meet the time and data collection requirements of the study; 2) be randomized to one of the three intervention arms; 3) adhere to the recommendations of the study intervention as assigned; 4) participate in follow-up for 12 months; and 5) allow extraction of relevant information from their medical records.
1. Inability to speak, read or understand English;
2. No regular access to a computer with Internet and email capabilities;
3. Triglycerides ≥ 400 mg/dL;
4. Systolic blood pressure ≥ 160 mm Hg or diastolic blood pressure ≥ 100 mm Hg;
5. Initiation or change of drug therapy for elevated blood pressure or abnormal lipid levels within the past 3 months;
6. Initiation or change of antidepressant medication within the past 3 months;
7. Having a medical or physical condition that make moderate intensity physical activity (like a brisk walk) difficult or unsafe;
8. Use of weight-loss medications in the past 3 months;
9. Regular use (> 5 days/month) of medications that affect appetite or weight (e.g., oral corticosteroids, insulin, oral hypoglycemics etc.);
10. Currently enrolled in a lifestyle intervention program at PAMF or elsewhere;
11. Planning to undergo bariatric surgery during the study period;
12. Diagnosis of Type 1 or Type 2 diabetes mellitus;
13. Significant medical co-morbidities, including uncontrolled metabolic disorders (e.g., thyroid, renal, liver), heart disease, stroke, and ongoing substance abuse;
14. Renal insufficiency (i.e. glomerular filtration rate < 60 mL/min/1.73 m2)
15. Diagnosis of psychiatric disorders that would limit adequate informed consent or ability to comply with study protocol;
16. Diagnosis of cancer (other than non-melanoma skin cancer) that was active or treated with radiation or chemotherapy within the past 2 years;
17. Diagnosis of a terminal illness and/or in hospice care;
18. Pregnant, lactating or planning to become pregnant during the study period;
19. Already enrolled or planning to enroll in a research study that would limit full participation in this study or confound the observation and interpretation of the study's findings;
20. Family/household member of another study participant or of a study staff member;
21. No longer a PAMF patient or planning to transfer care outside of PAMF during the study period;
22. Planning to move out of the area during the study period;
23. PCP determination that the study is medically inappropriate or unsafe for the patient;
24. Investigator discretion for clinical safety or protocol adherence reasons.
Recruitment and Screening Process
Target sample size for E-LITE is 240, recruited in three sequential cohorts. The screening process for each cohort begins with identification using relevant data available in the patient's electronic health record of age-appropriate, potentially eligible patients whose primary care provider (PCP) regards the interventions under study to be medically appropriate and safe for that patient. Patients whose participation is approved by their PCP are asked to complete a brief questionnaire regarding major exclusions, either online or by phone. Those who pass the initial screen are scheduled for a formal eligibility determination (baseline) visit (BV1), and, within two weeks prior to the visit, they are contacted and given instructions for completion of an online baseline questionnaire.
The BV1 occurs no more than four months after the initial screen and no more than four weeks prior to randomization. It includes completion of additional eligibility questionnaires, measurement of height, weight, waist circumference, and resting blood pressure, and a fasting blood draw for tests of plasma glucose and lipids at the onsite Clinical Laboratory. Time permitting, a seven-day physical activity recall  is completed; otherwise, it will be completed at the baseline assessment/randomization visit (BV2). Participants are given instructions and a three-day food record form to be completed and returned at BV2. Participants who have possible angina or peripheral vascular disease based on the Rose Questionnaire  are referred to their PCP for further evaluation and may only continue with explicit authorization of their physician.
Participants who are eligible to continue on the basis of BV1 are scheduled for BV2, which occurs at least seven days after BV1 and no more than three weeks prior to the start of the intervention. The BV2 includes measurement of weight, waist circumference, and resting blood pressure, a review of the three-day food record for completeness, complete review of medication and supplement use, a non-fasting blood draw for tests of A1c and CRP, and if necessary, completion of the physical activity recall. Following the measurements, participants are randomized.
All participants are properly and adequately informed and give appropriate consent at each step in the screening process of the trial and prior to participating in the post-randomization phase.
Randomization and Blinding
Participants are randomized on a 1:1:1 basis to one of three arms: UC, SM, or CM. Pocock's "minimization" procedure  is used to assure better than chance group balance with respect to participant age, gender, race, BMI, fasting blood glucose, waist circumference, and use of PAMFOnline, which is PAMF's online patient portal to access his or her own health record (user vs. non-user). For each participant about to be randomized, a computerized randomization algorithm automatically calculates an imbalance score for each of the balancing factors, as the excess or deficit of previously randomized participants in each arm matching the current patient on that factor. These scores are summed over factors to form a total imbalance score, S, for each treatment arm. The randomization probability of assigning the patient to the treatment associated with the smallest S is set to 2/3, and the other two treatments are each assigned a probability of 1/6 based on Efron's biased coin method .
A designated research staff member who is not involved in follow-up data collection or data analysis assigns each study arm a non-revealing label, e.g., A, B, or C, and performs actual randomization of the participants. These labels are used in all study documents and other materials to ensure blinding of the investigators and staff responsible for follow-up data collection and analysis to participant treatment assignments throughout the trial.
Baseline and Follow-up Measures and Data Collection
List of measures and data collection schedule
Fasting blood: Total cholesterol, LDL-C, HDL-C, triglycerides, glucose, hemoglobin A1c
C-reactive protein (CRP)
Family medical history
Three-day food record
Eating Habits Confidence Survey
Social Support and Eating Habits Survey
Stanford Seven-day Physical Activity Recall
Exercise Confidence Survey
Social Support and Exercise Survey
Smoking and alcohol consumption
12-item Short Form Health Survey (SF-12)
Obesity Related Problems Scale
Nine-item Patient Health Questionnaire (PHQ-9)
Depression Anxiety Stress Scale
Care at non-PAMF health care facilities
Unified Theory of Acceptance and Use of Technology1
Data extracted from PAMF electronic databases
Current medical problems
Health care utilization
Primary and Secondary Outcomes
The primary outcome measure is the BMI. Height and weight, in light indoor clothes without shoes, are measured using a wall-mounted stadiometer and a balance beam scale, respectively. All scales are calibrated quarterly by trained study personnel using standard weights. BMI is calculated as the Quetelet index (kg/m2).
Secondary outcomes include glycemic control and component risk factors of the metabolic syndrome. Plasma glucose, total cholesterol, triglycerides, and high-density lipoprotein cholesterol (HDL-C) are measured after an overnight fast, and low-density lipoprotein cholesterol (LDL-C) is calculated by the Friedewald equation . Hemoglobin A1c and CRP are also measured. Waist circumference is measured using a tape, according to a standardized protocol, in a horizontal plane around the abdomen at the level of the right iliac crest Blood pressure is measured in the seated position after at least a five-minute rest. At the BV1, blood pressure is measured in both arms and the arm with the higher pressure is used for all subsequent blood pressure measurements. At each assessment visit, three blood pressure measurements are obtained with one-minute between measurements, using equipment and procedures that meet the American Heart Association's recommendations for blood pressure measurement in humans .
Additional secondary outcomes include generic and obesity-specific health-related quality of life and mental health. The 12-item Short Form Health Survey (SF-12) , a widely used quality of life instrument, is administered to evaluate changes in non-disease specific physical and mental health status. The Obesity-Related Problem Scale specifically measures the impact of obesity on psychosocial functioning. The eight-item scale has high internal reliability and sound test--retest reliability, correlates strongly with a wide range of theoretically related constructs, and is responsive to weight loss intervention . The nine-item Patient Health Questionnaire (PHQ-9) refers to the previous two-week interval and consists of nine items of depression symptoms and one follow-up question on functional impairment . The PHQ-9 is both a measure of depressive symptomatology and a tentative diagnostic instrument for the Diagnostic and Statistical Manual of Mental Disorders, 4th edition (DSM-IV) depressive disorders . The 21-item Depression Anxiety Stress Scale has high internal consistency and correlates strongly with other validated self-report measures of depression, anxiety, and stress .
Furthermore, changes in diagnoses, medication use and health care utilization will be assessed. With participant authorization, data are extracted from their EHRs at baseline and again at 15 months on current medical problems, current prescription medications, and health care contacts during the study (including outpatient visits, ER visits, hospitalizations, and phone/email consultations). Pharmacy dispensing data are currently available for patients with capitated insurance only (making up about 30% of the PAMF patient population). While the vast majority of health care of PAMF primary care patients, including specialist care, is received from PAMF, a significant proportion of medications prescribed are not obtained from the PAMF pharmacy. Also, PAMF patients may seek care outside the system. Therefore, additional data are obtained on medication and supplement use by recording information from the container and on health care outside PAMF by participant self-report.
Data are also obtained on a battery of behavioral and psychosocial measures using existing self-report instruments to assess potential mediators of the interventions.
The two main foci of the SM and CM interventions are dietary changes to achieve weight loss and increased physical activity. Adherence to the interventions is assessed by three-day food records and the Stanford 7-Day Physical Activity Recall. Multiple-day food records are considered a gold standard for collection of individual dietary data . The Stanford 7-Day Physical Activity Recall has been tested for validity and reliability  and is sensitive to change in physical activity [37, 38]. In addition, adherence to the overall intervention "process" is assessed by documenting attendance at group sessions, completion of self-monitoring records, and frequency of use of the online self-management support systems included in the SM and CM interventions. Self-monitoring data obtained during the intervention program also are used for adherence monitoring and for individual feedback.
Based on the social cognitive theoretical underpinnings of the intervention (see below), two main hypothesized mediators of the intervention are selected to be measured: self-efficacy and social support. The Eating Habits Confidence Survey and the Exercise Confidence Survey , and the Social Support and Eating Habits Survey and the Social Support and Exercise Survey , have been shown to be reliable and have high internal consistency and are associated with other measures of social support and self-efficacy related to physical activity and dietary behaviors.
The questionnaire created by Venkatesh et al.  based on the Unified Theory of Acceptance and Use of Technology, a technology acceptance model, is adapted to assess user acceptance and use of the online self-management support systems among SM and CM intervention participants. The questionnaire includes the following scales: Performance Expectancy, Effort Expectancy, Social Influence, Facilitating Conditions, Attitude toward use, Self-Efficacy, Anxiety and Behavioral Intention.
Additional Process Measures
Data on the proportion and representativeness of patients willing to participate, as well as reasons for declining to participate, are used to assess the potential reach of the E-LITE interventions. Demographic and professional characteristics of PCPs (e.g., age, sex, years in practice, specialty and board certification, PAMF department, panel size and composition, %FTE) are obtained from PAMF administrative records. Data on the proportion and representativeness of physicians willing to approve their potentially eligible patients for participation are used to assess the likelihood of adoption of the E-LITE interventions.
The theoretical underpinning of the E-LITE interventions is derived from Social Cognitive Theory  and the Transtheoretical Model of Behavior Change . The former emphasizes the reciprocal determinism between individual, environment, and behavior, whereas the latter recognizes that behavior change is a dynamic process that moves, at variable speed, through varying stages of readiness to change. Behavior change is more likely with increased behavior capability, and behavior capability is strengthened through goal setting, skill building and self-monitoring. Also important are confidence in one's ability to perform a given behavior (self-efficacy) and expectation of favorable outcomes of the behavior (outcome expectations). Behavioral strategies may vary by stage of change (i.e., experiential processes during initial phases of behavioral adoption and behavioral processes occurring during action and maintenance phases) . In addition, the E-LITE interventions draw upon key research evidence for the importance of self-management in chronic disease management [44–46]. Successful self-management intervention is driven by patient-defined problems and fosters the mastery of skills in problem solving, action planning, decision making, and support building through an iterative process [46, 47].
This theoretical basis distinguishes the E-LITE interventions from the delivery of lifestyle modifications in the usual primary care setting. Current practice routinely involves physician advice, occasionally with referral to a dietitian who takes a diet history and who then provides standard educational materials and advice during a small number of individual or group sessions, typically with little or no follow-up. This standard clinical approach lacks the theoretical basis and behavioral self-management focus described above.
Evidence-based Intervention Goals
A goal-based approach is used in both SM and CM interventions, in which participants are given the same general goals: 7% weight loss and 150 minutes of moderate physical activity per week. These goals are consistent with those of the DPP . Participants who wish to lose more than 7% of their starting weight may be encouraged to do so only insofar as the participant maintains a normal BMI at or above 21 and the rate of weight loss does not exceed three pounds per week. The physical activity goal is consistent with the new Physical Activity Guidelines for Americans , and is deemed safe and attainable for most adults. Participants, especially those who are habitually sedentary, are advised to gradually and steadily increase their activity level and reach the goal within five weeks of beginning activity, or as soon as possible thereafter. Regular physical activity recommendations for activities of moderate intensity other than brisk walking, as well as strength and flexibility physical activities, are to be tailored to participant situation [49, 50]. After attaining the minimum goal of 150 minutes a week, participants who wish to be more active are encouraged to do so, as tolerated. If participants reach the 150-minute goal but are not achieving the weight goal, they are encouraged to further gradually increase their physical activity to 60 minutes/day of moderate physical activity [49, 51, 52]. Participants in both SM and CM interventions are strongly encouraged to track their weight and physical activity using the American Heart Association's online self-management portal at http://www.heart360.com.
Recommendations are also given for total fat reduction (to 25% of calories from fat) and calorie balance and restriction (with a goal of a 500- to 1000-calorie reduction diet). As in the DPP , the calorie and fat goals are given as a means to achieve and maintain the weight goal, rather than as a goal in and of itself. Therefore, if a participant consumes more than the assigned calorie or fat goal, but is achieving the weight goal, there is no need to focus on further reductions. Portion control, choices of low-energy and nutrient-dense meals and snacks, healthy food preparation techniques, and careful selection of restaurants, including fast food, and the items offered are promoted as strategies to gradually achieve the calorie and fat goals. Participants also are recommended to (1) lower saturated fat intake to < 10% of caloric intake, (2) lower cholesterol intake to < 300 mg/day, (3) consume a high plant-based diet that includes a variety of fruits and vegetables, whole grains, and low-fat dairy products, and (4) reduce intake of high glycemic index carbohydrates.
Intervention Format, Structure, and Content
Both SM and CM interventions last 15 months and involve Intensive Treatment and Maintenance phases.
Intensive Treatment Phase
The Intensive Treatment of both interventions lasts three months and is based on the GLB program . There are 12 weekly sessions and each lasts 90-120 minutes. Each session follows a similar structure and includes five curriculum components: 1) measurement and recording of weight, 2) review of self-monitoring records and progress, 3) identification of personal barriers to weight loss and activity and potential solutions, 4) presentation of a new content area, and 5) goal setting and action plans for next week.
SM condition. After attending a single-session group orientation, participants in the SM intervention are given the GLB program on a DVD to follow at home, with access to a study dietitian via secure online messaging for advice and support. Secure messaging is integrated with the electronic health record and allows patients to communicate confidentially with their provider online. The DVDs are provided by the Diabetes Prevention Support Center at the University of Pittsburgh Diabetes Institute. Participants are encouraged to message the dietitian comments and questions as they are completing the DVD program. The dietitian will answer secure messages from participants within 1-2 work days and provide general support and encouragement.
CM condition. Participants in the CM intervention receive the GLB program in 12 weekly group sessions led by a study dietitian and exercise physiologist. Both interventionists have training and experience in weight management counseling, and the dietitian has completed the GLB 2-day training workshop offered by the University of Pittsburgh's Diabetes Prevention Support Center. The sessions are conducted in a highly interactive fashion. The GLB Manual of Operations is closely followed, except for the addition of a food tasting activity as part of the check-in process and a 30-minute physical activity demonstration at the end of each session. The food tasting activities are aimed at increasing participant experience with healthy food choices, encouraging them to try new foods that they might not normally try on their own, and stimulating a social, fun and engaging environment. The physical activity demonstrations are aimed at increasing participant awareness of physical activity intensity, experiencing various moderate-intensity activities that are safe and that they can easily incorporate into their daily lives, and increasing participant confidence. E-LITE participants in both CM and SM arms receive a pedometer in the initial session (the group orientation for the SM arm), as opposed to in session 10 as in the original GLB program .
Both SM and CM interventions use secure online messaging as the primary mode of contact between participants and the dietitian during the maintenance phase. The contact time is likely to vary depending on individual needs in either intervention arm. The exercise physiologist is available to counsel the dietitian on issues related to physical activity but she will have no direct communication with participants in this phase. Participants are instructed to continue monitoring their weight, dietary intake, and physical activity at least twice each week.
SM condition. SM participants receive an email reminder every two weeks to continue self-monitoring. As in the Intensive Treatment phase, they are encouraged to submit comments and questions to the dietitian via secure messaging. The dietitian will respond to participant inquiries but will not initiate contact.
CM condition. In contrast, the dietitian provides active follow-up and individualized counseling to participants in the CM group via secure messaging on at least a monthly basis. Based on participant progress, the dietitian provides tailored feedback to reinforce progress, recommend problem solving and relapse prevention strategies, and encourage maintenance efforts. As the participant is successful or not in attaining his/her current goals, changes to the individual action plan are recommended, e.g., modifying goals, adding to them, or replacing them with new goals. The objective of any changes to the action plan is to keep the goals realistic yet challenging and to accommodate preferences and periodic fluctuations in motivation and schedule. Participants are encouraged to practice subject-initiated relapse prevention strategies, with feedback and support from the dietitian. Participants who fail to complete their self-monitoring diaries as scheduled are queried about their progress relative to their weight loss and behavioral change goals and any barriers they have encountered in attaining those goals. They are strongly encouraged to monitor and continue with the intervention. At the discretion of the dietitian, participants may be phoned or seen to address outstanding issues related to poor understanding of and/or adherence to the intervention protocol.
PCP approval is required before potentially eligible patients are contacted by the study. Participants are carefully screened and individuals for whom the interventions would be medically inappropriate or unsafe are excluded. During screening, women who are pregnant, lactating, or planning to become pregnant during the study period are excluded. If a participant becomes pregnant during the study, she is excluded immediately from further participation in all study activities, and her PCP is immediately notified. Participants who develop any other exclusionary condition (e.g., diabetes) following randomization may continue with the interventions and follow-up assessments only after explicit approval of their PCP. Surveillance for adverse events and relevant clinical events occurs by questionnaire at regularly scheduled intervals. Positive responses trigger an adverse event record, which is reviewed by the study physician for seriousness, study relatedness, and expectedness within 72 hours. Similar information reported by participants at other times (e.g., during intervention encounters) is duly noted and followed up with as needed to assure participant safety. Participants will be referred to their PCP for a medical evaluation and follow-up as needed or recommended by the study physician.
Adherence and retention in E-LITE is fostered by: 1) selection/retention, training, and quality control of qualified staff; 2) the relationship between staff and participants, 3) willingness to accommodate participant schedules and needs, and 4) resourcefulness and persistence of the staff. A participant tracking database is used to assure that participants are contacted on a timely basis to obtain study data. The assessment staff will contact participants who miss a follow-up assessment to try re-engaging the patient in subsequent follow-ups. Ongoing monitoring of indices of participation in intervention activities helps interventionists identify participants who are having problems with adherence to the intervention protocol and thus qualify for recovery efforts. Such efforts can range from brief telephone discussion to an individualized counseling session with an interventionist in which the participant who makes a decision to discontinue intervention can review concerns regarding E-LITE, reasons for staying in E-LITE, and decisions about remaining a participant. Unless the participant declines, the interventionist will continue to contact the participant on a progressively less frequent schedule, starting monthly and decreasing to semi-annually to remind her/him of the opportunity to re-enter E-LITE and to maintain contact for possible recruitment for the final assessment at the end of E-LITE.
Sample Size Considerations and Statistical Analysis
Given the target sample size of 240, we expect approximately 80% power for detecting a net difference of 1/2 of a standard deviation (equivalent to a medium effect size of 0.5) in BMI at 15 months between the SM intervention and usual care (and similarly, between the CM intervention and usual care) at a 2-sided α level of 0.05, assuming up to a 20% rate of loss to follow-up. The effect size is estimated based on a number of successful lifestyle weight loss intervention studies [6, 18–20]. The power estimate was calculated based on a t-test using simplified assumptions. Note that the t-test calculation is conservative because it does not account for variance reduction due to adjustment for baseline variables, nor for the better than chance comparability of the experimental groups. The primary comparisons of each intervention with usual care will be conducted using two-sided procedures at the overall significant level of 0.05. Multiplicity adjustments are not necessary because the primary interest is to estimate separate treatment effects for a limited number (i.e., n = 2) of key contrasts that pertain to different interventions . Therefore, p-values of each comparison will be compared to type I error α = 0.05 for significance.
The primary hypothesis compares BMI between each intervention (SM and CM) and usual care at 15 months using an intent-to-treat analysis. Linear mixed modeling,
using SAS PROC MIXED  will test time and group interactions to asses whether within-subject change in BMI differs by condition. This basic analytical strategy also accounts for the nature of repeated measurements, the blocked design by cohorts, and the clustering of patients within physicians. The same analysis strategy is appropriate for evaluating secondary aims where the hypotheses are identical but with different outcome measures (e.g., glycemic control, other component risk factors of the metabolic syndrome, and psychosocial well-being). The longitudinal effects of the interventions will be assessed using the same model, except that the focus is comparisons within intervention groups at different time points. Analyses will also be conducted to examine whether there is a dose-response relationship between intervention adherence and outcome, where dose is defined in terms of number of group sessions attended, number of secure messages sent, number of self-monitoring logs, average daily intakes of calories and fat, and average number of minutes of physical activity per week.
For participants with missing outcomes at the primary (15-month) or secondary (3- and 6-month) assessment point, we will conduct and report on sensitivity analyses in which different imputation methods are used (e.g., the baseline-observation-carried-forward method, the "hot deck" procedure, and an appropriate multiple imputation method [55, 56].
M is a moderator of the effect of T on O if M precedes T, γ1 = 0, and β3 ≠ 0. M is a mediator of the effect of T on O if T precedes M, γ1 ≠ 0, and either β2 ≠ 0 or β3 ≠ 0.
All study data are entered into computerized data files utilizing: 1) Microsoft Access for participant tracking and intervention data entry, 2) Vovici's survey software (Dulles, VA) for self-administered questionnaires and entry of clinical measurements, 3) Food Processor, v8.7 (ESHA Research, Oregon) for nutrient analysis based on three-day food records, and 4) a custom-designed web application for seven-day physical activity recall data entry. Research assistants (blinded to treatment assignment) will review participant responses on questionnaires with participants present, and skipped or incorrectly addressed items will be brought to the participant to correct. All of the data entry systems employ automatic, real-time range, logic, and missing value checks. Data sets will be cleaned, verified and archived, and then read into SAS (Enterprise Guide 4.1; SAS Institute, Cary, NC) data sets, which also are archived. One official copy of all the study data and a master data dictionary are maintained and updated regularly by the study data analyst. All analytic and tracking database files are stored in a secure network drive with daily backups. One copy of the backups is saved on-site and one off-site. Separate archival databases are permanently maintained. The data files can be shared by authorized study personnel both on-site and in remote locations via a secure virtual private network. Multiple levels of password protection are utilized to ensure data security.
Intervention quality assurance procedures ensure that project activities are standardized across the interventionists and across the cohorts and that intervention process data are collected accurately. To achieve this, standardized protocols, procedures, and educational materials are prepared, and staff are systematically trained in their use. Provider and auditor checklists are created to ensure that the intervention protocols are followed and that treatment objectives for each group session are met. Interventionists complete a Provider Checklist after each session. A random sample of 10% of group sessions will be observed and rated by a qualified individual using the Auditor Checklist. When a session is reviewed with less than 85% of treatment-specific objectives met, the auditor will inform the PI who will remediate interventionist training as needed. This process continues through all treatment waves so that interventionist drift can be swiftly and consistently corrected.
The U.S. health care system has evolved primarily to react to acute episodes of patient illness, and it remains largely so even though chronic disease that is largely preventable through lifestyle and behavior change has increasingly dominated patient demands and health care expenditures since the middle of the last century . The enormous clinical consequences of obesity demand that our health care system resolutely take on the mission of obesity and risk factor management and integrate this task into routine clinical care. Obese patients with pre-diabetes and/or metabolic syndrome are a critical group because of their increased lifetime risk for diabetes and CVD and the potential reversibility of their condition. Yet current systems of care often fail to intervene when prevention is still possible, responding only after irreversible adverse events have occurred . The standard clinical approach of delivering lifestyle modifications not only lacks in the frequency and intensity of contact to effect much change but is also missing a solid theoretical basis and behavioral self-management focus.
Efficacy trials such as the DPP  have shown that intensive individual lifestyle intervention results in significant weight loss and reduces the risks of type 2 diabetes and the metabolic syndrome. For intensive lifestyle interventions proven efficacious in the research setting to be successfully translated into routine clinical use, however, alternative mechanisms of delivery must be sought that are both scalable to the large, growing population of obese or overweight patients with additional risk factors and sustainable to provide ongoing patient self-management support and monitoring.
E-LITE is a randomized clinical trial aimed at rigorously evaluating the feasibility and potential effectiveness of translating two lifestyle interventions into ongoing care of overweight or obese adults with pre-diabetes and/or metabolic syndrome in a primary care practice. Studies of integrating the DPP lifestyle intervention to primary care settings are limited and few have used a randomized design [11, 14, 15]. In E-LITE, a DPP-based curriculum will be delivered in a self-guided DVD or in small groups, plus ongoing individual counseling via secure online messaging. Self-guided educational materials, group counseling, and secure messaging are modalities in use in contemporary health care systems. In addition to utilizing these potentially cost-effective means of delivering the intervention, the E-LITE study is designed and implemented with close attention to existing resources, skills, and barriers of the clinical setting in order to enhance its generalizability and sustainability. For example, we will recruit from an actual patient population in the clinic. We use data already available in the electronic health record to first identify an enriched pool of potentially eligible patients and then adopt a physician referral approach to promote safety and to facilitate integration of the intervention with primary care. Furthermore, we utilize well-trained non-physician clinicians (e.g., registered dietitians) who are already in the health care workforce to deliver the interventions, which will help address commonly cited barriers to primary care-based lifestyle programs in terms of physician time commitment and training. Finally, secure messaging is integrated with the electronic health record and all communications between the interventionist and the patient are viewable by the patient's PCP, which allows for integration of the intervention into ongoing care. Also, if proven successful, secure messaging would help address the need for ongoing, long-term support -- one of the greatest challenges of maintaining healthy lifestyles -- in primary care practice. With the advent of electronic health record systems and associated communication modalities, such population-based lifestyle interventions are a realistic possibility in the primary care setting.
Results from the E-LITE study will provide objective evidence on the extent of reductions in BMI and related cardiometabolic risk factors from two comprehensive, evidence-based lifestyle interventions of varying intensity that could be implemented as part of routine health care. We will also assess the potential reach, cost effectiveness, adoption, implementation, and maintenance of the interventions.
The project described was supported by grant R34DK080878 from the National Institute of Diabetes and Digestive and Kidney Diseases and a Scientist Development Grant award from the American Heart Association. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institute of Diabetes and Digestive and Kidney Diseases or the American Heart Association. The authors would like to acknowledge the Diabetes Prevention Support Center of the University of Pittsburgh Diabetes Institute for development of and the training and support for implementation and maintenance of the Group Lifestyle Balance program.
- Centers for Disease Control and Prevention: National diabetes fact sheet: general information and national estimates on diabetes in the United States, 2007. 2008, Atlanta, GA: U.S. Department of Health and Human Services, Centers for Disease Control and PreventionGoogle Scholar
- Boyle JP, Honeycutt AA, Narayan KM, Hoerger TJ, Geiss LS, Chen H, Thompson TJ: Projection of diabetes burden through impact of changing demography and disease prevalence in the U.S. Diabetes Care. 2050, 24: 1936-1940. 10.2337/diacare.24.11.1936.View ArticleGoogle Scholar
- Must A, Spadano J, Coakley EH, Field AE, Colditz G, Dietz WH: The disease burden associated with overweight and obesity. Jama. 1999, 282: 1523-1529. 10.1001/jama.282.16.1523.View ArticlePubMedGoogle Scholar
- Ogden CL, Carroll MD, Curtin LR, McDowell MA, Tabak CJ, Flegal KM: Prevalence of overweight and obesity in the United States, 1999-2004. Jama. 2006, 295: 1549-1555. 10.1001/jama.295.13.1549.View ArticlePubMedGoogle Scholar
- Grundy SM, Cleeman JI, Daniels SR, Donato KA, Eckel RH, Franklin BA, Gordon DJ, Krauss RM, Savage PJ, Smith SC, et al: Diagnosis and management of the metabolic syndrome: an American Heart Association/National Heart, Lung, and Blood Institute Scientific Statement. Circulation. 2005, 112: 2735-2752. 10.1161/CIRCULATIONAHA.105.169404.View ArticlePubMedGoogle Scholar
- Knowler WC, Barrett-Connor E, Fowler SE, Hamman RF, Lachin JM, Walker EA, Nathan DM: Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin. N Engl J Med. 2002, 346: 393-403. 10.1056/NEJMoa012512.View ArticlePubMedGoogle Scholar
- DPP: The Diabetes Prevention Program (DPP): description of lifestyle intervention. Diabetes Care. 2002, 25: 2165-2171. 10.2337/diacare.25.12.2165.View ArticleGoogle Scholar
- The Diabetes Prevention Program Research Group: Within-trial cost-effectiveness of lifestyle intervention or metformin for the primary prevention of type 2 diabetes. Diabetes Care. 2003, 26: 2518-2523. 10.2337/diacare.26.9.2518.View ArticlePubMed CentralGoogle Scholar
- Herman WH, Hoerger TJ, Brandle M, Hicks K, Sorensen S, Zhang P, Hamman RF, Ackermann RT, Engelgau MM, Ratner RE: The cost-effectiveness of lifestyle modification or metformin in preventing type 2 diabetes in adults with impaired glucose tolerance. Ann Intern Med. 2005, 142: 323-332.View ArticlePubMedPubMed CentralGoogle Scholar
- Ackermann RT, Finch EA, Brizendine E, Zhou H, Marrero DG: Translating the Diabetes Prevention Program into the community. The DEPLOY Pilot Study. Am J Prev Med. 2008, 35: 357-363. 10.1016/j.amepre.2008.06.035.View ArticlePubMedPubMed CentralGoogle Scholar
- Amundson HA, Butcher MK, Gohdes D, Hall TO, Harwell TS, Helgerson SD, Vanderwood KK: Translating the diabetes prevention program into practice in the general community: findings from the Montana Cardiovascular Disease and Diabetes Prevention Program. Diabetes Educ. 2009, 35: 209-210. 10.1177/0145721709333269. 213-204, 216-220 passim.View ArticlePubMedGoogle Scholar
- Boltri JM, Davis-Smith YM, Seale JP, Shellenberger S, Okosun IS, Cornelius ME: Diabetes prevention in a faith-based setting: results of translational research. J Public Health Manag Pract. 2008, 14: 29-32.View ArticlePubMedGoogle Scholar
- Kramer MK, Kriska AM, Venditti EM, Miller RG, Brooks MM, Burke LE, Siminerio LM, Solano FX, Orchard TJ: Translating the Diabetes Prevention Program: A Comprehensive Model for Prevention Training and Program Delivery. Am J Prev Med. 2009.Google Scholar
- Seidel MC, Powell RO, Zgibor JC, Siminerio LM, Piatt GA: Translating the Diabetes Prevention Program into an urban medically underserved community: a nonrandomized prospective intervention study. Diabetes Care. 2008, 31: 684-689. 10.2337/dc07-1869.View ArticlePubMedGoogle Scholar
- McTigue KM, Conroy MB, Bigi L, Murphy C, McNeil M: Weight loss through living well: translating an effective lifestyle intervention into clinical practice. Diabetes Educ. 2009, 35: 199-204. 10.1177/0145721709332815. 208.View ArticlePubMedGoogle Scholar
- Kingsley RG, Wilson GT: Behavior therapy for obesity: a comparative investigation of long-term efficacy. J Consult Clin Psychol. 1977, 45: 288-298. 10.1037/0022-006X.45.2.288.View ArticlePubMedGoogle Scholar
- Renjilian DA, Perri MG, Nezu AM, McKelvey WF, Shermer RL, Anton SD: Individual versus group therapy for obesity: effects of matching participants to their treatment preferences. J Consult Clin Psychol. 2001, 69: 717-721. 10.1037/0022-006X.69.4.717.View ArticlePubMedGoogle Scholar
- Tate DF, Jackvony EH, Wing RR: A randomized trial comparing human e-mail counseling, computer-automated tailored counseling, and no counseling in an Internet weight loss program. Arch Intern Med. 2006, 166: 1620-1625. 10.1001/archinte.166.15.1620.View ArticlePubMedGoogle Scholar
- Tate DF, Wing RR, Winett RA: Using Internet technology to deliver a behavioral weight loss program. JAMA. 2001, 285: 1172-1177. 10.1001/jama.285.9.1172.View ArticlePubMedGoogle Scholar
- Wing RR, Tate DF, Gorin AA, Raynor HA, Fava JL: A self-regulation program for maintenance of weight loss. N Engl J Med. 2006, 355: 1563-1571. 10.1056/NEJMoa061883.View ArticlePubMedGoogle Scholar
- Tate DF, Jackvony EH, Wing RR: Effects of Internet behavioral counseling on weight loss in adults at risk for type 2 diabetes: a randomized trial. Jama. 2003, 289: 1833-1836. 10.1001/jama.289.14.1833.View ArticlePubMedGoogle Scholar
- Ma J, Urizar GG, Alehegn T, Stafford RS: Diet and physical activity counseling during ambulatory care visits in the United States. Prev Med. 2004, 39: 815-822. 10.1016/j.ypmed.2004.03.006.View ArticlePubMedGoogle Scholar
- Ma J, Xiao L, Stafford RS: Adult Obesity and Office-based Quality of Care in the United States. Obesity (Silver Spring). 2009, 17: 1077-1085. 10.1038/oby.2008.653.View ArticleGoogle Scholar
- Blair SN, Haskell WL, Ho P, Paffenbarger RS, Vranizan KM, Farquhar JW, Wood PD: Assessment of habitual physical activity by a seven-day recall in a community survey and controlled experiments. Am J Epidemiol. 1985, 122: 794-804.PubMedGoogle Scholar
- Rose G, McCartney P, Reid DD: Self-administration of a questionnaire on chest pain and intermittent claudication. Br J Prev Soc Med. 1977, 31: 42-48.PubMedPubMed CentralGoogle Scholar
- Pocock SJ: Clinical Trials, A Practical Approach. 1991, Chichester: John Wiley and SonsGoogle Scholar
- Efron B: Forcing sequential experiment to be balanced. Biometrika. 1971, 58: 403-417. 10.1093/biomet/58.3.403.View ArticleGoogle Scholar
- Friedewald W, Levy R, Fredrickson D: Estimation of the concentration of low-density lipoprotein cholesterol in plasma, with use of the preparative ultracentrifuge. Clinical Chemistry. 1972, 18: 499-502.PubMedGoogle Scholar
- NHLBI: Practical Guide to the Identification, Evaluation and Treatment of Overweight and Obesity in Adults. 2000, Bethesda, MD: Public Health Service, U.S. Department of Health and Human ServicesGoogle Scholar
- Pickering TG, Hall JE, Appel LJ, Falkner BE, Graves J, Hill MN, Jones DW, Kurtz T, Sheps SG, Roccella EJ: Recommendations for blood pressure measurement in humans and experimental animals: Part 1: blood pressure measurement in humans: a statement for professionals from the Subcommittee of Professional and Public Education of the American Heart Association Council on High Blood Pressure Research. Hypertension. 2005, 45: 142-161.View ArticlePubMedGoogle Scholar
- Ware J, Kosinski M, Keller SD: A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996, 34: 220-233. 10.1097/00005650-199603000-00003.View ArticlePubMedGoogle Scholar
- Karlsson J, Taft C, Sjostrom L, Torgerson JS, Sullivan M: Psychosocial functioning in the obese before and after weight reduction: construct validity and responsiveness of the Obesity-related Problems scale. Int J Obes Relat Metab Disord. 2003, 27: 617-630. 10.1038/sj.ijo.0802272.View ArticlePubMedGoogle Scholar
- Spitzer RL, Kroenke K, Williams JB: Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA. 1999, 282: 1737-1744. 10.1001/jama.282.18.1737.View ArticlePubMedGoogle Scholar
- American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders. 1994, Washington, D.C.: American Psychiatric Association, fourthGoogle Scholar
- Antony MM, Bieling PJ, Cox BJ, Enns MW, Swinson RP: Psychometric properties of the 42-item and 21-item versions of the Depression Anxiety Stress Scales (DASS) in clinical groups and a community sample. Psychological Assessment. 1998, 10: 176-181. 10.1037/1040-35220.127.116.11.View ArticleGoogle Scholar
- Block G: A review of validations of dietary assessment methods. Am J Epidemiol. 1982, 115: 492-505.PubMedGoogle Scholar
- Dunn AL, Marcus BH, Kampert JB, Garcia ME, Kohl HW, Blair SN: Reduction in cardiovascular disease risk factors: 6-month results from Project Active. Prev Med. 1997, 26: 883-892. 10.1006/pmed.1997.0218.View ArticlePubMedGoogle Scholar
- Young DR, Haskell WL, Taylor CB, Fortmann SP: Effect of community health education on physical activity knowledge, attitudes, and behavior. The Stanford Five-City Project. Am J Epidemiol. 1996, 144: 264-274.View ArticlePubMedGoogle Scholar
- Sallis JF, Pinski RB, Grossman RM, Patterson TL, Nader PR: The development of self-efficacy scales for health-related diet and exercise behaviors. Heath Educ Res. 1988, 3: 283-292. 10.1093/her/3.3.283.View ArticleGoogle Scholar
- Sallis JF, Grossman RM, Pinski RB, Patterson TL, Nader PR: The development of scales to measure social support for diet and exercise behaviors. Prev Med. 1987, 16: 825-836. 10.1016/0091-7435(87)90022-3.View ArticlePubMedGoogle Scholar
- Venkatesh VV, Morris MG, Davis GB, Davis FD: User acceptance of information technology: toward a unified view. Mis Quarterly. 2003, 27: 425-478.Google Scholar
- Bandura A: Social Foundations of Thought and Action: A Social Cognitive Theory. 1986, Englewood Cliffs, N.J.: Prentice HallGoogle Scholar
- Prochaska JO, DiClemente CC: Stages and processes of self-change of smoking: toward an integrative model of change. J Consult Clin Psychol. 1983, 51: 390-395. 10.1037/0022-006X.51.3.390.View ArticlePubMedGoogle Scholar
- Bodenheimer T, Lorig K, Holman H, Grumbach K: Patient self-management of chronic disease in primary care. Jama. 2002, 288: 2469-2475. 10.1001/jama.288.19.2469.View ArticlePubMedGoogle Scholar
- Holman H, Lorig K: Patient self-management: a key to effectiveness and efficiency in care of chronic disease. Public Health Rep. 2004, 119: 239-243. 10.1016/j.phr.2004.04.002.View ArticlePubMedPubMed CentralGoogle Scholar
- Lorig KR, Holman H: Self-management education: history, definition, outcomes, and mechanisms. Ann Behav Med. 2003, 26: 1-7. 10.1207/S15324796ABM2601_01.View ArticlePubMedGoogle Scholar
- Winett RA, Tate DF, Anderson ES, Wojcik JR, Winett SG: Long-term weight gain prevention: a theoretically based Internet approach. Prev Med. 2005, 41: 629-641. 10.1016/j.ypmed.2004.12.005.View ArticlePubMedGoogle Scholar
- Physical Activity Guidelines for Americans. [http://www.health.gov/paguidelines/pdf/paguide.pdf]
- Haskell WL, Lee IM, Pate RR, Powell KE, Blair SN, Franklin BA, Macera CA, Heath GW, Thompson PD, Bauman A: Physical activity and public health: updated recommendation for adults from the American College of Sports Medicine and the American Heart Association. Circulation. 2007, 116: 1081-1093. 10.1161/CIRCULATIONAHA.107.185649.View ArticlePubMedGoogle Scholar
- Nelson ME, Rejeski WJ, Blair SN, Duncan PW, Judge JO, King AC, Macera CA, Castaneda-Sceppa C: Physical activity and public health in older adults: recommendation from the American College of Sports Medicine and the American Heart Association. Med Sci Sports Exer. 2007, 39: 1435-1445. 10.1249/mss.0b013e3180616aa2.View ArticleGoogle Scholar
- Hill JO, Wyatt HR: Role of physical activity in preventing and treating obesity. J Appl Physiol. 2005, 99: 765-770. 10.1152/japplphysiol.00137.2005.View ArticlePubMedGoogle Scholar
- Dietary Guidelines for Americans. [http://www.healthierus.gov/dietaryguidelines]
- Cook R, V F: Multiplicity Considerations in the Design and Analysis of Clinical Trials. Journal of the Royal Statistical Society, Series A. 1996, 159: 93-110.View ArticleGoogle Scholar
- Littell RC, Milliken GA: SAS System for Mixed Models. 1996, Cary, NC: SAS Institute IncGoogle Scholar
- Little RJA, Rubin DB: Statistical Analysis with Missing Data. 1987, New York: John Wiley & Sons, Inc.Google Scholar
- Mazumdar S, Liu KS, Houck PR, Reynolds CF: Intent-to-treat analysis for longitudinal clinical trials: coping with the challenge of missing values. J Psychiatr Res. 1999, 33: 87-95. 10.1016/S0022-3956(98)00058-2.View ArticlePubMedGoogle Scholar
- Kraemer HC, Kiernan M, Essex M, Kupfer DJ: How and why criteria defining moderators and mediators differ between the Baron & Kenny and MacArthur approaches. Health Psychol. 2008, 27: S101-108. 10.1037/0278-6133.27.2(Suppl.).S101.View ArticlePubMedPubMed CentralGoogle Scholar
- Hoffman C, Rice D, Sung HY: Persons with chronic conditions. Their prevalence and costs. Jama. 1996, 276: 1473-1479. 10.1001/jama.276.18.1473.View ArticlePubMedGoogle Scholar
- Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A: Improving chronic illness care: translating evidence into action. Health Aff (Millwood). 2001, 20: 64-78. 10.1377/hlthaff.20.6.64.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2296/10/71/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.