Economic evaluation of a lifestyle intervention in primary care to prevent type 2 diabetes mellitus and cardiovascular diseases: a randomized controlled trial
© van Wier et al.; licensee BioMed Central Ltd. 2013
Received: 25 September 2012
Accepted: 18 March 2013
Published: 4 April 2013
Cost-effectiveness studies of lifestyle interventions in people at risk for lifestyle-related diseases, addressing ‘real-world’ implementation, are needed. This study examines the cost-effectiveness of a primary care intervention from a societal perspective, compared with provision of health brochures, alongside a randomized controlled trial.
Adults aged 30-50 years, at risk of type 2 diabetes (T2DM) and/or cardiovascular disease (CVD), were recruited from twelve general practices in The Netherlands. They were randomized to the intervention (n = 314) or control group (n = 308). The intervention consisted of up to six face-to-face counseling sessions with a trained practice nurse, followed by three-monthly sessions by phone. Costs were collected using three-monthly retrospective questionnaires. Quality of life was measured with the EuroQol-5D-3L, at baseline, 6, 12 and 24 months. Nine-year risk of developing T2DM and ten-year risk of CVD mortality were estimated using the ARIC and SCORE formulae, respectively, based on measurements at baseline and 24 months while applying a fixed age of 60 years at both time points.
Small, statistically non-significant differences in effects were found between the intervention and control group with regard to risk scores and Quality Adjusted Life Years (QALYs) gained. The mean difference in costs between the intervention and control group was €-866 (95% confidence interval -2372; 370). The probability that the intervention was cost-effective varied from 93% at €8000/QALY to 88% at €80,000/QALY.
A primary care lifestyle intervention aimed at adults at increased risk of T2DM and/or CVD could result in cost savings over a two-year period. However, due to methodological uncertainty no advice can be given regarding the implementation of the intervention in Dutch general practices.
Current Controlled Trials ISRCTN59358434.
KeywordsCost-effectiveness Cost-utility General practitioner Lifestyle counseling Practice nurse
Worldwide an increased prevalence of type 2 diabetes (T2DM) has been noted over the last decades . A further rise is expected, due to an aging population and the high prevalence of obesity. The expected increase is not only a medical, but also a socioeconomic problem. In most countries health care costs are rapidly rising, and the obesity epidemic plays an important role in this process . Several studies have shown that the risk of developing T2DM and associated cardiovascular diseases (CVDs) reduces with weight loss and improved lifestyle behaviors . A recent review found evidence for the cost-effectiveness of diabetes prevention interventions . Nevertheless, as these interventions have been studied under strictly controlled conditions, there remains a need for cost-effectiveness studies of interventions addressing ‘real-world’ settings. Information about the tradeoff between costs and benefits of these interventions will help policy makers to decide whether it is efficient to implement and reimburse them.
In the Netherlands, a theory-based primary care intervention aimed at reducing the risk of T2DM and CVD was developed and tested in general practices using a randomized controlled trial (RCT) design . The purpose of the current study is to assess the cost-utility and cost-effectiveness of the intervention in reducing the risk for developing T2DM and CVD, compared with the provision of health brochures. The primary outcome of the study is the number of Quality Adjusted Life Years (QALYs) gained. Secondary outcomes are changes in estimated risk of developing T2DM in the following 9 years and of CVD mortality in the following 10 years. These outcomes are assessed within the two year trial period.
Design of the study
An economic evaluation was conducted alongside a RCT, the Hoorn Prevention Study, carried out in the Netherlands from 2008 to 2010. The economic evaluation was performed from a societal perspective. Details of the study design, the recruitment results and the implementation of the intervention have been published elsewhere [5, 6]. The study design and informed consent procedure were approved by the Medical Ethics Committee of the VU University Medical Center and all participants provided written informed consent.
Study population and setting
Intervention and control
Both groups received care as usual, e.g. prescription of medication in the case of severe hypertension. Additionally, an intervention based on cognitive behavioral principles was offered to the intervention group. The intervention was aimed at improving physical activity, diet or smoking behavior, as chosen by the participants. It consisted of up to six monthly individual 30-minute face-to-face counseling sessions, followed by three-monthly 15-minute sessions by phone. Counseling was done by eight practice nurses, who received 18 hours of training prior to the intervention. Feedback on the quality of counseling was provided to the practice nurses halfway through the sessions and consisted of one hour individual coaching. Also, a peer supervision meeting was arranged. A full description of the intervention and its underlying principles has been published elsewhere .
The control group received existing brochures containing health guidelines regarding physical activity and a healthy diet, obtained from the Dutch Heart Foundation. Smokers received an additional brochure on how to stop smoking from the Dutch expertise center for tobacco discouragement policies (STIVORO). An independent administrative assistant sent the brochures to the participants.
Clinical outcome measures
For the cost-utility analysis, the EuroQol-5D with three levels for each of the five health dimensions (EQ-5D-3L) was used to assess quality of life at baseline, and at 6, 12 and 24 month follow-up . Health utilities were estimated with the Dutch tariff . QALYs were calculated by multiplying the utilities with the amount of time a participant spent in a particular health state. Transitions between health states were linearly interpolated.
Outcome measures of the cost-effectiveness analyses were the estimated risk of developing T2DM and the estimated risk of CVD mortality. The 9-year risk of developing T2DM was estimated with the risk formula derived from the Atherosclerosis Risk In Communities (ARIC) Study, based on ethnicity, parental history of diabetes, systolic blood pressure, waist circumference, and height . This formula was selected because of its potential applicability in primary care, since it includes only non-invasive methods to assess participants’ T2DM risk. The 10-year risk of CVD mortality was estimated with the formula developed by the Systematic COronary Risk Evaluation (SCORE) project  which includes sex, smoking status, total cholesterol, and systolic blood pressure. The application of the SCORE formula was considered to be the most useful for the calculation of CVD mortality risk. Former comparative analyses of the SCORE, the Framingham and the UKPDS formulae demonstrated that the Framingham function may overestimate an individual’s absolute chronic heart disease risk, and the UKPDS formula was not chosen based on its specific inclusion of T2DM as variable . Baseline risks and follow-up risks were estimated while standardizing the age of each participant at 60 years. The formulas and the estimated risks are further explained in Additional file 1. Data was collected by means of physical measurements and questionnaires. A detailed description of the data collection has previously been published .
Information on health care utilization, medication costs, participant costs and productivity loss was obtained through eight retrospective three-month questionnaires provided to the participants between baseline and 24-month follow-up.
Health care utilization consisted of general practitioner care, allied health care, medical specialist care and hospitalization . Participants’ costs concerned complementary care, over-the-counter (OTC) medication, and costs associated with improving physical activity, such as sports club memberships and sports equipment. Health care utilization and complementary care were valued with Dutch standard costs. When these were not available, prices reported by professional associations were used. The costs of prescribed medication were calculated using prices charged by the Royal Dutch Society for Pharmacy . Costs of OTC medication and sports were reported by the participants. Costs of productivity losses based on self-reported sick leave from work were estimated with the friction cost approach (friction period 154 calendar days and an elasticity of 0.8), using the mean income of the Dutch population according to age and gender . Cost categories and prices used in the economic evaluation can be found in Additional file 2. Prices were adjusted to the year 2008 (the year of the first measurement) using consumer price indices . In the base case analysis no discounting was done for the costs in the second year. The effect of discounting was however explored in a sensitivity analysis.
Bottom-up micro-costing was used to estimate intervention costs. These consisted of a sum of fixed costs and variable costs. The fixed costs covered costs of the development and printing of materials, training and supervision of the practice nurses, and of costs for selecting and inviting the participants. Of the 207,000 inhabitants in the region, around 27% is between 30 and 50 years old. Of these 56,000 people, about one-fifth is expected to be eligible and willing to participate. Development costs were therefore spread over 10,000 patients. Total fixed costs per participant were €15. Variable costs per participant consisted of counseling costs. These were calculated based on the number of face-to-face contacts and telephone contacts that took place as reported by the practice nurse. The cost price of a face-to-face session was €24, and of a phone session €12.
Analyses were based on group allocation, regardless of actual intervention received or of adherence to the intervention (i.e. intention-to-treat). In the base case analysis it was assumed that when data on follow-up telephone sessions were missing, no sessions had taken place and the missing data were imputed with zero. The reason for doing so was that many practice nurses failed to report the number of follow-up phone contacts they had with a particular participant. It seems fair to assume that this was because none took place. Missing number of face-to-face contacts, health care costs, participant costs, sick leave days and clinical outcomes were imputed using multiple imputation techniques . The imputation model included age, sex, educational level, smoking status, living alone yes/no, baseline outcome values, available midpoint (6 and 12 months) and follow-up outcome values, and available number of face-to-face and phone sessions, health care costs, participant costs and sick leave days at each measurement. Imputations were done separately for the intervention and control group. Five different data sets were created in SPSS (version 17.0.2, Chicago, Ill) using Fully Conditional Specification and Predictive Mean Matching procedures, assuming that data were missing at random . These data sets were analyzed as specified below. The estimates were pooled with methods described by Rubin . This method does not allow for an estimation of standard deviations, so the standard error of the mean (SEM) is presented to describe variability.
Base case analysis
Costs and outcomes were estimated separately. Linear regression analysis (ordinary least squares) was used to compare outcomes between the intervention and control groups. Follow-up outcomes were adjusted for baseline values . To compare costs between groups, confidence intervals around the mean differences in costs were estimated using the bias-corrected and accelerated bootstrap method with 5000 replications. Incremental cost-effectiveness ratios (ICERs) were estimated by dividing the difference in total costs over 24 months between the treatment groups by the regression coefficient for treatment effect at 24 months. To graphically present uncertainty around the ratios, bias-corrected percentile bootstrapped cost-effect pairs (5000 replications) were plotted in cost-effectiveness planes (CE-planes) . The uncertainty of cost-effectiveness was presented in cost-effectiveness acceptability curves (CEACs) . Analyses were performed with R version 2.10.1 . Participants who developed CVD or T2DM during the study (n = 9) or became pregnant (n = 7), and participants who had died (n = 1) were excluded from all analyses.
Sensitivity analyses were conducted to test the robustness of the results. In the first sensitivity analysis the costs for the second year were discounted with 4% and QALYs achieved in this year were discounted with 1.5%, in line with Dutch guidelines . In the second sensitivity analysis the productivity losses were valued with the human capital method. In the third sensitivity analysis the costs for sports were excluded. In the fourth sensitivity analysis, missing data for follow-up phone calls (which in the base case analysis were assumed to be zero) were multiply imputed. For the fifth sensitivity analysis, 50 multiply imputed files were created, according to the rule of thumb that the number of imputed files should at least equal the fraction of incomplete cases . The sixth sensitivity analysis was restricted to participants with complete cost and effect data, i.e., complete case analysis (CCA). In the final sensitivity analysis, cost-effectiveness was assessed from the healthcare perspective.
Participant flow and baseline characteristics
The participant flow is presented in Figure 1. On average, 64% of the cost questionnaires were fully completed and returned. Data on the number of face-to-face and phone counseling sessions, necessary to calculate the intervention costs, were complete for, respectively, 291/314 (93%) and 177/314 (56%) participants. As a consequence, 36 to 44% of the cost data were imputed, as was 22 to 26% of the outcome data.
Baseline characteristics of all randomized participants
n = 308
n = 314
Female [n (%)]
Age [mean (SD), (years)]
Level of education [n(%)]a
≤ Primary education
Paid job [n (%) yes]b
Smoking [n (%) yes]a
T2DM risk [mean (SD)], %
CVD risk [mean (SD)]e, %
Health utility [mean (SD)]f
The mean number of face-to-face counseling sessions after multiple imputation was 2.4 (SEM 0.08). The mean number of follow-up phone sessions was 2.3 (SEM 0.2). The findings of our process evaluation indicate that practice nurses adhered to the intervention protocol and were reasonably competent and confident in the provision of the intervention .
QALYs achieved during the two-year period were 1.81 (SEM 0.01) in the control group, and 1.80 (SEM 0.02) in the intervention group. After adjustment for baseline utilities, the intervention group gained a statistically nonsignificant 0.02 (95% CI -0.02 to 0.05) more QALYs than the control group.
Both groups improved their risk of T2DM and CVD. Respectively, these reduced to 17.9% (SEM 0.5) and 3.6% (SEM 0.2) in the control group, and 18.5% (SEM 0.5) and 3.7% (SEM 0.2) in the intervention group. Only minimal and statistically non-significant differences were found between the groups. The intervention group experienced a relative increase in T2DM risk of 0.6% (95% CI -0.1 to 1.3) and a decrease in CVD risk of 0.1% (95% CI -0.4 to 0.2), compared with the control group.
Pooled costs and cost differences in Euros a between baseline and two year follow-up, after multiple imputation
Intervention versus control
N = 300
N = 305
Mean difference (95% CI)
Incremental cost-effectiveness ratios and distribution of the joint cost-effect pairs in the cost-effectiveness plane
Sample size per group
ΔC (95% CI)
ΔE (95% CI)
Distribution in cost-effectiveness plane (%)
T2DM risk f
Health care perspective
CVD risk g
Health care perspective
Health care perspective
The ICER of the 9-year risk for developing T2DM was -1416. Over the two year period, a €1416 saving was seen per 1% increase in risk for developing T2DM among the intervention participants as compared to those who received health brochures. The CE-plane showed that the majority (86%) of the cost-effectiveness pairs were located in the south-west quadrant, indicating that the intervention is likely to be less expensive, but also less effective than the alternative (Table 3). The CEAC for T2DM-risk (not presented) showed that the probability of cost-effectiveness at a ceiling ratio of €0 per one percent risk modification was 90%. The CEAC dropped when the amount that society is willing to pay or accept increased. Beyond a ceiling ratio of approximately €1500 per one percent risk change, the probability that health brochures are cost-effective is higher than the probability that the lifestyle intervention is cost-effective.
The ICER for the 10-risk of CVD mortality was 6405, meaning that a 1% lower risk as a result of the intervention is accompanied by a societal saving of €6405, compared with health brochures (Table 3). Cost-effectiveness pairs were mostly located (74%) in the south-east quadrant, indicative of higher effectiveness at lower cost (Table 3). The probability of cost-effectiveness for CVD-risk started at 90% at a ceiling ratio of €0 per one percent risk modification and fell slightly to 80% at a ceiling ratio of €10,000 per one percent risk modification (CEAC not presented).
The sensitivity analyses in which costs and QALYs were discounted, productivity losses were valued with the human capital method, the costs for sports were excluded from the participant costs, missing number of follow-up phone calls were multiply imputed, and 50 multiply imputed data sets were created and analyzed, showed similar results (Results shown in Additional file 3). The sensitivity analysis in which only participants with complete cost and effect data were included and the analysis from the healthcare perspective, gave different results (Table 3). In the complete case analysis the difference in societal costs virtually disappeared, but the differences in the clinical outcomes were similar to the main analysis. The CEAC showed that for risk of T2DM that the probability of cost-effectiveness at a ceiling ratio of €0 was 50%. The CEAC for risk of CVD was around 50% at all ceiling ratios. With regard to QALYs gained, the maximum probability of cost-utility compared with health brochures was 45% at a ceiling ratio of €0/QALY, 75% at €80,000/QALY and converged to 77% at €100,000/QALY.
In the analysis from the healthcare perspective, the cost difference between the groups reduced to €-5. For all outcomes, the probability of cost-effectiveness was around 50% at a ceiling ratio of €0. For T2DM the probability decreased as willingness to pay increased, whereas for CVD it increased to nearly 70% at €10,000 per 1% change. Probability of cost-utility was about 80% from €25,000/QALY upwards, converging to 85% at the maximum willingness to pay.
This study examined the cost-effectiveness of a primary care intervention to prevent T2DM and CVD from a societal perspective, compared with provision of health brochures. Small, statistically non-significant differences in risk scores and QALYs gained were found between the intervention and comparison group. The mean difference in costs was €-866 (95% CI -2372 to 370). The probability of cost-effectiveness for health risk modification was 90% at a ceiling ratio of €0. Increasing the ceiling ratio resulted in a slight drop in the probability of cost-effectiveness for risk of CVD, but severely for risk of T2DM. The probability of cost-utility of the intervention, compared with the brochures group, was around 90% at all ceiling ratios. The results were confirmed in the sensitivity analyses, except in the complete case analysis. This showed that the intervention was not more likely to be cost-effective for reducing health risks than provision with health brochures. Furthermore, the probability of cost-utility reduced to a maximum of 77%.
The results indicate that there were no statistically significant differences between the intervention and control group with regard to the clinical outcomes. Baseline health utilities were already high, which implied that there was little room for improvement in QALYs gained. High baseline utilities and lack of improvement might be related to the use of the EQ-5D-3L to measure health status. This instrument is known for its ceiling effects in relatively healthy populations. Other instruments, such as the recently developed EQ-5D-5L might resolve this problem, but this is still under research . Lack of differential effect on risk profile could be related to the low attendance to the counseling sessions. On average only 2.4 of the 6 available face-to-face counseling sessions had taken place, whereas the mean use of the 3-monthly phone-calls was 2.3. These results underscore the difficulties in translating efficacious methods to interventions that are feasible and effective in real-world settings.
Cost-differences were in favor of the intervention albeit statistically not significant. Due to the skewed nature of the cost data, the study may have been underpowered to reach statistical significance for cost differences. The difference in total costs was mostly explained by differences in costs of productivity losses. To explore the effect of outliers on these costs, a post-hoc analysis was done. In this, the number of sick leave days was truncated at 30 days, as it is improbable that sick leave over 30 days would have been influenced by the intervention. The cost difference reduced to €-179 (95% CI -725 to 311). However, a reduction in societal costs remained.
To our knowledge, no other studies of lifestyle interventions to prevent T2DM or CVD have found immediate cost reductions as a consequence of the program, in the absence of health effects . Some researchers have suggested that health promotion programs have non-health benefits that are currently not measured, such as increased health literacy . These benefits may have a direct influence on health care use and sickness absenteeism . The reduction in costs of personal expenses, mainly consisting of sports costs, is puzzling. Because the intervention participants were stimulated to be more physically active, higher costs were expected. All in all, the finding of possible cost savings in favor of the intervention cannot be easily explained.
The main aim of an economic evaluation is to decide whether the treatment under scrutiny offers value for money. Ceiling ratios for reductions in risk of CVD or T2DM are not determined. The ceiling ratio for QALYs gained in the Netherlands is also not established, but it has been proposed to be set at €8000 for diseases with a low burden and at €80,000 for diseases with a high burden . The immediate burden of disease of an elevated risk for T2DM and CVD is unknown, but likely lies at the lower end of the range. At a ceiling ratio of €8,000 per QALY gained, the probability of cost-utility of the intervention was 93%. At the higher end, probability of cost-utility was 89% at a ceiling ratio of €80,000 per QALY gained. The intervention therefore has a high probability of cost-utility at all acceptable ceiling ratios. However, there is methodological uncertainty regarding this probability. The complete case analyses showed that the probability that the true cost-utility ratio falls below €80,000 is 75%. The analysis from the health care perspective also showed a lower probability of cost-effectiveness. The post-hoc analysis in which the number of sick leave days was truncated at 30 days, showed a maximum probability of 70% at a ceiling ratio of €0. Thus, in these sensitivity analyses, cost-utility results were less positive. Furthermore, people generally demand larger compensations for losses compared with how much they are willing to pay for gains (willingness to pay < willingness to accept). If this aversion to loss is applicable to losses in health, a lower probability of cost-utility would have been found . Finally, as explained before, questions remain about the cause of the cost-differences. In light of these uncertainties, it is unsure if the possible benefits outweigh the efforts involved in the implementation of this new intervention.
Limitations and strengths
A limitation of the study is the amount of incomplete cost data. Intervention costs were missing for 140/314 (45%) participants, mainly because the practice nurses failed to report the number of phone sessions to the research team. However, a more complete report may be difficult to achieve in real-world settings. In addition, 36% of the self-reported data on health care utilization, personal spending and sick leave was missing. This is comparable to other RCTs in the Netherlands with a follow-up of one year or longer [32, 33]. Studies in the Netherlands that need individual data on health care use have to rely on self-report because it is not feasible to collect these data from health insurers. Nevertheless, methods to improve data-completeness in studies with many self-reported cost-measurements should be devised to increase the internal validity of these studies.
Over one-third of all cost data were imputed, using multiple imputation techniques. In multiple imputation it is assumed that unobserved data are (in part) dependant on the observed data (e.g. available costs). However, this assumption cannot be fully tested. Although methodological studies show that multiple imputation is preferred over complete case analyses and simple imputation methods results from this study should be treated with some caution.
The use of ‘projected’ risk scores for T2DM and CVD was useful to accentuate absolute risk, but should not be considered as current absolute risk. For both risk scores and for each participant, age was extrapolated to 60 years while all other variables in the risk scores (e.g. blood pressure or cholesterol) were absolute scores. Thus, the scores estimated the risk of participants as if they were 60 years old, but with current values.
Lastly, the time horizon of the study was too short to observe the development of T2DM or CVDs, and to measure their associated changes in QALYs achieved. Decision modeling could be used to extend the time horizon of the study. This would give more insight in the longer term cost-effectiveness, and would increase the comparability of the results to those from other studies. Decision modeling also has the advantage that the results of similar interventions could be included, thereby broadening the evidence base . This would however have to be done in a separate study.
Strengths of the study include the relatively long-term follow-up in terms of intermediate outcomes, the use of multiple imputation to address the large amount of missing cost data, the use of both the friction cost approach and the human capital approach to value productivity losses, and the application of a randomized controlled design in a real-world setting.
The lifestyle program offered by practice nurses to adults at risk for T2DM and CVD was not more effective in reducing these risks than the provision of general health brochures. However, the intervention appeared to result in short-term cost savings. A high probability of cost-utility was found at all ceiling ratios. Nevertheless, due to methodological uncertainty no advice can be given regarding the implementation of the intervention in Dutch general practices.
The study was funded by the Netherlands Organization for Health Research and Development (project number: 62300041).
- van Dieren S, Beulens JW, van der Schouw YT, Grobbee DE, Neal B: The global burden of diabetes and its complications: an emerging pandemic. Eur J Cardiovasc Prev Rehabil. 2010, 17 (Suppl 1): S3-S8.View ArticlePubMed
- Wang YC, McPherson K, Marsh T, Gortmaker SL, Brown M: Health and economic burden of the projected obesity trends in the USA and the UK. Lancet. 2011, 378: 815-825. 10.1016/S0140-6736(11)60814-3.View ArticlePubMed
- Horton ES: Effects of lifestyle changes to reduce risks of diabetes and associated cardiovascular risks: results from large scale efficacy trials. Obesity (Silver Spring). 2009, 17 (Suppl 3): S43-S48.View Article
- Li R, Zhang P, Barker LE, Chowdhury FM, Zhang X: Cost-effectiveness of interventions to prevent and control diabetes mellitus: a systematic review. Diabetes Care. 2010, 33: 1872-1894. 10.2337/dc10-0843.PubMed CentralView ArticlePubMed
- Lakerveld J, Bot SD, Chinapaw MJ, van Tulder MW, van Oppen P, Dekker JM: Primary prevention of diabetes mellitus type 2 and cardiovascular diseases using a cognitive behavior program aimed at lifestyle changes in people at risk: design of a randomized controlled trial. BMC Endocr Disord. 2008, 8: 6-10.1186/1472-6823-8-6.PubMed CentralView ArticlePubMed
- Lakerveld J, Bot S, Chinapaw M, van Tulder M, Kingo L, Nijpels G: Process evaluation of a lifestyle intervention to prevent diabetes and cardiovascular diseases in primary care. Health Promot Pract. 2012, 13: 696-706. 10.1177/1524839912437366.View ArticlePubMed
- Klein S, Allison DB, Heymsfield SB, Kelley DE, Leibel RL, Nonas C: Waist circumference and cardiometabolic risk: a consensus statement from shaping America’s health: association for weight management and obesity prevention; NAASO, the obesity society; the American society for nutrition; and the American diabetes association. Obesity (Silver Spring). 2007, 15: 1061-1067. 10.1038/oby.2007.632.View Article
- Balkau B, Deanfield JE, Despres JP, Bassand JP, Fox KA, Smith SC: International Day for the evaluation of abdominal obesity (IDEA): a study of waist circumference, cardiovascular disease, and diabetes mellitus in 168,000 primary care patients in 63 countries. Circulation. 2007, 116: 1942-1951. 10.1161/CIRCULATIONAHA.106.676379.PubMed CentralView ArticlePubMed
- Conroy RM, Pyorala K, Fitzgerald AP, Sans S, Menotti A, De BG: Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. Eur Heart J. 2003, 24: 987-1003. 10.1016/S0195-668X(03)00114-3.View ArticlePubMed
- EuroQol Group: EuroQol-a new facility for the measurement of health-related quality of life. Health Policy. 1990, 16: 199-208.
- Lamers LM, Stalmeier PF, McDonnell J, Krabbe PF, van Busschbach JJ: Measuring the quality of life in economic evaluations: the Dutch EQ-5D tariff. Ned Tijdschr Geneeskd. 2005, 149: 1574-1578.PubMed
- Schmidt MI, Duncan BB, Bang H, Pankow JS, Ballantyne CM, Golden SH: Identifying individuals at high risk for diabetes: the atherosclerosis risk in communities study. Diabetes Care. 2005, 28: 2013-2018. 10.2337/diacare.28.8.2013.View ArticlePubMed
- van der Heijden AA, Ortegon MM, Niessen LW, Nijpels G, Dekker JM: Prediction of coronary heart disease risk in a general, pre-diabetic, and diabetic population during 10 years of follow-up: accuracy of the Framingham, SCORE, and UKPDS risk functions: the Hoorn study. Diabetes Care. 2009, 32: 2094-2098. 10.2337/dc09-0745.PubMed CentralView ArticlePubMed
- Oostenbrink JB, Bouwmans CAM, Koopmanschap MA, Rutten FFH: Dutch manual for costing: methods and standard costs for economic evaluations in health care. 2004, Diemen, The Netherlands: Dutch Health Care Insurance Board
- Z-Index: G-standaard [G-standard]. 2006, The Hague: The Netherlands, Z-Index
- Statistics Netherlands: Consumer price indices. 2011, Netherlands: Statistics Netherlands
- Van Buuren S, Boshuizen HC, Knook DL: Multiple imputation of missing blood pressure covariates in survival analysis. Stat Med. 1999, 18: 681-694. 10.1002/(SICI)1097-0258(19990330)18:6<681::AID-SIM71>3.0.CO;2-R.View ArticlePubMed
- Van Buuren S: Multiple imputation of discrete and continuous data by fully conditional specification. Stat Methods Med Res. 2007, 16: 219-242. 10.1177/0962280206074463.View ArticlePubMed
- Rubin DB: Multiple imputation for nonresponse in surveys. 1987, New York: J. Wiley & SonsView Article
- Twisk J, Proper K: Evaluation of the results of a randomized controlled trial: how to define changes between baseline and follow-up. J Clin Epidemiol. 2004, 57: 223-228. 10.1016/j.jclinepi.2003.07.009.View ArticlePubMed
- Black WC: The CE plane: a graphic representation of cost-effectiveness. Med Decis Making. 1990, 10: 212-214. 10.1177/0272989X9001000308.View ArticlePubMed
- Fenwick E, Marshall DA, Levy AR, Nichol G: Using and interpreting cost-effectiveness acceptability curves: an example using data from a trial of management strategies for atrial fibrillation. BMC Health Serv Res. 2006, 6: 52-10.1186/1472-6963-6-52.PubMed CentralView ArticlePubMed
- R Development Core Team: R: A language and environment for statistical computing. 2008, Vienna, Austria: R Foundation for Statistical Computing
- Rodenburg-van Dieten HEM: Guidelines for pharmacoeconomic research; evaluation and update. 24088606. 2005, Diemen, The Netherlands: Dutch Health Care Insurance Board
- White IR, Royston P, Wood AM: Multiple imputation using chained equations: issues and guidance for practice. Stat Med. 2011, 30: 377-399. 10.1002/sim.4067.View ArticlePubMed
- Fenwick E, O’Brien BJ, Briggs A: Cost-effectiveness acceptability curves–facts, fallacies and frequently asked questions. Health Econ. 2004, 13: 405-415. 10.1002/hec.903.View ArticlePubMed
- Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D: Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011, 20: 1727-1736. 10.1007/s11136-011-9903-x.PubMed CentralView ArticlePubMed
- Peerson A, Saunders M: Health literacy revisited: what do we mean and why does it matter?. Health Promot Int. 2009, 24: 285-296. 10.1093/heapro/dap014.View ArticlePubMed
- Eichler K, Wieser S, Brugger U: The costs of limited health literacy: a systematic review. Int J Public Health. 2009, 54: 313-324. 10.1007/s00038-009-0058-2.PubMed CentralView ArticlePubMed
- Dutch Council for Public Health and Health Care: Zinnige en duurzame zorg [Sensible and sustainable care]. 2006, Zoetermeer, The Netherlands: Raad voor Volksgezondheid en Zorg
- Severens JL, Brunenberg DE, Fenwick EA, O’Brien B, Joore MA: Cost-effectiveness acceptability curves and a reluctance to lose. PharmacoEconomics. 2005, 23: 1207-1214. 10.2165/00019053-200523120-00005.View ArticlePubMed
- Hupperets MD, Verhagen EA, Heymans MW, Bosmans JE, van Tulder MW, van Mechelen W: Potential savings of a program to prevent ankle sprain recurrence: economic evaluation of a randomized controlled trial. Am J Sports Med. 2010, 38: 2194-2200. 10.1177/0363546510373470.View ArticlePubMed
- Uegaki K, Bakker I, de Bruijne M, van der Beek A, Terluin B, van Marwijk H: Cost-effectiveness of a minimal intervention for stress-related sick leave in general practice: results of an economic evaluation alongside a pragmatic randomised control trial. J Affect Disord. 2010, 120: 177-187. 10.1016/j.jad.2009.04.012.View ArticlePubMed
- Sculpher MJ, Claxton K, Drummond M, McCabe C: Whither trial-based economic evaluation for health care decision making?. Health Econ. 2006, 15: 677-687. 10.1002/hec.1093.View ArticlePubMed
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2296/14/45/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.