- Research article
- Open Access
- Open Peer Review
Cost-effectiveness of supported self-management for CFS/ME patients in primary care
BMC Family Practice volume 14, Article number: 12 (2013)
Nurse led self-help treatments for people with chronic fatigue syndrome/myalgic encephalitis (CFS/ME) have been shown to be effective in reducing fatigue but their cost-effectiveness is unknown.
Cost-effectiveness analysis conducted alongside a single blind randomised controlled trial comparing pragmatic rehabilitation (PR) and supportive listening (SL) delivered by primary care nurses, and treatment as usual (TAU) delivered by the general practitioner (GP) in North West England. A within trial analysis was conducted comparing the costs and quality adjusted life years (QALYs) measured within the time frame of the trial. 296 patients aged 18 and over with CFS/ME diagnosed using the Oxford criteria were included in the cost-effectiveness analysis.
Treatment as usual is less expensive and leads to better patient outcomes compared with Supportive Listening. Treatment as usual is also less expensive than Pragmatic Rehabilitation. PR was effective at reducing fatigue in the short term, but the impact of the intervention on QALYs was uncertain. However, based on the results of this trial, PR is unlikely to be cost-effective in this patient population.
This analysis does not support the introduction of SL. Any benefits generated by PR are unlikely to be of sufficient magnitude to warrant recommending PR for this patient group on cost-effectiveness grounds alone. However, dissatisfaction with current treatment options means simply continuing with ‘treatment as usual’ in primary care is unlikely to be acceptable to patients and practitioners.
The trial registration number is IRCTN74156610
Chronic fatigue syndrome (or myalgic encephalomyelitis / encephalitis or ME; hereafter abbreviated to CFS/ME) is characterised by a principal complaint of fatigue, of sufficient duration and severity to impair functioning . CFS/ME causes substantial disability , and is associated with high levels of resource use . The NICE guideline for CFS/ME  emphasises the importance of confident diagnosis, of starting treatment early, and of developing tailored care-packages, agreed with the patient, which may include input from both NHS and social care services. In the absence of a clear explanatory model for CFS/ME and available treatment options, GPs avoid making the diagnosis feeling they have nothing to offer patients  and there is still some scepticism about the existence of the condition. Practice Nurses consider they have a limited in the support and management of patients with CFS/ME .
A recent UK multicentre clinical study randomised primary care patients to one of three treatments: pragmatic rehabilitation (PR) or supporting listening (SL), a non-directive counselling approach, delivered over ten sessions by primary care nurses, or treatment as usual (TAU) . PR provides an explanation for patients’ symptoms, based on a model in which CFS occurs as a consequence of physiological dysregulation associated with inactivity, disturbance of sleep and circadian rhythms, and the somatic symptoms of arousal or anxiety. The explanation provides the rationale for a rehabilitation program, developed collaboratively with the patient, which includes a graded eturn to activity and normalisation of sleep patterns. The model is presented to patients both verbally and in the form of a fully referenced manual. The therapy aims to help patients understand the model and to support them as they make the behavioural and lifestyle changes suggested by the model. PR was effective after 18 weeks of treatment in reducing fatigue, depression and improving sleep, but these effects had diminished one year later .
The purpose of this article is to present a cost-effectiveness analysis to compare costs and Health Related Quality of Life (HRQoL), as measured by quality-adjusted life years (QALYs), associated with these treatments.
The decision problem addressed in this paper is to assess the cost-effectiveness of three treatment strategies for CFS/ME, Pragmatic Rehabilitation (PR), Supportive Listening (SL) and Treatment as Usual (TAU) delivered by GPs in a primary care setting, in the budget constrained system of the UK NHS. Briefly, the clinical study on which this cost-effectiveness analysis is based was a three armed randomised controlled trial comparing the three strategies listed above. PR, originally developed in a secondary care context  involves an individualized programme of activity and improved sleep hygiene developed collaboratively between the patient and therapist (in this study, a primary care based nurse). SL is a variant of a non-specific counselling intervention originally designed for common psychological difficulties, while TAU represents the treatment as usual or management received by patients with CFS/ME from their GP. PR and SL interventions were delivered by three registered adult-speciality general nurses who had worked in primary care, but had no prior experience of CFS/ME; all three nurses delivered both pragmatic rehabilitation and supportive listening. It was expected PR and SL would be delivered to patients over ten sessions. Patients aged 18 or over with CFS/ME that had been present for over 6 months were eligible; full inclusion and exclusion criteria are presented in the original clinical paper .
The cost-effectiveness analysis is conducted from the perspective of the National Health Service and personal social services and measures costs to the NHS at 2008/09 prices. Costs and outcomes (as measured by Quality Adjusted Life Years) are discounted at 3.5% per year . Private expenditures, the costs of informal care and the costs of lost production are reported in a descriptive analysis. The interventions, population and recruitment procedures for the study are described in detail elsewhere .
Health related quality of life outcomes
HRQoL is measured using Quality Adjusted Life Years (QALYs). QALYs are the product of the health state of each individual and the time spent in that state. The health state of each individual in the study was assessed at entry to the trial (week 0), after treatment (week 20), and one year after treatment (week 70) using the EQ5D instrument.
Resource use and unit costs
Patients were asked to recall use of hospital services (inpatient, outpatient, A&E, day case surgery), day services (day centre, drop-in centre or social club), and contacts with health professionals over the time period of the trial. In addition, detailed costing of use of all prescribed medications was performed for each follow-up . The cost of delivering the intervention, in terms of nurse time, travel and training was also included. Though ten sessions were scheduled for each PR was delivered over a mean of 9.5 sessions with SL delivered over a mean of 9.6 sessions (see web appendix).
Costs of CFS/ME borne by patient or family
The trial collected data from patient questionnaires on the economic impact of CFS/ME on patients and their families. These costs included help from informal carers, payments for prescription and over-the-counter medicines, payment for complementary therapies, major one off expenses, lost days and lost income from work and days lost from leisure. These costs are described in this paper but are not included in the estimation of the cost-per-QALY .
Missing data arose where patients did not fully complete the follow up questionnaires, or missed one or more follow up interviews. In the base case analysis missing data were imputed by multiple imputation using chained equations (see web appendix) . Complete case analysis (excluding patient with missing data) was carried out as a sensitivity analysis.
The questionnaire at 70 weeks post-randomization asked about patient experience and resource use during the previous 6 months (i.e. 26 weeks), to reduce the risk of recall bias. Hence no resource use data were collected by the trial between weeks 20 to 44. Therefore in all analyses and for all patients, costs were imputed during this period based on mean weekly health-care expenditure for that patient during the other two follow up periods (excluding the cost of the intervention). These imputations were incorporated into the system of multiple imputation chained equations to reflect uncertainty.
Regression analysis was used to estimate the mean difference in cost and mean difference in QALYs per patient for each treatment over 70 weeks, relative to treatment as usual. Incremental cost effectiveness ratios (ICERs) were calculated where appropriate; ICERs formally compare the incremental costs and effects associated with intervention(s) (see web appendix). Conventionally, NHS treatments in England are considered cost-effective by NICE if the incremental cost-effectiveness ratio is less than £20,000 per QALY . For interventions that are associated with an ICER between £20-30,000 per QALY gained, there needs to be evidence that the intervention is innovative and/or that HRQoL is not captured adequately and/or that there is considerable uncertainty around the ICER. As the ICER goes above £30,000 per QALY gained, this evidence needs to be stronger .
Semi-parametric bootstrapping is used to estimate of the probability that each intervention is cost-effective for a range of threshold values of a QALY; cost-effectiveness acceptability curves are used to graphically represent this uncertainty around the adoption decision [12, 13]. The bootstrap is semi-parametric (rather than fully non-parametric) because at each resample the model estimates parametric regressions to impute missing data, thereby imposing some parametric constraints on the predictions of incremental costs and QALYs and their distributions .
Table 1 shows the unit costs for each resource captured in the trial.
Costs of healthcare
Table 2 shows the mean costs of each type of healthcare service at each follow up period Resource use is shown in the web appendix.
Figure 1 summarises the mean undiscounted costs per patient by randomised treatment group for patients who were followed up at both week 20 and week 70. Costs are imputed from week 20 to week 44 based on mean resource use in the other follow up periods, as no data were collected in the trial for this period. Supportive listening tended to be more costly over the whole trial period but there was not a statistically significant difference in total cost per patient between groups (p= 0.33).
Economic impact of CFE/ME on patient and family
Though outside the strict perspective of the NHS and personal social services advocated by NICE , the economic impact of CFE/ME on the patient and their family may be of interest to decision makers (see web appendix). Non-parametric K-sample tests of differences in medians between the groups found a difference at the 5% significance level for major one off expenses at week 20 and lost leisure time at week 70. However, after adjustment for multiple comparisons, ANOVA tests found that mean expenditures did not differ significantly by treatment group at week 70, controlling for health expenditure by individuals in the 6 months before the start of the trial. However, there is some weak evidence that those in the treatment as usual arm had greater loss of leisure time and higher costs of informal care than those in the PR group (Table 2).
Health related quality of life
Table 3 shows the proportion of patients in each health state of the EQ5D for 296 patients at baseline, 274 patients who were interviewed at week 20 and the 257 patients who were interviewed at week 70.
Figure 2 shows mean EQ5D index at baseline, week 20 and week 70 by randomised group (without multiple imputation). HRQL tended to increase in all groups at week 20 but returned towards baseline levels by week 70. ANOVA found that the differences in HRQL between treatment groups (adjusted for baseline EQ5D) were not statistically significant (p=0.47 at week 20 and p=0.75 at week 70).
Imputation of missing data
Of the 296 participants in the trial, 254 were followed up at week 20 and week 70, 19 were not followed up at either week 20 or week 70, 20 were followed up at week 20 only, and 3 were followed up at week 70 only. There were no statistically significant differences in the probability of follow up between randomised groups. Multiple imputation was used to impute missing data (costs and EQ5D) (The Additional file 1: web appendix gives details of validation for the imputation procedures).
Table 4 shows mean incremental QALYs and mean incremental costs compared with treatment as usual. Multiple imputation has been used to deal with missing data, and confidence intervals have been estimated by bootstrapping the 15 imputed datasets. After adjusting for baseline differences in EQ-5D, TAU delivered in primary care tends to be slightly more effective than either PR or SL and at a lower cost. Estimates of both incremental costs and effects are associated with considerable uncertainty with all confidence intervals crossing zero.
Given that on average TAU has lower costs and better outcomes that either intervention, it is the dominant therapy and calculation of an ICER is not appropriate . However, there is a considerable amount of uncertainty around these estimates. The probability that TAU is cost-effective is 0.645 at a threshold cost-per-QALY of £20,000, 0.626 at a threshold of £30,000 per QALY and 0.600 at a threshold of £50,000 (Figure 3).
A complete case analysis (N=254) (excluding patients who did not complete questionnaires at baseline, 20 weeks or 70 weeks), suggested that PR tended to be associated with slightly higher QALYs than TAU though again with wide confidence intervals that crossed zero (Table 4). In this analysis, PR has an incremental cost-effectiveness ratio of £39583 per QALY versus TAU (calculated as £475/0.012). SL is dominated by TAU. Based on this sensitivity analysis, TAU is likely to be the preferred option as the ICER associated with PR is higher than that usually recommended . Pragmatic rehabilitation and treatment as usual were roughly equally likely to be cost effective at a threshold of £30000 per QALY in the complete case analysis (Figure 3).
Summary of main findings
This study has compared the costs and QALYs of pragmatic rehabilitation versus supportive listening versus GP delivered treatment as usual for patients with CFS/ME treated in the community. Supportive Listening was no more effective than the other therapies and more costly, and is therefore not cost-effective. The primary analysis (imputing for missing data) also finds that Pragmatic Rehabilitation (PR) does not appear to be more effective than GP delivered treatment as usual over the time scale of the study, and does not appear to be cost-effective. A secondary analysis (using complete cases only) found that PR tended to be slightly more effective than treatment as usual. In this analysis which favours PR, the cost-per-QALY generated compared with treatment as usual is greater than £30000 per QALY and pragmatic rehabilitation is unlikely to be considered cost-effective at current thresholds used in the UK. Whether these thresholds are appropriate in the UK for this patient population is open to debate. Some authors have suggested that the thresholds may be too high , while others have suggested that the public may value a QALY at over £30,000 .
The findings of this analysis are broadly consistent with the clinical study of this trial, which concluded that the benefits of pragmatic rehabilitation seen while treatment was ongoing attenuated over the one year follow up period . It is worth noting that the clinical effectiveness of PR delivered in primary care as reported by Wearden et al.  was much less than in a previous trial of PR in secondary care . The conclusion from this single trial analysis is that whether there are benefits associated with PR when delivered in this way depends on the analysis chosen. However, any increases in QALYs generated by PR are not substantial and GP delivered TAU is likely to be cost-effective.
Strengths and limitations
The current study finds that although pragmatic rehabilitation delivered in primary care appears to be associated with benefits to patients at 20 weeks, patients also improve on average in the GP delivered treatment as usual arm. The incremental benefit of PR, as measured by QALYs over the time period of the trial, is very small or non-existent. The current study has a time horizon of 70 weeks. This in effect assumes there are no differences between treatments one year after the end of the trial therapy period. While the assumption potentially may be a source of bias, in this case it is probably justified given that the mean HRQoL of all groups appears to converge at 70 weeks. As with all evaluations that use patient assessments of their health status and resource use at specified time points, we do not know the extent of over/under-estimation. In addition we do not know the trajectory of the EQ5D scores over the whole time period. We have assumed a linear interpolation of EQ5D scores, but while this is common practice, the small absolute differences in effect size suggest that any variation from this may have had an impact on results and conclusions.
The perspective of the study covers health and personal social services. However, the presentation of questions in the patient questionnaire may mean that some social care use was under-reported. Some services, such as family support workers and other social care costs were not explicitly included, but are unlikely to influence the conclusions. The inclusion of productivity losses is also unlikely to influence conclusions.
In addition, the study only considers three options. There may be other ways of designing services so that, for example, PR could be delivered less expensively, perhaps by practice nurses or GPs could be better trained to recognise and manage CFS/ME . In addition, we know that patients needed to believe in the intervention model presented in order to engage fully . Ideally these options should be considered as part of the evaluation.
Comparison with existing literature
A recently published trial  suggests that graded exercise therapy leads to better patient outcomes (in terms of reduced fatigue and better physical function) than standardised usual specialist medical care. The cost-effectiveness analysis conducted alongside this trial  showed that both graded exercise therapy (GET) and Cognitive Behavioural Therapy (CBT) added significantly to costs, but also improved health related quality of life when compared with specialised medical care (SMC). The authors conclude that GET was likely to be cost-effective when compared to SMC, but that CBT had the highest probability of being cost-effective. However, like the patients in the previous PR trial reported by Powell et al. (2001) , these patients had been referred to secondary care and so were a selected group, unlike the group in the FINE trial.
The results of the present analysis can be compared with a previous study that estimated the economic burden of CFS/ME in a UK primary care setting 2003 . The costs of health services seem slightly higher in the current study, and the costs of informal care appear considerably lower in the current study. However, these differences may be due to recall bias or due the wording of the study questionnaires, rather than reflecting real differences.
Implications for future research and clinical practice
There is a body of evidence that suggests that patients with CFS/ME are not satisfied with the care they currently receive from primary care, and that GPs find management of these patients difficult [5, 21]. Thus the suggestion that the cost-effective solution should be implemented is of limited use if patients feel that this option is not acceptable. Thus further research into effective management options for patients with CFS/ME is needed. In addition, the skills of GPs in making the diagnosis of CFS/ME and offering acceptable treatment, or referral to specialist CFS/ME services, need to improve. The team are currently developing and evaluating resources to support GPs and patients with CFS/ME.
Clinical commissioning groups will need to consider what are the appropriate services to commission for patients with CFS/ME and where they should be provided and cost-effectiveness might not be the only consideration.
Access to data
The authors all had full access to all of data in the study and can take responsibility for the integrity of the data and the accuracy of the data analysis.
The FINE Trial Writing Group consists of: Alison Wearden, Richard Bentall, Carolyn Chew-Graham, Christopher Dowrick, Graham Dunn, Karina Lovell, Richard Morriss, Sarah Peters, Gerry Richardson and Lisa Riste.
The FINE Trial Group consisted of: Colette Bennett, Richard Bentall, Laura Booth, Joanna Brocki, Greg Cahill, Anna Chapman, Carolyn Chew-Graham, Susan Connell, Christopher Dowrick, Graham Dunn, Deborah Fleetwood, Laura Ibbotson, Diana Jerman, Karina Lovell, Jane Mann, Richard Morriss, Sarah Peters, Pauline Powell, David Quarmby, Gerry Richardson, Lisa Riste, Alison Wearden, Jennifer Williams.
Ethical approval for this trial was granted by the Eastern MREC, reference 03/5/62.
Role of the funder
The funder had no role in the study design, collection, analysis and interpretation of data, writing of the article or the decision to submit it for publication.
Accident and Emergency
Analysis of Variance
Chronic Fatigue Syndrome/Myalgic Encephalitis
Fatigue Intervention by Nurses
Health Related Quality of Life
Incremental Cost Effectiveness Ratio
Multi-centre Research Ethics Committees
National Health Service
National Institute for Health and Clinical Excellence
Quality Adjusted Life Year
Treatment as usual.
- Cost-effectiveness versus patient acceptability:
the exemplar of CFS/ME.
Sharpe MC, Archard LC, Banatvala JE, Borysiewicz LK, Clare AW, David A, Edwards RHT, Hawton KEH, Lamber HP, Lane RJM, et al: A report - chronic fatigue syndrome: guidelines for research. J R Soc Med. 1991, 84 (2): 118-121.
Komaroff AL, Fagioli LR, Doolittle TH, Gandek B, Gleit MA, Guerriero RT, Kornish J, Ware NC, Ware JE, Bates DW: Health status in patients with chronic fatigue syndrome and in general population and disease comparison groups. Am J Med. 1996, 101 (3): 281-290. 10.1016/S0002-9343(96)00174-X.
McCrone P, Darbishire L, Ridsdale L, Seed P: The economic cost of chronic fatigue and chronic fatigue syndrome in UK primary care. Psychol Med. 2003, 33 (2): 253-261. 10.1017/S0033291702006980.
National Institute for Health and Clinical Excellence: Chronic fatigue syndrome / myalgic encephalomyelitis (or encephalopathy): diagnosis and management of CFS/ME in adults and children. NICE Clinical guideline 53. 2007
Chew-Graham C, Cahill G, Dowrick C, Wearden A, Peters S: Use of multiple sources of evidence about CFS/ME in primary care consultations. Ann Fam Med. 2008, 6: 340-348. 10.1370/afm.867.
Chew-Graham C, Dixon R, Shaw J, Smyth N, Lovell K, Peters S: Practice nurses' views of their role in the management of CFS / ME: a qualitative study. BMC Nursing. 2009, 8 (2): 10.1186/1472-6955-8-2.
Wearden A, Dowrick C, Chew-Graham C, Bentall RP, Morriss RK, Peters S, Riste L, Richardson G, Lovell K, Dunn G, Fatigue Intervention by Nurses Evaluation (FINE) Trial Writing Group and the FINE Trial Group: Nurse led, home based self help treatment for patients in primary care with chronic fatigue syndrome: randomised controlled trial. BMJ. 2010, 10.1136/bmj.c1777.
Powell P, Bentall RP, Nye FJ, Edwards KHT: Randomised controlled trial of patient education to encourage graded exercise in chronic fatigue syndrome. Br Med J. 2001, 322 (7283): 387-390. 10.1136/bmj.322.7283.387.
National Institute for Health and Clinical Excellence: Guide to the methods of technology appraisal. 2008
British Medical Association: British national formualry. 2009, 58: September 2009
Rubin DB, Stern HS, Vehovar V: Handling "don't know" survey responses: the case of the Slovenian plebiscite. J Am Stat Assoc. 1995, 90 (431): 822-828.
Fenwick E, Claxton K, Sculpher M: Representing uncertainty: the role of cost-effectiveness acceptability curves. Health Econ. 2001, 10 (8): 779-787. 10.1002/hec.635.
van Hout BA, Al MJ, Gordon GS, Rutten FF: Costs, effects and C/E-ratios alongside a clinical trial. Health Econ. 1994, 3 (5): 309-319. 10.1002/hec.4730030505.
Efron B, Tibshirani RJ: An introduction to the Bootstrap. 1993, Chapman and Hall
Department of Health: NHS Reference costs 2007/8. 2008, http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_098945,
Personal Social Services Research Unit: Unit Costs of Health and Social Care. 2009
Drummond M, Sculpher MJ, Torrance GW, O’Brien BJ, Stoddart GL: Methods for the Economic Evaluation of Health Care Programmes. 2005, Oxford University Press
Claxton K, Martin S, Soares M, Rice N, Spackman E, Hinde S, Devlin N, Smith P, Sculpher M: Methods for the Estimation of the NICE Cost Effectiveness Threshold. 2011, http://www.york.ac.uk/media/che/documents/reports/Methods%20for%20the%20Estimation%20of%20the%20NICE%20Cost%20Effectiveness%20Threshold%20(Draft%20Final%20Report)%20(1).pdf,
Baker R, Bateman I, Donaldson C, Jones-Lee M, Lancsar E, Loomes G, Mason H, Odejar M, Pinto Prades J, Robinson A, et al: Weighting and valuing quality-adjusted life-years using stated preference methods: preliminary results from the Social Value of a QALY Project. HTA. 2010, 14 (27): 1-162.
Chew-Graham C, Dowrick C, Wearden A, Richardson V, Peters S: Making the diagnosis of CFS/ME in primary care: a qualitative study. BMC Fam Pract. 2010, 11 (16): 10.1186/1471-2296-11-16.
Chew-Graham C, Brooks J, Wearden A, Dowrick C, PSO: Factors influencing engagement of patients in a novel intervention for CFS/ME: A qualitative study. Prim Health Care Res Dev. 2010, 10.1017/S146342361000037X.
White P, Goldsmith KA, Johnson AL, Potts L, Walwyn R, DeCesare JC, et al: Comparison of adaptive pacing therapy, cognitivie behaviour therapy, graded exercise therapy, and specialists medical care for chronic fatigue syndrome (PACE): a randomised trial. Lancet. 2011, 10.1016/S0140-6736(11)60096-2.
McCrone P, Sharpe M, Chalder T, Knapp M, Johnson AL, et al: Adaptive Pacing, Cognitive Behaviour Therapy, Graded Exercise, and Specialist Medical Care for Chronic Fatigue Syndrome: A Cost-Effectiveness Analysis. PLoS ONE. 2012, 7 (8): e40808-10.1371/journal.pone.0040808.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2296/14/12/prepub
We would like to thank all the patients who took part in the study. We are also grateful for the assistance of Liverpool Primary Care Trust, the Mersey Primary Care R&D Consortium, and the staff of the186 general practices who referred to our study.
UK Medical Research Council (G200212) and Department of Health.
All authors have completed the Unified Competing Interest form (available from the first author). All authors declare that the answer to the questions on the competing interest form are all “No” and all authors therefore have no competing interests to declare.
All authors participated in the overall design of the study, contributed to the interpretation of the data, and contributed to several drafts of this paper. GR was the trial health economist, and advised on trial assessments and inclusion of appropriate measures as well as supervising the economic analysis. DE conducted the cost-effectiveness analysis. In addition, AJW, the principal investigator, conceived of the study, prepared the protocol, contributed to training of therapists and supervision of researchers, had overall responsibility for the day-to-day running of the study, interpreted the data and took the lead on writing this report. She is the guarantor for the study. CD and CCG participated in the training of therapists and the recruitment of general practices into the study, and advised on medical exclusions from the trial. RB and RKM participated in the training and supervision of therapists. RKM trained the researchers in psychiatric interviewing and advised on psychiatric exclusions from the trial. SP participated in training of therapists and recruitment of patients to the trial. LR was the trial manager. She participated in recruitment, training of research staff, was responsible for staff management and overall coordination of the study. KL advised on recruitment of patients to the trial, and participated in the design and implementation of the therapy rating exercise. GD was the trial statistician. He advised on randomization and all statistical aspects of the trial, developed the analysis plan, and performed the statistical analysis. All authors read and approved the final manuscript.