- Research article
- Open Access
- Open Peer Review
Interventions to improve adherence to cardiovascular disease guidelines: a systematic review
BMC Family Practice volume 16, Article number: 147 (2015)
Successful management of cardiovascular disease (CVD) is impaired by poor adherence to clinical practice guidelines. The objective of our review was to synthesize evidence about the effectiveness of interventions that target healthcare providers to improve adherence to CVD guidelines and patient outcomes.
We searched PubMed, EMBASE, Cochrane Library, PsycINFO, Web of Science and CINAHL databases from inception to June 2014, using search terms related to adherence and clinical practice guidelines. Studies were limited to randomized controlled trials testing an intervention to improve adherence to guidelines that measured both a patient and adherence outcome. Descriptive summary tables were created from data extractions. Meta-analyses were conducted on clinically homogeneous comparisons, and sensitivity analyses and subgroup analyses were carried out where possible. GRADE summary of findings tables were created for each comparison and outcome.
Results and Discussion
We included 38 RCTs in our review. Interventions included guideline dissemination, education, audit and feedback, and academic detailing. Meta-analyses were conducted for several outcomes by intervention type. Many comparisons favoured the intervention, though only the adherence outcome for the education intervention showed statistically significant improvement compared to usual care (standardized mean difference = 0.58 [95 % confidence interval 0.35 to 0.8]).
Many interventions show promise to improve practitioner adherence to CVD guidelines. The quality of evidence and number of trials limited our ability to draw conclusions.
Cardiovascular disease (CVD) is a leading cause of death in Canada . Successful management of CVD involves not only the treatment of a specific disease, but also treating and preventing risk factors for CVD, including diabetes, dyslipidemia and hypertension [1–3]. However, the management of CVD is complicated by the large number of clinical practice guidelines available for conditions that contribute to this disease. An article by Ray et al. noted there are also discrepancies in recommendations across guidelines, potentially contributing to low adherence rates [2, 4, 5]. A harmonized guideline by Tobe et al. (2011) found there are over 400 recommendations for managing risk factors for heart disease .
Given the complexity of the management of this illness, it is imperative that practitioners use guidelines, and the most appropriate guidelines, in caring for patients with CVD and risk factors for CVD. The impact of guideline implementation has been illustrated previously; a review by Grimshaw and Russell found that using guidelines improved clinical practice . Despite evidence to support the use of guidelines, there remains a gap in their implementation .
The dissemination of guidelines alone has little to no effect on practice , thus many studies have investigated interventions of varying intensity to increase the uptake of clinical practice guidelines. Numerous studies of interventions to improve the uptake of guidelines in CVD prevention are available. However, their overall impact on guideline adherence and clinical outcomes is unclear. Unverzagt et al.  published a systematic review on a similar topic that focused on primary care physicians’ adherence to guidelines, wherein they demonstrated these interventions can have an impact on adherence outcomes. It is important to determine the effect of these interventions on other healthcare providers, as well as determine the impact of these interventions on clinical outcomes, which is yet to be addressed in the literature to our knowledge.
We identified and synthesized the available research evidence about the effectiveness of interventions that target healthcare providers to improve adherence to CVD prevention and treatment guidelines and clinical outcomes. Our secondary objective was to explore characteristics of guideline implementation interventions and contexts that are associated with increased effectiveness. This leads to our research question: what is the most effective intervention to improve the implementation of, uptake of, or adherence to cardiovascular disease-related clinical practice guidelines by healthcare providers in randomized controlled trials?
As this research did not involve the collection of primary data, we did not seek ethics approval. This review has been registered with PROSPERO 2014:CRD42014010111. Available from http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42014010111
A systematic search was conducted using search terms related to “adherence” and “clinical practice guidelines”, which was refined with the help of a medical librarian. We searched the following databases: PubMed, EMBASE, Cochrane Library (including CENTRAL, DARE and HTAs), PsycINFO, Web of Science and CINAHL (all available years, up to June 2014). Grey literature was also searched, including clinicaltrials.gov to identify potential new studies, ICTRP registry database, and ProQuest thesis database. Our search strategy did not impose any limits on language of publication (Additional file 1).
The included studies were limited to randomized controlled trials (RCTs). We included all types of RCTs, including cluster RCTs, and nested designs.
Studies that enrolled any registered healthcare providers were included. Subgroups of interest for our analyses included comparing physician participants to other healthcare providers (non-physicians). We excluded trials if less than 75 % of the participants included were certified, regulated healthcare providers.
All studies that evaluated the impact of an intervention on the implementation of, uptake of, or adherence to a clinical practice guideline by a health care provider were included. The guideline of concern had to relate to the prevention or management of CVD, including risk factor management for any of: diabetes, dyslipidemia or hypertension. Guideline definitions were based on authors stating a guideline to be such. A study was deemed to be about the implementation or adherence to a guideline if the trial report explicitly stated that improving use of a clinical practice guideline was the focus of the intervention. Types of interventions included: academic detailing, audit and feedback, educational sessions, continuing medical education (CME) sessions, and ‘other’ (such as reminders or decision support systems).
We selected studies that included at least one control group. Comparison groups included usual care, a similar guideline implementation intervention of differing intensity or duration than the main intervention group, or no intervention (receipt of the intervention at a different time than the intervention group, such as after data collection).
We included trials that reported both a measure of guideline adherence and at least one clinical outcome. Measures of adherence included self-reported adherence, prescription review, and chart review. We included studies reporting any relevant clinical outcomes and considered the following groups of outcomes for analyses: mortality, hospitalizations, quality of life, and disease targets. Outcomes assessed at similar time points were combined in our analysis as short term (3–6 months), and long term (7 months or longer).
Study selection and data extraction
Articles were screened based on title and abstract using the inclusion criteria, then based on full text by two independent reviewers. Discrepancies were resolved by consensus.
Data from included articles was extracted in duplicate by independent extractors. We extracted study characteristics (study design, setting and population), a description of the intervention (the type of intervention, providers, and resources involved), comparison intervention, risk of bias, outcome measurement and results, and funding for the study. Risk of bias was assessed using the Cochrane Risk of Bias tool for RCTs . All discrepancies between extractors were resolved through consensus. Data was managed using spreadsheets created for each extractor. Authors were contacted after data extraction and consensus meetings were completed to request missing data and to check the accuracy of our extractions.
We conducted descriptive analyses of included studies. We conducted meta-analyses (MA) for outcome results when there was sufficient clinical homogeneity across the studies. Clinical homogeneity was based on similar study characteristics (intervention type, outcome and follow-up point of interest). Meta-analyses were conducted in Review Manager (RevMan 5), using a random effects model and forest plots were generated. Intraclass correlation coefficient (ICC) for cluster RCTs were used in our meta-analyses to calculate the effective sample size to ensure the effect of clustering was taken into account in our analyses, as per the Cochrane Handbook . A Z-test was used to assess statistical significance of meta-analysis results and a p < 0.05 was considered significant.
The adherence and patient outcomes were measured as both dichotomous and continuous outcome measures. Odds ratios (OR) and 95 % confidence intervals (CI) were calculated for use in the MA for dichotomous outcomes. Standardized mean differences (SMD) were used for continuous outcomes, as outcomes measuring the same construct were measured on different scales. Most continuous outcome analyses looked at the differences in mean change of each group from baseline, and this value was used in the MA, though some trials reported follow up results in each group, wherein we calculated the change score for each group to use in our MA. In order to impute the standard deviation for the change score in this instance, the standard deviation of the change score from another similar study was used.
We conducted sensitivity analyses to determine the robustness of our results, comparing the results of our analyses including and excluding studies with imputed standard deviations, and excluding studies with high risk of bias (greater than 3 domains rated as high risk of bias). We conducted subgroup analyses considering participant subgroups (physician participants and other healthcare providers), and considering the condition that was the focus of the guideline in the study (acute and chronic CVD conditions or risk factors). We planned to create funnel plots to investigate potential publication bias if at least ten studies were included for a given outcome, however this was not possible. We present a summary of the overall strength of evidence available using GRADE Summary of Findings tables produced using GRADEpro.
Results of the search
We identified 12,255 potentially relevant unique citations. We excluded 12,033 citations during the initial abstract and title screening. We reviewed 222 full text publications and included 38 studies in the review [12–54] (Fig. 1).
Included studies (Table 1)
Eighteen studies took place in the USA, 14 were completed in Europe (the Netherlands, Italy, England, and Norway), two took place in Canada, one in South Africa, one in Brazil, one in Asia-Pacific area, and one in the Virgin Islands. Thirty-five studies included an intervention to improve physician use of guidelines and ten of those studies included a nurse as a target for the intervention; two studies focused on nurses alone, and one study focused on pharmacists. The most common intervention type was educational focused intervention (18/38), followed by audit and feedback (9/38), academic detailing focused interventions (4/38), comprehensive interventions that included education, audit and feedback and an academic detailing component (2/38), and “other” interventions that did not fall into any pre-designated category (8/38). Seven trials included more than one intervention group. All studies included an adherence outcome, as per our inclusion criterion. Disease target was the most common clinical outcome reported (33/38 trials), followed by mortality (11/38). Hospitalization and quality of life data were also reported in 8/38 and 6/38 trials, respectively.
Risk of bias in included studies
Risk of bias summary graphs and tables were created using RevMan (Figs. 2 and 3). Risk of bias was often assessed as unclear due to poor reporting of a methodological procedure. The majority of trials (33/38) were cluster RCTs, therefore additional risk of bias criteria were included for these studies. Random sequence generation was most often assessed to be low risk of bias, while blinding of participants was most commonly rated as high risk of bias.
Effects of interventions
Seventeen trials tested an education-focused intervention and were included in a meta-analysis. These trials overall favoured the intervention, and one meta-analysis was statistically significant. Seven trials (2545 subjects) reported mortality outcomes, three of which reported mortality at a short term time point with an overall odds ratio of 0.54 (95 % CI 0.2 to 1.42). Four trials reported mortality at a long term time point with an overall odds ratio of 0.48 (95 % CI 0.11 to 1.98). Four trials (979 subjects) reported hospitalizations as an outcome at a long term time point. The overall odds ratio for this outcome was 0.88 (95 % CI 0.54 to 1.41). Six trials (2145 subjects) reported disease target results at a short term time point (SMD = −0.32 (95 % CI −0.71 to 0.07)) and five trials (2732 subjects) reported this outcome at a long term time point (SMD = −0.09 (95 % CI −0.24 to 0.07)) (Fig. 5). Seventeen trials reported adherence outcome data, six (2306 subjects) reported dichotomous data at a short term time point (OR = 2.11 (95 % CI 0.90 to 4.97)), four trials (322 subjects) reported continuous data at a short term time point (Fig. 4) and eight trials (6019 subjects) reported dichotomous data at a long term time point (OR = 1.05 (95 % CI 0.82 to 1.34)) (Fig. 6).
Audit and feedback
Nine trials included an intervention that focused on audit and feedback, and seven of those trials reported data sufficient to be included in meta-analyses. Three trials (2240 subjects) reported disease target results at a long term time point with an overall effect of −0.44 SMD (95 % CI −1.05 to 0.17) (Fig. 5). Six trials (2983 subjects) reported adherence data at a long term time point with an overall odds ratio of 1.39 (95 % CI 0.88 to 2.21) (Fig. 6).
Four trials (6017 subjects) included academic detailing as the focus of the intervention and all of these trials reported data that was included in a meta-analysis for adherence outcome. The overall odds ratio for this comparison was 1.32 (95 % CI 0.88 to 1.96) (Fig. 6).
Eight trials included an intervention whose focus did not fit these previous groups. Four trials (1782 subjects) included a decision support tool as the focus of their intervention. The overall odds ratio for this comparison was 1.19 (95 % CI 0.83 to 1.70) (Fig. 6).
Sensitivity and subgroup analyses
Sensitivity analysis investigating the impact of imputed standard deviations in continuous data was possible in the education intervention outcome for the disease target outcome at a short term time point. The pooled SMD from six studies in this comparison was −0.32 (95 % CI −0.71 to 0.07), while the estimate from the sensitivity analysis, with studies that included imputed standard deviation removed, was −0.27 (95 % CI −0.71 to 0.17). Another sensitivity analysis, investigating the impact of high risk of bias studies on the overall estimate was possible for the meta-analysis of the effect of education on short term adherence outcomes. The pooled odds ratio was 2.36 (95 % CI 0.86 to 6.51) before studies with high risk of bias were excluded, and 3.65 (95 % CI 0.53 to 25.15) after studies with high risk of bias were excluded.
We compared results in studies that targeted physicians only in their intervention to interventions that involved non-physician healthcare providers alone or in addition to physicians with subgroup analysis. This subgroup analysis was possible in seven comparisons, and the subgroups of physician participants alone frequently had less heterogeneity than when grouped with all studies, suggesting participants may be a source of heterogeneity (Additional file 2: Figure S1). Another subgroup analysis we conducted compared results in studies that focused on an acute cardiovascular condition to a chronic cardiovascular condition. Five comparisons showed inconsistent results although the heterogeneity was reduced in at least one of the two subgroups in all comparisons.
GRADE summary of findings tables
The overall quality of evidence identified in this systematic review was moderate to very low due to high risk of bias, imprecision, and heterogeneity (Table 2). The most patient important outcome of mortality had moderate quality of evidence associated, indicating the results may be interpreted with some confidence.
Statement of principal findings
We have focused on interventions aimed at improving adherence to CVD guidelines. Overall studies are variable in their conclusions on whether the intervention was effective, though our quantitative analysis supports that interventions trend towards having an impact on adherence to guidelines and patient outcomes. One comparison of an education intervention for the adherence outcome was statistically significant, indicating this area of study deserves further consideration, as these interventions may help improve both adherence to guidelines, and more importantly, patient outcomes. Our results were robust where sensitivity analyses were possible. Subgroup analyses (participant and condition) reduced the statistical heterogeneity but there was inconsistency in the subgroup with the larger effect for each analysis. In some cases, the physician subgroup favoured the intervention to a greater degree than the non-physician subgroup, but in other comparisons the opposite was true. The same results were found for the condition subgroup (acute vs. chronic condition). The confidence in these recommendations ranged from moderate to very low based on a GRADE summary of findings due to imprecision, risk of bias, and inconsistency.
Strengths and weaknesses of the review
Our systematic review has several strengths, including that it was comprehensive in inclusion of studies. We included all types of healthcare providers in order to illustrate the impact these interventions can have on both physicians and non-physicians, which is increasingly important for multidisciplinary teams required for complex diseases such as CVD. We limited our study inclusion to those that reported both adherence and a patient outcome, as interventions must improve both in order to be clinically useful. All screening, data extraction, and risk of bias assessment was done in duplicate with trained reviewers to ensure the reproducibility of these results. Our quantitative analysis was pre-specified to avoid finding spurious results due to post hoc analyses. We minimized the number of comparisons that were made while ensuring comparisons had fairly good clinical homogeneity to maintain the strength of those conclusions. We also contacted authors for missing data and to verify the accuracy of our data extractions of their trial, thus we have confidence in this data.
However, this review has limitations. The first relates to the quality of reporting in trials. Reporting of risk of bias domains was poor in many trials, making it difficult to assess risk of bias. There was also significant heterogeneity in the studies’ interventions and characteristics making combining results in a meta-analysis difficult, leading to small numbers of studies included in each comparison. Meta-analyzing results was further complicated by uncertainty of the exact nature of some interventions due to limited descriptions of interventions available in publications. This also limited our ability to assess publication bias, so we were unable to determine the effect that might have on our confidence in these results.
Comparison to similar reviews
A systematic review on CVD guideline implementation strategies in primary care physicians by Unverzagt et al. reported similar conclusions on the effectiveness of education and reminder system interventions to improve adherence . Our review extends these findings, illustrating the impact at the patient level on mortality, hospitalizations, quality of life and disease targets, and to different healthcare providers.
Similar to our findings, a review by Grimshaw et al. on guideline implementation noted overall the most effective interventions tend to include specific educational interventions and patient specific reminders at point of care .
Meaning of the review results
These results indicate there is some evidence to support the use of some interventions to improve healthcare provider adherence to CVD guidelines. Despite the limitations in the studies in this review, a trend of interventions improving adherence and patient outcomes was noted, supporting that these interventions may be more effective than passive guideline dissemination strategies. However, more studies are needed to strengthen these conclusions.
The majority of interventions included were multifaceted, which some reviews have suggested provide positive outcomes more frequently than single interventions [53–55]. However, our results were not consistent with these; we found these interventions have limited effects, which may be related to the number of components in a given intervention, as only two interventions included all of the types of interventions. A review by Squires et al. found there is ambiguity in the evidence of whether multifaceted interventions are more effective than single interventions, which is in agreement with our inconsistent findings .
Another possible reason for the overall small effect sizes may relate to the complexity of the management of CVD. This includes treating and preventing multiple risk factors in patients, such as diabetes, hypertension and dyslipidemia . Most guidelines address only one of these diseases, and this may contribute to the small improvements found in this review. Given the multifactorial nature of CVD, it needs to be treated with guidelines that acknowledge this. Using harmonized CVD guidelines such as C-CHANGE is an important step that needs to be taken in CVD guideline implementation intervention trials to ensure the best, most comprehensive care is provided to patients . This is also an important consideration as to why CVD guideline implementation strategies must differ from strategies used in treating simpler diseases such as pneumonia or asthma [57, 58].
Unanswered questions and future research
It would be beneficial for more high quality studies on this topic to be conducted to improve the strength of our recommendations, given the low confidence in most of these estimates due to a small number of studies included in each MA. Interventions should be fully described so they are not only reproducible, but future reviews are able to confidently determine homogeneous groups for meta-analyses. Future reviews on this topic should also define clinically important differences to determine whether the effects are not only statistically significant, but clinically significant as well.
Interventions to improve adherence to CVD guidelines can be effective at improving both adherence and patient outcomes, and are often more effective than guideline dissemination alone. Interventions that focused on healthcare provider education demonstrated statistically significant improvements. The overall quality of evidence available in this review was low, but several patient important outcomes including mortality were supported by moderate to high quality evidence.
Clinical practice guideline
Randomized controlled trials
Grading of Recommendations Assessment, Development and Evaluation
Continuing medical education
Standardized mean difference
Tobe SW, Stone JA, Brouwers M, Bhattacharyya O, Walker KM, Dawes M, et al. Harmonization of guidelines for the prevention and treatment of cardiovascular disease: the C-CHANGE Initiative. Can Med Assoc J. 2011;183(15):e1135–50.
Perk J, De Backer G, Gohlke H, Graham I, Reiner Z, Verschuren WM, et al. European Guidelines on cardiovascular disease prevention in clinical practice (version 2012): Addenda The Fifth Joint Task Force of the European Society of Cardiology. Eur Heart J. 2012. doi:10.1093/eurheart/ehs165.
Indio do Brasil CKO, Avezum A, Uint L, Del Monaco MI, De Barros VM, Campos SYR, et al. Cardiovascular prevention in coronary heart disease patients: guidelines implementation in clinical practice. Rev Bras Cir Cardiovasc. 2013;28(2):238–47.
Ray KK, Kastelein JJP, Boekholdt SM, Nicholls SJ, Khaw KT, Ballantyne CM, et al. The ACC/AHA 2013 guideline on the treatment of blood cholesterol to reduce atherosclerotic cardiovascular disease risk in adults: The good the bad and the uncertain: A comparison with ESC/EAS guidelines for the management of dyslipidaemias 2011. Eur Heart J. 2014;35:960–8.
Stone NJ, Robinson JG, Lichtenstein AH, Merz CNB, Blum CB, Eckel RH, et al. ACC/AHA Guideline on the Treatment of Blood Cholesterol to Reduce Atherosclerotic Cardiovascular Risk in Adults A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation. 2014;129 suppl 2:S1–S45.
Grimshaw JM, Russell IT. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993;342:1317–22.
Feifer C, Ornstein SM, Jenkins RG, Wessell A, Corley ST, Nemeth LS, et al. The logic behind a multimethod intervention to improve adherence to clinical practice guidelines in a nationwide network of primary care practices. Eval Health Prof. 2006;29:65–88.
Davis DA, Taylor-Vaisey A. Translating guidelines into practice. Can Med Assoc J. 1997;157:408–16.
Unverzagt S, Oemler M, Braun K, Klement A. Strategies for guideline implementation in primary care focusing on patients with cardiovascular disease: a systematic review. Fam Pract. 2014;31(3):247–66.
Higgins J, Green S. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [Updated March 2011]. The Cochrane Collaboration, 2011. Available from www.cochrane-handbook.org.
McKenzie J, Ryan R, Di Tanna GL; Cochrane Consumers and Communication Review Group. ‘Cochrane Consumers and Communication Review Group: cluster randomised controlled trials’. http://cccrg.cochrane.org, March 2014 (December 20, 2014).
Ansari M, Shlipak MG, Heidenreich PA, Van Ostaeyen D, Pohl EC, Browner WS, et al. Improving guideline adherence: A randomized trial evaluating strategies to increase beta-blocker use in heart failure. Circulation. 2003;107:2799–804.
Baker R, Fraser RC, Stone M, Lambert P, Stevenson K, Shiels C. Randomised controlled trial of the impact of guidelines, prioritised review criteria and feedback on implementation of recommendations for angina and asthma. Br J Gen Pract. 2003;53:284–91.
Bertoni AG, Bonds DE, Chen H, Hogan P, Crago L, Rosenberger E, et al. Impact of a multifaceted intervention on cholesterol management in primary care practices. Public Health. 2009;169(7):678–86.
Browner WS, Baron RB, Solkowitz S, Adler LJ, Gullion DS. Physician management of hypercholesterolemia. A randomized trial of continuing medical education. West J Med. 1994;161:572–8.
Carter BL, Ardery G, Dawson JD, James P, Bergus GR, Doucette WR, et al. Physician and pharmacist collaboration to improve blood pressure control. Arch Intern Med. 2009;169(21):1996–2002.
Deales A, Fratini M, Romano S, Rappelli A, Penco M, Perna GP, et al. Care manager to control cardiovascular risk factors in primary care: The Raffaello cluster randomized trial. Nutr Metab Cardiovasc Dis. 2014;24(5):563–71.
de Lusignan S, Gallagher H, Chan T, Thomas N, van Vlymen J, Nation M, et al. The QICKD study protocol: a cluster randomised trial to compare quality improvement interventions to lower systolic BP in chronic kidney disease (CKD) in primary care. Implement Sci. 2009;4:39–54.
Dijkstra RF, Niessen LW, Braspenning JCC, Adang E, Grol R. Patient-centred and professional-directed implementation strategies for diabetes guidelines: A cluster-randomized trial-based cost-effectiveness analysis. Diabet Med. 2006;23:164–70.
Eccles M, Hawthorne G, Whitty P, Steen N, Vanoli A, Grimshaw J, et al. A randomised controlled trial of a patient based Diabetes Recall and Management System: the DREAM trial: a study protocol [ISRCTN32042030]. BMC Health Serv Res. 2002;2(1):5.
Feldman RD, Zou GY, Vandervoort RK, Wong CJ, Nelson SE, Feagan BG. A simplified approach to the treatment of uncomplicated hypertension: a cluster randomized, controlled trial. Hypertension. 2009;53:646–53.
Fihn SD, Bucher JB, McDonell M, Diehr P, Rumsfeld JS, Doak M, et al. Collaborative Care Intervention for Stable Ischemic Heart Disease. Arch Intern Med. 2011;171(16):1471–9.
Fretheim A, Oxman AD, Håvelsrud K, Treweek S, Kristoffersen DT, Bjørndal A. Rational prescribing in primary care (RaPP): A cluster randomized trial of a tailored intervention. PLoS Med. 2006;3(6):0783–91.
Fretheim A, Oxman AD, Treweek S, Bjørndal A. Rational Prescribing in Primary Care (RaPP-trial). A randomised trial of a tailored intervention to improve prescribing of antihypertensive and cholesterol-lowering drugs in general practice [ISRCTN48751230]. BMC Health Serv Res. 2003;3:5–13.
Fretheim A, Oxman AD, Flottorp S. Improving prescribing of antihypertensive and cholesterol-lowering drugs: a method for identifying and addressing barriers to change. BMC Health Serv Res. 2004;4(1):23.
Gill JM, Chen YX, Glutting JJ, Diamond JJ, Lieberman MI. Impact of decision support in electronic medical records on lipid management in primary care. Popul Health Manag. 2009;12(5):221–6.
Harris SB, Leiter LA, Webster-Bogaert S, Van DM, O’Neill C. Teleconferenced educational detailing: diabetes education for primary care physicians. J Contin Educ Health Prof. 2005;25:87–97.
Hayes RP, Baker DW, Luthi JC, Baggett RL, McClellan W, Fitzgerald D, et al. The effect of external feedback on the management of medicare inpatients with congestive heart failure. Am J Med Qual. 2002;17:225–35.
Headrick LA, Speroff T, Pelecanos H, Cebul RD. Efforts to improve compliance with the national cholesterol education program guidelines. Arch Intern Med. 1992;152:2490–96.
Hendriks JML, De Wit R, Crijns H, Vrijhoef H, Prins M, Pisters R, et al. Nurse-led care vs. usual care for patients with atrial fibrillation: Results of a randomized trial of integrated chronic care vs. routine clinical care in ambulatory patients with atrial fibrillation. Eur Heart J. 2012;33:2692–9.
Leonardis D, Mallamaci F, Enia G, Postorino M, Tripepi G, Zoccali C. The MAURO study: Baseline characteristics and compliance with guidelines targets. J Nephrol. 2012;25(5):1081–90.
Levine DA, Funkhouser EM, Houston TK, Gerald JK. Improving Care After Myocardial Infarction Using a 2-Year Internet-Delivered Intervention. Arch Intern Med. 2014;171(21):1910–7.
Ornstein S, Jenkins RG, Nietert PJ, Feifer C, Roylance LF, Nemeth L. Improving Patient Care A Multimethod Quality Improvement Intervention To Improve Preventive Cardiovascular Care. Ann Intern Med. 2004;141:523–32.
Petersen LA, Simpson K, Pietz K, Urech TH, Hysong SJ, Profit J, et al. Effects of individual physician-level and practice-level financial incentives on hypertension care: a randomized trial. JAMA. 2013;310(10):1042–50.
Petersen LA, Urech L, Simpson K, Pietz K, Hysong SJ, Profit J, et al. Design, rationale, and baseline characteristics of a cluster randomized controlled trial of pay for performance for hypertension treatment: study protocol. Implement Sci. 2011;6(1):114.
Peters-Klimm F, Campbell S, Müller-Tasch T, Schellberg D, Gelbrich G, Herzog W, et al. Primary care-based multifaceted, interdisciplinary medical educational intervention for patients with systolic heart failure: lessons learned from a cluster randomised controlled trial. Trials. 2009;10:68.
Peters-Klimm F, Müller-Tasch T, Remppis A, Szecsenyi J, Schellberg D. Improved guideline adherence to pharmacotherapy of chronic systolic heart failure in general practice - Results from a cluster-randomized controlled trial of implementation of a clinical practice guideline. J Eval Clin Pract. 2008;14:823–9.
Reutens AT, Hutchinson R, Van Binh T, Cockram C, Deerochanawong C, Ho LT, et al. The GIANT study, a cluster-randomised controlled trial of efficacy of education of doctors about type 2 diabetes mellitus management guidelines in primary care practice. Diabetes Res Clin Pract. 2012;98(1):38–45.
Rood E, Bosman R, Van der Spoel J, Taylor P, Zandstra D. Use of a computerized guideline for glucose regulation in the ICU improved both guideline adherence and glucose regulation. J Am Med Inform Assoc. 2005;12:172–80.
Rossi RA, Every NR. A computerized intervention to decrease the use of calcium channel blockers in hypertension. J Gen Intern Med. 1997;12:672–8.
Simon SR, Majumdar SR, Prosser LA, Salem-Schatz S, Warner C, Kleinman K, et al. Group versus individual academic detailing to improve the use of antihypertensive medications in primary care: A cluster-randomized controlled trial. Am J Med. 2005;118:521–8.
Steyn K, Lombard C, Gwebushe N, Fourie JM, Everett-Murphy K, Zwarenstein M, et al. Implementation of national guidelines, incorporated within structured diabetes and hypertension records at primary level care in Cape Town, South Africa: A randomised controlled trial. Glob Health Action. 2013;6:1–9.
Svetkey LP, Pollak KI, Yancy WS, Dolor RJ, Batch BC, Samsa G, et al. Hypertension improvement project: Randomized trial of quality improvement for physicians and lifestyle modification for patients. Hypertension. 2009;54:1226–33.
Tierney WM, Overhage JM, Murray MD, Harris LE, Zhou X, Eckert GJ, et al. Effects of computerized guidelines for managing heart disease in primary care. J Gen Intern Med. 2003;18:967–76.
van Bruggen R, Gorter KJ, Stolk RP, Verhoeven RP, Rutten GE. Implementation of locally adapted guidelines on type 2 diabetes. Fam Pract. 2008;25:430–7.
van Steenkiste B, van der Weijden T, Stoffers HEJH, Kester ADM, Timmermans DRM, Grol R. Improving cardiovascular risk management: a randomized, controlled trial on the effect of a decision support tool for patients and physicians. Eur J Cardiovasc Prev Rehabil. 2007;14:44–50.
Verweij LM, Proper KI, Weel AN, Hulshof CTJ, van Mechelen W. Long-term effects of an occupational health guideline on employees’ body weight-related outcomes, cardiovascular disease risk factors, and quality of life: results from a randomized controlled trial. Scand J Work Environ Health. 2013;39(3):284–94.
Verweij LM, Proper KI, Weel ANH, Hulshof CTJ, van Mechelen W. Design of the Balance@Work project: systematic development, evaluation and implementation of an occupational health guideline aimed at the prevention of weight gain among employees. BMC Public Health. 2009;9:461.
Kiessling A, Lewitt M, Hendriksson P. Case-based training of evidence-based clinical practice in primary care with decreased mortality in patients with coronary heart disease. Ann Fam Med. 2011;9:211–18.
Roumie C, Elasy T, Greevy R, Griffin M, Liu X, Stone W, et al. Improving Blood Pressure Control through Provider Education, Provider Alerts, and Patient Education. Ann Intern Med. 2006;145:165–75.
Bonds D, Hogen P, Bertoni A, Chen H, Clinch C, Hiott A, et al. A multifaceted intervention to improve blood pressure control: The Guideline Adherence for Health Health (GLAD) study. Am J Manag Care. 2010;157(2):278–84.
Eaton C, Parker D, Borkan J, McMurray J, Roberts M, Lu B, et al. Translating Cholesterol Guidelines Into Primary Care Practice: A Multimodal Cluster Randomized Trial. Ann Fam Med. 2011;9:528–37.
Berwanger O, Guimaraes H, Larangeira L, Cavalcanti A, Kodama A, Zazula A, et al. Effect of a multifaceted intervention on use of evidence-based therapies in patients with acute coronary syndromes in Brazil: The BRIDGE-ACS randomized trial. JAMA. 2012;307(19):2041–49.
Goldstein M, Lavori P, Coleman R, Advani A, Hoffman B. Improving adherence to guidelines for hypertension drug prescribing: cluster-randomized controlled trial of general versus patient-specific recommendations. Am J Manag Care. 2005;11:677–85.
Squires JE, Sullivan K, Eccles MP, Worswick J, Grimshaw JM. Are multifaceted interventions more effective than single-component interventions in changing health-care professionals’ behaviours? An overview of systematic reviews. Implement Sci. 2014;9:152.
Reiner Z, Sonicki Z, Tedeschi-Reiner R. Physicians perception, knowledge and awareness of cardiovascular risk factors and adherence to prevention guidelines: The PERCRO-DOC survey. Atherosclerosis. 2010;213:598–603.
Okelo SO, Butz AM, Sharma R, Diette GB, Pitts SI, King TM, et al. Interventions to modify health care provider adherence to asthma guidelines. Rockville (MD): AHRQ Publication. 2013;95.
Ambroggio L, Thomson J, Murtagh Kurowski E, Courter J, Statile A, Graham C, et al. Quality improvement methods increase appropriate antibiotic prescribing for childhood pneumonia. Pediatrics. 2013;131:e1623–31.
We acknowledge the assistance of Robin Parker for advice during the creation of our search strategy. RAJ received funding from the DMRF Leo Alexander Summer Research Studentship. JH held funding from the Nova Scotia Health Research Foundation to support local systematic review activities. MJT and GHC received funding through the RIM summer research program. CVZ has received a research grant through Boehringer-Ingelheim. All funding bodies had no influence on the conception, design or interpretation of data.
RAJ received funding from the DMRF Leo Alexander Summer Research Studentship. JAH held funding from the Nova Scotia Health Research Foundation to support local systematic review activities. MJT and GHC received funding through the RIM summer research program. CVZ has received a research grant through Boehringer-Ingelheim. All funding bodies had no influence on the conception, design or interpretation of data
CVZ received a research grant through Boehringer-Ingelheim. All other authors declare no conflicts of interest.
RAJ conceived of the study and its design, coordinated and participated in data extraction and carried out statistical analyses, and drafted the manuscript. MJT participated in screening and data extraction. GHC participated in screening. CT participated in screening. AC participated in data extraction. CVZ helped conceive of the study. JH helped plan the design and data analysis, and helped draft the manuscript. All authors read, revised, and approved the final manuscript.
RAJ, GHC and MJT are medical students at Dalhousie University. CT is an undergraduate science student at St. Mary’s University. JH is an associate professor in Epidemiology at Dalhousie University and is head of the Nova Scotia Cochrane Resource Centre. CVZ is a general internist and an assistant professor in the Department of Medicine at Dalhousie University.
Availability of data and materials