- Research article
- Open Access
- Open Peer Review
Controlled trial of the impact of a BC adult mental health practice support program (AMHPSP) on primary health care professionals’ management of depression
BMC Family Practicevolume 19, Article number: 183 (2018)
Depression affects over 400 million people globally. The majority are seen in primary care. Barriers in providing adequate care are not solely related to physicians’ knowledge/skills deficits, but also time constraints, lack of confidence/avoidance, which need to be addressed in mental health-care redesign. We hypothesized that family physician (FP) training in the Adult Mental Health Practice Support Program (AMHPSP) would lead to greater improvements in patient depressive symptom ratings (a priori primary outcome) compared to treatment as usual.
From October 2013 to May 2015, in a controlled trial 77 FP practices were stratified on the total number of physicians/practice as well as urban/rural setting, and randomized to the British Columbia AMHPSP⎯a multi-component contact-based training to enhance FPs’ comfort/skills in treating mild-moderate depression (intervention), or no training (control) by an investigator not operationally involved in the trial. FPs with a valid license to practice in NS were eligible. FPs from both groups were asked to identify 3–4 consecutive patients > 18 years old, diagnosis of depression, Patient Health Questionnaire (PHQ-9) score ≥ 10, able to read English, intact cognitive functioning. Exclusion criteria: antidepressants within 5 weeks and psychotherapy within 3 months of enrollment, and clinically judged urgent/emergent medical/psychiatric condition. Patients were assigned to the same arm as their physician. Thirty-six practices recruited patients (intervention n = 23; control n = 13). The study was prematurely terminated at 6 months of enrollment start-date due to concomitant primary health-care transformation by health-system leaders which resulted in increased in-office demands, and recruitment failure. We used the PHQ-9 to assess between-group differences at baseline, 1, 2, 3, and 6 months follow-up. Outcome collectors and assessors were blind to group assignment.
One hundred-and-twenty-nine patients (intervention n = 72; control n = 57) were analysed. A significant improvement in depression scores among intervention group patients emerged between 3 and 6 months, time by treatment interaction, likelihood ratio test (LR) chi2(3) = 7.96, p = .047.
This novel skill-based program shows promise in translating increased FP comfort and skills managing depressed patients into improved patient clinical outcomes⎯even in absence of mental health specialists availability.
The World Health Organization (WHO) recognizes mental illness as becoming the number one cause of years-lived with disability worldwide by 2020 [1,2,3]. Depression is one of the most prevalent and costly conditions, affecting over 400 million people globally [4,5,6]. Concurrent with other physical and psychiatric conditions, there is higher morbidity and cost to the healthcare system . These facts underscore the need for evidence-based strategies that promote early recognition and treatment, thereby improving patient outcomes [1, 6]. Thus, integration of mental health in primary care is ideal and has been an area of focus in mental healthcare redesign that strengthens patient-centered, evidence-based, sustainable care. Family physicians (FPs) see over 85% of these patients, and the majority can be handled early and effectively in this setting [8,9,10,11,12,13,14,15]. Most patients experience less stigma and increased comfort sharing problems with their doctor with whom they have established trust [16,17,18]. However, even when the diagnosis is made, less than 20% receive adequate treatment . In one study conducted in 21 countries, respondents who met DSM-IV criteria for major depressive disorder (MDD) within 12 months before the interview, only 16.5% received minimally adequate treatment as defined by evidenced-based guidelines [i.e. receiving either pharmacotherapy (for a minimum of 1 month, plus 4 visits with any type of medical doctor) or psychotherapy (for a minimum of 8 visits with any professional including religious or spiritual advisor, social worker or counsellor)]. Other studies have shown that although FPs commonly prescribe antidepressants,  in mild/moderate cases antidepressants are not necessarily associated with improved long-term outcomes, [21,22,23,24]. Studies suggest that cognitive behaviour therapy (CBT) has an enduring effect with lower rates of relapse, that many patients prefer non-drug options,  and where clinically appropriate, patient choice of evidence-based options improves outcomes .
The extent to which training programs lead to practice changes or improved clinical outcomes remains questionable [27,28,29,30,31]. Barriers in providing adequate care are not solely related to physicians’ knowledge deficits, but as a result of complex interdependent factors. There are physician factors, e.g., in-office time constraints, a large number of domains to which they extend care, mental and physical health conditions being intertwined and thereby confusing symptoms; systems support factors, e.g., lack of mental health specialists, ineffective interdisciplinary teams, funding, legislation [32, 33]; and patient factors, e.g., stigma as a barrier to help-seeking, patients lack of disclosure sensing physicians’ time pressures, costly uninsured services [10, 31, 34, 35].
Training programs with top-down and bottom-up approaches such as the British Columbia (BC) Adult Mental Health Practice Support Program (AMHPSP) show the most promise as the program expands well beyond a simple education program or workshop [36, 37]. Physicians are trained to manage mild-moderate depression and anxiety disorders on their own within office time constraints by coaching patients through supported CBT-based self-management strategies. They flexibly use tools and strategies with or without antidepressants, reflecting a “real world” scenario, [38,39,40] and the program is based on the quality improvement framework of plan-do-study-act shown to effectively affect change [41,42,43,44,45,46,47,48] by offering FP opportunities to practice new skills immediately after the training sessions within the scope of their practice. A practice support coordinator provides on-site, in-practice support during action periods to help implement and sustain these changes [31, 49,50,51]. Patients are engaged through guided self-management strategies, which is key for effective chronic illness care [52,53,54,55,56,57]. Finally, physicians are compensated to attend training. In a realistic context where physicians are responsible on their own to manage these patients, or while patients wait to be seen by specialty services, we —were looking to evaluate—in a real-world environment—if training in the AMHPSP improves patient clinical outcomes. The training would provide physicians another feasible non-drug treatment option in their armamentarium.
While qualitative evaluations of the AMHPSP conducted in BC report a positive impact on several key outcomes , the program has not been rigorously evaluated through a controlled trial The NS Department of Health & Wellness and Mental Health Commission of Canada therefore sponsored a trial to evaluate its effectiveness.
The first published part of our study shows a significant improvement (diminishment) in intervention-group physicians’ preference for social distance, and significant increases in perceived confidence and comfort managing mental illness . In this part of the study, we sought to determine whether training FPs in the AMHPSP would lead to greater improvements in patient depression scores (primary outcome in this part of the study) compared to the control group. This paper also focuses on patients’ satisfaction with care received, and physicians’ antidepressants prescribing. A third part of the study consisting of a health economic analysis is underway.
We chose a cluster RCT design (randomized practices) as the impact of intervention might bring about practice pattern changes. In the component of the study looking at patient outcomes we planned an individual-level analysis of depressive symptoms, accounting for the clustering of patients within practices, since this seemed more clinically salient than practice-level outcomes in this part of the analysis. An implication of this decision, however, is that the full benefits of randomization are lost since the unit of analysis differs from the unit of randomization.
Aim, study design and setting
The aim of this study was to evaluate whether training family physicians (FPs) in the AMHPSP would lead to greater improvements in patients’ depression scores (primary outcome) compared to the control group.
This was a multicentre two-parallel group, controlled trial in which practices were randomly allocated to the intervention arm (INT) or control arm and allocation was masked in the outcome assessment. Physicians in practices assigned to the intervention group attended the AMHPSP training whereas physicians assigned to the control group continued with treatment as usual (TAU).
Seventy-seven NS community-based family practices identified through associations, presentations, and promotional letters. Interested physicians provided written informed consent and enrolled between October 2013 and January 2014 (111 FP). Physicians actively seeing patients remunerated by any method (fee-for-service/alternative funding program etc.) with a NS practice license were eligible to participate.
Eligible patients were identified by their physician. Inclusion criteria included over 18 years of age, diagnosis of depression, PHQ-9 score ≥ 10, ability to read/speak English (grade 6 level), intact cognitive functioning (physician judgment). Exclusion criteria included active treatment with antidepressants within 5 weeks and psychotherapy within 3 months of enrollment, urgent/emergent medical or psychiatric condition (physician judgment). Patients were enrolled between June 2014 and May 2015, with the last follow-up visit in November 2015.
Practice recruitment, randomization and masking
Seventy-seven practices (111 community-based FP) were enrolled. Practice allocation was concealed at cluster level through a unique practice number (1–77) assigned by the principal Investigator (PI): B.L-H. Practices were stratified on number of physicians/practice, as well as urban and rural setting before randomization. An investigator (SP) not involved in trial operations assigned the randomization sequence. STATA, version 12 (College Station, TX, 2012) was used to generate the randomization sequence from a binomial distribution—probability of success of 0.5.
Patients and physicians’—assigned unique identifier codes—were linked to their corresponding practice number. The PI kept a master file containing participant names with ID codes in a secure location. Study databases contained de-identified information. We could not conceal arm allocation from physicians for obvious reasons. However, the RC (data collector) and outcome assessors (independent researchers) were blinded to group assignment. In addition—although we could not guarantee patient blinding—physicians were asked not to disclose group allocation to their patients.
Practices ranged from 1 to 6 physicians (INT), and 1–8 physicians (Control). Thirty-nine practices were allocated to the intervention group, and 38 to the control group. Nine percent of targeted practices withdrew prior to intervention delivery. The main reason; lack of time for study specific requirements. Only 23 of 36 (64%) of intervention and 13 of 34 (38%) of control practices recruited patients for the same reason (Fig. 1). Physician baseline characteristics such as age, gender, years of practice, pattern of work (full-time, part-time etc.), practice size, number of unique annual patients were collected.
Between February–June 2014, physicians in practices assigned to the intervention group attended three half-day interactive workshops delivered by the BC team, the Adult Mental Health Practice Support Program (AMHPSP). The AMHPSP consists of three half-day interactive workshops delivered by the BC team, interspaced by 5–6 week action periods during which physicians practiced what they learned. The program introduces an organized approach that takes learners through a problem and strength-based assessment to the development of an action plan. Key components included 3 supported self-management strategies for mild to moderate depression and anxiety meant to help shift responsibility from primary care provider to a shared responsibility with the patients engaging them in illness management and their recovery; the Cognitive Behavioral Interpersonal Skills workbook incorporating a comprehensive mental illness screening tool and patient user friendly supported self-management handouts based on evidence-based cognitive behavioural therapy principles; the Canadian Mental Health Association (CMHA) Bounce Back program, a telephone guided CBT-based service; and an Antidepressant Skills Workbook . Contact-based education occurred through first-voice advocates sharing their journey . Office staff members attended the training and Mental Health First Aid  to increase their comfort caring for patients. Local psychiatrists and allied health professionals (counsellors, psychologists, clinicians etc.) attended training solely to familiarize themselves with the program. During action periods, a coordinator offered on-site guidance on practical office redesign to enhance the implementation of new learnings and tools, and shares experiences, challenges, and recommendations with stakeholders. Physicians had flexibility to use tools and strategies as clinically judged. Intervention group FPs received a learning stipend (CAN$3274.20) to participate in workshops and action periods but remunerated through usual methods to manage their patients. The control group practices received the training November 2015 (at study end) including the learning stipend.
Once the intervention group completed the training (June 2014), all FPs from both intervention and control groups were asked to identify 3–4 consecutive patients with a clinical diagnosis of depression, and a Patient Health Questionnaire PHQ-9 score ≥ 10. To minimize damaging the doctor/patient relationship (patients refusing or feeling-pressured to participate ), willing patients’ were contacted by the research coordinator (RC) who described the study, administered and obtained written consent, and assessed study eligibility. Eligible patients were assigned to the same arm as their physician. Once enrolled, patients’ own FP continued to manage the depression. A total of 169 patients were eligible to participate. Forty of 169 (24%) declined or did not return calls to complete baseline data. We enrolled 129 patients (intervention n = 72, control n = 57) all included in the analysis (Fig. 1).
For depression scores (primary outcome), we used the PHQ-9. The PHQ-9 covers the nine DSM-5 symptom-based criteria for major depressive disorder. Total score range: 0–27; 0–4 not depressed; 5–9 mild; 10–14 moderate; 15–19 moderate-severe; 20–27 severe [63,64,65,66]. (Score ≥ 10; sensitivity 88%, specificity; 88%; positive likelihood ratio, 7.1). During scale development, criterion validity was assessed against the Structured Clinical Interview (SCID) [66, 67].
Occupational/general functioning (secondary outcomes) were assessed with the Lam Employment Absence and Productivity Scale (LEAPS) and the Sheehan Disability Scale (SDS) respectively. The LEAPS⎯a 7-item scale⎯assesses workplace impact of major depression . Total score range = 0–28; 0–5 = none-minimal impairment; 6–10 = mild; 11–16 = moderate; 17–22 = severe; 23–28 = very severe. The SDS rates disruption (0–10) in each domain⎯work/school; social/leisure activities; family life/home responsibilities, (Total score range = 0–30; lower scores signify less disruption) .
Physician frequency of antidepressant prescribing, patient satisfaction, and quality of life (exploratory outcomes), were assessed with the Client Service Receipt Inventory, an extensively validated inventory,  the Client Satisfaction Inventory (CSI), and the Medical Outcomes Study Short-Form (SF-36) respectively [71,72,73]. Outcome measures were collected at baseline, 1, 2, 3, 6 months. All scales are validated as patient self-report, as well as telephone-collection methods. Patients could complete questionnaires over the phone, in writing or digitally online.
The study was prematurely terminated in May 2015 for the following reasons. Patient recruitment completely stopped within 6 months of the enrollment start-date due to concomitant primary care health-care transformation by health-system leaders. This resulted in physicians’ reports of requiring more time for each type of appointment in order to effectively provide quality comprehensive care within in-office time constraints, thus reducing available time they could allocate to the study. The research team’s substantial efforts to re-engage physicians through evidenced-based recruitment “Best-Practices” had minimal impact. We therefore choose to report results and our challenges as useful information for future study designs, and as an exploratory assessment of the intervention.
The NS Multisite and University of Calgary Research Ethics Boards approved this study, registration www.clinicaltrials.gov #NCT01975948.
We calculated a sample size of 100 evaluable patients/arm to achieve 80% power to detect between-group differences in PHQ-9 mean of 2 points, with a significance level (α) of .05, 2-sided test, and assumed standard deviation of 5 points. A compensatory increase to 166 patients/arm was needed using a design effect of 1.1 (intra cluster correlation of 0.05 for patient outcomes based on a study by Murphey et al.,  and 3 patients/practice on average), and the assumption that 66% of patients would provide adequate follow-up data, accounting for attrition.
Between-group mean differences of PHQ-9 scores during follow-up were assessed as a group-by-time interaction. In order to take advantage of the multiple measures of data, we used a multi-level mixed-model analysis⎯with patients clustered within practices and PHQ-9 ratings clustered within patients. As the pattern of improvement over time was not expected to be linear, time points were represented in the model using indicator variables. The baseline assessment was not included in the outcome assessment except as a covariate (even though it also included a PHQ-9 rating) since these ratings occurred prior to the intervention. We conducted a modified intention to treat analysis, including all respondents who provided at least one follow-up rating. The effect of the intervention was measured as series of 3 study group by time interactions, using a likelihood ratio (LR) test to test the significance of the treatment by time interaction terms. This test produced the p-value used to assess the statistical significance of observed differences. Occupational, general functioning, quality of life, and client satisfaction were analyzed using the same model. Antidepressant use at any time during the 6 month study period was treated as a binary variable (Y/N). Data was analysed (SP, SK) using STATA, version 14 (College Station, TX, 2015).
Since attrition occurred during follow-up, we conducted a sensitivity analysis using last observation carried forward imputation of post-attrition PHQ-9 ratings and also conducted an analysis of completers only.
One between-group difference was observed. Physicians assigned to intervention group were more likely to work in small practices due to one large practice being randomly assigned to the control group. Twenty-four of 36 practices (67%) who recruited patients were individual-practice FPs (Table 1).
Patients were predominantly female, employed, and post-secondary educated. There were no clinically meaningful between-group differences, except that a higher proportion of control group participants were employed as compared to intervention group participants (Table 2). Also, participants with complete follow-up data tended to be in smaller practices, had somewhat lower baseline PHQ-9 scores, and were more likely to identify as married/common-law.
PHQ-9 scores diminished in both groups (Fig. 2). The treatment group, however, had a progressive diminishment in mean PHQ-9 scores, whereas the control group did not continue to decrease after the 3-month follow-up visit. The multi-level mixed model results were reflective of a significant treatment effect (LR for treatment group by time interactions, chi2(3) = 7.96, p = .047), which was essentially unchanged after adjusting for baseline depressive symptoms (LR Chi2(3) = 9.04, p = 0.029). Addition of age categories and sex to the model (the age categories were depicted in the dataset using indicator variables representing six age groups) did not change the result (LR for treatment group by time interactions terms, chi2(3) =10.40, p = 0.006). Consistent with the pattern seen in Fig. 2, which suggests that differences were only evident in the final time interval, removal of the first 2 time-by-treatment group interactions did not significantly affect the fit of the models, e.g. for the model with adjustments for age, sex and baseline depressive symptoms (LR comparing the original to the reduced model, chi2(1) = 1.07, p = 0.301), indicating no significant loss of fit with removal of the two interaction terms.
Because of the imbalance in employment observed in Table 2, the analysis was repeated including an indicator term for full time employment status. The results were unchanged: LR chi2(3) = 10.37, Prob > chi2 = 0.0157.
Between-group changes on LEAPS and SDS, SF-36, and CSI were not significantly different (See Additional file 1).
Antidepressant use at any time during the 6 months study period was significantly lower in the intervention group compared to the control group Fisher’s exact test, p = 0.003. (Control group = 68.4%; Intervention group = 41.7%). In a sensitivity analysis using LOCF imputation there was no evidence of a treatment effect as assessed by the three group by time interactions (LR for the treatment group by time interactions, chi2(3) = 5.28, Prob > chi2 = 0.153). However, in the completer analysis, the effect remained significant: LR for the treatment group by time interactions chi2(3) = 7.96, Prob > chi2 = 0.047. Fifty-one percent of INT patients used program tools/strategies. The top 3 were CBT-based with BounceBack being highest (51% of patients who used tools, 26% of INT patients) (Table 3).
Results of this study provide tentative evidence of the AMHPSP’s effectiveness in improving patient depression scores. A large majority of INT patients (71%) reported using the program tools and strategies, the most frequently used was the BounceBack program (Table 3). Anecdotal FP reports suggested that BounceBack program offers increased support by shared patient management. PHQ-9 scores diminished in both groups from baseline to 3 months due to the episodic nature of depression expected to cause regression to the mean, and possibly as a result of placebo responders through repeated encounters with the research data collector. In psychiatric disorders such as depression, this non-specific treatment effect is a well-recognized component in all psychotherapeutic encounters . The treatment group, however, had a progressive diminishment in mean PHQ-9 scores, whereas the control group did not continue to decrease after the 3-month follow-up visit (Fig. 1).
Further research is needed in this area as our study did not achieve its pre-planned sample size, lending to the possibility of Type II error. Also, the effect observed was small only evident at a single time interval, between 3 and 6 months, a finding that may have occurred as a result of Type I error. There was substantial attrition, and LOCF imputation did not result in preservation of the effect. However, the pattern of between-group change in mild/moderate depression scores over time is suggestive of a possible treatment effect. Furthermore, these changes occurred despite reduced prescribing of medication by FPs. (Table 3) Participants with complete follow-up data had somewhat lower baseline PHQ-9 scores, which is consistent with the AMHPSP’s target population: mild to moderate depression, hence future studies should consider including only this group. Future studies should also strongly consider using a practice-level unit of analysis since randomization in such trials must by necessity occur at the practice level.
In a context where collaborative care has proven difficult, (e.g., where primary care is delivered in independent practice settings and/or no funding mechanisms for collaborative care arrangements, we were looking at ways of implementing time-efficient evidence-based strategies to increase physicians’ comfort and skills, decreasing anxiety/avoidance treating highly prevalent depression conditions. We do not feel there are or will ever be enough mental health physicians/clinicians to support FPs especially in rural and remote areas. Therefore, responsibility to care for the mentally ill largely rests with family physicians. We hear time and again that primary care knowledge gaps contribute to unrecognized and undertreated mental illness. However, training efforts aimed to improve mental health management and patient outcomes remain questionable . Training efforts need to include time efficient tools FPs can feasibly implement in the realistic context of a busy practice.
The AMHPSP cannot address all barriers, however it is novel recognizing that FPs need in-practice support that expand well beyond a simple education program or workshop. It includes many theoretically crucial ingredients required to fill knowledge gaps, through organized training that creates a substantial sustainable change, in the delivery of patient-centered respectful care, by FPs that fits their busy schedule, targets stigma, and supports physicians and patients through incentives, resources, and tools engaging patients in recovery efforts. Most patients want to participate in their recovery. Where better to learn the skills than in a trusted, safe place with their physician, even in settings where access to specialty care is difficult or unavailable?
To our knowledge, this study is the first RCT of its kind specifically evaluating a practice support program focusing on mental health as it is meant to be used in a real-world environment. We believe this provides insight on the potential impact of the AMHPSP training on patients’ clinical outcomes and practical applicability of delivering the program in primary care. Furthermore improvement in depression scores occurred despite reduced prescribing of medication by FPs which suggests possible cost offsets due to reduced prescribing costs (Table 3). Also, prior analyses indicated reductions in social distance preferences and increased confidence and comfort with the training, beneficial effects not captured by the analysis of patient-reported outcomes presented here58.
First, this was a controlled trial, but randomization occurred at the practice level rather than individual patients. Because the analysis occurred at the level of patients, the benefits of randomization (equal distribution of confounding variables) cannot be assumed to have fully manifested in the analysis. Indeed, as some practices failed to recruit patients at all, the patient data analysis may have been influenced by selection bias despite the randomization. Whereas the random assignment would help ensure that the practices assigned to each group had similar characteristics, including unmeasured ones, it does not ensure that the ones that recruited patients were comparable on such characteristics. The significant difference in PHQ-9 scores was observed later in follow-up, at which point some physician and patient attrition had occurred, and this attrition may have caused bias. The lack of significant effects in a sensitivity analysis using LOCF imputation heightens these concerns. In addition, the there was an imbalance in patient group sizes (intervention n = 72, Control n = 57) which could have further affected the specific effects of the intervention compared to TAU (Fig. 1). However, the mixed model analysis methods permits the use of all data (e.g. data points from earlier in follow-up even when lost to follow-up), and may help to control bias that may arise due to attrition.
As noted above, future studies randomizing such interventions by practice should consider the use of practice-level outcome measures that would allow the analysis to derive full benefit from the randomization, a larger sample size and employ effective strategies to prevent attrition, especially since the benefits of this type of intervention may unfold over a time frame of several months. Third, physician participants were volunteers receiving a learning stipend, therefore may not be representative of FPs in general, may have a special interest in the subject matter. Although some aspects of the study could not be blinded, performance bias was minimized by data collector and outcome assessors blinding as well as the use of widely validated scales⎯more specifically the PHQ-9 for our primary outcome. We took measures also to minimize the risk of patient selection bias by asking physicians to identify 3 consecutive patients with a diagnosis of depression.
Finally, a longer patient follow-up period may be important to shed light if divergence of depression scores would further increase, or reveal a significant difference in quality of life/occupational functioning as these outcomes may take longer to improve. Since the study sample consisted mostly of white, married, middle-age females, there should be caution in generalizing results beyond this group. However, the approach is applicable to all prepaid health insurance plans in the US and to Canada’s single payer system .
In assessing satisfaction, most patients reported high baseline physician satisfaction⎯ceiling effect. An outcome measure specific to mental healthcare would have been a better choice.
This study provides preliminary evidence that well-designed novel skills-based PSPs that promote integration of mental health into primary care may contribute to mental health strategies in improving mental health care. It also highlights the difficulties in evaluating community-delivered interventions.
Adult mental health practice support program
cognitive behaviour therapy
Canadian mental health association
Client satisfaction inventory
Lam employment absence and productivity scale
last observation carried forward
likelihood ratio t
Patient health questionnaire-9
Structured clinical interview
Sheehan disability scale
Medical outcomes study short-form
Treatment as usual
Murray CJL, Barber RM, Foreman KJ, Ozgoren AA, Abd-Allah F, Abera SF, et al. Global, regional, and national disability-adjusted life years (DALYs) for 306 diseases and injuries and healthy life expectancy (HALE) for 188 countries, 1990–2013: quantifying the epidemiological transition. Lancet. 2015;386:2145–91.
Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, et al. Global burden of disease attributable to mental and substance use disorders: findings from the global burden of disease study 2010. Lancet. 2013;382:1575–86.
Depression in Europe [Internet]. 2012 [cited 2018 May 26]. Available from: http://www.euro.who.int/en/health-topics/noncommunicable-diseases/mental-health/news/news/2012/10/depression-in-europe
Lim K-L, Jacobs P, Ohinmaa A, Schopflocher D, Dewa CS. A new population-based measure of the economic burden of mental illness in Canada. Chronic Dis Can. 2008;28:92–8.
Kessler RC, Aguilar-Gaxiola S, Alonso J, Chatterji S, Lee S, Ormel J, et al. The global burden of mental disorders: an update from the WHO world mental health (WMH) surveys. Epidemiol Psichiatr Soc. 2009;18:23–33.
Principaux repères sur la dépression [Internet]. World Health Organ. [cited 2018 May 25]. Available from: http://www.who.int/fr/news-room/fact-sheets/detail/depression
Naylor C. SP0115 the link between long-term conditions and mental health. Ann Rheum Dis. 2013;71:28–9.
Barr MS. The need to test the patient-centered medical home. JAMA. 2008;300:834–5.
Iglehart JK. No place like home--testing a new model of care delivery. N Engl J Med. 2008;359:1200–2.
Unützer J, Park M. Strategies to improve the management of depression in primary care. Prim Care. 2012;39:415–31.
Kauye F, Jenkins R, Rahman A. Training primary health care workers in mental health and its impact on diagnoses of common mental disorders in primary care of a developing country, Malawi: a cluster-randomized controlled trial. Psychol Med. 2014;44:657–66.
Butler M, Kane RL, McAlpine D, Kathol RG, Fu SS, Hagedorn H, et al. Integration of mental health/substance abuse and primary care. Evid Rep Technol Assess. 2008:1–362.
Unutzer J, Katon WJ, Fan M-Y, Schoenbaum MC, Lin EHB, Della Penna RD, et al. Long-term cost effects of collaborative care for late-life depression. Am J Manag Care. 2008;14:95–100.
WHO | Integrating mental health into primary care: a global perspective [Internet]. WHO. [cited 2018 May 26]. Available from: http://www.who.int/mental_health/policy/services/integratingmhintoprimarycare/en/
Mental Health and Addictions Strategy | novascotia.ca [Internet]. [cited 2018 May 26]. Available from: https://novascotia.ca/dhw/mental-health/mental-health-addiction-strategy.asp
Orleans CT, George LK, Houpt JL, Brodie HK. How primary care physicians treat psychiatric disorders: a national survey of family practitioners. Am J Psychiatry. 1985;142:52–7.
Azrin ST. Integrated care: high-impact mental health-primary care research for patients with multiple comorbidities. Psychiatr Serv Wash DC. 2014;65:406–9.
Jorm AF, Korten AE, Jacomb PA, Christensen H, Rodgers B, Pollitt P. “Mental health literacy”: a survey of the public’s ability to recognise mental disorders and their beliefs about the effectiveness of treatment. Med J Aust. 1997;166:182–6.
Mulsant BH, Whyte E, Lenze EJ, Lotrich F, Karp JF, Pollock BG, et al. Achieving long-term optimal outcomes in geriatric depression and anxiety. CNS Spectr. 2003;8:27–34.
Kendrick T, King F, Albertella L, Smith PW. GP treatment decisions for patients with depression: an observational study. Br J Gen Pract. 2005;55:280–6.
Schulberg HC, Block MR, Madonia MJ, Rodriguez E, Scott CP, Lave J. Applicability of clinical pharmacotherapy guidelines for major depression in primary care settings. Arch Fam Med. 1995;4:106–12.
Schulberg HC, Block MR, Madonia MJ, Scott CP, Lave JR, Rodriguez E, et al. The “usual care” of major depression in primary care practice. Arch Fam Med. 1997;6:334–9.
Fournier JC, DeRubeis RJ, Hollon SD, Dimidjian S, Amsterdam JD, Shelton RC, et al. Antidepressant drug effects and depression severity: a patient-level meta-analysis. JAMA. 2010;303:47–53.
Kirsch I, Deacon BJ, Huedo-Medina TB, Scoboria A, Moore TJ, Johnson BT. Initial severity and antidepressant benefits: a meta-analysis of data submitted to the Food and Drug Administration. PLoS Med. 2008;5:e45.
van Schaik DJF, Klijn AFJ, van Hout HPJ, van Marwijk HWJ, Beekman ATF, de Haan M, et al. Patients’ preferences in the treatment of depressive disorder in primary care. Gen Hosp Psychiatry. 2004;26:184–9.
Sherbourne CD, Wells KB, Duan N, Miranda J, Unützer J, Jaycox L, et al. Long-term effectiveness of disseminating quality improvement for depression in primary care. Arch Gen Psychiatry. 2001;58:696–703.
van Os TW, Ormel J, van den Brink RH, Jenner JA, Van der Meer K, Tiemens BG, et al. Training primary care physicians improves the management of depression. Gen Hosp Psychiatry. 1999;21:168–76.
Kroenke K, Taylor-Vaisey A, Dietrich AJ, Oxman TE. Interventions to improve provider diagnosis and treatment of mental disorders in primary care. A critical review of the literature. Psychosomatics. 2000;41:39–52.
Kalet AL, Gillespie CC, Schwartz MD, Holmboe ES, Ark TK, Jay M, et al. New measures to establish the evidence base for medical education: identifying educationally sensitive patient outcomes. Acad Med J Assoc Am Med Coll. 2010;85:844–51.
Sikorski C, Luppa M, König H-H, van den Bussche H, Riedel-Heller SG. Does GP training in depression care affect patient outcome? - a systematic review and meta-analysis. BMC Health Serv Res. 2012;12:10.
Crabtree BF, Nutting PA, Miller WL, McDaniel RR, Stange KC, Jaen CR, et al. Primary care practice transformation is hard work: insights from a 15-year developmental program of research. Med Care. 2011;49(Suppl):S28–35.
Phillips RL, Miller BF, Petterson SM, Teevan B. Better integration of mental health care improves depression screening and treatment in primary care. Am Fam Physician. 2011;84:980.
Chomienne M-H, Grenier J, Gaboury I, Hogg W, Ritchie P, Farmanova-Haynes E. Family doctors and psychologists working together: doctors’ and patients’ perspectives. J Eval Clin Pract. 2011;17:282–7.
Unützer J, Schoenbaum M, Druss BG, Katon WJ. Transforming mental health care at the interface with general medicine: report for the presidents commission. Psychiatr Serv Wash DC. 2006;57:37–47.
Pereira B, Andrew G, Pednekar S, Kirkwood BR, Patel V. The integration of the treatment for common mental disorders in primary care: experiences of health care providers in the MANAS trial in Goa, India. Int J Ment Health Syst. 2011;5:26.
Fortney J, Enderle M, McDougall S, Clothier J, Otero J, Altman L, et al. Implementation outcomes of evidence-based quality improvement for depression in VA community based outpatient clinics. Implement Sci IS. 2012;7:30.
Weinerman R, Campbell H, Miller M, Stretch J, Kallstrom L, Kadlec H, et al. Improving mental healthcare by primary care physicians in British Columbia. Healthc Q Tor Ont. 2011;14:36–8.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629.
Miller WL, Crabtree BF, McDaniel R, Stange KC. Understanding change in primary care practice using complexity theory. J Fam Pract. 1998;46:369–76.
Plsek P. Complexity and the Adoption of Innovation in Health Care. Paper presented at Accelerating Quality Improvement in Health Care: Strategies to Accelerate the Diffusion of Evidence-Based Innovations. Washington, D.C.: National Institute for Healthcare Management Foundation and National Committee for Quality in Health Care; 2003.
Ruggles B. The improvement guide: a practical approach to enhancing organizational performance. Qual Prog Milwaukee. 1998;31:108.
MacCarthy D, Weinerman R, Kallstrom L, Kadlec H, Hollander MJ, Patten S. Mental health practice and attitudes of family physicians can be changed! Perm J. 2013;17:14–7.
Alweis R, Greco M, Wasser T, Wenderoth S. An initiative to improve adherence to evidence-based guidelines in the treatment of URIs, sinusitis, and pharyngitis. J Community Hosp Intern Med Perspect [Internet]. 2014 [cited 2018 May 25];4. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3937558/
Ginsburg LR, Lewis S, Zackheim L, Casebeer A. Revisiting interaction in knowledge translation. Implement Sci IS. 2007;2:34.
Stange KC, Goodwin MA, Zyzanski SJ, Dietrich AJ. Sustainability of a practice-individualized preventive service delivery intervention. Am J Prev Med. 2003;25:296–300.
Parker LE, Kirchner JE, Bonner LM, Fickel JJ, Ritchie MJ, Simons CE, et al. Creating a quality-improvement dialogue: utilizing knowledge from frontline staff, managers, and experts to foster health care quality improvement. Qual Health Res. 2009;19:229–42.
Rubenstein LV, Mittman BS, Yano EM, Mulrow CD. From understanding health care provider behavior to improving health care: the QUERI framework for quality improvement. Quality Enhancement Research Initiative. Med Care. 2000;38:I129–41.
Mendel P, Meredith LS, Schoenbaum M, Sherbourne CD, Wells KB. Interventions in organizational and community context: a framework for building evidence on dissemination and implementation in health services research. Admin Pol Ment Health. 2008;35:21–37.
Walters ST, Matson SA, Baer JS, Ziedonis DM. Effectiveness of workshop training for psychosocial addiction treatments: a systematic review. J Subst Abus Treat. 2005;29:283–93.
Tamburrino MB, Nagel RW, Lynch DJ. Managing antidepressants in primary care: physicians’ treatment modifications. Psychol Rep. 2011;108:799–804.
Davis DA, Thomson MA, Oxman AD, Haynes RB. Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA. 1995;274:700–5.
Nicholas MK, Asghari A, Corbett M, Smeets RJEM, Wood BM, Overton S, et al. Is adherence to pain self-management strategies associated with improved pain, depression and disability in those with disabling chronic pain? Eur J Pain Lond Engl. 2012;16:93–104.
Turner A, Anderson JK, Wallace LM, Bourne C. An evaluation of a self-management program for patients with long-term conditions. Patient Educ Couns. 2015;98:213–9.
Sevick MA, Trauth JM, Ling BS, Anderson RT, Piatt GA, Kilbourne AM, et al. Patients with complex chronic diseases: perspectives on supporting self-management. J Gen Intern Med. 2007;22(Suppl 3):438–44.
Theeboom T, Beersma B, Van Vianen A. Does coaching work? A meta-analysis on the effects of coaching on individual level outcomes in an organizational context. J Posit Psychol. 2013;9(1):1–18.
Linden A, Butterworth SW, Prochaska JO. Motivational interviewing-based health coaching as a chronic care intervention. J Eval Clin Pract. 2010;16:166–74.
Butterworth S, Linden A, McClay W, Leo MC. Effect of motivational interviewing-based health coaching on employees’ physical and mental health status. J Occup Health Psychol. 2006;11:358–65.
Beaulieu T, Patten S, Knaak S, Weinerman R, Campbell H, Lauria-Horner B. Impact of skill-based approaches in reducing stigma in primary care physicians: results from a double-blind, parallel-cluster, randomized controlled trial. Can J Psychiatry Rev Can Psychiatr. 2017;62:327.
Antidepressant Skills Workbook - CARMHA - Centre for Applied Research in Mental Health & Addiction - Simon Fraser University [Internet]. [cited 2018 May 25]. Available from: https://www.sfu.ca/carmha/publications/antidepressant-skills-workbook.html
Healthy Minds Cooperative: [Internet]. [cited 2018 May 25]. Available from: https://www.healthyminds.ca/.
Mental Health First Aid | Mental Health Commission of Canada [Internet]. [cited 2018 May 25]. Available from: https://www.mentalhealthcommission.ca/English/resources/mental-health-first-aid
Hellman S, Hellman DS. Of mice but not men. Problems of the randomized clinical trial. N Engl J Med. 1991;324:1585–9.
Mulrow CD, Williams JW, Gerety MB, Ramirez G, Montiel OM, Kerber C. Case-finding instruments for depression in primary care settings. Ann Intern Med. 1995;122:913–21.
Martin A, Rief W, Klaiberg A, Braehler E. Validity of the brief patient health questionnaire mood scale (PHQ-9) in the general population. Gen Hosp Psychiatry. 2006;28:71–7.
Löwe B, Schenkel I, Carney-Doebbeling C, Göbel C. Responsiveness of the PHQ-9 to psychopharmacological depression treatment. Psychosomatics. 2006;47:62–7.
Kroenke K, Spitzer RL. The PHQ-9: a new depression diagnostic and severity measure. Psychiatr Ann. 2002;32:509–15.
Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–13.
Lam RW, Michalak EE, Yatham LN. A new clinical rating scale for work absence and productivity: validation in patients with major depressive disorder. BMC Psychiatry. 2009;9:78.
Sheehan DV, Harnett-Sheehan K, Raj BA. The measurement of disability. Int Clin Psychopharmacol. 1996;11(Suppl 3):89–95.
Chisholm D, Knapp M, Knudsen H, Amaddeo F, Gaite L, Van Wijngaarden B. Client socio-demographic and service receipt inventory - European Version: Development of an instrument for international research - EPSILON Study 5. Br J Psychiatr. 2000;177:S28–33.
Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30:473–83.
McHorney CA, Ware JE, Raczek AE. The MOS 36-item short-form health survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Med Care. 1993;31:247–63.
McHorney CA, Ware JE, Lu JF, Sherbourne CD. The MOS 36-item short-form health survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care. 1994;32:40–66.
Murphy AW, Esterman A, Pilotto LS. Cluster randomized controlled trials in primary care: an introduction. Eur J Gen Pract. 2006;12:70–3.
Schoemaker JH, Kilian S, Emsley R, Vingerhoets AJJM, Medical and Clinical Psychology. Factors associated with placebo response in depression trials. Neurol Psychiatry Brain Res. 2017;30:12–21.
The authors would like to thank the primary care providers and patients who participated as part of this trial.
Upon completion of the project Ms. Beaulieu’s affiliation changed. She held the position of Research Coordinator, British Columbia Centre for Excellence in HIV/AIDS.
This project was made possible through funding from the Nova Scotia Department of Health and Wellness and the Mental Health Commission of Canada. The DOH&W covered the time and expenses of the research coordinator/practice support coordinator, participants, psychiatrists, mental health clinicians and first voice individuals. The DOH&W also covered costs associated with the Bounce Back program, the Mental Health First Aid training, and costs related to training facilities, equipment, and materials. The MHCC covered travel expenses related to meetings as well as the remuneration for RW, HC and those responsible for delivery of the intervention. As the lead research institution, Dalhousie University, Department of Psychiatry contributed in-kind services for the Principal Investigator, BLH, as well as related institutional overhead costs. The MHCC and the DOH&W did not influence any aspect of the research or publication.
Availability of data and materials
The data are archived on the University of Calgary Web Server at:
The data can be accessed from within Stata using the following command:
(See Additional file 2)
Ethics approval and consent to participate
The Nova Scotia Multisite and University of Calgary Research Ethics Boards approved this study, registration #NCT01975948. Written informed consent was obtained from all participants.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.