A pilot study evaluating alternative approaches of academic detailing in rural family practice clinics
© Hartung et al.; licensee BioMed Central Ltd. 2012
Received: 3 August 2012
Accepted: 20 December 2012
Published: 31 December 2012
Academic detailing is an interactive, convenient, and user-friendly approach to delivering non-commercial education to healthcare clinicians. While evidence suggests academic detailing is associated with improvements in prescribing behavior, uncertainty exists about generalizability and scalability in diverse settings. Our study evaluates different models of delivering academic detailing in a rural family medicine setting.
We conducted a pilot project to assess the feasibility, effectiveness, and satisfaction with academic detailing delivered face-to-face as compared to a modified approach using distance-learning technology. The recipients were four family medicine clinics within the Oregon Rural Practice-based Research Network (ORPRN). Two clinics were allocated to receive face-to-face detailing and two received outreach through video conferencing or asynchronous web-based outreach. Surveys at midpoint and completion were used to assess effectiveness and satisfaction.
Each clinic received four outreach visits over an eight month period. Topics included treatment-resistant depression, management of atypical antipsychotics, drugs for insomnia, and benzodiazepine tapering. Overall, 90% of participating clinicians were satisfied with the program. Respondents who received in person detailing reported a higher likelihood of changing their behavior compared to respondents in the distance detailing group for five of seven content areas. While 90%-100% of respondents indicated they would continue to participate if the program were continued, the likelihood of participation declined if only distance approaches were offered.
We found strong support and satisfaction for the program among participating clinicians. Participants favored in-person approaches to distance interactions. Future efforts will be directed at quantitative methods for evaluating the economic and clinical effectiveness of detailing in rural family practice settings.
Prescribing quality is widely acknowledged to be highly variable and suboptimal according to a multitude of indicators [1, 2]. The growing costs of healthcare make these deficiencies even more glaring.
Academic detailing, a term coined by Jerry Avorn, MD in the mid 1980s, is an approach aimed at improving prescribing practices and other medical decision-making using proactive outreach with non-commercial, evidence-based medical information in a user friendly format . The academic detailing model is based largely on successful strategies developed and refined by pharmaceutical industry marketing departments. Detailers, who are commonly clinical pharmacists, nurses, or physicians, are trained to employ a variety of the same social marketing strategies as their industry counterparts. In a seminal paper on the topic, Soumerai and Avorn summarized the basic elements critical for a successful program as: a focused problem or objective, understanding target audience motivations, establishing credibility, encouraging two-sided communication and promotion of an active learning environment, repetition and reinforcement, and the use of brief graphical printed material .
There is a large and growing literature demonstrating the effectiveness of academic detailing. Several randomized trials of academic detailing have documented significant improvements in prescribing practices in areas ranging from the use of psychoactive drugs in the nursing home to rational antibiotic use [3, 5]. A Cochrane Systematic Review of 69 randomized trials of educational outreach visits (e.g., academic detailing) found that this approach is associated with significant improvements in targeted behavior changes . Quantitative meta-analyses from this review suggest academic detailing is associated with a 5.6% absolute improvement in the targeted behavior. As one might expect, considerable heterogeneity exists in the topics and general format of the programs studied. Some outreach interventions were multifaceted and coupled with other interventions such as audit reports. In this review, multifaceted interventions were associated with a larger effect size (8.8% absolute difference in behavior), but the change was not statistically different from the overall effect.
The reach and influence of the pharmaceutical industry on clinical practice has been documented for over 50 years [7–9]. Interaction with industry is particularly high among family practitioners relative to other medical specialties . As clinicians become more acutely aware of the problems associated with industry-related conflict of interest, academic detailing may emerge as an appealing alternative . Moreover, academic detailing programs are considered by some to an attractive strategy in which to bridge the evidence translation gap .
The need to effectively communicate new clinical research is magnified by the substantial recent investments in patient-centered comparative effectiveness research .
The economic implications of academic detailing programs are mixed, and reflect component costs and effectiveness of both the behavior change and the detailing program itself [13–16]. In-person outreach may not be economically feasible in geographically remote or rural areas and is a particular concern. Using technology to more efficiently deliver education to these distant regions may be a solution. The feasibility of employing technology to augment academic detailing efforts has not been formally studied or described. The overarching objective of this project was to develop and gain experience using a distance-learning academic detailing model. Specifically, the goal of this pilot study was to gain insight on the effectiveness and satisfaction of such a program in family physicians practicing in rural Oregon.
The Rural Oregon Academic Detailing (ROAD) project was a collaboration between the Oregon State University College of Pharmacy and the Oregon Rural Practice-based Research Network (ORPRN) at Oregon Health & Science University (OHSU). ORPRN is an Agency for Healthcare Research and Quality (AHRQ) recognized Practice-based Research Network consisting of 46 primary care clinics in rural Oregon who participate in community-based research with the goal of improving the health of rural populations. Four family practice clinics were recruited to participate based on geographic area, clinic interest, and past experience with other ORPRN projects.
Following recruitment, we conducted a focus group with each clinic to assess baseline attitudes and preferences about prescription drug information and collect logistic data relevant to delivery of education (e.g., what times and dates would work for scheduling, contact information). During the focus groups, the ROAD outreach team (DH, AH) met in person with clinicians at each clinic over a period of 2 months to lay out an overview of the project, describe the premise and goals of academic detailing, outline what would be expected of the clinic, discuss what therapeutic areas each clinic would find most helpful, and, finally, to explore which educational formats would be most beneficial. Each clinic was given a $1000 honorarium for participating in the focus group and survey work. Because the State of Oregon Medicaid program co-funded this project, clinics were encouraged to select educational topics of highest relevance to the state such as management of mental illness. Specific topics suggested included mental health pharmacotherapy such as treatment of depression, use of antipsychotics in primary care, anxiety disorders, bipolar disorder, insomnia, and the use of anticonvulsants for mental illness. Based on these initial discussions, ROAD project leadership assigned two clinics to a face-to-face educational approach and two clinics to a mix of technology-enabled distance detailing. These decisions were made based on each clinic’s comfort and capacity to receive distance technology.
Messages delivered during detailing session
Treatment-resistant Depression in the Primary Care Setting
· Formulate a treatment plan at the start of therapy
· Prior to switching or augmenting an antidepressant consider a longer trial (12–14 weeks) at a therapeutic dose
· Triiodothyronine (T3, cytomel) is an effective and well tolerated augmentation agent
Use of Atypical Antipsychotics in Treatment –resistant Depression
· Consider T3 (or lithium) prior to considering atypical antipsychotic augmentation agent
· Atypical antipsychotics are associated with metabolic abnormalities and require regular monitoring
Pharmacotherapy options for Insomnia
· Cognitive behavior therapy and pharmacologic treatment approaches have similar effectiveness
· All sedative/hypnotics appear to be comparable in treating insomnia
· Clinical data regarding sedating antidepressants and antipsychotics are lacking
Clinical use and comparative effectiveness of benzodiazepines
· Long-term benzodiazepine use is rarely warranted
· Withdrawal of benzodiazepine has led to improvements in cognitive functioning, balance, and memory without worsening insomnia (particularly in frail elderly)
· Discontinuation should always include gradual tapering
The academic detailing was performed by a clinical pharmacist with specialty training in psychopharmacology (AH). Detailing material comprised a mix of different formats and media tailored to each clinic environment. The material was developed internally and selected from existing education available from reputable sources. The central therapeutic message for each interaction was incorporated into a short discussion, facilitated with a slide set. Two clinics received face-to-face visits and slides were printed out as handouts. Education delivered to the distance sites engaged with the detailer in differing ways. In one clinic, detailing was conducted using video conference. Information on slides was supplied beforehand as a handout as well as visually displayed during the discussion. For the other distance site, the education was delivered as a self-paced, Flash-enabled learning module accessed via the web, with the detailer’s contact information made available for follow-up questions or comments. Modules were developed using the software Articulate Presenter™. This software enables the addition of self-paced narration and interactivity within existing Windows PowerPoint slides. Although we did not directly track how many users completed each module we were able to monitor internet traffic through the website. In the year following introduction of the modules we were able to document 1289 views of the treatment resistant depression module, 787 views of the atypical antipsychotic module, 391 views of the insomnia module, and 309 views of the benzodiazepine module.
In all cases, a series of stand-alone handouts were developed that contained a summary of the key evidence supporting the clinical message for that visit. Several of these handouts contained information describing clinic-specific prescribing practices related to that message. We used pharmacy and medical claims from the state Medicaid program to create prescribing reports for three of the four modules. For the treatment-resistant depression module, our handout highlighted clinic and state level antidepressant market share, persistence with antidepressant therapy after initiation, and metrics describing the proportion of individuals who switched to a different antidepressant, or added an augmenting agent. The atypical antipsychotic utilization report also contained state and local market share data as well as information about metabolic testing (i.e. medical claims for glucose or lipid testing). A final utilization report focused on medications for insomnia and contained market share data as well as a synopsis of a recent systematic review. We also used existing clinician handouts produced through the AHRQ Effective Health Care program where applicable. All material was delivered in person or electronically to all 4 clinics during the outreach. Educational materials used for this program, including web modules, can be accessed through the ROAD website http://pharmacy.oregonstate.edu/drug_policy/road.
We assessed clinician satisfaction, perceptions of service usefulness, and willingness to continue with the program using a short, written survey delivered at the midpoint and project completion stages. This two-three page survey consisted of several multiple choice Likert-scale questions that asked clinicians to rate their impressions and satisfaction with various aspects of the service. Several open-ended questions were also used to gain additional insights into what was of specific value and what could be improved. Surveys were delivered via SurveyMonkey™. Chi-square tests of proportion were used to evaluate the statistical significance of survey responses between clinicians receiving face-to-face versus distance detailing. This study was approved by the Oregon Health & Science University IRB (#5012). Informed consent was obtained for all clinicians participating in survey assessments.
Clinic descriptive information
Rurality (RUCA Category)*
Isolated small rural town
Large rural city/town population 10,000-49,999
Large rural city/town population 10,000-49,999
Small rural town with flow to an urban cluster of 10,000-49,999
Clinic Patient Panel Size
July 1, 2009
Aug 19, 2009
Aug 18, 2009
July 7, 2009
Nov 13, 2009
Nov 18, 2009
Nov 12, 2009
Nov 25, 2009
Jan 29, 2010
Jan 20, 2010
Jan 25, 2010
Feb 3, 2010
May 15, 2010
May 19, 2010
May 4, 2010
June 3, 2010
June 16, 2010
June 18, 2010
June 1, 2010
July 13, 2010
A summary of open-ended comments from clinicians about what they liked most about the ROAD project and what they would change for the future can be found online (http://pharmacy.oregonstate.edu/drug_policy/sites/default/files/ROAD/Documents/ROAD_appendixTable.pdf).
The ROAD pilot project of alternative approaches to delivering academic detailing was well received by participating family medicine clinics. Survey data overwhelmingly indicate clinicians were satisfied with the content and approaches used. The component with the highest reported satisfaction involved the specific content covered during the outreach. The component achieving the lowest level of reported satisfaction was our Medicaid prescribing profile. This finding is not entirely surprising. While we intended our prescribing reports to inform clinicians about their own current prescribing practices, the number of claims identified for each prescribing indicator was generally small and highly variable. Nevertheless, participating clinicians uniformly indicated they would likely or had already changed behavior related to several of the educational messages delivered. On average 60% to 75% of respondents indicated their willingness to change behavior. Clinicians indicated the least likelihood for changing the use of generic SSRI antidepressants as the initial choice for treating depression. This was unexpected because prevailing evidence shows only modest differences in effectiveness between commonly used SSRI antidepressants . One possible explanation is that nearly 75% of current prescribing is already for generic SSRI antidepressants leaving little room for changes in practice to occur.
While satisfaction between the face-to-face and distance detailing approaches were similar, clinicians’ perceptions of impact seemed to favor the face-to-face encounter over the distance approach. Clinicians who received in–person outreach rated their likelihood of changing as qualitatively higher for 5 of 7 categories. While virtually all participants indicated their willingness to continue future participation in the program, enthusiasm for the outreach was diminished for distance approaches such as asynchronous web modules and teleconference. Unstructured responses solicited from the participants confirm the bias towards in-person detailing, with several individuals suggesting the teleconference approach was not effective. Many in the field strongly advocate that academic detailing requires a face-to-face interaction for the purpose of relationship building, establishing credibility, and facilitating two-way communication between the clinician and the detailer . In theory, much of this communication could potentially be accomplished through video conferencing. In practice, however, it was our impression that barriers to open dialog still exist with such an approach, such as the diminished ability to recognize body language. Future programs might benefit from a hybrid approach where less frequent visitations are coupled with online or other distance technologies. Also, our program used an approach where clinicians engaged with the clinical pharmacist in small groups (versus one-on-one). We used this model because of the logistical difficulties anticipated with individual clinician meetings and because preliminary focus group suggested a preference for it. Although much of what has been described in the literature consists of a one-on-one detailing model, some evidence exists showing that small group detailing is an effective alternative to individual encounters .
Project resources allowed for only a small amount of clinical pharmacist (detailer) time to deliver education and to assist in content development. Content development and generation of provider prescribing profiles was resource-intensive, requiring significant time for research, programming and design. We question the ultimate return on investment for developed reports given the limitations and narrow population scope of the summarized data. In developing other educational tools, we attempted to leverage existing evidence-based products. For example, we used the clinician handout for treatment of depression developed by the AHRQ Effective Healthcare Program. We also explored the existence of materials on academic detailing websites in Canada, Australia, and the Harvard program which operates in Pennsylvania (http://www.rxfacts.org). Unfortunately, at the time there was a scarcity of material on many of the mental health topics we elected to detail on, such as treatment-resistant depression.
Our findings are tempered by several limitations. First, while the response rate from our survey was moderate, the overall response was low and likely not adequately powered to detect significant differences between the two detailing approaches. Initially, we explored using Medicaid pharmacy data to both generate prescribing profiles and to measure changes in behavior following our intervention. It became clear during the design of these profiles that the number of patients, and ultimately pharmacy claims, associated with each clinician was very small. As a result, our prescribing profiles were likely of little value. Similarly, the use of pharmacy claims to quantify changes in behavior was highly variable and unreliable.
Each clinic was given a $1000 honorarium for participating in the ROAD project. Our intent was to provide clinics with a gesture of gratitude for time spent with research-related activities, such as filling out surveys and participating in the focus group, rather than as an incentive to receive the detailing itself. It is unclear if clinics would be as willing to participate in future efforts if the financial reimbursement was eliminated. While Medicaid data limitations curtailed our ability to document changes in prescribing behavior, the outreach was well received and helpful to clinicians. In the near future, the State of Oregon is rolling out an all–payer, all-claims dataset that will serve as a repository for medical and pharmacy claims for private (group and self-insured) and public (Medicaid and Medicare) insured individuals (~3 million covered lives per year) in the state. The implementation of Oregon’s all–payer, all-claims dataset is a promising development that could assist in generating more accurate and comprehensive prescribing profiles, targeting specific providers, and enhance our ability to evaluate future programs.
While many academic medical centers have taken steps to curtail influence of the pharmaceutical industry on the continuing education of their clinicians, family physicians in small independent practices may continue to rely on industry for prescribing information as well as the provision of drug samples [10, 19]. The Institute of Medicine’s consensus report entitled “Conflict of Interest in Medical Research, Education, and Practice” published in 2009 recognizes the information needs of clinicians and proposes that academic detailing programs may be an attractive alternative for clinicians to obtain non-commercial prescribing information . In the US, academic detailing activities have primarily been localized state programs, although AHRQ is currently funding a national effort focused on dissemination and translation of its Effective Health Care products to primary care clinicians . Several lessons emerge from this project that will assist in informing a longer-term more sustained effort in the state. First and foremost, the distance approach, as formulated in this project, was not viewed as favorably as outreach delivered in person. This is consistent with the theoretical framework of detailing which stresses the importance of relationship building and credibility on affecting change [4, 22]. Future work should either abandon this approach or supplement it with individual interaction. At the very least, if a similar approach is used, it will be important to actively assess and incentivize provider engagement, as well as knowledge attainment and retention with the distance modules. Video conferencing may still be a viable option if it can be configured in a way that facilitates the personal connection between the detailer and provider. Also, it is unclear at what interval or intensity of engagement needs to occur in order to achieve a desired change. Understanding this will be critical for sustaining programs that cover geographically distant areas. Finally, the effort required to synthesize evidence into usable clinical practice recommendations it not a trivial matter. Although a variety of organizations have built a sizable library of material that can be used in academic detailing efforts, gaps remain. The work of packaging evidence syntheses for clinical use will grow substantially as evidence from the US comparative effectiveness research enterprise accumulates.
The goal of this pilot study was to explore the feasibility and satisfaction associated with a distance learning approach to academic detailing. While study limitations and sample size prohibit definitive conclusions, our data suggest participants favored, and were generally more responsive to, in-person approaches compared to distance interactions. Future efforts will be directed at evaluating the clinical and economic benefits of detailing in rural family practice settings.
Agency for Healthcare Research and Quality
Oregon Health & Science University (OHSU)
Oregon Rural Practice-based Research Network (ORPRN)
Rural Oregon Academic Detailing Project
Selective serotonin reuptake inhibitor
Sequenced Treatment Alternatives to Relieve Depression.
We acknowledge the efforts ORPRN staff in completion of this project, especially LeAnn Michaels, Monica Goubaub, and Jo Mahler.
This study was funded through a grant from the Pew Charitable Trust (Community Catalyst), and the Oregon Department of Human Services.
Daniel Hartung is employed by Oregon State University and receives funding through an Agency for Healthcare Research and Quality career development award (K12-HS019456-01).
Ann Hamer is employed by OptumHealth Behavioral Health. Luke Middleton is employed by Oregon State University. Dean Haxby is employed by Oregon State University.
Lyle J. Fagnan is employed by Oregon Health & Science University and receives funding from the Agency for Healthcare Research and Quality and the Foundation for Informed Medical Decision Making, and Gordon and Betty Moore Foundation.
The funders had no role in the study design, data collection, analysis and interpretation of the data, writing of the manuscript, or the decision to submit for publication.
- Shrank WH, Asch SM, Adams J, Setodji C, Kerr EA, Keesey J, Malik S, McGlynn EA: The quality of pharmacologic care for adults in the United States. Med Care. 2006, 44 (10): 936-945. 10.1097/01.mlr.0000223460.60033.79.View ArticlePubMed
- Zhang Y, Baicker K, Newhouse JP: Geographic Variation in the Quality of Prescribing. N Engl J Med. 2010, 363 (21): 1985-1988. 10.1056/NEJMp1010220.PubMed CentralView ArticlePubMed
- Avorn J, Soumerai SB: Improving drug-therapy decisions through educational outreach. A randomized controlled trial of academically based “detailing”. N Engl J Med. 1983, 308 (24): 1457-1463. 10.1056/NEJM198306163082406.View ArticlePubMed
- Soumerai SB, Avorn J: Principles of educational outreach (‘academic detailing’) to improve clinical decision making. JAMA. 1990, 263 (4): 549-556. 10.1001/jama.1990.03440040088034.View ArticlePubMed
- Avorn J, Soumerai SB, Everitt DE, Ross-Degnan D, Beers MH, Sherman D, Salem-Schatz SR, Fields D: A randomized trial of a program to reduce the use of psychoactive drugs in nursing homes. N Engl J Med. 1992, 327 (3): 168-173. 10.1056/NEJM199207163270306.View ArticlePubMed
- O’Brien MA, Rogers S, Jamtvedt G, Oxman AD, Odgaard-Jensen J, Kristoffersen DT, Forsetlund L, Bainbridge D, Freemantle N, Davis DA, et al: Educational outreach visits: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2007, 4: CD000409-PubMed
- Campbell EG, Gruen RL, Mountford J, Miller LG, Cleary PD, Blumenthal D: A National Survey of Physician‚ ÄìIndustry Relationships. N Engl J Med. 2007, 356 (17): 1742-1750. 10.1056/NEJMsa064508.View ArticlePubMed
- Wazana A: Physicians and the Pharmaceutical Industry. JAMA: The Journal of the American Medical Association. 2000, 283 (3): 373-380. 10.1001/jama.283.3.373.View ArticlePubMed
- May CD: Selling drugs by “educating” physicians. Journal of medical education. 1961, 36: 1-23.PubMed
- Evans DV, Hartung DM, Andeen G, Mahler J, Haxby DG, Kraemer DF, Fagnan LJ: One practice’s experiment in refusing detail rep visits. J Fam Pract. 2011, 60 (8): E1-E6.PubMed
- Avorn J, Fischer M: ‘Bench To Behavior’: Translating Comparative Effectiveness Research Into Improved Clinical Practice. Health Aff. 2010, 29 (10): 1891-1900. 10.1377/hlthaff.2010.0696.View Article
- Fischer MA, Avorn J: Academic detailing can play a key role in assessing and implementing comparative effectiveness research findings. Health Aff (Millwood). 2012, 31 (10): 2206-2212.View Article
- Mason J: FNNIEMHADM: WHen is it cost-effective to change the behavior of health professionals?. JAMA: The Journal of the American Medical Association. 2001, 286 (23): 2988-2992. 10.1001/jama.286.23.2988.View ArticlePubMed
- Fretheim A, Aaserud M, Oxman AD: Rational prescribing in primary care (RaPP): economic evaluation of an intervention to improve professional practice. PLoS Med. 2006, 3 (6): e216-10.1371/journal.pmed.0030216.PubMed CentralView ArticlePubMed
- Naughton C, Feely J, Bennett K: A RCT evaluating the effectiveness and cost-effectiveness of academic detailing versus postal prescribing feedback in changing GP antibiotic prescribing. J Eval Clin Pract. 2009, 15 (5): 807-812. 10.1111/j.1365-2753.2008.01099.x.View ArticlePubMed
- Simon SR, Rodriguez HP, Majumdar SR, Kleinman K, Warner C, Salem-Schatz S, Miroshnik I, Soumerai SB, Prosser LA: Economic analysis of a randomized trial of academic detailing interventions to improve use of antihypertensive medications. Journal of clinical hypertension (Greenwich, Conn). 2007, 9 (1): 15-20. 10.1111/j.1524-6175.2006.05684.x.View Article
- Rush AJ, Trivedi MH, Wisniewski SR, Stewart JW, Nierenberg AA, Thase ME, Ritz L, Biggs MM, Warden D, Luther JF, et al: Bupropion-SR, Sertraline, or Venlafaxine-XR after Failure of SSRIs for Depression. N Engl J Med. 2006, 354 (12): 1231-1242. 10.1056/NEJMoa052963.View ArticlePubMed
- van Eijk MEC, Avorn J, Porsius AJ, de Boer A: Reducing prescribing of highly anticholinergic antidepressants for elderly people: randomised trial of group versus individual academic detailing. BMJ. 2001, 322 (7287): 654-10.1136/bmj.322.7287.654.PubMed CentralView ArticlePubMed
- Brennan TA, Rothman DJ, Blank L, Blumenthal D, Chimonas SC, Cohen JJ, Goldman J, Kassirer JP, Kimball H, Naughton J, et al: Health industry practices that create conflicts of interest: a policy proposal for academic medical centers. JAMA. 2006, 295 (4): 429-433. 10.1001/jama.295.4.429.View ArticlePubMed
- Lo B, Fields M: Conflict of Interest in Medical Research, Education, and Practice. 2009, Washington (DC): National Academies Press (US)
- National Resource Center for Academic Detailing. http://www.narcad.org/resources/useful-links/,
- Fugh-Berman A, Ahari S: Following the script: how drug reps make friends and influence doctors. PLoS Med. 2007, 4 (4): e150-10.1371/journal.pmed.0040150.PubMed CentralView ArticlePubMed
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2296/13/129/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.