Research article | Open | Open Peer Review | Published:
Identification of priorities for improvement of medication safety in primary care: a PRIORITIZE study
BMC Family Practicevolume 17, Article number: 160 (2016)
Medication error is a frequent, harmful and costly patient safety incident. Research to date has mostly focused on medication errors in hospitals. In this study, we aimed to identify the main causes of, and solutions to, medication error in primary care.
We used a novel priority-setting method for identifying and ranking patient safety problems and solutions called PRIORITIZE. We invited 500 North West London primary care clinicians to complete an open-ended questionnaire to identify three main problems and solutions relating to medication error in primary care. 113 clinicians submitted responses, which we thematically synthesized into a composite list of 48 distinct problems and 45 solutions. A group of 57 clinicians randomly selected from the initial cohort scored these and an overall ranking was derived. The agreement between the clinicians’ scores was presented using the average expert agreement (AEA). The study was conducted between September 2013 and November 2014.
The top three problems were incomplete reconciliation of medication during patient ‘hand-overs’, inadequate patient education about their medication use and poor discharge summaries. The highest ranked solutions included development of a standardized discharge summary template, reduction of unnecessary prescribing, and minimisation of polypharmacy. Overall, better communication between the healthcare provider and patient, quality assurance approaches during medication prescribing and monitoring, and patient education on how to use their medication were considered the top priorities. The highest ranked suggestions received the strongest agreement among the clinicians, i.e. the highest AEA score.
Clinicians identified a range of suggestions for better medication management, quality assurance procedures and patient education. According to clinicians, medication errors can be largely prevented with feasible and affordable interventions. PRIORITIZE is a new, convenient, systematic, and replicable method, and merits further exploration with a view to becoming a part of a routine preventative patient safety monitoring mechanism.
Medication errors are preventable mistakes in prescribing, ordering, dispensing, administration and monitoring of drugs that can cause patient harm . Preventable adverse drug events, i.e. injuries that arise from medication errors, are one of the most common and costly patient safety incidents, estimated to affect 2% of adult outpatients and 1.6% of adult inpatients . The estimated financial cost of preventable adverse reactions arising from medication errors amounts each year to more than £770 million in the NHS and $17 billion in the USA [3, 4].
A case note review of prescribing in English primary care detected a 5% prevalence of prescribing or monitoring errors . A systematic review of 13 studies estimated the prevalence of hospital admissions due to medication errors was 3.7% with the majority of incidents judged to be preventable through simple improvements in prescribing . However, evidence on medication error mostly stems from the hospital setting [7, 8]. Evaluating medication safety in primary care is more challenging as administration of medication is largely performed outside the more controlled environment of a healthcare facility [8, 9].
The literature on medication errors is largely retrospective and includes case-note reviews, malpractice data, incident reporting, surveys and direct observation [10–12]. While their frequency is known, it is still unclear which medication errors in primary care are most harmful and should be tackled first. Clinicians’ engagement is essential to determine medication safety priorities and to ensure successful implementation of proactive responses to medication error. A recent study revealed that staff perception of the culture of organisation safety predicted patient safety outcomes . Yet, healthcare providers openly voicing safety concerns may not be part of established healthcare organisational culture . In this study, we used a novel crowd-sourcing, priority-setting methodology to gather and explore clinicians’ views on the causes of, and solutions for, medication errors in primary care.
In this study, we employed PRIORITIZE, a novel crowd-sourcing, priority-setting methodology (Fig. 1). We developed PRIORITIZE by modifying the Child Health and Nutrition Research Initiative (CHNRI) approach for patient safety context. The CHNRI approach is an established research priority setting methodology and has been used extensively to inform policy makers, funders and international organizations about research gaps and resource priorities [15–17]
In the CHNRI approach, priorities for research are identified and prioritized by international research experts. Correspondingly, in PRIORITIZE, priorities for healthcare services delivery are determined and ranked by clinicians. The PRIORITIZE methodology is designed to determine priorities by simultaneously exploring them from two angles: problems and solutions. The final output of the PRIORITIZE approach is a presentation of the immediate priorities, categorized according to organisational level, for implementation: a) actions for clinicians; b) actions for healthcare organisations; and, c) actions for health system custodians.
This study was deemed to be a service evaluation and quality and safety improvement initiative and consequently did not require ethics approval, research governance approval or informed consent according to the UK’s Health Research Authority guidance . The project steering group (Imperial College Health Partners’ Patient Safety Board) considered previous evidence on patient safety in UK primary care and decided to focus the larger project, of which this study is a part, on medication safety and delayed diagnosis in North West London. This paper describes the findings related to medication safety. North West London has a population of 2.3 million residents, £3.4 billion annual health spend, 440 GP practices employing 1100 GPs and more than 40 000 NHS staff . The patient safety board also determined the criteria for prioritisation of collated suggestions in this study, which were used to score the problems and solutions (Table 1).
In the first phase, we developed an open-ended questionnaire for clinicians to identify the main perceived problems and solutions relating to medication safety in primary care. The eligible survey participants were clinicians working in primary care in North West London. It was piloted on a smaller sample of primary care physicians and trainees and underwent multiple rounds of revisions. The final questionnaire (Additional file 1) was distributed in both paper-based and online versions and disseminated via email lists, snowballing (participants were asked to forward the survey to colleagues), and visits to general practices in North West London. We targeted academic and non-academic general practitioners, trainees, pharmacists and nurses.
The collected responses were examined using content analysis with open coding to categorise the free-text responses. Ideas proposed that were sufficiently similar were merged. The coding was performed by one author and subsequently verified by two co-authors. In the second phase, we asked clinicians to score the ideas using four options: score 1 for ‘Yes - I agree with the statement’, score 0 for ‘No - I do not agree with the statement’, score 0.5 for ‘Unsure - I am unsure whether or not I agree’ and blank (no response) for ‘Unaware – I do not feel sufficiently familiar or confident to score this suggestion’ (Additional file 2). This scoring process took about 1 h to complete and we offered a token payment to the participants in a form of a £100 grocery voucher. We invited participants at random from the initial cohort of primary care clinicians to score the priorities. The enrolment for scoring ended after collecting at least 50 completed sheets as per CHNRI guidance (personal communication I. Rudan).
The intermediate scores, i.e. scores for each criterion for every suggestion, were calculated by adding up all the answers (“1,” “0,” or “0.5”) and dividing the sum by the number of received answers. All intermediate scores for all research options were therefore assigned a value between 0 and 100. The overall priority score was then computed as the mean of the scores for each of the five criteria for problems and two criteria for solutions. Higher ranked solutions received more “Yes” responses for each of the criteria and a higher score. The Kappa statistic was deemed an inappropriate test to determine inter-rater agreement in this study due to the sample size, the non-standardized categorical nature of data, the option of blank response to some statements and the number of different criteria used for scoring . Instead, we evaluated inter-rater agreement using the average expert agreement (AEA) . AEA has the ability to expose the suggestions with greatest agreement and controversy as it is shows what proportion of scorers assigned the same score to a particular criterion. AEA does not provide information on statistical significance of any differences between scorers, but it is relevant to policy makers as it gives an indication of the degree of agreement between clinicians in terms of priorities. In calculating AEA, all four possible responses (“Yes”, “No”, “Unsure” and “Unaware”) are treated as a valid response. Therefore, if the substantial proportion of the participants choose “Unaware – I do not feel sufficiently familiar or confident to score this suggestion” as the answer, AEA will reflect this and reduce the level of overall agreement, rather than increase it. The AEA is calculated using the following two formulae for problems and solutions, respectively:
(where q is a question that experts are being asked to evaluate competing patient safety threats (in this case medication errors), ranging from 1 to 5 for problems and 1 to 3 for solutions) .
Suggested problems and solutions relating to medication safety in primary care were classified using an adapted model of medication delivery as well as the London Protocol, a framework for analysing risk and safety in clinical practice  (Additional file 3).
Out of 500 primary care clinicians who were invited to participate, 113 (22.6%) completed the questionnaire. The majority were general practitioners (GPs) (n = 85, 75.2%) (Additional file 4). 175 problems and 147 solutions relating to medication safety in general practice were collected and thematically grouped into a set of 48 distinct problems and 45 solutions for medication safety (Additional file 5: Table S5 and Additional file 6: Table S6). From the initial primary care clinicians’ cohort, 168 GPs were invited to score the composite list of suggestions resulting in 57 fully completed scoring sheets (Fig. 2). Collated problems and solutions were ranked based on the scores obtained.
The three top ranked problems leading to medication errors were incomplete reconciliation of medication during patient ‘hand-overs’, inadequate patient education about how to take their medications and poor discharge summaries (Table 2). The three highest ranked solutions were standardized discharge summary templates, reduction of unnecessary prescribing, and avoidance of polypharmacy (Table 3).
Overall, clinicians identified monitoring and prescribing as the medication stages most vulnerable to medication errors. However, the top 5 problems mostly referred to routine matters such as errors during transfer of care and administering of medication. Poor care coordination and communication between different services and providers of care, lack of or inappropriate medication reviews and monitoring as well as patient-related factors (e.g. polypharmacy or memory issues) were seen as the main medication safety concerns (Additional file 5: Table S5). Several problems focused on inappropriate prescribing in specific circumstances e.g. for pain management, antipsychotics, teratogenic medications in pregnancy, for example.
Many of the suggested solutions focused on re-design of medication delivery, e.g. by developing standardized discharge summaries, unified investigation and medication records, shared care protocols or patient-held records. Information technology was also considered important for the streamlining of care and improvement of safety (e.g. use of e-discharge letters and e-referrals, computer system alerts for overdue blood tests and warnings when re-issuing medication). The most cost-effective solutions according to clinicians were minimising polypharmacy, taking patients’ comorbidities into consideration when prescribing and introducing standardized discharge summaries. The most feasible solutions according to clinicians were standardized discharge summaries, healthcare assistants’ home visits to ensure medication adherence, and unified medication and investigations records that have listings of allergies and current medications of patients across primary and secondary care (Additional file 6: Table S6).
The top ranked solutions corresponded to the top ranked problems. The highest ranked suggestions had the highest AEA, i.e. there was a stronger consensus among clinicians for the top suggestions compared to those ranked lower. Proposed solutions received higher AEA scores compared to problems, i.e. clinicians agreed more on the ranking of solutions compared to the ranking of problems (Additional file 5: Table S5).
In this study, clinicians identified priorities for improving medication safety in primary care. The top three problems were incomplete reconciliation of medication during patient ‘hand-overs’, inadequate patient education about their medication use and poor discharge summaries. The highest ranked solutions included development of a standardized discharge summary template, reduction of unnecessary prescribing, and minimization of polypharmacy. Overall, improving communication among clinicians and with patients, re-design of medication delivery and patient education were seen as key areas for improvement of medication safety. Many identified suggestions in our study are feasible, affordable and could contribute to improvements to medication safety in primary care. Some would, however, require more time within already time-pressured clinical encounters.
There is a paucity of research on underlying causes of, and solutions for, medication errors in the primary care setting [5, 24]. The existing evidence stems mostly from secondary care and addresses certain stages of medication delivery rather than the whole process . This fragmented approach prevents a systems-oriented perspective to the minimisation of medication errors. Our study encompasses all steps in medication delivery in primary care, tackling both the contributory factors and the prevention strategies. Such dual strategy was useful since many of the suggested problems focused on individual failure, whereas the proposed solutions focused on organisational re-design.
Clinicians in our study perceived prescribing and monitoring of medication as particularly susceptible to safety incidents. Similarly, a systematic review on medication safety in primary care showed that most medication errors occur during prescribing and monitoring stages . However, the top identified problems mostly focus on routine, service delivery-related matters rather than areas requiring clinical decision making skills, e.g. incomplete reconciliation of medication, repeat prescribing without proper review or delays in receiving patient notes. Notably, clinicians in our study, instead of addressing difficulties with prescribing, prioritised much more mundane and fixable problems.
Poor communication among clinicians and with patients as well as incomplete healthcare documentation were seen as the main safety threats which reinforces findings from previous work [26, 27]. Research shows that direct communication between hospital and primary care physicians is often sporadic and accompanied by discharge summaries missing important drug-related information [27–29]. As a possible solution, our study suggested that a standardized discharge summary template clearly indicating changes in medication may improve information transfer and medication safety. Recent studies show that the use of templates can improve the quality of discharge summaries [30, 31]
Lack of medication adherence is considered one of the main patient-related medication safety threats in primary care . In our study, several suggestions focused on ensuring medication adherence through patient education and support. Correspondingly, patient education was also identified by the international patient safety experts as a safety imperative [9, 32, 33]. A Cochrane review showed that provision of patient self-monitoring and self-management programmes improved medication safety . Our study identified discrete methods of educating and empowering patients to be more involved in their healthcare; namely, giving clear guidelines to patient about how frequently they require medication reviews and using computer systems to inform the patient about overdue blood tests.
A number of identified solutions to medication errors in our study focused on organisational changes and re-design of particular medication delivery tasks. It is unclear how effective these strategies are as the literature on effective interventions to reduce medication errors is lacking in terms of the experimental study designs, breadth of evaluated interventions and types of outcomes. Among the organisation-level solutions identified in our study, the use of clinical computer systems (in the form of e-discharge letters, e-referrals, alerts etc.) was perceived beneficial which corresponds to the evidence showing that the use of information technology prevents medication errors [35–39].
Strengths and limitations
PRIORITIZE is a modified version of an established priority-setting methodology [15–17]. It is transparent, systematic, easily reproducible and anonymous. PRIORITIZE enables open and blame-free expression of safety concerns, recommendations and ideas from many participants. Potential limitations of this study relate to the generalizability and validity of the findings. There is a possibility of selection bias as a self-selected sample was recruited and the respondents in our study potentially differed from the non-respondents. All invited participants had the same eligibility criteria by being a primary care healthcare provider in North West London but there may have been other, unmeasured biases such as clinicians with specific views being more likely to respond. The findings are perhaps not generalizable to other healthcare settings or systems, which have a different organization of primary care. However, they correspond to the available international literature and should be seen as pertinent beyond the study setting. The modest response rate in this study matches other clinician surveys and evidence showing that physicians often decline to participate in surveys [40, 41]. Longer, online surveys and those with open-ended questions (such as our survey) are particularly prone to a poor response rate . Increasing participation and improving reliability of findings could be achieved by introducing PRIORITIZE as a standard part of the organizational quality improvement efforts.
The PRIORITIZE approach is at an early stage and could be further improved. For example, it may be useful to provide examples that would guide the specificity and type of the suggestions (e.g. error producing conditions, errors and adverse events) or to ensure longitudinal data collection through repeated annual questionnaires. Different types of analyses could be applied, e.g. determining the suitable healthcare implementation level for each solution, choosing prioritization criteria most important to the healthcare organisation (e.g. urgency, impact, affordability, execution risk, sustainability etc.), analysing correlation between priorities, analysing patterns of priorities for different staff groups or regional areas, or undertaking an in-depth comparison of providers’ and patients’ views.
Medication errors in primary care are common, impactful and yet under-investigated. In our study, clinicians identified a range of areas of medication safety that were potentially amenable to improvement as well as discrete interventions that were achievable. Better care coordination, robust quality assurance mechanisms and improved patient education were seen as key to the prevention of medication errors in primary care. This bottom-up approach (in which staff views drive change) is essential for successful implementation of new healthcare policies. This study offers unique value in that suggestions were in line with health system custodians’ identified needs. Its findings are being used to guide Imperial College Health Partners’ work on Medicines Optimisation in North West London. Their Patient Safety Board determined the priorities that were synergistic or inter-related (e.g. “minimising polypharmacy”, “reduction of unnecessary antibiotic prescribing”, “long-term prescribing of nonsteroidal anti-inflammatory drugs (NSAIDs) without reviewing if there is an on-going need for it”, “repeat prescribing of pain-killers including opiates without a regular review of true need or alternatives”) to address them with a focused and concerted effort. This association among identified suggestions reaffirmed the importance of certain priorities and gave a clear message where action is needed. Next steps should include synthesis of the existing evidence relating to the identified suggestions to determine effective interventions.
This novel priority setting approach offers many advantages to healthcare policy makers. PRIORITIZE corresponds to the recent policy decisions to involve healthcare staff in patient safety research and is a complementary method to current exploratory tools used for mapping of primary care safety priorities [7, 43, 44]. Following further validation of the method, it may be used as a routine mechanism for staff feedback to identify safety threats at different healthcare levels, increase patient safety awareness and improve organisational culture.
Average experts’ agreement
Morimoto T, Gandhi TK, Seger AC, Hsieh TC, Bates DW. Adverse drug events and medication errors: detection and classification methods. Qual Saf Health Care [Internet]. 2004 [cited 2016 Mar 11];13:306–14. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1743868&tool=pmcentrez&rendertype=abstract.
Hakkarainen KM, Hedna K, Petzold M, Hägg S. Percentage of patients with preventable adverse drug reactions and preventability of adverse drug reactions - a meta-analysis. PLoS One. 2012;7:11–3.
National Patient Safety Agency. Safety in doses: medication safety incidents in the NHS [Internet]. London; 2007. Available from: http://www.nrls.npsa.nhs.uk/EasySiteWeb/getresource.axd?AssetID=61392.
Institute of Medicine. To Err Is Human: Building a Safer Health System [Internet]. In: Kohn LT, Corrigan JM, Donaldson MS, editors. Committee on Quality of Health Care in America I of M, editor. Washington, D.C: National Academies Press; 2000. [cited 2015 Nov 10]. Available from: http://www.nap.edu/catalog/9728/to-err-is-human-building-a-safer-health-system.
Avery AJ, Ghaleb M, Barber N, Dean Franklin B, Armstrong SJ, Serumaga B, et al. The prevalence and nature of prescribing and monitoring errors in English general practice: a retrospective case note review. Br J Gen Pract [Internet]. 2013 [cited 2015 Mar 5];63:e543–53. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3722831&tool=pmcentrez&rendertype=abstract.
Howard RL, Avery AJ, Slavenburg S, Royal S, Pipe G, Lucassen P, et al. Which drugs cause preventable admissions to hospital? A systematic review. Br J Clin Pharmacol [Internet]. 2007 [cited 2015 Sep 25];63:136–47. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2000562&tool=pmcentrez&rendertype=abstract.
Battles JB, Dixon NM, Borotkanics RJ, Rabin-Fastmen B, Kaplan HS. Sensemaking of patient safety risks and hazards. Health Serv Res. 2006;41:1555–75.
Makeham M, Dovey S, Runciman WLI. Methods and measures used in primary care patient safety research. Geneva: World Health Organization; 2008.
Kingston-Riechers J, Ospina M, Jonsson E, Childs P, McLeod L, Maxted J. Patient safety in primary care. Edmonton: Canadian Patient Safety Institute and BC Patient Safety and Quality Council; 2010. Available from http://www.patientsafetyinstitute.ca/english/research/commissionedresearch/primarycare/pages/default.aspx.
Gandhi TK. Impact of Basic Computerized Prescribing on Outpatient Medication Errors and Adverse Drug Events. J Am Med Informatics Assoc. 2002;9:48S–9S.
Singh H, Thomas EJ, Wilson L, Kelly PA, Pietz K, Elkeeb D, et al. Errors of diagnosis in pediatric practice: a multisite survey. Pediatrics [Internet]. 2010 [cited 2014 Sep 22];126:70–9. Available from: http://pediatrics.aappublications.org/content/126/1/70.long.
Kukreti V, Cosby R, Cheung A, Lankshear S. Computerized prescriber order entry in the outpatient oncology setting: from evidence to meaningful use. Curr Oncol [Internet]. 2014 [cited 2015 Apr 13];21:e604–12. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=4117626&tool=pmcentrez&rendertype=abstract.
Lawton R, O’Hara JK, Sheard L, Reynolds C, Cocks K, Armitage G, et al. Can staff and patient perspectives on hospital safety predict harm-free care? An analysis of staff and patient survey data and routinely collected outcomes. BMJ Qual Saf [Internet]. 2015 [cited 2015 Dec 11];24:369–76. Available from: http://qualitysafety.bmj.com/content/24/6/369.long.
Francis R. Freedom to speak up [Internet]. London; 2015. Available from: www.freedomtospeakup.org.uk.
Tomlinson M, Chopra M, Sanders D, Bradshaw D, Hendricks M, Greenfield D, et al. PLoS Med Public Library of Science. 2007;4:e259.
Viergever RF, Olifson S, Ghaffar A, Terry RF. A checklist for health research priority setting: nine common themes of good practice. Health Res Policy Syst. 2010;8:36.
Rudan I, El Arifeen S, Bhutta ZA, Black RE, Brooks A, Chan KY, et al. Setting research priorities to reduce global mortality from childhood pneumonia by 2015. PLoS Med Public Library of Science. 2011;8:e1001099.
Health Research Authority NHS. Defining Research [Internet]. London: UK; 2013. Available from: http://www.hra.nhs.uk/documents/2016/06/defining-research.pdf.
Imperial College Health Partners. Who we are [Internet]. London; 2016. Available from: http://imperialcollegehealthpartners.com/who-we-are/.
Cohen J. A Coefficient of Agreement for Nominal Scales. Educ Psychol Meas [Internet]. 1960 [cited 2014 Oct 23];20:37–46. Available from: http://epm.sagepub.com/content/20/1/37.extract.
George A, Young M, Bang A, Chan KY, Rudan I, Victora CG, et al. Setting implementation research priorities to reduce preterm births and stillbirths at the community level. PLoS Med. 2011;8, e1000380.
Lawn JE, Bahl R, Bergstrom S, Bhutta ZA, Darmstadt GL, Ellis M, et al. Setting research priorities to reduce almost one million deaths from birth asphyxia by 2015. PLoS Med [Internet]. Public Library of Science; 2011 [cited 2015 Nov 11];8:e1000389. Available from: http://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.1000389.
Vincent C. Patient Safety. 2nd ed. Oxford: Wiley-Blackwell; 2010.
Slight SP, Howard R, Ghaleb M, Barber N, Franklin BD, Avery AJ. The causes of prescribing errors in English general practices: a qualitative study. Br J Gen Pract [Internet]. 2013 [cited 2015 Dec 28];63:e713–20. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3782805&tool=pmcentrez&rendertype=abstract.
Garfield S, Barber N, Walley P, Willson A, Eliasson L. Quality of medication use in primary care-mapping the problem, working to a solution: a systematic review of the literature. BMC Med. 2009;7:50.
Marchon SG, Mendes Junior WV. Patient safety in primary health care: a systematic review. Cad Saude Publica [Internet]. 2014 [cited 2014 Nov 1];30:1815–35. Available from: http://www.ncbi.nlm.nih.gov/pubmed/25317512.
Kripalani S, LeFevre F, Phillips CO, Williams MV, Basaviah P, Baker DW. Deficits in communication and information transfer between hospital-based and primary care physicians: implications for patient safety and continuity of care. JAMA. 2007;297:831–41.
Cresswell A, Hart M, Suchanek O, Young T, Leaver L, Hibbs S. Mind the gap: Improving discharge communication between secondary and primary care. BMJ Qual Improv Reports [Internet]. 2015 [cited 2016 Jun 28];4. Available from: http://qir.bmj.com/content/4/1/u207936.w3197.abstract.
Cooper J, Murphy E, Jordan R, Mackway-Jones K. Communication between secondary and primary care following self-harm: are National Institute of Clinical Excellence (NICE) guidelines being met? Ann Gen Psychiatry [Internet]. 2008 [cited 2016 Jun 28];7:21. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2584095&tool=pmcentrez&rendertype=abstract.
Almidani E, Hussain I Bin, Almofada S, Hijazi M, Almalhooq N, Alobari R, et al. The effect of implementing a standardized process on the quality of discharge summaries. Int J Pediatr Adolesc Med. [Internet]. 2014 [cited 2016 Jun 28];1:78–88. Available from: http://www.sciencedirect.com/science/article/pii/S2352646714000519.
Ladds E, Betteridge F, Yamamoto S, Gupta-Jessop T. Improving the quality of discharge summaries for elective surgical procedures at North Bristol NHS Trust. BMJ Qual Improv Reports [Internet]. 2015 [cited 2016 Jun 28];4:u203452.w1552. Available from: http://qir.bmj.com/content/4/1/u203452.w1552.abstract.
Costello M. Prescription Opioid Analgesics. AJN Am J Nurs [Internet]. 2015 [cited 2016 Jun 28];115:50–6. Available from: http://www.ncbi.nlm.nih.gov/pubmed/26510070.
Vaismoradi M, Jordan S, Kangasniemi M. Patient participation in patient safety and nursing input - a systematic review. J Clin Nurs [Internet]. 2015 [cited 2016 May 14];24:627–39. Available from: http://www.ncbi.nlm.nih.gov/pubmed/25178172.
Ryan R, Santesso N, Lowe D, Hill S, Grimshaw J, Prictor M, et al. Interventions to improve safe and effective medicines use by consumers: an overview of systematic reviews. Cochrane database Syst Rev [Internet]. 2014 [cited 2014 Dec 18];4:CD007768. Available from: http://www.ncbi.nlm.nih.gov/pubmed/24777444.
Rinke ML, Bundy DG, Velasquez CA, Rao S, Zerhouni Y, Lobner K, et al. Interventions to reduce pediatric medication errors: a systematic review. Pediatrics [Internet]. 2014 [cited 2014 Dec 22];134:338–60. Available from: http://pediatrics.aappublications.org/content/early/2014/07/09/peds.2013-3531.
Black AD, Car J, Pagliari C, Anandan C, Cresswell K, Bokun T, et al. The impact of eHealth on the quality and safety of health care: a systematic overview. PLoS Med. [Internet]. Public Library of Science; 2011 [cited 2016 Jan 5];8:e1000387. Available from: http://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.1000387#s4.
Ojeleye O, Avery A, Gupta V, Boyd M. The evidence for the effectiveness of safety alerts in electronic patient medication record systems at the point of pharmacy order entry: a systematic review. BMC Med Inform Decis Mak [Internet]. 2013 [cited 2016 Jan 18];13:69. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3702525&tool=pmcentrez&rendertype=abstract.
Rassen JA, Brookhart MA, Glynn RJ, Mittleman MA, Schneeweiss S. Instrumental variables I: instrumental variables exploit natural variation in nonexperimental data to estimate causal relationships. J Clin Epidemiol [Internet]. 2009 [cited 2014 Jul 12];62:1226–32. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2905668&tool=pmcentrez&rendertype=abstract.
Nuckols TK, Smith-Spangler C, Morton SC, Asch SM, Patel VM, Anderson LJ, et al. The effectiveness of computerized order entry at reducing preventable adverse drug events and medication errors in hospital settings: a systematic review and meta-analysis. Syst Rev [Internet]. 2014 [cited 2015 Dec 21];3:56. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=4096499&tool=pmcentrez&rendertype=abstract.
Nicholls K, Chapman K, Shaw T, Perkins A, Sullivan MM, Crutchfield S, et al. Enhancing response rates in physician surveys: the limited utility of electronic options. Health Serv Res [Internet]. 2011 [cited 2014 Dec 20];46:1675–82. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3207199&tool=pmcentrez&rendertype=abstract.
Wiebe ER, Kaczorowski J, MacKay J. Why are response rates in clinician surveys declining? Can Fam Physician [Internet]. 2012 [cited 2014 Dec 20];58:e225–8. Available from: http://www.cfp.ca/content/58/4/e225.full.
Jepson C, Asch DA, Hershey JC, Ubel PA. In a mailed physician survey, questionnaire length had a threshold effect on response rate. J Clin Epidemiol [Internet]. 2005 [cited 2014 Dec 20];58:103–5. Available from: http://www.ncbi.nlm.nih.gov/pubmed/15649678.
Iacobucci G. New programme is launched to embed patient safety in the NHS. BMJ [Internet]. 2014;349:g6201. Available from: http://dx.doi.org/10.1136/bmj.g6201.
Grol R, Wensing M, Eccles M, et al. Improving Patient Care: The Implementation of Change in Health Care. 2nd ed. Chichester: Wiley-Blackwell; 2013.
The authors wish to thank the individuals who participated in the study. The authors are grateful for the funding and support from the NIHR and the Imperial Health Partners.
The study received financial support from the Imperial College Health Partners (a partnership organisation bringing together the academic and health science communities across North West London) and the Department of Primary Care and Public Health, Imperial College London. The Department of Primary Care & Public Health at Imperial College is grateful for support from the National Institute for Health Research (NIHR) under the Collaborations for Leadership in Applied Health Research and Care (CLAHRC) programme for North West London, the NIHR Biomedical Research Centre scheme, and the Imperial Centre for Patient Safety and Service Quality. The views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health. Professor Charles Vincent is supported by the Health Foundation.
Availability of data and materials
Original data can be requested from the corresponding author at email@example.com.
LTC, AB, CV and JC conceived and designed the study. MEK and NP performed the data collection. LTC and NP analysed the data and wrote the initial draft of the paper. RS, KW, AB, AM, PA, RA, IR, JC, HB, CV and BDF participated in the interpretation of the data and revised the manuscript for important intellectual content. All authors read and approved the final manuscript.
Dr Adrian Bull is the Managing Director of Imperial College Health Partners (a partnership organisation bringing together the academic and health science communities across North West London) which co-funded this study.
Consent for publication
Ethics approval and consent to participate
This study was deemed to be a service evaluation and quality and safety improvement initiative and consequently did not require ethics approval, research governance approval or informed consent according to the UK’s Health Research Authority guidance .
Initial questionnaire on problems and solutions related to medication safety and delayed diagnosis in primary care. (ODT 60 kb)
Scoring questionnaire. (ODT 136 kb)
Framework used for analysis of Contributing Factors to medication safety in primary care (based on the London protocol). (ODT 5 kb)
Characteristics of the respondents to the initial questionnaire. (ODT 6 kb)
Ranking of all (48) medication-related problems from primary care clinicians’ perspective (AEA range: 0 to 1) (ODT 20 kb)
Ranking of all (45) solutions to medication-related problems from primary care clinicians’ perspective (AEA range: 0 to 1). (ODT 17 kb)