- Research article
- Open Access
Organisational targets of patient safety improvement programs in primary care; an international web-based survey
BMC Family Practice volume 14, Article number: 145 (2013)
Organisational problems contribute to many errors in healthcare delivery. Our objective was to identify the most important organisational items in primary care which could be targeted by programs to improve patient safety.
A web-based survey was undertaken in an international panel of 65 experts on patient safety from 20 countries. They were asked to rate 52 patient safety items on a five-point Likert scale which regards importance of each item for use for educational interventions to improve patient safety.
The following 7 organizational items were regarded ‘extremely important’ by more than 50% of the experts: the use of sterile equipment with small surgical procedures (63%), the availability of adequate emergency drugs in stock (60%), regular cleaning of facilities (59%), the use of sterile surgical gloves when recommended (57%), the availability of at least one adequately trained staff member to deal with collapse and need for resuscitation (56%), adequate information handover when a patient is discharged from the hospital (56%) and periodically training of GPs in basic life support and other medical emergencies (53%).
Seven organisational items were consistently prioritized; other items may be relevant in specific countries only. The logical next step is to develop and evaluate interventions targeted at these items.
Patient safety receives increased attention worldwide, also in primary care [1, 2]. Patient safety in primary care is crucially important, as most diseases are managed in this setting, particularly in countries with a strong primary care system . Primary care has low risk of major harm in most contacts and procedure, but incidents with major consequences do occur from time to time [4–6]. So, the challenge is to enhance patient safety in the high-volume, low-risk setting of primary care, while avoiding defensive medicine or heavy bureaucratic control structures.
Interventions to improve patient safety include reporting and analysis of incidents, and measurement and feedback on patient safety culture . In primary care in the Netherlands, incident reporting is new and not yet widely implemented, although it is now promoted as a team-based approach to enhance patient safety through reflective learning . Some research evidence supports the belief that incident reporting improves patient safety . Apart from incident reporting, organisational culture has received much attention. There is also some evidence that culture within organizations may be a relevant factor in health care performance, yet articulating the nature of that relationship proves to be difficult and interventions addressing safety culture are not clearly effective .
Organizational problems, such as suboptimal control of repeat prescriptions or inadequate routines for cleaning equipment, contribute to patient safety incidents. The challenge is to identify methods to identify and remedy such organizational problems, which are effective as well as feasible in primary care. An inventory in an international panel of primary care experts found that continuing education of health professionals on patient safety was perceived as highly relevant and currently lacking . Focusing educational interventions (e.g. audit and feedback, prospective risk analysis) on organisation of primary care is potentially feasible and effective to improving patient safety. The question is which items need to be considered in educational programs to enhance patient safety.
In the context of Linneaus Euro-PC, an international patient safety promoting and researching initiative on patient safety in primary care, we asked respondents to rate organisational items . Our aim was to document the relevance of specific organisational items for patient safety to support the development of educational programs for enhancing patient safety in primary care.
Study design and setting
A web-based survey was conducted in a purposeful sample of primary care physicians and researchers with a special interest in patient safety. With help of the Linneaus project we identified the participants. Key individuals (all members of the Linneaus consortium) were asked to provide the names of at most 10 practising primary care physicians with a potential interest in patient safety and at most 10 researchers or experts in patient safety in their country. A total of 111 individuals were e-mailed and invited to complete an internet survey. Non-respondents were sent a second invitation after one week and a third invitation one month later. The Medical Ethics Committee of the Radboud University Nijmegen Medical Centre approved this study.
Specific organisational items were based on EPA safety indicators - European Practice Assessment, an internationally validated set of indicators developed to compare and improve the organisation and management of general practices - and an interview study in primary care physicians and nurses to explore what constitutes ‘patient safety’ in primary care [12, 13]. The semi-structured interviews yielded a wide range of items considered relevant for patient safety. Salient organizational aspects were selected from these studies and translated into 52 specific items, which was subsequently reviewed by three experts on patient safety in order to fine-tune the questionnaire. These organisational items were clustered into ten broad domains: hygiene, information technology, emergency medicine, incident reporting, patient records, coordination, decision support tools, quality improvement, medication and accessibility/ triage. The respondents were asked to rate these items with respect to importance for patient safety along a five-point Likert scale which ranged from ‘not important’ to ‘extremely important’. The survey also included some questions to determine the demographic characteristics of the respondents. The following text was provided with the questionnaire: ‘We use a broad definition of patient safety. A patient safety incident is defined as an unintended event during the care process that resulted, could have resulted, or still might result in harm to the patient. Both acts of omission and of commission are included’.
The data were entered into SPSS 16.0 for analysis and the response frequencies per item were calculated. As the numbers of responses per country are low, we did not compare the outcomes between countries.
The survey was completed by 65 individuals (59% response rate). Table 1 reports on their characteristics. Most (n = 48) had medical training, of which 41 were practicing general practitioners (GPs) or family/ primary care physicians. Seven had a biomedical, behavioural, social science, or information technology backgrounds and five had a background in pharmacy. The remaining three respondents had a background in allied health professions. Those working in a practice worked in practices that were spread across rural areas, towns and cities. There was a wide spread in the number of patients per practice. Table 2 reports on the reported perceived relevance of patient safety items. Table 3 reports on the average score per pre-defined domain. We will discuss the most salient findings below. We will discuss the domains in order to average rating.
Domain A: Hygiene (4 items)
The use of sterile equipment with small surgical procedures was scored as the most relevant item. All hygiene items were scored among the 10 most important items.
Domain B: Information technology (3 items)
The item ‘The patient record system has a facility for information back-up’ scored highest in this group and tenth overall. Many respondents scored ‘The practice has all documentation included in an electronic patient record system’ and ‘All prescriptions are done in an electronic prescribing system in the practice’ as extremely important for patient safety.
Domain C: Emergency medicine (6 items)
The item ‘availability of adequate emergency drugs in stock’ was scored highest in this group and second overall. Next to this, the items ‘There is at least one adequately trained staff member available to deal with collapse and need for resuscitation’ and ‘GPs are periodically trained in basic life support and other medical emergencies’ were scored extremely important.
Domain D: Incident reporting (6 items)
The item ‘the practice analyses the reported incidents, and takes adequate actions’ was scored highest in this group and thirteenth overall.
Domain E: Patient records (4 items)
The item ‘Major diseases and health problems are labelled in the patient record (for example in a problem list)’ was scored highest in this group and eighth overall. Next to this, the item ‘Every clinical telephonic advice given is noted in the patient record’ was scored relatively high.
Domain F: Coordination of care (3 items)
The item ‘When a patient is discharged from the hospital adequate information is handed over to the GP’ was scored highest in this group and sixth overall.
Domain G: Decision support tools (7 items)
The item ‘There is a system for showing alerts to inform GPs of seriously abnormal test results’ was scored highest in this group and twelfth overall.
Domain H: Quality management (5 items)
All items were scored extremely important by less than 20% of the respondents.
Domain I: Medication (9 items)
The items ‘There is an actual list of medication used present in the practice for every patient’ and ‘The practice has a control programme for oral anticoagulants when prescribed and dosed by the practice’ were scored highest in this group and fifteenth overall.
Domain J: Accessibility/ triage (4 items)
The items ‘The practice has an emergency telephone line’, ‘Is it easy to get in contact with out-of-hours service’ and ‘There is an adequate triage on the telephone to assess the urgency of the complaints’ were scored mediocre important.
Items that yielded the highest scores (>50% of the experts scored the items as ‘extremely important’) were the use of only sterile equipment with small surgical procedures, the availability of adequate emergency drugs in stock, regular cleaning of facilities (e.g. spirometry), the use of sterile surgical gloves when recommended, the availability of at least one adequately trained staff member to deal with collapse and need for resuscitation, adequate information hand over when a patient is discharged from the hospital and periodically training of GPs in basic life support and other medical emergencies. We suggest that these organizational items should be targeted by educational interventions to enhance patient safety in primary care.
A previous consultation of an international panel showed that educational approaches to improving patient safety were prioritized, such as practice guidelines, a culture that enhances learning, and continuing education. Therefore we focused on such approaches in our consultation of international experts. As far as we know, this was the first study which systematically examined a broad range of organizational items in relation to patient safety in primary care in an international context. An observational study in a convenient sample 271 general practices from 10 countries found substantial variation in presence of organizational items, which was to some extent related to practice size . However, this observational study was based on secondary analysis of data, while we developed our list of organizational items from the beginning with a focus on patient safety in primary care.
Some remarkable results will be highlighted. First, it was noticed that the domain hygiene scored highest of all domains; all items scored among the ten most important items. This is interesting, because hygiene is not universally perceived as highly relevant for patient safety in primary care . Next to this, the domain information technology and emergency medicine scored very high as all but one item were scored ‘extremely important’ by more than thirty percent of the respondents. In many countries the items among these domains have received a lot of attention. Nevertheless, there still seem to be practices where all recommended organizational items are not implemented . To our surprise, the theme ‘medication’ scored relatively low. This may indicate that the respondents do not find medication issues important for patient safety. However, it may also indicate that respondents opt for other ways of improving knowledge about medication rather than via interventions aimed at patient safety.
Strengths and weaknesses
Our study was based on a series of studies and involved an international panel of experts, both of which contributed to the validity of findings . However, the response rate was 59% so we cannot rule out selection bias. For instance, most of the respondents were primary care physician, so managers and policy makers may be underrepresented. The use of an international panel may result in the exclusion of items, which are crucially important in a particular country but not in others (for example items related to advanced technical or organizational infrastructures). However, the items that are selected by an international panel despite differences across countries are likely to be important. It might be possible that we missed important organizational items, because it is not possible to identify and assess all possible items systematically. In our study, we focused on patient safety from the provider perspective. In further research and development, the role of the patient in patient safety systems needs be further explored. Apart from this, we could not test the questionnaire at length before applying it. The low sample size did not allow reliable comparisons between for example rural and urban general practitioners, or similar comparisons.
Implications for future research
This study highlights those patient safety items that could be included in educational patient safety interventions in primary care. Obviously, other organisational items may be particularly relevant in specific countries but less important in other countries, because primary care is organized in different ways across the world. The logical next step is to develop, apply and evaluate interventions which address the prioritized organizational items. Audit and feedback is likely to be one component of such interventions. It is helpful to consider the work by Ivers et al. . which suggests that an educational intervention has highly variable impact and that specific factors seem to attribute to higher impacts: the intervention is most effective when baseline performance is low, feedback is provided by a supervisor or senior colleague, the feedback is provided more than once, the feedback is provided both verbally and written and the feedback includes both measurable targets and an action plan.
This international inventory among experts of patient safety in primary care identified organizational items, which could be targeted by educational interventions. The development and evaluation of such interventions is the logical next step.
Stelfox HT, Palmisani S, Scurlock C, Orav EJ, Bates DW: The “To Err is Human” report and the patient safety literature. Qual Saf Health Care. 2006, 15 (3): 174-178. 10.1136/qshc.2006.017947.
Donaldson SL: An international language for patient safety: global progress in patient safety requires classification of key concepts. Int J Qual Health Care. 2009, 21 (1): 1-10.1093/intqhc/mzn056.
Starfield B, Shi L, Macinko J: Contribution of primary care to health systems and health. Milbank Q. 2005, 83 (3): 457-502. 10.1111/j.1468-0009.2005.00409.x.
Sandars J, Esmail A: The frequency and nature of medical error in primary care: understanding the diversity across studies. Fam Pract. 2003, 20 (3): 231-236. 10.1093/fampra/cmg301.
Gaal S, Verstappen W, Wolters R, Lankveld H, van Weel C, Wensing M: Prevalence and consequences of patient safety incidents in general practice in the Netherlands: a retrospective medical record review study. Implement Sci: IS. 2011, 6: 37-10.1186/1748-5908-6-37.
Wetzels R, Wolters R, van Weel C, Wensing M: Mix of methods is needed to identify adverse events in general practice: a prospective observational study. BMC Fam Pract. 2008, 9: 35-10.1186/1471-2296-9-35.
Conradi M: Fouten van huisartsen. 1995, Amsterdam: Boom
McKay J, Bradley N, Lough M, Bowie P: A review of significant events analysed in general practice: implications for the quality and safety of patient care. BMC Fam Pract. 2009, 10: 61-10.1186/1471-2296-10-61.
Scott T, Mannion R, Marshall M, Davies H: Does organisational culture influence health care performance? A review of the evidence. J Health Serv Res Policy. 2003, 8 (2): 105-117. 10.1258/135581903321466085.
Gaal S, Verstappen W, Wensing M: What do primary care physicians and researchers consider the most important patient safety improvement strategies?. BMC Health Serv Res. 2011, 11: 102-10.1186/1472-6963-11-102.
Learning from International Networks about Errors and Understanding Safety in Primary Care (LINNEAUS Euro-PC). http://www.linneaus-pc.eu,
Gaal S, van Laarhoven E, Wolters R, Wetzels R, Verstappen W, Wensing M: Patient safety in primary care has many aspects: an interview study in primary care doctors and nurses. J Eval Clin Pract. 2010, 16 (3): 639-643.
Engels Y, Dautzenberg M, Campbell S, Broge B, Boffin N, Marshall M, Elwyn G, Vodopivec-Jamsek V, Gerlach FM, Samuelson M, et al: Testing a European set of indicators for the evaluation of the management of primary care practices. Fam Pract. 2006, 23 (1): 137-147.
Gaal S, van den Hombergh P, Verstappen W, Wensing M: Patient safety features are more present in larger primary care practices. Health policy. 2010, 97 (1): 87-91. 10.1016/j.healthpol.2010.03.007.
Gaal S, Verstappen W, Wensing M: Patient safety in primary care: a survey of general practitioners in The Netherlands. BMC Health Serv Res. 2010, 10: 21-10.1186/1472-6963-10-21.
Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O’Brien MA, Johansen M, Grimshaw J, Oxman AD: Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Datab Syst Rev. 2012, 6: CD000259-doi:10.1002/14651858.CD000259.pub3
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2296/14/145/prepub
The participation of the experts and general practitioners is gratefully acknowledged. This study is part of the Linneaus project http://www.linneaus-pc.eu, and is a project funded by the European Union Framework 7 programme.
The authors declare that they have no competing interests.
SG, WV and MW developed the study; JW collected the data, performed the analyses, presented the results and drafted the manuscript. WV and SG contributed to the conception and design of the study and critically revised the manuscript. MW supervised the study, contributed to the conception and design of the study and critically revised the manuscript. All authors read and approved the final manuscript.
About this article
Cite this article
Wammes, J.J.G., Verstappen, W., Gaal, S. et al. Organisational targets of patient safety improvement programs in primary care; an international web-based survey. BMC Fam Pract 14, 145 (2013). https://doi.org/10.1186/1471-2296-14-145
- Patient safety
- Primary care
- Prospective risk analysis