- Research article
- Open Access
- Open Peer Review
Enhancing delivery of osteoarthritis care in the general practice consultation: evaluation of a behaviour change intervention
BMC Family Practice volume 19, Article number: 26 (2018)
Professionally-focussed behaviour change intervention (BCI) workshops were utilised in the Management of OsteoArthritis in Consultations (MOSAICS) trial investigating the feasibility of implementing the National Institute for Health and Care Excellence (NICE) Osteoarthritis (OA) Guideline in general practice. The workshops aimed to implement the general practitioner (GP) component of the trial intervention: an enhanced consultation for patients presenting with possible OA. This study presents an evaluation of the BCI workshops on GP competency in conducting these enhanced consultations.
A before-and-after evaluation of the workshops, delivered to GPs participating in the intervention arm of the MOSAICS trial, using video-recorded GP consultations with simulated OA patients. GPs attended four workshops, which had been developed using an implementation framework. Videos were undertaken at three time-points (before workshops and at one- and five-months after) and were assessed by independent observers, blinded to time points, for GP competency in undertaking 14 predetermined consultation tasks.
Videos of 15 GPs were assessed. GP competency increased from a median of seven consultation tasks undertaken by each GP at baseline to 11 at both time-points after the workshops. Specific tasks which were undertaken more frequently after the workshops related to explaining that OA is treatable and not inevitably progressive, eliciting and addressing patient expectations of the consultation, and providing written OA information. However, the use of the word “osteoarthritis” in giving the diagnosis of OA was not enhanced by the workshops.
BCI workshops can enhance GP competency in undertaking consultations for OA. Further initiatives to implement the NICE OA Guideline and enhance the care of people with OA in primary care can be informed by the content and delivery of the workshops evaluated in this study.
Osteoarthritis (OA) is a highly prevalent long-term condition in older adults for which extensive recommendations on assessment and treatment have been published [1,2,3,4,5]. It is predominantly managed in primary care, notably in the UK in general practice, but surveys of care, and interviews with patients and professionals, indicate that management of OA in general practice is suboptimal [6,7,8].
One aspect of suboptimal OA care is the conduct by general practitioners (GPs) of consultations for older patients presenting with peripheral joint pain, those likely to have OA. Evidence suggests that elements of the consultation could be improved, including: making the diagnosis of OA clinically; providing accurate information about the condition and on prognosis; promoting and supporting the use of non-pharmacological treatments; and adopting a patient-centred approach [9,10,11].
In the UK the National Institute for Health and Care Excellence (NICE) recommends that: OA should be diagnosed clinically; a holistic assessment should be undertaken; OA self-management should be supported; core treatments should be information, advice on activity and exercise and, if relevant, interventions to achieve weight loss; non-pharmacological and pharmacological treatments, and referral for consideration of joint should be used as additional treatment options [3, 12]. To implement these recommendations in UK general practice they would need to be acted on by GPs – to whom the majority of people with possible OA first present. Given current evidence of suboptimal GP consultations for OA, implementation of NICE OA guidance would need to include activities to enhance GP OA consultations.
This approach was taken in the Management of OsteoArthritis in Consultations (MOSAICS) trial, a cluster randomised trial to investigate the impact of implementing the 2008 NICE OA Guideline . The trial intervention was a “model OA consultation” delivered by intervention arm practices to patients aged 45 years and over presenting to their GP with peripheral joint pain. This consisted of an OA Guidebook, an “enhanced initial OA consultation” with the GP, and a nurse-led OA clinic. A behaviour change intervention (BCI) was developed, and delivered as a series of BCI workshops, to implement the delivery of the “enhanced initial OA consultation” by GPs in intervention arm practices .
When evaluating the impact of behaviour change interventions, direct measurement of the intended behaviour, such as GP performance in day-to-day clinical practice, is recommended wherever possible, but indirect proxy measures are available when this is not practical . Such proxy measures include the use of patient report, analysis of medical record entries, and the use of video-recorded consultations with simulated patients to measure competency – what someone is capable of doing in “controlled representations of professional practice” . In the context of the MOSAICS trial it was not practical to directly measure GP performance in delivering the “enhanced initial OA consultation” – due to the logistics of recording such consultations in day-to-day practice – and a proxy measure was chosen.
This study aimed to evaluate the success of BCI workshops to implement delivery by GPs of the “enhanced initial OA consultation” by measuring workshop impact on GP competency to conduct these consultations using video-recorded consultations with simulated patients.
A before-and-after evaluation of BCI workshops (for simplicity henceforth referred to as “the workshops”) was conducted using paired data on video-recorded consultations between GPs and simulated patients presenting with joint pain. GPs were video-recorded at their practices at three time-points: baseline before the workshops, and 1 month and 5 months after the workshops.
Setting and participants
The study took place in four UK general practices which were participating in the intervention arm of the MOSAICS trial. All GPs working in these practices were invited to attend the workshops on OA management and delivery of the “enhanced initial OA consultation”. Eligible GPs for this study were those working in one of the practices and who had a video-recorded consultation at each time-point.
The development of the content and style of the workshops has been described in detail elsewhere . In brief they were developed using an implementation of change model , presented the GPs with a “concrete proposal for change” , addressed “determinants of change” identified using the Theoretical Domains Framework , and incorporated systematically selected behaviour change techniques . They consisted of four workshops, which used a mixture of didactic and interactive sessions, were learner-centred and facilitated by local opinion leaders, principally addressed identified knowledge and skills gaps relevant to delivery of OA consultations, and were mainly delivered at the GP practices. Full details are given in Additional file 1 using the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) checklist .
Video-recorded consultation data capture
Five simulators, who each portrayed a simulated patient with a different “story”, were recruited and trained for the study. At each time-point a research nurse and simulated patient attended the practice and GPs were invited, during an organised break in morning surgery, to undertake a simulated consultation (one at each time-point). At baseline (before the workshops) GPs were instructed to undertake the consultation as they would normally do, at the two later time-points (after the workshops) they were asked to undertake the consultation as promoted in the workshops. At each time-point the simulated patient, and so the scenario he or she presented, was new to the GPs, so providing a proxy for a new patient first presenting with a new problem (see Additional file 2).
Assessment of video-recorded consultations
Videos were assessed for the presence of 14 predetermined OA consultation tasks. The tasks were the elements of the “enhanced initial OA consultation” which had been identified from a consensus study  as key elements of an initial consultation between a GP and an older adult presenting with peripheral joint pain (Table 1).
Videos were assessed by four trained assessors (GPs who were all independent of the MOSAICS trial), using a rating tool whose validity, and reliability in use, had been established (for details of assessor training, and validity and reliability testing see Additional file 3). Assessors were instructed to decide for each video and for each task whether the task had been undertaken or not, i.e. a binary assessment of “task present” or “task not present”. Each assessor was randomly allocated a set of trial GPs’ videos, (those of three or four GPs) and they assessed in random order all the videos of each of their allocated GPs, blinded to time-point.
Duration of videotaped consultations was calculated in minutes, and paired t tests were used to compare duration at baseline with that at one- and five-months.
We sought to measure both the competence of an individual GP in conducting an entire consultation, and the extent to which an individual task was undertaken by all the GPs at a given time-point. Two summary measures were therefore defined:
GP competency score: the number of tasks assessed as present in each video.
Task delivery score: the number of videos at a given time-point in which the task was assessed as present.
GP competency score was determined for each GP at each time-point. For each time-point median, interquartile range and range of competency scores across all GPs were calculated. Wilcoxon matched pairs signed-rank sum test  was used to compare median GP competency score at baseline with that at one- and five-months.
Task delivery score was calculated for each consultation task at each time-point and McNemar test with continuity correction (2-sided)  was used to compare scores at baseline with those at one- and five-months.
Thirty-one GPs in total were eligible to take part from the practices participating in the MOSAICS trial. All were invited to attend the workshops and be video-recorded. Baseline videos were obtained for 24 GPs. Of these, there were 15 GPs who had a video suitable for analysis from all three time-points (baseline plus two follow-ups), resulting in a total of 45 videos assessed and used for the main analysis (full details given in Fig. 1 (participant recruitment flowchart)). Of the 15 GPs, 12 had attended all the workshops, two GPs two of the three workshops and one GP none.
Mean duration of all videos was 14.46 min (range of 8.80 to 26.93 min) with no difference in duration at the three time-points (paired t test: baseline v one-month, p = 0.28: baseline v five-months, p = 0.63; one-month v five-months, p = 0.13).
GP competency score increased after the workshops from median of seven consultation tasks undertaken before the workshops to 11 at both one-month and five-months after (Wilcoxon signed-rank test: one-month v baseline, p = 0.001; five-months v baseline, p = 0.001), see Table 2 for full details.
Task delivery score was high at baseline for two tasks (eliciting what the patient is trying for pain, and advising or prescribing analgesia) which were present in all baseline videos. The score for six other tasks increased after the workshops at one-month (McNemar test: one-month v baseline, p < 0.05), with the increase for three of these tasks sustained at five-months (McNemar test: five-month v baseline, p < 0.05), see Table 3 for full details.
The task delivery score for “Giving the diagnosis of OA using the word “osteoarthritis”” decreased non-significantly after the workshops (Table 3), an unexpected finding given this task was a key focus of the workshops. Further analysis determined that the reason for the low task delivery scores after the workshops was that the diagnosis was often given using the word “arthritis”, and not “osteoarthritis” (see Additional file 4).
This study has demonstrated that GP competency for undertaking consultations for OA can be significantly increased by workshops. After the workshops, GPs were undertaking a median of 11 of 14 pre-determined OA consultation tasks in each consultation, and nine of the tasks were being undertaken by at least 80% of GPs at each consultation. Six tasks increased in frequency from baseline and were those relating to: giving more positive explanations about OA, eliciting and addressing patient expectations about the consultation, offering written information, and, in the context of the MOSAICS trial, offering a follow-up in a nurse-led OA clinic. Tasks relating to managing pain and advising on exercise were undertaken by nearly all GPs at baseline and continued to be so after the workshops, but those relating to eliciting patient ideas about their problem, their understanding of OA, and their prior use of non-pharmacological treatments were not increased by the workshops and were variably undertaken by the GPs.
Despite being a specific focus of the workshops, using the word “osteoarthritis” when giving the diagnosis of OA did not increase after the workshops, with OA often being referred to as “arthritis”. This finding aligns with the conclusion from a recent observational study on real-life consultations for OA that there is much confusion as to how to portray and explain OA in the general practice consultation . The average duration of the video-recorded consultations was longer than GP consultations in day-to-day practice, and may reflect the effect of being observed, but the increase in competency was not associated with longer consultations. This is an important finding for generalisability and implementation of the optimal consultation.
To our knowledge this is the first study which has evaluated the effect of a behaviour change intervention to optimise GP consultations for OA on clinical practice. Other studies on primary care management of OA have evaluated the effect of standardised consultations , interactive peer-group training  and a training course about OA care  on patient outcomes but not clinical practice. Studies which have evaluated the effect of workshops using a similar approach to skills training for GPs as used in this study, those based on the “context-bound” skills training method  (a method which focuses on the management of the clinical problem and not simply the uptake of specific communication skills), have shown that this approach can significantly enhance clinical practice in consultations for other conditions [28, 29].
Study strengths included the robust assessment methodology used, with each assessor viewing all the videos of an individual GP in random order and blinded to time-point, and the establishment of validity and reliability of use of the video rating tool. All bar one of the GPs included in the evaluation had attended two or more workshops.
Study limitations included the use of a non-randomised before and after design to evaluate the workshops, but the logistics of embedding the study in the intervention arm practices of the MOSAICS trial precluded randomising GPs to training or not training, as all needed to be trained to deliver the trial intervention. In addition resources precluded undertaking video-recorded consultations with control arm practices. However, the use of paired before and after observations enabled us to control for the effect of GP characteristics differing between time-points. A possible limitation is that in two practices not all the GPs invited to attend the training were included in this study as not all had a full set of video-consultations. This could have resulted in selection bias in that those included might not have been typical of all GPs from these practices. The GPs who were included might have been more committed to the study, in that they undertook all the videos, and so may have been more motivated to enhance their clinical practice. However, two of the 11 GPs included from these practices were only “partially trained” and one not trained at all, suggesting that even among the included GPs there was a range of commitment to the study. Furthermore, whether GPs had a full set of videos for assessment, or not, was due to whether they were working in the practice on the days the videos were undertaken and not solely to their commitment to the study: the research nurse endeavoured to video all GPs who were present in the surgery at the time of the video sessions. Another possible limitation, with the use of repeat video-recorded consultations to evaluate the workshops, is that of a learning effect from previously undertaking the consultation. We addressed this by using different simulated patients with different scenarios at each of the three time-points.
The finding that the workshops increased GP competency for OA consultations should be generalisable to GPs as a whole: although the GPs in this study were those in practices which had signed up to participating in the MOSAICS trial, and so may have differed from GPs as a whole, their reported views and practice at baseline on OA management were similar to those reported by GPs more generally [30, 31]. Although the findings are for GP competency for OA consultations, and not performance, the consultations with simulated patients were made as real and naturalistic as possible by undertaking them in the GPs’ own surgeries and by having detailed and realistic patient scenarios and biographies (see Additional file 2). The use of the workshops, in the specific manner in which they were delivered in this study, to enhance other GPs’ clinical practice for OA may not be feasible across the health service as a whole: the workshops were quite labour-intensive to deliver and required GPs to commit considerable time to attendance. In the UK NICE has recently updated its guidance on the care of people with OA  and, given current evidence on the management of OA in general practice in the UK, implementation of its recommendations will require GP consultations for OA to be optimised. The evidence from this study, on how to enhance GP competency for such consultations, will contribute to developing training resources for more general use, evidenced by its use in the development of written  and on-line  educational material for UK GPs and in underpinning OA implementation projects in UK regionally and in Europe. One issue that the detailed information from the current study will enable us to reflect on and consider is whether the content and delivery of training can be streamlined and made more efficient for general use without reducing its effectiveness in changing GP behaviour.
Further research is needed on how to help GPs better communicate with patients about OA, both in terms of what to call it, which was not resolved by this study, and of how to explain what it is. The latter can build on the approach taken in this study which led to GPs giving more positive OA explanations, namely that OA is treatable and is not inevitably progressive.
In summary, this before and after study has demonstrated that GP competency in undertaking consultations for OA can be enhanced. The workshops evaluated in this study to enhance competence can inform development of future generalised initiatives to enhance OA care in general practice.
Behaviour change intervention
- MOSAICS trial:
Management of OsteoArthritis in Consultations trial
National Institute for Health and Care Excellence
Thomas E, Peat G, Croft P. Defining and mapping the person with osteoarthritis for population studies and public health. Rheumatology (Oxford). 2014;53(2):338–45.
Jordan KP, Joud A, Bergknut C, Croft P, Edwards JJ, Peat G, et al. International comparisons of the consultation prevalence of musculoskeletal conditions using population-based healthcare data from England and Sweden. Ann Rheum Dis. 2014;73(1):212–8.
Conaghan PG, Dickson J, Grant RL, Guideline DG. Care and management of osteoarthritis in adults: summary of NICE guidance. BMJ. 2008;336(7642):502–3.
Zhang W, Doherty M, Arden N, Bannwarth B, Bijlsma J, Gunther KP, et al. EULAR evidence based recommendations for the management of hip osteoarthritis: report of a task force of the EULAR standing Committee for International Clinical Studies Including Therapeutics (ESCISIT). Ann Rheum Dis. 2005;64(5):669–81.
Jordan KM, Arden NK, Doherty M, Bannwarth B, Bijlsma JW, Dieppe P, et al. EULAR recommendations 2003: an evidence based approach to the management of knee osteoarthritis: report of a task force of the standing Committee for International Clinical Studies Including Therapeutic Trials (ESCISIT). Ann Rheum Dis. 2003;62(12):1145–55.
Steel N, Hardcastle AC, Clark A, Mounce LT, Bachmann MO, Richards SH, et al. Self-reported quality of care for older adults from 2004 to 2011: a cohort study. Age Ageing. 2014;43(5):716–20.
Porcheret M, Jordan K, Jinks C, Croft P. Primary care rheumatology society. Primary care treatment of knee pain--a survey in older adults. Rheumatology (Oxford). 2007;46(11):1694–700.
Jinks C, Ong BN, Richardson JC. A mixed methods study to investigate needs assessment for knee pain and disability. Population and individual perspectives. BMC Musculoskelet Disord. 2007;8:59.
Paskins Z, Sanders T, Hassell AB. Comparison of patient experiences of the osteoarthritis consultation with GP attitudes and beliefs to OA: a narrative review. BMC Fam Pract. 2014;15:46.
Paskins Z, Sanders T, Croft PR, Hassell AB. The identity crisis of osteoarthritis in general practice: a qualitative study using video-stimulated recall. Ann Fam Med. 2015;13(6):537–44.
Coxon D, Frisher M, Jinks C, Jordan K, Paskins Z, Peat G. The relative importance of perceived doctor's attitude on the decision to consult for symptomatic osteoarthritis: a choice-based conjoint analysis study. BMJ Open. 2015;5(10):e009625,2015–009625.
NICE Pathway for the Management of Osteoarthritis. Available at: https://pathways.nice.org.uk/pathways/osteoarthritis. Accessed 30 Jan 2018.
Dziedzic KS, Healey EL, Porcheret M, Ong B, Main CJ, Jordan KP, et al. Implementing the NICE osteoarthritis guidelines: a mixed methods study and cluster randomised trial of a model osteoarthritis consultation in primary care - the management of OsteoArthritis in consultations (MOSAICS) study protocol. Implement Sci. 2014;9(1):95.
Porcheret M, Main C, Croft P, McKinley R, Hassell A, Dziedzic K. Development of a behaviour change intervention: a case study on the practical application of theory. Implement Sci. 2014;9(1):42.
Hrisos S, Eccles M, Francis J, Dickinson H, Kaner E, Beyer F, et al. Are there valid proxy measures of clinical behaviour? A systematic review. Implement Sci. 2009;4(1):37.
Rethans JJ, Norcini JJ, Baron-Maldonado M, Blackmore D, Jolly BC, LaDuca T, et al. The relationship between competence and performance: implications for assessing practice performance. Med Educ. 2002;36(10):901–9.
Grol R, Wensing M, Eccles M. Improving patient care: the implementation of change in Clinical Practice. 2005.
Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A, et al. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf. Health Care. 2005;14(1):26–33.
Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived Behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57(4):660–80.
Phillips A, Lewis L, McEvoy M, Galipeau J, Glasziou P, Moher D, et al. Development and validation of the guideline for reporting evidence-based practice educational interventions and teaching (GREET). BMC Med. Educ. 2016;16:237.
Porcheret M, Grime J, Main C, Dziedzic K. Developing a model osteoarthritis consultation: a Delphi consensus exercise. BMC Musculoskelet Disord. 2013;14:25.
Altman DG. Practical statistics for medical research. 1st ed. London: Chapman and Hall; 1991.
Siegel S, Castellan N. Nonparametric statistics for behavioural sciences. 2nd ed. New York: McGraw-Hill Book Company; 1988.
Ravaud P, Flipo RM, Boutron I, Roy C, Mahmoudi A, Giraudeau B, et al. ARTIST (osteoarthritis intervention standardized) study of standardised consultation versus usual care for patients with osteoarthritis of the knee in primary care in France: pragmatic randomised controlled trial. BMJ. 2009;338:b421.
Rosemann T, Joos S, Laux G, Gensichen J, Szecsenyi J. Case management of arthritis patients in primary care: a cluster-randomized controlled trial. Arthritis Rheum. 2007;57(8):1390–7.
Chassany O, Boureau F, Liard F, Bertin P, Serrie A, Ferran P, et al. Effects of training on general practitioners’ management of pain in osteoarthritis: a randomized multicenter study. J Rheumatol. 2006;33(9):1827–34.
Rollnick S, Kinnersley P, Butler C. Context-bound communication skills training: development of a new method. Med Educ. 2002;36(4):377–83.
Rollnick S, Seale C, Kinnersley P, Rees M, Butler C, Hood K. Developing a new line of patter: can doctors change their consultations for sore throat? Med Educ. 2002;36(7):678–81.
Cals JW, Scheppers NA, Hopstaken RM, Hood K, Dinant GJ, Goettsch H, et al. Evidence based management of acute bronchitis; sustained competence of enhanced communication skills acquisition in general practice. Patient Educ Couns. 2007;68(3):270–8.
Kingsbury SR, Conaghan PG. Current osteoarthritis treatment, prescribing influences and barriers to implementation in primary care. Prim Health Care Res Dev. 2012;13(4):373–81.
Cottrell E, Roddy E, Foster NE. The attitudes, beliefs and behaviours of GPs regarding exercise for chronic knee pain: a systematic review. BMC Fam Pract. 2010;11:4. 2296-11-4
Osteoarthritis. Care and management in adults. Available at: http://guidance.nice.org.uk/CG177/NICEGuidance/pdf/English. Accessed 16 June 2014.
Osteoarthritis: a modern approach to diagnosis and management. Available at: http://www.arthritisresearchuk.org/health-professionals-and-students/reports/hands-on/hands-on-autumn-2011.aspx. Accessed 16 June 2014.
Musculoskeletal Care ( osteoarthritis module). Available at: http://elearning.rcgp.org.uk/course/info.php?popup=0&id=206. Accessed 30 Jan 2018.
We would like to thank the following who have contributed to the work presented in this article: the GPs in the four intervention practices of the MOSAICS trial who attended the workshops and agreed to undertake repeated video-recorded consultations; Richard Hayward, John Edwards, Simon Somerville and Claire Burton for agreeing to be assessors for the videos; Doreen Briggs, Tim Briggs, Jean Clarke, Bernard Moss and Sheila Moss who acted as simulated patients for the videos; Kelvin Jordan for help with statistical analysis; Ashley Ford for technical help with the videos;. June Handy, Chan Vohora and Angela Pushpa-Rajah who helped organise the set-up and delivery of the workshops and video sessions; members of the MOSAICS trial research team, especially Emma Healey, Vince Cooper and Zoe Paskins who helped develop and deliver the training workshops.
This paper presents independent research commissioned by the UK National Institute for Health Research (NIHR) Programme Grant (RP-PG-0407-10386). This research was also commissioned by the Arthritis Research UK Centre in Primary Care grant (Grant Number 18139). KD and MP are supported by the UK NIHR Collaborations for Leadership in Applied Health Research and Care West Midlands. KD is part-funded by a Knowledge Mobilisation Research Fellowship (KMRF-2014-03-002) from the NIHR. MP was supported by an NIHR In-Practice Fellowship. The views expressed in this paper are those of the author(s) and not necessarily those of the National Health Service, the NIHR or the Department of Health.
Availability of data and materials
The datasets during and/or analysed during the current study available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The study was approved by the North West 1 Research Ethics Committee, Cheshire, UK (REC reference: 10/H1017/76), informed written consent was given by all GPs participating in the study.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
GREET 2015 checklist for the behaviour change intervention workshops. (DOCX 25 kb)
Development of simulated patient scenarios and biographies (a description of their development and a synopsis of the six scenarios developed), and arrangements for undertaking video-recorded simulated patient consultations. (DOCX 22 kb)
Validity, and reliability in use, of the video rating tool - methodology and results of establishing validity and reliability of the video rating tool. (DOCX 93 kb)
Further analysis of task delivery score for “Giving the diagnosis of OA using the word “osteoarthritis – methodology” and results of further analysis undertaken”. (DOCX 15 kb)