- Research article
- Open Access
- Open Peer Review
Patient satisfaction with a teleradiology service in general practice
BMC Family Practice volume 17, Article number: 17 (2016)
Accessibility to secondary health services is not always easy for patients who live at a great distance of hospital. In these circumstances, transferring diagnostic tools and treatment options to primary care could prove beneficial for patients. To do so, the quality of medical care and the costs and benefits of the approach need to be assessed. However, the patient perspective is equally important, offering important insights.
In a cross-sectional study we investigate the satisfaction of patients toward a new teleradiology facility offered a general practice on Ameland, an island in the Netherlands.
A questionnaire was created based on the Dutch version of the Patient Satisfaction Questionnaire III and completed by all patients after receiving an x-ray in primary care between June 1, 2007 and June 1, 2009. Those who received more than one x-ray in that period were included only once. The technical and interpersonal skills of doctors were rated out the sum score of the questionnaire namely 25 and 30, respectively. Analysis of variance (ANOVA) was used to analyze the differences between the means of the satisfaction subscales and the patient characteristics.
The response proportion was after reminder 65 % (381/587 patients). Satisfaction with the technical skills of the doctor providing the teleradiology service was 22.4 ± 3.7, while satisfaction with the interpersonal skills of the doctor during the diagnostic phase was 26.8 ± 3.8. Island residents, the elderly, and those with no history of trauma were more satisfied with the technical and interpersonal aspects of the consultation than non-residents, younger patients, and those with a history of trauma.
Patients in the island community of Ameland experienced high levels of satisfaction with the teleradiology service offered in primary care.
The debate as to whether traditional secondary care services can be transferred to primary care has received renewed impetus, not only because of the need to control spiraling healthcare costs [1–3] but also because of developments in the available technology [4–8]. Indeed, it is now possible for the general practitioner (GP) and the specialist to discuss and determine treatment options through the exchange of electronic data files. Therefore, patients do not necessarily have to attend hospital for specialist diagnostic assessment. This approach is, already commonplace in cardiology and dermatology in the Netherlands where electrocardiograms and images of skin abnormalities, respectively, are sent digitally from the GP to the specialist for diagnosis and treatment [9, 10]. Another potential area where traditional secondary care services can be introduced to primary care is radiological examination. Teleradiology can be of particular benefit in remote areas.
The present article deals with patient satisfaction of the x-ray and teleradiology service offered in primary care on the Dutch island of Ameland. We showed already that the introduction of teleradiology in general practice has reduced the costs for both the healthcare provider and the patient , the number of missed fractures, the unnecessary travel to the hospital with an increase of the treatment in the general practice of normally hospital patients . Given these outcomes it is also very important to investigate whether the patients appreciate such a teleradiology facility. To be particular, the aim of this article is to investigate the satisfaction of patients toward a new teleradiology facility offered in primary care in an island community.
Literature on the use of teleradiology in primary care is scarce [4–8], and to our knowledge only one study has reported the views of patients: a General Practice in Otta, Norway, communicates via teleradiology with the hospital in Lillehammer at a distance of 115 km . Of note, a majority of patients (90 %) preferred an x-ray examination in Otta; only 3 % preferred an examination in Lillehammer. Patient satisfaction surveys have been used far more often in the study of telemedicine [13–16], particularly in the form of teledermatology [17–19] and teleconsultation . Again, these studies report very high levels of patient satisfaction with the service [17–21].
It is known from family practice surveys that the continuity of the doctor-patient relationship affects patient satisfaction, as do various sociodemographic factors such as age, sex, education level, and whether or not the patient is seen by their usual doctor [22–25]. This is where teleradiology may be perceived as most useful by patients, with the GP able to offer diagnostic procedures and treatment without the need for time-consuming referrals to hospital. Assessment should ideally not only include the general levels of satisfaction with the service but also the satisfaction with aspects related to the doctor-patient relationship (the interpersonal aspects of care) and the technical skills of GPs providing the service.
Study design and data collection
We conducted a cross-sectional survey to analyze patient satisfaction with the teleradiology service between June 1, 2007 and June 1, 2009. All patients who had an x-ray in primary care during the study period were included. Those who received more than one x-ray in that period were included only once. Patients or their representatives (eg. of children and patients with dementia) were asked to provide informed consent after making the x-ray on the general practice. After informed consent, a few weeks later a questionnaire was sent to their home addresses and was filled in at home by the patient themselves or by their representatives. The completed questionnaires were returned in pre-paid envelopes to an independent researcher. This procedure was used to guarantee patient anonymity and to limit the potential for response bias. A reminder was sent after three months to all patients. Patients who did not agree with the informed consent did not receive a questionnaire and were excluded. The subscales of the questionnaire that were not completely filled in by the patients were also excluded.
Ameland is a Dutch island with a population of 3500 inhabitants that increases twenty-fold with an influx of tourists during the peak season. There are only two general practices on the island, with the nearest hospital being located on the mainland, requiring a minimum travel time of four hours. Therefore, a teleradiology service was developed, with the facilities located in one of the general practices, but with the service accessible to all patients regardless of practice or tourist status.
X-rays are taken at the facility by a certified radiographer and digitally transmitted to the mainland hospital in Dokkum where evaluation and interpretation are performed by a radiologist or surgeon. This expert review service is available 24 h a day for emergencies and during daytime working hours for routine imaging. Moreover, the radiologist always responds the same day and, if necessary, direct by phone with additional instructions for the radiographer. The teleradiology service is indicated for trauma (e.g., fractures) and non-trauma (e.g., hip, knee, or lung imaging) in preparation for surgery (e.g., coxarthrosis) or for monitoring pulmonary pathology (e.g., lung carcinoma).
Quality assurance is maintained through continuous feedback about the quality of x-rays by the radiologist, and by the radiographer receiving a training in the hospital once every three months. The GP is also trained as a radiation protection expert and is responsible for radiation hygiene and safety together with the institute of Nuclear Services for Energy, Environment, and Health in the Netherlands.
Initially, information on the following variables was collected: sociodemographic variables (included age, sex, educational level, whether or not paid profession, health status, and status as an islander or tourist), previous x-ray experience, treatment experience after the x-ray examination (whether or not the patient received treatment as well as whether that treatment was received in general practice, by the GP or in hospital, by the specialist) and health status. The survey instrument was based on the Dutch version of the Patient Satisfaction Questionnaire III (PSQ.NL), a reliable instrument with adequate validity in hospital settings (e.g., oncology, surgery, cardiology departments) . The PSQ.NL measures, in contrast to the original PSQ, satisfaction in general, as well as satisfaction with the technical quality of the GPs, interpersonal skills, and accessibility of care. However, our focus was on satisfaction with the technical and interpersonal skills of the GP as well as overall satisfaction with the service.
We selected one general satisfaction question, five medical technical questions and six interpersonal questions, beginning with PSQ questions were directly usable without adaptation, and then the ones that were usable with a slight modification. The general satisfaction question (1) was specifically adapted to address the x-ray service instead of the medical care. Two questions (8: I would rather go to the hospital for an x-ray and 12: Taking x-rays is a task for the hospital) replaced the original PSQ question (7: I think my doctor’s office has everything needed to provide complete care.; and we added the brand new question 2: I could choose whether to get an x-ray in the GP surgery or in hospital) (Additional file 1: Table S1). Our questionnaire is completed with four mirror questions (Additional file 1: Table S2).
The questions were answered using a 5-point Likert scale (i.e., [strongly] disagree, neutral, and agree [strongly]) and a no-opinion possibility. Answers in this last category were excluded from the statistical analyses.
To investigate possible biases in answering the questionnaire questions, we applied the matched pair method using four questions and their mirror questions. The question and mirror questions had opposite ends. Answers to negatively posed PSQ-questions were re-coded on a positive scale such that a high score corresponded to a positive attitude. A principal component analysis on the answers of the questions with a orthogonal rotation (varimax) with Kaiser normalization, revealed that the medical technical and interpersonal subscales were loaded in the right factors with Cronbach’s alfas of 0.76 each.
In addition, the benefits of the service were listed and patients were asked to rate each benefit in terms of its value to themselves (Additional file 1: Table S3).
All analyses were performed with IBM SPSS Statistics for Windows, Version 20.0 (IBM Corp., Armonk, NY, USA). To determine the representativeness of the sample, age, sex, and island residency (yes or no) were compared with the research population, i.e., all patients that had an x-ray on the island during the research period, between June 1, 2007 and June 1, 2009. Data were presented as means of the sums of the sub-scale questions and standard deviations or as number (percentage). Analysis of variance (ANOVA) was used to analyze the differences between the means of the satisfaction subscales and the patient characteristics.
By asking patients for informed consent our study is conform the Medical Research Involving Human Subjects Act (WMO) in the Netherlands and does not need to be approved by a medical ethics committee.
Of the 587 patients invited to participate in the study, 381 returned the questionnaire (response proportion 65 %). The characteristics of the respondents are summarized in Table 1. The youngest patient was 5 years old and the oldest 101 years. The majority of patients (69 %) were island residents, with 31 % being non-islanders, these as well as gender and age were consistent with the ratios of all patients that had an x-ray on the island during the research period, between June 1, 2007 and June 1, 2009.
Most patients were educated to at least secondary school level and were not in paid employment. The main indication for x-ray was suspected fracture (35.3 %). The majority (89.0 %) had previously had an x-ray examination.
The majority of patients (90.0 %) were very satisfied with the general practice teleradiology facility and with the extra medical care they received, scoring ≥ 4 on question 1 (Additional file 1: Table S4). The preferred arguments in favor of teleradiology were: “I liked the fact that I could stay on the island or at home” (83 %); “It took me no travel time” (68 %); and “This runs more quickly than in the hospital” (67 %) (Additional file 1: Table S5). Satisfaction with the technical skills of the doctor providing the teleradiology service was 22.4 ± 3.7 and satisfaction with the interpersonal manner of the doctor was 26.8 ± 3.8, out of maximum scores of 25 and 30, respectively (Table 2).
Table 3 shows the satisfaction subscales by patient characteristics. ANOVA outcomes indicated a significant difference (p < 0.001) for islander patients and non-islander patients on both scales. Differences in satisfaction did not exist by sex, whether patients had previously had an x-ray, whether patients received treatment, whether that treatment was in general practice or hospital, level of education, health status, occupation, or between the two island general practices (p > 0.05 for all). However, satisfaction with interpersonal skills was significantly different for several variables (p < 0.001), with greater satisfaction for non-traumatic indications (versus traumatic indications), among islanders (versus non-islanders), and with advancing age (over 60 years > 20–60 years > less than 20 years) (Table 3).
This study shows that the majority of patients (90 %) having an x-ray taken in primary care on Ameland were very satisfied with the service overall and welcomed its introduction. Moreover, satisfaction with both the technical quality and the interpersonal manner were also very high, with neither sex, health status, level of education, previous in-hospital x-ray nor treatment by the GP influencing satisfaction. Island residents were more satisfied than non-residents with both the technical and interpersonal aspects of the service. Thus, the teleradiology service offered in primary care was well received on the Dutch island of Ameland. We believe that, because of the near complete isolation of the population of Ameland, the service facilitated continuity of the doctor-patient relationship for island residents. However, it was clear that the ability to stay on the island was the most important argument in favor of teleradiology, regardless of whether the patient was an islander or not.
Elderly patients and those with non-trauma indications were also more satisfied than younger patients and those with a trauma indication. Although this was true of both satisfaction subscales, the effect was most pronounced on the interpersonal scale for both age and indication. A possible explanation for the different satisfaction outcomes between trauma and non-trauma patients might be the different approach of the GP to the patient. For patients with trauma, the service tends to be more hurried and formal: to ensure accuracy and prevent complications, the GP focus is on providing quick instructions and checks followed by action and conclusion before terminating the consultation. This is a non-standard consultation technique in general practice. In contrast, a session with a non-trauma patient tends to begin with an introduction and then action, which is part of the normal GP-patient conversation that forms the basis of the doctor-patient relationship.
Our findings may be generalizable to other general practices since the current political strategy of the Western governments is to close hospitals, especially in the periphery. This implies that more and more patients will live in the future at a greater distance from the hospital and general practices becoming more remote. Our findings will be relevant for these remote general practices.
Strengths and limitations
This is the largest study of patient satisfaction with teleradiology in primary care, adding additional information to our existing knowledge base in this area. In addition, it is the first study that investigates patient satisfaction in general and the technical quality and interpersonal manner during their experience of the teleradiology service. Another notable strength is the response proportion of 65 %.
Limitations of the study are the cross sectional design, it is a study at on specific point in time and we do not know the level of patient satisfaction before the introduction of the teleradiology service. Satisfaction with referral to the mainland hospital for an x-ray is also unknown. Both these facts preclude meaningful comparison. Therefore, we cannot conclude whether patient satisfaction improved after the introduction of the teleradiology service, or whether there was truly greater satisfaction than with the usual hospital service. Nevertheless, the most important perceived benefit with the teleradiology service in the general practice was the fact that patients could stay on the island. Future studies in this area might benefit from a before and after comparison to confirm our argument.
A further limitation is, the questionnaire is not completed directly after the x-ray is taken but after a short period which can – in theory - provide a bias. Also the fact that a validated questionnaire did not exist, so that we had to adapt the original PSQ-NL questionnaire is a limitation as well as the relatively high percentage of patients not answering certain items.
Another limitation is the concept of satisfaction. It is known that surveys of patients’ satisfaction often fail to distinguish between individual doctors because most of the variation in doctors is due to differences between patients and random error rather than differences between doctors. Measures related to patients’ experience discriminate more effectively between practices than do measures of general satisfaction . However when we started our study the Consumer Quality (CQ) -questionnaire was not yet sufficiently developed .
Comparison with existing literature
As mentioned in the background, we found just one article concerning teleradiology and patient satisfaction in general practice. However, that study did not distinguish between different subscales of satisfaction. The article concluded that patients were satisfied with the new facility and particularly appreciated the facility nearby . This is consistent to our finding that, when using the teleradiology service, patients preferred the ability to remain on the island, the short travel time, and the faster service time in comparison with the hospital service.
In contrast to the limited research into patient satisfaction of teleradiology in primary care, more research has been performed into patient satisfaction of telemedicine in general [13–16, 20] and teledermatology in particular [17–19]. Nevertheless, each of these studies are deficient in some way, having small samples, low response rates, short investigation periods, or narrow definitions of satisfaction [18, 20]. Our study resolves these issues, providing a large sample with an acceptable response proportion over a long investigation period, while using clear definitions and measures of satisfaction.
It is well known from patient satisfaction studies of GPs that age, being seen by the same or usual doctor, education, sex, and health status can affect satisfaction with interpersonal communication [22–25, 29]. In our study, we additionally identified that satisfaction was different for technical quality and interpersonal manner. Indeed, satisfaction with the interpersonal manner was strongly affected by the patients’ age, whether they were an islander, and the indication for x-ray (trauma or not), while satisfaction with the technical quality was also strongly affected by whether they were an islander or not, but was less strongly influenced by age or indication. This distinction between island and non-island residents does not exist in the literature, which has only distinguished registered patients from others. Our data was also notable for the lack of influence of patient education status, health status, or sex on satisfaction levels, a fact that contrasts with the existing literature on satisfaction with GPs. This may however be an artefact of the specific period for which we carried out our study.
Implications for research and practice
Future research should assess whether our finding that patients appreciate the teleradiology service also holds true for less remote general practices. In addition, more research is needed to assess the influence of the continuity of the doctor-patient relationship on patient satisfaction this together with the development of a patient satisfaction survey focused on the use of hospitals facilities in the general practice. Further research may also benefit from the inclusion of a Consumer Quality Index [28, 30–32] to advance our understanding of the patient experience.
This study completes our research into the pilot teleradiology service in primary care on the Dutch island of Ameland. The introduction of teleradiology reduced the number of missed fractures and unnecessary referrals to the hospital and led to an increase in fracture treatment by the GP . Moreover, it resulted in considerable cost reductions for patients (111 k euro per year) and health insurance companies (minimum 89 k euro per year) . This study adds to these results, by showing that patients appreciated the teleradiology service. Thus, we conclude that the teleradiology is a suitable candidate secondary care facility for transfer to primary care, especially for patients who live at a considerable distance from hospital.
Patient Satisfaction Questionnaire
Analysis of variance
Wistow G. Decentralisation from acute to home care settings in England. Health Policy. 1997;41:suppl:91–108.
Robberts E, Mays N. Can primary care and community based models of emergency care substitute for the Hospital Accident and Emergency (A & E) Department? Health Policy. 1998;44(3):191–214.
Starfield B, Shi L. Policy relevant determinants of health: an international perspective. Health Policy. 2002;60(3):201–18.
Norum J, Pedersen S, Stormer J, Rumpsfeld M, Stormao A, Janissen N, Sunde H, Ingebrigtsen T, Larsen ML. Prioritisation of telemedicine services for large scale implementation in Norway. J Telemed Telecare. 2007;13:185–92.
Ekeland AG, Bowes A, Flottorp S. Effectiveness of telemedicine: a systematic review of reviews. Int J Med Inform. 2010;79:736–71.
Mun SK, Tohne WG, Platenberg RC, Choi I. Teleradiology and emerging business models. J Telemed Telecare. 2005;11(6):271–5.
Johansen I. Experience with teleradiology in general practice in Oppland. Idsskr Nor Laegeforen. 2000;120(16):1896–8.
Knop FK, Staunting JA. The benefits of diagnostic imaging in general practice. Ugeskr Laeger. 2006;2:794–8.
Backman W, Bendel D, Rakhit R. The telecardiology revolution: improving the management of cardiac disease in primary care. J R Soc Med. 2010;103:442–6.
van der Heijden JP, de Keizer NF, Bos JD, Spuls PI, Witkamp L. Teledermatology applied following patient selection by general practitioner in daily practice improves efficiency and quality of care at lower costs. Br J Dermat. 2011;165:1058–65.
Jacobs JJWM, Jacobs JPAM, Wiersma D, Sanderman R. Teleradiology in the general practice at Ameland: a benefit cost analysis (Dutch). Ned Tijdschr Geneesk. 2012;156:A5428.
Jacobs JJWM, Jacobs JPAM, van Sonderen F, van der Molen T, Sanderman R. Fracture diagnostics, unnecessary travel and treatment: a comparative study before and after the introduction of teleradiology in a remote general practice. BMC Fam Pract. 2015;16(1):53.
Marshall GN, Hays RD, Sherbourne CD, Wells KB. The structure of patient satisfaction with outpatient medical care. Psychol Assess. 1993;5(4):477–83.
Aoki N, Dunn K, Johnson-Throop KA, Turley JP. Outcomes and methods in telemedicine evaluation. Telemed J E Health. 2003;9(4):393–401.
Whitten P, Love B. Patient and provider satisfaction with the use of telemedicine: overview and rationale for cautious enthusiasm. J Postgrad Med. 2005;51(4):294–300.
Mair F, Whitten P. Systematic review of studies of patient satisfaction with telemedicine. BMJ. 2000;320:1517–20.
Whited JD, Hall RP, Foy ME, Marbrey LE, Grambow SC, Dudley TK, Datta SK, Simel DL, Oddone EZ. Patient and clinician satisfaction with a store-and-forward teledermatology consult system. Telemed J E Health. 2004;10(4):422–31.
Whited JD. Teledermatology research review. Int J Dermat. 2006;45:220–9.
Demiris G, Speedie SM, Hicks LL. Assessment of patients’ acceptance of and satisfaction with teledermatology. J Med Syst. 2004;28(6):575–9.
Iseli MA, Kunz R, Blozik E. Instruments to assess patient satisfaction after teleconsultation and triage: a systematic review. Patient Prefer Adherence. 2014;8:893–907.
Grogan S, Norman P, Willits D, Porter I. Validation of a questionnaire measuring patient satisfaction with general practitioner services. Qual Health Care. 2000;9(4):210–5.
Rahmquist M. Patient satisfaction in relation to age, health status and other background factors: a model for comparisons of care units. Int J Qual Health Care. 2001;13(5):385–90.
Campbell JL, Ramsay J, Green J. Age, sex, socioeconomic, and ethnic differences in patients’ assessments of primary health care. Qual Health Care. 2001;10:90–5.
Jung HP, Baerveldt C, Olesen F, Grol R, Wensing M. Patient characteristics as predictors of primary health care preferences: a systematic literature analysis. Health Expect. 2003;6:160–81.
Howard M, Goertzen J, Hutchison B, Kaczorowski J, Morris K. Patient satisfaction with care for urgent health problems: a survey of family practice patients. Ann Fam Med. 2007;5(5):419–24.
Hagedoorn M, Uijl SG, Van Sonderen E, Ranchor A, Grol BMF, Otter R, Krol B, Van den Heuvel W, Sanderman R. Structure and reliability of Ware’s patient satisfaction questionnaire III. Patients’ satisfaction with oncological care in the Netherlands. Med Care. 2003;41(2):254–63.
Salisbury C, Wallace M, Montgomery AA. Patients ‘experience and satisfaction in primary care: secondary analysis using multilevel modelling. BMJ. 2010;341:c5004.
Delnoij D, Ten Asbroek G, Arah O, De Koning J, Stam P, Poll A, Vriens B, Schmidt P, Klazinga N. Made In USA: The Import of American Consumer Assessment of Health Plan Surveys (CAHPS) into the Dutch Social Insurance System. Eur J Public Health. 2006;16(6):652–9.
Hankins M, Fraser A, Hodson A, Hooley C, Smith H. Measuring patient satisfaction for the quality and outcomes framework. Br J Gen Pract. 2007;57:737–40.
Damman OC, Hendriks M, Sixma HJ. Towards more patient centered healthcare: a new consumer quality index instrument to assess patients’ experiences with breast care. Eur J Cancer. 2009;45:1569–77.
Berendsen AJ, Groenier KH, De Jong GM, Meyboom-de Jong B, Van der Veen WJ, Dekker J, De Waal MWM, Schuling J. Assessment of patient’s experiences across the interface between primary and secondary care: consumer quality index continuum of care. Patient Educ Couns. 2009;77:123–7.
Meuwissen LE, De Bakker DH. Consumer quality’-index ‘general practice care’ measures patients’ experiences and compares general practices with each other (Dutch). Ned Tijdschr Geneesk. 2009;153:A180.
The authors would like to thank Marina Beckers, for assistance with the logistics of the questionnaire and the first analysis of the outcomes, and the editor for detailed comments and suggestions which improved our manuscript considerably.
The pilot study on the introduction of teleradiology in a general practice was financially supported by De Friesland Zorgverzekeraar (De Friesland insurance company).
The authors declare that they have no competing interests.
JJJ participated in: concept/design, data analysis and interpretation, methodology and statistics, drafting article, critical revision of article, and approval article. RE participated in: concept/design, data analysis and interpretation, drafting article, critical revision of article and approval article. JPJ participated in: concept/design, data analysis and interpretation, methodology and statistics, drafting article, critical revision of article, and approval article. TvdM participated in: data interpretation, methodology, drafting article, critical revision of article, and approval article. RS participated in: concept/design, data interpretation, drafting article, critical revision of article and approval article. All authors read and approved the final manuscript.
Patient satisfaction questions. Table S2. Mirror Questions. Table S3. Patients’ perceptions and expectations. Table S4. Results patient satisfaction questions. Table S5. Results: Patients’ perceptions and expectations. (DOCX 24 kb)
About this article
Cite this article
Jacobs, J.J.W.M., Ekkelboom, R., Jacobs, J.P.A.M. et al. Patient satisfaction with a teleradiology service in general practice. BMC Fam Pract 17, 17 (2016). https://doi.org/10.1186/s12875-016-0418-y
- Patient satisfaction
- General practice
- Family practice