- Research article
- Open Access
Telephone counselling by nurses in Norwegian primary care out-of-hours services: a cross-sectional study
BMC Family Practice volume 18, Article number: 84 (2017)
The primary care out-of-hours (OOH) services in Norway are characterized by high contact rates by telephone. The telephone contacts are handled by local emergency medical communication centres (LEMCs), mainly staffed by registered nurses. When assessment by a medical doctor is not required, the nurse often handles the contact solely by nurse telephone counselling. Little is known about this group of contacts. Thus, the aim of this study was to investigate characteristics of encounters with the OOH services that are handled solely by nurse telephone counselling.
Nurses recorded ICPC-2 reason for encounter (RFE) codes and patient characteristics of all patients who contacted six primary care OOH services in Norway during 2014. Descriptive statistics and frequency analyses were applied.
Of all telephone contacts (n = 61,441), 23% were handled solely by nurse counselling. Fever was the RFE most frequently handled (7.3% of all nurse advice), followed by abdominal pain, cough, ear pain and general symptoms. Among the youngest patients, 32% of the total telephone contacts were resolved by nurse advice compared with 17% in the oldest age group. At night, 31% of the total telephone contacts were resolved solely by nurse advice compared with 21% during the day shift and 23% in the evening. The share of nurse advice was higher on weekdays compared to weekends (mean share 25% versus 20% respectively).
This study shows that nurses make a significant contribution to patient management in the Norwegian OOH services. The findings indicate which conditions nurses should be able to handle by telephone, which has implications for training and routines in the LEMCs. There is the potential for more nurse involvement in several of the RFEs with a currently low share of nurse counselling.
The primary care out-of-hours (OOH) services in Norway are characterized by high contact rates by telephone [1, 2]. Telephone contacts are handled by local emergency medical communication centres (LEMCs). The LEMCs are most commonly staffed by registered nurses, who triage the contacts and refer the patients to the appropriate level of care. If the patient’s condition does not require assessment by an on-call medical doctor, the nurse often handles the contact solely by telephone counselling. In most of the 200 or so Norwegian primary care OOH districts, the only way to contact the OOH services is by first calling the LEMC. In several of the largest cities patients can contact OOH casualty clinics at all times (24/7), and may turn up directly without calling the LEMC in advance. Direct attendance is, however, not encouraged. The OOH system is organized within the primary health care sector, owned by the municipalities, and serves as a gatekeeper to the hospitals and other secondary health care, which are owned by the state. Medical responsibility for the services is mainly assumed by general practitioners (GPs) who take shifts in their own OOH district, and by interns serving their compulsory general practice period.
Because of the challenging geography in parts of Norway, with poor roads, islands without road connection to the mainland, and scarcely-populated rural areas, the size of the OOH organisations varies considerably. The smallest organisation serves a population of less than a thousand people, while the largest casualty clinic in the capital, Oslo, serves more than 600,000.
The nurses’ contribution to the LEMCs constitutes an important part of the primary care OOH services. It is estimated that there were approximately 1.8 million contacts with the OOH services in Norway in 2013 (contact rate 0.36 per inhabitant per year) and about 75% of these contacts were telephone contacts to an LEMC (0.27 contacts per inhabitant per year) . Based on estimates, less than a third of these contacts were handled solely by nurse telephone counselling, with a wide variation between the LEMCs . Nevertheless, this is an important and large volume activity that educates and counsels patients and caregivers, and reduces casualty clinic workload.
Previous literature on nurses’ triage and telephone counselling in the OOH services has focused on the quality of communication and decisions [3,4,5,6,7], the safety of telephone triage [8,9,10], the use of protocols and decision support tools [11,12,13,14,15,16], the process of giving advice over the telephone versus meeting the patient face-to-face , patients’ satisfaction with the advice, and their understanding and adherence to the advice [18,19,20,21]. Overall, previous research has found nurse telephone triage to be safe [8, 21]. Nonetheless, the nature of telephone triage makes it a vulnerable part of the service because the patient is not seen face-to-face. The level of nurse telephone advice differs between countries, ranging from about 23% in Norway [2, 22] to 40–50% in the Netherlands and UK [18, 23]. Studies have found that the quality of the nurses’ advice is satisfactory , and that the patients understand and follow the advice given by the nurses [19,20,21, 24].
Because the organisation of primary care services varies, it can be difficult to directly compare nurse telephone triage between countries. Many of the European countries have a strong primary care health service, where triage nurses cover the whole range of contact types. In countries where the primary care service is less built out, such as in the United States, additional nurse triage services are often run from the specialized health care services, aimed at specific patient groups, such as paediatrics [24,25,26]. However, some findings are similar across continents. Studies from Europe, the United States, New Zealand and Australia all show that children constitute a large group of the OOH contacts across the different continents [2, 24, 27,28,29]. Frequent RFEs in this group include fever, vomiting, colds and cough [24, 27, 28].
There is a lack of epidemiological studies documenting which medical problems and reason for encounter (RFE) are resolved and handled by nurses’ telephone advice in the OOH services. Some European studies include information on the RFE using the ICPC-2 classification system [29,30,31,32]. In a Dutch study, researchers explored nurse telephone triage using the determinants of independent advice and return consultation . Other than this, we have not found studies that investigate the characteristics of telephone contacts that were resolved by nurse telephone counselling.
Therefore, the present study aimed to identify which RFEs are most frequently handled by nurse telephone counselling in the OOH services. More specifically, we wanted to investigate which diagnostic chapters and single codes within the ICPC-2 are most frequently resolved by nurse telephone advice and, in addition, to examine a number of patient characteristics and the time of the encounter.
A cross-sectional design was applied to this study. Patient data for one year (2014) were collected from six OOH districts to estimate the incidence of nurse counselling at different RFEs.
The data were collected within a sentinel network called “The Watchtowers”, which was established in 2006 by the National Centre for Emergency Primary Health Care . The network includes the LEMCs in a representative sample of seven Norwegian OOH districts, consisting of 18 municipalities. Information on all contact, both by telephone and direct attendance, to the participating centres is recorded in an online database (Zoho Creator®) by the nurses on duty at that time. For the purposes of this study we included six of the seven Watchtowers. One was excluded due to major organisational changes during the time of data collection. Approximately 150 nurses worked in the LEMCs of the six Watchtowers during the period of data collection. Most nurses working in the LEMCs were registered nurses, and had prior clinical work experience before starting work in the LEMC. All nurses in the study were involved in both telephone nurse counselling and clinical patient management in the OOH services where they worked. This means that, in addition to operating the telephone in the LEMC, they also had duties in regard to taking care of patients in the casualty clinic, such as triage, performing clinical observations, assisting the GP and laboratory work (such as blood samples and measuring C-reactive protein). The nurses rotated between operating the telephone and undertaking clinical work in the casualty clinic.
Participants and study size
Study size was determined by the number of dispensed patient contacts handled by nurses in the Watchtower project in 2014. Because the study focusses on contacts handled solely by nurse telephone advice, only telephone contacts were included in the study. Contacts of direct attendance at the OOH service, or with unknown mode of contact, were excluded from the study.
RFE was registered using the ICPC-2 (International Classification of Primary Care, 2nd edition). The ICPC-2 allows for classification of the patient’s RFE, problems, diagnoses and interventions. The ICPC system was developed by WONCA . It was published in 1987 and has been used in Norway from 1992. In the Watchtower project, RFE is recorded based on the patient’s complaint or stated reason for contacting the OOH service. In order to minimize systematic variation, nurses at all participating casualty clinics have received standardized instructions on how to register ICPC-2 RFE codes in accordance with the official manual (http://www.kith.no/sokeverktoy/icpc-2/bok/kontaktarsak.html).
“Action taken” was classified in one of the following categories: (A) Telephone consultation/advice with a nurse or other health personnel, not a doctor, (B) Telephone consultation with a doctor, (C) Medical examination by a doctor, (D) Consultation with other than a doctor, (E) Call-out with a doctor and ambulance, and (F) Home visit by GP. The main focus of this study is on the contacts registered in the category: “Telephone consultation/advice with a nurse or other health personnel, not a doctor”. For the purposes of analysis, we refer to this as “contacts handled solely by nurse telephone counselling/advice”.
Mode of contact was classified in one of the following categories: (A) Telephone contact, (B) Direct attendance at the casualty clinic, (C) Contact with health professionals, (D) Contact with national emergency medical communication centres, or (E) Other.
Time of day was registered by three time categories: Daytime 08.00–15.29, afternoon 15.30–22.59, and night 23.00–07.59. We also recorded day of the week (Monday-Sunday), and the patient’s gender and age (under one year of age was recorded as “0”). The urgency level was assessed by the nurse in accordance with the Norwegian Index for Medical Emergency Assistance (Index)  into one of three urgency levels defined by colour: Red (acute), yellow (urgent) and green (non-urgent). Because of the low numbers of yellow (n = 892) and red (n = 19) urgency level cases handled by nurse telephone counselling we combined all levels of urgency in the analysis.
Because many of the ICPC-2 codes involve similar symptoms, we grouped some related ICPC-2 codes (see Additional file 1).
All patient contact data from 2014 were downloaded from the online database (Zoho Creator®) in January 2015. Excel was used to organize the data before importing the files into IBM SPSS statistics 22. Descriptive statistics and frequency analyses were used. In addition, logistic regression analysis was used to explore the relationship between nurse telephone counselling and time of day, and age of the patients. Nurse telephone counselling (yes/no) was the dependent variable; time of day and age group were independent, categorical variables. Data are presented as frequencies, rate per 100,000 inhabitants/year and proportion of total telephone contacts.
The Watchtower project has been approved by the Regional Committee for Medical and Health Research Ethics, the Norwegian Social Science Data Services, and by the privacy ombudsman for research for Uni Research. The Watchtower database is owned and managed by our institution, the National Centre for Emergency Primary Health Care. No patient identifiable data were recorded at any time. The database was only accessible to the researchers in the project.
Participants and contact characteristics
The six OOH districts included in the study had a combined population of 218,205 inhabitants as of 1 January 2014. During the study period, there were a total of 77,863 medical encounters, equivalent to 357 contacts per 1000 inhabitants per year. Of these, 16,394 attended the casualty clinic directly without contacting the LEMC beforehand, and 28 records had unknown mode of contact. Because the scope of this study is telephone contacts, direct attendance and unknown mode of contact were not included in the analysis. This gave a total of 61,441 encounters, equivalent to 282 telephone contacts per 1000 inhabitants per year, to be included in the analysis. These accounted for 79% of the total medical contacts.
14,155 (23%) of the telephone contacts were handled solely by nurse telephone counselling (65 contacts per 1000 inhabitants per year). The remaining telephone contacts were handled as follows: 10.2% had a telephone consultation with a doctor (29 contacts per 1000 inhabitants per year), 58.3% had a medical examination by a doctor (164 contacts per 1000 inhabitants per year), 1.2% had a consultation with other than a doctor (3 contacts per 1000 inhabitants per year), 2.6% had a call-out with a doctor and an ambulance (7 contacts per 1000 inhabitants per year), 1.4% had a home visit by GP (4 contacts per 1000 inhabitants per year), and 3% were other actions.
The age of the patients in the group that received nurse advice ranged from 0 to 103 years (median age of 25 years, mean age of 30.7 years), and women constituted 57.7% of the records. 1702 cases (12%) had no registered ICPC-2 code, and in 601 (4.2%) cases age was not registered.
Telephone contacts handled by nurse counselling in the different ICPC-2 chapters
Table 1 presents the distribution of telephone contacts handled by nurse telephone counselling in each ICPC-2 chapter. Encounters related to chapter A (General and unspecified problems) were most frequently resolved by nurse telephone advice, followed by L (Musculoskeletal), D (Digestive), S (Skin) and R (Respiratory problems).
In chapters H (Ear) and X (Female genital), more than 30% of the total telephone contacts were resolved by nurse advice. In contrast, in chapters U (Urological) and K (Cardiovascular) less than 15% of the total telephone contacts were resolved by nurse advice.
The distribution of the ICPC-2 chapters most frequently handled by nurse telephone counselling was quite similar for day and evening shifts, with some small differences for the night shifts. Chapter A (General and unspecified) was the chapter most frequently resolved by nurse telephone advice during all three shifts. Chapters D (Digestive) and P (Psychological) constituted more of the contacts resolved by nurse telephone advice during night shifts compared to day and evening shifts.
RFE ICPC-2 codes most frequently handled by nurse telephone counselling
For telephone contacts handled solely by nurse telephone counselling, 447 different ICPC-2 codes were recorded.
Table 2 presents the 15 RFE ICPC-2 codes most often handled solely by nurse telephone counselling. A03 (Fever) was most prevalent, accounting for 7% of all nurse advice in this study, and constituted 39% of all nurse advice given in chapter A. This was followed by D01 (Abdominal pain), R05 (Cough), H01 (Ear pain) and A29 (General symptoms). In eight of the RFE codes in Table 2 more than 30% of the total telephone contacts were resolved by nurse telephone advice. S18 (Laceration/cut) had the lowest total share in this group, with 11% of the total telephone contacts resolved solely by a nurse.
Table 3 presents the 30 RFE groups and non-grouped RFE codes most frequently handled by nurse telephone counselling. The RFEs in Table 3, General symptoms, were most frequently resolved by nurse advice, followed by the non-grouped RFE code A03 (Fever) and the groups Lower limbs symptom/injury/condition, Respiratory symptom/condition, Abdominal pain and Fears/concerns and worries. Table 3 includes 80% of all nurse advice given with a known ICPC-2 code (71% of all advice given when contacts with unknown ICPC-2 code are included). Furthermore, it includes 168 (38%) of the 447 ICPC-2 codes in the category of telephone contacts handled by nurse telephone counselling.
The ten RFE ICPC-2 codes most frequently handled by nurse telephone counselling within different age groups are presented in Table 4. A03 (Fever) and D01 (Abdominal pain) were among the top ten RFEs most often handled by nurse telephone advice in all six age groups. However, fever was significantly more prevalent in the youngest age group (0–5 years old), both in relation to other symptoms within this age group, and in relation to the prevalence of fever in the other age groups. It accounted for 21.6% of all advice given in the youngest age group, compared to 2.0–7.4% in the other age groups. H01 (Ear pain) was also a frequent symptom in the two youngest age groups, but was not among the symptoms most frequently handled by nurse telephone counselling in any of the other age groups. L17 (Foot/toe symptom) and N01 (Headache) were present in the three age groups from 6 to 59 years, while L02 (Back symptoms) was prevalent in all the age groups from 16 years and upwards. R02 (Shortness of breath/dyspnoea) was found among the most frequent RFEs only in the two oldest age groups.
The five ICPC-2 codes most frequently handled by nurse telephone counselling in the age group 0–5 years old constituted about 40% of the total advice given in this group. Equivalent figures were 25% in the age group 6–15 years, and about 15% in the other age groups.
Factors potentially influencing the decision to handle contacts solely by nurse telephone counselling
Of the contacts handled by nurse counselling, 34% were during daytime, 48% in the evening and 18% at night. Patients in the age groups 0–5 years and 30–59 years received 24 and 25% of all nurse advice respectively.
Table 5 presents the share of telephone contacts handled by nurse telephone counselling, stratified by age groups, genders and time of day. The results of the logistic regression analysis are displayed in Table 6. There were significant differences in the likelihood of handling telephone contacts by nurse counselling between the different times of the day, and between the different age groups (P < 0.001 for all variables).
A larger share of the total telephone contacts was handled solely by nurses in the night shifts, compared with the evening and day shifts. Furthermore, the share of nurse telephone advice decreased as the patients’ age increased. In the age group 0–5 years, the total share of nurse telephone counselling was 32%, compared with 17% in the two oldest age groups. In the youngest age group, the share of total telephone contacts handled by nurse counselling increased from 27% in daytime, to 47% at night. In the two oldest age groups, equivalent numbers were 16% during the day and 21 and 22% during the night.
In the age group 80 years and above, 41% of the contacts were made by health personnel on behalf of the patient (the most frequent RFEs being A13 (Concern medical treatment), A28 (Limited function) and A96 (Death)), while this was the case in only 0.2% of the contacts in the youngest age group. There were no significant differences in the share of telephone contacts resolved by nurse advice between the weekdays Monday to Friday. However, there was a significant difference in the share of nurse advice during the week (mean nurse advice share: 25% (95% CIs 24–25)) compared to the weekend (mean nurse advice share: 20% (95% CIs 19–20)). In regard to the patients’ gender, only small variations were found; during the night 32% of all female contacts were resolved by nurse telephone advice compared with 29% of the male contacts.
The findings reveal that a large number of telephone contacts to the LEMCs were handled solely by nurse telephone counselling. The RFEs most frequently resolved by nurse telephone advice were fever, abdominal pain, cough, ear pain and general symptoms. Telephone contacts were more often resolved by nurse advice at night compared to day and evening, and more often during the week (Monday to Friday) compared to the weekends. A higher share of contacts with the youngest patients were handled by nurse telephone counselling compared with the oldest age group.
Of the total telephone contacts in our data material, 23% were handled solely by nurse counselling, which is equivalent to 65 nurse advice per 1000 inhabitants/year. This correlates with findings from previous years in the Watchtower project [2, 22]. It is also comparable with a study from the Netherlands where a nurse alone handled 27.5% of the telephone contacts . Other studies from the Netherlands and UK have found that nurses handle as much as 40–50% of the contacts by nurse telephone advice [18, 23]. However, the literature seems somewhat divided on the effectiveness of nurse telephone triage. In one of the Dutch studies, it was indicated that high proportions of nurse telephone consultations were associated with increased probability of follow-up contacts, which in turn could lead to increased workload . In contrast, studies from the UK found that nurse telephone consultation could reduce GP workload without an increase in adverse events . Previous studies on the Norwegian OOH services conclude that two-thirds of the callers receiving nurse advice did not re-contact the OOH services, own GP or other sections of the healthcare services in the following week . In the Norwegian OOH services, however, advising the patient to contact his or her own GP in practice hours is also an appropriate way of handling contacts that can wait. It is important to add that differences in the organization of the healthcare systems can make it difficult to directly compare study results between countries. In some European countries (e.g. UK and the Netherlands), and in the United States, self-referral to a hospital emergency department is possible. In Norway, a referral via the primary care sector is needed. Furthermore, in the Danish OOH service, it is mostly doctors who handle the phone calls, which is different from the other countries mentioned above, where nurses, physician assistants or secretaries handle the calls.
In our study, one fifth of all contacts handled by nurse telephone counselling were contacts regarding ICPC-2 chapter A (General and unspecified). The high frequency in this chapter can to some extent be explained by the code A03 (Fever). Fever was the symptom most often handled by nurse telephone counselling, and constituted 39% of all nurse advice given in chapter A. To the best of our knowledge, not many studies examine which RFEs telephone nurses resolve by advice. Findings from the United States also show that, among parents contacting a children’s careline regarding a child with fever, a majority followed nurse advice for home care, in spite of initially preferring to have their child seen by a medical doctor . Furthermore, a Dutch study exploring determinants associated with nurse telephone advice alone presents similar findings to those found in our study . A large share of contacts regarding earache, vomiting and fever were handled by nurse telephone consultations, consistent with our findings. Contacts regarding chest pain had the lowest share of nurse telephone advice, which is also similar to our study in which cardiovascular problems have the lowest share of contacts handled by nurse consultation. Furthermore, the Dutch study found that a greater share of telephone contacts was handled by nurse counselling at night, compared to day and evening. Contacts by the youngest age groups were more often handled by nurse advice compared to the older age groups. These findings are also in line with ours.
Several factors probably contribute to the large share of contacts handled in our study by nurse telephone counselling during the night, compared to day and evenings (Table 5); less resources at night-time, a desire not to wake the doctor on call, or the nurses may be stricter on what they would assign to be seen by a doctor during the night. Furthermore, our findings reveal that the major increase in nurse telephone advice during the night was due to changes in the two youngest age groups (Table 5). The lower share of nurse counselling during the weekend compared to the weekdays could be explained by the fact that it was not possible to advise the patients to contact their own GP the same day - or the day after, if a Saturday.
One reassuring finding is that the rate of nurse telephone advice declined as the patients’ age increased, indicating that nurses at the LEMCs make safe decisions. The oldest age group is a complex group, often presenting with several and more severe symptoms and comorbidities compared with younger patients. However, on our data form it is only possible to register one symptom per patient. Consequently, we do not know if the older patients in our group presented with a mix of symptoms. Another factor might be that contacts from the oldest age group were made much more frequently by health personnel on behalf of the patient. This means that the patient’s condition had often already been evaluated before contacting the OOH service. Furthermore, the youngest age group appeared to be more predictable regarding which RFEs the nurse resolved by nurse telephone advice. The five most commonly reported RFEs handled by nurse counselling in the youngest age group (fever, cough, ear pain, vomiting and localized rash), constituted around 40% of all advice given in this group. The type of contacts handled by nurse telephone counselling in the other age groups varied more.
Findings from Europe, the United States, New Zealand and Australia all show that children constitute a large group of the OOH contacts [2, 24, 27,28,29]. Studies from Denmark, Scotland and the Netherlands also report that the youngest age group receives telephone advice more frequently than the older age groups [29, 33, 37], and involves symptoms similar to those found in our study . In a study from England reporting on young people’s (aged 0–15) use of the telephone service NHS Direct, it was found that 44 to 49% of all calls were resolved solely by nurse advice . The high share of nurse telephone counselling in this group of patients might emphasize the parents’ need for advice and reassurance when their children are ill. Measures to meet this need could include public health centres to provide information and guidance to parents on the most usual symptoms and conditions that affect infants and young children.
Strengths and limitations
This study adds important knowledge on the telephone nurses’ work in the Norwegian LEMCs. To our knowledge, this is the first study of its kind in Norway. One of the strengths of the study is the high numbers of observations. The data analysed were collected over a period of one year which minimises the influence of seasonal variations. Reports from previous years of the Watchtower project show that the quality of the data is good; in 2013 only 1% of the total records lacked at least one piece of information. Records lacking RFE ICPC-2 codes are not included in this number, as RFE is not marked as “compulsory” in the registering program.
In 2014, RFE ICPC-2 codes were missing in 11% of the total records, with a wide variation between individual OOH clinics, ranging from 2 to 21% . These differences could reflect varying practices between the clinics in registration of the data. Of the contacts handled by nurse telephone counselling, 12% had no RFE ICPC-2 code registered. Even though the nurses have received standard training in how to register RFEs, there is still a potential for bias, for instance by recording a potential diagnosis instead of the symptom presented by the patient. However, symptoms are the dominating RFEs in our data material. The RFE mode of the ICPC system has also been found to be a reliable tool for registering RFEs in the primary care sector .
Although this study provides an important picture of the nurses’ contributions to the LEMCs, and which contacts are handled solely by nurse telephone counselling, it would have been of great interest to analyse associations between characteristics of the individual nurses and nurse telephone counselling strategies. However, such data were not available.
Comparing the Watchtower data with the yearly statistics on reimbursement claims in the Norwegian OOH service, it is evident that there is under-reporting of cases in the Watchtower database. Results from 2014 show a 15% deviation in the numbers of doctor consultations . Under-reporting of nurse telephone consultations in our data material is probably of the same size, if not greater. However, it is not possible to calculate accurate figures. Reasons for missing records could be related to different priorities during busy times in the LEMCs.
When the Watchtower project was initiated in 2006, it was designed to be a representative sample of the OOH services in Norway . However, changes in population and community structures might cause the representativeness to be less accurate in 2014 compared with 2006. In our study, we also excluded one of the Watchtowers due to organisational changes at the time of data collection.
Nonetheless, because of the high numbers of observations, we believe that our data still provide a reliable picture of contacts handled by nurse telephone counselling in the Norwegian OOH services.
This study shows that nurses contribute significantly to patient management in the Norwegian OOH services. The findings can guide the process of developing training programmes for work in the LEMCs, especially in regard to the type of contacts the nurses have to manage and master. There is the potential for more nurse involvement in several of the RFEs which currently have a low share of nurse counselling. Finally, the study identifies areas that need further investigation. This includes the high share of nurse counselling provided during the night, compared to daytime, and the differences in the share of nurse advice between the youngest and the oldest age groups.
International classification of primary care
Local emergency medical communication centre
Reason for encounter
Eikeland OJ, Raknes G, Hunskår S. Vakttårnprosjektet. Epidemiologiske data frå legevakt. Samlerapport for 2014. Rapport nr. 3–2015. [The Watchtower project. Epidemiological data from OOH services 2014]. Bergen: National Centre for Emergency Primary Health Care, Uni Research Health; 2015.
Eikeland OJ, Raknes G, Tønsaker S, Hunskår S. Vakttårnprosjektet. Epidemiologiske data frå legevakt. Samlerapport for 2013. Rapport nr. 3–2014. [The Watchtower project. Epidemiological data from OOH services 2013]. Bergen: National Centre for Emergency Primary Health Care, Uni Research Health; 2014.
Derkx HP, Rethans JJ, Muijtjens AM, Maiburg BH, Winkens R, van Rooij HG, et al. Quality of clinical aspects of call handling at Dutch out of hours centres: cross sectional national study. BMJ. 2008;337:a1264.
Derkx HP, Rethans JJ, Maiburg BH, Winkens RA, Muijtjens AM, van Rooij HG, et al. Quality of communication during telephone triage at Dutch out-of-hours centres. Patient Educ Couns. 2009;74:174–8.
Derkx HP, Rethans JJ, Knottnerus JA, Ram PM. Assessing communication skills of clinical call handlers working at an out-of-hours centre: development of the RICE rating scale. Br J Gen Pract. 2007;57:383–7.
Hansen EH, Hunskaar S. Telephone triage by nurses in primary care out-of-hours services in Norway: an evaluation study based on written case scenarios. BMJ Qual Saf. 2011;20:390–6.
Nyen B, Hansen EH, Bondevik GT. Kvaliteten på sykepleieres håndtering av telefonhenvendelser til legevakt. [The quality of nurses’ handling of telephone contacts to the out-of-hours service]. Sykepleien Forskning. 2009;3:220–6.
Huibers L, Smits M, Renaud V, Giesen P, Wensing M. Safety of telephone triage in out-of-hours care: a systematic review. Scand J Prim Health Care. 2011;29:198–209.
Giesen P, Ferwerda R, Tijssen R, Mokkink H, Drijver R, van den Bosch W, et al. Safety of telephone triage in general practitioner cooperatives: do triage nurses correctly estimate urgency? Qual Saf Health Care. 2007;16:181–4.
Lattimer V, George S, Thompson F, Thomas E, Mullee M, Turnbull J, et al. Safety and effectiveness of nurse telephone consultation in out of hours primary care: randomised controlled trial. The South Wiltshire Out of Hours Project (SWOOP) Group. BMJ. 1998;317:1054–9.
Mayo AM, Chang BL, Omery A. Use of protocols and guidelines by telephone nurses. Clin Nurs Res. 2002;11:204–19.
Holmström I. Decision aid software programs in telenursing: not used as intended? Experiences of Swedish telenurses. Nurs Health Sci. 2007;9:23–8.
O'Cathain A, Sampson FC, Munro JF, Thomas KJ, Nicholl JP. Nurses’ views of using computerized decision support software in NHS Direct. J Adv Nurs. 2004;45:280–6.
Dowding D, Mitchell N, Randell R, Foster R, Lattimer V, Thompson C. Nurses’ use of computerised clinical decision support systems: a case site analysis. J Clin Nurs. 2009;18:1159–67.
Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330:765.
Ernesäter A, Holmström I, Engström M. Telenurses’ experiences of working with computerized decision support: supporting, inhibiting and quality improving. J Adv Nurs. 2009;65:1074–83.
Purc-Stephenson RJ, Thrasher C. Nurses’ experiences with telephone triage and advice: a meta-ethnography. J Adv Nurs. 2010;66:482–94.
Huibers L, Koetsenruijter J, Grol R, Giesen P, Wensing M. Follow-up after telephone consultations at out-of-hours primary care. J Am Board Fam Med. 2013;26:373–9.
Hansen EH, Hunskaar S. Understanding of and adherence to advice after telephone counselling by nurse: a survey among callers to a primary emergency out-of-hours service in Norway. Scand J Trauma Resusc Emerg Med. 2011;19:8.
Purc-Stephenson RJ, Thrasher C. Patient compliance with telephone triage recommendations: a meta-analytic review. Patient Educ Couns. 2012;87:135–42.
Blank L, Coster J, O’Cathain A, Knowles E, Tosh J, Turner J, et al. The appropriateness of, and compliance with, telephone triage decisions: a systematic review and narrative synthesis. J Adv Nurs. 2012;68:2610–21.
Hansen EH, Zakariassen E, Hunskaar S. Sentinel monitoring of activity of out-of-hours services in Norway in 2007: an observational study. BMC Health Serv Res. 2009;9:123.
Bunn F, Byrne G, Kendall S. The effects of telephone consultation and triage on healthcare use and patient satisfaction: a systematic review. Br J Gen Pract. 2005;55:956–61.
Light PA, Hupcey JE, Clark MB. Nursing telephone triage and its influence on parents’ choice of care for febrile children. J Pediatr Nurs. 2005;20:424–9.
Bunik M, Glazner JE, Chandramouli V, Emsermann CB, Hegarty T, Kempe A. Pediatric telephone call centers: how do they affect health care use and costs? Pediatrics. 2007;119:305–13.
Keatinge D, Rawlings K. Outcomes of a nurse-led telephone triage service in Australia. Int J Nurs Pract. 2004;11:5–12.
St George I, Cullen M, Gardiner L, Karabatsos G. Universal telenursing triage in Australia and New Zealand. A new primary health service. Aust Fam Physician. 2008;3:476–9.
Cook EJ, Randhawa G, Large S, Guppy A, Chater AM, Pang D. Young people’s use of NHS Direct: a national study of symptoms and outcome of calls for children aged 0–15. BMJ Open. 2013;3:e004106.
Leutgeb R, Laux G, Hermann K, Gutscher A, Szcsenyi J, Kuhlein T. Patient care in an out-of-hours care practice - A descriptive study of the CONTENT project. Gesundheitswesen. 2014;76:836–9.
Huibers LA, Moth G, Bondevik GT, Kersnik J, Huber CA, Christensen MB, et al. Diagnostic scope in out-of-hours primary care services in eight European countries: an observational study. BMC Fam Pract. 2011;12:30.
Moth G, Huibers L, Christensen MB, Vedsted P. Out-of-hours primary care: a population-based study of the diagnostic scope of telephone contacts. Fam Pract. 2016;33:504–9.
Raknes G, Hunskaar S. Reasons for encounter by different levels of urgency in out-of-hours emergency primary health care in Norway: a cross sectional study. BMC Emerg Med. 2017;17:19.
Moll van Charante EP, ter Riet G, Drost S, van der Linden L, Klazinga N, Bindels PJ. Nurse telephone triage in out-of-hours GP practice: determinants of independent advice and return consultation. BMC Fam Pract. 2006;7:74.
Hansen EH, Hunskaar S. Development, implementation, and pilot study of a sentinel network (“The Watchtowers”) for monitoring emergency primary health care activity in Norway. BMC Health Serv Res. 2008;8:62.
Lamberts H, Wood M. The birth of the International Classification of Primary Care (ICPC) Serendipity at the border of Lac Léman. Fam Pract. 2002;19:433–5.
Norwegian Medical Association. Norsk indeks for medisinsk nødhjelp (Norwegian Index of Emergency Medical Assistance). 3rd ed. Stavanger: Laerdal Medical A/S- The Laerdal Foundation for Acute Medicine; 2009.
Elliot A, McAteer A, Heaney D, Ritchie L, Hannafored P. Examining the role of Scotland’s telephone advice service (NHS) for managing health in the community: analysis of routinely collected NHS 24 data. BMJ Open. 2015;5:e007293.
van der Horst F, Metsemakers J, Vissers F, Saenger G, de Geus C. The reason-for-encounter mode of the ICPC: reliable, adequate, and feasible. Scand J Prim Health Care. 1989;7:99–103.
Act on medical and health research (the Health Research Act). https://lovdata.no/dokument/NL/lov/2008-06-20-44. Accessed 28 June 2017.
The authors would like to thank all the staff in the Watchtower project involved in registering the activity in the LEMCs.
Availability and data materials
The datasets generated and/or analysed during the current study are not publicly available because the approvals from the ethics committee and the privacy ombudsman for research do not permit disclosure of raw data, but the data are available from the corresponding author on reasonable request.
This research was funded by the National Centre for Emergency Primary Health Care, Uni Research Health, Box 7810, NO 5020 Bergen, Norway.
Ethics approval and consent to participate
The Watchtower project has been approved by the Norwegian Social Science Data Services and by the privacy ombudsman for research for Uni Research (statement no. 2007/17049).
The project was considered by the Regional Committee for Medical and Health Research Ethics (REC West, Bergen, statement no. 2012/1094) which concluded that there was no need for formal dispensation from professional secrecy requirements or consent to participate. This is according to national regulations, since the data were anonymised .
The database was only accessible to the researchers in the project. The Watchtower database is owned and managed by our institution, the National Centre for Emergency Primary Health Care. Researchers within the institution can use data from the Watchtower database for research projects. The leader of the Watchtower project gives the researchers access to the data needed for each specific project. The researchers do not need an ethical clearance to access these data, as this is already approved on behalf of the institution.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Midtbø, V., Raknes, G. & Hunskaar, S. Telephone counselling by nurses in Norwegian primary care out-of-hours services: a cross-sectional study. BMC Fam Pract 18, 84 (2017). https://doi.org/10.1186/s12875-017-0651-z
- Telephone counselling
- Primary health care
- After-hours care
- Reason for encounter
- International classification of primary care