This article has Open Peer Review reports available.
Quality of sickness certification in primary health care: a retrospective database study
© Skånér et al.; licensee BioMed Central Ltd. 2013
Received: 21 December 2012
Accepted: 8 April 2013
Published: 12 April 2013
In the period 2004–2009, national and regional initiatives were developed in Sweden to improve the quality of sickness certificates. Parameters for assessing the quality of sickness certificates in primary health care have been proposed. The aim of this study was to measure the quality of sickness certification in primary health care by means of assessing sickness certificates issued between 2004 and 2009 in Stockholm.
This was a retrospective study using data retrieved from sickness certificates contained in the electronic patient records of 21 primary health care centres in Stockholm County covering six consecutive years. A total number of 236 441 certificates were used in the current study. Seven quality parameters were chosen as outcome measures. Descriptive statistics and regression models with time, sex and age group as explanatory variables were used.
During the study period, the quality of the sickness certification practice improved as the number of days on first certification decreased and the proportion of duly completely and acceptable certificates increased. Assessment of need for vocational rehabilitation and giving a prognosis for return to work were not significantly improved during the same period. Time was the most influential variable.
The quality of sickness certification practice improved for most of the parameters, although additional efforts to improve the quality of sickness certificates are needed. Measures, such as reminders, compulsory certificate fields and structured guidance, could be useful tools to achieve this objective.
Sickness certificates issued by physicians are mandatory after one week of self-certification, when a person applies for benefits due to sickness in Sweden. All physicians in Sweden are obliged to issue these certificates. Most of them are issued in general practice .
Activities regarding sickness certification
Regional Social Insurance Medicine Committee
One day education in Social Insurance Medicine for physicians held by Social Insurance Offices
Regional co-operation group; Stockholm County Council and regional Social Insurance Office
Economic agreement between the government and the Federation of County Councils during the period 2007-20092)
Regional sick-listing agreement between Stockholm County Council and regional Social Insurance Office3)
National sickness certification guidelines
New form for sickness certification
Quality parameter project4)
Educational activities regarding national guidelines
Regional sick-listing recommendations5)
Sickness certification audit1)
Changes in social insurance regulations
Education addressed to intern and resident physicians
Various educational activities
Information from Social Insurance Office regarding changes in Social Insurance regulations
A report by the Swedish Social Insurance Administration found there was an urgent need to focus on the content of sickness certificates, as they often contain insufficient information [3–6]. National initiatives have been directed towards general practice where the majority of sickness certificates are issued. Differences in the quality of sickness certificates due to context and patient mix have previously been identified [7, 8].
The management of a clinic or a primary health care centre (PHCC) is responsible for the quality of the sickness certificates issued by the physicians they employ. To ensure a high quality of sickness certificates, regular monitoring of the sickness certification practices of physicians are necessary.
Since 2004, a group of 27 PHCCs in Stockholm County has been working on bench marking, contributing data and getting feedback regarding various clinical diagnoses and treatments, including sickness certification (the “EK-group”, Efterutbildning och Kvalitet, standing for education and quality). A few of the PHCCs in the network, constituting a “quality group”, have worked on a research project that focuses on the quality of sickness certificates. Between 2008 and 2009, this quality group participated in a joint action with PHCCs from four other Swedish counties to investigate certain quality parameters such as adherence to recommendations on sickness certification from the Regional Social Insurance Medicine Committee of the Stockholm County Council; the sickness certificate forms themselves; knowledge about quality in sickness certification; and the possibility of retrieving data from sickness certificates contained in electronic patient records (EPR). At the beginning the quality control group suggested 18 parameters, which were subsequently tested in a pilot study . Of those 18 parameters, seven were thought to be suitable for highlighting quality aspects in a relevant and measurable way, and were therefore chosen for additional tests. The main selection criteria were face validity, simplicity, and the possibility to determine target levels. Preliminary target levels were also determined for these parameters (except for the parameter “number of days on the first sickness certificate”).
The aim of the study was to assess whether the numerous initiatives taken between 2004 and 2009 have resulted in an improvement of sickness certification in primary health care in Stockholm.
Design and setting
This is a retrospective study using data retrieved from the sickness certificates contained in the EPR from 21 PHCCs in Stockholm County covering a 6-year period (2004–2009).
All PHCCs in Stockholm County work under the same authority, and the 21 participating PHCCs represented different geographical areas, socio-economic characteristics, and numbers of patients and physicians. A total of 236 441 sickness certificates were examined in this study.
In 2010, approximately 200 PHCCs were found in Stockholm County. Of those, 21 were included in the current study. The inclusion criteria were: 1) the possibility to extract EPR data with extraction software MedRave™ (93 PHCCs, all of which were invited to participate), 2) interest in participating, and written consent from the directors of the PHCCs (26 PHCCs), and 3) access to EPR data of at least three of the six years in focus (21 PHCCs). For three of the 21 centres, no data could be retrieved for the period between 2004 and 2006, and for two of the 21 centres, no data could be retrieved for 2007. This was mainly due to privatisation, which made old data inaccessible. The PHCCs did not have to give reasons for not participating in the study. Twelve of the participating 21 PHCCs belonged to the quality network. Extraction software MedRave ™ was used to extract data from EPRs.
Main outcome measures
Definition of the quality parameters
1. Number of days on the first sickness certificate during a sickness absence episode issued within the centre.1)
This has been shown to be an important predictor of total length of the sickness absence period.
2. Proportion of sickness certificates issued on the basis of a face-to-face consultation between issuing physician and patient.2)
Sickness certificates should in general be issued on the basis of a face-to-face consultation.
3. Proportion of non-specific diagnoses (ICD-10 R or ICD-10 Z) after 30 days of sickness absence.3)
Non-specific diagnoses may be adequate during the first part of a sickness absence episode, but after 30 days the patient should have a specific ICD-10 diagnosis.
4. Proportion of sickness certificates with documented assessment of need/no need for vocational rehabilitation after 30 days of sick leave.3)
After 30 days of sickness absence, the physician should make an evaluation of the patient’s need for vocational rehabilitation.
5. Proportion of sickness certificates with documentation about prognosis regarding scheduled time for return to work after 30 days of sickness absence.3)
After 30 days of sickness absence, there should be an evaluation of the patient’s prognosis regarding return to work.
6. Proportion of completely filled in sickness certificates (13 specified fields of information filled in) after 30 days of sickness absence.3)
This is a criterion required by the Social Insurance Offices.
7. Proportion of sickness certificates with the minimum amount of information filled in: medical history, examination and functional limitations.2)
This is a criterion considered by the quality group as a minimum requirement for all sickness certificates.
Since ensuring sickness certification of high quality is the responsibility of the director of a PHCC, the centres themselves were used to measure changes over time for each of the seven quality parameters. Medians for parameter 1 and proportions for parameters 2–7 were calculated for each PHCC. The overall medians for each parameter were calculated for all PHCCs. The medians were chosen instead of the arithmetic means because the number of patients varied widely across the different PHCCs and because medians are less influenced by outliers than are arithmetic means. First and third quartiles were also calculated.
For the regression models, all sickness certificates were used but PHCCs were not included as outcome variables. Explanatory factors of time, sex and age group were used to generate the complete regression model. In Step 1, complete regression models were generated with the seven parameters as outcome variables and time (years 2004–2009), sex and age group (20–29, 30–39, 40–49, 50–59 and 60+) as explanatory variables. In Step 2, the variables that were significant in the complete models were used to generate the final models. The coefficient of determination (R2) is the proportion of variance explained by a model.
The number of certificates was large enough to generate a model significant enough for each parameter. This way, it was possible to understand how each explanatory factor affected the dependant variable.
The statistical software used was SAS 9.2/Enterprise Guide.
Changes in quality over time
Medians of quality parameters per year for all PHCCs
2004 n = 18
2005 n = 18
2006 n = 18
2007 n = 19
2008 n = 21
2009 n = 21
1. Number of days on first certificate (days)
2. Proportion of face-to-face consultations (%)
3. Proportion of certificates with non-specific diagnoses after 30 days (%)
4. Proportion of certificates with notation about need for vocational rehabilitation after 30 days (%)
5. Proportion of certificates with notation about prognosis for return to work after 30 days (%)
6. Proportion of completely filled in certificates after 30 days (%)
7. Proportion of acceptable certificates (%)
Regression models for the outcome variables
Variation in quality explained by regression models
Pr > |t|
95% Confidence limits
1. Number of days on first certificate
2. Face-to-face meeting
3. Non-specific diagnoses
4. Documentation of need for vocational rehabilitation
5. Documentation of prognosis
6. Complete certificates
7. Acceptable certificates
The models for parameter 1 (number of sick leave days on the first sickness certificate), parameter 6 (duly completed certificates) and parameter 7 (acceptable certificates) were the strongest models, with an R2 of approximately 30%, while the model for parameter 2 (face-to-face contacts) had an R2 of 15.6%, which indicated relative strength. By contrast, models based on certificates with non-specific diagnoses (parameter 3), documented assessment of need for vocational rehabilitation (parameter 4), and documented prognosis for return to work (parameter 5) were found to be very weak, at least partly because of skewed distribution of the data.
In the current study we observed an increase in the quality of sickness certification between 2004 and 2009 in primary health care in Stockholm County by means of examining all sickness certificates issued during that period. Time was the decisive factor, and accounted for the variability observed in three of the seven parameters assessed, i.e. number of days on the first certificate, completely filled in certificates and acceptable certificates, and to some extent for one of the parameters, namely face-to-face consultations.
There are few studies that have examined the parameters in the current study, and no other study has measured changes in sickness certification over time. Information about the need for vocational rehabilitation after 30 days of absence was lacking in 60% of the certificates in a Swedish study of general practitioners’ certificates from 2002 . With regard to information about prognosis for return to work after 30 days of absence, two Swedish studies [3, 10] showed that it was lacking in 29% and 27% of the certificates, respectively. These results were consistent with our findings from 2004. Notes on medical history, physical examination and functional limitations in the sickness certificates comprised a compound measure in the current study and may therefore be difficult to compare to findings from previous studies. Nevertheless, in an earlier Swedish study, information about physical examination was missing in 35% of certificates, and 52% of these contained unclear information about functional capacity, which is similar to our results .
The reduction in the number of days on the first sickness certificate that was observed in this study over time was paralleled by a decrease in the total number of sickness days in the population during the same period. The median number of days of fulltime sickness absence per 10 000 inhabitants attending the 21 PHCC was 31 830 in 2004 and 19 769 in 2009 (data presented in a report in Swedish) . The rise in the proportion of face-to-face consultations over time may have been influenced by financial changes that affected PHCCs in 2007 when funds to conduct telephone consultations were withdrawn.
The main strength of this study was its use of authentic data retrieved directly from the medical records in 21 PHCCs of Stockholm County covering six consecutive years, and the large sample population, consisting of more than 200 000 sickness certificates. Although a number of factors were shown to affect sickness certification, we cannot exclude the possibility that other explanatory factors may have been involved which were not studied here.
Since 2008, time limits have been used in the Swedish social security system. This has made parameters 4–7 more important than ever before. Information about the need for vocational rehabilitation and prognosis for return to work (parameters 4 and 5) is necessary for the implementation of measures taken by the employer and the social insurance officer to support persons on sick leave who wish to return to work. Complete and detailed information (parameter 6) is required by the Social Insurance Offices after 30 days of sickness absence, while a minimum amount of information (parameter 7) is needed in all cases. Overall, better planning is required to avoid long, drawn-out benefit payments. We found a considerable discrepancy between preliminary target quality levels and actual quality levels in relation to information about the need for vocational rehabilitation and complete certificates. This discrepancy implies that additional efforts would be needed to improve the quality of those two parameters.
The fact that the PHCCs in the quality network did not get better results than the others may indicate that getting feedback on sickness certification is not enough to improve sickness certification; local quality work is needed as well. Overall, GPs in many countries regard sickness certification as a complex task [12–14].
Educational initiatives have been, by far, the most commonly used way to bring about change in physicians’ sickness certification practices, but their effect on the quality of certificates issued was found to have been rather small, perhaps due to insufficient or inadequate focus . Complementary measures would be required to change physicians’ sickness certification practices. One such measure could be the use of reminders, which has been shown to be successful, for example, in safe drug prescriptions . Another tool might be electronic completion and on-line transmission of the sickness certificate, which is introduced in other parts of Sweden as well as in Italy . Using this method, filling in certain fields could be made compulsory, which would automatically affect parameters 4–7 in this study.
A parameter not addressed in this study but which may have affected quality of sickness certificates is problems physicians may have in making the necessary assessments. This has been demonstrated in earlier Swedish studies as well in studies from other countries [12, 14, 18]. To resolve this, the WHO International Classification of Functioning Disability and Health (ICF) has been discussed as a possible tool. In Sweden, measures have been taken to use ICF codes in a structured way that is integrated into the electronic sickness certificate system. A pilot study of ours conducted in Stockholm County implied that the use of ICF, via ICF Core Sets, could be a way to increase the quality of the descriptions of activity limitations, an area where improvements are urgently needed (submitted).
The quality of the sickness certification practice improved over time during the study period with respect to the number of days on first certification and the proportion of properly completed and acceptable certificates but assessment of the need for vocational rehabilitation and giving a prognosis for return to work were not significantly improved over time during the same period. Although the quality levels of all these parameters were not satisfactory they may provide a good basis for further work. To improve the quality of sickness certificates, measures, such as reminders, compulsory certificate fields, and structured guidance, would be needed.
YS has many years of experience as a specialist in General Practice, and has a PhD including studies on Medical Judgement and Decision-making. She holds a position as Associated Professor at Karolinska Institutet, Stockholm, Sweden.
BA has many years of experience as a specialist in General Practice, and has a PhD that included studies on sickness certification. She holds a position as Senior Consultant and Medical expert in Social Insurance Medicine, Stockholm County Council, Sweden.
LGB has many years of experience as a specialist in General Practice. He has a PhD that included studies on Medical Judgement and Decision-making and holds a position as a researcher at Karolinska Institutet, Stockholm, Sweden.
MF is a specialist in General Practice. She has developed a web–based tool for using ICF as a tool in the sickness certification process.
AWÅ is a statistician and has been working for many years with large data bases in Stockholm County Council, Sweden.
GHN is a specialist in General Practice, and has a PhD that included studies in informatics and decision-making. He holds a position as professor at Karolinska Institutet, Stockholm, Sweden.
All authors are members of a research group at the Centre for Family Medicine, Karolinska Institutet that works with and plans a number of studies related to the quality of sickness certification.
We want to thank the general practitioners in the quality indicator group and the directors of primary health care centres who participated in the study.
This study was supported by the Stockholm County Council.
- Arrelöv B, Borgquist L, Ljungberg D, Svärsudd K: Do GPs sick-list patients to a lesser extent than other physician categories? A population-based study. Family Practice. 2001, 18 (4): 393-398. 10.1093/fampra/18.4.393.View ArticlePubMedGoogle Scholar
- Skaner Y, Nilsson GH, Arrelov B, Lindholm C, Hinas E, Wilteus AL: Use and usefulness of guidelines for sickness certification: results from a national survey of all general practitioners in Sweden. BMJ Open. 2011, 1 (2): e000303-10.1136/bmjopen-2011-000303.View ArticlePubMedPubMed CentralGoogle Scholar
- Söderberg E, Alexanderson K: Sickness certificates as a basis for decisions regarding entitlement to sickness insurance benefits. Scandinavian Journal of Public Health. 2005, 33: 314-20. 10.1080/14034940510005798.View ArticlePubMedGoogle Scholar
- Söderberg E, Shahirnejad B, Johansson H, Alexandersson K: I gränssnittet mellan medicin och försäkring - en studie av läkarintygs kvalitet. Swedish: The boundary between medicine and insurance – a study of the quality of sickness certificates. Report. 2003, Försäkringskassan Östergötland: LinköpingGoogle Scholar
- Hensing G, Alexanderson K, Timpka T: Dilemmas in the daily work of social insurance officers. Scandinavian Journal of Social Welfare. 1997, 6: 301-309. 10.1111/j.1468-2397.1997.tb00201.x.View ArticleGoogle Scholar
- Bird S: Sickness certification. Aust Fam Physician. 2011, 40 (1/2): 69-71.PubMedGoogle Scholar
- Arrelov B, Alexanderson K, Hagberg J, Lofgren A, Nilsson G, Ponzer S: Dealing with sickness certification - a survey of problems and strategies among general practitioners and orthopaedic surgeons. BMC Public Health. 2007, 7 (147): 273-View ArticlePubMedPubMed CentralGoogle Scholar
- Arrelöv B: Towards understanding of determinants of physicians’ sick-listing practice and their interrelations. A population-based epidemiological study. PhD thesis. 2003, Uppsala UniversityGoogle Scholar
- Arrelöv B: Uppföljning av sjukskrivningspraxis och kvalitetsindikatorer för medicinska underlag vid sjukskrivning. Swedish; Follow-up of sicklistingpraxis and quality indicators for sickness certificates. FoU Rapport 2010 [R&D Report 2010]. 2010, Stockholm County Council: StockholmGoogle Scholar
- Englund L, Tibblin G, Svardsudd K: Effects on physicians’ sick-listing practice of an administrative reform narrowing sick-listing benefits. Scand J Prim Health Care. 2000, 18 (4): 215-219. 10.1080/028134300448779.View ArticlePubMedGoogle Scholar
- Skånér Y, Arrelöv B, Bergensand P, Nilsson GH: Uppföljning av hur införandet av det Nationella försäkringsmedicinska beslutsstödet påverkar läkares sjukskrivningspraxis. Swedish; Follow-up of the influence of the National Sickness Certification Guidelines on doctors’ sick-listing praxis. FoU Rapport [R&D Report]. 2010, Stockholm County Council: StockholmGoogle Scholar
- Letrilliart L, Barrau A: Difficulties with the sickness certification process in general practice, and possible solutions: a systematic review. Eur J Gen Pract. 2012, 18 (4): 219-28. 10.3109/13814788.2012.727795.View ArticlePubMedGoogle Scholar
- Winde LD, Alexandersson K, Carlsen B, Kjeldgård L, Witeus AL, Gjesdal S: General practitioners’experience with sickness certification: a comparison of survey data from Sweden and Norway. BMC Fam Pract. 2012, 13: 10-10.1186/1471-2296-13-10.View ArticlePubMedPubMed CentralGoogle Scholar
- Foley M, Thorley K, Denny M: The sick note: a qualitative study of sickness certification in general practice in Ireland. Eur J Gen Pract. 2012, 18 (2): 92-99. 10.3109/13814788.2012.672967.View ArticlePubMedGoogle Scholar
- Kiessling A, Arrelöv B: Sickness certification as a complex professional and collaborative activity – a qualitative study. BMC Public Health. 2012, 12: 702-10.1186/1471-2458-12-702.View ArticlePubMedPubMed CentralGoogle Scholar
- Weingart SN, Simchowitz B, Shiman L, Brouillard D, Cyrulik A, Davis RB: Clinicians’ assessments of electronic medication safety alerts in ambulatory care. Arch Intern Med. 2009, 169 (17): 1627-1632.View ArticlePubMedGoogle Scholar
- Massoni F, Salesi M, Sarra M, Ricci S: Absence from work and the medical sickness certificate. Panminerva Med. 2013, 55 (1): 99-105.PubMedGoogle Scholar
- Lindholm C, Arrelöv B, Nilsson GH, Löfgren A, Hinas E, Skånér Y, Ekmer A, Alexanderson K: Sickness-certification practice in different clinical settings; a survey of all physicians in a country. BMC Public Health. 2010, 10: 752-10.1186/1471-2458-10-752.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2296/14/48/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.