- Research article
- Open Access
- Open Peer Review
Agreement between self-reported and general practitioner-reported chronic conditions among multimorbid patients in primary care - results of the MultiCare Cohort Study
BMC Family Practice volume 15, Article number: 39 (2014)
Multimorbidity is a common phenomenon in primary care. Until now, no clinical guidelines for multimorbidity exist. For the development of these guidelines, it is necessary to know whether or not patients are aware of their diseases and to what extent they agree with their doctor. The objectives of this paper are to analyze the agreement of self-reported and general practitioner-reported chronic conditions among multimorbid patients in primary care, and to discover which patient characteristics are associated with positive agreement.
The MultiCare Cohort Study is a multicenter, prospective, observational cohort study of 3,189 multimorbid patients, ages 65 to 85. Data was collected in personal interviews with patients and GPs. The prevalence proportions for 32 diagnosis groups, kappa coefficients and proportions of specific agreement were calculated in order to examine the agreement of patient self-reported and general practitioner-reported chronic conditions. Logistic regression models were calculated to analyze which patient characteristics can be associated with positive agreement.
We identified four chronic conditions with good agreement (e.g. diabetes mellitus κ = 0.80;PA = 0,87), seven with moderate agreement (e.g. cerebral ischemia/chronic stroke κ = 0.55;PA = 0.60), seventeen with fair agreement (e.g. cardiac insufficiency κ = 0.24;PA = 0.36) and four with poor agreement (e.g. gynecological problems κ = 0.05;PA = 0.10).
Factors associated with positive agreement concerning different chronic diseases were sex, age, education, income, disease count, depression, EQ VAS score and nursing care dependency. For example: Women had higher odds ratios for positive agreement with their GP regarding osteoporosis (OR = 7.16). The odds ratios for positive agreement increase with increasing multimorbidity in almost all of the observed chronic conditions (OR = 1.22-2.41).
For multimorbidity research, the knowledge of diseases with high disagreement levels between the patients’ perceived illnesses and their physicians’ reports is important. The analysis shows that different patient characteristics have an impact on the agreement. Findings from this study should be included in the development of clinical guidelines for multimorbidity aiming to optimize health care. Further research is needed to identify more reasons for disagreement and their consequences in health care.
In the future, more and more elderly people will require medical attention due to a chronic disease. Many older people even have multiple chronic conditions. This phenomenon is known as multimorbidity. Studies on multimorbidity showed repeatedly that there is no uniform definition of the term [1, 2]. Some studies, for example, defined multimorbidity as the presence of two chronic diseases, while others required at least three chronic diseases. Various authors’ reviews showed a wide range in the prevalence of multimorbidity (3.5% to 98.5%) [1, 3]. Not only the definition of multimorbidity, but also the data sources (patient reports, claims data or collected through physician or medical records) seem to have a decisive influence on the measured prevalence of multimorbidity [4–6]. Another problem concerning multimorbidity are the missing clinical guidelines for medical practice [7, 8]. For the development of clinical guidelines, it is important to know if patients are aware of their diseases and how much they agree with their doctor regarding these illnesses.
Studies investigating the agreement of physician and patient information on the morbidity of patients showed an association of various patient characteristics with the concordance of morbidity data. For example, agreement decreased with old age, male gender, low education, comorbidity, depression, cognitive decline and hospitalization [9–14]. The physician-reported data was usually collected from the medical records. In previous studies, doctors were rarely asked directly about their patients and few studies included GPs for the collection of data on patient morbidity [15–17]. Often only diseases with high prevalence were compared. The present study examined the agreement between self-reported and general practitioner-reported chronic conditions among multimorbid patients in primary care. The associations of patient characteristics on the agreement values were also examined.
The following research questions were addressed:
To what extent is there agreement between self-reported and general practitioner-reported chronic conditions among multimorbid patients in primary care?
Which patient characteristics predict the agreement between self-reported and general practitioner-reported chronic conditions?
The following analyses are based on data from the MultiCare Cohort Study. This is a multicenter, prospective, observational cohort study with a total of 3,189 multimorbid patients, ages 65 to 85, from general practices in Germany. The study protocol has previously been published . The study participants were recruited from 158 GP practices near eight study centers distributed across Germany (Bonn, Düsseldorf, Frankfurt/Main, Hamburg, Jena, Leipzig, Mannheim and Munich). In each practice we created a list of patients based on the GP’s electronic database. This list encompassed all patients who were born between 1.7.1923 and 30.6.1943 and consulted their GP at least once within the last completed quarter (i.e. 3 month period). From this list we randomly selected 50 patients with multimorbidity and contacted them for written, informed consent. Multimorbidity was defined as the coexistence of at least three chronic conditions from a list of 29 diseases published elsewhere . Patients were excluded from the study if they were not regulars of the participating practices (i.e. in case of emergency consultation of the GPs), if they were unable to participate in the interviews (especially blindness and deafness), or if they were not able to speak and/or read German. Further exclusion criteria were: nursing home residency, severe illnesses (probably lethal within three months according to the GP), insufficient ability to consent (especially dementia) and participation in other studies at the present time . The sampling and response rate have been published by Schäfer et al. . In short, 24,862 patients were randomly selected from the study practices and checked for multimorbidity and exclusion criteria. 7,172 of these patients were eligible for study participation and contacted for informed consent to do so. Of all contacted patients, a total of 3,317 patients agreed to participate, which corresponds to a total response rate of 46.2%. Retrospectively we had to exclude 128 patients, because they passed away before the baseline interview or because we found out that the patients met exclusion criteria which their GP did not know of. Finally, 3,189 patients were included in the study. Recruitment and baseline data collection took place from July 2008 to October 2009.
A comprehensive description of the data sources, as well as the collected data, can be found in the study protocol . Information regarding the patients’ diseases was collected in personal interviews with the patients and their GPs. The interviews were conducted by trained scientists and study nurses using a standardized list of defined diagnosis groups (based on ICD-10). The development of this list and the 46 diagnosis groups with corresponding ICD codes have been described elsewhere [20, 21]. In short, the diagnosis groups are based on the most frequent conditions found in GP practices as mentioned: in a panel survey of the Central Research Institute of Statutory Ambulatory Health Care in Germany (“ADT-Panel”) , in the scientific experts’ report for the formation of a morbidity-orientated, risk adjustment scheme in the German Statutory Health Insurance , and in the data from the Gmünder ErsatzKasse (GEK) - a statutory health insurance company operating nationwide in Germany, insuring about 1.7 million people (2006) . The ICD-10 system was used, because all issues managed by physicians within statutory ambulatory care have to be coded in ICD-10 and forwarded to the health insurance companies as regulated by German law in §295(1) SGB V and §44(3) of the Federal Collective Agreement within the statutory health insurance system in Germany .
The names of the diagnosis groups for the patient interviews were adapted to a more patient-friendly language. This translation was done by an expert team of general practitioners with practical experience from the Department of Primary Medical Care of the University Medical Center Hamburg-Eppendorf. When developing the diagnosis group names, terms were selected that are commonly used by the patients in their daily routines. Therefore, several different names and symptom descriptions were used.
The compilation of the diagnosis groups list was not finished by the beginning of the baseline interviews. This led to 7 of the 46 diagnosis groups not being part of the standardized GP questionnaire during the baseline interviews. This applied to chronic gastritis, insomnia, allergies, hypotension, sexual dysfunction and tobacco abuse. Dementia was not present in the baseline questionnaire, because it served as an exclusion criterion. In addition, some diagnosis groups were asked only in the GP interviews, as they were deemed to be too intimate for the patient interviews, or they were already being asked in other questionnaires e.g. depression (see below). This includes the diagnosis groups: obesity, liver disease, depression, severe hearing loss, somatoform disorders, urinary incontinence and anxiety. Therefore, this study compared the self-reported and the general practitioner-reported chronic conditions for a total of 32 diagnosis groups. The selection of the diagnosis groups is shown in Additional file 1.
The prevalence proportions for the 32 diagnosis groups, the kappa coefficients (with a 95% CI) and the proportions of specific agreement were calculated in order to examine the agreement of patient-reported and general practitioner-reported diseases. The proportions of specific agreement are positive and negative agreement. Positive agreement (PA) is calculated with the following formula: PA = 2a/(2a + b + c) and negative agreement (NA) with the formula: NA = 2d/(2d + b + c) . Assuming that the patients are not aware of their disease if they don’t give an answer, missing values in the patients’ self-reported list of diseases were converted to: “no disease reported”.
To analyze the associations of patient characteristics to the agreement of reported illnesses, we calculated logistic regression models in 26 diagnosis groups. Diagnosis groups with less than 50 cases per independent variable were excluded from the multivariate models. At this point we applied strict criteria because we wanted to ensure an adequate filling of cells. We excluded gynecological problems, urinary tract calculi, anemia, psoriasis, migraine/chronic headache and Parkinson’s disease because of their low prevalence (compare Additional file 1). The total positive agreement (i.e. both GP and patient say yes) was defined as the dependent variable of the logistic regression models. Independent variables were sex, age (in years), education (low vs. medium/high), income (in Euro), disease count (number of chronic conditions from the general practitioner interviews), depression (not depressed vs. depressed), health related quality of life (scaled from 0–100) and nursing care dependency (no nursing care dependency vs. nursing care dependency). The education levels were split into three groups (low, medium, high) according to the international CASMIN classification . Patients’ income was reported as the net income per month after being adjusted to the patients’ household sizes . We made a logarithmic transformation for the income variable because we assumed a non-linear association. We defined depression as a score higher than six on the geriatric depression scale (GDS) . We assessed the health-related quality of life with the EQ visual analogue scale (EQ VAS) . Nursing care dependency was considered present when a patient had a health-insurance company issued nursing dependency level.
A p-value of <0.05 was used as the criterion for statistical significance. Due to the exploratory approach of the study, the results should therefore be considered exploratory and the p-values should be interpreted cautiously.
The analyses were performed using IBM SPSS Statistics Version 19, Microsoft Office Excel 2003 and R (version 3.0.1) .
Missing values in the dataset arising from item non-response have been imputed in order to avoid any bias generated by listwise deletion subjects with missing values from the statistical analyses using the procedure hot deck imputation. This imputation procedure is described elsewhere in detail . We imputed missing values in the following variables: income (12.4% missing values), self-rated health (0.3%), depression (0.4%) and nursing care dependency (0.7%). The variables age, gender, education and disease count did not contain any missing values. The imputation of missing values was performed with the R 2.13.0 package StatMatch.
The study was approved by the Ethics Committee of the Medical Association of Hamburg (approval no. 2881). Participants signed a written, informed consent form to participate in the study.
Characteristics of the study population: patients and GPs
The socio-demographic characteristics of the study’s participants (patients and GPs) are shown in Table 1. The mean age of the patients at the time of their baseline interviews was 74.4 years. 59.3% were female, 56.2% were married and 27.7% were widowed. The majority of participating study patients (62.3%) had a low level of education (CASMIN grade 1). Only 4.5% had a health-insurance company issued nursing dependency level. On average, the patients reported 7.6 chronic conditions, whereas the physicians diagnosed 6.3 chronic conditions. The mean age of the GPs at baseline interview was 50.2 years. 60.8% were male. The physicians had an average of 15 years of practice experience. Most of the participating GPs had comparably large practices considering 51.3% treated 1,000 or more patients in each quarter (three month period).
Prevalence of diagnosis groups in patients’ self-reports and general practitioner reports
The prevalence proportions of the patients’ self-reported diagnoses and general practitioner-reported diagnoses are shown in Table 2. The biggest difference in the prevalence when comparing patient self-reported and physician reported diagnoses concerned dizziness (GPs: 7.7% vs. patients: 35.0%). Other major differences occurred in severe vision reduction (18.9% vs. 44.0%), joint arthrosis (43.3% vs. 66.5%) and neuropathies (14.7% vs. 35.6%) where the patients reported the diagnoses more frequently than their GPs. GPs often reported a higher prevalence of diseases that can be easily measured by laboratory values e.g. lipid metabolism disorders or diabetes mellitus.
Agreement between patient self-reported and general practitioner-reported diagnoses
The kappa statistics and the proportions of specific agreement are presented in Table 2.
The diagnosis groups diabetes mellitus, Parkinson’s disease, thyroid dysfunction and asthma/COPD had a good agreement according to the Altman classification of kappa coefficients (0.61-0.80) . A moderate agreement was found in hypertension, osteoporosis, cerebral ischemia/chronic stroke, chronic ischemic heart disease, cancers, cardiac arrhythmia and psoriasis (0.41-0.60). The majority (17) of the diagnosis groups only had fair agreement (0.21-0.40). Neuropathies, hemorrhoids, dizziness and gynecological problems only showed a poor agreement (<0.20).
The positive agreement (PA) estimates the probability with which the GPs and the patients both report the chronic condition. The highest values were found for hypertension and diabetes mellitus with more than 0.80. Chronic cholecystitis/gallstones, anemia, cardiac insufficiency, neuropathies, migraine/chronic headache, rheumatoid arthritis/chronic polyarthritis, urinary tract calculi, dizziness and hemorrhoids had a lower probability for positive agreement (0.21-0.40). Gynecological problems showed a PA of only 0.1.
The negative agreement (NA) measures the probability with which both the GPs and the patients did not report the chronic condition. 25 chronic conditions show high values for negative agreement (>0.80) (compare Table 2). The lowest NA values were found for joint arthrosis (0.59) and chronic low back pain (0.58).
Patient characteristics associated with the agreement of patient self-reported and general practitioner-reported diagnoses
26 logistic regression models, whose results are summarized in Table 3, show the association of certain patient characteristics with the positive agreement of the patient self-reported and general practitioner-reported diagnoses.
Women had higher odds ratios for a positive agreement with their GP regarding the diagnosis groups: osteoporosis (OR = 7.16), thyroid dysfunction (OR = 4.51), rheumatoid arthritis/chronic polyarthritis (OR = 2.81), varicosis (OR = 2.61), intestinal diverticulosis (OR = 2.07), joint arthrosis (OR = 2.01), chronic low back pain (OR = 1.97), chronic cholecystitis/gallstones (OR = 1.86) and dizziness (OR = 1.45). The association with positive agreement was lower for chronic ischemic heart disease (OR = 0.29), atherosclerosis/PAOD (OR = 0.30), renal insufficiency (OR = 0.35), hyperuricemia/gout (OR = 0.50), cerebral ischemia/chronic stroke (OR = 0.51), diabetes mellitus (OR = 0.64), cardiac arrhythmias (OR = 0.65), cancers (OR = 0.66), cardiac insufficiency (OR = 0.69) and hemorrhoids (OR = 0.71).
Age was associated with positive agreement for cardiac insufficiency (OR = 2.25), renal insufficiency (OR = 1.79), chronic cholecystitis/gallstones (OR = 1.58), severe vision reduction (OR = 1.42), dizziness (OR = 1.38), prostatic hyperplasia (OR = 1.34), hypertension (OR = 1.29) and cardiac arrhythmias (OR = 1.21). The association with positive agreement was lower for lipid metabolism disorders (OR = 0.64), thyroid dysfunction (OR = 0.71), chronic low back pain (OR = 0.71), diabetes mellitus (OR = 0.72), intestinal diverticulosis (OR = 0.72), asthma/COPD (OR = 0.72) and neuropathies (OR = 0.75). The odds ratios for age were calculated using ten year intervals.
Patients with a medium or high education had higher odds ratios for positive agreement, compared to patients with low education, for the diagnosis groups thyroid dysfunction (OR = 1.28), severe vision reduction (OR = 1.27) and osteoporosis (OR = 1.27). This association was lower for atherosclerosis/PAOD (OR = 0.57).
The natural logarithm of household-size adjusted, net income showed an association with positive agreement for three chronic conditions: asthma/COPD (OR = 0.67), diabetes mellitus (OR = 0.83) and cerebral ischemia/chronic stroke (OR = 1.45). The odds ratios for income were calculated using one step on the logarithmic scale. One step, for example, including 400 € to 1,100 € net income per month, another step covering 3,000 € to 8,100 € per month.
The disease count showed higher odds ratios for positive agreement for 24 diagnosis groups. The odds ratios, calculated for a difference of three diseases, were between 1.22 and 2.41. The highest odds ratios were found for hemorrhoids (OR = 2.41), cardiac insufficiency (OR = 2.23), chronic low back pain (OR = 2.08) and hyperuricemia/gout (OR = 2.06).
Patients, with a potential depression according to the GDS, had lower association of positive agreement for thyroid dysfunction (OR = 0.65). The odds ratios were higher for dizziness (OR = 1.98), atherosclerosis/PAOD (OR = 1.97) and neuropathies (OR = 1.45).
The effect of the EQ visual analogue scale was calculated in 10 point intervals on the scale of 0–100. We found a lower association with positive agreement for chronic rheumatoid arthritis/chronic polyarthritis (OR = 0.72), cardiac insufficiency (OR = 0.80), chronic low back pain (OR = 0.86), asthma/COPD (OR = 0.87), renal insufficiency (OR = 0.87), neuropathies (OR = 0.89), dizziness (OR = 0.89), osteoporosis (OR = 0.90), joint arthrosis (OR = 0.91) and chronic ischemic heart disease (OR = 0.93).
Patients with a nursing care dependency had higher odds ratios for positive agreement regarding cerebral ischemia/chronic stroke (OR = 5.23), cancers (OR = 2.67) and cardiac insufficiency (OR = 1.75).
Agreement between patient self-reports and general practitioner reports
The results of our analysis indicate that the agreement of self-reported and general practitioner-reported chronic conditions in a multimorbid elderly population is dependent on the type of disease and varies by the patients’ characteristics.
Very good agreement was found for diabetes mellitus. Many other studies also showed very good or good agreement for this illness [10, 11, 13, 14, 16, 17, 32–38]. Generally, a very good agreement between patients and their GPs for diabetes mellitus is not surprising. The treatment of diabetes mellitus requires a high level of patient participation: regular blood glucose monitoring, dietary changes, etc. In addition, many patients in Germany with diabetes mellitus are enrolled in a disease management program (DMP) that requires regular appointments and prescribed examinations, so that both physicians and patients are often confronted with the disease. The same could apply to the diagnosis group asthma/COPD, for which there is also a DMP in Germany. The agreement on asthma/COPD was good in our cohort. Other studies also found good and moderate agreement for asthma [14, 33, 35]. However, Merkin et al. found only poor agreement for COPD, in a study with end-stage renal patients .
Moderate agreement, based on kappa statistics and high PA, was found for hypertension. Many other studies confirm this result [11, 13, 16, 35, 37–40]. In many cases, medication is needed, as well as regular blood pressure monitoring. High prevalence in the elderly population, drug treatments and regular follow-up appointments may have a positive effect on the agreement of GP and patient. However, studies which include younger people indicate poor to fair kappa coefficients for hypertension [33, 34].
We found moderate agreement for the diagnosis group cerebral ischemia/chronic stroke. Other studies reported higher values [9, 11, 13, 32, 34], while Muggah et al. reported merely a fair agreement for stroke in their study on the comparison of health-administrative data and patient self-report which included patients ages 20 to over 75 . The differences, in comparison to the majority of the other studies, could be explained by a specific cohort or lower number of cases. For instance, the study participants of Bush et al. were also participants of a screening program for elderly patients . Due to the screening program participants may have greater attention for their illness and for the accurate reporting of their diseases in the study. In the MultiCare Cohort Study only 12.5% of all patients with cerebral ischemia/chronic stroke had a nursing care dependency, therefore, the lesser disease severity could explain the poorer concordance. In addition, ischemic stroke often results in dementia. Kemper et al. report a prevalence of 12.5% for dementia in a German population aged 50 years and older after a first ischemic stroke . We excluded patients with dementia because of their inability to consent which also might have contributed to the lesser agreement.
The agreement on chronic ischemic heart disease was moderate in our study. This result is consistent with those of other studies [11, 13, 17, 32, 34, 36, 40]. Some studies reported good to very good agreement on myocardial infarction or surgeries on the heart [9, 13, 14, 32–34, 37]. Presumably, the concordances were greater because the events are remembered better if surgical intervention took place, or if there was a myocardial infarction in the past.
For cardiac insufficiency we found only fair agreement, which were also seen in other studies [14, 17, 33]. Some studies reported moderate agreement [9, 11, 13, 34]. Cardiac insufficiency belongs to those diseases which are difficult to communicate to the patients. The medical term is not very familiar to the patients. They probably know of the disease, but tend to call this a general heart disease. This makes it harder to distinguish from chronic ischemic heart disease.
We found a moderate agreement on cancer. A few studies reported the same results [9, 40], while others demonstrated good to very good kappa coefficients [11, 16, 32–34, 37]. This difference may be due to the data collection methods used for the cancer diagnosis variable in the MultiCare Cohort Study. In contrast to the patients, the GPs reported cancer nearly twice as often. Looking at the severity specified by the GPs, it is notable that the cancer is rated dormant in 34% of these cases. One reason for the moderate agreement might be that some patients did not report such a dormant cancer. We also saw a smaller percentage of patients who reported cancer when their GP did not. A further examination of this phenomenon is required.
The agreement for neuropathies had only a poor kappa coefficient and a slightly higher PA value. Neuropathies include many different symptoms with varying degrees of severity. This makes an agreement between GP and patient on the disease more difficult. Louie et al. found a moderate agreement for neurological complications in bone marrow transplantation survivors .
In this study, similar agreement values were found for dizziness: A kappa value of 14% and a PA of 25%. Dizziness is another disease which has no clear diagnostic criteria and who’s symptoms and causes vary greatly from patient to patient. Soto-Varela et al. validated a classification of peripheral vertigo by medical assessors. They saw a moderate agreement between the assessors regarding the accordance level . Therefore, it is not surprising that the agreement between patient and GP was lower than that of medical experts.
Hemorrhoids and gynecological problems also had low agreement values. These two chronic conditions have the potential to be very shameful for some patients. In an elderly population, Sjahid et al. investigated the agreement levels between the drugs a patient presented during a patient interview and the drugs listed in that patient’s pharmacy records. They found the lowest kappa statistic for organo-heparinoids often used as ointments against hemorrhoids . It is assumed, that some patients rather use over-the-counter products for their problem instead of talking to their GP. In addition, the interviewers in our project asked every patient directly about these diseases. This could explain the higher prevalence in the patient self-reported disease lists. Furthermore, the gynecological problems are principally treated by a gynecologist, so perhaps the patient feels no need to mention these to her GP.
The kappa coefficient is affected by two paradoxes. First, a high level of rater agreement can lead to a low kappa value. The formula for the kappa coefficient shows that the value of kappa depends on the level of chance agreement. Large chance agreement levels can lead to low kappa values despite observed high agreement levels. Second, imbalanced marginal totals affect the values of kappa. In case of an asymmetrical distribution of marginal totals, the chance agreement levels are lower which results in higher kappa values [44, 45].
Therefore we calculated the proportions of specific agreement [25, 46, 47]. We saw large differences between the kappa coefficient and the PA for the chronic conditions: hypertension, lipid metabolism disorder, joint arthrosis and chronic low back pain. These diseases all had a high prevalence and the PA values were much higher than the kappa values. The differences could be caused by the paradoxes described above. Therefore, the proportions of specific agreement seem to be the better approach to observing agreement and are more informative for clinicians as previously described by de Vet and colleagues .
It is further noted that the prevalence differences between the reported diagnosis groups should be taken into account when interpreting the results. Missing agreement can be caused by such factors as systematic differences between the raters, recall bias or chance. If this absolute error rate is the same for all chronic conditions, the relative random error for low prevalent diseases would be higher than for highly prevalent diseases. Hence, poor agreement for diseases with low prevalence should be registered with caution.
Patient characteristics associated with agreement
Our analyses of the associations of patient characteristics with agreement levels show that women agreed positively with their GPs on the diagnoses: osteoporosis, thyroid dysfunction, rheumatoid arthritis/chronic polyarthritis, varicosis, intestinal diverticulosis, joint arthrosis, chronic low back pain, chronic cholecystitis/gallstones and dizziness. The women’s odds ratios for positive agreement were lower for chronic ischemic heart disease, atherosclerosis/PAOD, renal insufficiency, hyperuricemia/gout, cerebral ischemia/chronic stroke, diabetes mellitus, cardiac arrhythmias, cancers, cardiac insufficiency and neuropathies. Englert et al. reported an association of the male gender with the over-reporting of myocardial infarction, stroke, hypertension and cardiac arrhythmias in a German study population of patients with hypercholesterolemia . Kriegsman et al. reported this association for stroke as well . This result reflects the gender-specific diseases. Cardio vascular diseases are more frequent in men and are, respectively, attributed rather to the men than to women. Furthermore, men may pay greater attention to male-specific diseases and women to female-specific diseases. As mentioned above, this might also be an effect of the diseases’ prevalences, as gender-specific differences in prevalence might also affect gender-specific agreement proportions.
We saw a negative association between positive agreement and increasing age in seven diagnosis groups. Other studies were able to show this as well e.g. for diabetes [13, 14, 16]. Whereas increasing age was also associated with better agreement for eight diagnosis groups. For cardiac insufficiency other studies reported lower associations between agreement and older age , higher associations between disagreement and increasing age  or saw no effect for age at all . A higher prevalence of cardiac insufficiency in the older age group (75 years and more) in our cohort could possibly be a reason for better agreement. The results of other studies also varied for high blood pressure. Some saw no association between age and agreement [13, 34], others reported an association between increasing age and poorer agreement [17, 35] and others described more accurate self-reports for older hypertensive respondents . Overall, the results on the association between agreement and age indicate that the agreement is higher for diseases associated with older age (e.g. cardiac insufficiency or renal insufficiency) or lower for diseases associated with lesser age (e.g. lipid metabolism disorders). Furthermore, this might be an effect of prevalence differences as already described.
For severe vision reduction, osteoporosis and thyroid dysfunction, a lower association to positive agreement was identified in patients with a low education level. It is assumed that patients with a higher education manage their medical records better. Rather surprisingly, we saw a lower odds ratio for positive agreement on atherosclerosis/PAOD in patients with higher education. This also might be an effect of prevalence considering that, in our cohort, the prevalence for atherosclerosis/PAOD is half as high in patients with higher level education as in patients with lower level education.
For asthma/COPD and diabetes mellitus the odds ratios for a positive agreement decreased with increasing income. Leikauf and Federman reported an association between low household incomes and fewer reports of asthma for inner-city seniors . For cerebral ischemia/chronic stroke the odds ratio for positive agreement was higher with increasing income. Okura et al. found an association between higher education levels and better agreement for stroke in their unadjusted, logistic regression model . Further investigations on this trend are required, especially for multimorbid older patients.
There was an association with the disease count for almost all examined diagnoses groups. The odds ratios for positive agreement increased with each additional disease. This may be an effect of a higher prevalence of the examined diseases in persons with more chronic conditions as reported by Schäfer . Merkin et al. reported a positive association between reported congestive heart failure and the presence of additional chronic diseases . Other studies described the opposite effect: Comorbidity results in poorer agreement [11, 13]. It is possible that the patients in the MultiCare cohort differ from other studies regarding this effect, because all patients have at least three chronic conditions.
We saw a negative association of depression with the concordance of patient self-reported and general practitioner reported thyroid dysfunction. Corser et al. found this as well, but for other diseases (cerebrovaskular disease, chronic pulmonary disease, cancer and diabetes) . For atherosclerosis/PAOD, dizziness and neuropathies, the analysis even revealed an increased probability for a positive agreement concerning depression. However, the sample size of patients in the MultiCare Cohort Study with a positive statement and depression (GDS > 6 points) was small (n = 119), which may result in low statistical power.
Patients with a higher score on the EQ visual analogue scale had lower odds ratios for positive agreement on ten chronic diseases. Most of these diseases are known for their high burden of pain or physical limitations, which are associated with a lower quality of life such as chronic low back pain, rheumatoid arthritis/chronic polyarthritis or asthma/COPD. Leikauf and Federman saw an association between poor general health in a patient and the accuracy of his/her self-report of asthma . Patients with a lower score on the EQ visual analogue scale may belong to the severe cases. These cases might be better known by the general practitioners, and patients with a lower quality of life might be more motivated to inform themselves about their diseases. However, it should be noted that the effect sizes for this association were not very high.
Patients with a nursing care dependency had higher odds ratios for positive agreement on cancer, cerebral ischemia/chronic stroke and cardiac insufficiency. For patients with cancer, stroke and/or cardiac diseases, Kriegsman et al. described high odds ratios of patients over-reporting mobility impairments . Regarding stroke, the relationship is obvious, since this often leads to dependency. Moreover, it can be assumed that due to the increased care burden in a patient with a nursing care dependency, the GP’s record keeping is more accurate. In a retrospective cross-sectional study, Erler et al. examined the agreement of patients’ medical records from German GP practices with claims-based diagnoses and observed an over-reporting of permanent chronic conditions. Non-severe diagnoses, on the other hand, which are frequently encountered in GP practices, were under-reported .
Strengths and weaknesses
This is one of the few analyses of agreement which was performed with a large number of chronic conditions. Most studies considered fewer diseases. Furthermore, this study compared GP reports collected in personal interviews, where many other studies simply took medical records as a source for the physicians’ statements [9, 12–14, 32–37, 50, 51]. Few studies involved GPs in their analysis of concordance [15–17]. We assume that personal interviews have a better validity than an analysis of medical records because diagnoses are often only used to justify insurance claims and, therefore, might not be mentioned in the records if no intervention is necessary. The personal interviews by trained interviewers, with both GPs and their patients, enabled a particularly precise survey of chronic diseases. Missing information in the medical records or incomplete questionnaires have probably been avoided in many cases.
The generalizability of the MultiCare Cohort Study could be affected by our criteria for exclusion at baseline. We excluded patients with dementia because of their inability to consent as well as patients residing in a nursing home. Our recruitment only took place in larger German cities, so that rural areas were not included in our study. Nevertheless, our study is representative of an older, urban, multimorbid cohort in primary care . We may have overestimated the validity of GP diagnoses, because the doctors who participated in the survey may have been more motivated than those who didn't participate. For this reason the agreement of GP and patient diagnoses could be lower in reality than as was presented in our study.
We found almost no inconsistencies in the dates of the interviews. In some cases the GP interview may have taken place after the patient interview so that, in the meantime, a new diagnosis could have been made, which was not yet known by the patient at the time of his interview. However, this related to an average of less than 1% of all cases.
Some of the diagnoses groups names in the patient interview were partially different than in the GP interview. We had to adapt the names of the diagnosis groups for the patient interview to a more patient-friendly language. This could have led to lower agreement values. For example, in patient interviews, cardiac insufficiency was named “weakness of the heart, which can cause fluid retention in the legs or lungs” because few patients understand the specialized term. Other studies reported this problem as well [11, 17, 33, 35].
Assuming that patients are not aware of their disease if they don’t give an answer (cases we defined as missing values), we converted these missing values in the patients’ self-reports to a “no disease” report. Giving no answer could have several reasons, e.g. an interviewer mistake or vague statements on behalf of the patients. Nevertheless, this affects an average of only 0.13% of the cases. The maximum amount of missing self-reported diagnoses was found for rheumatoid arthritis/chronic polyarthritis (0.3%).
Furthermore, a multitude of procedures for the prevention of insufficient data quality, the detection of inaccurate or incomplete data and actions to improve the data’s quality were performed (e.g. user reliability trainings, automatic plausibility and integrity checks and data error reports to the collaborating centers).
We were able to obtain a high participation rate of 46%. The non-responder analysis found that there was a slight selection bias considering the younger age of the participants, but no bias regarding gender or 93% of the diagnosis groups. We recruited participants according to the practices’ chart registry and not through a waiting-room process. Therefore we should have no problems regarding the overestimation of conditions that lead to greater heath care utilization .
As a further strength, we calculated multivariate analyses in order to adjust for possible confounding.
The data corresponds to the reality of primary care. Diseases with good agreement are easier to diagnose and often have established clinical guidelines (e.g. diabetes mellitus). Diseases with poor agreement are more difficult to diagnose (e.g. dizziness or neuropathies) and they are more difficult to communicate.
For multimorbidity research and the development of clinical guidelines, it is important to know which chronic diseases have a high disagreement between patient and physician reports. GPs should pay special attention to these chronic conditions. The analysis also shows that different patient characteristics have an impact on the quality of the agreement.
Further research is needed to identify more reasons for disagreement. In addition to the patient characteristics, there are certainly other reasons for a lack of agreement between the GP and his patient. Especially the low agreement on cancer or the association of increasing income and agreement for stroke should be considered in more detail. GPs and patients should possibly become more involved in this research topic (e.g. via qualitative research). Further studies may help to identify types of patients, who have particularly low agreement levels. A targeted communication with these patients may improve the patients’ understanding of their illnesses and increase the GP’s level of information about the patient. This assumption should be examined in further studies as well as the consequences of disagreement for health care. The results from this study might be useful in guiding the development of clinical guidelines and thus optimizing health care.
Fortin M, Stewart M, Poitras M-E, Almirall J, Maddocks H: A systematic review of prevalence studies on multimorbidity: toward a more uniform methodology. Ann Fam Med. 2012, 10: 142-151. 10.1370/afm.1337.
van den Akker M, Buntinx F, Knottnerus JA: Comorbidity or multimorbidity: what’s in a name? A review of literature. Eur J Gen Pract. 1996, 2: 65-70. 10.3109/13814789609162146.
Marengoni A, Angleman S, Melis R, Mangialasche F, Karp A, Garmen A, Meinow B, Fratiglioni L: Aging with multimorbidity: a systematic review of the literature. Ageing Res Rev. 2011, 10: 430-439. 10.1016/j.arr.2011.03.003.
van den Bussche H, Schäfer I, Wiese B, Dahlhaus A, Fuchs A, Gensichen J, Höfels S, Hansen H, Leicht H, Koller D, Luppa M, Nützel A, Werle J, Scherer M, Wegscheider K, Glaeske G, Schön G: A comparative study demonstrated that prevalence figures on multimorbidity require cautious interpretation when drawn from a single database. J Clin Epidemiol. 2013, 66: 209-217. 10.1016/j.jclinepi.2012.07.019.
Fortin M, Hudon C, Haggerty J, van den Akker M, Almirall J: Prevalence estimates of multimorbidity: a comparative study of two sources. BMC Health Serv Res. 2010, 10: 111-10.1186/1472-6963-10-111.
Violán C, Foguet-Boreu Q, Hermosilla-Pérez E, Valderas JM, Bolíbar B, Fàbregas-Escurriola M, Brugulat-Guiteras P, Muñoz-Pérez MÁ: Comparison of the information provided by electronic health records data and a population health survey to estimate prevalence of selected health conditions and multimorbidity. BMC Public Health. 2013, 13: 251-10.1186/1471-2458-13-251.
Guthrie B, Payne K, Alderson P, McMurdo MET, Mercer SW: Adapting clinical guidelines to take account of multimorbidity. BMJ. 2012, 345: e6341-e6351. 10.1136/bmj.e6341.
Hughes LD, McMurdo MET, Guthrie B: Guidelines for people not for diseases: the challenges of applying UK clinical guidelines to people with multimorbidity. Age Ageing. 2013, 42: 62-69. 10.1093/ageing/afs100.
Katz JN, Chang LC, Sangha O, Fossel AH, Bates DW: Can comorbidity be measured by questionnaire rather than medical record review?. Med Care. 1996, 34: 73-84. 10.1097/00005650-199601000-00006.
Goldman N, Lin I-F, Weinstein M, Lin Y-H: Evaluating the quality of self-reports of hypertension and diabetes. J Clin Epidemiol. 2003, 56: 148-154. 10.1016/S0895-4356(02)00580-2.
Simpson CF, Boyd CM, Carlson MC, Griswold ME, Guralnik JM, Fried LP: Agreement between self-report of disease diagnoses and medical record validation in disabled older women: factors that modify agreement. J Am Geriatr Soc. 2004, 52: 123-127. 10.1111/j.1532-5415.2004.52021.x.
Susser SR, McCusker J, Belzile E: Comorbidity information in older patients at an emergency visit: self-report vs. administrative data had poor agreement but similar predictive validity. J Clin Epidemiol. 2008, 61: 511-515. 10.1016/j.jclinepi.2007.07.009.
Okura Y, Urban LH, Mahoney DW, Jacobsen SJ, Rodeheffer RJ: Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure. J Clin Epidemiol. 2004, 57: 1096-1103. 10.1016/j.jclinepi.2004.04.005.
Corser W, Sikorskii A, Olomu A, Stommel M, Proden C, Holmes-Rovner M: Concordance between comorbidity data from patient self-report interviews and medical record documentation. BMC Health Serv Res. 2008, 8: 85-10.1186/1472-6963-8-85.
Kehoe R, Wu SY, Leske MC, Chylack LT: Comparing self-reported and physician-reported medical history. Am J Epidemiol. 1994, 139: 813-818.
Kriegsman DMW, Penninx BWJH, van Eijk JTM, Boeke AJP, Deeg DJH: Self-reports and general practitioner information on the presence of chronic diseases in community dwelling elderly: a study on the accuracy of patients’ self-reports and on determinants of inaccuracy. J Clin Epidemiol. 1996, 49: 1407-1417. 10.1016/S0895-4356(96)00274-0.
Englert H, Müller-Nordhorn J, Seewald S, Sonntag F, Völler H, Meyer-Sabellek W, Wegscheider K, Windler E, Katus H, Willich SN: Is patient self-report an adequate tool for monitoring cardiovascular conditions in patients with hypercholesterolemia?. J Public Health. 2010, 32: 387-394. 10.1093/pubmed/fdq013.
Schäfer I, Hansen H, Schön G, Maier W, Höfels S, Altiner A, Fuchs A, Gerlach FM, Petersen JJ, Gensichen J, Schulz S, Riedel-Heller S, Luppa M, Weyerer S, Werle J, Bickel H, Barth K, König H-H, Rudolph A, Wiese B, Prokein J, Bullinger M, von dem Knesebeck O, Eisele M, Kaduszkiewicz H, Wegscheider K, van den Bussche H: The German MultiCare-study: patterns of multimorbidity in primary health care – protocol of a prospective cohort study. BMC Health Serv Res. 2009, 9: 145-10.1186/1472-6963-9-145.
Schäfer I, Hansen H, Schön G, Höfels S, Altiner A, Dahlhaus A, Gensichen J, Riedel-Heller S, Weyerer S, Blank WA, König H-H, von dem Knesebeck O, Wegscheider K, Scherer M, van den Bussche H, Wiese B: The influence of age, gender and socio-economic status on multimorbidity patterns in primary care. First results from the multicare cohort study. BMC Health Serv Res. 2012, 12: 89-10.1186/1472-6963-12-89.
Schäfer I, von Leitner E-C, Schön G, Koller D, Hansen H, Kolonko T, Kaduszkiewicz H, Wegscheider K, Glaeske G, van den Bussche H: Multimorbidity patterns in the elderly: a new approach of disease clustering identifies complex interrelations between chronic conditions. PLoS ONE. 2010, 5: e15941-10.1371/journal.pone.0015941.
van den Bussche H, Koller D, Kolonko T, Hansen H, Wegscheider K, Glaeske G, von Leitner E-C, Schäfer I, Schön G: Which chronic diseases and disease combinations are specific to multimorbidity in the elderly? Results of a claims data based cross-sectional study in Germany. BMC Public Health. 2011, 11: 101-10.1186/1471-2458-11-101.
Zi - Zentralinstitut für die kassenärztliche Versorgung in der Bundesrepublik Deutschland - ADT-Panel 2010: Die 50 häufigsten ICD-10 Schlüsselnummern nach Fachgruppen. [http://www.zi.de/cms/projekte/adt-panel/]
Bundesversicherungsamt - Wissenschaftlicher Beirat: Wissenschaftliches Gutachten für die Auswahl von 50 bis 80 Krankheiten zur Berücksichtigung im morbiditätsorientierten Risikostrukturausgleich. [http://www.bundesversicherungsamt.de/fileadmin/redaktion/Risikostrukturausgleich/Wissenschaftlicher_Beirat/Gutachten_Krankheitsauswahl_2007]
KBV - Bundesmantelvertrag - Bundesmantelvertrag - Ärzte (BMV-Ä). [http://www.kbv.de/html/bundesmantelvertrag.php]
Cicchetti DV, Feinstein AR: High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol. 1990, 43: 551-558. 10.1016/0895-4356(90)90159-M.
Brauns H, Steinmann S: Educational reform in France, West-Germany and the United Kingdom: Updating the CASMIN educational classification. ZUMA-Nachrichten. 1999, 44: 7-44.
Jöckel K, Babitsch B, Bellach B, Bloomfield K, Hoffmeyer-Zlotnik J, Winkler J, Wolf C: Messung und Quantifizierung soziographischer Merkmale in epidemiologischen Studien: Empfehlungen der Deutschen Arbeitsgemeinschaft Epidemiologie (DAE), der Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie (GMDS), der Deutschen Gesellschaft für Sozialmedizin und Prävention (DGSMP) und der Deutschen Region der Internationalen Biometrischen Gesellschaft, erarbeitet von der Arbeitsgruppe ‘Epidemiologische Methoden’ in der DAE der GMDS und der DGSMP. RKI-Schrift 1/98. 1998, München: MMV Medizin Verlag, http://www.gmds.de/publikationen/empfehlungen.php,
Yesavage JA, Brink TL, Rose TL, Lum O, Huang V, Adey M, Leirer VO: Development and validation of a geriatric depression screening scale: a preliminary report. J Psychiatr Res. 1982, 17: 37-49. 10.1016/0022-3956(82)90033-4.
Brooks R: EuroQol: the current state of play. Health Policy. 1996, 37: 53-72. 10.1016/0168-8510(96)00822-6.
R Core Team: R: A Language and Environment for Statistical Computing. 2011, Vienna, Austria: R Foundation for Statistical Computing, http://www.R-project.org,
Altman DG: 1. CRC Press reprint. Practical statistics for medical research. 1999, Boca Raton, Fla: [u.a.]: Chapman & Hall/CRC
Bush TL, Miller SR, Golden AL, Hale WE: Self-report and medical record report agreement of selected medical conditions in the elderly. Am J Public Health. 1989, 79: 1554-1556. 10.2105/AJPH.79.11.1554.
Tisnado DM, Adams JL, Liu H, Damberg CL, Chen W-P, Hu FA, Carlisle DM, Mangione CM, Kahn KL: What is the concordance between the medical record and patient self-report as data sources for ambulatory care?. Med Care. 2006, 44: 132-140. 10.1097/01.mlr.0000196952.15921.bf.
Merkin SS, Cavanaugh K, Longenecker JC, Fink NE, Levey AS, Powe NR: Agreement of self-reported comorbid conditions with medical and physician reports varied by disease among end-stage renal disease patients. J Clin Epidemiol. 2007, 60: 634-642. 10.1016/j.jclinepi.2006.09.003.
Leikauf J, Federman AD: Comparisons of self-reported and chart-identified chronic diseases in inner-city seniors. J Am Geriatr Soc. 2009, 57: 1219-1225. 10.1111/j.1532-5415.2009.02313.x.
Barber J, Muller S, Whitehurst T, Hay E: Measuring morbidity: self-report or health care records?. Fam Pract. 2010, 27: 25-30. 10.1093/fampra/cmp098.
Malik AS, Giamouzis G, Georgiopoulou VV, Fike LV, Kalogeropoulos AP, Norton CR, Sorescu D, Azim S, Laskar SR, Smith AL, Dunbar SB, Butler J: Patient perception versus medical record entry of health-related conditions among patients with heart failure. Am J Cardiol. 2011, 107: 569-572. 10.1016/j.amjcard.2010.10.017.
Muggah E, Graves E, Bennett C, Manuel DG: Ascertainment of chronic diseases using population health data: a comparison of health administrative data and patient self-report. BMC Public Health. 2013, 13: 16-10.1186/1471-2458-13-16.
Taylor A, Dal Grande E, Gill T, Pickering S, Grant J, Adams R, Phillips P: Comparing self-reported and measured high blood pressure and high cholesterol status using data from a large representative cohort study. Aust N Z J Public Health. 2010, 34: 394-400. 10.1111/j.1753-6405.2010.00572.x.
Louie AD, Robison LL, Bogue M, Hyde S, Forman SJ, Bhatia S: Validation of self-reported complications by bone marrow transplantation survivors. Bone Marrow Transplant. 2000, 25: 1191-1196. 10.1038/sj.bmt.1702419.
Kemper C, Koller D, Glaeske G, van den Bussche H: Mortality and nursing care dependency one year after first ischemic stroke: an analysis of German statutory health insurance data. Top Stroke Rehabil. 2011, 18: 172-178. 10.1310/tsr1802-172.
Soto-Varela A, Arán-González I, López-Escámez JA, Morera-Pérez C, Oliva-Domínguez M, Pérez-Fernández N, Pérez-Garrigues H, Pérez-Vázquez P, Rossi-Izquierdo M, Santos-Pérez S: [Peripheral vertigo classification of the Otoneurology Committee of the Spanish Otorhinolaryngology Society: diagnostic agreement and update (version 2–2011)]. Acta Otorrinolaringol Esp. 2012, 63: 125-131. 10.1016/j.otorri.2011.10.004.
Sjahid SI, van der Linden PD, Stricker BHC: Agreement between the pharmacy medication history and patient interview for cardiovascular drugs: the Rotterdam elderly study. Br J Clin Pharmacol. 1998, 45: 591-595. 10.1046/j.1365-2125.1998.00716.x.
Grouven U, Bender R, Ziegler A, Lange S: Der Kappa-Koeffizient. Dtsch Med Wochenschr. 2007, 132: e65-e68. 10.1055/s-2007-959046.
Feinstein AR, Cicchetti DV: High agreement but low Kappa: I. the problems of two paradoxes. J Clin Epidemiol. 1990, 43: 543-549. 10.1016/0895-4356(90)90158-L.
de Vet HCW, Mokkink LB, Terwee CB, Hoekstra OS, Knol DL: Clinicians are right not to like Cohen’s. BMJ. 2013, 346: f2125-f2135. 10.1136/bmj.f2125.
Kottner J, Audigé L, Brorson S, Donner A, Gajewski BJ, Hróbjartsson A, Roberts C, Shoukri M, Streiner DL: Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. J Clin Epidemiol. 2011, 64: 96-106.
Schäfer I: Does multimorbidity influence the occurrence rates of chronic conditions? A claims data based comparison of expected and observed prevalence rates. PLoS ONE. 2012, 7: e45390-
Erler A, Beyer M, Muth C, Gerlach FM, Brennecke R: Garbage in – Garbage out? Validität von Abrechnungsdiagnosen in hausärztlichen Praxen. Das Gesundheitswesen. 2009, 71: 823-831.
Pakhomov SV, Jacobsen SJ, Chute CG, Roger VL: Agreement between patient-reported symptoms and their documentation in the medical record. Am J Manag Care. 2008, 14: 530-539.
McGrady A, Lynch DJ, Nagel RW, Tamburrino M: Coherence between physician diagnosis and patient self reports of anxiety and depression in primary care. J Nerv Ment Dis. 2010, 198: 420-424.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2296/15/39/prepub
The study is funded by the German Federal Ministry of Education and Research (grant numbers 01ET0725-31 and 01ET1006A-K).
This article is on behalf of the MultiCare Cohort Study Group, which consists of Attila Altiner, Horst Bickel, Wolfgang Blank, Monika Bullinger, Hendrik van den Bussche, Anne Dahlhaus, Lena Ehreke, Michael Freitag, Angela Fuchs, Jochen Gensichen, Ferdinand Gerlach, Heike Hansen, Sven Heinrich, Susanne Höfels, Olaf von dem Knesebeck, Hans-Helmut König, Norbert Krause, Hanna Leicht, Margrit Löbner, Melanie Luppa, Wolfgang Maier, Manfred Mayer, Christine Mellert, Anna Nützel, Thomas Paschke, Juliana Petersen, Jana Prokein, Steffi Riedel-Heller, Heinz-Peter Romberg, Ingmar Schäfer, Martin Scherer, Gerhard Schön, Susanne Steinmann, Sven Schulz, Karl Wegscheider, Klaus Weckbecker, Jochen Werle, Siegfried Weyerer, and Birgitt Wiese.
We are grateful to the general practitioners in Bonn, Dusseldorf, Frankfurt/Main, Hamburg, Jena, Leipzig, Mannheim and Munich who supplied the clinical information on their patients, namely: Theodor Alfen, Martina Amm, Katrin Ascher, Philipp Ascher, Heinz-Michael Assmann, Hubertus Axthelm, Leonhard Badmann, Horst Bauer, Veit-Harold Bauer, Sylvia Baumbach, Brigitte Behrend-Berdin, Rainer Bents, Werner Besier, Liv Betge, Arno Bewig, Hannes Blankenfeld, Harald Bohnau, Claudia Böhnke, Ulrike Börgerding, Gundula Bormann, Martin Braun, Inge Bürfent, Klaus Busch, Jürgen Claus, Peter Dick, Heide Dickenbrok, Wolfgang Dörr, Nadejda Dörrler-Naidenoff, Ralf Dumjahn, Norbert Eckhardt, Richard Ellersdorfer, Doris Fischer-Radizi, Martin Fleckenstein, Anna Frangoulis, Daniela Freise, Denise Fricke, Nicola Fritz, Sabine Füllgraf-Horst, Angelika Gabriel-Müller, Rainer Gareis, Benno Gelshorn, Maria Göbel-Schlatholt, Manuela Godorr, Jutta Goertz, Cornelia Gold, Stefanie Grabs, Hartmut Grella, Peter Gülle, Elisabeth Gummersbach, Heinz Gürster, Eva Hager, Wolfgang-Christoph Hager, Henning Harder, Matthias Harms, Dagmar Harnisch, Marie-Luise von der Heide, Katharina Hein, Ludger Helm, Silvia Helm, Udo Hilsmann, Claus W. Hinrichs, Bernhard Hoff, Karl-Friedrich Holtz, Wolf-Dietrich Honig, Christian Hottas, Helmut Ilstadt, Detmar Jobst, Gunter Kässner, Volker Kielstein, Gabriele Kirsch, Thomas Kochems, Martina Koch-Preißer, Andreas Koeppel, Almut Körner, Gabriele Krause, Jens Krautheim, Nicolas Kreff, Daniela Kreuzer, Franz Kreuzer, Judith Künstler, Christiane Kunz, Doris Kurzeja-Hüsch, Felizitas Leitner, Holger Liebermann, Ina Lipp, Thomas Lipp, Bernd Löbbert, Guido Marx, Stefan Maydl, Manfred Mayer, Stefan-Wolfgang Meier, Jürgen Meissner, Anne Meister, Ruth Möhrke, Christian Mörchen, Andrea Moritz, Ute Mühlmann, Gabi Müller, Sabine Müller, Karl-Christian Münter, Helga Nowak, Erwin Ottahal, Christina Panzer, Thomas Paschke, Helmut Perleberg, Eberhard Prechtel, Hubertus Protz, Sandra Quantz, Eva-Maria Rappen-Cremer, Thomas Reckers, Elke Reichert, Birgitt Richter-Polynice, Franz Roegele, Heinz-Peter Romberg, Anette Rommel, Michael Rothe, Uwe Rumbach, Michael Schilp, Franz Schlensog, Ina Schmalbruch, Angela Schmid, Holger Schmidt, Lothar Schmittdiel, Matthias Schneider, Ulrich Schott, Gerhard Schulze, Heribert Schützendorf, Harald Siegmund, Gerd Specht, Karsten Sperling, Meingard Staude, Hans-Günter Stieglitz, Martin Strickfaden, Hans-Christian Taut, Johann Thaller, Uwe Thürmer, Ljudmila Titova, Michael Traub, Martin Tschoke, Maya Tügel, Christian Uhle, Kristina Vogel, Florian Vorderwülbecke, Hella Voß, Christoph Weber, Klaus Weckbecker, Sebastian Weichert, Sabine Weidnitzer, Brigitte Weingärtner, Karl-Michael Werner, Hartmut Wetzel, Edgar Widmann, Alexander Winkler, Otto-Peter Witt, Martin Wolfrum, Rudolf Wolter, Armin Wunder, and Steffi Wünsch.
We also thank Corinna Contenius, Cornelia Eichhorn, Sarah Floehr, Vera Kleppel, Heidi Kubieziel, Rebekka Maier, Natascha Malukow, Karola Mergenthal, Christine Müller, Sandra Müller, Michaela Schwarzbach, Wibke Selbig, Astrid Steen, Miriam Steigerwald, and Meike Thiele for collecting the data, as well as Ulrike Barth, Elena Hoffmann, Friederike Isensee, Leyla Kalaz, Heidi Kubieziel, Helga Mayer, Karine Mnatsakanyan, Michael Paulitsch, Merima Ramic, Sandra Rauck, Nico Schneider, Jakob Schroeber, Susann Schumann, and Daniel Steigerwald for entring the data.
The authors declare that they have no competing interests.
HvdB, IS, HH, KW, MS and BW conceived and designed the study. BW and GS prepared the data for analysis. HH and GS analyzed the data. HH drafted the manuscript. SRH, JG, SW, JJP, HHK, HB, AF and SH participated in the study design and implementation. All authors read and approved the final manuscript.
Electronic supplementary material
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.