- Research article
- Open Access
- Open Peer Review
This article has Open Peer Review reports available.
Validation of Self-Management Screening (SeMaS), a tool to facilitate personalised counselling and support of patients with chronic diseases
- Nathalie Eikelenboom1, 2Email author,
- Ivo Smeele†2,
- Marjan Faber†1,
- Annelies Jacobs†1,
- Frank Verhulst†3,
- Joyca Lacroix†4,
- Michel Wensing†1 and
- Jan van Lieshout†1
© Eikelenboom et al. 2015
Received: 15 May 2014
Accepted: 28 October 2015
Published: 11 November 2015
A rising number of people with chronic conditions is offered interventions to enhance self-management. The responsiveness of individuals to these interventions depends on patient characteristics. We aimed to develop and validate a tool to facilitate personalised counselling and support for self-management in patients with chronic diseases in primary care.
We drafted a prototype of the tool for Self-Management Screening (SeMaS), comprising 27 questions that were mainly derived from validated questionnaires. To reach high content validity, we performed a literature review and held focus groups with patients and healthcare professionals as input for the tool. The characteristics self-efficacy, locus of control, depression, anxiety, coping, social support, and perceived burden of disease were incorporated into the tool. Three items were added to guide the type of support or intervention, being computer skills, functioning in groups, and willingness to perform self-monitoring. Subsequently, the construct and criterion validity of the tool were investigated in a sample of 204 chronic patients from two primary care practices. Patients filled in the SeMaS and a set of validated questionnaires for evaluation of SeMaS. The Patient Activation Measure (PAM-13), a generic instrument to measure patient health activation, was used to test the convergent construct validity.
Patients had a mean age of 66.8 years and 46.6 % was female. 5.9 % did not experience any barrier to self-management, 28.9 % experienced one minor or major barrier, and 30.4 % two minor or major barriers. Compared to the criterion measures, the positive predictive value of the SeMaS characteristics ranged from 41.5 to 77.8 % and the negative predictive value ranged from 53.3 to 99.4 %. Crohnbach’s alpha for internal consistency ranged from 0.56 to 0.87, except for locus of control (α = 0.02). The regression model with PAM-13 as a dependent variable showed that the SeMaS explained 31.7 % (r2 = 0.317) of the variance in the PAM-13 score.
SeMaS is a short validated tool that can signal potential barriers for self-management that need to be addressed in the dialogue with the patient. As such it can be used to facilitate personalised counselling and support to enhance self-management in patients with chronic conditions in primary care.
The number of people suffering from one or more chronic conditions is rising rapidly. In the Netherlands, the percentage of patients that suffered from at least one chronic disease raised from 12.6 % in 2003 to 15.0 % in 2009 . Several studies have shown positive effects of self-management programs on lifestyle and clinical outcomes, as well as on patients’ motivation, cognition, knowledge, engagement and activation related to self-management behaviours [2–5]. Self-management is defined as ‘the care taken by individuals towards their own health and well-being: it comprises the actions they take to lead a healthy lifestyle; to meet their social, emotional and psychological needs; to care for their long-term condition; and to prevent further illness or accidents’ .
However, realising effective self-management in daily life is a major challenge for many people. Substantial variation exists regarding the responsiveness of individuals to self-management interventions [7, 8]. One of the main reasons for the lack of success of self-management interventions is that they often fail to address the individual characteristics of the patient (i.e., personal barriers, needs and situation that play a role in self-management behaviour), resulting in suboptimal reach and impact. The challenge is to find ways to enhance the impact of self-management programs by personalised counselling and support.
The concept of personalisation of treatment to individual characteristics has been introduced in other fields of research, especially human genetics, where treatment is tailored to genomic profiles. This is called personalised medicine . Similarly, in psychology treatment can be adjusted to psychological characteristics of the patient [10–12]. Personalisation has also been applied to web-based interventions and printed material [13, 14]. We applied the concept of personalisation on the application of self-management interventions and hypothesised that self-management counselling and support can be more successful if a personalised approach is used.
Several studies have identified a single determinant of patients’ self-management behaviour, such as self-efficacy, depressive symptoms or coping behaviour [7, 15–17]. Self-efficacy is the patients’ perceived ability to overcome difficulties in behavioural change. This is a predictor for behavioural change, which is needed when confronted with a chronic illness [18, 19]. Co-morbid depression is often seen in patients with chronic diseases . Depression negatively affects patients’ self-care . Finally, coping refers to the way chronically ill patients cope with problems they encounter. An active coping style positively affects well-being and clinical outcomes .
It is essential to have a good understanding of the set of individual characteristics that need to be considered in personalised counselling and support of patients’ self-management and how these characteristics can be measured in a valid and feasible way in a primary care setting. There are some instruments available that measure one or more aspects of self-management, often disease specific, such as the Confidence in diabetes self-care scale, or the Nijmegen Clinical Screening Instrument (NCSI) for patients with Chronic Obstructive Pulmonary Disease (COPD) [22, 23]. The NCSI questionnaire measures disease-specific characteristics that determine the health status. The Self-Management Ability Scale (SMAS) focuses on self-management ability of the elderly in relation to well-being . Other instruments have been developed to assess the effect of self-management interventions, such as the Health education impact Questionnaire (heiQ), containing items on health directed behaviour, attitude, self-monitoring and social support . The Partners in Health (PIH) scale and the Patient Activation Measure (PAM-13) both measure the current status of self-management, with items on e.g. knowledge of the condition and skills to monitor symptoms [8, 26].
However, to the best of our knowledge, no generic instrument exists that aims to measure patients’ characteristics that could be a barrier for self-management, in order to provide personalised counselling and support. Moreover, no generic instrument exists that measures these characteristics in a concise way with minimal respondent burden. As with other patient-reported outcome measures, minimising respondent burden is important for the response rate and quality of the collected data [27, 28]. Also, to make the tool practically applicable to facilitate personalised counselling, results should be presented in a way that is easy to interpret and use in day-to-day care .
Relying on these insights, we aimed to develop and validate a generic, brief and practically applicable self-management screening questionnaire (SeMaS) to measure possible patient-related barriers to self-management in chronic patients in primary care.
Overview of methods used for validation of SeMaS
Type of validation
Focus group interviews
Focus group interviews
Calculation of PPV, NPV and correlations of SeMaS using the validated questionnaires as ‘golden standard’
(Convergent) Construct validity (hypothesis testing)
Correlation of SeMaS with PAM-13
Reliability: internal consistency
The study was carried out in two primary care group practices in the south of the Netherlands. These practices are a member of ‘De Ondernemende Huisarts’ (DOH), an innovative primary care group comprising 15 primary care group practices, and serving approximately 110.000 patients. The care group provides integrated healthcare for several chronic diseases, and has defined self-management as a priority in their policy. The professionals of this care group are all trained in the ‘actual practice and maintenance’ approach, consisting of a behaviour change model (“series of steps”) and “individual related factors” to enhance self-management . The “individual related factors” include the constructs locus of control, self-efficacy, anxiety, depression, stress, coping style, styles of attribution, pain and somatisation. These factors can be barriers for behavioural change.
Content validity and face validity
The content and face validity of SeMaS were based on a literature review, focus group interviews with patients and healthcare professionals, and pilot testing.
Many publications report on one or two individual characteristics that influence self-management behaviour. To create an overview of possible important patient-related characteristics, we performed a review in 2011 based on a systematic literature search in the PubMed and psycINFO databases, and screening of articles from the years 2000 to 2011 on title and abstract. Due to time constraints, we were not able to screen all full texts. Therefore, of the 133 articles we screened all full texts that described trials, controlled or comparative research, and the most recent non-comparative, or qualitative research. In total, 68 articles were screened, and from 42 full-text articles, all the characteristics that were named in the articles were listed, as well as instruments used for measurement. This review yielded a list of 43 items, many of which overlapped. Examples were sex, age, perceived burden of disease, and psychosocial factors such as self-efficacy, social support and coping. Details of the literature review are provided in Additional file 1.
Focus group interviews were held to document what patients and professionals considered important for effective self-management based on their experience. A purposeful sample of patients with chronic conditions (the same patients participated in 3 focus groups; n = 10, n = 6, n = 5) and primary care professionals (including general practitioners, psychologist, dietician, physiotherapist, nurse; 2 focus groups; n = 4, n = 5, one GP participated in both groups) participated in the focus groups. The items from the literature review were used as input in these interviews. The focus group interviews were audio recorded, and field notes were made for identification of the important characteristics. A report was made of each focus group, which was sent to the participants as preparation for the next session. Details of the focus group interviews are described in Additional file 1. The result of the focus group interviews was a preliminary list of characteristics that should be incorporated in the tool, according to the patients and professionals.
The development of the tool was guided by a group of stakeholders, consisting of two general practitioners, a psychologist, a nurse, three researchers, and two healthcare innovation experts of two health insurance companies. After completing the focus group interviews, the stakeholder group made the final selection of characteristics to be incorporated in the tool, as described below. Also, the stakeholder group monitored whether the study was conducted as planned.
Selection of characteristics for the SeMaS questionnaire
Patient characteristics identified in literature review
Mentioned in focus group interviews with professionals and/or patients
Scientific evidence for impact on self-management
Validated measure available
Included in SeMaS
Number of items in SeMaS
Perceived burden of disease
1 (6 subitems)
Sense of self esteem
Confidence in self care
Locus of control
No (added by stakeholders)
Next, we developed a prototype of the questionnaire to test in practice. For the selected characteristics, we used items from validated questionnaires, which we identified in the literature review, further targeted searches on the Internet, or consultation of experts in the stakeholders group. The items were selected, considering the psychometric features of the questionnaire if available. Otherwise, items were selected based on face validity, as described in the Measures section. Specifically, the research team discussed whether the selected items would suffice to cover all aspects of the construct being measured. For uniformity in the newly developed SeMaS questionnaire, the wording of some items in SeMaS was slightly altered. For example: all items were formulated in I-form instead of the you-form. We also slightly adjusted the response scales to make it as uniform as possible, and thus easier for the patient to fill out the questionnaire. For example, the response scale of self-efficacy was reduced from a 7 point to a 4 point Likert scale, and still ranging from completely false to completely true. Also, one option was added to the response scale of coping, ranging from never to very often/continuously, to correspond with the anxiety and depression subscales. However, when scoring these items, the extra option for coping (‘often’) received the same score as the option ‘very often/continuously’. As a result, all questions of SeMaS had a 4 or 5 point Likert scale, except perceived burden of disease. This item was scored on a visual analogue scale from 0 to 10. The original questionnaires are provided in Additional file 2. To enhance the content validity, the stakeholders group assessed the prototype, leading to some minor adaptations. Three items were added to guide the type of support or intervention, being computer skills, functioning in groups, and willingness to perform self-monitoring.
We wanted to provide the results of SeMaS in a graphic profile that can be easily used and interpreted by the healthcare professional in day-to-day care. For each characteristic, a score was calculated by adding up the scores of the individual items. These scores were categorised and presented in a graphic profile in terms of barriers for self-management: no, minor, or major barriers. For anxiety and depression, the categorisation was in line with the original questionnaire, where the categories no, minor and major elevation were used based on the sum scores. For locus of control and coping, the categorisation in the type of locus (internal or external) or coping style (problem solving, expressing emotions or looking for distraction) was used. No categorisation was available for perceived burden of disease, self-efficacy, and social support. Therefore, categorisation was based on face validity. For perceived burden of disease, a low burden (0–2) was classified as a possible minor barrier for self-management, as the motivation for behavioural change could be low. On the other hand, a high burden of disease (8–10) could hinder self-management due to e.g. functional impairments, and thus also classified as minor barrier. Scores 3 to 7 were classified as no barrier.
The responses for the two items on self-efficacy were scored from 0 to 3, thus having a maximum sum score of 6. The scores 4 to 6 were classified as having high self-efficacy and thus no barrier, 2 to 3 as a minor barrier, and 0 to 1 as major barrier.
For social support, the responses ‘no’, ‘completely false’ and ‘somewhat false’ were scored as 0; ‘somewhat true’ as 1, and ‘completely true’ as 2. Total score for this category was 12. The scores 3 to 12 were categorised as having no barrier (thus having 2–3 persons in the patients’ network who can provide support), 2 was categorised as having a minor barrier, and 1 to 0 as having a major barrier.
Although developed separately, the SeMaS questionnaire and the ‘actual practice and maintenance approach’ overlapped substantially in patient characteristics that were included for their importance for self-management, such as self-efficacy, social support, anxiety, depression, coping and locus of control . Therefore, a manual was developed for the practice nurses to guide the interpretation and use of this information, based on the ‘actual practice and maintenance approach’ . Both the categorisation and manual were developed in collaboration with the developer (author FV) of this approach.
Construct and criterion validity
The construct and criterion validity of the SeMaS tool were tested in an observational study with a sample of patients from two general practices.
The patient sample comprised patients visiting two group practices from the care group. Patients with a chronic disease (diabetes mellitus, COPD, asthma, and/or (high risk for) cardiovascular disease) who were treated for this condition in primary care by a practice nurse, and were over 18 years of age were eligible to participate in the study. The chronic conditions were coded according to the International Classification of Primary Care (ICPC) in the medical health records.
To test the practicality of the instrument, practice nurses were asked to discuss the results of SeMaS with the patients in planned consultations. To simulate the normal procedure in the primary care practice, patients were selected from the agenda of the practice nurse. As many patients as possible were selected per day in a five month period, while not selecting on other patient characteristics, besides the inclusion criteria. 243 patients responded to the invitation to participate in the study.
Patients were invited to complete the questionnaire and return it in a prepaid envelope to the research institute, together with the signed informed consent form. The questionnaire consisted of the SeMaS, and a set of validated questionnaires to evaluate SeMaS, as described in the ‘Measures’ section.
The SeMaS questionnaire that was tested contained 27 items in total, measuring the psychological constructs self-efficacy (2 items), coping (6 items), depression (3 items), anxiety (4 items) and locus of control (2 items) [18, 19]. The construct of social support included 5 items . Also, the perceived burden of disease was assessed (1 item). Three other items that guide the type of support concerned computer skills, functioning in groups and willingness to perform self-monitoring (3 items). The questionnaire was made available in the Dutch language.
To determine the criterion validity of the SeMaS, we assessed whether the scores on the SeMaS were an adequate reflection of the scores on the original validated instruments. For this purpose, patients were asked to fill in these original instruments. The original instruments and the items used in SeMaS are described below. The original instruments were used in their original form.
In the SeMaS questionnaire, two out of four items from the perceived competence scale were used to determine the level of self-efficacy, based on face validity [19, 32, 33]. To improve uniformity in the SeMaS questionnaire, we adjusted the response categories of the original questionnaire from a 7-point to a 4-point Likert scale, ranging from completely false to completely true . Items were translated from English to Dutch by the research team. For assessing the criterion validity of the characteristic self-efficacy, two questions from the Dutch version of the Patient Activation Measure (PAM-13) were used in the analysis, as these items were very similar, and were already assessed for construct validity [8, 34]. The PAM-13 measures knowledge, skills and self-efficacy for self-management .
For coping, we used the Dutch version of the short Utrecht Coping List (UCL-k) [18, 35]. This questionnaire consists of 14 items, with a 4-point response scale ranging from never to very often/continuously. Respondents indicate how often they cope with problems in a certain way. The questionnaire distinguishes three coping styles, being problem solving (P), expressing emotions (E) and looking for distraction (D). Based on correlations between the items from available research data from 183 carers for patients with dementia, we used two items per coping style in the SeMaS questionnaire, thus six items in total. The wording of the items was slightly altered to the I-form, and the response categories adjusted to the 5-point scale of the anxiety and depression subscales.
Anxiety and depression
For anxiety and depression, we used these subscales of the validated Dutch version of the 4-dimensional symptom questionnaire (4DSQ). The 4DSQ is a self-report questionnaire of 50 items that measures non-specific general distress, depression, anxiety and somatisation, with a 5-point response scale ranging from never to very often/continuously . Using available data from 2127 patients in general practice , we computed correlations between the items, and removed items that had a correlation >0.7 with another item. For anxiety, we used 4 from the original 12 items. For depression, we used 3 from the original 6 items. The wording of the questions was slightly changed to the I-form. Response categories were not altered.
Locus of control
We used the Dutch version of the Multidimensional Health locus of control scale (MHLCS) for locus of control [19, 37]. The MHLCS consists of 18 questions with a 6-point Likert-scale, ranging from completely disagree to completely agree. The MHLCS identifies three orientation scales, being: physician orientation, chance orientation, and internal orientation. Sum scores are produced per scale. The scale with the highest score is the most prevalent one. In the SeMaS questionnaire we dichotomised the locus of control sum score into an internal orientation versus an external orientation (physician and chance), consistent with the “actual practice and maintenance” approach . We used two MHLCS items in SeMaS that most clearly represented the internal and external orientation. The items were chosen on face validity, as no data was available to us. The response categories were reduced to a 4-point Likert-scale for uniformity in the SeMaS.
For social support, the Short Scale of Social Support (SSSS) was used. This questionnaire consists of 5 items and measures actual support in case of need . One item on the support from neighbours was added, as this was relevant for the Dutch context. The response categories were adjusted to match the subscales of self-efficacy and locus of control for consistency from helpful (not at all-completely) to completely disagree/agree (both 4-point Likert scale). Items were translated from English to Dutch by the research team.
Perceived burden of disease
For perceived burden of disease, the Dutch version of the EQ-5D questionnaire was used, containing five dimensions of quality of life, and one item on the perceived health status . The item on the perceived health status was used in the SeMaS, and inversely formulated to measure the perceived burden of disease. The item was scored on a visual analogue scale from 0 to 10 (0 to 100 in EQ-5D), as this is a concise way of measuring subjective characteristics.
Convergent construct validity
Hibbard et al. developed a short questionnaire to measure the level of patient activation, the PAM-13 . This questionnaire assesses patient knowledge, skills, and self-efficacy for self-management . The PAM-13 is one of the few generic measures for the level of self-management. We obtained permission of Insignia to use the PAM-13 in this study.
We used the validated Dutch version of PAM-13 to determine the convergent construct validity, hypothesising that the better the score on the SeMaS (i.e. having fewer barriers to self-management), the higher the score on PAM-13 . We obtained permission of Insignia to use the PAM-13 in this study.
Descriptive analysis was used to inspect the distributions of scores and numbers of missing values on items in the SeMaS questionnaire. When computing sum scores for each construct, cases with missing values were excluded, except for social support. In the SeMaS and the Short Scale of Social support the missing values were interpreted as ‘not applicable’.
The internal consistency was determined for each construct in SeMaS using Crohnbach’s alpha. Values of 0.6–0.7 are considered acceptable; 0.7 or higher is considered as good .
To determine the criterion validity, the positive (PPV) and negative predictive value (NPV) of the characteristics in SeMaS were determined regarding the scores on the (more comprehensive) original questionnaires. The positive predictive value (PPV) indicates the percentage of rightly detected barriers by SeMaS, compared to the original questionnaire. The PPV is calculated by dividing the number of patients with a barrier for self-management detected by SeMaS and the original questionnaire, by the total number of patients with a barrier detected by SeMaS. The negative predictive value (NPV) indicates the percentage of rightly indicated absence of barriers by SeMaS, compared to the original questionnaire. The NPV is calculated by dividing the number of patients with no barrier detected by SeMaS and the original questionnaire, by the total number of patients with no barrier detected by SeMaS. We considered the PPV and NPV as relevant measures for application of the SeMaS tool in everyday practice [41, 42]. Also, correlations of the sum scores of each construct in SeMaS with the sum scores on the original questionnaire were computed to investigate the relationship between both measures. Values of 0.3 to 0.7 indicate a moderate linear relationship; 0.7 or higher indicate a strong linear relationship. For validation purposes, a correlation of 0.7 is recommended . We checked whether the sum scores were normally distributed. In case of a normal distribution, we used Pearson’s r, otherwise the non-parametric Spearman’s rho.
PAM-13 was used to determine the construct validity of the SeMaS based on convergent validity. In a regression analysis, categorical variables should consist of two categories. Therefore, in the regression analysis, we dichotomised the scores on SeMaS into having no barrier versus having a (minor or major) barrier. Using univariate ANOVA, all constructs were tested on whether the PAM scores differed between the categories. Subsequently, using multivariate linear regression models, the relations between the relevant SeMaS characteristics and PAM scores (0–100) were investigated. We performed all analyses using SPSS software (version 20, IBM Corp.).
We performed the aforementioned analyses as primary analyses. Based on the findings in the primary analyses, the tool was adjusted to its final version as a last step in the validation process. After the final adjustments, we performed the secondary analyses. The final instrument is added in Additional file 3, as well as the calculation of the scores. The results of the primary analyses are shown in Additional file 4. Also, the final adaptations are described in this additional file. Here, we present the results of the secondary analyses, as these represent the test characteristics of the instrument in its actual form.
Description of the study population (numbers (%))
Number of respondents
109 (53.4 %)
95 (46.6 %)
Age in years (mean ± SD)
66.7 ± 9.1
66.9 ± 9.6
0 (0 %)
3 (3.2 %)
18 (16.5 %)
31 (32.7 %)
43 (39.4 %)
27 (28.4 %)
42 (38.6 %)
20 (21.0 %)
1 (0.9 %)
6 (6.3 %)
5 (4.6 %)
8 (8.4 %)
49 (16.2 %)
34 (35.4 %)
100 (92.6 %)
88 (91.7 %)
13 (12.0 %)
19 (19.8 %)
3 (2.8 %)
6 (6.3 %)
2 (1.9 %)
0 (0 %)
The number of missing values per characteristic in SeMaS ranged from 3 (self-efficacy) to 64 (coping). For social support, 101 cases had missing values on the individual items. One case was excluded, which had no valid responses on the items for social support. Cases were excluded from the analysis if they had missing data for the construct being analysed.
Number of respondents with minor or major barriers for self-management
Number of barriers
Number of respondents
Percentage of respondents
Description of the psychometric characteristics of the final SeMaS
Crohnbach’s alpha (α) for internal consistency
Correlation of sum score on SeMaS with sum score on original questionnaire
Locus of control
Perceived burden of disease
Results of the regression model with PAM-13 as the dependent variable
Locus of control
Perceived burden of disease
This manuscript describes the validation of SeMaS using a mixed methods approach. We aimed at developing a short screening questionnaire that is applicable in day-to-day care by practice nurses in a primary care setting. The instrument is now ready for testing of its impact in every day practice.
The analyses for criterion validity showed reasonable to good results, with values for NPV and PPV that are comparable to or better than other diagnostic tests in primary care [44–46]. Most patients showed barriers for coping and locus of control. The majority of the participants did not experience any anxiety or self-efficacy barriers. The PPV and NPV are dependent on the prevalence of the barriers. A low prevalence causes a low PPV, even when the sensitivity and specificity of the test are good. This could be the case for anxiety, as only 4.9 % of the patients had a barrier detected by SeMaS, and the PPV was on the low side. Thus, SeMaS could be sufficiently able to detect barriers on anxiety, while this is not reflected in the PPV value.
Furthermore, the values of Crohnbach’s alpha for internal consistency are in the acceptable range for most of the characteristics. The value of Crohnbach’s alpha depends on the length and heterogeneity of the construct being measured . This could explain the lower values for the characteristics locus of control, social support and anxiety. These constructs are heterogeneous, e.g. for anxiety several types of anxiety complaints are measured: irrational fears, anticipation, anxiety and avoidance behaviour .
For locus of control, both the Crohnbach’s alpha and correlations are low. This could be due to the concise way of measuring this characteristic in the SeMaS, as we decreased the number of items from 18 in the original questionnaire to two items in the SeMaS. Literature on this characteristic showed that the scientific evidence of the impact of locus of control on self-management is inconclusive [15, 48]. Therefore, further validation and research on this characteristic is recommended.
The SeMaS is developed with the explicit aim to contain only a limited number of questions to enable its feasibility in daily practice. Depending on the cut-off points of the categories, more false positive or more false negative cases will be detected. We defined the cut-off points realising that the instrument opens up the opportunity to find barriers otherwise at all undetected. The SeMaS is intended as a tool to signal potential barriers for self-management that need to be addressed in the conversation with the patient, rather than as a diagnostic tool.
Depression and anxiety are important possible barriers for self-management , and often undiagnosed by the general practitioner [50–52]. SeMaS helps in detecting these problems. If indicated, additional diagnostic instruments should be used for anxiety and depression.
To test whether the tool was practically applicable, practice nurses were asked to discuss the results of SeMaS with the patients during the planned consults in the observational study. In evaluative interviews, the practice nurses indicated the tool as practical and useful in practice, although they needed time to learn to work with the tool (findings available upon request).
The SeMaS scores explained part of the variance in the PAM-13 scores. The main part of this explained variance could be attributed to the shared characteristic of both instruments, being self-efficacy. As PAM-13 further measures knowledge and skills (related to management of the disease, and not related to possible interventions), which are not incorporated in the SeMaS, it is understandable that not all variance in the PAM scores can be explained by the SeMaS. Nevertheless we chose PAM-13 as a reference, since it is one of the few generic measures for the level of self-management at this time.
As discussed in the introduction, there are a few other instruments that show some overlap with the SeMaS. These instruments assess disease-specific characteristics (NCSI), or focus on the current level of self-management (PIH, PAM-13) [8, 26, 53]. The difference between these instruments and SeMaS is that SeMaS is a generic instrument that assesses person-related characteristics that could be a barrier for self-management of a chronic condition. By assessing these characteristics and presenting the results in a graphic profile, SeMaS can be used to provide personalised counselling and support.
Strengths and limitations of this study
SeMaS was systematically developed, using a range of methods. Based on the input from the focus group interviews and the stakeholder group much effort was put in the uniformity of the questionnaire regarding wording of the items and response categories. In the first analyses the rephrasing of various items showed to be a factor with negative influence on the PPV and the NPV. For this reason we decided to adjust the wordings more in line with the original questionnaires, as described in Additional file 4. A further strength of this study was that the response of the selected sample was high (>80 %), decreasing the risk of attrition bias. Also, the minimal number of respondents (150) for a validation study was well achieved. Another strength of this study could be that the participating primary care practices are part of an innovative care group, which has formulated a policy agenda on self-management. This may have influenced the development of the instrument in a positive way, as the participating patients and professionals may have been more experienced in what characteristics could hinder self-management. Furthermore, the fact that patients and health care professionals were involved in the development of this instrument increases the possibility of the instrument being applicable in practice.
A limitation of this study is that the literature study comprised a systematic search, and screening of all abstracts for inclusion, but review of a subset of the full text articles. Since many characteristics were mentioned in multiple articles, and the characteristics that are important for self-management were also discussed in the focus group interviews, we felt we captured the most important characteristics that had to be incorporated in the tool.
Another limitation of this study could be that the participating primary care practices are part of an innovative care group, with a policy agenda on self-management. Possibly, the issues raised by the patients and professionals in the focus groups differ from issues in other care groups. This may have implications for use in practice, as other care groups less experienced with stimulating self-management may not recognise the incorporated characteristics as important, or may have less possibilities in providing personalised support.
The SeMaS questionnaire has been developed and validated in this study. The SeMaS is now ready for testing in practice as a generic, brief, practically applicable tool to measure possible patient-related barriers to self-management in chronic patients in primary care.
The results of this study show that it is possible to create profiles of patients regarding their self-management competence. Next, we will investigate the applicability and the impact of the use of these profiles in counselling on self-management in primary care . Using the profiles to provide personalised self-management support may positively influence the effectiveness of the support and self-management interventions. This next study will also provide possibilities for further validation of the SeMaS questionnaire.
We would like to express our gratitude to Maarten Klomp for his contribution to the development of the concept of SeMaS.
This study is funded by the Dutch health care insurance companies CZ and VGZ, and by Philips Research. This is the source of funding for NE, AJ, JL, and JvL. MF and MW are funded by IQ healthcare. The activities of IS and FV are funded by the DOH organisation.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Tacken MA, Opstelten W, Vossen I, Smeele IJ, Calsbeek H, Jacobs JE, et al. Increased multimorbidity in patients in general practice in the period 2003–2009. Ned Tijdschr Geneeskd. 2011;155(26):A3109.PubMedGoogle Scholar
- de Silva D, Evidence: Helping people help themselves. A review of the evidence considering whether it is worthwhile to support self-management. Health Foundation (Great Britain), 2011, ISBN 978–1–906461–26–3.Google Scholar
- Effing T, Monninkhof EM, van der Valk PD, van der Palen J, van Herwaarden CL, Partidge MR, et al. Self-management education for patients with chronic obstructive pulmonary disease. Cochrane Database Syst Rev. 2007;4, CD002990.PubMedGoogle Scholar
- Orrow G, Kinmonth AL, Sanderson S, Sutton S. Effectiveness of physical activity promotion based in primary care: systematic review and meta-analysis of randomised controlled trials. BMJ. 2012;344, e1389.View ArticlePubMedPubMed CentralGoogle Scholar
- Lu Z, Cao S, Chai Y, Liang Y, Bachmann M, Suhrcke M, et al. Effectiveness of interventions for hypertension care in the community--a meta-analysis of controlled studies in China. BMC Health Serv Res. 2012;12:216.View ArticlePubMedPubMed CentralGoogle Scholar
- Department of Health. Self Care - A Real Choice: Self Care Support - A Practical Option. 2005.Google Scholar
- Bischoff EW, Hamd DH, Sedeno M, Benedetti A, Schermer TR, Bernard S, et al. Effects of written action plan adherence on COPD exacerbation recovery. Thorax. 2011;66(1):26–31.View ArticlePubMedGoogle Scholar
- Hibbard JH, Mahoney ER, Stockard J, Tusler M. Development and testing of a short form of the patient activation measure. Health Serv Res. 2005;40(6 Pt 1):1918–30.View ArticlePubMedPubMed CentralGoogle Scholar
- Ziegler A, Koch A, Krockenberger K, Grosshennig A. Personalized medicine using DNA biomarkers: a review. Hum Genet. 2012;131(10):1627–38.View ArticlePubMedPubMed CentralGoogle Scholar
- Cuijpers P, Reynolds 3rd CF, Donker T, Li J, Andersson G, Beekman A. Personalized treatment of adult depression: medication, psychotherapy, or both? A systematic review. Depress Anxiety. 2012;29(10):855–64.View ArticlePubMedGoogle Scholar
- Siskind D, Harris M, Pirkis J, Whiteford H. Personalised support delivered by support workers for people with severe and persistent mental illness: a systematic review of patient outcomes. Epidemiol Psychiatr Sci. 2012;21(1):97–110.View ArticlePubMedGoogle Scholar
- Evers AW, Rovers MM, Kremer JA, Veltman JA, Schalken JA, Bloem BR, et al. An integrated framework of personalized medicine: from individual genomes to participatory health care. Croat Med J. 2012;53(4):301–3.View ArticlePubMedPubMed CentralGoogle Scholar
- Noar SM, Benac CN, Harris MS. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull. 2007;133(4):673–93.View ArticlePubMedGoogle Scholar
- Lustria ML, Cortese J, Noar SM, Glueckauf RL. Computer-tailored health interventions delivered over the Web: review and analysis of key components. Patient Educ Couns. 2009;74(2):156–73.View ArticlePubMedGoogle Scholar
- Ahola AJ, Groop PH. Barriers to self-management of diabetes. Diabet Med. 2013;30(4):413–20.View ArticlePubMedGoogle Scholar
- Dirik G, Karanci AN. Psychological distress in rheumatoid arthritis patients: an evaluation within the conservation of resources theory. Psychol Health. 2010;25(5):617–32.View ArticlePubMedGoogle Scholar
- Murray J, Fenton G, Honey S, Bara AC, Hill KM, House A. A qualitative synthesis of factors influencing maintenance of lifestyle behaviour change in individuals with high cardiovascular risk. BMC Cardiovasc Disord. 2013;13:48.View ArticlePubMedPubMed CentralGoogle Scholar
- Kratz AL, Molton IR, Jensen MP, Ehde DM, Nielson WR. Further evaluation of the Motivational Model of Pain Self-Management: coping with chronic pain in multiple sclerosis. Ann Behav Med. 2011;41(3):391–400.View ArticlePubMedPubMed CentralGoogle Scholar
- AbuSabha R, Achterberg C. Review of self-efficacy and locus of control for nutrition- and health-related behavior. J Am Diet Assoc. 1997;97(10):1122–32.View ArticlePubMedGoogle Scholar
- Thomas J, Jones G, Scarinci I, Brantley P. A descriptive and comparative study of the prevalence of depressive and anxiety disorders in low-income adults with type 2 diabetes and other chronic illnesses. Diabetes Care. 2003;26(8):2311–7.View ArticlePubMedGoogle Scholar
- Scharloo M, Kaptein AA, Weinman J, Hazes JM, Willems LN, Bergman W, et al. Illness perceptions, coping and functioning in patients with rheumatoid arthritis, chronic obstructive pulmonary disease and psoriasis. J Psychosom Res. 1998;44(5):573–85.View ArticlePubMedGoogle Scholar
- Van Der Ven NC, Weinger K, Yi J, Pouwer F, Ader H, Van Der Ploeg HM, et al. The confidence in diabetes self-care scale: psychometric properties of a new measure of diabetes-specific self-efficacy in Dutch and US patients with type 1 diabetes. Diabetes Care. 2003;26(3):713–8.View ArticlePubMed CentralGoogle Scholar
- Vercoulen JH. A simple method to enable patient-tailored treatment and to motivate the patient to change behaviour. Chron Respir Dis. 2012;9(4):259–68.View ArticlePubMedGoogle Scholar
- Schuurmans H, Steverink N, Frieswijk N, Buunk BP, Slaets JP, Lindenberg S. How to measure self-management abilities in older people by self-report. The development of the SMAS-30. Qual Life Res Int J Qual Life Asp Treat Care Rehab. 2005;14(10):2215–28.View ArticleGoogle Scholar
- Osborne RH, Elsworth GR, Whitfield K. The Health Education Impact Questionnaire (heiQ): an outcomes and evaluation measure for patient education and self-management interventions for people with chronic conditions. Patient Educ Couns. 2007;66(2):192–201.View ArticlePubMedGoogle Scholar
- Petkov J, Harvey P, Battersby M. The internal consistency and construct validity of the partners in health scale: validation of a patient rated chronic condition self-management measure. Qual Life Res Int J Qual Life Asp Treat Care Rehab. 2010;19(7):1079–85.View ArticleGoogle Scholar
- Turner RR, Quittner AL, Parasuraman BM, Kallich JD, Cleeland CS, Mayo FDAP-ROCMG. Patient-reported outcomes: instrument development and selection issues. Value Health. 2007;10 Suppl 2:S86–93.View ArticlePubMedGoogle Scholar
- Aaronson N, Alonso J, Burnam A, Lohr KN, Patrick DL, Perrin E, et al. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res Int J Qual Life Asp Treat Care Rehab. 2002;11(3):193–205.View ArticleGoogle Scholar
- van der Burgt M, Verhulst F. Doen en blijven doen. 4th ed. Houten: Springer; 2009.View ArticleGoogle Scholar
- Baker DW, Williams MV, Parker RM, Gazmararian JA, Nurss J. Development of a brief test to measure functional health literacy. Patient Educ Couns. 1999;38(1):33–42.View ArticlePubMedGoogle Scholar
- Strom JL, Egede LE. The impact of social support on outcomes in adult patients with type 2 diabetes: a systematic review. Curr Diab Rep. 2012;12(6):769–81.View ArticlePubMedPubMed CentralGoogle Scholar
- Williams GC, McGregor HA, Zeldman A, Freedman ZR, Deci EL. Testing a self-determination theory process model for promoting glycemic control through diabetes self-management. Health Psychol. 2004;23(1):58–66.View ArticlePubMedGoogle Scholar
- Williams GC, Lynch M, Glasgow RE. Computer-assisted intervention improves patient-centered diabetes care by increasing autonomy support. Health Psychol. 2007;26(6):728–34.View ArticlePubMedGoogle Scholar
- Rademakers J, Nijman J, van der Hoek L, Heijmans M, Rijken M. Measuring patient activation in The Netherlands: translation and validation of the American short form Patient Activation Measure (PAM13). BMC Public Health. 2012;12:577.View ArticlePubMedPubMed CentralGoogle Scholar
- Schreurs PJG, van de Willige G, Brosschot JF, Tellegen B, Graus GMH. De Utrechtse Copinglijst: UCL. Omgaan met problemen en gebeurtenissen. Lisse: Swets & Zeitlinger; 1993.Google Scholar
- Terluin B, van Marwijk HW, Ader HJ, de Vet HC, Penninx BW, Hermens ML, et al. The Four-Dimensional Symptom Questionnaire (4DSQ): a validation study of a multidimensional self-report questionnaire to assess distress, depression, anxiety and somatization. BMC Psychiatr. 2006;6:34.View ArticleGoogle Scholar
- Wallston KA, Wallston BS, DeVellis R. Development of the Multidimensional Health Locus of Control (MHLC) Scales. Health Educ Monogr. 1978;6(2):160–70.View ArticlePubMedGoogle Scholar
- Funch DP, Marshall JR, Gebhardt GP. Assessment of a short scale to measure social support. Soc Sci Med. 1986;23(3):337–44.View ArticlePubMedGoogle Scholar
- Salen BA, Spangfort EV, Nygren AL, Nordemar R. The Disability Rating Index: an instrument for the assessment of disability in clinical settings. J Clin Epidemiol. 1994;47(12):1423–35.View ArticlePubMedGoogle Scholar
- Kline P. The handbook of psychological testing. 2nd ed. London: Routledge; 2000.Google Scholar
- Knottnerus JA, Leffers P. The influence of referral patterns on the characteristics of diagnostic tests. J Clin Epidemiol. 1992;45(10):1143–54.View ArticlePubMedGoogle Scholar
- Schneider A, Gindner L, Tilemann L, Schermer T, Dinant GJ, Meyer FJ, et al. Diagnostic accuracy of spirometry in primary care. BMC Pulm Med. 2009;9:31.View ArticlePubMedPubMed CentralGoogle Scholar
- Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.View ArticlePubMedGoogle Scholar
- Cadogan A, McNair P, Laslett M, Hing W. Shoulder pain in primary care: diagnostic accuracy of clinical examination tests for non-traumatic acromioclavicular joint pain. BMC Musculoskelet Disord. 2013;14:156.View ArticlePubMedPubMed CentralGoogle Scholar
- Carballido J, Fourcade R, Pagliarulo A, Brenes F, Boye A, Sessa A, et al. Can benign prostatic hyperplasia be identified in the primary care setting using only simple tests? Results of the Diagnosis IMprovement in PrimAry Care Trial. Int J Clin Pract. 2011;65(9):989–96.View ArticlePubMedGoogle Scholar
- Damian AM, Jacobson SA, Hentz JG, Belden CM, Shill HA, Sabbagh MN, et al. The Montreal Cognitive Assessment and the mini-mental state examination as screening instruments for cognitive impairment: item analyses and threshold scores. Dement Geriatr Cogn Disord. 2011;31(2):126–31.View ArticlePubMedGoogle Scholar
- Schmitt N. Uses and abuses of coefficient alpha. Psychol Assess. 1996;8(4):350–3.View ArticleGoogle Scholar
- Wiebe JS, Christensen AJ. Patient adherence in chronic illness: Personality and coping in context. J Pers. 1996;64(4):815–35.View ArticlePubMedGoogle Scholar
- Gazmararian JA, Ziemer DC, Barnes C. Perception of barriers to self-care management among diabetic patients. Diabetes Educator. 2009;35(5):778–88.View ArticlePubMedGoogle Scholar
- Janssen EH, van de Ven PM, Terluin B, Verhaak PF, van Marwijk HW, Smolders M, et al. Recognition of anxiety disorders by family physicians after rigorous medical record case extraction: results of the Netherlands Study of Depression and Anxiety. Gen Hosp Psychiatry. 2012;34(5):460–7.View ArticlePubMedGoogle Scholar
- Smolders M, Laurant M, van Wamel A, Grol R, Wensing M. What determines the management of anxiety disorders and its improvement? J Eval Clin Pract. 2008;14(2):259–65.View ArticlePubMedGoogle Scholar
- Hermanns N, Caputo S, Dzida G, Khunti K, Meneghini LF, Snoek F. Screening, evaluation and management of depression in people with diabetes in primary care. Primary care diabetes. 2013;7(1):1–10.View ArticlePubMedGoogle Scholar
- Peters JB, Daudey L, Heijdra YF, Molema J, Dekhuijzen PN, Vercoulen JH. Development of a battery of instruments for detailed measurement of health status in patients with COPD in routine care: the Nijmegen Clinical Screening Instrument. Qual Life Res Int J Qual Life Asp Treat Care Rehab. 2009;18(7):901–12.View ArticleGoogle Scholar
- Eikelenboom N, van Lieshout J, Wensing M, Smeele I, Jacobs AE. Implementation of personalized self-management support using the self-management screening questionnaire SeMaS; a study protocol for a cluster randomized trial. Trials. 2013;14:336.View ArticlePubMedPubMed CentralGoogle Scholar