Assessing system-based trainings for primary care teams and quality-of-life of patients with multimorbidity in Thailand: patient and provider surveys

Abstract

Background

Strengthening primary care is considered a global strategy to address non-communicable diseases and their comorbidity. However, empirical evidence of the longer-term benefits of capacity building programmes for primary care teams contextualised for low- and middle-income countries is scanty. In Thailand, a series of system-based capacity building programmes for primary care teams have been implemented for a decade. An analysis of the relationship between these systems-based trainings in diverse settings of primary care and quantified patient outcomes was needed.

Methods

Facility-based and community-based cross-sectional surveys were used to obtain data on exposure of primary care team members to 11 existing training programmes in Thailand, and health profiles and health-related quality of life of their patients measured in EuroQol-5 Dimension (EQ-5D) scale. Using a multilevel modelling, the associations between primary care provider’s training and patient’s EQ-5D score were estimated by a generalized linear mixed model (GLMM).

Results

While exposure to training programmes varied among primary care teams nationwide, District Health Management Learning (DHML) and Contracting Unit of Primary Care (CUP) Leadership Training Programmes, which put more emphasis on bundling of competencies and contextualising of applying such competencies, were positively associated with better health-related quality of life of their multimorbid patients.

Conclusions

Our report provides systematic feedback to a decade-long investment on system-based capacity building for primary care teams in Thailand, and can be considered as new evidence on the value of human resource development in primary care systems in low- and middle-income countries. Building multiple competencies helps members of primary care teams collaboratively manage district health systems and address complex health problems in different local contexts. Coupling contextualised training with ongoing programme implementation could be a key entity to the sustainable development of primary care teams in low and middle income countries which can then be a leverage for improving patients outcomes.

Background

Multimorbidity, the co-existence of more than one chronic condition in one person, has increasingly posed a major challenge to existing models of healthcare delivery. In fact, multimorbidity in low- and middle-income countries (LMICs) is more complex than that of high-income countries as it usually combines non-communicable diseases (NCDs), infectious chronic diseases, and injuries [1]. To cope with such difficulties, the current healthcare delivery models in LMICs need to be shifted towards primary care models that can provide first contact and continuous, coordinated, and comprehensive care for individuals and families [2].

Literature also suggests human resource development for primary care in LMICs should be contextualised to their settings, and that primary care practice should be redesigned to tackle the challenge of NCDs in resource-limited countries by focusing more on patients and communities, integration of services, innovative service delivery, and adoption of new technologies for communication [3, 4]. Yet many agencies have paid substantial attention to strengthening primary care in LMICs they tend to have focused only on traditional health threats, such as infectious diseases and maternal and child health [3].

In Thailand, primary health care has long been a focus of national healthcare reforms [5], and has gradually transformed towards a more comprehensive, integrated, people-centred health services [6, 7]. The country is recognised as a ‘trailblazer’ amongst LMICs in achieving successful implementation of universal health coverage (UHC) [8, 9]. Thailand’s UHC is not considered the ‘big bang’ reform, but rather a result of successive governmental investments on financial risk protection and improving coverage of health services via a series of incremental changes since 1970s—spearheading by continuous development of health care infrastructure and workforce [10]. Currently, more than 98% of the Thai population are covered by one of the three financial risk protection schemes: the Civil Servant Medical Benefit Scheme (CSMBS) provides cover for civil servants and their dependents (9%); the Social Health Insurance (SHI) provides cover for private sector employees (15%), and the Universal Coverage Scheme (UCS) provides cover for those not enrolled in either CSMBS or SHI schemes (75%) [11]. Among the three schemes, the UCS put the greatest emphasis on primary care development, as its primary care networks were given greater control of financial resources to developing community-based health facilities that provide integrated medical and public health services and its beneficiaries are entitled to free outpatient and inpatient services at their registered state-run health facilities within local networks of District Health System (DHS) [12].

Thailand is self-reliant as regards its healthcare workforce production and recognises the gaps in workforce density especially within the primary care workforce. Thailand has a limited number of physicians per population with approximately 36,000 physicians in the total workforce serving a population of over 62 million [13], thus the provision of primary care in most DHSs of Thailand has relied heavily on a non-physician workforce like many other LMICs [14]. To combat these gaps Thailand has chosen to adopt a “task shifting” strategy as a long-term approach to training health workers to work in primary care settings [13]. However, instead of using oversea resource as often happens in many LMICs Thailand’s capacity building programmes for primary care teams (PCT) were implemented by local experts and local financing mechanisms [12, 15]. Since 2006, a series of 11 training programmes for multidisciplinary PCTs have been implemented nationwide, aiming to prepare the workforce to cope, both with the rapidly growing demand for healthcare due to increased access post implementation of the UHC policy in 2002, and to manage the country’s epidemiological transition from infectious to chronic non-communicable disease (NCDs) and an aging population [15] (Table 5 in Appendix).

The direction of these system-based training programs was unified towards building knowledge and skills in providing integrated care at the district level for all UCS beneficiaries, under the governance of the National Health Security Office (NHSO) as shown on Fig. 1 although the contents and scope varied.

Fig. 1

Structures and functions for the provision of integrated primary care under the Universal Coverage Scheme (USC) at the district level of Thailand

Several training programmes, namely “District Health Management Learning (DHML)” and “Contracting Unit of Primary Care (CUP) Leadership Training”, focused on bundling of competencies for managing integrated primary care systems, including resource sharing, community participation and inter-sectoral collaboration, health information systems, management skills of the leaders, coordination and unity of teamwork, and integrated service delivery. Some programmes, such as the “Family Practice Learning (FPL)” and the “District Health Systems (DHS) Appreciation Training” had a narrower scope focusing primarily on managing ambulatory care in the district hospitals or on self-assessment of PCTs respectively. Other programmes were based on community health programmes, but not directly related to skills for primary care practices. For all programme mobilization of community health volunteers as well as local funds were considered a major focus.

Similar to primary care in other LMICs, there has been limited systematic assessment of the effects of these capacity building programmes on health outcomes both in Thailand and in other LMICs. A systematic review of mental health training for primary care workers and community health workers in Africa showed that most studies had methodological limitations, particularly with respect to the absence of controlled evaluations and use of short-term assessments and most focused on knowledge and attitude, with only one assessing patient outcomes [16]. Given that strategies of each training programmes are heterogeneous, empirical analyses that can reveal the impacts of these contextualised training programmes in diverse primary care settings of Thailand on health outcomes of multimorbid patients are needed. We investigated the relationship between exposure of PCTs to systems-based capacity building programmes in Thailand and health-related quality of life of their patients with multimorbidity.

Methods

The present study employed a multilevel, cross-sectional analysis of individual patients with multimorbidity and of the PCT trainings, clustered in the districts of eight selected provinces in three geographical regions of Thailand. Because the training programmes were embedded in multifaceted national policy interventions, patient outcomes might have been impacted by multiple factors, including selection bias and other changes due to history, maturation, secular trends or other endogenous change. Multilevel modelling enabled us to explore the relationships between the patient outcomes and the exposure to system-based training programmes of their primary care providers, and is considered an optimal approach to tease out the programme effects of such training programmes on the patient outcomes [17, 18].

Two parallel-hierarchical, cross-sectional surveys were conducted during October 2015—a patient survey enquiring about their health profiles and their experience of utilising primary care in local communities, and a survey of PCTs exposure to various training programmes and their work experience. Sample size was calculated for the patient level and the provider level, with statistical power dependent on the design effect and the total sample size for each level [19].

Sample size for PCT survey was calculated with sufficient number of participants to identify approximately 25% of PCT members previously exposed to system-based training programmes (n = 1.96² x (P)(1-P)/d² where d = 0.05), and the estimated sample size for PCT members was 288. Sample size for the patient survey was calculated to identify the multimorbid Thai patients with an average EQ-5D score of 65 (± S.D. of 46) [20]. The sample size calculation for patients took into the account of the design effect of 6.5 (n = (1.96² x σ²/ (E²)) x DE, where σ =46, E = margin of error of 5, DE = design Effect as determined by (1+ (m-1) x ICC), where m = number of sites of 24, ICC = intraclass correlation coefficient of 0.25, and thus the estimated sample size for patient’s survey was 2113.

A multi-stage, clustered sampling was used to conduct our survey of patient’s health profiles and their experiences of utilising primary care. The three most populated regions of the country (northeast, central, south) were selected to participate in the study, excluding the regions which the top executives did not allow their PCTs to participate in our survey. Within each of these three regions, two to three provinces were chosen with the size of population of those provinces being proportional to size of the population in each region. In each province, the most urban district and two adjacent rural districts were selected, based on the number of training programmes that the PCTs in each district were exposed to (Table 6 in Appendix). As a result, 24 districts in eight provinces were selected.

Ethical approval was obtained prior to data collection from the Institutional Ethical Review Board of the Faculty of Medicine Ramathibodi Hospital, Mahidol University.

Selection of patients

In accordance with UCS policy, the population in each sub-district are enrolled at local health centres, which serve as their primary care organisation [10]. In each health centre, patients with multimorbidity are categorised within the patient registry into four groups: the chronically ill, the elderly, the disabled, and the terminally ill. Although these four groups were not mutually-exclusive by nature, each patient was registered by only the most severe condition in terms of functional limitations. Hence, these four groups were administratively considered mutually-exclusive, enabled for selection via random sampling of multimorbid patients from each group.

Due to the small size within the category of the terminally ill, the patients who are in dying processes defined as the last minutes or days of life when death is obviously imminent [21], were used as index cases to start with. Then, the patients from other three groups who resided in the same community were selected by simple random sampling, with the number of samples in each group proportional to the size of the corresponding patient group in the community. The average number of sampled patients per each primary care organization were six terminally ill, eleven disabled, eight elderly persons with functional limitations, and 53 chronically ill patients.

Selection of PCT team members

All the members of PCT health personnel of each team were invited to participate in the survey. The average number of members was 10 persons per team, with a range of eight to 12 persons per team, and the average number of members who participated was nine persons.

Data from the patient survey

Data were obtained from patients by face-to-face interviews during household visits, using a standard set of questions for assessment of HRQoL. In addition, a cognitive assessment tool and a questionnaire assessing patient’s health profiles and experiences with utilising health services were also conducted.

The HRQoL questionnaire consisted of one page of the Thai version of the EuroQol-5 Dimensions (EQ-5D), a generic instrument widely used for describing health outcomes and already was validated in the Thai population [22, 23]. The five dimensions of impairment are mobility, self-care, usual daily activities, pain or discomfort, anxiety or depression. Each dimension is measured in 5-Likert scale from no impairment to extreme impairment. It took five to 7 minutes to administer the face-to-face test by a trained nurse (Additional file 1).

The Thai version of Rowland Universal Dementia Assessment Scale (RUDAS-Thai) [24] was used to predict the performance of patients on tests of verbal learning, executive function, working memory, visuospatial function, and motor function. We used this cognitive assessment tool to rule out patients with impaired cognitive functions that might compromise the validity and the reliability of their responses to our patient survey. It took eight to 10 minutes to administer the face-to-face test by a trained nurse. A cut-off point of 25 or less was used to maximize sensitivity of the screening test. The questions for patients, caregivers and stakeholders are shown on the Additional file 1.

Data from the PCT survey

A self-administered questionnaire was distributed to all members of the PCTs in the selected community hospitals and health centres in the selected 24 districts. This self-administered standard questionnaire comprised exposure to training on specific topics and further training needs, as well as other items including team structure and functions, channels and frequency of communication among team members, experience of working within a PCT, and work experiences. A total of 11 training programmes were identified from reviewing governmental documents, and all included in the questionnaire. The questions for leaders and members of primary care team are shown on the Additional files 2 and 3.

Data analysis

Due to the hierarchical structure of our data, a multilevel analysis was used to consider the patient data (level 1) nested within the PCT data (level 2). Districts were grouped into provinces in order to achieve the power of test and to reflect a more realistic contextual effect on the trainings at provincial level. The percentage of exposure by each type of PCT member was estimated. Variance of exposure to the programmes by each type of PCT member was also estimated. Multi-level modelling was used to distinguish between the effects of training-programme on PCTs and the effects of trained PCTs on patients. The association between EQ-5D score and selected predictor variables (morbidity, regularly visited healthcare facility, age, sex) were tested using a generalized linear mixed model (GLMM) [25].

The multilevel analysis of GLMM began with a two-level null (empty) model with no predictor variables in the fixed part, and only the intercepts in the random part of the model (M1). This model was used as a reference for comparing the size of contextual (province) variations in EQ-5D scores in subsequent models. The next model (M2) included patient-level variables as the fixed effects only. Finally, the explanatory variables at the patient level and provincial level were added as fixed effects resulting in the best model fit (M3).

The variance partition coefficients at each level were calculated using the restricted maximum likelihood. The random part results of the null model (M1) are reported together with the corresponding intra-class correlations at the district level. Variance partition coefficients with corresponding two-sided 95% confidence intervals (CI) are provided. The significance level was set to 5% (two-sided). All statistical analyses were carried out using Statistical Package for the Social Science for Windows (SPSS) version 18.0 (SPSS Inc., Chicago, IL, USA), with the exception of the multilevel analysis that was conducted by using the procedure “mixed” in Stata statistical software version 10 (Stata Corp, College Station TX, USA).

Results

The patient outcomes (level 1)

A total number of 1916 participated in our cross-sectional survey (88.9%). Approximately two thirds (62.8%) of patient samples self-completed the survey, whilst just over a third (37.2%) responded by their care givers as the proxy respondents due to cognitive impairment of the patients, as measured by our cognitive assessment tool. Mean age was 67.5 years and 60% were female. Almost 90% lived with multimorbidity and 63% were terminally ill. Table 1 details their health profiles and other attributes, including residential provinces and type of healthcare facilities they regularly visited.

Table 1 Patients’ health profiles and other attributes (N = 1874^a)

Mean EQ-5D score of our patient samples was 69 (± S.D. of 42). To provide a global impression, the percentage of patient samples reporting HRQoL being compromised from moderate to severe degree, according to the EQ-5D measure, is summarized in Table 2. Mobility was the most reported dimension of diminished quality of life (44% of respondents).

Table 2 Percentage of patients reported quality of life being compromised from moderate to severe degree according to EQ-5D (N = 1874^a)

As shown on Table 3, the association between the EQ-5D score and selected predictor variables (morbidity, age, sex, regularly visited healthcare facility) were tested by using GLMM. Although both single morbidity and multimorbidity were inversely associated with the QoL, only the association between single morbidity and the QoL was statistically significant (p = 0.033).

Table 3 Parameter estimates of GLMM (level 1) with EQ-5D scores as dependent variable adjusted for patients’ age, sex, and regularly visited healthcare facilities (N = 1874^c)

The PCT outcomes (level 2)

A total of 218 PCT members responsible for patients living in the selected districts participated in our survey. Amongst all professions in the PCTs, the highest percent of participants were nurses (29.8%), physiotherapists (16.5%) and community health volunteers (16.5%). The average proportion of PCT members reportedly exposed to each system-based training programmes was 26.3% among all PCT members. The majority of PCTs (88%) in the selected districts were exposed to less than five training programmes from the total of 12 programmes. Percentage of exposure to the selected training programmes among PCT members varied, with the most limited exposure (6.42%) being to the training on CUP Leadership and the most frequent exposure (76.15%) being to the training on DHML. The distribution of PCT exposure to selected training programmes shown in detail on Table 7 in Appendix.

Among 11 identified training programmes, only four were included in the final regression model: DHML, DHS Appreciation, CUP Leadership, and FPL. Programmes with low uptake by PCT members or deemed by the research team to have content less relevant to capacity building were excluded. Results of multilevel analysis on PCT, detailed on Table 4, show that HRQoL were associated to the PCT exposure to three training programmes: DHML, CUP Leadership and FLP. However, associations between the three training programmes and patient’s HRQoL were not consistently positive, as FPL was negatively associated with patient’s HRQoL. Additionally, the duration of time spent working within the PCT was also slightly negatively associated with EQ-5D score of their patients.

Table 4 Parameter estimates of the final GLMM (the multilevel model) with EQ-5D score as dependent variable (N = 1865^a)

Discussion

Our study provides an assessment of training programmes for PCTs that are closely-linked with domestic funding and national policies—with all programmes being embedded in multifaceted national policy interventions and implemented in overlapping periods during the past decade. Amid the deficiency of systematic, quantitative assessment of these training programmes, this report provides preliminary findings on how contextualized training programmes potentially impact the performance of PCTs taking care of patients with multimorbidity. This report provides new evidence on mobilising system-based approaches to human resource development of primary care systems in LMICs. Policy interventions supporting better trained PCTs must be prioritised, as they are vital to sustainable development goals and UHC in LMICs [26].

Our findings demonstrated that patient outcomes were positively associated with PCT exposure to training with a focus on bundling of competencies and contextualization—the DHML Programme addressed how PCTs should be continuously learning and providing relevant health services to their patients under the dynamic primary care contexts, and the CUP Leadership Programme enhanced the conceptual and managerial skills of hospital directors, who controlled healthcare resources of each DHS according to the purchasing model of UCS [10], in development of area-based primary care delivery systems. These competencies are consistent with existing evidence of effective “systems interventions” following the concepts of Wagner’s Chronic Care Model (CCM) [27,28,29].

In contrast, we found that programmes which demonstrated no relationship with patient outcomes had a narrow scope, as in the case of the FPL Programme. The relatively isolated training in the hospital settings of the FPL did not address the training needs of public health workers who were delegated to take care of patients with chronic conditions at health centres—a primary care setting that serves a significant share of patients (25.4%) of DHSs. In the case of the DHS Appreciation Programme, there was insufficient power to assess fully due to low coverage as where only 48/928 districts (5.2%) had access and it was only available for 1 year.

A slightly negative association between the duration of each health worker working in PCTs and their patient’s HRQoL was rather surprising. One possible explanation could be the high workload and the lack of health workforce management staff leading to health care personnel experiencing burnout, increased levels of stress or work disengagement, which in turn could be linked to undesirable patient outcomes [10]. Further studies are needed to explore if this explanation is valid, and which policies could have prevented this phenomenon.

As our findings were drawn from more than one capacity building programmes being implemented in overlapping periods over years, a timely assessment could have helped policymakers reallocating resources across programmes more effectively. Further investigation is needed for a better understanding of why each programme demonstrated different relationship with patient outcomes. Moreover, if more systematic, long-term impact monitoring and evaluation were put in place, it can help to start conversations and raise more questions of what the priorities are in Thailand’s primary care development, and which then need to be researched furthermore.

Lessons learned from these capacity building programmes for PCTs in Thailand can be applied in other LMICs, too. For instance, in African countries where developing sustainable family medicine training programmes is found to be feasible but slow to progress due to many obstacles such as lack of role models [30], adequate support from key figures at policy level and academic institutes for system-based capacity build is warranted. Using Thailand as example, finding sustainable sources of financing for such training programmes should be a major concern, as sustainability of primary care development is at risk when the countries rely only on partnerships, international financial supports and expertise from overseas.

This empirical study also contributes to a growing body of the literature that suggests human resource development for primary care in LMICs should be contextualised to their resource-limited settings. Communities are the critical entry points for prevention and control of NCDs, and experimental studies have shown that community leaders, civil society organizations, churches, and women’s groups are well positioned to raise awareness of NCDs and the importance of healthy lifestyles [31]. In Brazil, primary care encompasses health services delivered by physicians and community health workers, and task shifting from physicians to other health workers in a country with physician shortage is associated with good results at a low cost of treatments for complex patients, such as patients living with HIV/AIDS [2]. A longitudinal data analysis also demonstrated this model of primary care significantly contributed to mortality reduction from heart and cerebrovascular diseases [32].

Positive findings from our study in Thailand are consistent with a recent meta-analysis of 36 studies from developed countries, which revealed a possibly increased effectiveness of case management delivered by multidisciplinary primary care teams (PCTs) that including social workers for elderly with multimorbidity [33]. Capacity building of such high-performing PCTs has been highlighted by multiple components of specific team goals with measurable outcomes, detailed clinical and administrative systems, clear division of labour, a permanent training environment, and agreed-upon modes of communication within the team [34]. As evident by systematic reviews of chronic disease management in primary care settings, multi-component interventions including team-based training seem to be more effective than either standalone primary care interventions or standalone training of PCTs [35,36,37].

Limitations of this study include that although using EQ-5D score as the standardized measurement for patient outcomes make sense in our analysis of multimorbid patients whose HRQoL usually decreased at all level of comorbidity, previous studies indicate that the cumulative effect of chronic health conditions is not simply incremental—the consequences of specific disease combinations may have a greater effect on functional status, quality of life and mortality than others [22, 38]. With a limited sample size for patients who had more than one morbidity, we were not able to demonstrate the gradient of association as expected, and therefore further studies are needed.

Conclusion and recommendations

Our report provides new evidence on a long-term approach to system-based trainings of PCTs amidst the rising challenges of aging, NCDs and associated multimorbidity in resource-limited settings of LMICs. The strengths of our study include applying a generalized linear mixed model to assess a multilevel association of the predictor variables and the standardized measure of patient’s quality of life. The multilevel analysis revealed a positive relationship between system-based trainings and patient outcomes in diverse settings of Thailand’s primary care for programmes with an emphasis on bundling of competencies for managing complex health problems in different local contexts are associated with desirable patient outcomes.

Our findings should be considered preliminary given the limitations of cross-sectional design to demonstrate causal relationship, limited sample size for specific groups of patients with more than one morbidity. Non-random sample selection may compromise external validity of the findings, while cross-sectional design of our study is inadequate to prove a causal relationship as other confounders such as disease duration or socio-economic status of the patients are not included. Despite a high response rate of our patient survey, potential non-response bias still can be made. The limitations of sample size given the multiple analyses should also be considered. Further studies would be needed to fill the gaps, for instance, by using a cohort study that takes into the account of multilevel factors.

Nonetheless, our study can be considered a “proof of concept” that the effective capacity building programmes for primary care in LMICs are beyond developing only clinical skills, and that trainings in isolation of programme implementation is not enough. It can help policymakers looking in a greater depth of monitoring and evaluation of existing capacity building programmes for PCTs and considering removing resources from programmes that show no positive relationship with patients’ health outcomes, and thus freeing up resources to spend on more functioning ones. Coupling contextualized training by bundling of competencies with an ongoing programme implementation and evaluation may be the key to the sustainable development of primary care providers in developing countries.

Appendix

Table 5 List of training programs relevant to primary care

Table 6 Number of individual patient samples (N) distributed by district with the number of previous exposure to training programs

Table 7 Percentage of each type of members in primary care team exposed to selected training programs included in the final multilevel model (N = 218)