Feasibility of an implementation strategy for the integration of health promotion in routine primary care: a quantitative process evaluation
© The Author(s). 2017
Received: 26 April 2016
Accepted: 19 January 2017
Published: 17 February 2017
Process evaluation is recommended to improve the understanding of underlying mechanisms related to clinicians, patients, context and intervention delivery that may impact on trial or program results, feasibility and transferability to practice. The aim of this study was to assess the feasibility of the Prescribe Healthy Life (PVS from the Spanish “Prescribe Vida Saludable”) implementation strategy for enhancing the adoption and implementation of an evidence-based health promotion intervention in primary health care.
A descriptive study of 2-year implementation indicators for the PVS clinical intervention was conducted in four primary health care centers. A multifaceted collaborative modeling implementation strategy was developed to enhance the integration of a clinical intervention to promote healthy lifestyles into clinical practice. Process indicators were assessed for intervention reach, adoption, implementation, sustainability and their variability at center, practice, and patient levels.
Mean rates of adoption by means of active collaboration among the three main professional categories (family physicians, nurses and administrative personnel) were 75% in all centers. Just over half of the patients that attended (n = 11650; 51.9%) were reached in terms of having their lifestyle habits assessed, while more than a third (33.7%; n = 7433) and almost 10% (n = 2175) received advice or a printed prescription for at least one lifestyle change, respectively. Only 3.7% of the target population received a repeat prescription. These process indicators significantly (p < 0.001) varied by center, lifestyle habit and patient characteristics. Sustainability of intervention components changed thorough the implementation period within centers.
The implementation strategy used showed moderate-to-good performance on process indicators related to adoption, reach, and implementation of the evidence-based healthy lifestyle promotion intervention in the context of routine primary care.
Sources of heterogeneity and instability in these indicators may improve our understanding of factors required to attain adequate program adoption and implementation through improved implementation strategies.
KeywordsProcess evaluation Implementation Health promotion Primary Health Care
In the growing field of implementation research, the process of implementation of interventions is considered important in determining how to enhance their effectiveness, feasibility and sustainability [1, 2]. Further, the development, implementation and evaluation of complex health interventions all require careful consideration not only of outcomes obtained but also of the processes involved . Process evaluations within trials explore the implementation, receipt and setting of an intervention, and help interpret the outcome results and ascertain the true implications of interventions in real practice [4, 5]. Further, this type of evaluation is particularly important in multisite trials, where the “same” intervention may be implemented and received in different ways, and consequently, may make it possible to assess fidelity and to monitor tolerable intervention doses and their variability. A better understanding of program implementation may also reveal opportunities for refining intervention content and delivery . Lastly, process evaluation of intervention trials may inform future implementation and roll-out of the intervention in other contexts and settings, and indicate how interventions could move from research to practice [3, 5, 6].
The Prescribe Healthy Life (PVS from the Spanish “Prescribe Vida Saludable”) strategy aims to optimize health promotion practice in primary and community care through implementation research . Though no clinical intervention has a greater potential impact on public health than the promotion of healthy lifestyles, it remains far from being an integrated element of clinical practice, and hence, health promotion in primary care is an excellent example of the so-called “translational gap”.
PVS follows a stepwise framework, appropriate for the design, evaluation and translation of complex interventions in clinical settings [3, 8]. In 2006, a preclinical phase was carried out to characterize the problem of health promotion integration, analyzing the causes of and barriers to change as well as the theoretical basis for developing solutions . Then, in 2008, we conducted the phase I or modeling phase, in which four primary health care (PHC) centers, following an implementation strategy based on a collaborative and facilitated process , planned and designed intervention programs adapted to their specific contexts and resources, and identified strategies for change and mechanisms through which interventions should operate. This was done collaboratively among health care professionals, researchers, health service management, community workers and public health professionals. In the present paper, we describe the phase II pilot study conducted in the same four PHC centers with the goal of piloting and optimizing the previously designed intervention programs and their assessment procedures, and exploring the adoption, implementation, sustainability, acceptance and potential effectiveness and efficiency of the intervention programs.
The aim of the process evaluation reported in this paper was to assess the feasibility of the PVS implementation strategy for integrating healthy lifestyle promotion in PHC. Within the present study, feasibility concerns to the extent, likelihood, and manner in which an evidence-based health promotion intervention has been implemented as a direct result of performing an implementation strategy aimed at enhancing the adoption of the intervention . Specifically, we describe PHC population-based indicators of the reach, adoption, implementation and sustainability of a healthy lifestyle promotion intervention in the context of routine primary care, and their variability at center, practice, and patient levels. We also identify socio-demographic and clinical characteristics associated with exposure to the intervention.
Study design and setting
A descriptive study of 2-year implementation indicators for the PVS clinical intervention was conducted in four PHC centers. The study protocol was approved by the Primary Care Research Committee of the Basque Health Service, Osakidetza, and by the Basque Country Clinical Research Ethics Committee (Ref: 6/2009). Our health service provides universal coverage that is free at the point of use, apart from co-payment for drugs, funded through regional general taxation. Each resident is included on the list of one practice under the care of a family physician or a pediatrician and a primary care nurse, who offer comprehensive primary care and access to hospital services. Primary care professionals work in full-time PHC teams at local centers providing health care for users in a defined geographical area.
PHC centers and their staff, as the initiative seeks to improve health promotion practice through the mutual adaptation of evidence-based interventions and the center’s organization; and
primary care patients attending these health centers that fail to adhere to at least one of the following lifestyle recommendations: regular physical activity, healthy diet and abstinence from smoking.
Eligible centers were identified through the Medical Directors of the seven primary care organizations into which PHC is structured in the Basque Health System. Of the seven organizations, four agreed to collaborate and each selected one PHC center with the following eligibility criteria: (i) previous involvement in innovative health promotion programs or preventive practice optimization initiatives, (ii) the existence of community health promotion initiatives in their geographical area of influence, (iii) the presence of a positive attitude and cooperation among professionals, and (iv) the possibility of making changes in the organization of services. After explaining the study objectives and work plan in a meeting in each candidate center, we requested individual written commitment by a majority plus one of the staff in each of professional category (administrative personnel, nurses, family physicians, pediatricians, and others). The minimum required number of staff was obtained for all categories in all four centers. Health care professionals that committed to participate also gave written consent for the anonymous management and publication of data pertaining both to patients assigned to their practices and indicators related to their health care delivery activity.
As public health programs, the PVS intervention programs aim to have an impact at the whole population level. Hence, their target population was all PHC users aged 10 to 65 years old registered with any of the collaborating PHC clinicians in any of the collaborating centers that attended the center during the program implementation period (from September 2011 to September 2013). We excluded patients who moved, those diagnosed with psychotic disorders, neurological degenerative diseases, or severe mental retardation, and those in residential care or with terminal illnesses.
The PVS clinical intervention targets three key aspects of a healthy lifestyle, namely, regular physical activity, a healthy diet and abstinence from smoking. The intervention is grounded in evidence-based theoretical models explaining behavior change: the Health Belief Model, the Theory of Planned Behaviour, the Transtheoretical model and Social-Cognitive Theory . The multiple active intervention components and strategies are structured following the 5 A’s (Ask, Advise, Agree, Assist, and Arrange follow-up) intervention framework , as it encompasses most of the evidence-based behavior modification techniques used to promote changes in the targeted lifestyles. It is considered that this strategy is useful in primary care for its simplicity, and low requirements for training and time, as well as for the scientific evidence supporting its effectiveness [7, 11–15].
The PVS implementation strategy worked at multiple levels: bottom-up primary care organizational change, top-down support from managers, community involvement, and the development of innovative e-health information and communication technologies . Among the multiple specific implementation strategies used, three are directly related to the present study.
First, with the aim of adapting the clinical intervention to the context of each center where it was to be implemented and to redesign the health promotion delivery system, an action research-based collaborative modeling process was conducted in each of the centers with the active participation of PHC professionals and managers as well as researchers. Through a bottom-up decision making process based on discussion and consensus meetings among a multi-professional primary care team and community members guided by an external facilitator, staff in each center modeled and adapted the clinical intervention to their specific contexts and resources, and identified strategies for change, and mechanisms through which the interventions would operate. Between 10 and 13 working sessions were needed involving most of the primary care staff and at least one community-based organization. The process yielded multiple tailored healthy lifestyle intervention programs, varying between centers in the agents involved in each of the intervention actions as well as in the resources for their implementation and execution. Generally, within the collaborating PHC centers, administrative assistants, nurses and physicians were all involved in the PVS program but to different degrees. All professional categories were somewhat involved in the Assess step (A1), with considerable participation of administrative staff in order to perform the assessment before the medical consultation. Outside the center, individuals were themselves able to perform the assessment of healthy lifestyles through the PVS web questionnaire or a paper-based version of the same questionnaire delivered at community resources (e.g., company occupational health departments). The Advice and Agree steps (A2 and A3) were mainly delivered by family physicians, while the Assist step (A4) was mainly performed by nurses. All participants inside and outside the centers were involved in the Arrange follow-up (A5) process with particular involvement of administrative assistants and nurses. Based on reports by a sample of 32 professionals over 3 months of intervention piloting, the estimated mean time dedicated to each intervention component was 3, 7.84 and 13.67 min for assessing patient lifestyle (A1), and advising on (A2) and prescribing (A4) lifestyle change, respectively.
Second, an information and communication tool integrated in the electronic health record was developed in order to help and guide practitioners’ clinical decision making related to diagnosis and therapeutic interventions in promoting healthy lifestyles. The functions of this software are the following: a) to identify people whose lifestyle habits have not been assessed and recorded; b) to assess patients’ physical activity levels, diet, and smoking habits, complemented by paper-based questionnaires and a self-assessment website, c) to flag those not adhering to the recommendations; d) to identify high-priority populations for intervention based on data recorded in the electronic health records, e.g., age, motivation to change behavior, and chronic diseases; e) to guide health professionals in providing personalized and tailored advice based on effective communication of risks and benefits associated with lifestyle; f) to facilitate the prescription of plans for lifestyle modification, providing algorithms, evidence-based guidance and recommendations, warnings, timetables and information about community resources; f) to facilitate patient monitoring thorough the follow-up; and g) to integrate all the information and make it available to all staff of the center, thereby making it easier to track patients.
And lastly, there were audit and feedback strategies in the form of monthly tracking of process indicators related to patient reach and extent of implementation of intervention components. This auditing and feedback sought to maintain fidelity and intensity once initial implementation had been achieved.
Process indicators pertaining to program execution and user socio-demographic (age, sex, socioeconomic status) and clinical (chronic health problems) characteristics were calculated from routine data extracted from the electronic health records of Osakidetza. The Primary Care Research Unit of Bizkaia (UIAPB) in conjunction with the Informatics Department of Osakidetza were responsible for the coordination and quality control of the process and execution of the study. This research unit is expressly authorized to retrieve and use data from the electronic health records for research by the owner thereof, namely, the Governing Board of Osakidetza. The data were kept confidential, anonymized, encrypted and managed centrally, in accordance with the Spanish laws on data protection and patient autonomy.
Specifically, within the program, healthy lifestyles were assessed with the 10-item PVS-Healthy Lifestyle Screening questionnaire. Briefly, content validity of this screening questionnaire was supported by an expert panel. Further, we conducted a pilot concurrent validity study in a sample of 126 patients. Firstly, we found that the physical activity screening items were acceptably correlated with total activity counts (r = 0.46; p < 0.001) and minutes of moderate-to-vigorous activity (r = 0.34; p < 0.001) measured with an ActiGraph GT3X accelerometer. Secondly, the two items used to screen fruit and vegetable consumption were well correlated with the total (r = 0.50; p < 0.001) score on a modified version of the Mediterranean Diet Adherence Screener used in the PREDIMED study  and with the specific items regarding fruit and vegetable consumption (r = 0.54; p < 0.001) on the PREDIMED Food Frequency Questionnaire . Thirdly, the responses obtained in the tobacco use sub-scale showed a strong correlation with the level of carbon monoxide in exhaled air (CO in ppm) measured with a breath CO monitor (r = 0.69, p < 0.001) (data not published).
Using data extracted from health records for a 4-year period, we assessed whether each of the patients had any of nine groups of chronic diseases and also checked a list of 52 conditions and specific criteria defined for each condition to consider it active, based on the work of Orueta et al. . For the purposes of this study, multimorbidity was defined as the coexistence of more than one health problem in the same patient considering these 52 conditions.
A Deprivation Index (DI), defined by census tract, developed and published in 2008  was used as a socioeconomic status indicator. This index is an ordinal variable, categorized into five levels (DI quintiles), providing a measure of the socioeconomic characteristics of the population of census tracts. Its design allows the estimation of socioeconomic and environmental inequalities among inhabitants by census tract in Spain. The calculation takes into account the percentages of residents in a tract who are manual workers, unemployed, temporary employees, or have an poor level of educational attainment, overall and also specifically among young people, according to the most recent census data available (2001).
To assess the effectiveness of the PVS programs in terms of public health significance we used the RE-AIM (Reach, Efficacy, Adoption, Implementation, Maintenance) framework . This framework underlines that to have a public health impact programs require more than efficacy. They must reach a diverse and representative sample of the at-risk population. Their adoption in specific practice/clinical settings must be realistic. Further, programs must be able to be implemented as intended. Lastly, they must also be maintained over time in a sustainable way by the individual and the practice/clinical setting. These dimensions together determine the overall impact of a program at the population level. Specifically, the process indicators assessed within the RE-AIM dimensions are:
Reach (Patient level)
Exposure of patients to the program at each center in terms of the percentage of the target population (patients 10 to 65 years old who attended the center at least once during the program implementation period) who had their lifestyle habits assessed, and consequently were exposed to the program.
Adoption (Practice/Center level)
Professional participation in the program: the percentage of professionals by professional category and percentage of practices (multidisciplinary health care professionals with an assigned list of patients, e.g., family physician plus nurse) in each center participating in the program who had performed at least one intervention component.
Implementation (Practice/Center level)
The percentage of practices that assessed at least 50% of their target population, gave advice to 25% and prescribed lifestyle change with a personalized plan to 10%.
Implementation (Patient level)
Reception of intervention components as intended in terms of the percentage of target patients whose lifestyle habits were assessed and included because they failed to adhere to at least one healthy lifestyle recommendation (I1: Included); the percentages of target patients (I2a: Advised-target) and included patients (I2b: Advised-included) who received advice; the percentages of target patients (I3a: Assisted-target), included patients (I3b: Assisted-included), and advised patients (I3c: Assisted-advised) who received a prescription for lifestyle change; and the percentages of target patients (I4a: Arranged-target), included patients (I4b: Arranged-included), and prescribed patients (I4c: Arranged-prescribed) who received a repeat prescription related to the same aspect of their lifestyle.
Sustainability of intervention program components over time in terms of the monthly rates of the aforementioned process indicators over 2 years.
Lastly, we also explored the association of patient socio-demographic and clinical characteristics with the likelihood of being assessed, advised or prescribed lifestyle changes.
Data analysis was performed with SAS software. Frequencies and proportions were used to describe professional, practice and patient characteristics for continuous and categorical variables, respectively. Process indicators for each collaborating center and in total regarding adoption, reach and implementation were expressed as frequencies and percentages along with their corresponding 95% confidence intervals (CIs). Survival analysis was used to describe sustainability and compare the incidence of exposure to the intervention components (time until exposure to lifestyle assessment, advice, and prescription for lifestyle change) between the different centers. For univariate analysis of the association of time until exposure to the different intervention components with the comparison centers, cumulative survival probabilities over 24 months were estimated and compared using Kaplan-Meier curves along with the log-rank and Wilcoxon tests (SAS PROC LIFETEST, version 9.2, SAS Institute; 2008). Time to event or censoring was defined as the time between study entry (date of baseline interview) and date of exposure to the specific intervention component, or possible censoring at the end of the study (September 19, 2013), respectively.
Adjusted hazard ratios (AHRs) and 95% CIs describing relations between patient characteristics and the exposure to the intervention components were estimated using Cox proportional hazards models . These models included health care center, sex, age, recorded chronic diseases, and the deprivation index as independent factors. The proportional hazard assumption was tested, introducing the interaction of each of the variables with time in the models. In the case of covariates for which the proportional hazard assumption was not satisfied, the Cox model was extended with time-dependent variables allowing hazard ratios to change over time.
Practitioner team level (Center/professional level)
Adoption, Implementation & Maintenance
Professional and practice level participation, and patient demographic and clinical characteristics, by center
Assessed (A1) 50% of target patients
Advised (A2) 25% of target patients
Assisted (A4) 10% of target patients
Mental health problema
No chronic health problems
Failure to adhere to ≥1 lifestyle recommendation
Insufficient physical activity
Insufficient fruit and vegetable consumption
Implementation of program components also varied between practices and centers. Specifically, rates of participation of practices in the execution of program components were not similar, except in one of the centers in which all teams collaborated and worked equally well. Overall, only 48% of practices assessed the lifestyles of 50% of all target patients that attended the center at least once during the program implementation period. Within centers, this rate of assessment was achieved by half or more than half of practices in three of the centers. However, only in two of the centers did half or more than half of collaborating practices reach levels of 25% or 10% of target patients being advised or prescribed lifestyle changes, respectively.
Reach, Implementation & Maintenance
A total sample of 22459 target patients aged 10 to 65 years old assigned to collaborating practices attended their PHC center at least once during program implementation period. As presented in Table 1, overall, half of the target patients were male (50.6%) and more than a half (55.2%) were young adults 20 to 45 years of age, with 37.9% and 7% of target patients being adults and adolescents, respectively. Approximately 40% of target patients had at least one chronic condition. The most prevalent diagnosed chronic health problems were mental health problems (16.2%) followed by cardiovascular (12.8%) and metabolism- related (7.8%) diseases.
Within centers, a higher percentage of women were present in the sample in center 2, and the age distribution of primary care users was slightly older in center 1. The most distinct characteristic of the populations was socioeconomic status (Table 1), with one of the centers having the vast majority of users in the lowest status (86.5%), while in two other centers users were mostly included in the three highest categories, and in the fourth center users were mostly in the second (59%) and lowest (29%) socioeconomic status categories.
Implementation indicators at target and included patient population levels, by center and lifestyle habit
A1 at least on 1 lifestyle
A2 at least on 1 lifestyle
A4 at least on 1 lifestyle
A5 at least on 1 lifestyle
Physical Activity (PA)
Advice on change in at least one of the lifestyle habits was provided to a third (33.7%; n = 7433) of all target patients (I2a) and to 70.7% of included patients found not to adhere to at least one lifestyle recommendation when assessed (I2b) (Table 2). Regarding the areas in which advice was given, diet was the lifestyle on which the highest percentage of patients received advice (24.2% of target patients; 67.4% of those not eating five servings of fruits and vegetables a day). Advice for increasing physical activity was provided to 16.5% of target patients and 56.7% of those not reaching recommended physical activity levels, while advice on smoking cessation was given the least in terms of reaching target patients (10.6% of target patients; 65.1% of those identified as smokers at inclusion).
Regarding lifestyle prescription, 9.7% (n = 2175) of all target patients collaboratively designed and then received a printed prescription for at least one healthy lifestyle change (I3a), diet being the lifestyle most frequently addressed (6.4% of all target patients) followed by physical activity and smoking cessation (3.5% and 1.25% of all target patients, respectively). From those included in the program with unhealthy lifestyles, 20.7% received a prescription for at least one lifestyle change (I3b), while 29.3% of those who received advice regarding lifestyle changes finally ended up designing and receiving a personalized lifestyle change plan (I3c). Further, of those who received dietary advice, 26.5% were also prescribed dietary changes, while prescriptions regarding increasing physical activity and smoking cessation were provided to 21.4% and 11.1% of those advised, respectively.
Only 3.7% of the target population received repeat prescriptions and consequently the full 5 A’s intervention over the course of the program (I4a), again with diet being the lifestyle addressed in most cases (2.6% for diet; 1% for physical activity and 0.4% for smoking cessation). The percentage of patients with a repeat prescriptions rose to 7.8% and 37.9% in included patients’ (I4b) and in those with a previous prescription (I4c), respectively. Multiple-lifestyle intervention indicators were as follows: 4.7% of the target population (n = 1057) received advice on all three lifestyles considered and 12.7% (n = 2861) received it on two. This corresponded to only 35 patients who attended the centers (0.15%) receiving a prescription to change physical activity, diet and smoking habits, while in 609 (2.7%) modifications in two aspects of patient lifestyles were planned and prescribed.
Characteristics of target population associated with exposure to the main intervention components: Assessment of lifestyles (A1), Advice on lifestyle change (A2), and Prescription of lifestyle change (A4)
Adjusted Hazard Ratio (95% CI)
Age (unit = 5 years)
Mental health problem
Other chronic health problem
With respect to the other variables included in the model, most patient personal and clinical characteristics where also associated with the implementation of the different intervention components (Table 3). Specifically, the hazard ratio for exposure to components of the healthy lifestyle promotion intervention was higher in women than in men (AHR of being assessed in men: 0.83; 95% CI: 0.80–0.86) and increased with patient age, 1.05-fold for every 5 years of age. Some of the chronic conditions were also related to exposure to intervention components. The hazard ratio for exposure to assessment, advice and prescription for lifestyle change was significantly higher in those with cardiovascular, musculoskeletal, respiratory, digestive, and metabolism-related diseases, among other conditions, than in patients without these conditions. Among these chronic health problems, cardiovascular diseases had the strongest association with being assessed (AHR: 1.41; 95% CI: 1.33 to 1.49), advised (HR: 1.51; 95% CI: 1.42 to 1.62), and receiving a prescription for lifestyle change (AHR: 1.87; 95% CI: 1.67 to 2.09).
Results of this pilot study showed that the PVS implementation strategy was feasible and achieved modest-to-good improvement in clinical practice regarding adoption, reach, and implementation of an evidence-based healthy lifestyle promotion intervention in the context of routine primary care. The main contribution of this study is the description of the significant heterogeneity observed in the assessed process indicators associated with lifestyle habits, patient characteristics, settings and implementation timeframe.
Overall, rates of adoption within centers were high in the three main professional categories considered, family physicians, nurses and administrative personnel. During the 2-year period of program implementation, more than the half of all the primary care users aged 10 to 65 years old were reached in the four centers in terms of having their lifestyles assessed. This level of reach should be considered notably high, given that the program has been implemented in “real world” conditions in primary care, among those attending routine appointments, and thus represents general and unselected sample of the primary care population for the groups covered. Other studies evaluating the feasibility of lifestyle screening in routine context have attained reach rates ranging from 49.6 to 86.7%, though these figures have been attained in shorter exposure periods or/and with limited sample sizes [22–24].
Research on healthy lifestyle promotion in clinical settings has established that intensive counseling in the form of advice and the use of behavioral change techniques are some of the active components that help individuals initiate and maintain health-related behavior change . The PVS implementation strategy aimed to enhance the integration and feasibility of the execution of these effective intervention components . PVS centers have been able to provide advice on change in at least one of the lifestyles considered to a third of patients who attended the centers and almost 10% of these patients have collaboratively designed and then received a printed prescription for at least one lifestyle change. Other implementation trials aiming to improve the promotion of healthy lifestyles have also shown positive results in terms of increasing screening and intervention rates [25–29]. However, as observed in other studies [30, 31], a full 5 A’s intervention is rarely performed, only 4% of patients receiving all components in relation to at least one aspect of their lifestyle.
These process and performance indicators regarding adoption, reach and implementation varied between lifestyle habits, patient characteristics and centers. First, regarding lifestyle habits, higher percentages of patients received advice and a prescription for change in the case of physical activity and diet once these had been assessed, while smoking habits has been the lifestyle most commonly assessed but with the lowest rates of advice and prescription. This variability in the priority given to the healthy lifestyles was a result of the implementation strategy used, which sought to help collaborating centers adapt the intervention program to their actual context and resources in order to enhance its integration in routine service delivery in PHC. In this adaptation process, they were instructed to prioritize both the lifestyles to be addressed and strategies to re-organize the delivery of preventive actions within centers. Considering that 90% of patients assessed in this study failed to adhere to at least one of the lifestyle recommendations considered, it seems reasonable to apply some sort of prioritization strategy to deal with work overload and maximize feasibility of a population-level healthy lifestyle promotion program in the context of routine primary care. Further research is warranted as to identify what are the best cut-off points for attaining the optimal balance between feasibility and workload when identifying individuals in need of a healthy lifestyle promotion intervention.
Second, the delivery of health promotion actions has been found to be associated with various personal and clinical characteristics of the targeted population. Regarding patients’ intra-personal characteristics, the likelihood of being assessed, receiving advice and being prescribed lifestyle changes increased with age and was higher in women than men. Those with chronic health conditions (e.g., cardiovascular disease) were also more likely to receive each of the intervention components. A possible explanation for these associations is that health care providers have targeted and prioritized their healthy lifestyle promotion actions to those more likely to face fewer obstacles to changing their lifestyle, such as, older patients who may have more free time (as they are working less or retired completely and have fewer obligations); or to those that would potentially benefit the most, such as those with a chronic health problem. Indeed, selective and targeted counseling of patients prioritizing among other factors patient with known health risks or readiness for change has been documented  and is currently recommended in order to maximize their impact [33, 34].
Moreover, factors beyond personal characteristics, such as socioeconomic status also influenced the implementation of intervention components. Specifically, each of the main intervention components were more likely to be received by those with higher socioeconomic status. Therefore, it seems that intra- and extra-personal characteristics of target populations may also explain variability in the integration and implementation of healthy lifestyle promotion and the feasibility of this type of intervention [32, 35].
Third, PHC center has been observed to be a great source of variability in program adoption, reach and implementation indicators. Overall, relatively high rates of adoption by staff have been attained in all the centers. This is not surprising given that written commitment from the majority of staff within the different categories was a requirement for study participation. However, actual rates of involvement and contribution differed: while in one of the centers all staff committed to participate and did so, in other centers complete participation was not attained. These rates of adoption may have a direct impact on both the actual reach of the program and the implementation of intervention components as could be observed in the present study. On the one hand, in the center in which all staff participated, more than 80% of the target population was reached in terms of the identification of at least one healthy lifestyle, and almost 60% received advice on lifestyle changes, as well as the highest percentage of target users (comparing with other centers) received a prescription of a lifestyle change plan. Additionally, within collaborating professionals, all of them actually showed good performance in terms of indicators of implementation. On the other hand, the center with the lowest rates of adoption obtained the poorest rates of implementation of intervention components at practices and patient levels (e.g., 37% of target patients assessed and only 2 out of 11 collaborating practices assessed at least 50% of target users seen during the program implementation period).
Furthermore, rates of adoption by staff and reach at the patient level may have contributed substantially to the observed variability in implementation rates at the center level. Specifically, the likelihood of being exposed to intervention components of advice and prescription for lifestyle change was 4 times more likely in the center with the highest rates of adoption and reach than the center with the lowest rates of adoption and reach. The likelihood of exposure to the intervention program in the other two centers with intermediate rates of adoption and reach was also significantly higher than in the center with the lowest rates. In this sense, based on the actual adoption and implementation of intervention components across collaborating health centers, we may distinguish three levels of implementation performance: high, medium and low.
Variability in program adoption by professionals, program reach and implementation indicators between different sites has also been reported in other implementation trials [24, 36]. Centers each have different contexts and thus implementation strategies must be targeted and adapted to those specific contexts. Even after a hypothetical adaptation, results and products would be context specific. That is, context is crucial, meaning that interventions may be implemented in different ways in different settings and thus outcomes may also vary [37–39].
And finally, another important finding of the present study is that the sustainability or the extent of exposure to intervention components over time differed between centers and varied thorough the implementation period within centers, probably reflecting intermittent efforts and continuous adaptation to the multiple unstable contextual and organizational factors in the centers, to the innovation itself, the providers, the processes involved and the interaction of all of these factors [40–42]. We should recognize that in the present implementation study competition with other initiatives, in particular those imposed by health system management, structural changes and staff movements, lack of ongoing training of staff, and technical problems with the information and communication tool may all have hindered ideal implementation of intervention components throughout the implementation period [see accompanying paper by Martinez et al.].
The present study has several limitations. First, the process evaluation refers to a prospective cohort study performed in four selected centers and the observational nature of the study together with the absence of a comparison group mean that it is not possible to attribute the results obtained to the implementation strategy alone. Although collaborating centers are apparently diverse, they may not be representative of all PHC centers in our health service. In addition, though we have described some characteristics regarding representativeness (in terms of PHC size and composition, socioeconomic status of catchment populations, and so on), missed information regarding other specific characteristics of the context may hinder interpretation of results. Though the external validity of the study may be questioned, implementation trials aim to conduct a broad evaluation of the translation of proven-efficacy interventions into routine care, assessing results in heterogeneous, unselected populations and real-life clinical settings [43, 44]. Another limitation relates to difficulties interpreting the results obtained, especially those concerning variability between centers/settings and the nature of changes or reasons for intermittent sustainability. Consequently, a qualitative inquiry study has also been performed to explore staff perceptions of the program implementation and its results [see accompanying paper by Martinez et al.].
The main strengths of the study are that it has been conducted at the population level and the quality of data assessed, as these were recorded in and subsequently retrieved from an established electronic health record.
Implementation research must be the priority in order to first transform our health systems into continuously learning organizations and consequently enact the final step of translating scientific knowledge to real-life clinical settings in an effort to close the translational gap. In doing so, engagement of all stakeholders is crucial, especially of those who interact with patients and are the actual providers of health care. However, contexts are heterogeneous and unstable and an adequate program adoption and implementation may not always be achieved. Identifying the factors behind implementation heterogeneity may help us to tailor implementation strategies, but comparative effectiveness research is needed to determine the best theoretically grounded and operationalized implementation strategies to improve clinical practice.
- 5 A’s:
Ask, Advise, Agree, Assist, and Arrange follow-up
Assessment of healthy lifestyles
Advice on healthy lifestyle change
Prescription of a healthy lifestyle change
Adjusted hazard ratio
95% confidence interval
Included: percentage of target patients whose lifestyle habits were assessed and included because they failed to adhere to at least one healthy lifestyle recommendation
The percentage of target patients who received advice
The percentage of included patients who received advice
The percentage of target patients who received a prescription for lifestyle change
The percentage of included patients who received a prescription for lifestyle change
The percentage of advised patients who received a prescription for lifestyle change
The percentage of target patients who received a repeat prescription related to the same aspect of their lifestyle
The percentage of included patients who received a repeat prescription related to the same aspect of their lifestyle.
The percentage of prescribed patients who received a repeat prescription related to the same aspect of their lifestyle.
Primary Health Care
Prevención con Dieta Mediterranea study
Prescribe Vida Saludable study
Reach, Efficacy, Adoption, Implementation, Maintenance framework
The Primary Care Research Unit of Bizkaia
We gratefully acknowledge all the PVS participants who contributed to the focus groups and the representatives of the public health department who accompanied the facilitator in the interviews (see Additional file 1: Members of the PVS group).
The PVS project was supported by the Carlos III Health Institute of the Spanish Ministry of Economy and Competitiveness, co-financed by the European Regional Development Fund (research grant PS09/01461), the Health Department of the Basque Government (research grants 2007111009, 2009111072, and 2011111145), the Basque Foundation for Social and Health Care Innovation (grant CA-2012-086), the Basque Research Center in Chronicity-Kronikgune (grant 11/056), and the Spanish Primary Care Research Network for Prevention and Health Promotion (redIAPP RD06/0018/0018 and RD12/0005/0010). The funding body had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Availability of data and materials
Since data supporting the present study regards to routine data retrieved from the electronic health records of the Basque Health Service-Osakidetza, it will be only shared upon justified request to the study guarantors.
GG and AS conceived the idea and are the study guarantors. They are primarily responsible for the study design and planning, coordination and supervision, analysis and interpretation of results. AS and GG were responsible for the analysis of results and drafted the manuscript. JMC and HP collaborated in the study design, obtained funding, and were responsible for study coordination. MHC, EP, JM, and EG were local leaders at the primary care centers and contributed to implementation and interpretation of the process. All contributors have critically reviewed the manuscript and approved this version submitted for publication to Implementation Science.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The study protocol was approved by the Primary Care Research Committee of the Basque Health Service, Osakidetza, and by the Basque Country Clinical Research Ethics Committee (Ref: 6/2009). Health care professionals that committed to participate also gave written consent for the anonymous management and publication of data pertaining both to patients assigned to their practices and indicators related to their health care delivery activity.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what it is and how to do it. BMJ. 2013;347:f6753.View ArticlePubMedGoogle Scholar
- Neta G, Glasgow RE, Carpenter CR, Grimshaw JM, Rabin BA, Fernandez ME, Brownson RC. A Framework for Enhancing the Value of Research for Dissemination and Implementation. Am J Public Health. 2015;105(1):49–57.View ArticlePubMedPubMed CentralGoogle Scholar
- Medical Research Council. Developing and evaluating complex interventions: new guidance. London: Medical Research Council; 2008.Google Scholar
- Saunders RP, Evans MH, Joshi P. Developing a process-evaluation plan for assessing health promotion program implementation: a how-to guide. Health Promot Pract. 2005;6(2):134–47.View ArticlePubMedGoogle Scholar
- Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14:15.View ArticlePubMedPubMed CentralGoogle Scholar
- Steckler A, Linnan L. Process Evaluation for Public Health Interventions and Research. San Francisco: Jossey-Bass; 2002.Google Scholar
- Grandes G, Sánchez A, Cortada JM, Balague L, Calderon C, Arrazola A, Vergara I, Millan E. For the “Prescribe Vida Saludable” group, Is integration of healthy lifestyle promotion into primary care feasible? Discussion and consensus sessions between clinicians and researchers. BMC Health Serv Res. 2008;8:213.View ArticlePubMedPubMed CentralGoogle Scholar
- Medical Research Council. A framework for development and evaluation of complex interventions to improve health. London: Medical Research Council; 2000.Google Scholar
- Sanchez A, Grandes G, Cortada JM, Pombo H, Balague L, Calderon C. Modelling innovative interventions for optimising healthy lifestyle promotion in primary health care: ‘Prescribe Vida Saludable’ phase I research protocol. BMC Health Serv Res. 2009;9:103.View ArticlePubMedPubMed CentralGoogle Scholar
- Bowen DJ, Kreuter M, Spring B, Cofta-Woerpel L, Linnan L, Weiner D, Bakken S, Kaplan CP, Squiers L, Fabrizio C, Fernandez M. How we design feasibility studies. Am J Prev Med. 2009;36(5):452–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Goldstein MG, Whitlock EP, DePue J. Planning Committee of the Addressing Multiple Behavioral Risk Factors in Primary Care Project. Multiple behavioral risk factor interventions in primary care. Summary of research evidence. Am J Prev Med. 2004;27:61–79.View ArticlePubMedGoogle Scholar
- Sanchez A, Bully P, Martinez C, Grandes G. Effectiveness of physical activity promotion interventions in primary care: A review of reviews. Prev Med. 2015;76(Suppl):S56–67.View ArticlePubMedGoogle Scholar
- Richards J, Hillsdon M, Thorogood M, Foster C. Face-to-face interventions for promoting physical activity. Cochrane Database Syst Rev. 2013;9, CD010392.Google Scholar
- Bhattarai N, Prevost AT, Wright AJ, Charlton J, Rudisill C, Gulliford MC. Effectiveness of interventions to promote healthy diet inprimary care: systematic review and meta-analysis of randomised controlled trials. BMC Public Health. 2013;13:1203.View ArticlePubMedPubMed CentralGoogle Scholar
- Stead LF, Buitrago D, Preciado N, Sanchez G, Hartmann-Boyce J, Lancaster T. Physician advice for smoking cessation. Cochrane Database Syst Rev. 2013;5, CD000165.Google Scholar
- Schröder H, Fitó M, Estruch R, Martínez-González MA, et al. A short screener is valid for assessing Mediterranean diet adherence among older Spanish men and women. J Nutr. 2011;141(6):1140–5.View ArticlePubMedGoogle Scholar
- de la Fuente-Arrillaga C, Vázquez-Ruiz Z, Bes-Rastrollo M, et al. Reproducibility of a food frequency questionnaire (FFQ) validated in Spain. Public Health Nutr. 2010;13:1364–72.View ArticlePubMedGoogle Scholar
- Orueta JF, García-Álvarez A, García-Goñi M, Paolucci F, Nuño-Solinís R. Prevalence and costs of multimorbidity by deprivation levels in the Basque country: a population based study using health administrative databases. PLoS ONE. 2014;9(2):e89787.View ArticlePubMedPubMed CentralGoogle Scholar
- Domínguez-Berjón MF, Borrell C, Cano-Serral G, Esnaola S, Nolasco A, et al. Constructing a deprivation index based on census data in large Spanish cities (the MEDEA project). Gac Sanit. 2008;22:179–87.View ArticlePubMedGoogle Scholar
- Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Cox DR. 1972) Regression models and life tables (with discussion. J R Stat Soc. 1972;34:187–220.Google Scholar
- Krist AH, Phillips SM, Sabo RT, Balasubramanian BA, Heurtin-Roberts S, Ory MG, Johnson SB, Sheinfeld-Gorin SN, Estabrooks PA, Ritzwoller DP, Glasgow RE, MOHR Study Group. Adoption, reach, implementation, and maintenance of a behavioral and mental health assessment in primary care. Ann Fam Med. 2014;12(6):525–33.View ArticlePubMedPubMed CentralGoogle Scholar
- Krist AH, Woolf SH, Frazier CO, Johnson RE, Rothemich SF, Wilson DB, Devers KJ, Kerns JW. An electronic linkage system for health behavior counseling effect on delivery of the 5A’s. Am J Prev Med. 2008;35(5):S350–8.View ArticlePubMedGoogle Scholar
- Rodriguez HP, Glenn BA, Olmos TT, Krist AH, Shimada SL, Kessler R, Heurtin-Roberts S, Bastani R. Real-world implementation and outcomes of health behavior and mental health assessment. J Am Board Fam Med. 2014;27(3):356–66.View ArticlePubMedPubMed CentralGoogle Scholar
- Aspy CB, Mold JW, Thompson DM, Blondell RD, Landers PS, Reilly KE, Wright-Eakers L. Integrating screening and interventions for unhealthy behaviors into primary care practices. Am J Prev Med. 2008;35(5 Suppl):S373–80.View ArticlePubMedGoogle Scholar
- Goodwin MA, Zyzanski SJ, Zronek S, Ruhe M, Weyer SM, Konrad N, Esola D, Stange KC. A clinical trial of tailored office systems for preventive service delivery. The Study to Enhance Prevention by Understanding Practice (STEP-UP). Am J Prev Med. 2001;21(1):20–8.View ArticlePubMedGoogle Scholar
- Hogg W, Lemelin J, Moroz I, Soto E, Russell G. Improving prevention in primary care: Evaluating the sustainability of outreach facilitation. Can Fam Physician. 2008;54(5):712–20.PubMedPubMed CentralGoogle Scholar
- Grunfeld E, Manca D, Moineddin R, Thorpe KE, Hoch JS, Campbell-Scherer D, Meaney C, Rogers J, Beca J, Krueger P, Mamdani M, BETTER Trial Investigators. Improving chronic disease prevention and screening in primary care: results of the BETTER pragmatic cluster randomized controlled trial. BMC Fam Pract. 2013;14:175.View ArticlePubMedPubMed CentralGoogle Scholar
- Harris MF, Chan BC, Laws RA, Williams AM, Davies GP, Jayasinghe UW, Fanaian M, Orr N, Milat A, CN SNAP Project Team. The impact of a brief lifestyle intervention delivered by generalist community nurses (CN SNAP trial). BMC Public Health. 2013;13:375.View ArticlePubMedPubMed CentralGoogle Scholar
- Carroll JK, Antognoli E, Flocke SA. Evaluation of physical activity counselling in primary care using direct observation of the 5As. Ann Fam Med. 2011;9(5):416–22.View ArticlePubMedPubMed CentralGoogle Scholar
- Sherson EA, Yakes Jimenez E, Katalanos N. A review of the use of the 5 A’s model for weight loss counselling: differences between physician practice and patient demand. Fam Pract. 2014;31(4):389–98.View ArticlePubMedGoogle Scholar
- Bock C, Diehl K, Schneider S, Diehm C, Litaker D. Behavioral counseling for cardiovascular disease prevention in primary care settings: a systematic review of practice and associated factors. Med Care Res Rev. 2012;69(5):495–518.View ArticlePubMedGoogle Scholar
- Lin JS, O’Connor E, Whitlock EP, Beil TL. Behavioral counseling to promote physical activity and a healthful diet to prevent cardiovascular disease in adults: a systematic review for the U.S. Preventive Services Task Force. Ann Intern Med. 2010;153:736–50.View ArticlePubMedGoogle Scholar
- Grandes G, Sánchez A, Torcal J, Sánchez-Pinilla RO, Lizarraga K, Serra J, PEPAF Group. Targeting physical activity promotion in general practice: characteristics of inactive patients and willingness to change. BMC Public Health. 2008;8:172.View ArticlePubMedPubMed CentralGoogle Scholar
- Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.View ArticlePubMedPubMed CentralGoogle Scholar
- Wilcox S, Parra-Medina D, Felton GM, Poston MB, McClain A. Adoption and implementation of physical activity and dietary counseling by community health center providers and nurses. J Phys Act Health. 2010;7(5):602–12.View ArticlePubMedPubMed CentralGoogle Scholar
- Dickinson LM, Dickinson WP, Nutting PA, Fisher L, Harbrecht M, Crabtree BF, Glasgow RE, West DR. Practice context affects efforts to improve diabetes care for primary care patients: a pragmatic cluster randomized trial. J Gen Intern Med. 2015;30(4):476–82.View ArticlePubMedGoogle Scholar
- Hawe P, Shiell A, Riley T. Complex interventions: how “out of control” can a randomised controlled trial be? BMJ. 2004;328(7455):1561–3.View ArticlePubMedPubMed CentralGoogle Scholar
- Datta J, Petticrew M. Challenges to evaluating complex interventions: a content analysis of published papers. BMC Public Health. 2013;13:568.View ArticlePubMedPubMed CentralGoogle Scholar
- Wiltsey Stirman S, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7:17.View ArticlePubMedPubMed CentralGoogle Scholar
- Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50.View ArticlePubMedGoogle Scholar
- Greenhalgh T, Macfarlane F, Barton-Sweeney C, Woodard F. “If we build it, will it stay?” A case study of the sustainability of whole-system change in London. Milbank Q. 2012;90(3):516–47.View ArticlePubMedPubMed CentralGoogle Scholar
- Glasgow RE, Lichtenstein E, Marcus AC. Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003;93:1261–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Pinnock H, Epiphaniou E, Taylor SJ. Phase IV implementation studies. The forgotten finale to the complex intervention methodology framework. Ann Am Thorac Soc. 2014;11(2):S118–22.View ArticlePubMedGoogle Scholar