- Research article
- Open Access
Recruitment and reach in a pragmatic behavioral weight loss randomized controlled trial: implications for real-world primary care practice
BMC Family Practice volume 21, Article number: 47 (2020)
Obesity is a major risk factor behind some of the most common problems encountered in primary care. Although effective models for obesity treatment have been developed, the ‘reach’ of these interventions is poor and only a small fraction of primary care patients receive evidence-based treatment. The purpose of this study is to identify factors that impact the uptake (reach) of an evidence-based obesity treatment program within the context of a pragmatic cluster randomized controlled trial comparing three models of care delivery.
Recruitment and reach were evaluated by the following measures: 1) mailing response rates, 2) referral sources among participants contacting the study team, 3) eligibility rates, 4) participation rates, and 5) representativeness based on demographics, co-morbid conditions, and healthcare utilization of 1432 enrolled participants compared to > 17,000 non-participants from the clinic-based patient populations. Referral sources and participation rates were compared across study arms and level of clinic engagement.
The response rate to clinic-based mailings was 13.2% and accounted for 66% of overall program recruitment. An additional 22% of recruitment came from direct clinic referrals and 11% from media, family, or friends. Of those screened, 87% were eligible; among those eligible, 86% enrolled in the trial. Participation rates did not vary across the three care delivery arms, but were higher at clinics with high compared to low provider involvement. In addition, clinics with high provider involvement had a higher rate of in clinic referrals (33% versus 16%) and a more representative sample with regards to BMI, rurality, and months since last clinic visit. However, across clinics, enrolled participants compared to non-participants were older, more likely to be female, more likely to have had a joint replacement but less likely to have CVD or smoke, and had fewer hospitalizations.
A combination of direct patient mailings and in-clinic referrals may enhance the reach of primary care behavioral weight loss interventions, although more proactive outreach is likely necessary for men, younger patients, and those at greater medial risk. Strategies are needed to enhance provider engagement in referring patients to behavioral weight loss programs.
clnicialtrials.gov NCT02456636. Registered May 28, 2015, https://www.clinicaltrials.gov/ct2/results?cond=&term=RE-POWER&cntry=&state=&city=&dist=.
Primary care remains an underutilized yet important resource for patients with obesity who need assistance with weight loss [1,2,3]. This is especially the case for patients in underserved areas such as rural or other low socioeconomic communities where access to evidence-based programs are lacking [4,5,6]. Although systematic reviews of obesity treatment trials in primary care settings have concluded they result in sustained modest weight loss, [7, 8] the reach of such interventions, including the proportion and representativeness of patients who participate, is largely unknown . As a result, clinicians and program planners often lack information on the likelihood of achieving meaningful rates of uptake by patients, particularly patients who may have fewer resources or more competing demands .
Practical lessons can be learned from randomized trials that support later clinical implementation . Participation rates and representativeness, however, are rarely reported despite the clear value of such information for assessing overall impact [9, 12]. One estimate has indicated that less than 30–50% of primary care trials across a variety of contexts and topics ever meet their original recruitment goals [13,14,15]. In a review of 19 behavioral obesity trials conducted across various community and clinical settings, only 2 reported participation rates and 1 reported on the representativeness of the study sample, none of which were conducted in primary care clinics .
An additional factor that limits the ability to understand the potential reach of behavioral weight loss interventions is that few of the prior trials have been highly pragmatic, whereby existing clinic staff delivered the intervention and broad eligibility criteria were used to represent real-world populations [17, 18]. Pragmatic trials are especially needed in obesity treatment, because unfortunately uptake of services under the predominant fee-for-service model has been limited . Alternative care delivery models for obesity treatment, such as after-hours group visits or phone-based care, might be more acceptable to patients and expand the reach.
The aims of the current study are to evaluate patient recruitment strategies and reach within a 3-arm pragmatic cluster randomized trial comparing two alternative care delivery models to the fee-for-service model for behavioral treatment for obesity. We examine recruitment yield from different recruitment strategies, as well as eligibility and participation rates, and then compare these rates across the three study arms. We also explore recruitment strategies and participation rates across clinics that had a high versus a low level of provider involvement in recruiting patients. Finally, we examine representativeness of the trial sample by comparing demographic characteristics, co-morbid conditions, and healthcare utilization across study participants and non-participants.
Study design and setting
RE-POWER is a cluster randomized trial comparing three models of implementing behavioral weight loss interventions in 36 rural primary care practices in the Midwestern region of the U.S. Of the 36 randomized practices, 10 were owned by an integrated healthcare system in Wisconsin (the Marshfield Clinic), and the remaining were a mix of 13 hospital-owned clinics, 9 private practices, 3 non-profit clinics, and 1 Veteran Affairs (VA) clinic. All practices predominantly or exclusively served rural residents; 11 were designated rural health clinics and 12 were federally qualified health centers.
The study protocol has been previously reported . In brief, clinics were randomized to one of three care delivery models: 1) individual face-to-face 15-min office visits modeled after the fee-for-service provision for the Centers for Medicaid and Medicare Intensive Behavior Therapy,  2) 60-min group visits conducted after hours within the local practice modeled after patient-centered medical home standards (PCMH) that emphasize coordinated, comprehensive care with enhanced access,  and 3) 60-min group conference call visits conducted centrally modeled after a disease management approach (DM). For fee-for-service and PCMH arms, all sessions were provided by clinic-employed providers (e.g., primary care provider [PCP], registered nurse [RN], registered dietitian [RD], licensed clinical social worker [LCSW]). Session frequency started as weekly and tapered to monthly by 6 months and remained monthly through 24 months. The intervention across all three study arms included evidence-based behavioral components for reducing caloric intake, increasing physical activity, daily self-monitoring, and goal-setting. Treatment goals were 5 to 10% weight loss during the first 6 months, followed by weight loss maintenance from 6 to 24 months. The study was approved by a central Institutional Review Board  and the VA Nebraska-Western Iowa IRB. Recruitment and reach data were obtained from mailing lists, participant report of how they were referred to the study, screening outcomes, and enrollment outcomes. These data were collected from January 2016 to October 2017; analyses were conducted in 2019.
As a pragmatic study, the exclusion criteria were kept to a minimum. Patients were eligible if they were between 20 and 75 years-old, had a body mass index (BMI) between 30 and 45 kg/m2, and resided in a rural location . Medical clearance from the treating PCP was required, and patients must have been seen in the clinic within the past 18 months. Exclusions included a history of bariatric surgery or planned bariatric surgery within 2 years, pregnancy in the last 6 months, currently lactating, myocardial infarction, stroke, or new cancer diagnosis in the last 6 months, or plans to change primary care clinics during the study. One individual per household was allowed to enroll.
The two primary recruitment strategies were direct mailings and in-clinic referrals. Each practice was responsible for developing a mailing list of potentially eligible patients, based on eligibility criteria of age, obesity status, rural zip code, and a clinic visit within the past 18 months. Invitation letters signed by the local PCP and study principal investigator were mailed to patients, along with a study brochure and a pre-stamped opt-in postcard. Separate recruitment materials were designed for each study arm to reflect the nature of the three intervention delivery models. Mailings were sent in waves for each clinic until the recruitment target was met or the entire list was exhausted. Providers also referred patients during routine medical visits, and study brochures and opt-in postcards were distributed in clinics. Fourteen of the 36 clinics also elected to use advertisements placed around the community, printed in local newspapers, and/or posted on clinic webpages and social media.
Interested patients opted in for screening by contacting the central study team by phone, e-mail, or the opt-in postcard. Patients who responded were asked how they first heard about the study. If eligible by phone screening, PCP clearance was obtained, and patients were sent a baseline survey. After completion of the survey, local clinic staff called the patient to schedule a baseline visit at which time they verified BMI, obtained informed consent, and collected baseline lab measures.
Recruitment sources and mailing response rate
We report the total number and percent of patients who contacted the study team across different recruitment sources (self-reported by patients), as well as the median and range per clinic within each of the three randomization arms. The response rate to the mailing is calculated as the number of patients who contacted the study who received the mailing divided by the total number of letters mailed (excluding the number of undeliverable mailings).
Among patients who were screened, we report the number and percent who were eligible and who declined, in total and by study arm. We report different participation rates as recommended by Glasgow . From least to most conservative, participation rates include the number enrolled divided by 1) the number who screened and were assumed eligible (applying the eligibility rate at each screening step to those who declined prior to completing screening), 2) the number who contacted the study line and assumed eligible, and 3) the number mailed to and assumed eligible.
Provider involvement (low versus high) in creating recruitment lists
The level of provider input in curating the recruitment list varied across the sites, from a completely hands-off population-based approach (electronic medical record (EMR)-extracted list with no provider review) to a highly involved approach (list reviewed for medical and behavioral contraindications and/or some patients prioritized to receive the mailing first). These differences arose by natural variation during the conduct of the trial. Therefore, we explored whether recruitment sources, eligibility rates, and representativeness of enrolled participants varied across level of provider involvement. We created two categories of clinics (low verses high involvement) by reviewing detailed descriptions of how the lists were created along with the number of patients they excluded and/or prioritized. Low involvement clinics (n = 24) excluded few of the patients originally identified (median = 0%, range 0–16%) and prioritized very few to receive the mailing first (median = 0%, range 0–4%). High involvement clinics (n = 12) excluded a higher proportion of patients (median = 6%, range 0–39%) and/or prioritized a higher number of patients to receive the mailing first (median 28%, range 0–69%).
Characteristics of participants versus non-participants
We compare age, sex, race, rurality (Rural-Urban Commuting Area Codes),  months since last clinic visit, and BMI (kg/m2) between enrolled participants and non-participants who were patients at the participating clinics. We also explore these characteristics for participants enrolled from clinics with high versus low level of provider involvement.
For the 10 Marshfield Clinic sites, additional characteristics were available from EMR extraction for all patients who met the initial eligibility criteria of age, BMI, rural residence, clinic visit within 18 months, and were medically-homed to the Marshfield Clinic Health System with reasonably complete capture of all medical care, per standard quality reporting definitions used by the Marshfield Clinic Institute for Quality, Innovation and Patient Safety . Additional extracted variables included co-morbid conditions, smoking status, number of ambulatory visits, and in-patient days over the past 3 years.
Analysis of variance was conducted to examine differences across study arms in mailing response rates, ineligible and decline rates, and participation rates. Rates were calculated at the clinic-level and then averaged across clinics to account for site level variation. T-tests were used to explore differences across clinics with high versus low level of involvement. To evaluate representativeness, characteristics of study participants versus non-participants were compared at the clinic-level using paired t-tests. For demographic and BMI characteristics, non-participants include 13,858 patients who were mailed the study invitation, 3539 who were on the mailing lists but did not receive the mailing due the recruitment goal being met, and 100 who were patients at a participating clinic and called the study line but were not on the mailing list. To examine the potential impact of non-uniform methods across clinics in creating the mailing lists, two sensitivity analyses were conducted. First, we compared characteristics across enrolled participants to only non-participants who received the study mailing. Second, we compared characteristics just among the enrolled and non-enrolled sample at the 10 Marshfield Clinic sites, where uniform population-based EMR data extraction methods were used to create the lists. Finally, we also compared results with and without the single VA site, because their recruitment process varied and was handled locally due to VA IRB restrictions. Results were the same, thus findings are presented with this site included. All analyses were conducted with SPSS version 25.
Mailings were sent to 15,076 patients with a median of 357 mailings per clinic (Additional file 1: Figure S1). Of these, 1990 patients contacted the study line, for mailing response rate of 13.2%. Of these contacts, only 1383 self-reported they heard about the study from the mailing while the remainder reported they heard about the study during a clinic visit (n =247) or from media or family/friends (n = 67). There was no difference in mailing response rates by study arms (p = 0.42).
Of 2479 potential participants contacting the study, 66.1% reported being referred by the mailing, 21.5% by a provider during a clinic visit, and 11.0% from media or family/friends (Table 1). When restricting these analyses to just the sample who ultimately enrolled in the study (n = 1432), self-reported referral sources were similar (see supplemental Table S1). Clinics randomized to the DM arm had a higher proportion of patients recruited through media or family/friends (17.5% versus 6.1% for fee-for-service and 8.8% PCMH); p = 0.02.
Compared to clinics categorized as low involvement, high involvement clinics had a greater proportion of contacts from in-clinic referrals (32.8% versus 15.9%, respectively; p = 0.004) and a lower proportion from the mailing (55.8% versus 71.2%; p = 0.027); see supplemental Table S2. However, there was a high degree of clinic-level variation in the proportion of contacts from in-clinic referrals, ranging from 5.4 to 97.6% among high involvement clinics, and 0 to 29.8% among low involvement clinics.
Eligibility and participation rates
Figure 1 shows participant flow from screening to enrollment, and Table 2 summarizes the number and percent of screened participants who were ineligible and declined at various stages. There were no differences in ineligible or decline rates across study arms, or in participation rates. Of those screened, 13.2% were ineligible overall (86.8% eligibility rate) with 8.1% ineligible at phone screening. The top reason for ineligibility at phone screening was BMI out of range (Fig. 1). Only 2% (n = 38) of those who screened for the study were not cleared to participate by their PCP. Only 3% (n = 61) were ineligible at the baseline visit, with the vast majority of these (n = 52) due to verified BMI being out of range (Fig. 1).
Overall 10.6% of those who screened declined to participate, and the majority of these declined after the phone screening but prior to their baseline/consent visit. The number of participants who no showed (n = 15) or declined (n = 8) at the baseline/consent visit was very low. The clinic-level participation rates were as follows: 86.0% of those who screened eligible, 2) 66.3% of those who contacted the study line and presumed eligible, and 3) 15.7% of those who received the study mailing and presumed eligible.
Compared to clinics categorized as low involvement, patients from high involvement clinics had a lower ineligible rate (9.4% versus 14.9%, respectively; p = 0.005) as well as a lower decline rate (7.2% versus 12.1%, respectively; p = 0.003); see supplemental Table S3. Likewise, high involvement clinics had higher participation rates compared to low involvement clinics: 89.8% vs. 84.3% of those screened eligible, 78.1% vs. 62.4% of those who contacted the study line and presumed eligible, and 23.4% vs. 12.2% of those who received the study mailing and presumed eligible; all p’s < 0.01.
Comparison of participants and non-participants
Table 3 shows select characteristics of enrolled participants versus non-participants. Compared to non-participants, enrolled participants were significantly older (54.1 versus 51.3 years-old; p < 0.001), had a higher BMI (36.5 versus 35.6 kg/m2; p < 0.001), and were seen more recently in the clinic (3.9 versus 4.7 months since last visit; p = 0.02). They also were more likely to be female (76.9% versus 55.0%; p < 0.001) and to live in an isolated rural area (46.3% versus 41.7%; p < 0.001). In sensitivity analyses to examine the potential influence of the mailing on representativeness, comparisons on these characteristics were also made between enrolled participants and only those non-participants who were mailed a study invitation (n = 13,858), as well as for the subsample of participants and non-participants from the 10 Marshfield Clinic sites. In both of these sensitivity analyses, the results were the same with only one exception: there were no differences in rurality between participants and non-participants at the Marshfield sites.
Table 4 shows co-morbid conditions and healthcare utilization for the subsample of participants and non-participants from Marshfield Clinic sites. Compared to non-participants, enrolled participants were less likely to have cardiovascular disease (2.5% versus 5.0%; p = 0.03) and to currently smoke (5.9% versus 16.9%; p < 0.001) but more likely to have prior joint replacement surgery (10.9% versus 8.1%; p = 0.02). They also had fewer inpatient days over the previous 3 years; p = 0.001. No differences were observed for type 2 diabetes, history of cancer, kidney disease, pulmonary disease, depression, or number of outpatient encounters.
Finally, we explored the impact of provider involvement on representativeness of the sample by comparing enrolled participants versus non-participants separately within high versus low involvement clinics (see supplemental Tables S4 and S5). Within both high and low involvement clinics, enrolled participants were significantly older (p’s = 0.006 and < 0.001, respectively) and more likely to be female (p’s < 0.001). However, only within the low involvement clinics were enrolled participants significantly more likely to have a higher BMI (p < 0.001), to be seen in the clinic more recently (p = 0.005), and to live in a more isolated area (p = 0.005); within the high involvement clinics, differences on these characteristics between participants and non-participants were non-significant.
This study examined recruitment strategies and patient reach for a pragmatic trial comparing three models of primary care delivery for implementing behavioral therapy for obesity. The main recruitment strategy was direct mailings to patients who appeared eligible based on chart review of age, BMI, and rurality criteria. The response rate to the mailing was 13.2%, i.e. for every 30 individuals mailed an invitation, 4 responded. This rate is very similar to the 13.6% mailing response rate we observed in a prior obesity treatment trial among rural breast cancer survivors identified through local cancer registries,  and substantially higher than < 1% response rates seen in untargeted mailings to a general population [28, 29].
Perhaps most encouraging, the response to recruitment strategies and participation rates were consistent across clinics randomized to the three different study arms. Although these findings need confirmation in future studies, they suggest that the different models of delivering the weight management sessions (e.g., at the local clinic versus over the phone, in a group versus individual setting) were about equally ‘attractive’ to invited individuals. This may assuage some concerns around program format, as for example, the travel requirements for in-person delivery did not appear to present a systematically greater enrollment barrier. Factors such as the level of provider encouragement and patient readiness could be more critical for patients’ decisions to engage in a health promotion program .
The success of PCP referrals in recruiting patients into primary care obesity treatment trials varies widely across studies, from being completely ineffective  to being the sole recruitment strategy . This reveals a highly variable level of engagement of providers in the practical conduct of research-based interventions. We observed this level of variation even among the clinics participating in this trial, from highly engaged PCPs where 98% of participants came from in-clinic referrals, to very low engagement where none came from provider referrals. Comparisons across clinics categorized as high versus low level of provider involvement showed that higher involvement doubled the proportion of patients from in-clinic referrals (33% versus 16%). Ngune et al. has highlighted the importance of bona fide engagement with PCPs to ensure that research is clinically relevant and useful, rather than relying soley on practice databases to access patients . Without this necessary engagement and support, providers often report barriers such as forgetting to refer patients or assuming patients are uninterested [34, 35]. As evidenced by the within study variability we observed in RE-POWER, approaches to accomplishing provider engagement need to be tailored to each unique clinic-level context .
The majority of prior primary care obesity treatment trials have recruited primarily through proactive phone calls following an introductory mailing, rather than relying on patients to make the first contact [32, 37,38,39,40,41,42]. Recruitment strategies can be classified on a continuum of passive (general advertisements) to active (calling patients already identified as eligible after thorough chart review). The approach we used, i.e. a combination of targeted mailings, provider referrals, and clinic-driven advertisements), falls in the middle of this continuum. Passive strategies are typically less costly but also have lower yield. In contrast, proactive phone calls are more time-consuming and less applicable in clinical practice,  but may reach certain populations better. For example, one study found that participants recruited through proactive phone calls, compared to participants who made the first contact, were more likely to be racial/ethnic minorities and to have lower education . A cost analysis of recruitment methods for clinic-based pediatric obesity trials found that provider referrals was the most cost-effective, and the combination of provider referrals with targeted mailings the most successful . Our findings support the combined strategy of targeted mailings and provider referrals. Only 11% of patient contacts came from passive recruitment methods of either media or word-of-mouth referrals. The low rate of word-of-mouth referrals is notable for the rural setting of this trial, where one might expect greater family/friend referrals in small communities.
It is important to distinguish between eligibility rates, which is a function of the study-specific inclusion/exclusion criteria driven by internal validity concerns, and participation rates which represent uptake by patients meeting the eligibility criteria. As expected due to our pragmatic study design with limited eligibility criteria, we observed a high eligibility rate (87%) in comparison to previous primary care-based weight loss trials which noted eligibility rates ranging from 21 to 66% [32, 37,38,39, 42, 43, 45, 46]. Participation rates are difficult to compare to other studies due to a sparse literature and inconsistency in how they are calculated. We observed participation rates of 86% of those who screened eligible and 16% of those who received the mailing. An internet-based weight loss trial that used targeted mailings to health plan members observed a 5% participation rate . To enable comparison to a larger group of studies, we estimated participation rates in prior primary care behavioral weight loss trials from published participant flow diagrams where possible. These studies recruited through proactive phone calls, and using as the denominator the number of patients for whom contact was attempted multiplied by the eligibility rate, participation rates ranged from 26 to 61% of patients called [25, 37,38,39,40]. Although proactive phone calls may result in higher participation rates, due to added cost and clinical burden, this strategy may be best reserved for subgroups who may be less likely to respond to mailings.
Our analysis of representativeness is one of the first to empirically compare characteristics of participants to the broader primary care clinical populations. Overall, we found participants to be older and more likely to be female. Within our subsample of Marshfield Clinic sites, participants were also less likely to have cardiovascular disease, to smoke, and had fewer inpatient hospital days. In addition, within the low involvement clinics (but not the high involvement clinics), participants were more likely to have a higher BMI and to live in a more isolated rural area. This latter finding appears to be driven by the clinics that were located in isolated areas, where clinics with low involvement were less likely to draw from larger surrounding areas compared to clinics with high involvement.
Representativeness is rarely reported in weight loss trials, but our findings are largely consistent with a previous trial in 3 health maintenance organization (HMO) settings where enrollees were more likely to be female, non-smokers, and had a lower disease risk score . There is a long history of men being under-represented in behavioral weight loss trials, [48, 49] and surface-level tailoring of recruitment materials, e.g. including pictures of men as we did in this study, is likely insufficient. Our findings also suggest that provider engagement alone may be inadequate to recruit representative numbers of men and younger patients. More proactive recruitment strategies, including explicit training for providers to raise awareness and address any communication concerns in referring men and younger patients, may be needed.
This study has several limitations. First, the comparison of different recruitment sources is based on patient self-report of how they first heard about the study, and many who reported being referred during a clinic visit also received the mailing. We are unable to examine the impact of receiving information about the study from multiple sources, and it could be that a particular combination of referral sources has the greatest effect. Second, participants are all rural residents, and the cultural and geographical context of the trial may have had a bearing on the findings. Finally, in our comparison of participants and non-participants, we are unable to fully account for potential provider selection biases in creating the patient lists. Despite original intentions for how lists would be created, in reality the process had to be variable across sites to accommodate system capabilities and preferences. However, our sensitivity analysis with just the Marshfield Clinic sites that had uniform EMR-based curation of lists resulted in the same findings. The major strengths of this study include the unique analyses of representativeness, the large sample and diverse group of practice settings, and the pragmatic design of the trial (including the broad eligibility criteria and intervention delivery by clinic-employed staff) all of which allow for greater application of the findings to clinical practice.
In conclusion, findings support the use of direct patient mailings and in-clinic referrals for recruiting into a primary care behavioral weight loss intervention, although more proactive outreach is likely necessary for men, younger patients, and those at greater medial risk. Level of provider involvement had greater influence on participation rates than type of intervention sessions. High provider involvement, compared to low involvement, also resulted in a more representative sample for some characteristics (BMI, rurality, and months since last clinic visit), but not for gender or age. Further research is needed to develop strategies for enhancing provider engagement in referring patients to behavioral weight loss programs, particularly men and younger patients.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Body mass index
Electronic medical record
Health maintenance organization
Licensed clinical social worker
Primary care provider
Patient centered medical home
Bleich SN, Pickett-Blakely O, Cooper LA. Physician practice patterns of obesity diagnosis and weight-related counseling. Patient Educ Couns. 2011;82(1):123–9.
Galuska DA, Will JC, Serdula MK, Ford ES. Are health care professionals advising obese patients to lose weight? JAMA. 1999;282(16):1576–8.
Befort CA, Greiner KA, Hall S, Pulvers KM, Nollen NL, Charbonneau A, et al. Weight-related perceptions among patients and physicians: how well do physicians judge patients’ motivation to lose weight? J Gen Intern Med. 2006;21(10):1086–90.
Ely AC, Befort C, Banitt A, Gibson C, Sullivan D. A qualitative assessment of weight control among rural Kansas women. J Nutr Educ Behav. 2009;41(3):207–11.
Nothwehr F, Peterson NA. Healthy eating and exercise: strategies for weight management in the rural Midwest. Health Educ Behav. 2005;32(2):253–63.
Ariel-Donges AH, Gordon EL, Dixon BN, Eastman AJ, Bauman V, Ross KM, et al. Rural/urban disparities in access to the National Diabetes Prevention Program. Transl Behav Med. 2019. https://doi.org/10.1093/tbm/ibz098.
Wadden TA, Butryn ML, Hong PS, Tsai AG. Behavioral treatment of obesity in patients encountered in primary care settings: a systematic review. JAMA. 2014;312(17):1779–91.
Tsai AG, Wadden TA. Treatment of obesity in primary care practice in the United States: a systematic review. J Gen Intern Med. 2009;24(9):1073–9.
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.
Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R. Barriers to participation in randomised controlled trials: a systematic review. J Clin Epidemiol. 1999;52(12):1143–56.
Holtrop JS, Rabin BA, Glasgow RE. Dissemination and implementation science in primary care research and practice: contributions and opportunities. J Am Board Fam Med. 2018;31(3):466–78.
Glasgow RE, Klesges LM, Dzewaltowski DA, Bull SS, Estabrooks P. The future of health behavior change research: what is needed to improve translation of research into health promotion practice? Ann Behav Med. 2004;27(1):3–12.
Bower P, Wallace P, Ward E, Graffy J, Miller J, Delaney B, et al. Improving recruitment to health research in primary care. Fam Pract. 2009;26(5):391–7.
Bower P, Wilson S, Mathers N. Short report: how often do UK primary care trials face recruitment delays? Fam Pract. 2007;24(6):601–3.
Fletcher B, Gheorghe A, Moore D, Wilson S, Damery S. Improving the recruitment activity of clinicians in randomised controlled trials: a systematic review. BMJ Open. 2012;2(1):e000496.
Akers JD, Estabrooks PA, Davy BM. Translational research: bridging the gap between long-term weight loss maintenance research and practice. J Am Diet Assoc. 2010;110(10):1511–22 22 e1–3.
Glasgow RE, Gaglio B, Bennett G, Jerome GJ, Yeh HC, Sarwer DB, et al. Applying the PRECIS criteria to describe three effectiveness trials of weight loss in obese patients with comorbid conditions. Health Serv Res. 2012;47(3 Pt 1):1051–67.
Gaglio B, Phillips SM, Heurtin-Roberts S, Sanchez MA, Glasgow RE. How pragmatic is it? Lessons learned using PRECIS and RE-AIM for determining pragmatic characteristics of research. Implement Sci. 2014;9:96.
Hoerger TJ, Crouse WL, Zhuo X, Gregg EW, Albright AL, Zhang P. Medicare’s intensive behavioral therapy for obesity: an exploratory cost-effectiveness analysis. Am J Prev Med. 2015;48(4):419–25.
Befort CA, VanWormer JJ, DeSouza C, Ellerbeck EF, Kimminau KS, Greiner A, et al. Protocol for the rural engagement in primary care for optimizing weight reduction (RE-POWER) trial: comparing three obesity treatment models in rural primary care. Contemp Clin Trial. 2016;47:304–14.
Centers for Medicare and Medicaid Services, Medical Learning Network. (2012). Intensive behavior therapy for obesity. http://www.cms.gov/Outreach-and-Education/Medicare-Learning-Network-MLN/. Accessed 7 Jan 2020.
Agency for Healthcare Research and Quality. Defining the patient centered medical home http://pcmh.ahrq.gov/page/defining-pcmh. Accessed 7 Jan 2020.
Waitman LR, Aaronson LS, Nadkarni PM, Connolly DW, Campbell JR. The greater plains collaborative: a PCORnet clinical research data Network. J Am Med Inform Assoc. 2014;21(4):637–41.
Rural-Urban Commuting Area Codes (RUCAs). U.S. Department of Agriculture, Economic Research Service. https://www.ers.usda.gov/data-products/rural-urban-commuting-area-codes.aspx. Accessed 7 Jan 2020.
Glasgow RE, Strycker LA, Kurz D, Faber A, Bell H, Dickman JM, et al. Recruitment for an internet-based diabetes self-management program: scientific and ethical implications. Ann Behav Med. 2010;40(1):40–8.
VanWormer JJ, Bendixsen CG, Vickers ER, Stokley S, McNeil MM, Gee J, et al. Association between parent attitudes and receipt of human papillomavirus vaccine in adolescents. BMC Public Health. 2017;17(1):766.
Befort CA, Bennett L, Christifano D, Klemp JR, Krebill H. Effective recruitment of rural breast cancer survivors into a lifestyle intervention. Psychooncology. 2015;24(4):487–90.
Crane MM, LaRose JG, Espeland MA, Wing RR, Tate DF. Recruitment of young adults for weight gain prevention: randomized comparison of direct mail strategies. Trials. 2016;17(1):282.
Brown SD, Lee K, Schoffman DE, King AC, Crawley LM, Kiernan M. Minority recruitment into clinical trials: experimental findings and practical implications. Contemp Clin Trials. 2012;33(4):620–3.
Hibbard JH, Mahoney E. Toward a theory of patient and consumer activation. Patient Educ Couns. 2010;78(3):377–81.
Hsu MSH, Harper C, Gibson AA, Sweeting AN, McBride J, Markovic TP, et al. Recruitment strategies for a randomised controlled trial comparing fast versus slow weight loss in postmenopausal women with obesity-The TEMPO Diet Trial. Healthcare (Basel). 2018;6(3):1–17.
Eaton CB, Hartman SJ, Perzanowski E, Pan G, Roberts MB, Risica PM, et al. A randomized clinical trial of a tailored lifestyle intervention for obese, sedentary, primary care patients. Ann Fam Med. 2016;14(4):311–9.
Ngune I, Jiwa M, Dadich A, Lotriet J, Sriram D. Effective recruitment strategies in primary care research: a systematic review. Qual Prim Care. 2012;20(2):115–23.
Page MJ, French SD, McKenzie JE, O'Connor DA, Green SE. Recruitment difficulties in a primary care cluster randomised trial: investigating factors contributing to general practitioners’ recruitment of patients. BMC Med Res Methodol. 2011;11:35.
Foster JM, Sawyer SM, Smith L, Reddel HK, Usherwood T. Barriers and facilitators to patient recruitment to a cluster randomized controlled trial in primary care: lessons for future trials. BMC Med Res Methodol. 2015;15:18.
Damschroder LJ, Lowery JC. Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implement Sci. 2013;8:51.
Ma J, Yank V, Xiao L, Lavori PW, Wilson SR, Rosas LG, et al. Translating the diabetes prevention program lifestyle intervention for weight loss into primary care: a randomized trial. JAMA Intern Med. 2013;173(2):113–21.
Parra-Medina D, D'Antonio A, Smith SM, Levin S, Kirkner G, Mayer-Davis E, et al. Successful recruitment and retention strategies for a randomized weight management trial for people with diabetes living in rural, medically underserved counties of South Carolina: the POWER study. J Am Diet Assoc. 2004;104(1):70–5.
Bennett GG, Steinberg D, Askew S, Levine E, Foley P, Batch BC, et al. Effectiveness of an app and provider counseling for obesity treatment in primary care. Am J Prev Med. 2018;55(6):777–86.
Eakin EG, Winkler EA, Dunstan DW, Healy GN, Owen N, Marshall AM, et al. Living well with diabetes: 24-month outcomes from a randomized trial of telephone-delivered weight loss and physical activity intervention to improve glycemic control. Diabetes Care. 2014;37(8):2177–85.
Warner ET, Glasgow RE, Emmons KM, Bennett GG, Askew S, Rosner B, et al. Recruitment and retention of participants in a pragmatic randomized intervention trial at three community health clinics: results and lessons learned. BMC Public Health. 2013;13:192.
Goldman V, Dushkin A, Wexler DJ, Chang Y, Porneala B, Bissett L, et al. Effective recruitment for practice-based research: lessons from the REAL HEALTH-diabetes study. Contemp Clin Trials Commun. 2019;15:100374.
Yank V, Stafford RS, Rosas LG, Ma J. Baseline reach and adoption characteristics in a randomized controlled trial of two weight loss interventions translated into primary care: a structured report of real-world applicability. Contemp Clin Trials. 2013;34(1):126–35.
Raynor HA, Osterholt KM, Hart CN, Jelalian E, Vivier P, Wing RR. Evaluation of active and passive recruitment methods used in randomized controlled trials targeting pediatric obesity. Int J Pediatr Obes. 2009;4(4):224–32.
Wadden TA, Volger S, Sarwer DB, Vetter ML, Tsai AG, Berkowitz RI, et al. A two-year randomized trial of obesity treatment in primary care practice. N Engl J Med. 2011;365(21):1969–79.
Appel LJ, Clark JM, Yeh HC, Wang NY, Coughlin JW, Daumit G, et al. Comparative effectiveness of weight-loss interventions in clinical practice. N Engl J Med. 2011;365(21):1959–68.
Glasgow RE, Nelson CC, Kearney KA, Reid R, Ritzwoller DP, Strecher VJ, et al. Reach, engagement, and retention in an internet-based weight loss program in a multi-site randomized controlled trial. J Med Internet Res. 2007;9(2):e11.
Pagoto SL, Schneider KL, Oleski JL, Luciani JM, Bodenlos JS, Whited MC. Male inclusion in randomized controlled trials of lifestyle weight loss interventions. Obesity (Silver Spring). 2012;20(6):1234–9.
Rounds T, Harvey J. Enrollment challenges: recruiting men to weight loss interventions. Am J Mens Health. 2019;13(1):1557988319832120.
We express gratitude to the providers at staff at the following clinics for their effort and dedication to improving care for patients with obesity and their collaboration on this trial: Ashley Clinic (Chanute, KS), Bacani McKenney Clinic (Fredonia, KS), Beloit Medical Center (Beloit, KS), Belleville Medical Clinic (Belleville, KS), Blue Hill Medical Clinic (Blue Hill, NE), Bluestem Medical (Quinter, KS), Community Health Center of Southeast KS (Pittsburg, KS), Good Neighbor Community Health Clinic (Columbus, NE), Ellsworth County Medical Center (Ellsworth, KS), Family Medical Center of Hastings (Hastings, NE), Floyd Valley Healthcare (Le Mars, IA), Hastings Family Care (Hastings, NE), Hays Family Medicine, (Hays, KS), Hiawatha Community Hospital Family Clinic (Hiawatha, KS), LifeLine Family Practice (Plainville, KS), Meade Rural Health Clinic (Meade, KS), McPherson Family Practice (McPherson, KS), Omaha VA Nebraska-Western Iowa (Omaha, NE), Prairie Star Family Practice (Plainville, KS), Pratt Family Practice (Pratt, KS), Sabetha Family Practice (Sabetha, KS), Salina Family Healthcare Center (Salina, KS), Scott City Clinic (Scott City, KS), Seneca Family Practice (Seneca, KS), Solomon Valley Family Medicine (Stockton, KS), Stonecreek Family Physicians (Manhattan, KS), WaKeeney Family Care Center (WaKeeney, KS), and clinics within the Marshfield Clinic Health System in Wisconsin: Colby, Ladysmith, Marshfield (Family Medicine, General Internal Medicine, Med-Peds), Merrill,
Park Falls, Stratford, and Wisconsin Rapids.
The trial is funded by the Patient Centered Outcomes Research Institute (OTO-1402-09413). The funder had no role in study design, data collection, analysis or interpretation of data, in the writing of the report, or in the decision to submit the article for publication.
Ethics approval and consent to participate
The study was approved by the University of Kansas Medical Center Institutional Review Board (IRB00000161) and the VA Nebraska-Western Iowa IRB. Written informed consent was obtained from all participants.
Consent for publication
The authors declare that they have no competing interests
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Table S1. Percent of patients from different recruitment sources, among patients who enrolled in the study (n = 1432), by study arm. Table S2. Percent of patients from different recruitment sources among patients who contacted study team (n = 2479), by clinics with high versus low level of involvement. Table S3. Number of patients who were ineligible or declined to participate, as percent of patients screened (n = 1931), by clinics with high versus low level of involvement. Table S4. Demographics and BMI of enrolled participants versus non-participants from clinics with high provider involvement. Table S5. Demographics and BMI of enrolled participants versus non-participants from clinics with low provider involvement. Figure S1. Referral source from 2479 patients who contacted study team. Note: See Fig. 1. for participant flow subsequent to phone screening.
About this article
Cite this article
Befort, C.A., Kurz, D., VanWormer, J.J. et al. Recruitment and reach in a pragmatic behavioral weight loss randomized controlled trial: implications for real-world primary care practice. BMC Fam Pract 21, 47 (2020). https://doi.org/10.1186/s12875-020-01117-w
- Primary care
- Pragmatic randomized clinical trial