Research activity and capacity in primary healthcare: The REACH study: A survey
© Glynn et al; licensee BioMed Central Ltd. 2009
Received: 29 October 2008
Accepted: 11 May 2009
Published: 11 May 2009
Despite increased investment in primary care research and development (R&D), the level of engagement of primary healthcare professionals with research remains poor. The aim of this study is to assess the level of research activity and capacity for research among primary healthcare professionals in a health authority of over one million people in a mixed urban/rural setting in the West of Ireland.
A questionnaire, incorporating the R+D Culture Index, was sent to primary healthcare professionals in the HSE Western Region. Baseline characteristics were analysed with the use of one-way ANOVA and Chi-square test and the dependence of R&D Culture Index score on all sixteen available covariates was examined using multiple regression and regression tree modelling.
There was a 54% response rate to the questionnaire. Primary healthcare professionals appeared to have an interest in and awareness of the importance of research in primary care but just 15% were found to be research active in this study. A more positive attitude towards an R&D culture was associated with having had previous research training, being currently involved in research and with not being a general practitioner (GP) (p < 0.001), but much variability in the R&D culture index score remained unexplained.
Despite awareness of the importance of R&D in primary care and investment therein, primary healthcare professionals remain largely unengaged with the R&D process. This study highlights the issues that need to be addressed in order to encourage a shift towards a culture of R&D in primary care: lack of research training particularly in basic research skills and increased opportunities for research involvement. The use of the R&D Culture Index may enable groups to be identified that may be more research interested and can therefore be targeted in any future R&D strategy.
There is a growing body of evidence demonstrating that the cost-effectiveness of any national health care system is strongly correlated with the strength and position of primary care within that system[1, 2]. To enhance primary care practice, there has been an increasing emphasis on clinical decision making which is based on sound research evidence. That evidence must come at least in part from research carried out within the primary care setting . In addition, when those working in primary care are involved in research and development (R&D), it has been shown that there is an increase in the quality of care provided as well as faster dissemination and adoption of research evidence.
However, the level of engagement of primary care practitioners with research has been traditionally poor [4–6]. The reasons for this are unclear, but attempts to promote a culture of R&D continue to be hindered by the prevailing perception of research as a remote science and the absence of a supporting infrastructure[5, 7, 8]. Historically research in primary care has been under-resourced and marginalized over a prolonged period of time[2, 9]. This has changed more recently with increased funding and support for primary care research in countries such as the UK but the level of engagement of primary healthcare professionals in research activity appears to have remained static during this period[6, 7, 9, 10]. The Republic of Ireland, where this study took place, lags behind the UK in terms of investment in, and outputs from, primary care R&D.
The aim of this study was to assess the current level of research activity and research culture of primary healthcare professionals in a large health authority and to examine the factors affecting aptitude for future research through use of the R&D Culture Index. The R&D Culture Index has been developed to identify personal and organisational development needs and to guide strategy in advancing practitioner engagement with research. However, use of the R&D Culture Index to date has been confined to single professional groupings[11, 12] or has been limited by poor statistical methods[6, 11]. 'Research culture' is used in this context to refer to the capacity of practitioners to engage in R&D activity.
Primary healthcare professionals of the following professional groups working within the Health Services Executive (HSE) Western Region (a health authority of over one million people in a mixed urban/rural setting in the west of Ireland) on June 1st, 2006 were included in the study: community pharmacists; general practitioners (GPs); practice nurses; primary health care managers; public health doctors; public health nurses. Other primary health care professionals in the community were not included in the study due to absence of a centralized database for contact details. Contact details for all of the above primary health care professionals, with the exception of practice nurses, were obtained from local primary care units. Practice nurses are not contracted to the HSE but rather are employed directly by practices and so were contacted through their respective practices. All primary health care professionals were sent a piloted postal questionnaire with a covering letter and stamped addressed envelope. All non-responders were sent a second questionnaire after 4 weeks. This mailing strategy followed the Dillmann techniques in an attempt to maximise response rates among participants.
The postal questionnaire used in the study consisted of three sections. Section A gathered demographic details on participants such as age, gender, qualifications, level of clinical experience, research training and current work status. Section B consisted of the "Research & Development (R&D) Culture Index", a recently developed and validated research tool which is used to assess capacity for and attitude towards research and development among healthcare professionals. Section C assessed level of research engagement and research training needs among participants as well as perceived barriers and levers to participation in research. The R&D Culture Index is an 18-item questionnaire, scored on a four point likert scale from strongly disagree to strongly agree (0–3). Possible scores on the R&D Culture Index range from 0–54 with higher scores indicating a more positive attitude towards an R&D culture. In addition, respondents are asked to identify the five items that they perceive to most strongly contribute to an R&D culture. The statements address three specific domains: personal skills and aptitude towards R&D; working environment facilitatory towards R&D; and organisational infrastructure encouraging R&D. Previous validation has demonstrated a Cronbach alpha coefficient of 0.92 indicating good internal consistency for the whole index.
Baseline characteristics of study participants were analysed with the use of one-way ANOVA for continuous variables and Chi-square test for categorical variables. The primary aim in the analysis was to model the dependence of R&D Culture Index Score on the following sixteen explanatory variables: age, gender, work status, professional group, professional registration, number of years registered, postgraduate qualification, higher training qualification, research training, time in post, research involvement, named applicant on research funding application, named applicant on research ethics application, author of peer-reviewed publication, author of non-peer reviewed publication, presenter of research conference paper. Two different statistical approaches were used; multiple regression (using variable selection techniques) and regression tree modelling. The choice of best model amongst the candidate models was determined using best subsets and stepwise regression. In the tree based analysis the final regression tree derived employed the CART approach. This involved successive binary partitioning of the data set by identifying at each partition the explanatory variable which maximized the between-groups sum-of-squares using analysis of variance. Pruning was based on examining the complexity parameter and cross validation costs using the 1-SE rule. All statistical test values were two-sided, and a P value of less than 0.05 was considered to indicate statistical significance. Analysis was carried out using SPSS (14.0) and R statistical software. Ethical approval was granted by the research ethics committee of the Irish College of General Practitioners.
Baseline characteristics of 498 primary healthcare professionals according to professional group
(n = 286)
(n = 170)
(n = 42)
Mean Age in years (SD)
Female sex (%)
Working full time (%)
Years in Current Post (SD)
≤ 5 years in current post (%)
Formal Research Training (%)
Postgraduate qualification (%)
R&D Index Score
Research and Development Culture
Results of the Research & Development Culture Index (in order of highest agreement)
(n = 437–460)
Ranking for facilitation of R&D Culture
(n = 437) (%)
I would like more opportunities to share professional practice development ideas/research/information across the Health Board
I know how professional practice is influenced by research
I have the skills to use library and learning facilities
If I have an idea to improve clinical or work practice, I have the knowledge and skills to address it
There are opportunities to reflect on my work/practice
Development of my professional practice/work is valued as part of my job
There is an opportunity to develop professional practice in my area
I am very keen to use research in professional practice
I would like to learn more about research activity during the next 6 months
I understand research terminology
There are people around to help and support me to change and develop professional practice
My discipline here works as equal partners with other disciplines to change or develop professional practice
There is strong professional leadership
I have access to training and development opportunities which give me the skills to question and investigate practice
The development work that I do links with the plans of the Health Service Executive and the Primary Care Strategy
I feel confident about using research in my professional practice
I can organise my own time to create opportunities to develop professional practice
There are regular staff meetings to explore ideas
When participants were questioned about involvement with research, 15% reported being currently involved and the majority reported either current or former involvement. In the previous twelve months, 4.5% (22/492) had been named on a research funding application; 4.3% (21/492) had been named on an research ethics committee application; 3.3% (16/492) had been an author of a peer reviewed research publication; 3.3% (16/492) had been an author of a non-peer reviewed research publication; and 7.5% (37/492) had presented a conference research paper. HSE staff were significantly more likely than GPs to have been named on a research ethics committee application (χ2 = 18.3, 2 df, p < 0.001); been an author of a peer reviewed research publication (χ2 = 12.2, 2 df, p = 0.002); or presented a conference research paper (χ2 = 54.8, 2 df, p < 0.001). Nursing staff were significantly less likely than either HSE staff or GPs to be involved in such activities.
Barriers to research involvement and research training
When asked what factors prevented or precluded research involvement or interest, participants reported lack of protected time at work (82%), lack of funding (53%), lack of training (48%), lack of knowledge/research skills (43%) and lack of supervision or support (41%). Clinical staff (GPs and nursing staff) identified lack of protected time (p = .001) and lack of funding (p = .004) as barriers to R&D more frequently than other HSE staff. In terms of promoting personal research involvement, participants placed greatest value on protected time (64%), as well as availability of expert support and supervision (56%), support of a peer group (52%) and training in specific research skills (47%). The research skills training need identified by participants most frequently was in basic research skills.
Research and Development Culture Index Scores
Of the total group, 359 (72%) participants completed the R&D Culture Index giving a mean score of 31.1 (SD = 6.9) with a minimum score of 14 and a maximum score of 53. Mean scores differed significantly (F = 22.08, p < 0.001) across the professional groups with GPs scoring lowest (with a mean score of 29.1). A comparatively higher score on the R&D Culture Index was also associated with being female (t = -3.80, p < 0.001); having a postgraduate qualification (t = -2.83, p = 0.005); being in current post for 5 years or less (t = 3.42, p = 0.001); being part-time (t = -2.29, p = 0.023); having had previous research training (t = 6.83, p < 0.001); and having had some involvement with a research project in the past (t = -2.64, p = 0.009).
There was convincing evidence of a significant association between both conference attendance and research involvement (p < 0.001 in both cases) suggesting that the trees are essentially returning the same information. The Tree based model is more efficient in dealing with missing values and given that the two approaches identify a nearly identical subset of useful explanatory variables, the possibility that the missing values are having an undue influence on the final regression model is remote. The amount of variability in R&D Culture Index score explained by the regression model is relatively low (r2 adjusted = 23%).
Summary of main findings
This study shows that the primary healthcare professionals in this large healthcare authority appeared to have an interest in and awareness of the importance of research in primary care. In a country such as Ireland with an underdeveloped culture of primary care R&D, 15% of primary healthcare professionals remain research active at any one time. However, almost a third of respondents had never been involved in a research project and 90% of respondents had not achieved any 'research milestones' in the past 12 months. This appears to be primarily due to lack of research training particularly in basic research skills. However, 'research involvement' also appears as a strong predictor of a higher R&D Index score. Increased opportunities for research involvement may therefore influence research activity and capacity but such opportunities remain dependent on issues such as training, protected time and funding. A striking result was that GPs, the largest professional group in primary care, appear to have a more negative perception of R&D culture than the other professions in this study. Groups with a more positive perception of R&D culture are more likely to carry out research and so may merit identification and specific support and training when trying to encourage research activity. However, a perceived lack of confidence about using research in practice is apparent. This confidence may be improved by undergoing training in research skills and by increased exposure to a culture of R&D through attendance at conferences and peer research groups. Indeed, the factor most commonly regarded as essential for facilitating a R&D culture was the availability of training and development opportunities, but only about half of the respondents felt that these opportunities were actually available.
Strengths and limitations of this study
This study presents the first available evidence in regard to research activity and capacity among a representative sample of primary healthcare professionals in the Republic of Ireland. Our study had a number of limitations. Firstly, direct contact details for practice nurses were not available as they are not contracted to the HSE but rather are employed directly by practices and so there was no information available for non-responder practice nurses. Secondly, the authors were not able to include in the study other primary health care professionals in the community. Thirdly, the response rate in this study was 54%, thereby limiting external validity. Characteristics of the source population in its entirety could not be established and therefore there is no evidence that the sample in this study is representative of the entire primary healthcare professional population. However, this response rate is comparable to, or better than, other studies using the R&D culture index. Finally, the amount of variability in R&D Culture Index score explained by the statistical models was quite low (r2 adjusted = 23%), suggesting that R&D Culture Index may not be a precise metric for research activity or that other important factors in determining research activity and capacity were not measured.
Comparison with existing literature
Primary healthcare professionals in a primary care Authority in the UK and nurses in an integrated Authority in Northern Ireland prioritised the same contributors to the development of a culture of R&D as in this study. They highlighted the importance of organisational infrastructure and an appropriate working environment in developing research capacity as opposed to personal skills and attributes which were ranked relatively lower, occupying four of the five lowest ranked statements. The proportion of respondents with formal research training (42%) was similar to that reported in a study carried out nearly ten years previously in the UK (38%), probably reflecting the underdeveloped position of primary care R&D in this country.
The proportion of primary healthcare professionals involved in research at any one time appears remarkably consistent when compared to international literature. The figure in this study (15%) is similar to that reported previously[6, 7, 10]. However, the ability to publish in peer-reviewed journals over a twelve month period (3%) was lower than that previously reported by Whitford (4%), Robinson (4%) and Jowett (9%). The Mant report confirmed this under-performance in terms of output in Irish primary care compared to the UK despite the fact that, as this study suggests, a similar proportion of primary healthcare professionals appear to be involved in research in both settings. It is likely that the major drivers of research output and the major R&D supports for primary healthcare professionals do not arise from within primary care but from external sources such as government, universities and funding bodies.
Implications for future research and clinical practice
The continued low level of interaction of GPs with primary care research is worrying as it will contribute further to the decline in enquiry-led research. The Mant report suggested that Ireland was underperforming in the conduct of R&D in primary care. Our results confirm this and suggest that Irish GPs are especially resistant to the development of a R&D culture. However, the R&D Culture Index can be a useful tool to identify groups in primary care that should be targeted in order to encourage research involvement. Once these groups have been targeted, any programme to encourage research involvement will need to take place in the context of protected time. The correlation of a high score in the R&D Culture Index with current research involvement in this study and with recent research activity in a previous study, suggests that the index functions as a marker of both research interest and activity. A prospective study comparing scores from the R&D Culture Index with research activity would be useful to confirm its use in this respect. However, much variability in scoring remains unexplained and requires further investigation particularly in the case of GPs as a professional group. While not examined in this study, further to the generation of research within primary care, it is also essential to recognise the importance of the use of research in this sector of healthcare. Increased use of research within a practice may foster a culture of research, which may encourage research activity. Therefore, further studies regarding the use of research in practice would be of benefit.
It may be unreasonable to assume that a culture supportive of research and development can be established rapidly; however, a culture that perceives clinical practice and research as entirely separate activities is unsustainable and outdated. This study helps to highlight the issues that need to be addressed in order to encourage such a cultural shift, primarily more research training and support particularly in basic research skills and to the opportunity to become research involved. Despite such challenges, primary healthcare professionals, given the appropriate environment, are willing and able to engage in R&D activity. This study also helps to identify a possible target population of professionals for any future R&D strategy, thus increasing the likelihood of any such R&D strategy achieving enduring success.
We wish to acknowledge funding received from the HSE Western Region (Northern, Western and Midwestern Areas), the Health Research Board and the Irish College of General Practitioners to conduct this work. COR was awarded a HRB summer scholarship to participate in this study.
We thank Catherine Duffy (Western HSE Area), Noel Scott (Northwestern HSE Area), John Cullinane (Midwestern HSE Area) and Teresa McGuire (Health Research Board) for their interest and support; Una St. John, Breda Kelleher and Mary McQuinn for their efficency and peerless administrative support; Professor Charlotte Clarke for her permission to use the R+D culture index developed at Northumbria University and finally, we are especially grateful to all primary healthcare professionals who participated in the study.
- Starfield B: Primary Care: Balancing health needs, services and technology. 1998, Oxford: Oxford University PressGoogle Scholar
- Mant D: Primary Care R&D in Ireland. 2006, Dublin: Health Research BoardGoogle Scholar
- R&D in Primary Care – National Working Group: R&D inPrimary Care – National Working Group Report. 1997, Leeds: UK Department of HealthGoogle Scholar
- Funk SG, Champagne MT, Wiese RA, Tornquist EM: BARRIERS: The Barriers to research Utilisation Scale. Applied Nursing Research. 1991, 4: 39-45. 10.1016/S0897-1897(05)80052-7.View ArticlePubMedGoogle Scholar
- Parahoo K: Barriers to, and facilitators of, research utilization among nurses in Northern Ireland. Journal of Advanced Nursing. 2000, 31: 89-98. 10.1046/j.1365-2648.2000.01256.x.View ArticlePubMedGoogle Scholar
- Whitford DL, Walker C, Jelley D, Clarke CL, Watson B: Developing R&D capacity in a primary care trust: Use of the R&D culture index. Primary Health Care Research and Development. 2005, 6: 110-116. 10.1191/1463423605pc231oa.View ArticleGoogle Scholar
- Jowett SM, Macleod J, Wilson S, Hobbs FDR: Research in primary care: extent of involvement and perceived determinants among practitioners from one English region. British Journal of General Practice. 2000, 50: 387-389.PubMedPubMed CentralGoogle Scholar
- LeMay A, Mulhall A, Alexander C: Bridging the research-practice gap: exploring the research cultures of practitioners and managers. Journal of Advanced Nursing. 1998, 28: 428-437. 10.1046/j.1365-2648.1998.00634.x.View ArticleGoogle Scholar
- Mant D: R&D in primary care – an NHS priority. British Journal of General Practice. 1998, 48: 871-PubMedPubMed CentralGoogle Scholar
- Robinson G, Gould M: What are the attitudes of general practitioners towards research?. British Journal of General Practice. 2000, 50: 390-392.PubMedPubMed CentralGoogle Scholar
- Glacken M: Research and development in a Northern Ireland Trust. Nursing Standard. 2002, 16: 33-37.View ArticlePubMedGoogle Scholar
- Watson B, Clarke C, Swallow V, Forster S: Exploratory factor analysis of the research and development culture index among qualified nurses. Journal of Clinical Nursing. 2005, 14: 1042-1047. 10.1111/j.1365-2702.2005.01214.x.View ArticlePubMedGoogle Scholar
- Dillman DA: Mail and Internet Surveys, The tailored design method. 2000, New York: John Wiley and Sons, 2Google Scholar
- Kutner MH, Nachtsheim CJ, Neter J, Li W: Applied Linear Statistical Models. 2004, Chicago, Illinois: McGraw-Hill/Richard D. Irwin, Inc., 5Google Scholar
- Breiman L, Friedman JH, Olshen RA, Stone CJ: Classification and regression trees. 1984, Monterey, CA: Wadsworth & Brooks/Cole Advanced Books & SoftwareGoogle Scholar
- O'Dowd T: Research in general practice: who is calling the tune?. British Journal of General Practice. 1995, 45: 515-516.PubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2296/10/33/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.