Skip to main content


What research agenda could be generated from the European General Practice Research Network concept of Multimorbidity in Family Practice?



Multimorbidity is an intuitively appealing, yet challenging, concept for Family Medicine (FM). An EGPRN working group has published a comprehensive definition of the concept based on a systematic review of the literature which is closely linked to patient complexity and to the biopsychosocial model. This concept was identified by European Family Physicians (FPs) throughout Europe using 13 qualitative surveys. To further our understanding of the issues around multimorbidity, we needed to do innovative research to clarify this concept. The research question for this survey was: what research agenda could be generated for Family Medicine from the EGPRN concept of Multimorbidity?


Nominal group design with a purposive panel of experts in the field of multimorbidity. The nominal group worked through four phases: ideas generation phase, ideas recording phase, evaluation and analysis phase and a prioritization phase.


Fifteen international experts participated. A research agenda was established, featuring 6 topics and 11 themes with their corresponding study designs. The highest priorities were given to the following topics: measuring multimorbidity and the impact of multimorbidity. In addition the experts stressed that the concept should be simplified. This would be best achieved by working in reverse: starting with the outcomes and working back to find the useful variables within the concept.


The highest priority for future research on multimorbidity should be given to measuring multimorbidity and to simplifying the EGPRN model, using a pragmatic approach to determine the useful variables within the concept from its outcomes.


The number of people suffering from multiple conditions (multimorbidity) is rising rapidly especially in family medicine (FM) [1]. The concept of multimorbidity was first described in the 1970s [2]. It was, at that time, an addition to the concept of comorbidity, with the intention of looking at all the conditions in one individual [35]. Nevertheless, the concept remained unclear, especially for research and practical purposes [6, 7]. The World Health Organisation (WHO), in 2008, tried to clarify the concept and defined Multimorbidity as people being affected by two or more chronic health conditions [8]. The intention of the WHO was to look at all conditions in one individual that could impact on that individual’s global health status. However the word’condition’ was not sufficiently clear for research or practical purposes (for instance, whether a treated disease was a ‘condition’ in this sense), and could lead to numerous interpretations.

Despite those interpretations, multimorbidity is a very interesting and challenging concept, particularly for FM and long-term care, given the increasing prevalence of chronic illness in an aging population across all countries. It is closely related to a global or comprehensive view of the patient, which is a core competency of FM, as defined for instance by the World Organization of National Colleges, Academies and Academic Associations of General Practitioners/Family Physicians (WONCA) [9]. It is also a global ‘functional’ or ‘goal-oriented’ view (useful for Long-Term Care) versus a ‘disease’ centered point of view (useful for acute care). Nevertheless, the disease centered point of view remains the basis of most clinical guidelines even if it is not fully applicable in FM [10, 11].

The European General Practice Research Network (EGPRN) was very interested in the concept of multimorbidity as this network is committed to concepts that could advance research and practice in primary care throughout Europe. The EGPRN has created a research agenda specifically designed for methodological and instrumental research, which includes the development of primary care epidemiology, focusing on patient-centered health [12]. A clear definition of the concept of multimorbidity (i.e., one which is both understandable and usable for further collaborative research) is an important objective for a research network of this type. It aims to help researchers in FM to investigate the complexity of patients’ conditions and their overall impact on patients’ health. A clear definition of multimorbidity could be an additional tool for Family Physicians (FPs), enabling them to identify frail patients and prevent decompensation [13]. A specific research agenda could be developed for multimorbidity.

A research group, including 9 national groups, all active within the EGPRN, has created a research community for the purpose of clarifying the concept of multimorbidity for FM throughout Europe [14]. An initial review, presented in an EGPRN meeting in spring 2011 [15], identified more than one hundred different definitions used by academic researchers. Such a large number of definitions added more confusion than clarification to the discussion and led the group to the production of a comprehensive definition of the concept of multimorbidity with the help of a systematic review of literature [16].

It was then necessary to assess whether Family Physicians (FPs) recognized this concept, which had emerged from medical research, as applicable to their complex patients. FPs are well-placed to identify this concept as they aim to be more aware of their patients’ expectations than other specialists [17] and they are used to dealing with complex patients [18, 19]. In order to make this assessment, the comprehensive definition of Multimorbidity was carefully translated into 10 European languages with the help of a forward-backward translation procedure using a Delphi consensus methodology [20]. Those translated definitions were presented to European FPs with 13 consecutive qualitative surveys, designed to check how the FPs experienced and worked with the developed concept of multimorbidity and whether this was fully consistent with the definition. European FPs clarified the concept and added the role of gut feelings, core competencies of FM, and patient and doctor experience, to the management of Multimorbidity. A comprehensive concept of multimorbidity for FM was then established.

Researchers in the field of multimorbidity explored innovative research topics, themes, questions and appropriate design formats in relation to the concept of Multimorbidity for FM, leading to the question: what research agenda could be generated for Family Medicine from the EGPRN concept of Multimorbidity?


For this study we used a qualitative research method, i.e., a nominal group technique (NGT) [21]. This technique was chosen because multimorbidity is conceptually complex. The NGT enables researchers to gather information from relevant experts [22, 23]. NGT facilitates creative problem solving by means of judgmental decision making in situations where routine answers are inadequate [24]. With an NGT, it is possible to plan research through group meetings or by email [25]. The ethical committee of the “université de Bretagne occidentale” gave the ethical approval for the whole process as this university led the study. Informed consent was obtained from all participants even if it was a non-interventional study. NGT is a well-known technique that has already been used by members of the research group [26].

With an international group, adaptations were needed and an email system was used as it had already been successfully employed in several earlier studies [2729]. An NGT involves four phases: ideas generation phase, ideas recording phase, evaluation and analysis phase and a prioritization phase.

Type of participants and selection of experts

An international panel of experts in the field of multimorbidity was purposively sampled. The NGT does not require a fixed number of experts in order to be valid but does require relevant experts. To be relevant, those experts should have prior experience in the field of the research in question (multimorbidity, FM, patient-centered care). The group was selected from three backgrounds: The EGPRN, the Threads and Yarns network members (a group designed for research into the field of multimorbidity), and researchers in multimorbidity from Polish, Dutch and British Universities. The group was made up of FM clinicians, researchers in FM and linguistics, methodologists and epidemiologists. Some individuals were involved in two different groups. 18 experts were approached by email. 18 were willing to cooperate and received written information. We invited them to participate and 15 accepted. Reasons for declining were prior engagements and illness.

NGT sessions

For ideas generation, experts were asked to read the publications about the concept of Multimorbidity produced by the EGPRN (protocol [14], systematic review [16], translations [20] and qualitative surveys). Then they were asked to take time and write down what they regarded as the main research questions relating to the “concept of Multimorbidity issued by the EGPRN”. At the same time, they were asked to present an appropriate design for each research question, with a commentary to make it easily understandable by each participant. Each expert could produce a maximum of five propositions, arising from that definition, with a design and a commentary for each. The aim was to leave this process wide open in order to elicit the widest possible variety of responses.

In the ideas recording phase participants were engaged in a round-robin feedback system by email. All the propositions were sorted, with their designs and commentaries, and classified to detect duplicates. Duplicates were summarized and sent back to the planners to check that they were compatible with the planners’ initial intentions. Where necessary, corrections were made to the questions, designs and commentaries.

The evaluation and analysis phase was undertaken to identify and clarify research topics and themes and to develop designs. All the propositions were classified into research topics and themes and then summarized by an independent group of 6 researchers from the SPURBO research team (Université de Bretagne Occidentale). These 6 researchers’ propositions were sent to all participants for agreement before any further development. Then designs were developed, for each research theme and topic, by their proposers. The designs were sent back to all the participants for analysis. Where necessary, it was possible to have open discussions, by email, between members so that submitted propositions could be clarified. These emails were sent out to all the participants so that all the members received clarification on each proposition.

The intention of the prioritization phase was to aggregate the judgment of the experts in order to determine the relative importance of the research questions, and corresponding designs for future research relating to the concept of Multimorbidity produced by the EGPRN. All participants were asked to rank the propositions, according to the level of importance they attached to them, for FM and patient centered care. They had the opportunity to apply 3 scores: a score of 5 points for one proposition, a score of 3 points for another and a score of 1 point for the final proposition. A prioritized list of all the propositions was drawn up from these scores. This prioritized list was sent back to all the participants in order to evaluate the procedure and the outcomes and to collect objections, should any arise.


Description of participants

In total, 15 experts participated in the study, 7 men and 8 women from different countries, including Bulgaria, Croatia, France, Germany, Greece, Italy, Poland, Spain and the UK. Their average age was 49 years (ranging from 35 to 62 years). All clinicians (14 out of 15) had an average of 19.8 years’ practice experience (ranging from 4 to 33 years), with 10 working in group practices, mostly in urban areas. Methodologists, linguists and epidemiologists were also experienced, with an average of 38.5 published articles. They all had experience of publishing articles, with an average of 34 published articles (ranging from 6 to70), of which an average of 16 were in English (ranging from 3 to 65). Participants had had an average of 5 articles published with multimorbidity as a major topic (ranging from 1 to15).

Description of results

The ideas generation and ideas recording phase produced 61 research questions and study designs after duplicates had been withdrawn. Although there was considerable overlap in the ideas, the evaluation and analysis phase aggregated those 61 research questions into 11 themes, including 6 major topics, with their attached research questions and designs. The prioritization phase produced a consensual ranking of the topics and themes. The total score possible, by adding up the points of all 15 experts, was 135. Topics, themes and study design, with their ranking, are described in Table 1 below.

Table 1 Topics, Themes and design ranked by participants’ votes

The research questions suggested for the multimorbidity research agenda are listed, by topic, in Table 2 below.

Table 2 Proposed research questions for the different topics and themes


Main findings

With the help of a nominal group technique, the research team was able to establish a research agenda on Multimorbidity in Family Practice. 6 topics and 11 themes were listed with their corresponding designs (see Table 1). Overall, the highest priorities were given to the following topics: measuring Multimorbidity and the impact of Multimorbidity (see Table 2).

The measurement of Multimorbidity is seen as the most important topic when totaling the votes for the different themes included. The impact of Multimorbidity on patient or health outcomes is seen by the research group as the most important theme for future research, even if it is included in the second topic to research (Impact of Multimorbidity). The management of multimorbidity in practice is seen as the third most important topic.


The measurement of Multimorbidity has been explored considerably over the past 10 years and has often been divergent as the authors did not use the same definition of this concept [7, 30]. With the EGPRN concept of multimorbidity, this pitfall could be avoided, especially if an expert consensus could be obtained on the effect of the burden of diseases on multimorbidity (see Table 1). The effect of the burden of diseases on multimorbidity was a secondary research theme in this survey (7th theme to be researched) but could also be of major importance for the measurement of Multimorbidity. Although it has already been the subject of many studies [30, 31], practitioner input has, so far, been limited. Most of our experts are also practicing FPs and confirm the importance of this topic.

An alternative way of measuring multimorbidity, for this study’s experts, was to determine the impact of multimorbidity on negative health outcomes (such as frailty, depression, cost of care, health service use). The impact of multimorbidity was, according to the experts in this study, for the patient, the clinical, negative result of being Multimorbid. It is a reverse way of determining multimorbidity. The burden of diseases could determine whether a patient is multimorbid and the impact of multimorbidity will determine the effect of multimorbidity on a patient’s life. This alternative route could lead a research team to define the most effective variables that contribute to the concept of multimorbidity to help prevent those negative outcomes. In addition, it could simplify the concept when it is aimed at a specific outcome, to help clinicians in everyday practice. This was an attractive issue for most experts. It could resolve the debate about measuring a concept as broad as multimorbidity seems to be. Many studies have been conducted to assess the relationship between multimorbidity and health outcomes but without solving the problem of the meaning and the intensity of that relationship [32, 33].

The results underline the usefulness of the patient’s perception of his/her own multimorbidity which could be an alternative way to weigh and measure multimorbidity. This perception has rarely been explored [34]. The experts emphasized this fourth topic for future research and its importance for them. They were stimulated by their own practice experience and by their need to integrate the patients’ perspective as a key element of the decision making process. They felt that the patient’s perception was one way to enhance the coping strategies of the patient which is of importance in the EGPRN definition of multimorbidity: to lower the level of multimorbidity.

How to improve the management of multimorbidity in everyday practice seemed of importance to our experts, as a research theme, and this management focus could be linked to patient complexity, as both are important issues for family medicine. Using the concept of multimorbidity as an aid for detecting and managing patient complexity may be a new pathway for research.

The final topic took into account all the stakeholders’ perspectives, which should be incorporated into all the research, as stakeholders reflect population needs [4].

Strengths and limitations

Nominal group technique has already been used as a method to generate ideas for study designs [35]. It is an efficient technique to gather specific ideas about difficult research questions. The benefit of nominal group technique is that all experts have an equal opportunity to participate and influence the decision. It reduces the conforming common influence of face-to-face group meetings.

The study team tried to be as open as possible in the data collection. Information bias was limited as all the experts had open access to all the information. This bias was still possible because their prior researches in the field of multimorbidity could influence their prioritization. To handle that possible bias, throughout the entire process, the research team stimulated open discussion and interaction through regular face-to-face meetings. Selection bias was limited by the use of a pan-European panel of researchers, with real experience of multimorbidity research, assessed by specific publications, as well as experience in practicing as FPs.


Results allow researchers to start relevant and, it is hoped, high-quality studies using the EGPRN concept of multimorbidity, avoiding difficulties previously encountered in research into multimorbidity, to detect and measure it in practice. They highlight the connection between multimorbidity and complexity which could lead to specific recommendations for the complex patients, often seen in Family Medicine, whose situation has rarely been explored in research up to now. They increase the possibility of using reverse methods, starting from the outcomes, or the patient’s perspective, or the stakeholder’s perspective, and working back to the variables in the concept which are useful for research, in order to create pragmatic models for multimorbidity.

They also open up a new aim for practitioners: multimorbidity could help them in managing patients, by using a more holistic and goal-oriented approach as the EGPRN concept of multimorbidity is closely related to the biopsychosocial model [36]. The aim would be to place the exchange with the patient at the center of the clinical consultation process rather than allocate it a supporting role [37].

They also open new perspectives in medical education, focusing on the patient’s perspective which is a core competency for Family Practice, as specified in the WONCA Family Practice competencies [9].


Using a Nominal Group technique, a research agenda is now available for further research into Multimorbidity. The highest priority should be given to measuring multimorbidity and to simplifying this model, using the outcomes of a pragmatic approach to determine the useful variables of this concept.



Family medicine


Family physicians


European General Practice Research Network


Nominal Group Technique


World Organization of National Colleges, Academies and Academic Associations of General Practitioners/Family Physicians


  1. 1.

    Fortin M, Bravo G, Hudon C, Vanasse A, Lapointe L. Prevalence of multimorbidity among adults seen in family practice. Ann Fam Med. 2005;3:223–8.

  2. 2.

    Brandlmeier P. Multimorbidity among elderly patients in an urban general practice. ZFA. 1976;52:1269–75.

  3. 3.

    Starfield B. Global health, equity, and primary care. J Am Board Fam Med. 2007;20:511–3.

  4. 4.

    Beasley JW, Starfield B, van Weel C, Rosser WW, Haq CL. Global health and primary care research. J Am Board Fam Med. 2007;20(6):518–26.

  5. 5.

    Boyd CM, Shadmi E, Conwell LJ, Griswold M, Leff B, Brager R, et al. A pilot test of the effect of guided care on the quality of primary care experiences for multimorbid older adults. J Gen Intern Med. 2008;23(5):536–42.

  6. 6.

    Fortin M, Lapointe L, Hudon C, Vanasse A. Multimorbidity is common to family practice: is it commonly researched? Can Fam Physician. 2005;51:244–5.

  7. 7.

    Fortin M, Soubhi H, Hudon C, Bayliss EA, van den Akker M. Multimorbidity’s many challenges. BMJ. 2007;334(7602):1016–7.

  8. 8.

    World Health Organization. The World Health Report 2008. Primary Health Care - Now more than ever. Geneva: World Health Organization; 2008. p. 8.

  9. 9.

    European Academy of Teachers in General Practice (Network within Wonca Europe). the european definition of general practice/family medicine. WONCA; 2002. Available from: Accessed 1 may 2015.

  10. 10.

    Huber M, Knottnerus JA, Green L, van der Horst H, Jadad AR, Kromhout D, et al. How should we define health? BMJ. 2011;343:d4163.

  11. 11.

    Reuben DB, Tinetti ME. Goal-oriented patient care--an alternative health outcomes paradigm. N Engl J Med. 2012;366(9):777–9.

  12. 12.

    Hummers-Pradier E, Beyer M, Chevallier P, Eilat-Tsanani S, Lionis C, Peremans L, et al. Series: The research agenda for general practice/family medicine and primary health care in Europe. Part 4. Results: specific problem solving skills. Eur J Gen Pr. 2010;16(3):174–81.

  13. 13.

    Rougé Bugat M-E, Cestac P, Oustric S, Vellas B, Nourhashemi F. Detecting Frailty in Primary Care: A Major Challenge for Primary Care Physicians. J Am Med Dir Assoc. 2012;13:669–72.

  14. 14.

    Le Reste JY, Nabbe P, Lygidakis C, Doerr C, Lingner H, Czachowski S, et al. A Research Group from the European General Practice Research Network (EGPRN) Explores the Concept of Multimorbidity for Further Research into Long-Term Care. J Am Med Dir Assoc. 2012;14(2):132–3.

  15. 15.

    Le Reste JY. The FPDM (family practice depression and Multimorbidity) Study: Project for systematic review of literature to find criteria for multimorbidity definition. Eur J Gen Pr. 2011;17(3):180.

  16. 16.

    Le Reste J, Nabbe P, Manceau B, Lygidakis C, Doerr C, Lingner H, et al. The European General Practice Research Network presents a comprehensive definition of Multimorbidity in Family Medicine and Long-Term Care, following a systematic review of relevant literature. J Am Med Dir Assoc. 2013;14(5):319–25.

  17. 17.

    Wittkampf KA, van Zwieten M, Smits FT, Schene AH, Huyser J, van Weert HC. Patients’ view on screening for depression in general practice. Fam Pract. 2008;25(6):438–44.

  18. 18.

    Innes AD, Campion PD, Griffiths FE. Complex consultations and the “edge of chaos”. Br J Gen Pract. 2005;55(510):47–52.

  19. 19.

    Britt HC, Harrison CM, Miller GC, Knox SA. Prevalence and patterns of multimorbidity in Australia. Med J Aust. 2008;189(2):72–7.

  20. 20.

    Le Reste JY, Nabbe P, Rivet C, Lygidakis C, Doerr C, Czachowski S, et al. The European general practice research network presents the translations of its comprehensive definition of multimorbidity in family medicine in ten European languages. PLoS One. 2015;10(1):e0115796.

  21. 21.

    Hastie R, Kameda T. The robust beauty of majority rules in group decisions. Psychol Rev. 2005;112(2):494–508.

  22. 22.

    Jones J, Hunter D. Consensus methods for medical and health services research. BMJ. 1995;311(7001):376–80.

  23. 23.

    Gallagher M, Hares T, Spencer J, Bradshaw C, Webb I. The nominal group technique: a research tool for general practice? Fam Pract. 1993;10(1):76–81.

  24. 24.

    Carney O, McIntosh J, Worth A. The use of the Nominal Group Technique in research with community nurses. J Adv Nurs. 1996;23(5):1024–9.

  25. 25.

    Letrilliart L, Vanmeerbeek M. À la recherche du consensus: quelle méthode utiliser? Exercer. 2011;99(99):170–7.

  26. 26.

    Cadier S, Le Reste J-Y, Barraine P, Chiron B, Barais M, Nabbe P, et al. Création d’ une liste hiérarchisée d’ objectifs par la méthode du groupe nominal. Exercer. 2011;22(97):80–4.

  27. 27.

    Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7(1):10.

  28. 28.

    Castanheira L, Fresco P, Macedo AF. Guidelines for the management of chronic medication in the perioperative period: systematic review and formal consensus. J Clin Pharm Ther. 2011;36(4):446–67.

  29. 29.

    Krüger AJ, Lockey D, Kurola J, Di Bartolomeo S, Castrén M, Mikkelsen S, et al. A consensus-based template for documenting and reporting in physician-staffed pre-hospital services. Scand J Trauma Resusc Emerg Med [Internet]. 2011 Jan [cited 2014 Aug 14];19:71. Available from: Accessed 14 Sept 2015

  30. 30.

    Fortin M, Hudon C, Dubois M-F, Almirall J, Lapointe L, Soubhi H. Comparative assessment of three different indices of multimorbidity for studies on health-related quality of life. Health Qual Life Outcomes. 2005;3:74.

  31. 31.

    Valderas JM, Starfield B, Sibbald B, Salisbury C, Roland M. Defining comorbidity: implications for understanding health and health services. Ann Fam Med. 2009;7(4):357–63.

  32. 32.

    Foguet-Boreu Q, Violan C, Roso-Llorach A, Rodriguez-Blanco T, Pons-Vigués M, Muñoz-Pérez MA, et al. Impact of multimorbidity: acute morbidity, area of residency and use of health services across the life span in a region of south Europe. BMC Fam Pract. 2014;15(1):55.

  33. 33.

    Smith SM, O’Kelly S, O’Dowd T. GPs’ and pharmacists' experiences of managing multimorbidity: a “Pandora”s box’. Br J Gen Pract. 2010;60(576):285–94.

  34. 34.

    Noël PH, Parchman ML, Williams JW, Cornell JE, Shuko L, Zeber JE, et al. The challenges of multimorbidity from the patient perspective. J Gen Intern Med. 2007;22 Suppl 3:419–24.

  35. 35.

    Stolper E, Leeuwen YVAN, Royen PVAN, Wiel MVANDE, Bokhoven MVAN, Houben P, et al. Establishing a European research agenda on “gut feelings” in general practice. A qualitative study using the nominal group technique. Eur J Gen Pract. 2010;16(2):75–9.

  36. 36.

    Borrell-Carrió F, Suchman AL, Epstein RM. The biopsychosocial model 25 years later: principles, practice, and scientific inquiry. Ann Fam Med. 2004;2(6):576–82.

  37. 37.

    Muth C, van den Akker M, Blom JW, Mallen CD, Rochon J, Schellevis FG, et al. The Ariadne principles: how to handle multimorbidity in primary care consultations. BMC Med. 2014;12(1):223.

Download references


We would like to thank all FPs who participated in the research process throughout Europe and all trainees in FM from Brest University who participated in the research process and Mrs. Alex Gillman for her accurate translations.

Author information

Correspondence to JY Le Reste.

Additional information

Competing interest

The study had a Grant of 8000 Euros from the EGPRN. No non-financial competing interest to declare.

Authors’ contributions

LRJY designed the study, collected data, led meetings, drafted the article and submitted it for publication. NP designed the study, collected data, led meetings and reviewed the article. LH collected data and reviewed the article. KLD collected data and reviewed the article. RA collected data and reviewed the article. MM collected data and reviewed the article. SA collected data and reviewed the article. LC collected data and reviewed the article. DC collected data and reviewed the article. CS collected data and reviewed the article. AS collected data and reviewed the article. VJ collected data and reviewed the article. LFB designed the study, assembled themes and topics and reviewed the article. DJ, designed the study, assembled themes and topics and reviewed the article. JT, collected data, assembled themes and topics and reviewed the article. ME, collected data, assembled themes and topics and reviewed the article. BP, collected data, assembled themes and topics and reviewed the article. OM, collected data, assembled themes and topics and reviewed the article. LC designed the study and reviewed the article. VRP designed the study and reviewed the article. VMH designed the study and reviewed the article. All authors read and approved the final manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Le Reste, J., Nabbe, P., Lingner, H. et al. What research agenda could be generated from the European General Practice Research Network concept of Multimorbidity in Family Practice?. BMC Fam Pract 16, 125 (2015).

Download citation


  • Research Agenda
  • Core Competency
  • Family Practice
  • Biopsychosocial Model
  • Nominal Group Technique