This article has Open Peer Review reports available.
Referring patients to specialists: A structured vignette survey of Australian and British GPs
© Jiwa et al; licensee BioMed Central Ltd. 2008
Received: 21 August 2007
Accepted: 15 January 2008
Published: 15 January 2008
In Australia and in the United Kingdom (UK) access to specialists is sanctioned by General Practitioners (GPs). It is important to understand how practitioners determine which patients warrant referral.
A self-administered structured vignette postal survey of General Practitioners in Western Australia and the United Kingdom. Sixty-four vignettes describing patients with colorectal symptoms were constructed encompassing six clinical details. Nine vignettes, chosen at random, were presented to each individual. Respondents were asked if they would refer the patient to a specialist and how urgently. Logistic regression and parametric tests were used to analyse the data
We received 260 completed questionnaires. 58% of 'cancer vignettes' were selected for 'urgent' referral. 1632/2367 or 69% of all vignettes were selected for referral. After adjusting for clustering the model suggests that 38.4% of the variability is explained by all the clinical variables as well as the age and experience of the respondents. 1012 or 42.8 % of vignettes were referred 'urgently'. After adjusting for clustering the data suggests that 31.3 % of the variability is explained by the model. The age of the respondents, the location of the practice and all the clinical variables were significant in the decision to refer urgently.
GPs' referral decisions for patients with lower bowel symptoms are similar in the two countries. We question the wisdom of streaming referrals from primary care without a strong evidence base and an effective intervention for implementing guidelines. We conclude that implementation must take into account the profile of patients but also the characteristics of GPs and referral policies.
In Australia, as in the United Kingdom (UK), patients can only access specialists after referral by a General Practitioner (GP) but notwithstanding these similarities there are marked differences in health care organisation. In Australia, there are two health care systems:
▪ A clearly defined public hospital system manages the health care needs of the entire population. Access to hospital specialists follows referral from GPs;
▪ A private hospital system manages patients with private health insurance, currently estimated to cover 44% of the population . Access is also via referral by GPs however appointments in most cases are usually offered much more speedily than in the publicly funded hospital sector.
In Britain there are also two health care systems:
• A universally available and 'free at the point of use' National Health Service. Paid for by general taxation and used by the overwhelming majority of the population;
• A small private health care sector with only 11% of the population covered by health insurance .
Where cancer enters a GP's differential diagnosis, rapid access to specialists in the England is guaranteed for patients with signs and symptoms outlined in government guidelines . In Australia no such arrangements exist and the scheduling of appointments to a publicly funded hospital is governed by local specialists based on the clinical details relayed in a referral letter. Whatever the context, it is generally acknowledged that there are substantial gaps between the best evidence and the management patients receive from doctors .
Colorectal cancer is an important public health problem globally with nearly one million new cases diagnosed world-wide each year and half a million deaths . The best known symptoms of this cancer, namely persistent diarrhoea and episodes of rectal bleeding, are also common although the vast majority of people who experience such symptoms do not have cancer. In most cases a diagnostic colonoscopy is indicated to rule out malignancy rather than to confirm the clinical impression of cancer. However in recent years researchers suggest that it may be possible to identify those who are at higher risk of cancer from their symptom profile. Most colorectal cancers are diagnosed in patients over 65 years of age, in other words older than those currently eligible for government funded colorectal screening in Australia or the UK. Therefore the majority of cases will be diagnosed after medical consultation with symptoms rather than picked up at screening while asymptomatic. Few symptomatic people with lower bowel symptoms in Australia or Britain consult a medical practitioner and very few of these are referred for further investigation and definitive diagnosis to a specialist . Of those symptomatic people who consult a GP, most can be managed without specialist advice but others are overlooked who would benefit [7, 8].
It has been suggested that there is a wide variation in the way Australian GPs manage colorectal symptoms and by corollary, this may disadvantage some patients . Data from the UK also suggest that cancer referral guidelines do not appear to have changed referral practice in Britain or outcomes for cancer patients . In this structured vignette survey of GPs we aim to explore the impact of a variety of clinical and respondent characteristics on GPs' decision to refer patients with lower bowel symptoms.
Ethics approval was granted in Australia by the ethics committee of the University of Western Australia (Ref: RA/4/1/1462) and in the UK by the North Sheffield LREC (NS 2004 2 1861). Return of the completed questionnaire was considered consent to participate in the survey.
A self-administered postal survey was carried out. Self-administered questionnaires have the advantage of dealing better with sensitive issues where anonymity is assured. Vignettes also capture something approximating a real-life situation and allow some degree of contextualization when considering the issues . The value of this approach is also that we removed the confounding effect of doctor-patient miscommunication. Vignettes or 'stories' about patients with colorectal symptoms were constructed to include six clinical details with two possible variations. Therefore there were 64 potential scenarios to cover each of the possible combinations . The vignettes were presented to the sample in an 'incomplete-within-blocks' design to reduce the number of vignettes presented to each respondent to nine.
Scenarios for 'cancer' patients were based on features of colorectal cancer as incorporated in UK national clinical guidelines and reflect guidance to Australian GPs [13, 14]. Respondents were told that the patient in question did not have private health insurance in order to explore differences in decision making focusing on clinical rather than organisational issues. This implied the patient would have to be referred to a 'public' hospital where in both countries the patient would incur no charges and the appointment would be subject to the clinical need. Each respondent was potentially presented with two cases in which the evidence recommends an urgent referral:
1. Unexplained iron deficiency anaemia
2. Patient aged greater then 60 years of age with rectal bleeding and or altered bowel habit of at least 6 weeks duration. Although the UK guidelines stress the importance of looser or more frequent bowel motions as the significant change in bowel habit there has been doubt cast that persistent constipation is not a presenting symptom of cancer .
Thirty-eight out of the 64 vignettes contained at least one such scenario, henceforth referred to as 'cancer' vignettes. The other vignettes described cases that the guidelines imply do not constitute high risk cancer patients.
Age of patient (35 years or older than 60 years)
Duration of symptoms (6 weeks or two weeks)
Rectal bleeding (present or absent)
Change in bowel habit (present or absent)
Weight loss (present or absent)
Iron deficiency anaemia. (present or absent)
Each scenario contained similar information but was worded differently in order to introduce freshness to each case.
Demographic data about each respondent collected included:
3. Number of patients seen per week.
5. Number of years in clinical practice
6. Teaching status
7. Geographical location (Metro, outer metro and rural). Outer metropolitan areas are urban centres with populations of around 100,000 people. Rural areas are those serving populations of less than 25,000 .
In order to model up to 13 explanatory variables for one outcome variable we required 154 respondents . We anticipated a 50–60% response rate. Logistic regression was used to examine the relative importance of specific signs, symptoms and risk factors that may influence the decision to refer via the urgent or 'other' pathway. In order to control for clustering, a cluster option was used to estimate robust standard errors. All analysis was performed on Stata V9 .
GPs were recruited at random from the list of practitioners registered at the Royal Australian College of General Practitioners (RACGP) in Western Australia and in the UK from GPs listed in metropolitan areas of North Trent. In Australia recruitment was also designed to include a significant number of rural practitioners. Questionnaires were disseminated by post with a covering letter. Where necessary a reminder questionnaire was sent six weeks after the first mailing. Anonymity was protected, as practitioner identities were coded with only administrative staff able to identify individuals.
Demography of respondents to survey
GP Age Group
Number of years in practice
Full time equivalent GPs in the practice
Vignettes selected for referral
Impact of variables on decision to refer symptomatic patient
1.9 to 14.5
1.1 to 9.3
Years in practice (20+)
1.3 to 6.8
Age in vignette (> 60 years)
2.2 to 4.0
Duration of symptoms (6 weeks)
1.7 to 3.2
7.1 to 19.4
Altered bowel habit
3.5 to 6.9
Iron Deficiency anaemia
5.0 to 10.2
1.9 to 3.7
Vignettes referred 'urgently'
Impact of variables on decision to refer patients urgently
Outer metro location
1.2 to 4.4
1.5 to 5.2
1.1 to 5.0
1.9 to 11.4
4.4 to 53.8
Age in vignette (> 60 years)
2.4 to 4.4
Duration of symptoms (6 weeks)
1.6 to 2.7
3.2 to 6.1
Altered bowel habit
2.8 to 4.8
Iron Deficiency anaemia
2.5 to 4.5
2.9 to 5.3
1.2 to 3.40
The differences in health care organisation were not reflected in a difference in GP decisions about which patients to refer when focused on publicly funded services in these countries. Assuming that a colonoscopy is warranted for unexplained iron deficiency anaemia or for persistent symptoms in an older patient, just over half the cases presented in this study would be referred on the 'correct' pathway and a slightly greater proportion of 'cancer vignettes' selected for 'urgent' referral. However only a quarter of these, were explicitly recognised as warranting an urgent referral because of a higher risk of 'cancer', noting that 38 out of the 64 were intended to be 'cancer vignettes', indicating uncertainty when diagnosing cancer in a population where the condition presents infrequently. Interviews with GPs about managing lower bowel symptoms suggest that the mode of presentation and the disclosure of embarrassing symptoms had a significant influence on the decisions made at consultation . By presenting clinicians explicitly with clinical details we were able to record decisions not influenced by miscommunication. Surprisingly and despite any possible respondent bias, the data are consistent with practice recorded in a review of actual referrals in the locality where this study was conducted in the UK . Ideally we would have liked to validate clinician responses to this survey with observations from their clinical practice but this was not possible within the resources at our disposal.
A reasonable degree of variability was explained by the clinical and respondent variables modelled. The symptom of weight loss exerted considerable influence on the decision to refer patients urgently. Weight loss is a common feature of many cancers and is often a harbinger of poor prognosis . Therefore practitioners may be selecting patients for urgent investigation when the disease is already at a relatively advanced stage. There is some evidence that colorectal cancer patients referred from general practice to public hospitals in Western Australia enter specialist services with advanced disease . Evidence from the UK also suggests guidelines have made little difference to the prognosis of colorectal cancer patients in that country where they are promoted to stream patients for urgent specialist appointments . The impact of 'morbidity' has previously been demonstrated as misleading practitioners at the point of referral. Mitchell and colleagues concluded that referrals to specialists were sometimes based on measures that did not correspond with serious pathology . More recent evidence in studies of colorectal cancer suggests that weight loss is not a marker of advanced disease . However, in the context of upper gastrointestinal cancer weight loss is accepted as indicating poor survival. Therefore patients with so-called 'alarm symptoms' and incurable pathology may be selected for urgent endoscopy while those lesser morbidity but treatable pathology channelled to routine waiting lists . Therefore weight loss is not a sensible reason for referral if early diagnosis of cancer is the goal. That is not to say that patients with marked weight loss do not warrant an early specialist appointment, but weight loss, on current evidence is not a helpful basis on which to refer patients for timely treatment of gastrointestinal cancers.
The influence of patients' characteristics on referral decisions has been widely reported and echo much of the data reported here. In their study of differences in referral rates in the UK Sullivan et al conclude that 'morbidity' is likely to explain some of the variability but much of the variability remains 'unexplained' . However a study of Canadian family practitioners also explored practitioner characteristics and similarly posit that the age and practice location of the referring doctor exert an appreciable impact on referral patterns even within Canada's universal health insurance system . In our data relating to Australian practice these factors were also of interest although with small numbers and no other explanatory data we can only speculate on the reasons.
To politicians, health care managers and the general public guidelines promote evidence based practice, protect patient safety, ensure equity of access and or contain costs. However compliance with existing referral 'guidelines' is a contentious issue. In respect to colorectal cancer, recent research calls into question the value of 'early' referral of patients with 'symptomatic' colorectal cancer. 'Delay' for patients with the recognised 'red flag' symptoms measured in months or up to a year may not inevitably result in a poorer prognosis . The issue of 'red flag' symptoms was also challenged in a systematic review that concluded that clinical features currently listed in guidelines have unacceptably low predictive value . Focusing on practitioner decision making Gabbay and May suggested that doctors do not act on published evidence base but on the anecdotes and unsubstantiated opinions of respected colleagues or personal experience . Our data support the notion that the application of guidelines is moderated, or even negated, by the characteristics of those for whom they are intended. This is important because, in Britain, GPs are involved in prioritising health care expenditure in a so-called 'primary care led' National Health Service and serve as both poacher and game keeper .
In this structured vignette study selection of patients with colorectal symptoms reflects the data from surveys of actual referrals and does not indicate consistently evidence based practice. However despite these similarities in referral behaviour the observed outcomes for colorectal cancer are moderately better in Australia than they are in the UK . We speculate as others have done that this may be because GPs have greater access to urgent colonoscopy in Australia, perhaps via the private health care sector . We conclude that practitioners should have access to rapid appointments for those patients whose symptoms are worrisome either because of morbidity or because the patient may benefit from curative therapy. This calls into question the wisdom of streaming referrals from primary care without effective interventions for the implementation of evidence based guidelines.
This project was funded by the Sheffield Health and social care research consortium and the Brown Bequest, University of Western Australia. The authors would like to acknowledge all the General Practitioners who assisted with this project.
- Private Health Insurance Administration Council: Percentage of Australians covered by private health insurance. (accessed July 2007), [http://www.phiac.gov.au]
- Foubister T, Thomson S, Mossialos E, McGuire A: Private medical insurance in the United Kingdom. World Health Organization, Regional Office for Europe. 2006, (accessed July 2007), [http://www.euro.who.int/InformationSources/Publications/Catalogue/20060602_1]Google Scholar
- Department of Health: Referral Guidelines for suspected cancer. 2000, London: Department of HealthGoogle Scholar
- Glasziou P, Haynes B: The paths from research to improved health outcomes. Evid Based Med. 2005, 10: 4-7.View ArticleGoogle Scholar
- Boyle P, Leon ME: Epidemiology of colorectal cancer. Br Med Bull. 2002, 64: 1-25. 10.1093/bmb/64.1.1.View ArticlePubMedGoogle Scholar
- Thompson JA, Pond CL, Ellis BG, Beach MR: Rectal bleeding in general and hospital practice: "the tip of the iceberg". Colorect Dis. 2000, 2: 288-93. 10.1046/j.1463-1318.2000.00141.x.View ArticleGoogle Scholar
- Allgar VL, Neal RD: Delays in the diagnosis of six cancers: analysis of data from the National Survey of NHS patients: Cancer. Br J Cancer. 2005, 92: 1959-70. 10.1038/sj.bjc.6602587.View ArticlePubMedPubMed CentralGoogle Scholar
- Jiwa M, Reid J, Handley C, Grimwood J, Ward S, Turner K, Ibbotson M, Thorman N: Less haste more speed: factors that prolong the interval from presentation to diagnosis in some cancers. Fam Pract. 2004, 21 (3): 299-303. 10.1093/fampra/cmh314.View ArticlePubMedGoogle Scholar
- Sladden MJ, Thomson AN: How do general practitioners manage rectal bleeding?. Aust Fam Physician. 1998, 27 (1–2): 78-82.PubMedGoogle Scholar
- Jiwa M, Saunders C: Fast track referral for cancer. BMJ. 335 (7614): 267-8. 10.1136/bmj.39293.453090.AD.Google Scholar
- Babbie E: Survey research in the practice of social science. 1996, Belmont: Wadsworth publishingGoogle Scholar
- West P: Reproducing naturally occurring stories: vignettes in survey research. 1982, Glasgow: MRC Medical Sociology Research UnitGoogle Scholar
- McMurrick P, Dorien S, Shapiro J: Bowel cancer – guide for the GP. Aust Fam Physician. 2006, 35 (4): 192-7.PubMedGoogle Scholar
- The National Collaborating Centre for Primary Care: NICE- Referral guidelines for suspected cancer in adults and children 2005, University of Leicester and Royal College of General Practitioners. 2005, [http://www.nice.org.uk/guidance/CG27/guidance/pdf/English]Google Scholar
- Hamilton W, Sharp D: Diagnosis of colorectal cancer in primary care: the evidence base for guidelines. Fam Pract. 2004, 21 (1): 99-106. 10.1093/fampra/cmh121.View ArticlePubMedGoogle Scholar
- Australian Government. Department of Health and Ageing. (Accessed July 2007), [http://www.health.gov.au/internet/wcms/publishing.nsf/Content/outermet-relocguide-toc~outermet-relocguide-1]
- Green SB: How many subjects does it take to do a regression analysis?. Multivariate Behav Res. 1991, 26 (3): 499-10.1207/s15327906mbr2603_7.View ArticlePubMedGoogle Scholar
- StataCorp: Stata Statistical Software: Release 9.0. 2005, Stata Corporation: College Station, TXGoogle Scholar
- Knox S, Britt H, Pan Y, Miller GC, Bayram C, Valenti L, Henderson J, O'Halloran J: Locality matters: the influence of geography on general practice in Australia 1998–2004. Canberra: Australian Institute of Health and Welfare; University of Sydney (AIHW Cat. No. GEP17). 2005Google Scholar
- Jiwa M, Burr J: GP letter writing in colorectal cancer: a qualitative study. Curr Med Res Opin. 2002, 18 (6): 342-6. 10.1185/030079902125000886.View ArticlePubMedGoogle Scholar
- Jiwa M, Gordon M, Skinner P, Coker AO, Shaw L, Campbell MJ, Kenny R, Colwell B: Which symptomatic patients merit urgent referral for colonoscopy? A UK general practice perspective. Quality in Primary Care. 2007, 15: 21-5.Google Scholar
- Tisdale MJ: Wasting in Cancer. J Nutr. 1999, 129 (Suppl 1S): 243S-6S.PubMedGoogle Scholar
- Morris M, Iacopetta B, Platell C: Comparing survival outcomes for patients with colorectal cancer treated in public and private hospitals. Med J Aust. 186 (6): 296-300.Google Scholar
- Thorne K, Hutchings HA, Elwyn G: The effects of the Two-Week Rule on NHS colorectal cancer diagnostic services: a systematic literature review. BMC Health Serv Res. 2006, 6 (43):Google Scholar
- Mitchell HL, Carr AJ, Scott DL: The management of knee pain in primary care: factors associated with consulting the GP and referrals to secondary care. Rheumatology (Oxford). 2006, 45 (6): 771-6. 10.1093/rheumatology/kei214.View ArticleGoogle Scholar
- Stapley S, Peters TJ, Sharp D, Hamilton W: The mortality of colorectal cancer in relation to the initial symptom at presentation to primary care and to the duration of symptoms: a cohort study using medical records. Br J Cancer. 2006, 95 (10): 1321-5. 10.1038/sj.bjc.6603439.View ArticlePubMedPubMed CentralGoogle Scholar
- Bowrey DJ, Griffin SM, Wayman J, Karat D, Hayes N, Raimes SA: Use of alarm symptoms to select dyspeptics for endoscopy causes patients with curable esophagogastric cancer to be overlooked. Surg Endosc. 2006, 20 (11): 1725-8. 10.1007/s00464-005-0679-3.View ArticlePubMedGoogle Scholar
- Sullivan CO, Omar RZ, Ambler G, Majeed A: Case-mix and variation in specialist referrals in general practice. Br J Gen Pract. 2005, 55 (516): 529-33.PubMedPubMed CentralGoogle Scholar
- Chan BT: Austin PC Patient, physician, and community factors affecting referrals to specialists in Ontario, Canada: a population-based, multi-level modelling approach. Med Care. 2003, 41 (4): 500-11. 10.1097/00005650-200304000-00006.PubMedGoogle Scholar
- Rupassara KS, Ponnusamy S, Withanage N, Milewski PJ: A paradox explained? Patients with delayed diagnosis of symptomatic colorectal cancer have good prognosis. Colorectal Dis. 2006, 429;8 (5): 423-10.1111/j.1463-1318.2006.00958.x.View ArticleGoogle Scholar
- Gabbay J, le May A: Evidence based guidelines or collectively constructed "mindlines?" Ethnographic study of knowledge management in primary care. BMJ. 2004, 329 (7473): 1013-10.1136/bmj.329.7473.1013.View ArticlePubMedPubMed CentralGoogle Scholar
- Bravo Vergel Y, Ferguson B: Difficult commissioning choices: lessons from English primary care trusts. J Health Serv Res Policy. 2006, 11 (3): 150-4. 10.1258/135581906777641749.View ArticlePubMedGoogle Scholar
- Yu XQ, O'Connell DL, Forman D: Comparison of cancer survival in UK and Australia: rates are higher in Australia for three major sites. Br J Cancer. 91 (9): 1663-1665.Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2296/9/2/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.