This article has Open Peer Review reports available.
A qualitative exploration of the use of calendar landmarking instruments in cancer symptom research
© Mills et al.; licensee BioMed Central Ltd. 2014
Received: 15 March 2014
Accepted: 6 October 2014
Published: 25 October 2014
Late diagnosis is considered to be a major factor contributing to poorer cancer survival rates in the UK. Interventions have focussed on the promotion of earlier diagnosis in patients with potential cancer symptoms. However, to assess the effectiveness of these interventions, the time from symptom onset to presentation needs to be reliably and accurately measured. This qualitative study explored the use of calendar landmarking instruments in cancer symptom research.
We performed a secondary analysis of transcripts of interviews using the calendar landmarking instrument, undertaken with patients who had either been diagnosed with cancer (n = 40, IRCO study, Western Australia), or who had symptoms suggestive of cancer (n = 38, SYMPTOM study, North East and Eastern England). We used constant comparison methods to identify use of the calendar landmarking instruments and the impact of their application.
The calendar landmarking instrument appeared to help many patients, either by acting as a prompt or helping to refine recall of events. A combination of personal (e.g. birthday) and national (e.g. Christmas) landmarks seemed to be the most effective. Calendar landmarking instruments appeared more useful where the time period between onset of symptoms and date of first consultation was less than three months. The interviewee’s age, gender and cancer type did not appear to influence whether or not the instrument facilitated recall, and there were no instances where the use of the instrument resulted in the disclosure of a new first symptom. Symptoms of similar chronic conditions could create difficulties when applying the instrument; it was difficult for these participants to characterise and disentangle their symptoms which prompted their decisions to seek help. Some participants tended to prefer to use their own, already personalised, diaries to assist in their recall of events.
This study is the first to describe the potential role of calendar landmarking instruments to support research interviews which explore symptoms and events along the cancer diagnostic pathway. The major challenge remains as to whether they actually improve accuracy of recall.
Late diagnosis is considered to be a major factor contributing to poorer cancer survival rates. Recent research has focussed on interventions to promote earlier diagnosis in people with symptoms suggestive of cancer . In order to assess the effectiveness of these interventions the time from symptom onset to diagnosis and onset of treatment needs to be reliably and accurately measured . Time to diagnosis encompasses the `patient interval’ from first noticing a symptom, via symptom appraisal and help-seeking decisions to first presentation in primary care (also known as `time to presentation’), as well as the `healthcare professional interval’ from first presentation via investigations to diagnosis and initiation of treatment ,. The Aarhus Statement emphasises the importance of accurate definitions and measurement of these time intervals by clinicians and researchers . This type of research often involves retrospective recall of symptom onset by patients; such recall is subject to many types of error which may affect the accuracy, reliability and completeness of data collection.
Calendar landmarking instruments have been widely used across many research fields to increase the reliability of dating, and to improve consistency and completeness of data . A number of different calendar landmarking instruments have been devised, all of which aim to enhance recall of autobiographical memories through the use of significant private or public events as `landmarks’. Using landmark events can also enhance sequencing of events which reduces the risk of events being omitted. Calendar landmarking instruments usually incorporate a visual display of the time period in question and may gather information about one or more life domains as required. Calendar landmarking instruments were initially used in social sciences research. For example, they were shown to improve the accuracy of recall of living arrangements, involvement in education, employment and financial status over a period of months to years . Calendar landmarking instruments have also been used in relation to health behaviours. The Timeline Follow Back method was shown to have a slightly higher reliability and sensitivity than traditional quantity-frequency measurements of alcohol consumption , and women’s recall of their contraceptive use showed good agreement between a calendar landmarking instrument and medical records .
However, calendar landmarking instruments have seldom been used while collecting data for analysing time to clinical diagnosis for any conditions including cancer. The only example is from Corner and colleagues who investigated patients’ recollections of symptoms before a diagnosis of lung cancer using a timeline called “What Happened to Me?” to assist recall of events dating back from the time of diagnosis to the onset of the first symptoms. Patients were also asked to recall life events that had occurred at the same time, and their recollections were found to agree with their primary care and hospital records ,. Despite this limited evidence, the Aarhus Statement recommends the use of calendar landmarking techniques in studies of cancer diagnostic intervals. This paper reports a qualitative evaluation of our experiences using calendar landmarking methods in two studies of symptomatic cancer diagnosis.
The datasets were obtained from one completed study set in Australia and one on-going study set in England. Both studies involved in-depth interviews with patients who had either been diagnosed with cancer (Australia) or who had symptoms of possible cancer (England). The Australian study, set in Western Australia, aimed to identify patient, doctor and health factors that affect time to diagnosis and treatment outcomes in rural patients with cancer of the prostate, breast, colorectum or lung ,. Face-to-face in-depth interviews were undertaken between 2009 and 2010 by 5 interviewers. In total 66 interviews were undertaken, but 26 involved people with screen-detected cancer therefore calendar landmarking instruments were not used. All remaining 40 interviews were included in this secondary analysis.
The English study, set in the East and the North East of England, is a cohort study with a nested qualitative component, aiming to characterise factors affecting symptom appraisal and associations with cancer in people referred with symptoms suspicious of lung, colorectal or pancreatic cancer. These face-to-face in-depth interviews were undertaken between January and August 2011 (n = 38), by one experienced qualitative researcher in each region. The primary analysis is in progress.
While interviews with patients after cancer diagnosis may be subject to recall bias, recruitment of patients earlier in the diagnostic pathway will inevitably include people who go on to have both cancer and other diagnoses. We therefore chose to combine the datasets in order to enrich our understanding of patient recollections of the onset and appraisal of their symptoms, and the decisional factors leading to help-seeking in both patient groups. In both sets of interviews the participants were asked about the date of onset of the first symptom and the date of first consultation with a health care professional, using a calendar landmarking instrument to aid recall of their pathways towards diagnosis and the start of treatment. All interviews were audio-taped and professionally transcribed.
Ethical approval was obtained for each study. This was gained from the University of Western Australia (UWA) Human Research Ethics Committee (RA/4/1/2242) and the Cambridgeshire 3 Research Ethics Committee (10/H0306/50). Written informed consent was obtained from each participant prior to start of the interview.
The calendar landmarking instruments
A calendar landmarking instrument was specifically developed for the English study (CLI-UK), and the interviewers were instructed to use similar strategies to their Australian colleagues. The CLI-UK included similar international dates, with the national and local landmarks modified to reflect UK, rather than Australian events, see Figure 1B.
The analysis was undertaken using constant comparison techniques involving reading and re-reading of transcripts and comparison between transcripts to identify use of the calendar landmarking instruments and the impact of their application . Two authors (KM, CC) read all the transcripts; more than half of the transcripts were also read by at least two of the other researchers so that the analysis could be interpreted and refined though regular discussions. Once evidence of use of the calendar landmarking instruments had been established, all dates elicited for symptom onset and initial consultation in the first part of the interview (before the instruments were used) were compared with those elicited following use of the instruments by the interviewers. Examples of where the instruments aided the respondent’s recall were identified, as well as examples where the calendar landmarking instrument did not help or tighten recall of dates. We also assessed which landmarks had been most helpful and which had been less useful.
(n = 40)
(n = 38)
Cancer site c
4C, 13 N
2C, 1 N
Usefulness of calendar landmarking instruments
In more than half of the interviews the calendar landmarking instrument appeared to help participants recall the date of their first symptom onset and/or the date of the first GP consultation. It was useful in two key ways. First, interviewees used the calendar landmarking instrument as a prompt to their recall of events that had happened some months prior to their initial estimate of time of symptom onset. They used personal landmarks to pinpoint a time when a particular symptom had started, and often the interviewer’s role was mainly as facilitator – to listen and prompt further information as required.
I: So your first symptom was your shoulder pain, right shoulder pain, and that was in October/November `08?
R’s wife: It was probably there before that too ….
I: So maybe we’re looking at … just to pinpoint that first initial symptom…
R’s wife: Yes, so about May that year. No, you were driving the motor home at one stage…, we were going down for the kids’ birthdays in Bunbury and you said `oh, me shoulder’s annoying me’ and because it’s fairly heavy to drive and I know when I drive it I get sore shoulders, and whether that was the beginnings of it or not, that was February of that year. Yeah, `cause we used to go down there for the kids’ birthdays, `cause two of our grandchildren have birthdays a day apart down there.
I: So what days are those birthdays?
R’s wife: Eighteenth and 19th of February. …yeah but that sort of subsided and didn’t matter. We thought, oh well it was because he was driving. And of course that was way before….
[Australian patient, lung cancer]
Second, the interviewer used events from the calendar landmarking instrument to establish the date of first symptom onset. This could help interviewees refine a vague recollection such as `about summer last year’ to a specific range of days relating to a recalled event. The recalled event could be a national or international one:
R1: When did I go to the doctors? Two months ago?
I: Before Christmas then?
R2: Yeah, two or three months ago it was, but it was happening before that, long before that… So it was about summer last year.. when it started, yes.
I: Okay. So would that be before the August public holiday?
R2: It was before that, it was before August, it was during the kids’ school holidays…..
I: So was that before July? Before they went on holiday?
R1: Let’s say it happened at the World Cup finals.
I: World Cup, around there was it? The World Cup started in June.
R2: That would be about right because during the World Cup he was up and down going to the toilet and he missed part of the football, if you remember rightly.
R1: You have a better memory than I have pet!
[English patient, suspected colorectal cancer]
The recalled event could also be one of personal significance:
I: So, around May or June, were there any events’ that would be easy to remember?
R: Yes I, in fact I would say that it’s specifically June… because my daughter was admitted in April.. and was discharged on the same date.. that was this last.. you know.. Prime Minister debate thing.
I: Oh the General Election…
R: Yeah for the General Election.
I: So I think that was on the 6th of May.
R: Okay, 6th of May, yes. Then I think it was a week or two or three weeks after that that the Social Service lady visited us.. yeah it was around mid-May that [the] arrangement was made for me to be going to the charity to collect.. the food stuff…
I: And.. did the cold [and fever] start after that?
R: Yeah, in fact I can remember, it was one of the days that I was going to collect [the] food pack, ..that day in fact was the day I started feeling cold. Yes, yes, so I can’t tell you this specifically but normally it was on a Thursday that I used to go and collect that thing from the charity…..
[English patient, suspected lung cancer]
Examples where calendar landmarking instrument did not facilitate recall
Australian patient, colorectal cancer
I: We’ve got some tools here to maybe help you remember. Was this last year?
I: So that’s 2008. And We’ve got some events on this calendar that might help you remember when those symptoms first started. Was it winter or summer can you remember that sort of thing…
R: You really don’t know how bad my memory is, do ya … um….I’ve really got no idea.
I: Got no idea … birthdays … race rounds? Just roughly, when those symptoms started, [when] the bleeding first started.
R: I’ve got no idea. Honestly, no idea. Nuh.
Australian patient, breast cancer
I: Hopefully this will all make it a bit easier. We’ve got some dates down on the calendar there which uh, the idea is to try and help you remember what you were doing around these times…
R: I’ve got no idea. Five days, yeah… my days blend in…I run my own business, I’ve got two teenaged girls….and you can forget it.
English patient, suspected lung cancer
I: Do you remember exactly when it was when you went to see the doctor…?
I: Was it before Christmas?
R: Oh yes.
I: I have here, it’s … a tool to help people remember, I don’t know how helpful it’s going to be. (Laughs) So it was before Christmas, was it after bonfire night, November was it?
I: After bonfire night… after Armistice Day… no?
R: I’m trying to think… It’s got to be November… I’m sorry, I really can’t remember.
English patient, suspected lung cancer
I: So, do you think that was before Easter?
R: When would it be? It’s not so long ago, is it?
I: Was it before the Royal wedding?
R: Well you see this’ these are the letters for the whole, when I was going to get… now that one was the 10th May.
I: So is that before…?
R: So it would have been before that, yeah.. Yes, so from… it would be the back end of um, it would be the back end of ah, ah, back end of um, April.
I: Back end of April. So was that around all the public holidays and the Royal wedding and Easter? Does that ring a bell now that time?
R: No, that’s the one…that’s the last [xray] that got took, that one.
Factors affecting usefulness of calendar landmarking instruments
The time since symptom onset appeared to affect the usefulness of the calendar landmarking instruments in that they were used more often and added to the precision of dates where the time period between onset of symptoms and date of first consultation was less than three months. In contrast, the interviewee’s age, gender or cancer type did not appear to influence whether or not the calendar landmarking instrument facilitated recall; there were no instances where the use of the calendar landmarking instrument resulted in the disclosure of a new first symptom.
International events such as Christmas and New Year, and the public holidays in England, were the most useful `landmarks’, and personal events identified by interviewee, particularly family birthdays or holidays, were also frequently mentioned. Sporting events had some success as landmarks, including the international Olympic Games as well as a local horse race meeting in Australia. Unique events were also successful as landmarks: most noteworthy was the Royal Wedding in April 2011, and there were two interviewees who had been symptomatic for a while and who said the 2010 UK General Election was a helpful landmark. Interestingly, landmarks such as World War 2 anniversaries did not seem helpful for either the older or younger interviewees.
Where participants had existing chronic conditions, specifically where symptoms were of a similar nature such as chronic obstructive pulmonary disease and lung cancer, or benign prostatic hypertrophy and prostate cancer, we found that this could create difficulties when applying the instrument. It was difficult for these participants to characterise and disentangle their symptoms which prompted their decisions to seek help. During the interviews some participants had access to their own diary; in these instances they tended to prefer to use this rather than the calendar landmarking instrument to assist in their recall of events because they were so personalised already.
This study is the first to describe the potential role of calendar landmarking instruments to support research interviews which explore symptoms and events along the cancer diagnostic pathway. While they were not useful in all interviews, this qualitative exploration suggests that using calendars, particularly involving the use of personal (birthdays, holidays) and international (public holidays, Christmas) events, may facilitate recall. Using the landmarks often contributed to the refinement of the date of first symptom onset, and discussions of this time period appeared to enable some participants to re-visit their symptom appraisal and clarify the decisional factors which led them to seek healthcare. Greater insights were therefore gained into the patient processes and contributing factors which influenced symptom appraisal and seeking healthcare with the use of this visual presentation of time.
Comparison with existing literature
Our study findings are consistent with the results of a review of calendar landmarking instruments which describes how they can be used to discuss specific periods of time and explore sensitive issues with participants . Using a calendar instrument may make it easier to discuss sensitive issues for both the researchers and the respondents where referring to information written on the instrument can help with the discussion . Although we found that some people with similar chronic conditions could find it difficult to characterise and disentangle their symptoms, others found that calendar landmarking could be of particular value when their symptoms became more persistent or severe, or were of an episodic or vague nature .
In both our primary studies the calendar landmarking instruments were implemented by the researchers during the interviews and were used by the researcher to stimulate discussion. This contrasts with a Dutch study where the participants were sent the instrument to self-complete during telephone interviews . Both implementation techniques were found to assist in retrospective recall of the participants’ significant events, and we found that applying the instrument during the interview ensured the flow was un-interrupted. It was interesting that in our study some participants found that using their own diary was of more use than the calendar landmarking instrument, because it was already so personal. Future research may explore personal preferences for this as an alternative to standardised calendar landmarking instruments.
Strengths and limitations
This was a qualitative study involving secondary analysis of transcripts of interviews where a number of researchers had applied a calendar landmarking method to support patient recall of events prior to a cancer diagnosis. It involved 78 interviews across two countries and therefore reflects a broad experience of their use. It was not designed to assess the impact of this method to improve accuracy of recall. This would be a very challenging objective given the absence of any true reference dates.
There were seven interviewers who each used the calendar landmarking instruments in slightly different ways. We had initially envisaged a more formal introduction of the instruments at a set point during the interviews, with respondents being invited to personalise the landmarking tool with the interviewer before starting any discussion about dates of symptoms or GP consultations. In practice, however, the calendar landmarking instruments were used in a much more pragmatic and sensitive manner by each interviewer, and introduced when they felt it was most appropriate for the interviewee.
Implications for research and practice
Early diagnosis cancer research has been characterised by its complexity, a lack of transparency in multi-disciplinary perspectives, and a poorly developed set of definitions and methodological tools . The Aarhus Statement has suggested that one approach to improve the quality of studies of diagnostic intervals in symptomatic cancer is the use of calendar landmarking instruments. This study describes different ways in which using this technique may help participants to recall events leading to their cancer diagnosis, although we acknowledge that calendars were most use for those with shorter times from first symptoms to consultation. Despite being a challenging objective, further research on the usefulness of calendar landmarking instruments could include validation against reports from relatives, friends and the patient’s wider social group including workplace, and GP records. Further testing could include inter- and intra-person reliability measures to compare the use of calendar-landmarking instruments with no use. Further research is also required to establish whether calendar landmarking instruments could also have value in early diagnosis research across other diseases and conditions.
In conclusion, this qualitative exploration is the first to describe the potential role of calendar landmarking instruments to support research interviews which explore symptoms and events along the cancer diagnostic pathway. The major challenge remains as to whether they actually improve accuracy of recall.
FW and JE conceived the study. KM & NH conducted the participant interviews. KM, CC, LB, JE & FW completed the analysis. KM drafted the manuscript. All authors contributed to subsequent drafts and all read and approved the final manuscript.
We would like to thank the people who participated in the interviews in England and Australia.
This study analysed data collected during the Improving Rural Cancer Outcomes Study in Western Australia. This work was supported by the Cancer Council of Western Australia and a National Health and Medical Research Council (NHMRC) Partnership grant (572765). Data from the SYMPTOM Study in England was also analysed. This study is part of the DISCOVERY Programme, a NIHR programme grant for Applied Research (RP-PG-0608-10045), aimed at optimising diagnosis of symptomatic cancer.
- Richards MA: The size of the prize for earlier diagnosis of cancer in England. Br J Cancer. 2009, 101 (Suppl 2): S125-129. 10.1038/sj.bjc.6605402.View ArticlePubMedPubMed CentralGoogle Scholar
- Scott S, Walter FM: Studying help-seeking for symptoms: The challenges of methods and models. Soc Person Psychol Compass. 2010, 4 (8): 531-547. 10.1111/j.1751-9004.2010.00287.x.View ArticleGoogle Scholar
- Walter FM, Webster A, Scott S, Emery J: The Andersen model of total patient delay: a systematic review of its application in cancer diagnosis. J Health Serv Res Policy. 2012, 17 (2): 110-118. 10.1258/jhsrp.2011.010113.View ArticlePubMedPubMed CentralGoogle Scholar
- Olesen F, Hansen RP, Vedsted P: Delay in diagnosis: the experience in Denmark. Br J Cancer. 2009, 101 (Suppl 2): S5-S8. 10.1038/sj.bjc.6605383.View ArticlePubMedPubMed CentralGoogle Scholar
- Weller D, Vedsted P, Rubin G, Walter FM, Emery J, Scott S, Campbell C, Andersen RS, Hamilton W, Olesen F, Rose P, Nafees S, van Rijswijk E, Hiom S, Muth C, Beyer M, Neal RD: The Aarhus statement: improving design and reporting of studies on early cancer diagnosis. Br J Cancer. 2012, 106 (7): 1262-1267. 10.1038/bjc.2012.68.View ArticlePubMedPubMed CentralGoogle Scholar
- Glasner T, van der Vaart W: Applications of calendar instruments in social surveys: a review. Qual Quant. 2009, 43 (3): 333-349. 10.1007/s11135-007-9129-8.View ArticlePubMedGoogle Scholar
- van der Vaart W: The time-line as a device to enhance recall in standardized research interviews: a split ballot study. J Offic Stat. 2004, 20: 301-317.Google Scholar
- Sobell MB, Sobell LC, Klajner F, Pavan D, Basian E: The reliability of a timeline method for assessing normal drinker college students’ recent drinking history: utility for alcohol research. Addict Behav. 1986, 11 (2): 149-161. 10.1016/0306-4603(86)90040-7.View ArticlePubMedGoogle Scholar
- Rosenberg MJ, Layde PM, Ory HW, Strauss LT, Rooks JB, Rubin GL: Agreement between women’s histories of oral contraceptive use and physician records. Int J Epidemiol. 1983, 12 (1): 84-87. 10.1093/ije/12.1.84.View ArticlePubMedGoogle Scholar
- Corner J, Hopkinson J, Fitzsimmons D, Barclay S, Muers M: Is late diagnosis of lung cancer inevitable? Interview study of patients’ recollections of symptoms before diagnosis. Thorax. 2005, 60 (4): 314-319. 10.1136/thx.2004.029264.View ArticlePubMedPubMed CentralGoogle Scholar
- Corner J, Hopkinson J, Roffe L: Experience of health changes and reasons for delay in seeking care: a UK study of the months prior to the diagnosis of lung cancer. Soc Sci Med. 2006, 62 (6): 1381-1391. 10.1016/j.socscimed.2005.08.012.View ArticlePubMedGoogle Scholar
- Emery JD, Walter FM, Gray V, Sinclair C, Howting D, Bulsara M, Bulsara C, Webster A, Auret K, Saunders C, Nowak A, Holman CD: Diagnosing cancer in the bush: a mixed-methods study of symptom appraisal and help-seeking behaviour in people with cancer from rural Western Australia. Fam Pract. 2013, 30 (3): 294-301. 10.1093/fampra/cms087.View ArticlePubMedGoogle Scholar
- Emery JD, Walter FM, Gray V, Sinclair C, Howting D, Bulsara M, Bulsara C, Webster A, Auret K, Saunders C, Nowak A, Holman D: Diagnosing cancer in the bush: a mixed methods study of GP and specialist diagnostic intervals in rural Western Australia. Fam Pract. 2013, 30 (5): 541-550. 10.1093/fampra/cmt016.View ArticlePubMedGoogle Scholar
- Silverman D: Doing Qualitative Research: a Practical Handbook. 2000, Sage Publications, LondonGoogle Scholar
- Martyn KK, Martin R: Adolescent sexual risk assessment. J Midwifery Wom Health. 2003, 48 (3): 213-219. 10.1016/S1526-9523(03)00064-3.View ArticleGoogle Scholar
- Evans J, Chapple A, Salisbury H, Corrie P, Ziebland S: “It can’t be very important because it comes and goes”- patients’ accounts of intermittent symptoms preceding a pancreatic cancer diagnosis: a qualitative study. BMJ Open. 2014, 4 (2): e004215-10.1136/bmjopen-2013-004215.View ArticlePubMedPubMed CentralGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.