Skip to main content
BMJ Open logoLink to BMJ Open
. 2022 Jan 23;12(1):e053732. doi: 10.1136/bmjopen-2021-053732

Role of primary care physician factors on diagnostic testing and referral decisions for symptoms of possible cancer: a systematic review

Victoria Hardy 1,, Adelaide Yue 1, Stephanie Archer 1, Samuel William David Merriel 2, Matthew Thompson 3, Jon Emery 4, Juliet Usher-Smith 1, Fiona M Walter 1,5
PMCID: PMC8788239  PMID: 35074817

Abstract

Background

Missed opportunities for diagnosing cancer cause patients harm and have been attributed to suboptimal use of tests and referral pathways in primary care. Primary care physician (PCP) factors have been suggested to affect decisions to investigate cancer, but their influence is poorly understood.

Objective

To synthesise evidence evaluating the influence of PCP factors on decisions to investigate symptoms of possible cancer.

Methods

We searched MEDLINE, Embase, Scopus, CINAHL and PsycINFO between January 1990 and March 2021 for relevant citations. Studies examining the effect or perceptions and experiences of PCP factors on use of tests and referrals for symptomatic patients with any cancer were included. PCP factors comprised personal characteristics and attributes of physicians in clinical practice.

Data extraction and synthesis

Critical appraisal and data extraction were undertaken independently by two authors. Due to study heterogeneity, data could not be statistically pooled. We, therefore, performed a narrative synthesis.

Results

29 studies were included. Most studies were conducted in European countries. A total of 11 PCP factors were identified comprising modifiable and non-modifiable factors. Clinical judgement of symptoms as suspicious or 'alarm' prompted more investigations than non-alarm symptoms. ‘Gut feeling’ predicted a subsequent cancer diagnosis and was perceived to facilitate decisions to investigate non-specific symptoms as PCP experience increased. Female PCPs investigated cancer more than male PCPs. The effect of PCP age and years of experience on testing and referral decisions was inconclusive.

Conclusions

PCP interpretation of symptoms as higher risk facilitated testing and referral decisions for possible cancer. However, in the absence of 'alarm' symptoms or ‘gut feeling’, PCPs may not investigate cancer. PCPs require strategies for identifying patients with non-alarm and non-specific symptoms who need testing or referral.

PROSPERO registration number

CRD420191560515.

Keywords: primary care, public health, general medicine (see internal medicine), oncology


Strengths and limitations of this study.

  • To our knowledge, this is the first study that has examined a range of primary care physician (PCP) factors affecting testing and referral decisions in a cancer context.

  • We identified the role PCP factors play in managing ‘alarm’ symptoms and make recommendations for improving testing and referral decisions for patients with non-alarm and non-specific symptoms.

  • We were unable to perform a meta-analysis due to heterogeneity of outcomes among studies.

Introduction

Diagnostic error, which encompasses missed, delayed and incorrect diagnosis, is a major patient safety concern in primary care1. Cancer is among the most frequently missed diagnoses in this setting internationally.2–4 Improving patient safety in primary care has been identified by the World Health Organization (WHO) as a priority.5 Achieving a timely cancer diagnosis can be challenging due to low cancer incidence among populations presenting to primary care,6 patient comorbidity7 8 and overlapping symptoms between cancers (eg, abdominal symptoms can herald oesophageal, colorectal or renal cancer),9 as well as more commonly occurring benign conditions.10

Clinical guidelines, such as the National Institute for Health and Care Excellence (NICE) NG12 (2015) guidelines for suspected cancer which are based on patient risk factors and symptoms most predictive of cancer,11 are used in several countries to promote timely recognition and referral of symptoms warranting investigation.12 Despite reductions in diagnostic delay across multiple cancer sites since implementation of these guidelines in the early 2000s,13 14 around one-quarter of patients with cancer (including those with symptoms of relatively high predictive value; ‘alarm’ symptoms henceforth) in an analysis of over 17 000 cases from the English National Cancer Diagnosis Audit, were deemed to have had avoidable diagnostic delay.15 Such patients often have three or more consultations before referral to secondary care for further investigation,16 in addition to poor prognosis and experiences of healthcare.17

Notwithstanding the inherent difficulty of diagnosing cancer, approximately half of cancer-related diagnostic errors identified from English National Cancer Registries and closed malpractice claims in the USA, have been attributed to PCP delay or failure to recommend an appropriate test or referral.3 7 15 Unexplained PCP variation in use of dedicated urgent referral pathways after adjusting for case-mix,18 patient and practice factors,19 has suggested potential involvement of factors related to the PCP.20 However, the PCP factors contributing to decisions to investigate cancer, and the potential benefits and disadvantages such factors may confer to decision making is poorly understood. Therefore, in this systematic review, we aimed to identify and determine the influence of PCP factors on testing and referral decisions for symptoms suggestive of cancer.

Methods

This review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.21

Search strategy

We searched Medline, Embase, CINAHL, PsycINFO and Scopus for relevant articles from 1 January 1990 to 31 March 2021. We restricted the search from 1990 to coincide with increased public investment for primary care cancer research.22 Search queries were developed for Medline (online supplemental material 1) and adjusted according to the conventions of each database. Search terms comprised free text words and Medical Subject Headings informed by key words in titles and abstracts of relevant literature known to the authors,23–25 with input from an information specialist.

Supplementary data

bmjopen-2021-053732supp001.pdf (44.3KB, pdf)

Eligibility criteria

Studies were included if they were conducted in a developed country and investigated or described the influence of PCP factors on outcomes of testing and referral decisions during the diagnostic workup of adult patients (aged ≥18 years) with symptoms indicative of any cancer. We defined PCP factors as attributes that have been the object of interest regarding physician performance and competence, specifically focusing on the characteristics and attributes of physicians in clinical practice settings or the community.26 PCPs encompassed general practitioners and family physicians who have first patient contact and assume overall responsibility for coordinating patient care.27 We did not limit studies by symptom type or thresholds of cancer risk (ie, the positive predictive value of symptom profiles) because we wanted to understand how PCP factors contribute to the management of undifferentiated symptoms that are characteristic of presentations in primary care. As inferring the effect of PCP factors on individual PCP testing behaviour from associations derived in aggregate can be problematic, studies contributing quantitative data were only included if data were reported at the level of the PCP. Systematic reviews were excluded, but where relevant to our review question were used as a source of additional primary articles. We excluded commentaries, letters and editorials. There were no language restrictions.

Study selection

Citations retrieved by the search were imported into Rayyan QCRI.28 Following removal of duplicates, titles and abstracts were screened against eligibility criteria by VH. SWDM independently screened an initial 10% of titles and abstracts after which the inter-rater reliability (IRR) between reviewers was calculated using Cohen’s Kappa coefficient. The resulting coefficient value of 0.66 reflected substantial agreement and exceeded our minimum a priori IRR cut-off of ≥0.61,29 therefore, the remaining titles/abstracts were screened by VH alone. Full texts of potentially relevant studies were independently assessed by VH and AY to determine final inclusion. Reference lists of included studies and systematic reviews were hand-searched for additional articles not retrieved by the database searches. Discrepancies between reviewers were resolved through discussion or adjudicated by SA/FMW when agreement could not be reached.

Data extraction

Separate data extraction spreadsheets for quantitative and qualitative data were developed and piloted in Excel. Three authors (VH and AY/SA) independently extracted data relating to study characteristics, PCP factors, test and referral type, study results/findings, and cancer using the relevant data extraction spreadsheet. For quantitative studies, VH and AY extracted findings regarding the frequency of PCPs use of diagnostic tests and referrals and subsequent cancer diagnoses, along with odds ratios, hazard or risk ratios, or other statistical measures reported for each PCP factor. For qualitative studies, VH and SA extracted primary data (ie, participant quotations and authors’ verbatim summaries and interpretation) with the accompanying themes and subthemes to preserve context for data synthesis. Inconsistencies in data extraction between VH and AY/SA were resolved through discussion.

Critical appraisal

Quality of included studies was assessed using the Joanna Briggs Institute (JBI) Critical Appraisal Tools as they incorporate appraisal checklists for different study designs.30 VH and AY/SA independently rated each criterion of the relevant checklist for each included study, and discrepancies were resolved through discussion. As JBI checklists for different study types have a different number of criteria, we summarised study quality using a similar approach taken in a previous systematic review.31 The total score for each study was calculated as a percentage and classified as ‘low’ (0%–45%), ‘fair’ (≥46%–69%) or ‘high’ quality (≥70%).31 Studies were not excluded on the basis of low quality.

Data analysis and synthesis

Due to heterogeneity of study outcomes we were unable to statistically pool data. Therefore, we performed a narrative synthesis. We used a convergent segregated approach whereby quantitative and qualitative data were analysed separately before being thematically synthesised.32

Quantitative data were initially organised according to the PCP factor label given in included studies. Qualitative data were manually coded for PCPs’ perceptions of PCP factors on decisions to investigate cancer that could potentially be grouped into descriptive categories.

Definitions and/or descriptions of PCP factors from quantitative and qualitative studies were compared to determine the similarity of identified constructs. Data for each construct was iteratively grouped and checked by FW/SA until categories of PCP factors became clear. Final labels for each PCP factor were refined following team consensus meetings (table 1).

Table 1.

Description of PCP factors identified from included studies

PCP factor Description of PCP factors in this review PCP factor terms in original studies Definitions of PCP factors in original studies Assessment methods in original studies
Non-modifiable factors
Demographic characteristics
Sex Male or female Sex38 45; gender23 37 39 44 46 Not specified23 37 38 44–46 As recorded in the AMA Physician Masterfile38; questionnaire23 39; not specified37 44–46
Age Chronological age Age23 38 42 45 48 Survey year (2008)–year of birth38; in years23 42 45 48 Questionnaire23 35 42; not specified38 48
Years of experience A composite of the number of years since graduation from medical school and completion of PCP training or residency Years of experience35 37 50 52; years in practice or family medicine25 38 42 44; years since qualifying or graduating23 39 Survey year (2008)–year graduated from medical school38; number of years in clinical practice42; not specified23 25 35 37 39 44 50 52 PCP selection of: under 10 years/10–19 years/20–29 years/30–39 years/40–49 years or over/or ‘I prefer not to say’ to the question ‘how many years is it since you graduated as a doctor?’ in questionnaire39; questionnaire23 35 42; interviews50; not specified25 37 38 44 52
Modifiable factors
Clinical reasoning processes
Clinical judgement Clinical judgement regarding the possibility of cancer or other serious illness prompted by PCPs’ interpretation of patient’s symptoms or other clinical aspects of the presentation Suspicion of cancer (or other serious disease)47 49 51 57 60; symptom interpretation41; clinical concern43 Interpretation of symptoms as alarm (suggestive of cancer), serious (suggestive of any serious disease) or vague (not directly suggestive of cancer or other serious disease)41; suspicion of cancer based on patients first presented symptoms60; not specified43 47 49 51 57 Prospective49 and retrospective PCP questionnaire completed on basis of medical records41 49; surveys43 57 or a registration form47 including questions: ‘are you left with the slightest suspicion of cancer or another serious disease (new)?’ completed at time of patient presentation,47 ‘how did you interpret the symptoms?’41 or requesting indication of whether ‘cancer possible, follow-up needed’ or ‘cancer not likely’49 and presence or absence of clinical concern43; interviews51
‘Gut feeling’ A sense of alarm reflecting an uneasy feeling indicating concern about a possible adverse outcome, even though specific indications are lacking, or a ‘sense of reassurance’ reflecting a feeling of security about the patient’s management, even though the diagnosis may be uncertain87 88; typically considered irrational by PCPs87 Gut feeling40 50 52; hunch/gut instinct in response to symptoms55; intuition45; clinical suspicion/gut feeling34 50 Intuition,45 53 or an ‘intuitive feeling that something is wrong although there are no apparent clinical indications for this/a physician’s intuitive feeling that the strategy used in relation to the patient is correct although there is uncertainty about the diagnosis’40; clinical suspicion/gut feeling of cancer or serious disease34 50; features of clinical practice that would raise suspicion of lung cancer55; not specified52 Questionnaire completed by PCP retrospectively from medical records40; and survey including question: ‘to what degree do you use intuition in your everyday work as a GP, for example, in relation to referral for investigation, sampling, etc.?’,45 primary care referral forms and secondary care datasets34; interviews50 52 53 and focus groups55
First diagnostic impressions First diagnostic impressions or hypotheses regarding the possible cause of a presentation, typically understood to be based on the most easily recalled information, at the start of a clinical encounter89 First impressions25 59 Verbalisations of cancer as a possible diagnosis immediately after reading initial description of hypothetical case scenario but before gathering any further information about the ‘patients’ complaint25; not specified59 Coding of initial verbalisations as ‘cancer mentioned’ or ‘cancer not mentioned’ using audiorecorded think-aloud protocols25; thematic analysis of free text in primary care records59
Assessment of cancer risk Assessment of the likelihood or probability of cancer underpinned by the diagnostic value of patient risk factors, symptoms or test results to rule in or rule out cancer as a diagnosis90 Estimation of cancer risk at referral40; anticipated risk of cancer at referral45 Not specified40 45 Questionnaire completed retrospectively asking for PCPs estimation of cancer risk based on medical record entries for patients with any of 21 symptoms at time of referral40; and survey response to question: ‘in your judgement, what is the probability that a 50-year-old patient has cancer when you choose to refer the patient to fast track diagnostic services?’45
Dealing with uncertainty
Attitude to uncertainty and risk Positive or negative psychological responses to unexplained, incongruent, or imperfect diagnostic clues,91 and/or an inclination to act when the implication of making the wrong decision could be significant Level of risk38; physician risk attitude, tolerance for ambiguity45; uncertainty51 53 Not specified38 45 51 53 Surveys of self-assessed ratings on the ‘Tolerance for Ambiguity Scale’, and subscales of the ‘Physician Response to Uncertainty’ scale: anxiety due to uncertainty and concern about bad outcomes using six-point Likert scale from 1 (strongly disagree) to 6 (strongly agree)45; interviews51 53
Fear of malpractice Concern about potential accusations from colleagues or patients of professional negligence, and worry of formal or informal recourse as a consequence of those accusations Fear of malpractice38 50; fear of litigation or complaint43 56 Not specified38 43 50 56 Surveys38 43 requesting yes/no response to question: ‘what influences your decision to use fast-track referral route?’ for ‘fear of litigation’43; interviews/focus groups50 56
Professional role and involvement in continuing medical education
Attitude to role as gatekeeper Attitudes towards PCPs perceived role in facilitating or controlling patient access to specialist healthcare services Role as gatekeeper45 50 51 Not specified45 50 51 Surveys including binary (yes/no) responses to two individual statements: ‘the most important role as gatekeeper is to prevent overuse of secondary health services’ and ‘ensure proper medical guidance and referral’45 and interviews50 51
Participation in Continued Medical Education Participation in any professional activity to ‘maintain, develop or increase knowledge, skills, professional performance and relationships to provide services for patients, the public or the professio‘92 Involvement in clinical teaching38; value of professional education51 54 58 Not specified38 51 54 58 Open-ended survey questions58; interviews51 54; not specified38

AMA, American Medical Association; PCP, primary care physician.

Quantitative and qualitative findings for each PCP factor were then separately examined. The direction and magnitude of effect (for quantitative data) and PCPs’ perceptions (for qualitative data) of PCP factors, were summarised in textual format for every PCP factor. Quantitative and qualitative textual summaries were juxtaposed and subsequently combined into a new descriptive narrative that encapsulated findings from each study.33

Finally, PCP factors were organised into over-arching themes according to the extent to which they were deemed to be modifiable or non-modifiable. Modifiable factors were factors considered to be susceptible to individual control or being changed with intervention. Non-modifiable factors were viewed to be outside the purview of individual control and less susceptible to adjustment. Findings for each PCP factor were interpreted in the context of the methodological limitations of each study from the critical appraisal. Only PCP factors for which there were a minimum of two studies were synthesised.

Patient and public involvement

This systematic review was undertaken as part of the CanTest Collaborative research programme funded by Cancer Research UK. This programme involves close collaboration with a panel of PPI representatives whose views informed the design of this study, data analysis and data interpretation.

Results

Search results

The search yielded a total of 7938 studies. After deduplication, titles and abstracts of 4135 studies were screened; 3721 did not meet inclusion criteria and were excluded. We reviewed the full text of 82 studies retrieved from the search, with a further nine identified through hand-searching reference lists of included articles. 29 studies (19 quantitative and 10 qualitative) met inclusion criteria and were included in the final synthesis (see figure 1).

Figure 1.

Figure 1

PRISMA flow diagram. PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses.

Study characteristics

The included quantitative studies consisted of 13 cross-sectional studies25 34–45 and two experimental studies,23 46 of which 11 used vignette-based methods;23 25 35–39 42 44–46 three were prospective cohort studies,47–49 and one was a retrospective cohort study (online supplemental material 2).49 Qualitative data came from five interview studies,50–54 two focus group studies,55 56 two cross-sectional survey studies57 58 and one retrospective cohort of free-text primary care consultation data.59 Of these 29 included studies, 11 were conducted in the UK,23 25 34 37 43 44 50 51 54 55 57 six in Denmark,40 41 45 47 60 61 two across 20 countries within the European Union,39 58 two each in Australia,35 46 the USA,36 38 and Norway,49 53 and one each in the Netherlands,59 Sweden,52 Spain,56 and across Australia and the UK.42 Together, studies reflected a total of 10 300 PCPs (8000 from quantitative studies, 2300 from qualitative studies) and testing and referral decisions for 15 100 patients.

Supplementary data

bmjopen-2021-053732supp002.pdf (98.4KB, pdf)

The most common diagnostic action evaluated was urgent referral37 41–43 51 54 55 57 60 or direct referral to diagnostic testing centres,34 40 45 50 imaging tests,48 or other specialty services.35 46 Additional investigations included use of appropriate investigations for the cancer,23 25 36 38 39 any diagnostic action,47 49 50 52 53 58 or referral in general.56 59 Testing and referral decisions were mainly made in the context of symptoms generally suggestive of the target cancer(s).35 36 38 41 47 48 55 58–60The remaining studies examined decision making for symptoms at high-,46 49 low-,25 34 39 40 50 and mixed-risk of cancer (based on the positive predictive value of symptoms in national guidelines),23 37 42 44 or did not provide details of symptomatic context.43 45 51–54 56 57 Cancers studied were colorectal,36 37 42 43 52 54 55 59 lung,23 44 46 55 61 ovarian,38 60 a mixture of cancers,25 35 39–41 58 and any cancer.34 45 47 50 51 53 56 57

Quality of included studies

Twelve studies were assessed as high quality,23 25 34 36 37 39 45–47 49 50 53 11 were fair quality,35 38 40 41 44 48 51 52 55 59 60 and six were low quality (online supplemental material 2).42 43 54 56–58

The main quality issues for quantitative studies related to poor reporting of sample characteristics,40 41 43 47–49 60 failure to identify or adjust for confounding,38 42 43 49 and hindsight bias due to knowledge of the diagnosis at the point of assessment of PCP factors.40 41 49 There were also concerns about several studies using vignettes which were not adequately realistic of patient cases seen in clinical practice and lacked evidence of validation.25 35 37 46 57 Qualitative studies were limited by insufficient evidence of researcher reflexivity and positionality,50–55 57 59 suboptimal presentation of participants’ voices55 56 59 and failure to indicate whether ethical permissions were obtained or waived.56

Recall and social desirability bias was also a concern across study types where assessment of the exposure by PCPs was examined retrospectively,40 41 49 or based on PCPs reflections of their clinical practice.50–54

PCP factors

A total of 11 PCP factors were identified (table 1). Non-modifiable PCP factors comprised demographic characteristics. Modifiable PCP factors included clinical reasoning processes, dealing with uncertainty, and professional role and involvement in continuing medical education. The evidence for these 11 PCP factors is summarised below (quantitative and qualitative findings for each factor are presented separately in online supplemental materials 3 and 4, respectively).

Supplementary data

bmjopen-2021-053732supp003.pdf (119.8KB, pdf)

Supplementary data

bmjopen-2021-053732supp004.pdf (94.8KB, pdf)

Non-modifiable factors

Demographic characteristics

Sex (n=7)

Most studies suggested that female PCPs more often investigated possible cancer compared with male PCPs,37–39 46 48 though findings were predominantly descriptive. Being female was associated with increased odds of urgent specialist review for patients with a lung nodule on CT (OR 1.87, 95% CI 1.36 to 2.56, p≤0.001)46 and referral of symptoms suspicious of colorectal cancer.37 Compared with male PCPs, females more frequently recommended appropriate investigations for ovarian cancer38 and symptoms of any possible cancer,39 but these differences were not statistically significant. There was also no observable trend between PCP sex and use of investigations for lung cancer,23 48 nor was there an association with estimation of cancer risk at urgent referral.45

Age (n=5)

The effect of age on decisions to investigate possible cancer was inconclusive. In two studies in Australia/UK and the USA, younger PCPs (aged 30–39 years) were most likely to recommend specialist referral for colorectal cancer42 and request appropriate investigations for ovarian cancer.38 However, in another study conducted in the UK, younger PCPs overall used relevant investigations for lung cancer less frequently than PCPs older than 45 years.23 Odds of urgent referral increased with age in one study. PCPs 60–69 years were significantly more likely to recommend urgent referral (OR 15.4, 95% CI 4.4 to 53.8, p≤0.001) than those 30–39 years (OR 2.8, 95% CI 1.5 to 5.2, p≤0.001).42 PCPs 60 years and above tended to estimate cancer risk at referral to be higher than PCPs younger than 45 years, though this finding was non-significant.45 There was also no difference in mean age at referral between PCPs using and not using direct CT referral for lung cancer.61

Years of experience (n=10)

Evidence regarding the influence of years of experience was also mixed. Compared with those less experienced, PCPs with upwards of 10 years of experience were more likely to make a specialist referral for symptoms of ovarian35 and colorectal cancer,42 and initiate diagnostic action in general.39 PCPs trusted their clinical judgement with increasing experience and became more willing to investigate when they were suspicious of cancer, regardless of colleagues opinions of their decisions.50 52 However, one study found PCPs with less than 6 years of experience were most able to differentiate presentations at risk thresholds of 3% or more requiring urgent referral compared with PCPs with 18–36 years of experience.44 A further three studies found no observable influence of years of experience on decisions to test and refer for possible cancer.23 25 38

Modifiable factors

Clinical reasoning processes

Clinical judgement (n=7)

Clinical judgement of symptoms as suspicious or alarming consistently led to more investigations across multiple cancer sites.41 43 47 49 51 57 60 When PCPs were suspicious of cancer they were more likely to recommend imaging investigations (OR 3.95, 95% CI 2.80 to 5.57) or make a referral (OR 2.56, 95% CI 2.22 to 2.96) compared to when symptoms were interpreted as not suspicious.47 Symptoms that did not provoke suspicion60 or were interpreted as non-alarm41 were less likely to be urgently referred. PCPs had difficulty discerning the appropriateness of using urgent referral pathways when patients symptoms did not clearly match referral criteria which was perceived not to accommodate individual clinical judgement.57

‘Gut feeling’ (n=7)

The presence of ‘gut feeling’ did not lead to increased referral rates, but doubled the odds of a cancer diagnosis within 6-months when PCPs decided to act on this feeling.34 40 ‘Gut feeling’ was perceived to facilitate management of symptoms that were not definitive55 57 and become more accurate with experience.50 55 Justifying referral of patients with concerning symptoms not meeting referral criteria on the basis of ‘gut feeling’ was challenging as it was perceived to not be sufficient indication for referral among hospital specialists.50 53 57 PCPs’ assessment of cancer risk at referral was not influenced by ‘gut feeling’.45

First diagnostic impressions (n=2)

In one vignette study, PCPs whose first diagnostic impressions were of possible cancer were more likely to recommend investigation than PCPs whose initial impressions did not include cancer (OR 1.98, 95% CI 1.10 to 3.57, p≤0.01).25 Further, odds of a cancer diagnosis doubled when PCPs verbalised cancer as a possibility after reading the reason for the patients presentation compared with when they did not mention cancer.25 Failure of PCPs to reconsider initial diagnostic hypotheses could herald suboptimal testing strategies and delayed colorectal cancer diagnosis. False reassurance from positive response to medication, intermittent symptoms, misleading test results, and comorbidity were reported to contribute to failure of PCPs to consider alternative diagnostic hypotheses.59

Assessment of cancer risk (n=2)

The relationship between PCPs’ assessment of cancer risk and use of investigations was unclear. In a prospective cross-sectional study, higher estimation of cancer risk did not result in higher referral rates but did lead to a concomitant increase in the likelihood of a cancer diagnosis.40 Findings from a Danish vignette survey suggested that PCPs overestimate cancer risk as approximately one-third of PCPs' anticipated cancer risk at referral for a hypothetical patient to exceed 50%.45

Dealing with uncertainty

Attitude to uncertainty and risk (n=4)

Findings for this PCP factor were inconsistent. Survey responses on the Tolerance for Uncertainty scale suggested that PCPs most tolerant of uncertainty were the least confident in their assessment about the possibility of an underlying cancer at urgent referral compared to PCPs with the lowest tolerance for uncertainty.45 PCP responses to the Physician Risk Attitude scale and 'levels of anxiety due to uncertainty' and 'concern about bad outcome' domains in the Physician Reaction to Uncertainty scale, was not associated with assessment of cancer risk at referral.45 Another study found that decisions to test for ovarian cancer were not affected by PCPs attitude to risk.38 Diagnostic uncertainty was viewed as integral to clinical practice,53 but could lead younger doctors who were less comfortable with uncertainty to investigate unnecessarily.51 53

Fear of malpractice (n=4)

The potential influence of fear of malpractice diverged by study type. In two quantitative studies, PCPs concerns about malpractice did not influence selection of tests for ovarian cancer,38 nor did PCPs consider fear of malpractice to influence their decisions to use urgent referral pathways.43 In contrast, qualitative studies suggested that previous experience of complaints from patients or colleagues for suboptimal testing decisions could affect PCPs future diagnostic approach.56 Defensive testing was considered the only strategy available to PCPs concerned about litigation for reassuring patients and protecting themselves medicolegally.50

Professional role and involvement in continuing medical education

Attitude to role as gatekeeper (n=3)

Evidence for this PCP factor was predominantly descriptive. PCPs believed their role was to act in the best interests of the patient, advocate for patients healthcare needs with hospital specialists,51 and make appropriate management decisions.45 PCPs' attitudes were not associated with their assessment of cancer risk at referral.45 In their role as gatekeeper, PCPs had mixed encounters with hospital specialists when trying to make a referral on the basis of ‘gut feeling’. They described productive dialogue with specialists via telephone ahead of a referral, but were reluctant to write ‘gut feeling’ into the referral letter.50

Participation in continued medical education (n=4)

In one US vignette study, PCPs involved in clinical teaching were 1.04-fold more likely to use relevant tests for ovarian cancer compared with PCPs not participating in educational activities.38 Across three interview studies, PCPs wanted more educational opportunities to better differentiate symptoms that could be due to cancer.51 54 58 Frequent training on the latest evidence regarding the predictive value of symptoms for cancer was viewed as important51 as lack of clarity about when to suspect cancer was believed to have contributed to incorrect non-referral of patients in their practice.54 58

Discussion

Summary of principal findings

We identified a number of non-modifiable and modifiable PCP factors potentially influencing testing and referral decisions for cancer. Of the PCP factors deemed modifiable, we found most evidence for ‘clinical judgement’ and ‘gut feeling’. PCP judgement of symptoms as suspicious or ‘alarm’ led to more investigations for possible cancer than symptoms judged to be non-alarm. The presence of ‘gut feeling’ at referral increased the likelihood of a subsequent cancer diagnosis. PCPs relied on ‘gut feeling’ to guide decisions to investigate non-specific symptoms. Patients’ symptoms could not always be easily reconciled with clinical guidelines, making it difficult for PCPs to determine the appropriateness of referral. Clinical guidelines offered limited scope for PCPs to act on ‘gut feeling’ or clinical judgement when symptoms did not fit referral criteria. Female PCPs tended to investigate cancer more than male PCPs. The effect of years of experience was inconclusive, but more experience was perceived by PCPs to improve the reliability of ‘gut feeling’. The evidence for the remaining PCP factors was insufficient to derive clear conclusions.

Strengths and limitations

To date, research evaluating possible reasons for inconsistencies in PCPs use of suspected cancer referral pathways20 have primarily focused on the influence of patient,62 practice16 63 and health-system factors.64 65 By summarising quantitative and qualitative evidence for PCP factors, this review builds on existing knowledge regarding the range of factors affecting PCPs decisions to investigate cancer and highlights PCPs’ perspectives regarding the potential value of those factors in clinical practice. Our search strategy covered a variety of terms for PCP factors increasing the likelihood that all relevant studies were identified. We used a transparent approach to derive PCP factors which could be useful for developing uniform definitions of these factors that can be applied in future primary care cancer research.

However, this study does have some limitations. While we attempted to synthesise data for PCP factors representing similar constructs, heterogeneity in labelling of PCP factors between studies, which were seldom defined, may have affected construct validity. For example, studies reporting clinical suspicion and 'gut feeling' did not always adequately define these terms or describe how they were assessed, making it difficult to determine which construct was actually measured. Additionally, we did not limit evaluation to PCP factors assessed as a primary or secondary outcome, so findings for years of experience, age and sex, in particular, should be interpreted with some caution. These factors were typically examined ad hoc and may not be sufficiently powered to detect a true relationship with testing and referral decisions. While clinical decision making occurs in the context of the patient agenda and wider health system,66 67 a number of included studies did not adjust analyses for confounding from patient or health system factors, potentially obscuring the true relationship of PCP factors (notably those relating to PCP demographic characteristics, ‘clinical judgement’, attitude to uncertainty/risk and fear of malpractice) with testing and referral decisions.

Dichotomising factors as modifiable or non-modifiable may obfuscate the complex and dynamic mechanisms through which PCP factors influence decision making, and the extent to which these factors may be modifiable in practice. For example, PCPs’ interpretation of symptoms as ‘alarm’ or non-serious (ie, ‘clinical judgement’) may be due to variations in PCP knowledge of referral criteria for suspected cancer or application of cognitive shortcuts (eg, availability heuristic, overconfidence). Although there is scope for these respective components to be improved through interventions such as clinical updates or metacognitive practices that highlight the impact of errors in cognition on patient care,68–70 knowledge of clinical guidelines may be more susceptible to adjustment than PCPs use of heuristics which is influenced by personality traits that are more difficult to modify.71 ‘Gut feeling’ is associated with empathy72 and underpinned by clinical knowledge and experience.73 74 Thus, the ability of PCPs to access and leverage 'gut feeling' in interventions for enhancing empathy75 may be more instinctive to some PCPs than others. Though years of experience is not modifiable, clinical experience may be more important and mutable through simulated diagnostic experiences that increase exposure to presentations that could be due to cancer.76

The overall conclusiveness of our findings is also limited by methodological weaknesses of studies using retrospective (eg, interview, medical record review) methods that are susceptible to recall, social desirability and hindsight bias.

Comparison with existing literature

That PCPs were less likely to investigate symptoms judged to be ‘non-alarm’ comports with existing literature which reports longer diagnostic intervals for lower risk symptoms not meeting urgent referral criteria across cancer sites77 and non-investigation or delayed investigation of patients with gynaecological cancers presenting to primary care with non-specific symptoms.78 A recent systematic review and meta-analysis examining the influence of ‘gut feeling’ in the diagnosis of cancer similarly found ‘gut feeling’ to be highly predictive of cancer (OR 4.24, 95% CI 2.26 to 7.94) and linked with PCP experience.74 In the same review ‘gut feeling’ also led to more referrals74 which was not supported by our findings. This inconsistency may be due (in part) to differing interpretations of PCP factors constituting 'clinical judgement' and ‘gut feeling’ (for example, we deemed clinical suspicion in two similarly included studies47 49 to reflect 'clinical judgement' rather than ‘gut feeling’). Qualitative studies of cancer patients symptom appraisal suggest patients use vocabulary when communicating their symptoms that differs from biomedical terms familiar to PCPs,79–81 which may explicate the difficulties PCPs experienced reconciling patients’ symptoms with referral criteria. A cross-sectional observational study of English practices found that practices with majority male PCPs were less likely to urgently refer for suspected cancer,82 which accords with our finding that female PCPs were more inclined to investigate patients with symptoms of possible cancer.

Unanswered questions and future research

Future research in this area would benefit from standardised definitions and reporting of PCP factors. In the UK, the amalgam ‘clinical suspicion/gut feeling’ is indicated for expedited referral to non-specific symptom pathways, and NICE NG12 (2015)11 urgent referral criteria recommends clinical judgement is used when making appropriate testing decisions.11 34 However, the extent to which 'clinical suspicion' or 'clinical judgement' (both assessed as ‘clinical judgement’ in this review) and ‘gut feeling’ reflect distinct or overlapping constructs is unclear. Research is needed that elucidates how PCPs appraise symptoms as suspicious or non-suspicious to determine patient eligibility for referral. Consideration should be given to the subsequent impact on decisions to investigate possible cancer when symptoms are not described in biomedical terms. PCP factors are multidimensional and comprise contributory components that may be more modifiable than others. Disentangling the potential involvement of such components for ‘clinical judgement’ and ‘gut feeling’ could foster more understanding of these constructs and facilitate identification of factors to target in future interventions. Testing and referral decisions may be driven by aspects of PCP gender as opposed to sex, but empirical evidence for the effect of sociocultural vs biological factors is lacking.83 Since suboptimal decisions to investigate cancer are likely precipitated by a combination of factors,84 future research should examine possible interactions between PCP factors (and patient and health system factors). This is pertinent given the potential for reverse causality among some PCP factors.

Implications for policy and practice

As the majority of studies in this review were conducted in European countries, our findings have most applicability for countries where PCPs are gatekeepers to specialty services. Our findings have implications for improving the management of symptomatic patients with cancer in general rather than a specific cancer type. This is of clinical import as patients may be at lower risk of an individual cancer but higher risk of an underlying cancer overall.34 85 In the absence of clinical judgement of symptoms as ‘alarm’ or ‘gut feeling’, PCPs may not investigate patients in a timely manner. Novel pathways for non-specific symptoms (eg, SCAN pathway in Oxford86) that are currently in development in the UK, will be important for circumventing perceived barriers to acting on 'clinical judgement' or ‘gut feeling’ for symptoms not meeting urgent referral criteria. However, supplementary strategies are needed that support PCPs to recognise and investigate patients with non-alarm and non-specific symptoms that need referral. The challenge for policy-makers will be to determine how to enhance the utility of clinical guidelines for investigation of possible cancer by operationalising clinical suspicion/judgement and ‘gut feeling’, and ensuring recommendations refrain from reinforcing language siloes between patients and PCPs that may create opportunities for suboptimal testing decisions and diagnostic delay.

Supplementary data

bmjopen-2021-053732supp005.pdf (187.2KB, pdf)

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

Twitter: @sammerriel

Contributors: VH, MT, JE and FMW designed the study; VH developed and performed the search; VH, AY and SWDM screened the search results; VH, AY and SA extracted the data; VH drafted the manuscript with input from JU-S and FMW; all authors critically assessed and contributed to manuscript revisions. FMW is guarantor of this work.

Funding: This review is supported by the CanTest Collaborative which is funded by Cancer Research UK (C8640/A23385), where VH is a PhD student, SWDM is a Clinical Research Fellow, FMW is Director, and MT and JE are associate directors. SA is supported by Cancer Research UK grants (C12292/A20861).

Competing interests: None declared.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Data availability statement

All data relevant to the study are included in the article or uploaded as online supplemental information. All research data supporting this publication are provided within this article.

Ethics statements

Patient consent for publication

Not applicable.

References

  • 1.Singh H, Schiff GD, Graber ML, et al. The global burden of diagnostic errors in primary care. BMJ Qual Saf 2017;26:484–94. 10.1136/bmjqs-2016-005401 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Fernholm R, Pukk Härenstam K, Wachtler C, et al. Diagnostic errors reported in primary healthcare and emergency departments: a retrospective and descriptive cohort study of 4830 reported cases of preventable harm in Sweden. Eur J Gen Pract 2019;25:128–35. 10.1080/13814788.2019.1625886 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Aaronson EL, Quinn GR, Wong CI, et al. Missed diagnosis of cancer in primary care: insights from malpractice claims data. Journal of Healthcare Risk Management 2019;39:19–29. 10.1002/jhrm.21385 [DOI] [PubMed] [Google Scholar]
  • 4.Kostopoulou O, Delaney BC, Munro CW. Diagnostic difficulty and error in primary care--a systematic review. Fam Pract 2008;25:400–13. 10.1093/fampra/cmn071 [DOI] [PubMed] [Google Scholar]
  • 5.World Health organization . Diagnostic errors: technical series on safer primary care. Geneva, 2016. [Google Scholar]
  • 6.Hamilton W. Cancer diagnosis in primary care. Br J Gen Pract 2010;60:121–8. 10.3399/bjgp10X483175 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Swann R, McPhail S, Witt J, et al. Diagnosing cancer in primary care: results from the National cancer diagnosis audit. Br J Gen Pract 2018;68:e63–72. 10.3399/bjgp17X694169 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Koo MM, Swann R, McPhail S, et al. The prevalence of chronic conditions in patients diagnosed with one of 29 common and rarer cancers: a cross-sectional study using primary care data. Cancer Epidemiol 2020;69:101845. 10.1016/j.canep.2020.101845 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Koo MM, von Wagner C, Abel GA, et al. The nature and frequency of abdominal symptoms in cancer patients and their associations with time to help-seeking: evidence from a national audit of cancer diagnosis. J Public Health 2018;40:e388–95. 10.1093/pubmed/fdx188 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Stapley S, Peters TJ, Neal RD, et al. The risk of oesophago-gastric cancer in symptomatic patients in primary care: a large case-control study using electronic records. Br J Cancer 2013;108:25–31. 10.1038/bjc.2012.551 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.National collaborating centre for cancer . Suspected cancer: recognition and referral NICE guideline. full guideline, 2015. https://www.nice.org.uk/guidance/ng12/evidence/full-guideline-pdf-2676000277 [Google Scholar]
  • 12.Funston G, Van Melle M, Baun M-LL, et al. Variation in the initial assessment and investigation for ovarian cancer in symptomatic women: a systematic review of international guidelines. BMC Cancer 2019;19:1–13. 10.1186/s12885-019-6211-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Neal RD, Din NU, Hamilton W, et al. Comparison of cancer diagnostic intervals before and after implementation of NICE guidelines: analysis of data from the UK general practice research database. Br J Cancer 2014;110:584–92. 10.1038/bjc.2013.791 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Jensen H, Tørring ML, Olesen F, et al. Diagnostic intervals before and after implementation of cancer patient pathways – a GP survey and registry based comparison of three cohorts of cancer patients. BMC Cancer 2015;15:1–10. 10.1186/s12885-015-1317-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Swann R, Lyratzopoulos G, Rubin G, et al. The frequency, nature and impact of GP-assessed avoidable delays in a population-based cohort of cancer patients. Cancer Epidemiol 2020;64:101617. 10.1016/j.canep.2019.101617 [DOI] [PubMed] [Google Scholar]
  • 16.Mendonca SC, Abel GA, Saunders CL, et al. Pre-referral general practitioner consultations and subsequent experience of cancer care: evidence from the English cancer patient experience survey. Eur J Cancer Care 2016;25:478–90. 10.1111/ecc.12353 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Black G, Sheringham J, Spencer-Hughes V, et al. Patients’ Experiences of Cancer Diagnosis as a Result of an Emergency Presentation: A Qualitative Study. PLoS One 2015;10:e0135027–17. 10.1371/journal.pone.0135027 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Abel G, Saunders CL, Mendonca SC, et al. Variation and statistical reliability of publicly reported primary care diagnostic activity indicators for cancer: a cross-sectional ecological study of routine data. BMJ Qual Saf 2018;27:21–30. 10.1136/bmjqs-2017-006607 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Burton C, O’Neill L, Oliver P. Contribution of primary carer organisation and specialist care provider to variation in GP referrals for suspected cancer: ecological analysis of national data. BMJ Qual Saf 2019;29:274–6. 10.1136/bmjqs-2019-009469 [DOI] [PubMed] [Google Scholar]
  • 20.Meechan D, Gildea C, Hollingworth L, et al. Variation in use of the 2-week referral pathway for suspected cancer: a cross-sectional analysis. Br J Gen Pract 2012;62:e590–7. 10.3399/bjgp12X654551 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 2009;339:b2535–6. 10.1136/bmj.b2535 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.King’s Fund . An independent audit of the NHS under labour (1997-2005), 2005. Available: https://www.kingsfund.org.uk/publications/independent-audit-nhs-under-labour-1997-2005
  • 23.Sheringham J, Sequeira R, Myles J, et al. Variations in GPs’ decisions to investigate suspected lung cancer: a factorial experiment using multimedia vignettes. BMJ Qual Saf 2017;26:449–59. 10.1136/bmjqs-2016-005679 [DOI] [PubMed] [Google Scholar]
  • 24.Whiting P, Toerien M, de Salis I, et al. A review identifies and classifies reasons for ordering diagnostic tests. J Clin Epidemiol 2007;60:981–9. 10.1016/j.jclinepi.2007.01.012 [DOI] [PubMed] [Google Scholar]
  • 25.Kostopoulou O, Sirota M, Round T, et al. The role of physicians’ first impressions in the diagnosis of possible cancers without alarm symptoms. Med Decis Making 2017;37:9–16. 10.1177/0272989X16644563 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Wenghofer EF, Williams AP, Klass DJ. Factors affecting physician performance: implications for performance improvement and governance. Healthc Policy 2009;5:141–60. [PMC free article] [PubMed] [Google Scholar]
  • 27.Patient care and the general practitioner. BMJ 1994;309:1144–6. 10.1136/bmj.309.6962.1144 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Ouzzani M, Hammady H, Fedorowicz Z, et al. Rayyan—a web and mobile APP for systematic reviews. Syst Rev 2016;5:1–10. 10.1186/s13643-016-0384-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.McHugh ML. Interrater reliability: the kappa statistic. Biochem Med 2012;22:276–82. 10.11613/BM.2012.031 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Joanna Briggs Institute . Joanna Briggs Institute critical appraisal tools, 2016. Available: https://joannabriggs.org/research/critical-appraisal-tools.html
  • 31.Jones OT, Jurascheck LC, van Melle MA, et al. Dermoscopy for melanoma detection and triage in primary care: a systematic review. BMJ Open 2019;9:e027529. 10.1136/bmjopen-2018-027529 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.The Joanna Briggs Institute . The Joanna Briggs Institute Reviewers’ Manual 2014: the systematic review of economic evaluation evidence since, 2014. Available: https://nursing.lsuhsc.edu/JBI/docs/ReviewersManuals/Economic.pdf
  • 33.Popay J, Roberts H, Sowden A. Guidance on the conduct of narrative synthesis in systematic reviews. A product from the ESRC methods programme, 2006. [Google Scholar]
  • 34.Chapman D, Poirier V, Vulkan D, et al. First results from five multidisciplinary diagnostic centre (MDC) projects for non-specific but concerning symptoms, possibly indicative of cancer. Br J Cancer 2020;123:722–9. 10.1038/s41416-020-0947-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Ramanathan SA, Baratiny G, Stocks NP, et al. General practitioner referral patterns for women with gynaecological symptoms: a randomised incomplete block study design. Med J Aust 2011;195:602–6. 10.5694/mja10.10867 [DOI] [PubMed] [Google Scholar]
  • 36.Rogers HL, Dumenci L, Epstein RM, et al. Impact of patient gender and race and physician communication on colorectal cancer diagnostic visits in primary care. Journal of Women's Health 2019;28:612–20. 10.1089/jwh.2018.6961 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Kostopoulou O, Nurek M, Delaney BC. Disentangling the relationship between physician and organizational performance: a signal detection approach. Med Decis Making 2020;40:746–55. 10.1177/0272989X20936212 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Goff BA, Matthews B, Andrilla CHA, et al. How are symptoms of ovarian cancer managed? A study of primary care physicians. Cancer 2011;117:4414–23. 10.1002/cncr.26035 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Harris M, Brekke M, Dinant G-J, et al. Primary care practitioners’ diagnostic action when the patient may have cancer: an exploratory vignette study in 20 European countries. BMJ Open 2020;10:e035678. 10.1136/bmjopen-2019-035678 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Ingeman ML, Christensen MB, Bro F, et al. The Danish cancer pathway for patients with serious non-specific symptoms and signs of cancer–a cross-sectional study of patient characteristics and cancer probability. BMC Cancer 2015;15:1–11. 10.1186/s12885-015-1424-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Jensen H, Tørring ML, Olesen F, et al. Cancer suspicion in general practice, urgent referral and time to diagnosis: a population-based GP survey and registry study. BMC Cancer 2014;14. 10.1186/1471-2407-14-636 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Jiwa M, Gordon M, Arnet H, et al. Referring patients to specialists: a structured vignette survey of Australian and British GPs. BMC Fam Pract 2008;9:1–7. 10.1186/1471-2296-9-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.John SKP, Jones OM, Horseman N, et al. Inter general practice variability in use of referral guidelines for colorectal cancer. Colorect Dis 2007;9:731–5. 10.1111/j.1463-1318.2006.01201.x [DOI] [PubMed] [Google Scholar]
  • 44.Kostopoulou O, Nurek M, Cantarella S, et al. Referral decision making of general practitioners: a signal detection study. Med Decis Making 2019;39:21–31. 10.1177/0272989X18813357 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Pedersen A, Vedsted P. General practitioners’ anticipated risk of cancer at referral and their attitude to risk taking and to their role as gatekeeper. J Health Serv Res Policy 2015;20:210–6. 10.1177/1355819615601822 [DOI] [PubMed] [Google Scholar]
  • 46.Brownell P, Piccolo F, Brims F. Does this lung nodule need urgent review? a discrete choice experiment of Australian general practitioners. BMC Pulm Med 2020;20:1–8. 10.1186/s12890-020-1053-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Hjertholm P, Moth G, Ingeman ML, et al. Predictive values of GPs’ suspicion of serious disease: a population-based follow-up study. Br J Gen Pract 2014;64:e346–53. 10.3399/bjgp14X680125 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Guldbrandt LM, Rasmussen TR, Rasmussen F, et al. Implementing direct access to low-dose computed tomography in general practice--method, adaption and outcome. PLoS One 2014;9:e112162. 10.1371/journal.pone.0112162 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Scheel BI, Ingebrigtsen SG, Thorsen T, et al. Cancer suspicion in general practice: the role of symptoms and patient characteristics, and their association with subsequent cancer. Br J Gen Pract 2013;63:e627–35. 10.3399/bjgp13X671614 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Friedemann Smith C, Kristensen BM, Andersen RS. GPs’ use of gut feelings when assessing cancer risk in primary care: a qualitative study. Br J Gen Pract 2020;71:e356–63. 10.3399/bjgp21X714269 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Green T, Atkin K, Macleod U. Cancer detection in primary care: insights from general practitioners. Br J Cancer 2015;112 Suppl 1:S41–9. 10.1038/bjc.2015.41 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Högberg C, Samuelsson E, Lilja M, et al. Could it be colorectal cancer? General practitioners’ use of the faecal occult blood test and decision making – a qualitative study. BMC Fam Pract 2015;16:1–8. 10.1186/s12875-015-0371-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Johansen M-L, Holtedahl KA, Rudebeck CE. How does the thought of cancer arise in a general practice consultation? interviews with GPs. Scand J Prim Health Care 2012;30:135–40. 10.3109/02813432.2012.688701 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Kidney E, Greenfield S, Berkman L, et al. Cancer suspicion in general practice, urgent referral, and time to diagnosis: a population-based GP survey nested within a feasibility study using information technology to flag-up patients with symptoms of colorectal cancer. BJGP Open 2017;1:bjgpopen17X101109. 10.3399/bjgpopen17X101109 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Wagland R, Brindle L, James E, et al. Facilitating early diagnosis of lung cancer amongst primary care patients: the views of GPs. Eur J Cancer Care 2017;26:e12704–8. 10.1111/ecc.12704 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Harris M, Frey P, Esteva M. How health system factors influence referral decisions in patients that may have cancer: European symposium report. J Cancer Res Ther 2016;4:7–10. 10.14312/2052-4994.2016-2 [DOI] [Google Scholar]
  • 57.Dodds W, Morgan M, Wolfe C, et al. Implementing the 2-week wait rule for cancer referral in the UK: general practitioners’ views and practices. Eur J Cancer Care 2004;13:82–7. 10.1111/j.1365-2354.2004.00447.x [DOI] [PubMed] [Google Scholar]
  • 58.Harris M, Thulesius H, Neves AL, et al. How European primary care practitioners think the timeliness of cancer diagnosis can be improved: a thematic analysis. BMJ Open 2019;9:e030169–10. 10.1136/bmjopen-2019-030169 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.van Erp NF, Helsper CW, Olyhoek SM, et al. Potential for reducing time to referral for colorectal cancer patients in primary care. Ann Fam Med 2019;17:419–27. 10.1370/afm.2446 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Baun M-LL, Jensen H, Falborg AZ, et al. Ovarian cancer suspicion, urgent referral and time to diagnosis in Danish general practice: a population-based study. Fam Pract 2019;36:751–7. 10.1093/fampra/cmz013 [DOI] [PubMed] [Google Scholar]
  • 61.Guldbrandt LM, Fenger-Grøn M, Rasmussen TR, et al. The role of general practice in routes to diagnosis of lung cancer in Denmark: a population-based study of general practice involvement, diagnostic activity and diagnostic intervals. BMC Health Serv Res 2015;15:21. 10.1186/s12913-014-0656-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Walter FM, Mills K, Mendonça SC, et al. Symptoms and patient factors associated with diagnostic intervals for pancreatic cancer (symptom pancreatic study): a prospective cohort study. Lancet Gastroenterol Hepatol 2016;1:298–306. 10.1016/S2468-1253(16)30079-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Joyce K, Zermanos T, Badrinath P. Factors associated with variation in emergency diagnoses of cancer at general practice level in England. Eur J Public Health 2020;31:1–8. 10.1093/eurpub/ckab071 [DOI] [PubMed] [Google Scholar]
  • 64.Rose PW, Rubin G, Perera-Salazar R, et al. Explaining variation in cancer survival between 11 jurisdictions in the International cancer benchmarking partnership: a primary care vignette survey. BMJ Open 2015;5:e007212. 10.1136/bmjopen-2014-007212 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Harris M, Vedsted P, Esteva M, et al. Identifying important health system factors that influence primary care practitioners' referrals for cancer suspicion: a European cross-sectional survey. BMJ Open 2018;8:e022904. 10.1136/bmjopen-2018-022904 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Balogh EP, Miller BT, Ball JR. Improving diagnosis in health care, 2016: 1–472. [PubMed] [Google Scholar]
  • 67.Gillard S, Benson J, Silverman J. Teaching and assessment of explanation and planning in medical schools in the United Kingdom: cross sectional questionnaire survey. Med Teach 2009;31:328–31. 10.1080/01421590801953018 [DOI] [PubMed] [Google Scholar]
  • 68.Keijzers G, Fatovich DM, Egerton-Warburton D, et al. Deliberate clinical inertia: using meta-cognition to improve decision-making. Emerg Med Australas 2018;30:585–90. 10.1111/1742-6723.13126 [DOI] [PubMed] [Google Scholar]
  • 69.Meyer AND, Singh H. Calibrating how doctors think and seek information to minimise errors in diagnosis. BMJ Qual Saf 2017;26:436–8. 10.1136/bmjqs-2016-006071 [DOI] [PubMed] [Google Scholar]
  • 70.Whelehan DF, Conlon KC, Ridgway PF. Medicine and heuristics: cognitive biases and medical decision-making. Ir J Med Sci 2020;189:1477–84. 10.1007/s11845-020-02235-1 [DOI] [PubMed] [Google Scholar]
  • 71.del Campo C, Pauser S, Steiner E, et al. Decision making styles and the use of heuristics in decision making. J Bus Econ 2016;86:389–412. 10.1007/s11573-016-0811-y [DOI] [Google Scholar]
  • 72.Pedersen AF, Ingeman ML, Vedsted P. Empathy, burn-out and the use of gut feeling: a cross-sectional survey of Danish general practitioners. BMJ Open 2018;8:e020007–8. 10.1136/bmjopen-2017-020007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Kristensen BM, Andersen RS, Nicholson BD, et al. Cultivating doctors' gut feeling: experience, temporality and politics of gut feelings in family medicine. Cult Med Psychiatry 2021. doi: 10.1007/s11013-021-09736-3. [Epub ahead of print: 26 Sep 2021]. [DOI] [PubMed] [Google Scholar]
  • 74.Smith CF, Drew S, Ziebland S, et al. Understanding the role of GPs' gut feelings in diagnosing cancer in primary care: a systematic review and meta-analysis of existing evidence. Br J Gen Pract 2020;70:e612–21. 10.3399/bjgp20X712301 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Winter R, Issa E, Roberts N, et al. Assessing the effect of empathy-enhancing interventions in health education and training: a systematic review of randomised controlled trials. BMJ Open 2020;10:1–12. 10.1136/bmjopen-2019-036471 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Zwaan L, El-Kareh R, Meyer AND, et al. Advancing diagnostic safety research: results of a systematic research priority setting exercise. J Gen Intern Med 2021;36:2943–51. 10.1007/s11606-020-06428-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Din NU, Ukoumunne OC, Rubin G, et al. Age and gender variations in cancer diagnostic intervals in 15 cancers: analysis of data from the UK clinical practice research Datalink. PLoS One 2015;10:e0127717. 10.1371/journal.pone.0127717 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Williams P, Murchie P, Bond C. Patient and primary care delays in the diagnostic pathway of gynaecological cancers: a systematic review of influencing factors. Br J Gen Pract 2019;69:E106–11. 10.3399/bjgp19X700781 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Humphrys E, Walter FM, Rubin G, et al. Patient symptom experience prior to a diagnosis of oesophageal or gastric cancer: a multi-methods study. BJGP Open 2020;4:1–15. 10.3399/bjgpopen20X101001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Bankhead CR, Collins C, Stokes-Lampard H, et al. Identifying symptoms of ovarian cancer: a qualitative and quantitative study. BJOG 2008;115:1008–14. 10.1111/j.1471-0528.2008.01772.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.Mills K, Birt L, Emery JD, et al. Understanding symptom appraisal and help-seeking in people with symptoms suggestive of pancreatic cancer: a qualitative study. BMJ Open 2017;7:1–9. 10.1136/bmjopen-2016-015682 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Mendonca SC, Abel GA, Gildea C, et al. Associations between general practice characteristics with use of urgent referrals for suspected cancer and endoscopies: a cross-sectional ecological study. Fam Pract 2019;36:573–80. 10.1093/fampra/cmy118 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Champagne-Langabeer T, Hedges AL. Physician gender as a source of implicit bias affecting clinical decision-making processes: a scoping review. BMC Med Educ 2021;21:1–9. 10.1186/s12909-021-02601-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern Med 2005;165:1493–9. 10.1001/archinte.165.13.1493 [DOI] [PubMed] [Google Scholar]
  • 85.Herbert A, Rafiq M, Pham TM, et al. Predictive values for different cancers and inflammatory bowel disease of 6 common abdominal symptoms among more than 1.9 million primary care patients in the UK: a cohort study. PLoS Med 2021;18:e1003708. 10.1371/journal.pmed.1003708 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 86.Nicholson BD, Oke J, Friedemann Smith C, et al. The suspected cancer (scan) pathway: protocol for evaluating a new standard of care for patients with non-specific symptoms of cancer. BMJ Open 2018;8:1–8. 10.1136/bmjopen-2017-018168 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.Stolper E, van Bokhoven M, Houben P, et al. The diagnostic role of gut feelings in general practice a focus group study of the concept and its determinants. BMC Fam Pract 2009;10:1–9. 10.1186/1471-2296-10-17 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Pedersen AF, Andersen CM, Ingeman ML, et al. Patient–physician relationship and use of gut feeling in cancer diagnosis in primary care: a cross-sectional survey of patients and their general practitioners. BMJ Open 2019;9:e027288–10. 10.1136/bmjopen-2018-027288 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 89.Woolley A, Kostopoulou O. Clinical intuition in family medicine: more than first impressions. Ann Fam Med 2013;11:60–6. 10.1370/afm.1433 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90.Arroll B, Allan GM, Elley CR, et al. Diagnosis in primary care: probabilistic Reasoning. J Prim Health Care 2012;4:166–73. 10.1071/HC12166 [DOI] [PubMed] [Google Scholar]
  • 91.Hillen MA, Gutheil CM, Strout TD, et al. Tolerance of uncertainty: conceptual analysis, integrative model, and implications for healthcare. Soc Sci Med 2017;180:62–75. 10.1016/j.socscimed.2017.03.024 [DOI] [PubMed] [Google Scholar]
  • 92.VanNieuwenborg L, Goossens M, De Lepeleire J, et al. Continuing medical education for general practitioners: a practice format. Postgrad Med J 2016;92:217–22. 10.1136/postgradmedj-2015-133662 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2021-053732supp001.pdf (44.3KB, pdf)

Supplementary data

bmjopen-2021-053732supp002.pdf (98.4KB, pdf)

Supplementary data

bmjopen-2021-053732supp003.pdf (119.8KB, pdf)

Supplementary data

bmjopen-2021-053732supp004.pdf (94.8KB, pdf)

Supplementary data

bmjopen-2021-053732supp005.pdf (187.2KB, pdf)

Reviewer comments
Author's manuscript

Data Availability Statement

All data relevant to the study are included in the article or uploaded as online supplemental information. All research data supporting this publication are provided within this article.


Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES