Skip to main content
The British Journal of General Practice logoLink to The British Journal of General Practice
. 2011 Apr 26;61(586):e231–e243. doi: 10.3399/bjgp11X572427

The diagnostic value of symptoms for colorectal cancer in primary care: a systematic review

Margaret Astin 1,2,3, Tom Griffin 1,2,3, Richard D Neal 1,2,3, Peter Rose 1,2,3, William Hamilton 1,2,3
PMCID: PMC3080228  PMID: 21619747

Abstract

Background

Over 37 000 new colorectal cancers are diagnosed in the UK each year. Most present symptomatically to primary care.

Aim

To conduct a systematic review of the diagnostic value of symptoms associated with colorectal cancer.

Design

Systematic review.

Method

MEDLINE, Embase, Cochrane Library, and CINAHL were searched to February 2010, for diagnostic studies of symptomatic adult patients in primary care. Studies of asymptomatic patients, screening, referred populations, or patients with colorectal cancer recurrences, or with fewer than 100 participants were excluded. The target condition was colorectal cancer. Data were extracted to estimate the diagnostic performance of each symptom or pair of symptoms. Data were pooled in a meta-analysis. The quality of studies was assessed with the QUADAS tool.

Results

Twenty-three studies were included. Positive predictive values (PPVs) for rectal bleeding from 13 papers ranged from 2.2% to 16%, with a pooled estimate of 8.1% (95% confidence interval [CI] = 6.0% to 11%) in those aged ≥50 years. Pooled PPV estimates for other symptoms were: abdominal pain (three studies) 3.3% (95% CI = 0.7% to 16%); and anaemia (four studies) 9.7% (95% CI = 3.5% to 27%). For rectal bleeding accompanied by weight loss or change in bowel habit, pooled positive likelihood ratios (PLRs) were 1.9 (95% CI = 1.3 to 2.8) and 1.8 (95% CI = 1.3 to 2.5) respectively, suggesting higher risk when both symptoms were present. Conversely, the PLR was one or less for abdominal pain, diarrhoea, or constipation accompanying rectal bleeding.

Conclusion

The findings suggest that investigation of rectal bleeding or anaemia in primary care patients is warranted, irrespective of whether other symptoms are present. The risks from other single symptoms are lower, though multiple symptoms also warrant investigation.

Keywords: colorectal neoplasms; diagnosis; primary health care; review, systematic; symptoms


How this fits in

The symptoms of colorectal cancer have been described in many secondary and primary care studies. The risk of colorectal cancer in primary care patients with symptoms has been estimated in single studies. Risks from secondary care studies do not pertain to primary care populations, and generally overestimate the likelihood of a cancer as the cause of symptoms. The pooled positive predictive value of colorectal cancer with rectal bleeding was 8.1% in the over 50s, irrespective of other symptoms. Second symptoms accompanying rectal bleeding altered the strength of the association with cancer: weight loss or a change in bowel habit increased the risk further, whereas abdominal pain decreased the overall risk. Anaemia was also a high-risk symptom with a pooled positive predictive value of 9.7%, though there were too few studies to offer pooled estimates for specific levels of haemoglobin.

INTRODUCTION

Colorectal cancer is the third most common cancer in the UK, with over 37 000 new diagnoses each year. A national screening programme is operative, but will only identify a minority of cancers, with the majority presenting symptomatically to primary care.1 Many symptoms have been described, with the main ones being rectal bleeding, diarrhoea, or constipation — collectively sometimes named ‘change in bowel habit’ — loss of weight, abdominal pain, and anaemia.2 However, these symptoms are also common with benign conditions, so the clinician has to select patients at higher risk for investigation. There is no test available for use in primary care that has sufficient discrimination to provide the basis for referral decisions, although primary care investigation sometimes includes faecal occult blood testing and estimation of haemoglobin.

The decision to refer for investigation is largely based on the estimated risk of an underlying colorectal cancer. Risk estimates underpin national guidance, such as the Referral Guidelines for Suspected Cancer, first published in 2000 and updated in 2005.3 This guidance was based on a literature review of both primary studies and review papers. However, at that time almost all published research was based on findings in the referred population, and so does not pertain to the primary care population, where the advice is to be applied. This criticism applies to a previous systematic review that examined all studies together from different populations.4 Another review included both populations but differed in focus.5 Additionally, much progress has been made in quantifying the risk of cancer in primary care. Thus, a systematic review was performed to identify the risk of colorectal cancer in patients reporting a symptom to primary care.

METHOD

Data sources and search strategy

Comprehensive searches of electronic databases were conducted in MEDLINE (1950 to April 2009), Embase (1980 to April 2009), and MEDLINE in process (April 2009) using the OVID platform. The Cochrane Library (Database of Reviews of Effectiveness, Cochrane Database of Systematic Reviews, Cochrane Controlled Trials Register Issue 2 April 2009) and CINAHL (1998 to April 2009) were searched using the Wiley interface. All searches were updated in February 2010. Diagnostic terms were used along with study design terms to identify potentially relevant study types; terms to identify lower gastrointestinal neoplasia; terms to identify symptoms common in colorectal cancer, for example, rectal bleeding, weight loss, rectal or abdominal pain or mass, anaemia, constipation or diarrhoea; and terms for primary care settings Synonyms and spelling variations of these terms were used. All sets included Medical Subject Heading (MeSH) and free-text terms, and there were no language restrictions. The search strategy is available from the authors.

Further searches of ongoing studies included the European Organisation for Research and Treatment of Cancer, National Cancer Institute of Canada Clinical Trials Group, Cancer Research UK Directory of Funded Research, and the National Cancer Research Network. Reference lists of included studies were screened for relevance; personal literature collections and contacts of authors were also used.

Inclusion criteria

Studies of any design were eligible. These included randomised trials and retrospective or prospective observational studies such as cohort and case–control designs. Only adult populations of symptomatic individuals were of interest; however, if younger patients were participants, these studies were also included. Only studies conducted within primary care were eligible, including those utilising electronic general practice databases and those undergoing primary care-based investigations.

Exclusions were studies of asymptomatic participants attending for screening or population studies, those already referred to secondary care, or patients with recurrent colorectal cancer. Studies recruiting fewer than 100 participants were excluded, as they would provide very few cancers.

The target condition was adenocarcinoma of the colon or rectum, including carcinoma in situ. The methodology used in this review was that of diagnostic accuracy, using symptoms commonly reported by patients with colorectal cancer as index ‘tests’. Symptoms had to be adequately reported, for example, as abdominal pain not discomfort. They could be recorded by the clinician, collected using a questionnaire, or coded, for example, with the International Classification of Primary Care.6 Valid reference standards included histology, colonoscopy, double-contrast barium enema, computerised tomography colonography, or clinical follow-up of 1 year or more.

Study selection

One reviewer ran the searches and screened titles and abstracts for inclusion. All potentially relevant included abstracts were then screened blind by another author, and the findings compared. Any disagreements were resolved by consensus; if uncertainty remained, the full paper was obtained to assess its eligibility. Authors were contacted for further information when necessary.

Data extraction and quality assessment

Data extraction and quality assessment of full papers were conducted by one reviewer. Data extraction was checked by a second reviewer. Review Manager (Version 5.0) was used for data collation, and methodological quality was assessed with the QUADAS tool.7 Stata (version 10) was used to summarise positive predictive values (PPVs) and to plot Forest and likelihood ratio graphs. Other diagnostic performance measures were analysed in Meta-DiSc.8 One question was added to the QUADAS instrument about the description of symptoms, and two questions removed: blinding of the reference standard; and the presence of clinical information for interpretation of reference tests (symptoms were used as a ‘test’, and it was assumed that clinical information was available).

Statistical analysis and data synthesis

The number of true and false positives and true and false negatives were extracted from each study. If only data on true and false positives were available, as in some studies of patients with rectal bleeding, the PPV was calculated. Where all data for a 2 × 2 table were available in three or more studies, positive and negative likelihood ratios (PLRs, NLRs) were calculated (Cochrane Handbook for Systematic Reviews of Interventions Version 4.2.6 2006). Case–control studies were not used in the assessment of PPV because of potential bias associated with this research design.9,10 Inconsistency between studies for each metric was measured by the I2 statistic and categorised as low (0% to 25%), moderate (30% to 60%), substantial (50% to 90%), or considerable (75% to 100%). Tests for heterogeneity were based on χ2 and the I2 statistic, with P-values <0.10 taken to be statistically significant. Random effects models were used for summary and subgroup statistics.

Data were extracted for each relevant symptom and for pairs of symptoms. The effect of age of participants as a subgroup was also examined across all studies where possible. Other subgroup analyses considered were: sample size (<1000 versus ≥1000); number of cancers detected (<100 versus ≥100); single-centre recruitment versus multicentre recruitment; case–control versus cohort designs; data collection by template or questionnaire versus consultation; and studies of first-onset only rectal bleeding versus all times of onset. The effects of quality criteria were assessed by comparing the findings of studies that met the criteria with those that were either not met or unclear when significant heterogeneity was present between studies.

RESULTS

The electronic searches identified 2097 records; a further 11 were retrieved from reference lists, and four from personal collections. Fifty-seven papers were obtained for appraisal; 23 met the inclusion criteria, including one identified from reference list screening (Appendix 1). A total of 81 464 participants were recruited. Study characteristics are shown in Appendix 2. The majority of studies were conducted in Europe (n = 21), with one each in Australia and the US. Study sizes ranged from 112 to 933 in prospective designs, and from 130 to 43 791 in retrospective designs. Symptom data were collected using a questionnaire or template for patients or doctors in nine studies. In eight, the method of data collection was not described, or the routine process was used in GPs' surgeries; in six retrospective studies, symptom data were retrieved from NHS databases. Another study used GP records. Four of 15 papers reported first-onset rectal bleeding. In one study, GPs had recently undertaken a training programme in colorectal diseases.11 Only three studies were conducted in a single centre.1214

The proportion of study participants with colorectal cancer ranged from 0.4% to 23.2%, with 17 studies having 10% or less. The symptoms reported singly were: rectal bleeding (n = 15 studies), abdominal pain (n = 5 studies), anaemia (n = 5 studies), weight loss (n = 3 studies), diarrhoea (n = 3 studies), constipation (n = 3 studies), change in bowel habit (n = 2 studies), and bloating (n = 1 study). Two papers reported colorectal cancers from any of several symptoms rather than specific symptoms.15,16 Symptom pairs were reported in six papers.

Rectal bleeding

Studies reported rectal bleeding as either a single symptom, or subclassified by appearance. Some studies included only patients with a first rectal bleed.12,1719 All data on rectal bleeding were grouped together. Sufficient data to calculate PPVs for rectal bleeding were available in 13 papers with 18 634 participants.11,12,14,1726 This is displayed as a Forest plot (Figure 1A). The PPV ranged from 2.2%18 to 15.8%.11 A subgroup analysis of five studies with data from 887 patients over 50 years of age (Figure 1B) provided a pooled estimate of 8.1% (95% confidence interval [CI] = 6.0 to 10.8), with moderate inconsistency between studies (I2 = 31%, P = 0.21).17,21,2426 Data were pooled in three studies of rectal bleeding with 46 164 patients.11,27,28 However, a large degree of inconsistency (I2>96.0%, P<0.001) was present (Table 1).

Figure 1.

Figure 1

Positive predictive values of rectal bleeding in the diagnosis of colorectal cancer in primary care. Random effects pooled estimate (diamond) is based on a subgroup (B) aged ≥50 years.

Table 1.

Sensitivity, specificity, positive and negative likelihood ratios of unpaired symptoms

Symptom and study Sensitivity, % (95% CI) Specificity, % (95% CI) Positive likelihood ratio (95% CI) Negative likelihood ratio (95% CI)
Rectal bleeding
Hamilton etal, 200527 42 (37.2 to 47.8) 96 (94.8 to 96.7) 10.13 (7.85 to 13.08) 0.60 (0.55 to 0.66)
Hamilton etal, 200928 16 (14.6to 16.6) 99 (98.7 to 98.9) 12.97 (11.62 to 14.48) 0.85 (0.84 to 0.86)
Panzuto etal, 200311 44 (28.5 to 60.3) 60 (53.3 to 66.1) 1.09 (0.75 to 1.60) 0.94 (0.70 to 1.25)
Summary estimates 17 (16.4 to 18.4) 98 (98.3 to 98.6) 5.31 (1.65 to 17.07) 0.77 (0.57 to 1.03)
I2 = 98.6%, P<0.001 I2 = 99.6%, P<0.001 I2 = 98.7%, P<0.001 I2 = 96.7%, P<0.001

Abdominal pain
Hamilton etal, 200527 42 (37.2 to 47.8) 91 (89.2 to 92.0) 4.54 (3.75 to 5.49) 0.64 (0.58 to 0.70)
Hamilton etal, 200928 30 (28.5 to 31.0) 92 (91.6 to 92.1) 3.65 (3.46 to 3.85) 0.77 (0.75 to 0.78)
Panzuto etal, 200311 73 (57.1 to 85.8) 19 (14.4 to 24.8) 0.91 (0.75 to 1.10) 1.39 (0.79 to 2.46)
Summary estimates 31 (29.6 to 32.0) 91 (91.1 to 91.6) 2.47 (1.09 to 5.61) 0.75 (0.62 to 0.90)
I2 = 96.4%, P<0.001 I2 = 99.7% P<0.001 I2 = 99.0%, P<0.001 I2 = 89.9%, P<0.001

Weight loss
Hamilton etal, 200527 27 (22.3 to 31.9) 95 (93.6 to 95.7) 5.11 (3.92 to 6.65) 0.77 (0.72 to 0.82)
Hamilton etal, 200928 10 (9.5 to 11.1) 96 (95.8 to 96.2) 2.57 (2.34 to 2.81) 0.94 (0.93 to 0.94)
Panzuto etal, 200311 37 (22.1 to 53.1) 89 (84.0 to 92.4) 3.24 (1.89 to 5.54) 0.72 (0.56 to 0.91)
Summary estimates 11 (10.6 to 12.3) 96 (95.7 to 96.1) 3.48 (2.08 to 5.80) 0.82 (0.69 to 0.97)
I2 = 97.7%, P<0.001 I2 = 93.0%, P<0.001 I2 = 91.6%, P<0.001 I2 = 95.1%, P<0.001

Diarrhoea
Hamilton etal, 200527 38 (32.7 to 43.1) 90 (88.7 to 91.6) 3.86 (3.17 to 4.69) 0.69 (0.63 to 0.75)
Hamilton etal, 200928 18(17.0to 19.1) 94(94.1 to 94.6) 3.18 (2.97 to 3.41) 0.87 (0.86 to 0.88)
Panzuto etal, 200311 24 (12.4 to 40.3) 69 (62.3 to 74.4) 0.78 (0.44 to 1.37) 1.10 (0.91 to 1.34)
Summary estimates 19 (18.3 to 20.3) 94 (93.8 to 94.2) 2.44 (1.57 to 3.79) 0.86 (0.70 to 1.04)
I2 = 97.2%, P<0.001 I2 = 99.0%, P<0.001 I2 = 92.7%, P<0.001 I2 = 94.4%, P<0.001

Constipation
Hamilton etal, 200527 26 (21.5 to 31.0) 85 (83.5 to 86.8) 1.76 (1.43 to 2.17) 0.87 (0.81 to 0.93)
Hamilton etal, 200928 27 (25.8 to 28.2) 89 (89.1 to 89.7) 2.55 (2.42 to 2.69) 0.82 (0.80 to 0.83)
Panzuto etal, 200311 51 (35.1 to 67.1) 53 (46.2 to 59.2) 1.08 (0.78 to 1.50) 0.93 (0.66 to 1.30)
Summary estimates 27 (25.9 to 28.2) 89 (88.7 to 89.3) 1.74(1.11 to 2.72) 0.84 (0.79 to 0.88)
I2 = 81.7%, P= 0.004 I2 = 99.1%, P<0.001 I2 = 94.4%, P<0.001 I2 = 44.4%, P=0.17

Anaemia
Hamilton 200829 37 (35.7 to 39.1) 92 (91.2 to 92.3) 4.62 (3.03 to 7.06) 0.68 (0.65 to 0.71)
Panzuto etal, 200311 68 (51.9 to 81.9) 83 (77.5 to 87.4) 3.98(2.81 to 5.64) 0.38 (0.24 to 0.60)

Change in bowel habit
Hamilton etal, 200828 11 (10.4 to 12.1) 99 (98.9 to 99.1) 11.47 (10.12 to 13.00) 0.90 (0.89 to 0.91)
Panzuto etal, 200311 20 (8.8 to 34.9) 80 (73.8 to 84.4) 0.95 (0.49 to 1.86) 1.01 (0.86 to 1.19)

Bloating
Panzuto etal, 200311 54 (38.7 to 67.9) 39 (33.4 to 45.6) 0.88 (0.63 to 1.15) 1.18(0.79 to 1.64)

Participants in the six studies reporting symptom pairs all examined rectal bleeding with a second symptom; these are described next.1921,2224

Rectal bleeding with abdominal pain

Six studies from five papers20,2326 reported this symptom pair,19,2124 with a total of 1466 evaluated participants. The pooled sensitivity was low, with no inconsistency between studies. Specificity was poor, with considerable inconsistency, indicating that these two symptoms occurring together are unlikely to be specific to colorectal cancer. The PLR and NLR were low (NLR 1.04, 95% CI = 0.82 to 1.30), with moderate inconsistency. The PPV was 7.6%, with greater inconsistency (Table 2 and Figure 2A).

Table 2.

Sensitivity, specificity, positive likelihood ratio, and positive predictive value of symptompairs

Symptom pairs and study Sensitivity, % (95% CI) Specificity, % (95% CI) Positive likelihood ratio, (95% CI) Positive predictive value, % (95% CI)
Rectal bleeding with:

Abdominal pain
Fijten et al, 199521 33 (7.5 to 70.1) 49 (43.0 to 55.5) 0.66 (0.26 to 1.67) 2.22 (0.46 to 6.36)
Mant et al, 198922 25 (7.3 to 52.4) 70 (60.8 to 77.4) 0.82 (0.34 to 1.99) 9.30 (2.59 to 22.1)
Metcalf et al, 199623 38 (8.5 to 75.5) 57 (46.3 to 67.5) 0.88 (0.35 to 2.21) 7.14 (1.50 to 19.5)
Norrelund and Norrelund, 1996,19 S1 31 (16.1 to 50.0) 78 (71.6 to 84.2) 1.45 (0.81 to 2.60) 20.8 (10.5 to 35.0)
Norrelund and Norrelund, 1996,19 S2 50 (28.2 to 71.8) 77 (68.8 to 83.7) 2.16 (1.29 to 3.63) 26.2 (13.9 to 42.0)
Robertson et al, 200624 20 (5.7 to 43.7) 60 (55.8 to 64.0) 0.50 (0.21 to 1.21) 1.72 (0.47 to 4.36)
Summary estimates 33 (24.0 to 42.5), I2 = 0.0%, P = 0.42 63 (60.1 to 65.3), I2 = 91.3%, P<0.000 1.03 (0.63 to 1.69), I2 = 61.1%, P = 0.025 7.58 (3.00 to 19.2), I2 = 83.8%, P<0.001

Weight loss
Fijten et al, 199521 44 (13.7 to 78.8) 85 (80.5 to 89.4) 3.04 (1.38 to 6.68) 9.52 (2.66 to 22.6)
Mant et al, 198922 13 (1.6 to 38.3) 91 (84.1 to 95.0) 1.32 (0.33 to 5.38) 14.3 (1.78 to 42.8)
Metcalf et al, 199623 25 (3.2 to 65.1) 86 (76.8 to 92.2) 1.75 (0.48 to 6.43) 13.3 (1.66 to 40.5)
Norrelund and Norrelund, 1996,19 S1 16 (5.3 to 32.8) 90 (85.0 to 94.3) 1.62 (0.64 to 4.07) 22.7 (7.82 to 45.4)
Norrelund and Norrelund, 1996,19 S2 23 (7.8 to 45.4) 87 (80.5 to 92.4) 1.79 (0.74 to 4.36) 22.7 (7.82 to 45.4)
Robertson et al, 200624 14 (2.9 to 34.9) 90 (86.9 to 92.0) 1.32 (0.45 to 3.88) 4.84 (1.01 to 13.5)
Summary estimates 19 (12.3 to 27.9), I2 = 0.0%, P = 0.47 89 (86.7 to 90.2), I2 = 1.9%, P = 0.40 1.88 (1.25 to 2.83), I2 = 0.0%, P = 0.80 13.4 (8.15 to 21.9), I2 = 9.9%, P = 0.35

Change in bowel habit
Ellis and Thompson, 200520 100 (71.7 to 100.0) 58 (51.3 to 63.8) 2.26 (1.88 to 2.72) 9.24 (4.7 to 15.9)
Fijten et al, 199521 78 (40.0 to 97.2) 73 (66.8 to 78.0) 2.85 (1.91 to 4.26) 8.97 (3.7 to 17.6)
Mant et al, 198922 38 (15.2 to 64.6) 61 (51.6 to 69.2) 0.95 (0.49 to 1.86) 10.7 (4.04 to 21.9)
Metcalf et al, 199623 50 (15.7 to 84.3) 62 (50.8 to 71.6) 1.30 (0.62 to 2.72) 10.3 (2.87 to 24.2)
Norrelund and Norrelund, 1996,19 S1 59 (40.6 to 76.3) 77 (69.8 to 82.7) 2.55 (1.72 to 3.77) 31.7 (20.6 to 45.0)
Norrelund and Norrelund, 1996,19 S2 46 (24.4 to 67.8) 72 (63.2 to 79.1) 1.60 (0.94 to 2.73) 20.8 (10.5 to 35.0)
Robertson et al, 200624 59 (36.4 to 79.3) 55 (50.6 to 58.9) 1.31 (0.91 to 1.87) 4.83 (2.6 to 8.12)
Summary estimates 58 (49.0 to 67.3), I2 = 66.5%, P = 0.006 63 (60.4 to 65.1), I2 = 88.0%, P<0.001 1.81 (1.33 to 2.46), I2 = 74.6%, P = 0.001 11.8 (6.78 to 20.4), I2 = 77.1%, P<0.001

Anaemia
Fijten et al, 199521 33 (7.5 to 70.1) 96 (92.6 to 97.9) 7.88 (2.65 to 23.4) 21.4 (4.70 to 50.8)

Decreased appetite
Fijten et al, 199521 11 (0.30 to 48.2) 84 (79.2 to 88.4) 0.71 (0.11 to 4.57) 2.4 (0.06 to 12.6)

Diarrhoea
Metcalf et al, 199623 25 (3.20 to 65.1) 73 (62.2 to 81.4) 0.91 (0.26 to 3.16) 7.4 (0.91 to 24.3)

Constipation
Metcalf et al, 199623 13 (0.30 to 52.7) 58 (47.4 to 68.5) 0.30 (0.05 to 1.90) 2.6 (0.07 to 13.5)

Peri-anal symptoms
Ellis and Thompson, 200520 36 (10.9 to 69.2) 22 (17.0 to 27.5) 0.47 (0.21 to 1.02) 2.0 (0.54 to 4.80)

Tenesmus
Mant et al, 198922 13 (1.6 to 38.3) 78 (70.2 to 85.1) 0.58 (0.15 to 2.19) 6.7 (0.82 to 22.1)
Figure 2.

Figure 2

Positive likelihood ratios (LRs) of rectal bleeding and another symptom:A, abdominal pain;Bweight loss; C, change in bowel habit.

Rectal bleeding with weight loss

Six studies from five papers reported these symptoms, with a total of 1468 evaluated participants.19,2124 The pooled sensitivity of these symptoms was low but the specificity was stronger. The pooled PLR of 1.88 (95% CI = 1.25 to 2.83) and NLR of 0.93 (95% CI = 0.85 to 1.02) suggest that weight loss in addition to rectal bleeding increases the risk of an underlying cancer. There was little inconsistency between studies (Table 2 and Figure 2B).

Rectal bleeding with change in bowel habit

Seven studies from six papers reported this symptom, with a total of 1729 evaluated participants.19,2024 The pooled sensitivity and specificity of these symptoms was moderate, with substantial inconsistency between studies. The PLR of 1.81 (95% CI = 1.33 to 2.46) and NLR of 0.70 (95% CI = 0.51 to 0.96) again suggest a change in bowel habit slightly increases the risk of cancer over and above that from rectal bleeding. (Table 2 and Figure 2C).

Rectal bleeding with anaemia

One study with 269 patients assessed this symptom pair.21 The sensitivity was comparable to that of rectal bleeding with abdominal pain, though the specificity was higher. Consequently, the PLR and PPV were moderate although imprecise; the NLR was 0.70 (95% CI = 0.44 to 1.11) (Table 2).

Rectal bleeding with decreased appetite

The same study assessed this symptom pair.21 Sensitivity, specificity, and NLR (1.06; (95% CI = 0.83 to 1.34) were low, with unremarkable PLR and PPV (Table 2).

Rectal bleeding with diarrhoea or constipation

A small study of 99 evaluated patients assessed these symptom pairs.23 The diagnostic performance of the symptom rectal bleeding with diarrhoea or constipation was imprecise for all findings (Table 2). The NLR was unremarkable for diarrhoea (1.03, 95% CI = 0.68 to 1.57), and low for constipation (1.50, 95% CI = 1.10 to 2.06).

Rectal bleeding with peri-anal symptoms

A single study of 266 patients evaluated this symptom pair using any peri-anal symptom.20 The sensitivity and specificity were poor. A NLR of 2.90 (95% CI = 1.75 to 4.79) is evidence that the presence of peri-anal symptoms lessens the risk of colorectal cancer when the patient has rectal bleeding. A single study of 145 patients evaluated tenesmus specifically: all the findings were unremarkable (NLR = 1.12, 95% CI = 0.91 to 1.37) (Table 2).22

Abdominal pain

Five studies examined this symptom. PPVs were calculated in three studies,11,30,31 containing 1112 participants, giving an overall estimate of 3.3% (95% CI = 0.7% to 15.6%). However, considerable inconsistency was present (Table 3). The PLR and NLR estimated from another three studies of 46 164 participants,11,27,28 had considerable inconsistency between studies (I2>89.0%, P≤0.001), possibly due to variations in study design and sample size (Table 1).

Table 3.

Positive predictive values of unpaired symptoms

Symptom Study PPV, % (95% CI)
Abdominal pain Bellentani et al, 199030 3.94 (1.90 to 7.12)
Muris et al, 199331 0.52 (0.11 to 1.51)
Panzuto et al, 200311 13.5 (9.26 to 18.7)
Summary estimate 3.29 (0.69 to 15.6), I2 = 94.1%, P<0.001

Anaemia Farrus et al, 200013 2.30 (0.28 to 8.06)
Lucas et al, 199632 6.92 (3.21 to 12.7)
Panzuto et al, 200311 40.6 (28.9 to 53.1)
Yates et al, 200433 8.59 (6.12 to 11.6)
Summary estimate 9.70 (3.52 to 26.8), I2 = 91.7% P<0.001

Weight loss Panzuto et al, 200311 35.7 (9.3 to 18.6)

Change in bowel habit Panzuto et al, 200311 14.0 (6.26 to 25.8)

Diarrhoea Panzuto et al, 200311 11.8 (5.8 to 20.6)

Constipation Panzuto et al, 200311 15.7 (10.0 to 23.0)

Bloating Panzuto et al, 200311 13.2 (8.44 to 19.3)

PPV = positive predictive value.

Anaemia

Five studies, with a total of 14 625 participants, examined this feature. PPVs were calculated in four studies of 928 participants.11,13,32,33 The large degree of inconsistency in the pooled PPV may be due to a large proportion of true positives in the study by Panzuto et al.11 When this study was excluded, the pooled PPV reduced to 7.0% (95% CI = 4.2 to 11.4) with lower inconsistency (I2 = 40%, P = 0.19) (Table 3).

In a large case–control study,29 the sensitivity of anaemia for colorectal cancer was similar in males and females over the age of 30 years (37.2% versus 37.6%; χ2 P = 0.82). A smaller cohort study reported a higher sensitivity for anaemia.11 The PLRs of the two studies were similar in magnitude (Table 1).

Weight loss, diarrhoea, and constipation

Three studies of 46 164 participants, examined the association of weight loss, diarrhoea, and constipation separately (Table 1).11,27,28 Inconsistency was considerable for all parameters (I2 >81%, P≤0.004) with the exception of the NLR for constipation (I2 = 44%, P = 0.17). PPVs in the study by Panzuto et al were variable (Table 3).11

Change in bowel habit

Two studies of 44 071 participants evaluated this symptom.11,28 The PLRs were significantly different (P<0.001), while the NLRs were more consistent (P = 0.15), indicating that patients without these symptoms could not have cancer ruled out (Table 1). The PPV in the study by Panzuto et al was similar to that of constipation and diarrhoea (Table 3).11

Bloating

One study of 280 participants' evaluated bloating.11 The study was small and the GPs had recently taken a training programme on colorectal diseases (Tables 1 and 3). This may have influenced referral behaviour.

Any symptom

Two studies, with 965 participants, grouped relevant presenting symptoms to evaluate the association with a diagnosis of colorectal cancer or other conditions.15,16 As this is not as useful to clinicians as specific symptoms, these have not been reported further here.

Subgroup analyses

Subgroup analyses of PPVs for rectal bleeding were conducted in single-centre versus multicentre studies; symptom data collection by template or questionnaire versus by consultation or not reported; first-onset only rectal bleeding versus any onset, including those with a proportion of first-onset bleeding; and in studies where QUADAS scores were low. Three other subgroup analyses (prospective versus retrospective designs; number of cancers detected <100 versus ≥100; and study size <1000 versus ≥1000) were not performed because of the small number of large studies, or retrospective or case–control designs. No significant differences were found between the subgroups that could be analysed. No significant differences were found between studies in the PPV of rectal bleeding (criterion met versus not met or unclear) for the lowest-scoring QUADAS items' differential verification bias and partial verification bias.

Quality assessment

The quality assessment of 23 studies is shown in Figure 3. The criteria ‘met’ for differential and partial verification bias were relatively low (26% and 48% respectively) because of the range of reference tests reported; and not all participants received a reference standard. This is not unusual at the interface of primary and secondary care. Acceptable delay was met in 48% of studies, though a large proportion (43%) did not report this item.

Figure 3.

Figure 3

Methodological quality of studies

DISCUSSION

Summary

This review has confirmed the association between colorectal cancer and its main symptoms when reported to primary care. It was possible to quantify the associations by calculating summary PLRs and PPVs. The summary PLR for unpaired symptoms ranged from 5.3 for rectal bleeding to 1.7 for constipation. Intermediate values were found for weight loss, abdominal pain, and diarrhoea. There were not enough studies to perform a meta-analysis for the single symptoms of anaemia, change in bowel habit, and bloating, although the two studies of anaemia found a small increase in the likelihood of cancer. When rectal bleeding was accompanied by a second symptom the risk of colorectal cancer was greatest when weight loss or a change in bowel habit was also present.

Strengths and limitations

The study methods followed the traditional schema for systematic reviews. A broad selection of symptoms was chosen to ensure relevant studies were identified. All selected studies were observational, and most were multicentre. They were largely from Europe, which is to be expected. Studies performed reasonably well against the QUADAS criteria, which are designed for use with diagnostic tests. The lack of gold-standard confirmation (histology) of colorectal cancer diagnosis is a small concern, although it is reasonable to assume patients will have been given such a major diagnosis with good clinical reason, and most were followed up clinically. In this review, the larger studies all originated from electronic databases, so were reliant on accurate recording of symptoms. It is possible their results are not directly comparable to smaller studies.

There are several potential limitations. There was considerable heterogeneity between studies. Furthermore, the strength of the association between unpaired symptoms and cancer was often based on relatively few studies. Also, other symptoms may actually have been present but were not reported. Some studies used questionnaires to record specific patient symptoms. This may increase symptom reporting. Heterogeneity may also be due to uncontrollable factors such as variations in referral rates and differing severity of symptoms. It was possible to calculate negative predictive values, but these have been omitted from this paper, as they are not powerful enough on a ‘rule-out’ basis — it is impossible to state confidently that the absence of a particular symptom means cancer is not present. Other limitations include the generally small study sizes, as shown by wide CIs. The use of a search filter for primary health care reduced the number of candidate studies. Eleven studies were identified from reference lists, but only one was included, suggesting that the filter was not overly restrictive.

The decision to restrict this review to primary care studies is a strength, as one key clinical decision is whether to refer from primary care to secondary care for investigation of possible cancer. This cannot be done using secondary care data, as the predictive values are generally much higher than in the primary care population (reflecting the selection process that has taken place before referral). In this respect, this review differs from previous reviews4,5, — and the difference matters.34 Investigation of colorectal cancer costs more than treatment, at an estimated I2290 million annually, most of which relates to investigation of people who transpire not to have cancer.35 Any improvement in selection of patients for investigation would yield financial as well as clinical benefits, although countries with lower-cost investigations would see fewer of these.

Comparison with existing literature

The symptom that has been studied most is rectal bleeding. As the incidence of colorectal cancer is very low below the age of 50 years, the pooled estimate of PPV was restricted to those aged ≥50 years. This was also as near as the data would allow to the age cut-off for rectal bleeding in National Institute for Health and Clinical Excellence (NICE) guidance of 40 years. The pooled estimate of 8.1% is higher than expected. If this figure were taken at face value, it would be easy to recommend investigation of all rectal bleeding, whether accompanied by other symptoms or not. Some caution must be exercised, as subgroup analyses may be more biased; in particular, some studies only included patients in whom rectal bleeding was the focus of the consultation. This may overestimate the PPV. It is reasonable to expect a symptom that the patient deems important enough to make the focus of the consultation to be of higher risk. Similarly, the subgroup analysis of new-onset rectal bleeding versus all rectal bleeding yielded negative results. This counterintuitive finding may be true, or may simply reflect the small number of studies in this analysis.

Some symptoms (weight loss and change in bowel habit) increased the risk of bowel cancer when accompanying rectal bleeding, compared to rectal bleeding alone — as shown by a PLR of nearly 2.0. Conversely, other symptoms (decreased appetite, diarrhoea, constipation, and peri-anal symptoms) appeared to lower the risk of colorectal cancer when accompanying rectal bleeding, with a PLR ≤1.0. In the first version of national referral guidance to UK GPs, peri-anal symptoms were considered to obviate the need for referral in a patient with rectal bleeding.36 This advice was removed in the 2005 version,3 but is supported by the present findings. Iron-deficiency anaemia has long been recognised as a marker of colorectal cancer. Furthermore, it is the symptom associated with the longest delays in diagnosis and the worst prognosis.37 The pooled PPV was 9.7% (or 7.0% if the study of Panzuto et al11 study is removed). Such a figure clearly warrants investigation. Only one study was large enough to examine different levels of anaemia,29 so it is difficult to extrapolate from these findings a specific threshold of haemoglobin that warrants investigation.

Implications for practice

Overall, the findings of this study largely support referral guidance, including that for the UK. At the time these guidelines were formulated, there was relatively little primary care research to underpin the recommendations. No specific threshold level of risk was cited in NICE guidance, but it seems reasonable to suppose that most patients would elect for a figure of around 1–2%.38 A review of all primary cancer PPVs above 5% was published in the British Journal of General Practice while this paper was under submission, reporting such a high PPV only in iron-deficiency anaemia and for rectal bleeding, but only for some groups of patients with these symptoms, largely those who were older.39 Clearly, such a high level of risk warrants investigation, but for lower risks the review presented here should help to define symptoms (or symptom complexes) that are worthy of rapid investigation. Access to cancer investigations is likely to be increased in the UK; for colorectal cancer we are now better placed to decide which symptoms should qualify.

The deliberate restriction of this review to studies containing primary care data means that the results differ from previous systematic reviews using data from both primary care and secondary care.4,5 The predictive value of tests (or in this case, symptoms) is dependent on the prior probability of the disease of interest in the population. The selection process undertaken by primary care means that patients seen in secondary care have a much higher prior probability of cancer. This is not semantics: by restricting this review to the primary care population, the results can guide primary care physicians in their referral decisions. Indeed, one can advance this argument: if a patient has a symptom of possible bowel cancer, they may benefit from colonoscopy even if no cancer is found — it is still worth diagnosing, for example, ulcerative colitis. Thus, the PPV for ‘any disease worth identifying’ will be higher than the values calculated for cancer alone.

Acknowledgments

We also thank Alyson Huntley for her assistance in review of data extraction.

Appendix 1.

Appendix 1

Diagram of information flow.

Appendix 2.

Characteristics of included studies

Study Country Design Number recruiteda Number eligible Patients with colorectal cancer, n (%) Reference standard
Bellentani etal, 199030 Italy Prospective consecutive 254 254 10(3.9) Colonoscopy or double-contrast barium enema, follow-up at 2 months

Carlsson etal, 200115 Sweden Prospective cohort 379 28 5 (17.8) Not reported; several cancers examined

du Toit etal, 200612 UK Prospective cohort 265 265 15(5.7) Colonoscopy, flexible sigmoidoscopy or rigid sigmoidoscopy with barium enema

Ellis and Thompson, 200520 UK Prospective cohort 319 319 11 (3.4) Colonoscopy, flexible sigmoidoscopy, barium enema and 18 months’ follow-up

Farrus etal, 200013 Spain Prospective cohort 112 87 2 (2.3) Colonoscopy

Fijten etal, 199521 Netherlands Prospective consecutive 269 269 9 (3.3) Colonoscopy, sigmoidoscopy, X-ray, ultrasonography, follow-up 15-25 months

Hamilton et al, 200527 UK Matched case-control 2093 2093 349(16.7) Histology or strong clinical evidence

Hamilton et al, 200829 UK Matched case-control 13697 13 697 3183 (23.2) Not reported in THINb database

Hamilton et al, 200928 UK Matched case-control 43791 43 791 5477 (12.5) Not reported in THIN database

Heintze et al, 200517 Germany Prospective cohort 422 422 17(4.0); 3 in situ Colonoscopy, sigmoidoscopy, ultrasonography

Helfand etal, 199714 USA Prospective cohort 297 201 13 (6.5) Rigid sigmoidoscopy with biopsy, and double-contrast barium enema, follow-up 6 and 12 months

Jones et al, 200718 UK Retrospective cohort 15314 15 289 338(2.2) Not reported

Lucas etal, 199632 UK Retrospective cohort 130 130 9(6.9) Colonoscopy, sigmoidoscopy, biopsy, barium enema, follow-up 2 years

Mant etal, 198922 Australia Prospective cohort 248 145 15 (10.3) Histology, colonoscopy, follow-up 15-25 months

Metcalf etal, 199623 UK Prospective cohort 119 99 8(8.1) Histology, colonoscopy

Muris etal, 199331 Netherlands Prospective consecutive 578 578 3(0.5) Colonoscopy, sigmoidoscopy, X-ray, ultrasonography, follow-up 15 months

Muris etal, 199516 Netherlands Prospective cohort 933 933 4 (0.4) Endoscopy, other confirmatory tests not reported, follow-up at least 1 year

Norrelund and Norrelund, 199619 Denmark Prospective consecutive S1 208; S2 209 208; 209 32(15.4); 25(12.0) Histology, colonoscopy, barium enema, annual follow-up

Panzuto et al, 200311 Italy Prospective consecutive 280 280 41 (14.6) Histology, colonoscopy or double-contrast barium enema

Robertson et al, 200624 UK Prospective cohort 604 604 22 (3.6) Cancer registry, flexible sigmoidoscopy

Sanchez et al, 200525 Spain Prospective cohort 126 104 6(5.8) Colonoscopy

Wauters etal, 200026 Belgium Retrospective cohort 386 386 27(7.0) Histology, follow-up 18-30 months

Yates etal, 200433 UK Prospective randomised 431 431 37 (8.6) Histology
a

Number of patients recruited for study

b

The Health Improvement Network

Funding

This work was undertaken by the authors, who received funding from the Department of Health's NIHR School for Primary Care Research. The views expressed in this publication are those of the authors and not necessarily those of the Department of Health. Additionally, William Hamilton is funded through an NIHR postdoctoral fellowship. The study sponsor was the University of Bristol. The authors were independent from the funder and sponsor, who had no role in the conduct, analysis, or decision to publish.

Competing interests

The authors have declared no competing interests.

Discuss this article

Contribute and read comments about this article on the Discussion Forum: http://www.rcgp.org.uk/bjgp-discuss

REFERENCES

  • 1.Goodyear S, Stallard N, Gaunt A, et al. Local impact of the English arm of the UK Bowel Cancer Screening Pilot study. Br J Surg. 2008;95(9):1172–1179. doi: 10.1002/bjs.6230. [DOI] [PubMed] [Google Scholar]
  • 2.Hamilton W, Sharp D. Diagnosis of colorectal cancer in primary care: the evidence base for guidelines. Fam Pract. 2004;21(1):99–106. doi: 10.1093/fampra/cmh121. [DOI] [PubMed] [Google Scholar]
  • 3.National Institute for Health, Clinical Excellence. London: NICE; 2005. Referral guidelines for suspected cancer. [Google Scholar]
  • 4.Ford AC, Veldhuyzen van Zanten SJ, et al. Diagnostic utility of alarm features for colorectal cancer: systematic review and meta analysis. Gut. 2008;57(11):1545–1553. doi: 10.1136/gut.2008.159723. [DOI] [PubMed] [Google Scholar]
  • 5.Jellema P, van der Windt DAWM, Bruinvels DJ, et al. Value of symptoms and additional diagnostic tests for colorectal cancer in primary care: systematic review and meta-analysis. BMJ. 2010;340(313):c1269. doi: 10.1136/bmj.c1269. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Okkes I, Jamoulle M, Lamberts H, Bentzen N. ICPC-2-E: the electronic version of ICPC-2. Differences from the printed version and the consequences. Fam Pract. 2000;17(2):101–107. doi: 10.1093/fampra/17.2.101. [DOI] [PubMed] [Google Scholar]
  • 7.Whiting P, Rutjes A, Reitsma J, et al. The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Meth. 2003;3:25. doi: 10.1186/1471-2288-3-25. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Zamora J, Abraira V, Muriel A, et al. Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Med Res Meth. 2006;6:31. doi: 10.1186/1471-2288-6-31. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Deeks JJ. Systematic reviews in health care: systematic reviews of evaluations of diagnostic and screening tests. BMJ. 2001;323(7305):157–162. doi: 10.1136/bmj.323.7305.157. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Lijmer JG, Mol BW, Heisterkamp S, et al. Empirical evidence of design-related bias in studies of diagnostic tests. JAMA. 1999;282(11):1061–1066. doi: 10.1001/jama.282.11.1061. [DOI] [PubMed] [Google Scholar]
  • 11.Panzuto F, Chiriatti A, Bevilacqua S, et al. Symptom-based approach to colorectal cancer: survey of primary care physicians in Italy. Dig Liver Dis. 2003;35(12):869–875. doi: 10.1016/j.dld.2003.07.005. [DOI] [PubMed] [Google Scholar]
  • 12.Du Toit J, Hamilton W, Barraclough K. Risk in primary care of colorectal cancer from new onset rectal bleeding: 10 year prospective study. BMJ. 2006;333(7558):69–70. doi: 10.1136/bmj.38846.684850.2F. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Farrus PM, Perez OA, Mayer Pujadas MA, et al. Anaemia in primary care: etiology and morphological characteristics. Aten Primaria. 2000;25(4):230–235. doi: 10.1016/S0212-6567(00)78492-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Helfand M, Marton KI, Zimmer-Gembeck MJ, Sox HC Jr. History of visible rectal bleeding in a primary care population. Initial assessment and 10-year follow-up. JAMA. 1997;277(1):44–48. [PubMed] [Google Scholar]
  • 15.Carlsson L, Hakansson A, Nordenskjold B. Common cancer-related symptoms among GP patients. Opportunistic screening in primary health care. Scand J Prim Health Care. 2001;19(3):199–203. doi: 10.1080/028134301316982478. [DOI] [PubMed] [Google Scholar]
  • 16.Muris JW, Starmans R, Fijten GH, et al. Non-acute abdominal complaints in general practice: diagnostic value of signs and symptoms. Br J Gen Pract. 1995;45(395):313–316. [PMC free article] [PubMed] [Google Scholar]
  • 17.Heintze C, Matysiak-Klose D, Krohn T, et al. Diagnostic work-up of rectal bleeding in general practice. Br J Gen Pract. 2005;55(510):14–19. [PMC free article] [PubMed] [Google Scholar]
  • 18.Jones R, Latinovic R, Charlton J, Gulliford MC. Alarm symptoms in early diagnosis of cancer in primary care: cohort study using General Practice Research Database. BMJ. 2007;334(7602):1040. doi: 10.1136/bmj.39171.637106.AE. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Norrelund N, Norrelund H. Colorectal cancer and polyps in patients aged 40 years and over who consult a GP with rectal bleeding. Fam Pract. 1996;13(2):160–165. doi: 10.1093/fampra/13.2.160. [DOI] [PubMed] [Google Scholar]
  • 20.Ellis BG, Thompson MR. Factors identifying higher risk rectal bleeding in general practice. Br J Gen Pract. 2005;55(521):949–955. [PMC free article] [PubMed] [Google Scholar]
  • 21.Fijten GH, Starmans R, Muris JW, et al. Predictive value of signs and symptoms for colorectal cancer in patients with rectal bleeding in general practice. Fam Pract. 1995;12(3):279–286. doi: 10.1093/fampra/12.3.279. [DOI] [PubMed] [Google Scholar]
  • 22.Mant A, Bokey EL, Chapuis PH, et al. Rectal bleeding. Do other symptoms aid in diagnosis? Dis Colon Rectum. 1989;32(3):191–196. doi: 10.1007/BF02554525. [DOI] [PubMed] [Google Scholar]
  • 23.Metcalf JV, Smith J, Jones R, Record CO. Incidence and causes of rectal bleeding in general practice as detected by colonoscopy. Br J Gen Pract. 1996;46(404):161–164. [PMC free article] [PubMed] [Google Scholar]
  • 24.Robertson R, Campbell C, Weller DP, et al. Predicting colorectal cancer risk in patients with rectal bleeding. Br J Gen Pract. 2006;56(531):763–767. [PMC free article] [PubMed] [Google Scholar]
  • 25.Sanchez A, Munoz C, Bujanda L, et al. The value of colonoscopy to assess rectal bleeding in patients referred from Primary Care Units. Rev Esp Enferm Dig. 2005;97(12):870–876. doi: 10.4321/s1130-01082005001200003. [DOI] [PubMed] [Google Scholar]
  • 26.Wauters H, Van Casteren V, Buntinx F. Rectal bleeding and colorectal cancer in general practice: diagnostic study. BMJ. 2000;321(7267):998–999. doi: 10.1136/bmj.321.7267.998. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Hamilton W, Round A, Sharp D, Peters TJ. Clinical features of colorectal cancer before diagnosis: a population-based case-control study. Br J Cancer. 2005;93(4):399–405. doi: 10.1038/sj.bjc.6602714. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Hamilton W, Lancashire R, Sharp D, et al. The risk of colorectal cancer with symptoms at different ages and between the sexes: a case-control study. BMC Med. 2009;7:17. doi: 10.1186/1741-7015-7-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Hamilton W, Lancashire R, Sharp D, et al. The importance of anaemia in diagnosing colorectal cancer: a case-control study using electronic primary care records. Br J Cancer. 2008;98(2):323–327. doi: 10.1038/sj.bjc.6604165. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Bellentani S, Baldoni P, Petrella S, et al. A simple score for the identification of patients at high risk of organic diseases of the colon in the family doctor consulting room. The Local IBS Study Group. Fam Pract. 1990;7(4):307–312. doi: 10.1093/fampra/7.4.307. [DOI] [PubMed] [Google Scholar]
  • 31.Muris JW, Starmans R, Fijten GH, et al. Abdominal pain in general practice. Fam Pract. 1993;10(4):387–390. doi: 10.1093/fampra/10.4.387. [DOI] [PubMed] [Google Scholar]
  • 32.Lucas CA, Logan EC, Logan RF. Audit of the investigation and outcome of iron-deficiency anaemia in one health district. J R Coll Physicians Lond. 1996;30(1):33–36. [PMC free article] [PubMed] [Google Scholar]
  • 33.Yates JM, Logan ECM, Stewart RM. Iron deficiency anaemia in general practice: clinical outcomes over three years and factors influencing diagnostic investigations. Postgrad Med J. 2004;80(945):405–410. doi: 10.1136/pgmj.2003.015677. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Rubin G, Hamilton W. Alarm features of colorectal cancer. Gut. 2009;58(7):1026. [PubMed] [Google Scholar]
  • 35.York Health Economics Consortium. London: Department of Health; 2007. Bowel cancer services: costs and benefits. http://php.york.ac.uk/inst/yhec/?q=projects/report/costs-and-benefits-bowel-cancer-services-england-final-report (accessed 11 Mar 2011) [Google Scholar]
  • 36.National Institute for Health and Clinical Excellence. London: National Institute for Health and Clinical Excellence; 2000. Referral guidelines for suspected cancer. [Google Scholar]
  • 37.Stapley S, Peters TJ, Sharp D, Hamilton W. The mortality of colorectal cancer in relation to the initial symptom at presentation to primary care and to the duration of symptoms: a cohort study using medical records. Br J Cancer. 2006;95(10):1321–1325. doi: 10.1038/sj.bjc.6603439. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Barraclough K. The predictive value of cancer symptoms in primary care. Br J Gen Pract. 2010;60(578):639–640. doi: 10.3399/bjgp10X515304. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Shapley M, Mansell G, Jordan JL, Jordan KP. Positive predictive values of ≥5% in primary care for cancer: systematic review. Br J Gen Pract. 2010;60(578):366–377. doi: 10.3399/bjgp10X515412. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from The British Journal of General Practice are provided here courtesy of Royal College of General Practitioners

RESOURCES