Summary
Background
Colorectal cancer (CRC) incidence and mortality are increasing internationally. Endoscopy services are under significant pressure with many overwhelmed. Faecal immunochemical testing (FIT) has been advocated to identify a high-risk population of symptomatic patients requiring definitive investigation by colonoscopy. Combining FIT with other factors in a risk prediction model could further improve performance in identifying those requiring investigation most urgently. We systematically reviewed performance of models predicting risk of CRC and/or advanced colorectal polyps (ACP) in symptomatic patients, with a particular focus on those models including FIT.
Methods
The review protocol was published on PROSPERO (CRD42022314710). Searches were conducted from database inception to April 2023 in MEDLINE, EMBASE, Cochrane libraries, SCOPUS and CINAHL. Risk of bias of each study was assessed using The Prediction study Risk Of Bias Assessment Tool. A narrative synthesis based on the guidelines for Synthesis Without Meta-Analysis was performed due to study heterogeneity.
Findings
We included 62 studies; 23 included FIT (n = 22) or guaiac Faecal Occult Blood Testing (n = 1) combined with one or more other variables. Twenty-one studies were conducted solely in primary care. Generally, prediction models including FIT consistently had good discriminatory ability for CRC/ACP (i.e. AUC >0.8) and performed better than models without FIT although some models without FIT also performed well. However, many studies did not present calibration and internal and external validation were limited. Two studies were rated as low risk of bias; neither model included FIT.
Interpretation
Risk prediction models, including and not including FIT, show promise for identifying those most at risk of colorectal neoplasia. Substantial limitations in evidence remain, including heterogeneity, high risk of bias, and lack of external validation. Further evaluation in studies adhering to gold standard methodology, in appropriate populations, is required before widespread adoption in clinical practice.
Funding
National Institute for Health and Care Research (NIHR) [Health Technology Assessment Programme (HTA) Programme (Project number 133852).
Keywords: FIT, Colorectal cancer, Risk prediction models, Symptoms
Research in context.
Evidence before this study
Colonoscopy is an expensive and invasive investigation and health services cannot cope with demand. There is a widespread view that less invasive tools are required to determine which patients require colonoscopy. The use of faecal immunochemical testing (FIT) in the symptomatic setting has significantly increased over recent years and, in some settings, guidance now advocates FIT for use in patients with features of possible colorectal cancer (CRC) to guide referral for urgent investigation. There is growing interest in the use of risk prediction models–statistical models that combine information from two or more variables to predict the likelihood of an outcome, and whether these models could further improve performance in identifying those requiring investigation.
In this review we included studies assessing symptomatic patients, developing/validating a predictive model (with 2 or more factors) for the prediction of CRC and/or advanced colorectal polyp (ACP) using MEDLINE, EMBASE, Cochrane libraries, SCOPUS and CINAHL electronic databases from inception to April 2023.
Added value of this study
The review provides a comprehensive and up to date review on the ability of risk prediction models (FIT and non-FIT based) to identify colorectal neoplasia. It both updates and extends a past systematic review on this topic (which included papers published to March 2014) and evaluates the evidence in the context of current clinical practice.
Implications of all the available evidence
This review shows that there is considerable potential for the use of risk prediction models, both FIT-based and non-FIT based, in identifying those most at risk of colorectal neoplasia. However further evaluation of models is required in ‘real world’ settings before widespread use in clinical practice can be recommended. Based upon this review this team have undertaken research to develop risk models in the UK population that will be used to guide UK policy.
Introduction
Colorectal cancer (CRC) is the third most common cancer and second most common cause of cancer death worldwide, accounting for 1.9 million new cases and 935,000 deaths in 2020.1 The incidence of CRC is increasing and it is predicted that, by 2040 the number of new CRC cases globally per year will reach 3.2 million.2 This rise is based on projections of population ageing, population growth and human development.2,3
Most CRCs develop from pre-cancerous colorectal lesions (adenomas or serrated polyps) progressing, if left in situ, to CRC.4,5 This natural history means that there is considerable opportunity for cancer prevention if pre-cancerous lesions can be detected early and removed. Whilst population-based screening is effective in reducing incidence and mortality,6 the overwhelming majority of CRCs are diagnosed after symptoms develop, such as a change in bowel habit, abdominal pain, weight loss or the presence of iron deficiency anaemia.7,8
Colonoscopy, by allowing direct visualisation of the colonic mucosa, is the preferred investigation for those with suspected CRC.9 However, patients can experience pain, discomfort or anxiety before, during or after the procedure, and there is a risk (albeit small) of significant complications including haemorrhage and perforation.10,11 Moreover, demand on endoscopy services is increasing. In the United Kingdom (UK), for example, less than three-quarters of services meet targets for prompt investigation of patients referred for urgent investigation of symptoms.12,13
Until recently, there was no test to identify those higher-risk symptomatic patients warranting colonoscopy, nor to determine the urgency of investigation. In recent years, driven by growing demand for colonoscopy, researchers and service providers have explored the utility of Faecal Immunochemical Testing (FIT) in symptomatic populations.14,15 FIT is simple, non-invasive, can be completed by the patient at home, and is relatively cheap, making it attractive for widespread use. There is evidence to suggest that FIT is powerful in identifying a high-risk sub-population when used in symptomatic patients.14 As a consequence, guidance has begun to advocate routine use of FIT in patients with features of possible CRC.16 Alongside this, interest has grown in the development of risk prediction models–statistical models that combine information from two or more variables to predict the likelihood of an outcome–which seek to identify which sub-groups of symptomatic patients (e.g. defined by FIT result and/or a combination of other factors such as age, sex or medical history) are most likely to have pre-cancerous lesions or CRC.17 The hope is that routine implementation of the algorithms in such models could provide an efficient way for health services to ensure that those patients most at risk undergo colonoscopy in a timely manner, while those at lowest risk avoid unnecessary procedures.18,19
The aim of this systematic review was to identify, and assess the performance of, models that predict the risk of CRC and/or advanced colorectal polyps (ACP) in symptomatic patients, with a particular focus on those models that include FIT.
Methods
Study design
The review was registered with the International Prospective Register of Systematic Reviews (PROSPERO) (CRD42022314710) (Supplementary File 1) and has been conducted and reported in line with the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA) statement.20
The eligibility criteria were developed using the PICOTS (Population, Intervention, Comparator, Outcome, Timing, Setting) framework21 (Supplementary File 1). We included studies assessing symptomatic patients, developing/validating a predictive model (with 2 or more factors) for the prediction of CRC and/or ACP (see Supplementary File 1 for further detail on definition/terms used for ACP; in brief we accepted as eligible studies, which used a range of different terms). Studies could be randomised trials or observational studies that were conducted in primary, secondary or tertiary care. Studies utilising primary care databases/cancer registries were included if they did not explicitly state the study population included asymptomatic (screening) individuals. The main outcome was model accuracy (e.g. AUC, sensitivity, specificity) but we also included studies reporting positive predictive values (PPV) for combinations of predictors. In a deviation from protocol, studies reporting PPV, which used age or sex in combination with one other factor were not considered predictive models, as these generally involved simply calculating PPV for strata of the study population based on demographics; however, studies reporting PPV which included age and sex and at least one other factor were eligible. Studies were also excluded if they were not in English; assessed screening or surveillance only populations or prognostic factors for treatment or outcome of CRC; focused only on genetic variables; or included paediatric populations.
Searches were conducted from database inception to 4th March 2022, and updated on the 28th April 2023, in MEDLINE, EMBASE, Cochrane libraries, SCOPUS and CINAHL. The search strategy was developed by an information specialist in combination with the review team, utilising a pre-existing prognostic study filter.22 The complete search strategy can be seen in Supplementary File 2. Additionally, forward and backward citation searching was conducted on all included studies and systematic reviews identified as being relevant.
Study selection was conducted in two stages, first screening citations and then full text of potentially eligible papers, using Rayyan23 by two reviewers (JSH & RPWK) independently. A third reviewer (LS) arbitrated any conflicts at both title and abstract and full text screening stages. A data extraction form based on CHecklist for critical Appraisal and data extraction for systematic Reviews of prediction Modelling Studies (CHARMS) was created and utilised.24 Data were extracted by a single reviewer (JSH or RPKW) and checked for accuracy by a second reviewer (JSH or RPKW). For further information of what data was extracted, please see Supplementary File 1. The Prediction study Risk Of Bias Assessment Tool (PROBAST) was used to assess the risk of bias.25 One reviewer (JSH or RPKW) assessed risk of bias, with the second reviewer (JSH or RPKW) checking for accuracy.
Synthesis methods & statistical analysis
No statistical analyses were conducted due to heterogeneity of the studies, which meant a meta-analysis was not possible. We include forest plots for studies that report measures of discrimination (i.e. AUC) as a visual representation only. These forest plots do not include a summary of the effect size (weighted or unweighted) as computing these was not deemedstatistically appropriate. A narrative synthesis based on the guidelines for Synthesis Without Meta-analysis was therefore completed.26 For the purpose of synthesis, studies were categorised into FIT and non-FIT containing models. Where models included guaiac faecal occult blood testing (gFOBT) they were grouped with FIT containing models since both methods detect blood in stool to aid synthesis, where studies with binary outcomes reported a c-statistic, this has been referred to as AUC.
Role of the funding source
The funders played no role in the study design, collection, analysis, and interpretation of data, nor the writing of the report or the decision to submit the paper for publication. JSH and RPWK accessed and verified the data. LS, CJR and WH made the decision to submit the manuscript for publication.
Results
Database searches, after de-duplication, provided 17,667 records for screening; 306 full text papers were assessed. Citation chaining provided a further 66 records; 32 were assessed at full text. The study selection process and reasons for exclusions are shown in Fig. 1. Overall, 62 studies were included in the review and synthesis. An overview of what each model contains can be seen in Supplementary File 3.
All included studies were of an observational study design, with 21 cross-sectional studies,19,27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45 17 retrospective studies,18,30,46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60 15 prospective studies,39,61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74 and eight case–control studies.62,75, 76, 77, 78, 79, 80 One study design was unclear, as it was an abstract only.81
Settings were primary care (n = 21),30,31,35,47,50, 51, 52, 53, 54,56,59,62,64,66,68,71,73,77,78,80 primary and secondary care (n = 12),18,19,30,33,34,49,60,63,65,67,72 secondary care (n = 24),29,32,36, 37, 38, 39,41, 42, 43, 44,46,48,55,57,58,61,62,69,70,74, 75, 76,79,82 secondary and tertiary care (n = 3),27,28,40 and tertiary care (n = 1).45 One study was unclear regarding the setting.81 Databases or registries were used in 17 studies.30,47,48,50, 51, 52, 53, 54,56,60,77, 78, 79, 80,82, 83, 84
The studies were conducted in 15 different countries. One study examined patients from two different countries: Scotland and Spain.18 A further 24 studies assessed patients from the UK,30,31,38,41,43, 44, 45, 46, 47,51,56,57,59, 60, 61, 62,66,70,71,77,80,81 eight from Denmark,35,39,48,69,74,76,79,82 seven from Spain,19,30,34,40,49,63,65 five from the Netherlands,50,52, 53, 54,64 five from Sweden,67,68,78,83,84 four from Australia,27,28,37,72 two from China,32,55 one from the USA,73 one from Canada,42 one from New Zealand,58 one from Egypt,75 one from Italy,36 one from Malaysia33 and one from Nigeria.29 For further demographic information see Table 1.
Table 1.
Study (Country) | Study design and setting | Sample size and source of data (date) | Age (years) | Sex | CRC staging | Method used to identify the outcome | Outcome(s) to be predicted and number of events |
---|---|---|---|---|---|---|---|
Abdelhady 202175 (Egypt) | Case-control Secondary care |
CRC = 30 Pathological control = 30 Normal control = 30 Suez Canal University Hospital (June 2019–June 2020) |
Mean (SD) CRC = 68 (7.3) Control pathological = 56.9 (6.3) Control normal = 59.5 (7.5) |
CRC Male = 21 Female = 9 Pathological control Male = 12 Female = 18 Normal control Male = 15 Female = 15 |
I = 15 II = 10 III = 5 IV = 0 |
Pre-defined CRC cases, blood testing was utilised for the outcome | CRC = 30 |
Adelstein 201027 (Australia) | Cross-sectional Secondary/Tertiary |
Overall = 8204 Tertiary and non-tertiary practices/hospitals in NSW (April 2004–Dec 2006) |
Median = 58 Range = 18-95 |
Male = 3860 Female = 4344 |
NR | Colonoscopy (if not visualised, additional tests of CT colonography or barium enema were performed to complete exam) | CRC = 159 |
Adelstein 201128 (Australia) | Cross-sectional Secondary/Tertiary |
Overall = 8204 Tertiary and non-tertiary practices/hospitals in NSW (April 2004–Dec 2006) |
Median = 58 Range = 18-95 |
Male = 3860 Female = 4344 |
NR | Colonoscopy (if not visualised by follow up bowel investigations) | CRC = 159 Advanced Adenomas (≥25% villous features, high grade dysplasia, or >10 mm) = 468 Adenomas 6–9 mm = 286 Adenomas ≤5 mm = 507 |
Alatise 201829 (Nigeria) | Cross-sectional Secondary |
Overall = 362 Development = 217 Validation = 145 Three hospitals in southwest Nigeria (Training = OAUTHC; Validation = UCH and UITH) (Jan 2014–July 2016) |
Median (range) Overall = 59.5 (44–95) Development = 60 (45–95) Validation = 5944–87 |
Development Male = 137 Female = 80 Validation Male = 99 Female = 46 |
Overall II = 19 III = 30 IV = 17 |
Colonoscopy | CRC Development = 38 Validation = 28 |
Ayling 202146 (UK) | Retrospective cohort Secondary |
Overall = 617 Barts Health NHS Trust (1st May 2020 included, after 6 months clinical outcomes were collected) |
Median (range) = 58 (18–95) | Male = 314 Female = 303 |
NR | Clinical and radiological reports, endoscopy, and histological findings. Further investigation undertaken in 532 patients: Colonoscopy = 316 Abdominopelvic CT = 153 CT colonography = 54 Sigmoidoscopy alone = 6 |
CRC = 17 HRA = 28 |
Ballal 201061 (UK) | Prospective cohort Secondary |
Overall = 3457 Three consultant colorectal surgeons in a Welsh district general hospital. (Aug 2003–May 2008) |
Mean (SD) Patients referred = 58.7 (16.2) Completed assessment = 59.1 (15.9) |
Male = 1621 Female = 1836 |
NR | Either rigid or flexible sigmoidoscopy, colonoscopy, barium enema, or a combination of these. | CRC = 186 |
Blume 201676 (Denmark) | Case-control Secondary |
Overall = 4698 Final model for CRC = 300 Final model for AA = 302 Seven collaborating hospitals located in various Denmark locations. Three used for development and four for validation. (May 2010–Nov 2012) |
Mean (SD) Overall = 63.5 (12.6) Development Control = 63.8 (7.04) CRC = 64.5 (7.01) Validation Control = 64.8 (5.76) CRC = 65.6 (6.09) Adenoma Development Control = 62.7 (7.33) AA = 63.1 (7.09) Validation Control = 62.5 (6.21) AA = 62.9 (5.9) |
Overall Male = 2243 Female = 2455 Development (CRC) Male = 70 Female = 80 Validation (CRC) Male = 80 Female = 70 Development (AA) Male = 76 Female = 74 Validation (AA) Male = 76 Female = 76 |
Overall I = 101 II = 163 III = 139 IV = 108 NA = 1 Development I = 17 II = 30 III = 16 IV = 12 Validation I = 17 II = 21 III = 18 IV = 19 |
Colonoscopy Patients unable to undergo complete colonoscopy and patients with complete colonoscopy but without bowel pathology and persisting symptoms, were offered additional examination using combinations of x-ray with barium enema, ultrasound, computed axial tomography, and magnetic resonance imaging. |
Development CRC = 75 AA = 75 Validation CRC = 75 AA = 76 |
Boulind 202262 (UK) | Prospective cohort Secondary |
Overall = 558 Model = unclear Three NHS trusts (Yeovil, North Bristol, and St James, Leeds); screened from consecutive fast track CRC referrals and approached when attending colonoscopy or review. (Aug 2018–Dec 2020) |
mean (range): 64 (18–89) | Male = 311 Female = 247 |
NR | Colonoscopy or CT | CRC = 18 (5 suspected at CT) Polyp = 134 |
Cama 202130 (UK) | Retrospective cohort Primary |
3460 patients returned a FIT sample, 1046 underwent any investigation and 701 patients had full colonic evaluation–it is unclear who was used in the analysis Medical records (cross referenced with the trust cancer datanase); Herts Valley UK (June 2019–July 2020) |
Mean (IQR): 66 (56–76) | Male = 43% Female = 57% |
NR | Colonic investigation—undefined | NR |
Collins 201247 (UK) | Retrospective cohort Primary |
QResearch database (internal validation) = 1,236,601 THIN (external validation) Male = 417,560 (with imputation = 1,059,765) Female = 1,075,775 THIN database (external validation; 1st Jan 2000–30th June 2008) |
Mean (SD) QResearch database Development = 50.1 (15) Validation = 50.1 (14.9) THIN database Median (IQR) Male = 47 (38–60) Female = 49 (38–63) |
THIN database Male = 1,059,765 Female = 1,075,775 |
NR | Identification via the THIN database records. | THIN database CRC = 3712 |
Croner 201748 (Denmark) | Retrospective cohort Secondary |
Overall = 4698 Development = 3099 Validation = 1336 Endoscopy II database samples, collected from seven hospitals across Denmark. (2010–2012) |
Mean (SD) All = 63.5 (12.6) Development Control = 62.7 (12.6) CRC = 69.7 (10.6) Validation Control = 62.9 (12.7) CRC = 70.1 (10.7) |
Overall Male = 2243 Female = 2455 Development Control Male = 1286 Female = 1473 CRC Male = 196 Female = 144 Validation Control Male = 539 Female = 650 CRC Male = 92 Female = 55 |
Overall I = 101 II = 163 III = 139 IV = 108 Development I = 74 II = 105 III = 87 IV = 73 Validation I = 25 II = 50 III = 45 IV = 27 |
Colonoscopy | CRC Development = 340 Validation = 147 |
Cubiella 201619 (Spain) | Cross-sectional Primary and secondary |
Development = 1572 Validation = 1481 Development cohort consisted of consecutive patients with gastrointestinal symptoms referred for colonoscopy from primary and secondary health care to Complexo Hospitalario Universitario de Ourense, Spain (March 2012–Sept 2013). Validation cohort included a prospective cohort of patients with gastrointestinal symptoms referred for colonoscopy in 11 hospitals in Spain (March 2014–March 2015). |
Median (range) Development = 68 (20–96) Validation = 64 (19–101) |
Development Male = 810 Female = 762 Validation Male = 719 Female = 762 |
Development 0 = 2.8% I = 18.6% II = 25.1% III = 37.7% IV = 15.8% Validation NR |
Colonoscopy | CRC Development = 214 Validation = 136 AN Development = 251 Validation = 197 |
Cubiella 201718 (Spain and Scotland) | Retrospective cohort Primary and secondary |
Development = 1572 Validation = 3976 Development Patients referred to colonoscopy in Ourense, Spain (March 2012–Sept 2013) Validation Five studies evaluating diagnostic accuracy of different FIT analytical systems for CRC, AN, and SCL. Three Scottish and Two Spanish (dates not reported) |
Median (range) Overall = 65 (15–100) Development = 68 (25–96) Validation (five studies) 1 = 60 (15–89) 2 = 64 (16–90) 3 = 63 (18–84) 4 = 63 (18–90) 5 = 64 (19–100) |
Overall (%) Male = 46.2 Development Male = 51.5 Validation 1 = 40.4 2 = 45.5 3 = 42.1 4 = 46.9 5 = 48.7 |
NR | Colonoscopy | CRC (%) Development = 13.7 Validation 1 = 2.1% 2 = 3.7% 3 = 2.3% 4 = 3% 5 = 9% |
Digby 201985 (Scotland) | Cross-sectional Primary and secondary |
Overall = 1447 Patients presenting to primary care with symptoms, who underwent FIT and colonoscopy at NHS Tayside (Dec 2015–Dec 2016) |
NR | NR | NR | Colonoscopy In addition, linkage with the Scottish Cancer Registry was performed to ensure that all cases of CRC had been identified. |
CRC = 94 |
Ellis 200531 (UK) | Cross-sectional Primary |
Overall = 319 Analysis = 266 Three practices, one in a market/rural community, one in a suburban area, and one in an inner-city. GP asked to identify patients whose complaint was rectal bleeding and other symptoms, with rectal bleeding. (Study dates NR) |
Mean (range) Male = 56 (35–84) Female = 62 (35–94) |
NR | NR | Flexible sigmoidoscopy = 219 Barium enema = 37 Colonoscopy = 24 |
CRC = 11 |
Ewing 201683 (Sweden) | Case-control Primary |
Overall = 2681 Cases = 542 Control = 2139 Swedish Cancer register, a database in Region Vastra Gotaland (RVG) |
Median (range) Cases: 72 (30–94) Controls: 72 (30–94) |
NR | I = 118 II = 223 III = 201 |
Swedish Cancer register | CRC = 542 |
Fernandez-Banares 201963 (Spain) | Prospective cohort Primary and secondary |
Overall = 1495 Development = 867 Validation = 628 Three hospitals in Spain. (March 2014–Sept 2016) |
NR | Development ACN Male = 103 Female = 68 Control Male = 311 Female = 385 Validation ACN Male = 89 Female = 59 Control Male = 224 Female = 256 |
NR | Colonoscopy | ACN (CRC + AA) Development CRC = 67 AA = 104 Validation CRC = 49 AA = 99 |
Fijten 199564 (Netherlands) | Prospective cohort Primary |
Overall = 269 83 GPs in Limburg, Netherlands. (Sept 1988–April 1990) |
Mean (SD) = 42 (15) | Male = 118 Female = 151 |
NR | At the end of the initial consultation 8% of patients were referred to a medical specialist (5% to an internist, 3% to a surgeon). Endoscopy or roentgenography was requested for 14% and 10% of patients, respectively. Follow up after at least one year, a total of 24% of patients had been referred, 14% internist, 5% surgeon, 2% to another specialist and 3% to several specialist. 31% had further investigations initiated by the GP by: sigmoidoscopy (9%) colon roentgenography (9%) proctoscopy (8%) sonography (6%) colonoscopy (2%) some patients had more than 1 investigation |
CRC = 9 Polyps = 6 |
Hamilton 200577 (UK) | Case-control Primary |
Overall = 2093 Cases = 349 Control = 1744 Registry that collects registrations from three main sources: direct notifications by clinicians, routine notification of all positive histology results and forwarding of patient lists from oncology treatment centre (Devon and Exeter). (1998–2002) |
NR | Cases Male = 177 Female = 172 Control Male = 885 Female = 889 |
NR | Cancer registry at the Royal Devon and Exeter hospital. Supplemented by computerised searches at every practice identified for any missing from the cancer registry. | CRC = 349 |
Herrero 2018 (Spain) | Retrospective cohort Primary and secondary |
Overall = 1572 Uses COLONPREDICT cohort, see Cubiella 2016. |
NR | NR | NR | Colonoscopy | CRC = 214 |
Hijos-Mallada 202365 (Spain) | Prospective cohort Primary and secondary |
571 | Median (IQR) Significant pathology = 70 (59.5–80.5) Non-significant findings = 60 (48.5–71.5) |
Significant pathology Male = 67 Female = 51 Non-significant findings Male = 205 Female = 248 |
NR | Colonoscopy | CRC = 30 Adenoma = 53 |
Hippisley-Cox 201266 (UK) | Prospective cohort Primary |
Overall = 3,880,944 Development = 2,351,052 Validation = 1,236,601 QResearch database (v.30). All practices in England and Wales that had been using their EMIS (Egton Medical Information System) computer system for at least a year were included. Two thirds of practices were randomly allocated to the development cohort and the remaining third to the validation. |
mean (SD) development = 50.1 (15) validation = 50.1 (14.9) |
Development Male = 1,178,382 Female = 1,172,670 Validation Male = 620,240 Female = 616,361 |
NR | Database: incident of CRC during the 2 years after study entry. Either on GP record or on their linked ONS cause of death record. | CRC Development = 4798 Validation = 2603 |
Hogberg 202068 (Sweden) | Prospective cohort Primary |
Overall = 18,913 Analysis = 15,789 (Those with three samples of FIT; Note: number varies depending on equipment and combination) |
Median (IQR) = 65 (48–75) | Male = 7489 Female = 11,424 |
NR | Incident of CRC during 2 years after FIT completion. Information about patients diagnosed with CRC within 2 years of the FITs was obtained from the Swedish Cancer Register. Note: FIT was measured using 4 different analysers (Actim Fecal Blood, Analyz FOB, Chemtrue FOB, Diaquick FOB) and the results are reported split by each analyser |
CRC = 304 (Note: number varies depending on equipment and combination) |
Hogberg 201767 (Sweden) | Prospective cohort Primary and secondary |
Overall = 391 Analysis = 364 Four health care centres in the region Jamtland Harkedaken. (30 Jan 2013–31 May 2014) |
Median = 63 | Male = 138 Female = 253 |
NR | Colonoscopy In the results they do mention that some patients underwent CT (abdominal and colon). Some had barium enema. All patients that agreed to participate were followed for 2 years, and data on bowel imaging and clinical outcome were collected from their medical records |
CRC = 8 HRA = 8 |
Hoogendoorn 201650 (Netherlands) | Retrospective cohort Primary |
Overall >90,000 Final model number is unclear Anonymised primary care dataset originating from a network of GPs centred around the Utrecht University Medical Center. (1st July 2006–31st Dec 2011) |
NR | NR | NR | Electronic medical records | CRC = 588 |
Jin 201232 (China) | Cross-sectional Secondary |
Overall = 201 Beijing military general hospital. (Oct 2009–March 2010) |
Mean (range) = 67 (31–91) | Male = 153 Female = 48 |
NR | Colonoscopy | CRC = 21 AA = 47 |
Johansen 201569 (Denmark) | Prospective cohort Secondary |
Overall = 4496 Six Danish hospitals. (Jan 2004–Dec 2005) |
Median (range) = 61 (18–97) | Male = 2064 Female = 2432 |
NR | Colonoscopy = 2738 Flexible sigmoidoscopy = 1701 Rigid proctoscopy = 52 Unknown = 5 |
Colon cancer = 184 Rectal cancer = 109 adenomas = 854 |
Johnstone 200251 (UK) | Retrospective cohort Primary |
Overall = 4968 NHS Greater Glasgow and Clyde. (Aug 2018–Jan 2019) |
Median (range) = 59 (16–97) | Male = 2102 Female = 2866 |
NR | Cancer registry used to identify CRCs Colonoscopy = 1330 CT/CT colon = 153 |
CRC = 61 |
Koning 201552 (Netherlands) | Retrospective cohort Primary |
Overall = 2787 Julius General Pracitioners Network (JPGN) database. (Utretcht Netherlands; 1st Jan 2007–31st Dec 2011) |
Mean (SD) = 58 (13.9) | Male = 1260 Female = 1527 |
NR | Outcomes were extracted from colonoscopy test results, relevant specialist letters or, if these were not readily available or specifically coded, outcome was based on the presence of corresponding ICPC codes within 1 year after referral for colonoscopy. | CRC = 57 HRA = 31 |
Kop 201553 (Netherlands) | Retrospective cohort Primary |
Overall = 127,304 Numbers in analysis are unclear. Two GP databases in Utreccht Netherlands. (1st July 2006–31st Dec 2011) |
NR | NR | NR | Electronic medical records | CRC = 651 |
Kop 201654 (Netherlands) | Retrospective cohort Primary |
Overall = 263,879 Three GP databases in urban regions of the Netherlands. (2007–2011) |
NR | NR | NR | Electronic medical records | CRC = 1292 |
Law 201433 (Malaysia) | Cross-sectional Primary and secondary |
Overall = 1013 A large teaching institution serving multi-ethnic Asian urban population (Chinese, Malays, and Indians; July 2009–March 2011). |
Mean (SD) = 59.9 (13.7) Range = 18-95 |
Male = 483 Female = 530 |
NR | Colonoscopy | CRC = 114 Adenomas = 172 |
Liu 202155 (China) | Retrospective cohort Secondary |
Overall = 1142 Development = 686a Validation = 228a Testing = 228a Samples from human aerospace hospital and peoples hospital of Ningxiang. (Study dates not reported) |
Mean (range) = 49.2 (26–83) | Male = 577 Female = 565 |
I-II = 67 III-IV = 113 |
Colonoscopy | CRC = 180 Adenoma = 60 Polyp = 273 |
Lucoq 202281 (UK) | Unclear (abstract only) | A single health board (undefined) 2018–2021 |
Median = 65 (NR) | Ratio M:F = 0.9:1.0 |
NR | Colonoscopy | unclear |
Lue 202086 (Spain) | Cross-sectional Primary and secondary |
Overall = 404 Referred to HCU Lozano Blesa. (June 2015–April 2017) |
Median (IQR) = 59 (47–69) | Male = 166 Female = 238 |
NR | Colonoscopy | CRC = 16 AA = 39 |
Mahadavan 201270 (UK) | Prospective cohort Secondary |
Overall = 714 Patients obtained from a population of around 400,000, with approximately 125–140 (May 2008–May 2009) |
Median (IQR) CRC = 74 (70–80) Control = 70 (62–80) |
Male = 319 Female = 395 |
NR | Colonoscopy or CT (generally within 2–3 weeks) | CRC = 72 |
Malagon 201934 (Spain) | Cross-sectional Primary and secondary |
Overall = 333 Patients referred to Complexo Hospitalario de Ourense. (Study dates not reported) |
Mean (range) CRC = 73 (53–91) AA = 65 (44–83) non-AA = 67 (37–89) normal = 61 (20–87) |
Female n (%) CRC = 17 (10) AA = 15 (8.8) non-AA = 32 (18.8) normal = 106 (62.4) |
0 = 3 I = 6 III = 21 IV = 8 |
Colonoscopy | CRC = 48 AA = 30 |
Marshall 201156 (UK) | Retrospective cohort Primary |
Overall = 43,791 THIN Database. (Jan 2001–July 2006) |
Mean (range) = 70.6 (30–105) | Male = 23,253 Female = 20,538 |
NR | Identification via the THIN database records. | CRC = 5477 |
Mowat 201671 (UK) | Prospective cohort Primary |
Overall = 2173 Analysis = 755 At the point of referring patients to the colorectal pathway GPs were prompted to request FHb and FC tests alongside full blood count, urea and electrolytes and C reactive protein and record the presenting symptoms via NHS Tayside electronic test software. If they had more than one symptom, they were attributed one in order of decreasing clinical importance: rectal bleeding, anaemia, diarrhoea, altered bowel habit, abdominal pain, and weight loss. (Oct 2013–March 2014) |
Median (IQR) = 64 (52–73) Range = 16–90 |
Analysed: Male = 342 Female = 413 |
NR | Colonoscopy | CRC = 28 HRA = 41 |
Nemlander 2023a78 (Sweden) | Case-control Primary |
Overall = 2681 Development = 2013 Validation = 668 Swedish cancer register and the VEGA regional administrative healthcare database. Dates NR |
Age at diagnosis date Mean (SD) Cases = 71.2 (11.7) Controls = 71.2 (11.7) |
Male Cases = 272/542 Controls = 1074/2139 |
I = 118 II = 278 III = 130 |
Registry | Non-metastatic CRC Development = 407 Validation = 135 |
Nemlander 2023b84 (Sweden) | Case-control Primary |
Overall = 14,548 Stockholm regional health care administration database (VAL) 2015–2019 |
Age at diagnosis date Mean (SD) Cases = 70.7 (12.6) Controls = 70.6 (12.5) |
Male Cases = 1483/2920 Controls = 5901/11,628 |
I = 731 II = 846 III = 1343 |
Registry | Non-metastatic CRC cases = 2920 |
Norrelund 199635 (Denmark) | Cross-sectional Primary |
Study 1 = 208 Study 2 = 209 (analysis = 156) Study 1 Every fourth GP registered in the directory of the Danish medical associaton (n = 750) were to participate in the study. The GPs were to include a maximum of three consecutive patients, 40 years and older, who presented with a first episode of overt rectal bleeding within the previous six months. (1989–1991) Study 2 Using the same method as in study 1 but omitting the 750 GPs who were previously invited, 450 GPs were invited to participate in a second study. Each GP was to contribute a maximum of four patients. (1991–1992) |
NR | Study 1 Male = 97 Female = 111 Study 2 NR for all those in study 2 |
NR | A yearly letter to GP or microscopically verified | Study 1 CRC = 32 Polyps = 16 Study 2 CRC = 25 |
Parente 201236 (Italy) | Cross-sectional Secondary |
Overall = 280 Analysis = 278 (two patients excluded without reason) Three participating centres (A. Manzoni Hospital, Lecco, S. Orsola Hospital, Bologna, and Regina Margherita Hospital, Rome; over a 6 month period of an unspecified study period) |
Mean (range) = 67 (50–80) | Male = 157 Female = 123 |
NR | Colonoscopy | CRC = 47 AA = 85 Low risk adenomas = 22 |
Payne 198337 (Australia) | Cross-sectional Secondary |
Overall = 159 Recruitment setting and dates not specified. |
NR | NR | NR | Sigmoidoscopy, air contrast barium enema and/or colonoscopy | CRC = 46 |
Rai 200838 (UK) | Cross-sectional Secondary |
Overall = 1422 Three hospitals of the University Hospitals of Leicester National Health Service (NHS) Trust and the six peripheral community hospitals in Leicestershire. (Sept 2003–Aug 2004) |
Median (range) = 68 (21–95) | Male = 751 Female = 671 |
NR | All referrals were followed up during the course of hospital investigations until a final diagnosis, benign or malignant, was made. Exact method not specified. | CRC = 83 |
Rasmussen 201782 (Denmark) | Cross-sectional Secondary |
Overall = 4773 Final analysis = 4105 Endoscopy II project, collected from 7 hospitals across of Denmark (Aarhus, Bispebjerg, Herning, Hillerød, Horsens, Hvidovre and Randers). (May 2010–Nov 2012) |
Median (range) = 64 (18–95) | Male = 1964 Female = 2141 |
I-II = 225 III-IV = 216 |
Colonoscopy | CRC = 441 HRA = 342 |
Rasmussen 202179 (Denmark) | Case-control Secondary |
Overall = 4698 Final analysis = 784 Endoscopy II project, collected from 7 hospitals across of Denmark (Aarhus, Bispebjerg, Herning, Hillerød, Horsens, Hvidovre and Randers). (May 2010–Nov 2012) |
Median (range) CRC = 70 (38–92) HRA = 66 (42–96) Clean colorectum = 60 (28–87) |
CRC Male = 127 Female = 69 HRA Male = 54 Female = 44 Clean colorectum Male = 94 Female = 102 |
I = 49 II = 49 III = 49 IV = 49 |
Colonoscopy | CRC = 196 HRA = 96 |
Rodriguez-Alonso 201540 (Spain) | Cross-sectional Secondary and tertiary |
Overall = 1003 The Endoscopy Department of Bellvitge University Hospital. Referrals originated from general practitioners and community gastroenterologists, as well as from the hospital environment. (Sept 2011–Oct 2012) |
NR | Male = 470 Female = 533 |
NR | Colonoscopy | CRC = 30 AN = 133 |
Selvachandran 200241 (UK) | Cross-sectional Secondary |
Overall = 2268 Recruitment setting not specified. (Oct 1999–Oct 2001) |
NR | Male = 1037 Female = 1231 |
Dukes A = 22 Other stages not reported |
Endoscopy (specific procedure is not reported) | CRC = 95 |
Simpkins 201742 (Canada) | Cross-sectional Secondary |
Overall = 1981 Consecutive, unselected patients newly referred from primary care to two secondary care centres. The McMaster University Medical Center and St. Joseph's Healthcare. (Jan 2008–Dec 2012) |
Mean = 49.3 | Male = 730 Female = 1251 |
NR | Colonoscopy | CRC = 47 |
Stapley 201780 (UK) | Case-control Primary |
Overall = 5640 Data collected prospectively from the Clinical Practice Research Datalink (CPRD). The CPRD maintains records from nearly 700 participating practices in the UK. (Jan 2000–Dec 2013) |
Range = 18–49 | Cases Males = 855 Females = 806 Controls Males = 1828 Females = 2151 |
NR | Clinical Practice Research Datalink (CPRD) using diagnostic medical codes. | CRC = 1661 |
Steffen 201472 (Australia) | Prospective cohort Primary and secondary |
Development (45 and up) = 197,874 Validation (MCCS) = 24,233 Retrospective analysis of two prospective studies, the 45 and up study (development) and the Melbourne collaborative cohort study (validation). |
Mean (SD) at baseline Development = 61.2 (16.3) Validation = 65.7 (8.7) |
Developmenta Male = 84,492 Female = 113,382 Validationa Male = 9354 Female = 14,879 |
NR | Cancer registry | Development CRC = 1103 Validation CRC = 224 |
Thompson 201757 (UK) | Retrospective cohort Secondary |
Overall = 26,972 Development = 17,403 Validation = 11,602 All patients referred by their GP to the colorectal surgical outpatient clinics at St Mary's Hospital, Queen Alexandra Hospital and two peripheral hospitals in and near Portsmouth. (1986–2007) |
Mean (SD) Development = 60.1 (16.3) Validation = 60.1 (16.5) |
Development Male = 7651 Female = 9752 Validation Male = 5043 Female = 6559 |
NR | Sigmoidoscopy and/or whole colonic imaging Cancers not diagnosed after the first visit were included if detected within 3 years, mainly by referral back to hospital and local hospital audit. A small number were detected by comparison of the database with the Regional Cancer Registry. |
CRC = 1626 |
Turvill (2018)43 (UK) | Cross-sectional Secondary |
Overall = 515 A single centre in the UK. (Feb 2016–March 2017) |
Median (IQR) = 69 (61–76) | Reported that both sexes were equally represented | NR | Patients undergoing full colonoscopy or CT colonography or a lesser investigation (such as CT abdomen/pelvis with contrast plus flexible sigmoidoscopy) limited by the identification of pathology were included in the data analysis. | CRC = 27 |
Wells 201473 (USA) | Prospective cohort Primary |
Male = 80,062 Female = 100,568 Prospective cohort, followed up for 11.5 years, or until development of CRC, or until 31st Dec 2004. (Cohort study started between 1993 and 1996). |
Mean (SD) Male CRC = 64.2 (7.8) No CRC = 59.8 (8.9) Female CRC = 64 (7.9) No CRC = 59.5 (8.8) |
Male = 80,062 Female = 100,568 |
NR | Registry data (information regarding IBD disease, sigmoidoscopy or colonoscopy not known) | CRC Male = 1486 Female = 1276 |
Whitfield 201858 (New Zealand) | Retrospective cohort Secondary |
Development = 2236 Validation = 958 Single centre in New Zealand: Palmerston North Hospital. (July 2005–June 2016) |
NR | NR | NR | Colonoscopy | CRC Development = 170 Validation = 75 |
Widlak 201744 (UK) | Cross-sectional Secondary |
Overall = 430 Single centre in the UK: University Hospitals Coventry and Warwickshire UHCW National Health Service (NHS) Trust. (Jan 2015–March 2016) |
Median (IQR) = 67 (57–76) Range = 29–93 |
Male = 210 Female = 220 |
NR | Colonic investigations –Colonoscopy or CT colonography or CT abdomen/pelvis with contrast plus flexible sigmoidoscopy. | CRC = 24 (plus 1 high grade dysplasia) Adenoma (with low grade dysplasia and other pathology) = 28 Adenoma (with low grade dysplasia) = 42 |
Widlak 201845 (UK) | Cross-sectional Tertiary |
Overall = 562 Single tertiary care centre in UK. (Study dates not reported) |
Median (range) = 68 (29–89) | Male = 286 Female = |
NR | Endoscopic or radiological colonic cross-sectional imaging. | CRC = 35 HRA = 27 All adenomas = 94 |
Wilhelmson 201739 (Denmark) | Prospective cohort Secondary |
Overall = 4692 Final analysis = 4521 7 Collaborating hospitals in Denmark. (May 2010–Nov 2012) |
NR | NR | I = 101 II = 163 III = 139 IV = 108 1 not available |
Colonoscopy | CRC = 400 HRA = 399 |
Wilhelmsen 201874 (Denmark) | Prospective cohort Secondary |
Overall = 3732 Final analysis = 3555 7 Collaborating hospitals in Denmark. (May 2010–Nov 2012) |
NR | NR | I = 82 II = 127 III = 109 IV = 84 |
Colonoscopy Those without colonoscopy were offered additional examination, ie, gastroscopy, X-ray with barium enema, ultrasonography, computer-assisted tomography, and/or magnetic resonance imaging. (These tests likely for evaluation of extracolonic cancers). |
CRC = 400 Adenomas = 502 |
Wilson 201259 (UK) | Retrospective cohort Primary |
Overall = 748 Stage I = 632 Stage II = 249 19 General Practices in the South Birmingham area. Patients recruited through mailed questionnaires. (Study dates not reported) |
Median (IQR) = 59 (54–63) Range = 50–70 |
Male = 356 Female = 392 |
NR | Colonoscopy | CRC = 46 (8 sample were lost) |
Withrow 202260 (UK) | Retrospective cohort Primary and secondary |
Overall = 18,656 Final analysis = 16,604 Data from the Oxford University Hospital (OUH), 67 GPs in Oxford. (March 2017–Dec 2020; 6 month follow up allowed up until June 2021) |
Median = 61 | Male = 7019 Female = 9585 |
NR | The composite reference standard incorporated the review of multiple-linked databases (hospital clinical records, pathology results, and endoscopy and radiology reports) for evidence of a new colorectal cancer diagnosis | CRC = 139 |
Estimated from provided percentage. UK = United Kingdom; USA = United States of America; NR = not reported; CRC = colorectal cancer; AN = advanced neoplasia; AA = advanced adenoma; HRA = high risk adenoma; SD = standard deviation; IQR = inter-quartile range; CT = computed tomography.
Models including FIT
Twenty-three of the studies included FIT (n = 22) or gFOBT (n = 1) combined with one or more other variables (Table 2).18,19,30,32,34,36,40,43, 44, 45, 46,49,51,60,63,65,67,68,70,71,81 Of these, ten studies reported model development only,30,34,40,43, 44, 45,60,65,70,81 four studies presented validations of models,30,46,49 three studies presented both development and validation,18,19,63 and six were classed as PPV only studies (i.e. they reported PPVs for FIT in combination with at least one other factor).32,36,51,67,68,71
Table 2.
Study (type of study) |
Predictors (final model) | Modelling method | AUC (95% CI) | Sensitivity % (95% CI) | Specificity % (95% CI) | PPV % (95% CI) | NPV % (95% CI) |
---|---|---|---|---|---|---|---|
Ayling 202146 (validation; ColonFlag and FAST score) | ColonFlag (band 3) Age Sex Full blood count FAST score (>4.5) Age Sex FIT (≥4 μg Hb/g)b |
NR directly ColonFlag = machine learning FAST score = Logistic regression |
NR | CRC FAST: 72.7 (39–94) ColonFlag: 81.8 (48.2–97.7) CRC + HRA FAST: 60 (42.1–76.1) ColonFlag: 42.9 (26.3–60.7) FIT + ColonFlag CRC: 100 (71.5–100) CRC + HRA: 85.7 (69.7–95.2) |
CRC FAST: 80.6 (76.2–84.5) ColonFlag band 3: 73.5 (68.7–77.9) CRC + HRA FAST >4.5: 83 (78.7–86.8) Colonflag band 3: 73.4 (68.4–77.9) FIT + colonflag CRC: 49.6 (44.4–54.8) CRC + HRA: 51.6 (46.2–56.9) |
CRC alone FAST >4.5: 9.9 (6.7–14.3) Colonflag band 3: 8.3 (6.1–11.1) CRC + HRA FAST >4.5: 25.9 (19.7–33.3) Colonflag band 3: 13.7 (9.5–19.5) FIT + colonflag CRC: 5.5 (4.9–6) CRC + HRA: 14.9 (12.9–17.3) |
CRC alone FAST >4.5: 99 (97.5–99.6) Colonflag band 3: 99.3 (97.6–99.8) CRC + HRA FAST >4.5: 95.4 (93.3–96.9) Colonflag band 3: 92.8 (90.6–94.6) FIT + colonflag CRC: 100 CRC + HRA: 97.3 (94.1–98.8) |
Cama 202130 (validation; FAST score) | FAST score (>2.12) Age Sex FIT (>10 μg/g) NG12 criteria (comparison) |
NR Compared FAST score and NG12 criteria using MedCalc software |
NR | FAST >2.12 = 1.00 (0.93–1.00) NG12 = 0.82 (0.67–0.91) |
FAST >2.12 = 0.25 (0.24–0.27) NG12 = 0.42 (0.4–0.43) |
NR | NR |
Cubiella 201619 (development and validation; COLONPREDICT) | Age Sex Change in bowel habit Rectal bleeding Benign anorectal lesion Rectal mass Anaemia CEA Previous colonoscopy (10 yrs) Aspirin use FIT (≥20μ Hb/g) |
Logistic regression | CRC Development = 0.92 (0.91–0.94) Validation = 0.92 (0.9–0.94) ACN Development = 0.83 (0.8–0.85) Validation = 0.82 (0.79–0.85) |
Development 5.6+ CRC = 90.1 (85.1–93.6) ACN = 66.7 (61.8–71.2) 3.5+ CRC = 99.5 (97–100) ACN = 89.5 (86.1–92.2) Validation 5.6+ CRC = 87.1 (79.9–92.1) ACN = 66 (60.3–71.3) 3.5+ CRC = 100 (96–100) ACN = 88.2 (83.9–91.5) |
Development 5.6+ CRC = 78.7 (76.4–80.9) ACN = 82.3 (79.9–84.4) 3.5+ CRC = 45.8 (43.1–48.2) ACN = 50.1 (47.2–53.1) Validation 5.6+ CRC = 79.3 (76.9–81.4) ACN = 83.5 (81.2–85.7) 3.5+ CRC = 46.8 (44–49.6) ACN = 50.7 (47.7–53.7) |
Development 5.6+ CRC = 40.7 (36.2–45.3) 3.5+ CRC = 22.9 (20.3–25.8) Validation NR |
Development 5.6+ CRC = 98 (96.9–98.7) 3.5+ CRC = 99.8 (98.9–100) Validation NR |
Cubiella 201718 (development and validation; FAST Score) | Age Sex FIT (in equation 0, 20, or 200 μg Hb/g)b FAST scores assessed ≥4.50 and ≥ 2.12 |
Logistic regression | CRC Development = 0.88 (0.85–0.9) Validation = 0.91 (0.9–0.93) ACN Development = 0.82 (0.8–0.84) Validation = 0.79 (0.76–0.8) |
Development CRC: 4.50+ = 89.8 (84.7–93.3) 2.12+ = 100 (97.8–100) ACN: 4.50+ = 75.4 (70.9–79.4) 2.12+ = 98.8 (97.1–99.6) Validation CRC: 4.50+ = 89.3 (84.1–93) 2.12+ = 100 (97.7–100) ACN: 4.50+ = 60.7 (56.6–64.7) 2.12+ = 96.7 (94.9–98) |
Development CRC: 4.50+ = 71.3 (68.8–73.7) 2.12+ = 13.9 (12.1–15.9) ACN: 4.50+ = 76.9 (74.3–79.3) 2.12+ = 15.9 (13.9–18.2) Validation CRC: 4.50+ = 82.3 (81.1 = 83.5) 2.12+ = 19.8 (18.6–21.1) ACN: 4.50+ = 85.4 (84.1–86.5) 2.12+ = 21.5 (20.1–22.9) |
Development CRC: 4.50+ = 33.2 (29.4–37.2) 2.12+ = 15.6 (13.7–17.6) ACN: 4.50+ = 54.4 (50.2–58.5) 2.12+ = 30 (27.6–32.5) Validation CRC: 4.5+ = 21.7 (NR) ACN: 4.5+ = 41.7 (NR) |
Development CRC: 4.50+ = 97.8 (96.6–98.6) 2.12+ = 100 (97.5–100) ACN: 4.50+ = 89.6 (87.4–91.4) 2.12+ = 97.3 (93.5–99) Validation NR |
Digby 201985 (validation; FAST Score) | Age Sex FIT (in equation 0, 20, or 200 μg Hb/g)b FAST score ≥2.12 |
Logistic regression | NR | 2.12+ = 99 (94.3–100) | 2.12+ = 22.4 (20.2–24.7) | 2.12+ = 8.2 (8–8.5) | 2.12+ = 98.9 (97.7–100) |
Fernandez Banares 201963,d (development and validation; COLONOFIT) | Age MAXFIT (maximum f-Hb value of three samples) NSAMPLES >4 (number of samples >4 μg Hb/g faeces) Previous colonoscopy (5 yrs) Smoking status |
Bayesian logistic regression (Bootstrapping completed for internal validation; development) | Development CRC = 0.93 (0.91–0.95) CRC + AA = 0.865 (0.83–0.89) Validation CRC = 0.86 (0.025b) CRC + AA = 0.79 (0.02b) |
Validation CRC = 96 (85–99) CRC + AA = 79 (72–85.4) Development + Validation CRC = 98 (93–99.7) CRC + AA = 85 (80.3–88) |
Validation CRC = 52 (48–56) CRC + AA = 58 (54.2–63) Development + Validation CRC = 53 (51–56) CRC + AA = 60 (57.4–63) |
Validation CRC = 14.4 (11–19) CRC + AA = 37 (32–42.7) Development + Validation CRC = 15 (13–18) CRC + AA = 36 (33.2–40) |
Validation CRC = 99.3 97–99.9) CRC + AA = 90 (87–93.2) Development + Validation CRC = 99.7 (99–100) CRC + AA = 93.5 (91.5–95) |
Herrero 201849 (validation; COLONPREDICT, FAST Score, 2017 NG12 and CG27 NICE) | Various combinations for referral, only NG12 was directly reported: Age Weight loss Abdominal pain Iron deficiency anaemia Change in bowel habit Rectal mass Abdominal mass FIT |
NR | NG12 = 0.53 (0.49–0.57) CG27 = 0.59 (0.55–0.63) COLONPREDICT = 0.92 (0.91–0.94) FAST Score (≥4.50) = 0.87 (0.85–0.89) |
NG12 = 100 (97.8–100) CG27 = 68.2 (61.5–74.3) NB: for COLONPREDICT and FAST score, see Cubiella 2016; 2017 |
NG12 = 6.8 (5.6–8.4) CG27 = 50.3 (47.6–53) NB: for COLONPREDICT and FAST score, see Cubiella 2016; 2017 |
NG12 = 14.5 (12.8–16.5) CG27 = 17.8 (15.3–20.6) NB: for COLONPREDICT and FAST score, see Cubiella 2016; 2017 |
NG12 = 100 (95–100) CG27 = 91 (89–93) NB: for COLONPREDICT and FAST score, see Cubiella 2016; 2017 |
Hijos-Mallada 202365 (development) | FIT (qualitative) Transferrin (>0.4 μg/g) Lactoferrin (>10 μg/g) FC (>50 μg/g) |
Logistic regression | CRC = 0.872 (0.815–0.929) Adenoma = 0.673 (0.599–0.747) |
CRC = 50 (NR) Adenoma = 57 (NR) |
CRC = 96.5 (NR) Adenoma = 94 (NR) |
CRC = 44.1 (NR) Adenoma = 8.8 (NR) |
CRC = 97.2 (NR) Adenoma = 90.7 (NR) |
Hogberg 201767 (PPV) | FIT (one or more samples were positive, i.e. ≥25 μg Hb/g) Faecal Calprotectin (≥100 μg/g) Anaemia Iron deficiency |
NA | NA | FIT positive and/or FC 100ug/g+ = 87.5 FIT positive and/or FC 20ug/g+ = 100 FIT positive and/or anaemia = 100 FIT positive and/or iron deficiency = 100 FIT positive and/or anaemia and/iron deficiency = 100 |
FIT positive and/or FC 100ug/g+ = 61.1 FIT positive and/or FC 20ug/g+ = 40.3 FIT positive and/or anaemia = 60 FIT positive and/or iron deficiency = 59.2 FIT positive and/or anaemia and/iron deficiency = 54.8 |
FIT positive and/or FC 100ug/g+ = 4.7 FIT positive and/or FC 20ug/g+ = 3.5 FIT positive and/or anaemia = 5.2 FIT positive and/or iron deficiency = 5.1 FIT positive and/or anaemia and/iron deficiency = 4.7 |
FIT positive and/or FC 100ug/g+ = 99.6 FIT positive and/or FC 20ug/g+ = 100 FIT positive and/or anaemia = 100 FIT positive and/or iron deficiency = 100 FIT positive and/or anaemia and/iron deficiency = 100 |
Hogberg 202068 (PPV) | FIT (≥2–50 μg Hb/g depending on machine brand) Anaemia Thrombocytosis |
NA | NA | FIT positive + Anaemia Actim Fecal Blood = 52 Analyz FOB = 38.3 Chemtrue FOB = 55.2 Diaquick FOB = 30.6 FIT positive + Thrombocytosis Actim Fecal Blood = 14.3 Analyz FOB = 17.3 Chemtrue FOB = 20.7 Diaquick FOB = 12.1 |
FIT positive + Anaemia Actim Fecal Blood = 88 Analyz FOB = 90.8 Chemtrue FOB = 89.2 Diaquick FOB = 91.8 FIT positive + Thrombocytosis Actim Fecal Blood = 96.2 Analyz FOB = 96.8 Chemtrue FOB = 95.6 Diaquick FOB = 98.1 |
FIT positive + Anaemia Actim Fecal Blood = 7.9 (5.5–10.3) Analyz FOB = 8.6 (6.4–10.7) Chemtrue FOB = 8.9 (4.7–13) Diaquick FOB = 8.3 (4.2–14.3) FIT positive + Thrombocytosis Actim Fecal Blood = 7.6 (1.8–13.4) Analyz FOB = 10.7 (6.6–14.9) Chemtrue FOB = 8.7 (2–15.3) Diaquick FOB = 13.8 (3.9–31.7) |
FIT positive + Anaemia Actim Fecal Blood = 98.9 (98.6–100) Analyz FOB = 98.5 (98.2–98.8) Chemtrue FOB = 99.1 (98.5–99.6) Diaquick FOB = 98.2 (97.4–98.8) FIT positive + Thrombocytosis Actim Fecal Blood = 98 (97.4–98.6) Analyz FOB = 98.1 (97.8–98.5) Chemtrue FOB = 98.3 (97.7–99) Diaquick FOB = 97.8 (96.8–98.5) |
Johnstone 202251 (PPV) | FIT (categorised: <10 μg/g, 10–149 μg/g, 150–399 μg/g, and ≥400 μg/g) Anaemia |
NA | NA | 98.2 (NR) | 65.4 (NR) | 3.99 (NR) | 99.96 (NR) |
Jin 201232 (PPV) | FIT (≥0.2 μg/ml) Faecal transferrin test |
NA | NA | CRC = 47.6 AA 10 mm+ = 30.6 AA <10 mm = 36.4 AA + CRC = 36.8 |
CRC = 78.3 AA 10 mm+ = NR AA <10 mm = NR AA + CRC = 78.2 |
CRC = 20.4 AA 10 mm+ = 22.4 AA <10 mm = 8.2 AA + CRC = 34.1 |
CRC = 92.8 AA 10 mm+ = NR AA <10 mm = NR AA + CRC = 71.7 |
Lucoq 202281 (development) | FIT (undefined) Anaemia (iron deficiency, severe anaemia, low TSAT anaemia) Other symptoms (undefined) |
Machine learning | FIT + anaemia = 0.806 (NR) FIT + symptoms = 0.842 (NR) |
NR | NR | NR | NR |
Lue 202086 (development) | FIT (≥20 μg/g) Faecal Calprotectin |
NR | NR for individual outcomes | CRC = 93.75 AA = 82 CRC + AA = 85.5 |
CRC = 43.3 AA = 44.4 CRC + AA = 46.1 |
CRC = 6.4 AA = 13.6 CRC + AA = 20 |
CRC = 99.4 AA = 98.85 CRC + AA = 95.3 |
Mahadavan 201270 (development) | Age Sex Colonocyte DNA Mean red cell volume CEA Rectal bleeding FOBTc |
Logistic regression | Final model = 0.88 (0.84–0.92) Excl. unreliable samples = 0.9 (0.86–0.93) Excl. palpable patients = 0.84 (0.78–0.9) |
NR | NR | NR | NR |
Malagon 201934 (development; RAID-CRC) | FIT (10 μg Hb/g of faeces) Eubacteria (EUB) P stomatis (PTST) B fragilis (BCTF) B thetaiotaomicron (BCTT) |
Machine learning (four methods, neural network, logistic regression, gradient boosting tree, random forest) | CRC + AA = 0.84 (0.73–0.94) | CRC + AA = 80 (NR) | CRC + AA = 90 (NR) | CRC + AA = 70 (NR) | CRC + AA = 94 (NR) |
Mowat 201671 (PPV) | FHb (FIT: any numerical result greater than zero) Faecal Calprotectin (unclear cut-off) |
NA | NA | CRC FHb and/or FC 50+ μg/g = 100 FHb and/or FC 200+ μg/g = 100 HRA FHb and/or FC 50+ μg/g = 92.7 FHb and/or FC 200+ μg/g = 85 |
CRC FHb and/or FC 50+ μg/g = 20.3 FHb and/or FC 200+ μg/g = 35.4 HRA FHb and/or FC 50+ μg/g = 20.3 FHb and/or FC 200+ μg/g = 35.1 |
CRC FHb and/or FC 50+ μg/g = 4.7 FHb and/or FC 200+ μg/g = 5.7 HRA FHb and/or FC 50+ μg/g = 6.3 FHb and/or FC 200+ μg/g = 6.9 |
CRC FHb and/or FC 50+ μg/g = 100 FHb and/or FC 200+ μg/g = 100 HRA FHb and/or FC 50+ μg/g = 97.9 FHb and/or FC 200+ μg/g = 97.6 |
Parente 201236 (PPV) | Combinations of: FIT (100 ng/ml) Faecal Calprotectin Pyruvate kinase (M2-PK) At least one test must be positive for further investigation. |
NA | NA | CRC FIT + FC = 90.9 (78.8–96.4) FIT + M2-PK = 91.5 (80.1–96.6) FC + M2-PK = 95.7 (85.7–98.8) FIT + FC + M2-PK = 95.7 (85.7–98.8) ACN FIT + FC = 75.8 (67.3–82.7) FIT + M2-PK = 71.2 (62.9–78.2) FC + M2-PK = 82.8 (75.1–88.4) FIT + FC + M2-PK = 86.1 (78.8–91.1) |
CRC FIT + FC = 35.9 (29.7–42.6) FIT + M2-PK = 57.1 (50.6–63.2) FC + M2-PK = 26.4 (20.9–32.6) FIT + FC + M2-PK = 24.1 (18.8–30.2) ACN FIT + FC = 37.2 (29.6–45.6) FIT + M2-PK = 66.9 (58.9–73.9) FC + M2-PK = 26.9 (20.3–34.8) FIT + FC + M2-PK = 26.2 (19.7–34.1) |
CRC FIT + FC = 22.9 (17.3–29.7) FIT + M2-PK = 30.1 (23.1–38) FC + M2-PK = 22.1 (16.9–28.2) FIT + FC + M2-PK = 21.5 (16.5–27.6) ACN FIT + FC = 50.6 (43.2–57.9) FIT + M2-PK = 65.7 (57.6–73) FC + M2-PK = 49.5 (42.7–56.3) FIT + FC + M2-PK = 50.2 (43.5–56.9) |
CRC FIT + FC = 94.9 (87.7–98) FIT + M2-PK = 97.1 (92.7–98.9) FC + M2-PK = 96.6 (88.5–99.1) FIT + FC + M2-PK = 96.3 (87.5–98.9) ACN FIT + FC = 64.5 (53.5–75.4) FIT + M2-PK = 72.3 (64.2–79.1) FC + M2-PK = 64.4 (51.6–75.4) FIT + FC + M2-PK = 68.5 (55.2–79.3) |
Rodriguez-Alonso 201540 (Development; FAST score) | Age Sex FIT (≥10 μg/g faeces) |
Logistic regression (internal validity assessed by split sampling) | ACN = 0.79 (0.76–0.84) | Score ≥5 = 75.9 (67.8–82.9) | Score ≥5 = 72 (68.8–74.9) | NR | NR |
Turvill 201843 (development) | FIT (varied from ≥2 to ≥12 μg Hb/g) Faecal Calprotectin (varied from ≥10 to ≥239 μg/g) Combinations of the tests include number of times ran and cut-offs |
NR | Two FIT ≥2μgHb/g faeces + two FC ≥10 μg/g = 0.887 (0.828–0.946)a | 91.7 | 85.8 | 25.6 | 99.5 |
Widlak 201744 (development) | FIT (≥7 μg Hb/g) Faecal Calprotectin (≥50 μg Hb/g) |
NR | CRC + HGD = 0.95 (NR) Adenoma = NR |
CRC + HGD = 84 (NR) Adenoma = 69 (NR) |
CRC + HGD = 93 (NR) Adenoma = 56 (NR) |
CRC + HGD = 41 (NR) Adenoma = 15 (NR) |
CRC + HGD = 99 (NR) Adenoma = 94 (NR) |
Widlak 201845 (development) | Model 1 FIT (≥3 μg Hb/g) Faecal Calprotectin (cut-off unclear) Model 2 FIT (≥3 μg Hb/g) Volatile organic compounds |
Bayesian logistic regression (Internal validation by cross-validation) | Model 1 CRC = 0.91 (0.86–0.96) HRA = 0.69 (0.59–0.79) All adenomas = 0.6 (0.54–0.94) Model 2 CRC = 0.86 (0.77–0.94) |
Model 1 CRC = 80 (66–93) HRA = 93 (81–100) Adenomas = 86 (79–93) Model 2 CRC = 80 (66–93) |
Model 1 CRC = 93 (91–95) HRA = 25 (21–29) Adenomas = 26 (22–30) Model 2 CRC = 89 (87–93) |
Model 1 CRC = 43 (31–55) HRA = 6 (4–8) Adenomas = 19 (15–23) Model 2 CRC = NR |
Model 1 CRC = 99 (97–100) HRA = 99 (96–100) Adenomas = 90 (85–95) Model 2 CRC = 99 (97–100) |
Withrow 202260 (development) | FIT (≥2 or 10 μg Hb/g) Age Sex Blood tests (Hb, platelets, white cell count, MCH, MCV, serum ferritin, and CRP) |
Logistic regression | Model a (FIT continuous) = 0.91 (0.87–0.95) Model b (FIT and blood tests dichotomous) = 0.93 (0.91–0.96) Model c (FIT spline) = 0.94 (0.92–0.96) |
Model a = 93.8 (85–97.5) Model b = 93.5 (88.2–96.6) Model c = 92.1 (86.4–95.5) |
Model a = 45.9 (44.7–47.1) Model b = 90.1 (89.6–96.6) Model c = 91.5 (91.1–91.9) |
Model a = 1.7 (1.4–2.2) Model b = 7.4 (6.2–8.7) Model c = 8.4 (7.1–9.9) |
Model a = 99.9 (99.6–99.9) Model b = 99.9 (99.9–100) Model c = 99.9 (99.9–100) |
CRC = Colorectal Cancer; AA = Advanced Adenoma; HRA = High Risk Adenoma; ACN = Advanced Colorectal Neoplasia; NR = Not Reported; NA = Not Applicable; CI = Confidence Interval; AUC = Area Under the Curve; CEA = Carcinoembryonic Antigen; CIBH = Change in Bowel Habit; FIT = Faecal immunochemical test; BMI = Body Mass Index; MCH = Mean cell haemoglobin; CRP = C-reactive protein; HGD = High grade dysplasia; HRA = High Risk Adenoma; MCV = Mean Corpuscular volume; MCH = Mean Corpuscular Haemoglobin.
Most accurate model presented.
FAST score calculation increases with increasing value of FIT (0 μg/g, 0.6841 if 1–19 μg/g, 2.824 if 20–199 μg/g and 4.184 if ≥200 μg/g.
Undefined, assumed to be guaiac.
Assumed represents standard error.
The cut-off considered positive for FIT varied between studies (Table 2). One study classed any result above zero μg/g of faeces as positive71; another used a cut-off of 0.2 μg/ml,32 Eleven studies utilised a cut-off between 2 and 25 μg/g of faeces for a positive FIT result.19,34,40,43, 44, 45, 46,60,63,67,86 One study assessed four different analytical machines, with a positive FIT varying between machines (2–50 μg/g of faeces).68 Three studies of the FAST score (an equation based on FIT, age and sex) used different FIT cut-off values.18,49,85 One study categorised patients by their FIT result between <10 and >400 μg/g of faeces.51 The final FIT study assessed a cut-off 100 ng/ml.36 All studies including FIT/gFOBT as a variable were rated as high in the risk of bias. This was generally due to a lack of reporting of adequate calibration statistics (Fig. 2A).
FIT models assessing CRC
Ten of the models including FIT (or gFOBT) assessed CRC and reported measures of discrimination.18,19,34,43,45,49,60,63,65,70 Overall, these showed good discriminatory ability for CRC identification (i.e. AUC ≥0.8; see Fig. 3).
The most commonly reported model (n = 5) utilised FIT, age and sex (FAST) to produce a score that is assessed against a threshold (e.g. >2.12) for the prediction of both CRC and for can, separately (which is reported below). The FAST score showed good discriminatory ability for CRC when externally validated (AUC = 0.91).18 Further external validation showed similar results (AUC = 0.87).49 Three studies performed some form of further validation; these three studies reported similar levels of accuracy (i.e. sensitivity and specificity), but did not report measures of discrimination.30,46,85 All of these studies were rated high for risk of bias, mainly due to statistical concerns; for example, lack of calibration and selection of variables being based on univariate analysis. The case was similar for all studies that reported models including FIT, with no study being rated as low overall for risk of bias and analysis concerns being the major driver of this (see Fig. 2).
Two further models were also externally validated: COLONOFIT63 and COLONPREDICT.19 COLONOFIT, which used the maximum value and number of values above 4 μg Hb/g of FIT across three samples, in addition to age, smoking status and history of previous colonoscopy, showed good discrimination for CRC (validation AUC = 0.86). COLONPREDICT, which uses FIT, demographics, symptoms, and blood tests, also suggested good discrimination for CRC (validation AUC = 0.92). COLONPREDICT and the FAST score were reported to be more accurate at predicting CRC than the English National Institute for Health & Care Excellence (NICE) Guideline 12 (NG12)49 and Clinical Guideline 27 (CG27)—the NICE guideline for suspected cancer that preceded NG12.30,49
Ayling and colleagues (2021)46 also provided some validation of the ColonFlag score, an artificial intelligence learning algorithm, which was originally developed in an asymptomatic population.87, 88, 89, 90 They suggested that combining it with FIT could improve the sensitivity but discrimination and calibration were not reported.
Four studies reported on the combination of FIT/gFOBT and other biomarkers.60,65,70,75 One study obtained a high discrimination value for CRC (AUC = 0.94) by including haemoglobin, platelets, white cell count, Mean Corpuscular Haemoglobin (MCH), MCV, serum ferritin, and CRP markers, in addition to FIT.60 One other study reported on the combination of FIT and transferrin, but only reported accuracy measures (PPV = 20.4% for CRC).32 Another study assessed the combination of FIT, transferrin, lactoferrin and FC, showing good discriminatory ability (AUC = 0.87), however, this was not validated.65 One study that utilised a mixture of demographics, other biomarkers (colonocyte DNA, Mean Corpuscular Volume (MCV), Carcinoembryonic antigen (CEA)), rectal bleeding and gFOBT showed good discrimination for CRC (AUC = 0.88).
FIT combined with faecal calprotectin had high AUC for CRC, using either two samples from both tests (AUC = 0.89)43 or a single sample from each test (AUC = 0.91),45 but neither study provided either internal or external validation. Seven studies, reported varying results for accuracy when combining FIT with faecal calprotectin alone or with other variables (see Table 2).36,43, 44, 45,67,71,86 Three studies combining FIT and haematological tests such as anaemia/iron deficiency and thrombocytosis reported PPVs for CRC in the range 4%–9%.51,67,68
FIT models assessing CRC and ACP/ACN or colorectal neoplasia alone
Eight studies reported the discriminatory ability of FIT and other variables to assess CRC combined with other outcomes (e.g. advanced adenoma; AA) or such outcomes alone (e.g. ACN; see Fig. 4).18,19,34,40,44,45,63,65
The FAST score was originally developed for ACN, and it showed some discriminatory ability (AUC = 0.79)40; when externally validated this discriminatory ability was maintained (AUC = 0.79).18 Similar accuracy measures were obtained in these studies when using a cut-off score >4.5 for the outcome of CRC and HRA.46 Similar results for COLONPREDICT were observed when assessing the outcome of ACN (validation AUC = 0.82).19 COLONOFIT had a similar discriminatory ability for the outcome of CRC combined with advanced adenoma (AA), (validation AUC = 0.79).63
One study utilised machine learning methods to develop a model using bacterial biomarkers in addition to FIT for prediction of CRC and advanced adenoma (AA) combined, suggesting good discrimination (AUC = 0.84).34 However, the study was not internally or externally validated. Another biomarker study utilising FIT, FC, transferrin and lactoferrin showed poor discrimination (AUC = 0.67) for the prediction of adenomas.65
Assessing for the combined outcome of CRC and high-grade dysplasia, the combination of FIT and faecal calprotectin had high discriminatory ability (AUC = 0.95),44 but the study included only 430 people and did not report internal or external validation. One further study reported the combination of FIT with FC had poor discriminatory ability for HRA (AUC = 0.69) and all adenomas (AUC = 0.6)45 The combination of FIT and FC had a varying reported PPVs for outcomes such as ACN and HRA (PPV range = 6.3–22.9%).36,71,86
Non-FIT models
The remaining 39 studies did not include FIT/gFOBT and assessed models that utilised a mixture of symptoms, haematological tests, medical history, and demographical information.27, 28, 29,31,33,35,37, 38, 39,41,42,47,48,50,52, 53, 54, 55, 56, 57, 58, 59,61,62,64,66,69,72, 73, 74, 75, 76, 77, 78, 79, 80,82 Of these, 18 were development studies,27,28,33,39,41,50,52, 53, 54,59,62,64,69,73, 74, 75,79,82 three were validation studies,38,47,61 ten presented both development and validation,29,48,55, 56, 57, 58,66,72,76,78 and eight were classified as PPV studies.31,35,37,42,62,77,78,80 For further details of the results, see Table 3.
Table 3.
Study (type of study) | Predictors (final model) | Modelling method | AUC (95% CI) | Sensitivity % (95% CI) | Specificity % (95% CI) | PPV % (95% CI) | NPV % (95% CI) |
---|---|---|---|---|---|---|---|
Abdelhady 202175 (development) | Golgi protein-73 CEA |
Unclear | 0.984 (0.963–1.007) | 93.33 (NR) | 98.33 (NR) | 96.6 (NR) | 96.7 (NR) |
Adelstein 201027 (development) | Age Sex Previous colonoscopy (10 yrs) Diverticular disease NSAID/aspirin use Mucus Abdominal pain Anaemia |
Logistic regression, backwards elimination (Internal validation, bootstrapping) | 0.85 (NR)a | NR | NR | NR | NR |
Adelstein 201128 (development) | Age Sex Education level Previous colonoscopy (10 yrs) NSAIDs/aspirin use Smoking status Previous polyps IBS Rectal bleeding Mucus Anaemia Fatigue |
Logistic regression, backwards elimination | CRC = 0.83 (NR)a AA = 0.7 (NR)a |
NR | NR | NR | NR |
Alatise 201829 (development and validation) | Weight loss (last 6 months) Change in bowel habit |
logistic regression | Development = NR Validation = 0.875 (NR) |
89% (NR; Symptom score of 2) | 83% (NR; Symptom score of 2) | NR | NR |
Ballal 201061 (validation; Selva Score) | WNS derived from a colorectal symptom questionnaire. Works by adding assigned weightages to reported main symptoms of bleeding per rectum and CIBH. Weights change with age and presence/no presence of other symptoms (See Selvachandran 2002). | NR | 0.76 (SE = 0.02) | WNS score 40+: 93 (NR) WNS score 50+: 88.2 (NR) WNS score 60+: 70.4 (NR) WNS score 70+: 59.1 (NR) |
WNS score 40+: 31.7 (NR) WNS score 50+: 47.9 (NR) WNS score 60+: 64 (NR) WNS score 70+: 77.4 (NR) |
WNS score 40+: 7.2 (NR) WNS score 50+: 8.8 (NR) WNS score 60+: 10 (NR) WNS score 70+: 12.9 (NR) |
NR |
Blume 201676 (development and validation) | Alpha-1-acid glycoprotein 1 (AACT) Cathepsin D (CATD) CEA Complement component 3 (CO3) Complement component 9 (CO9) Macrophage migration inhibitory factor (MIF) P-selection glycoprotein ligand 1(PSGL) Seprase (SEPR) |
Machine learning (support vector, with sigmoid kernel–default parameters) | CRC Development = 0.85 (NR)a Validation = 0.82 (0.75–0.88)a AA Development = 0.77 (NR) Validation = 0.65 (0.56–0.74) |
80 (NR) | 68 (NR) | NR | NR |
Boulind 202262 (development) | Volatile organic compounds x 13 Unclear which compounds are used in the final model |
Artificial Neural Network 3 volatile organic compound analyses: Selected Ion Flow Tube Mass Spectrometry (SIFT-MS) Field Asymmetric Ion Mobility Spectrometry (FAIMS) Gas Chromatography Mass Spectrometry (GC–MS) |
CRC SIFT-MS = 0.872 (0.794–0.949) FAIMS = 0.855 (0.724–0.986) GCMS = 0.913 (0.825–1) CRC + polyps SIFT-MS = 0.662 (0.602–0.723) FAIMS = 0.664 (0.591–0.734) GCMS = 0.896 (0.802–0.966) CRC vs polyps SIFT-MS = 0.813 (0.704–0.922) FAIMS = 0.855 (0.732–0.977) GCMS = 0.896 (0.796–0.996) |
CRC: SIFT-MS = 0.778 (0.524–0.936) FAIMS = 0.889 (0.653–0.986) GCMS = 0.833 (0.586–0.964) CRC + polyps SIFT-MS = 0.6 (0.5–0.694) FAIMS = 0.429 (0.332–0.529) GCMS = 0.878 (0.752–0.953) CRC vs polyps SIFT-MS = 0.722 (0.465–0.903) FAIMS = 0.722 (0.465–0.903) GCMS = 0.889 (0.633–0.986) |
CRC: SIFT-MS = 0.78 (0.733–0.822) FAIMS = 0.778 (0.524–0.936) GCMS = 0.815 (0.7–0.901) CRC + polyps SIFT-MS = 0.605 (0.543–0.664) FAIMS = 0.872 (0.794–0.928) GCMS = 0.882 (0.726–0.967) CRC vs polyps SIFT-MS = 0.759 (0.655–0.844) FAIMS = 0.889 (0.653–0.986) GCMS = 0.871 (0.702–0.964) |
NR | NR |
Collins 201247 (validation; QCancer) |
Men Age Family history of GI cancer Abdominal pain Appetite loss Rectal bleeding Weight loss Anaemia Change in bowel habit Alcohol consumption |
NR directly QCancer = Cox's proportional hazards model |
Internal validation = 0.91 (0.9–0.91) External validation Multiple imputation model = 0.918 (0.913–0.923) Complete cases = 0.901 (0.892–0.910) |
NR | NR | NR | NR |
Women Age Family history of GI cancer Abdominal pain Appetite loss Rectal bleeding Weight loss Anaemia |
Internal validation = 0.89 (0.88–0.9) Complete cases = 0.909 (0.903–0.915) |
NR | NR | NR | NR | ||
Croner 201748 (development and validation) | Alpha-1-acid glycoprotein (A1AG) CEA Complement 9 (CO9) Dipeptidyl peptidase IV (DPPIV) Macrophage migration inhibitory factor (MIF) Pyruvate kinase isozyme M2 (PKM2) Transferrin receptor protein (TFRC) |
Machine learning | Development = 0.89 (NR) Validation = 0.86 (0.82–0.9) |
Development = 0.8 (NR) Validation = 0.8 (NR) |
Development = 0.87 (NR) Validation = 0.83 (NR) |
Validation = 36.5 (NR) | Validation = 97.1 (NR) |
Ellis 200531 (PPV) | Rectal bleeding + one or more of the following: Chang in bowel habit Perianal symptoms Abdominal pain |
NA | NA | Bleeding + CIBH = 100 Bleeding + CIBH (loose) = 91 Bleeding + no perianal symptoms = 64 Bleeding + CIBH + abdominal pain = 55 |
Bleeding + CIBH = 55 Bleeding + CIBH (loose) = 32 Bleeding + no perianal symptoms = 78 Bleeding + CIBH + abdominal pain = 44 |
Bleeding + CIBH = 9.2 Bleeding + CIBH (loose) = 12.1 Bleeding + no perianal symptoms = 11.1 Bleeding + CIBH + abdominal pain = 9 (+no pain = 9.6) |
NR |
Ewing 201683 (PPV) | Change in bowel habit Rectal bleeding (incl. GI, unclassified and melena) Weight loss (incl. anorexia) Anaemia (combined iron deficiency anaemia and other anaemias) Abdominal pain |
NA | NA | NR | NR | CIBH + bleeding = 13.7 (2.1–54.4) CIBH + abdominal pain = 1.5 (0.8–2.6) CIBH + Anaemia = 2.9 (1–8.4) Bleeding + abdominal pain = 12.2 (1.8–51.2) Bleeding + Anaemia = 2.9 (1.2–6.9) Weight loss + Anaemia = 5.6 (0.7–33) Abdominal pain + Anaemia = 4.2 (1.6–2.4) |
NR |
Fijten 1995 (development) | Age Sex Blood mixed with stool Change in bowel habit (excl. constipation) |
Logistic regression | 0.97 (NR) | Cut-off = 0.042 100 (NR) |
Cut-off = 0.042 90 (NR) |
Cut-off = 0.042 26 (NR) |
Cut-off = 0.042 0 (NR) |
Hamilton 200577 (PPV) | Constipation Diarrhoea Rectal bleeding Weight loss Abdominal pain Abdominal tenderness Abnormal rectal exam Haemoglobin |
NA | NA | NR | NR | PPV >5% Abdominal tenderness + weight loss = 6.4 Abnormal rectal exam + diarrhoea = 11 + rectal bleeding = 8.5 + weight loss = 7.4 + abdominal tenderness = 5.8 Hb < 10 g dl + abdominal pain = 6.9 + abdominal tenderness = >10 |
NR |
Hippisley-Cox 201266 (development and validation; QCancer) | Split by male and female: Age Alcohol status (Males only) Change in bowel habit (Males only) Family history of GI cancer Hb < 11 g/dl in last year Rectal bleeding Abdominal pain Appetite loss Weight loss |
Cox's proportional hazards model | Development = NR Validation Female = 0.89 (0.88–0.9) Male = 0.906 (0.899–0.913) |
Provided at risk thresholds for top percentage risk score: 10% = 70.6 5% = 56.4 1% = 24.6 |
Provided at risk thresholds for top percentage risk score: 10% = 90.1 5% = 95.1 1% = 99 |
Provided at risk thresholds for top percentage risk score: 10% = 1.5 5% = 2.4 1% = 5.2 |
Provided at risk thresholds for top percentage risk score: 10% = 1.5 5% = 2.4 1% = 5.2 |
Hoogendoorn 201650 (development) | Age Sex Medication: medication prescribed, dosage. ATC scheme Consultation codes: code of symptoms and/or diagnoses during the consultation visit, ICPC coding (Dutch version) Referrals: to secondary care Lab results: any form of lab measurement performed by the GP, or received from an external lab. Consultation notes: uncoded notes entered by GP (in Dutch) |
Machine learning (Completed using various methods: bag of words (1) topic modelling with oversampling (2) separate topic modeling for two classes (3) topic modeling beyond consultation code (4) coding using ICPC (5) coding using UMLS (6) topic modelling can use one of the following bayesian approaches: Latent dirichlet allocation (LDA) Hierarchical dirichlet processes (HDP)) |
Average AUCs obtained from 5 fold cross validation Age, sex consultation code, medication, referrals, lab result, and text/consultation notes—UMLS coding Regular counts = 0.896 (0.882–0.910)a Temporal patterns plus regular counts = 0.900 (0.886–0.914)a |
NR | NR | NR | NR |
Johansen 201569 (development) | Age Sex CEA Serum YKL-40 |
Logistic regression | 0.81 (NR) | NR | NR | NR | NR |
Koning 201552 (development) | Age Sex Hypertension Abdominal pain |
Logistic regression | CRC + Adenoma = 0.65 (NR) | NR | NR | NR | NR |
Kop 201553 (development) | Based on model Non-temporal model Temporal model All (non-temporal + temporal + age/sex) Knowledge driven (Bristol–Birmingham equation + age/sex) Age/sex only |
Machine learning (Four methods used, logistic regression, random forest, support vector modelling and classification and regression trees; 5 fold cross-validation) | Random forest provided the most accurate model Knowledge driven = 0.896 (0.88–0.912)a |
NR | NR | NR | NR |
Kop 201654 (development) | Temporal pattern with succession relationships (s). Top five predictors: Drugs for constipation Iron deficiency anaemia Lipid modifying agents (s) Drugs for constipation Age Drugs for acid related disorders (s) Drugs for constipation |
Machine learning (Three methods used, logistic regression, random forest, and classification and regression trees; 5 fold cross-validation) | Logistic regression Age/sex, Bristol–Birmingham equation + like category = 0.891 (0.879–0.903)a Extra step of “various steps of the regular pipeline” did not change AUC. |
NR | NR | NR | NR |
Law 201433 (development) | Age Sex Ethnicity Education level Smoking status Family history of colorectal polyps Family history of colitis Family history of any cancer Family history of colorectal cancer Medication history—NSAID, aspirin, anti-diabetic, and iron tablets Symptom history—abdominal pain, pain on defection, CIBH, jelly-like stool, anal irritation, itch and swelling General symptoms—loss of appetite, weight loss, tiredness |
Logistic regression (internal validation by cross-validation) | CRC Adjusted model = 0.83 (cross-validation = 0.79) Score based model = 0.83 (cross-validation = 0.83) CRC + AA Adjusted model = 0.76 (cross-validation = 0.73) Score based model = 0.76 (cross-validation = 0.75) |
Score CRC 5+ = 99.1 10+ = 86.4 15+ = 47.4 17+ = 34.2 CRC + AA 5+ = 85.7 10+ = 39.4 12+ = 22.9 |
Score CRC 5+ = 15.6 10+ = 63.9 15+ = 90.9 17+ = 96.3 CRC + AA 5+ = 49.3 10+ = 89.7 12+ = 96.9 |
Score CRC 5+ = 13 10+ = 23.3 15+ = 39.7 17+ = 54.2 CRC + AA 5+ = 26.1 10+ = 44.5 12+ = 60.6 |
Score CRC 5+ = 99.3 10+ = 97.5 15+ = 93.2 17+ = 92 CRC + AA 5+ = 94.3 10+ = 87.6 12+ = 85.7 |
Liu 202155 (development and validation) | Biomarkers: Septin 9 (SEPT9) Syndecan 2 (SDC2) Secreted frizzled-related protein 2 (SFRP2) |
Logistic regression | Development = 0.931 (NR) Validation = 0.927 (NR) Testing = 0.937 (NR) |
Testing = 94.1 (NR) | Testing = 89.2 (NR) | NR | NR |
Marshall 201156 (development and validation; Bristol–Birmingham equation and CAPER score) | Constipation Diarrhoea Change in bowel habit Abdominal pain Weight loss Rectal bleeding Hb concentration Mean cell volume |
Logistic regression | Development = 0.83 (0.82–0.84) Validation = 0.92 (0.91–0.94) CAPER scoreb Development = 0.91 (0.89–0.93) Validation = 0.79 (0.79–0.8) |
NR | NR | NR | NR |
Nemlander 2023a78 (development and validation) | Unclear; 16 most important variables were: Iron deficiency anaemia other diseases of anus and rectum Abdominal and pelvic pain Other anaemias Haemorrhoids and perianal venous thrombosis CIBH number of consultations during the year before the index date other and unspecified non-infective gastroenteritis and colitis Melaena Haemorrhage of anus and rectum gastrointestinal haemorrhage, unspecified Benign neoplasm of colon, rectum, anus and anal canal Nausea and vomiting Other diseases of digestive system Other and unspecified soft tissue disorders, not elsewhere classified Essential primary hypertension |
Stochastic gradient boosting applied to classification decision trees | Validation = 0.83 (0.79–0.87) | 73.3 (NR) | 83.5 (NR) | NR | NR |
Nemlander 2023b84 (PPV; validation) | Validation of Swedish Colorectal Cancer Risk Assessment Tool (SCCRAT) developed by Ewing 2016: CIBH rectal bleeding Weight loss abdominal pain anaemia |
Logistic regression | NR | NR | NR | PPVs > 2.5% All ages and sex CIBH + rectal bleeding = 7.8 (1.9–26.9) CIBH + abdominal pain = 3.1 (1.9–5) CIBH + anaemia = 3.5 (1.8–6.6) rectal bleeding + abdominal pain = 10.7 (1.5–48) rectal bleeding + anaemia = 4.2 (1.6–10.4) weight loss + anaemia = 3.8 (0.8–15.9) |
NR |
Norrelund 199635,c (PPV) | Age Change in bowel habit Patient belief symptoms due to cancer |
Logistic regression | NR | CRC Study 1 Age >69 yrs + CIBH = 44 (NR) Due to cancer + CIBH = 22 (NR) Study 2 new bleeders Age >69 yrs + CIBH = 15 (NR) Due to cancer + CIBH = 0 (NR) Study 2 new or changed bleeders Age >69 yrs + CIBH = 23 (NR) Due to cancer + CIBH = 5 (NR) |
CRC Study 1 Age >69 yrs + CIBH = 94 (NR) Due to cancer + CIBH = 97 (NR) Study 2 new bleeders Age >69 yrs + CIBH = 88 (NR) Due to cancer + CIBH = 95 (NR) Study 2 new or changed bleeders Age >69 yrs + CIBH = 88 (NR) Due to cancer + CIBH = 96 (NR) |
CRC Study 1 Age >69 yrs + CIBH = 56 (NR) Due to cancer + CIBH = 58 (NR) Study 2 new bleeders Age >69 yrs + CIBH = 13 (NR) Due to cancer + CIBH = 0 (NR) Study 2 new or changed bleeders Age >69 yrs + CIBH = 24 (NR) Due to cancer + CIBH = 14 (NR) |
CRC Study 1 Age >69 yrs + CIBH = 90 (NR) Due to cancer + CIBH = 87 (NR) Study 2 new bleeders Age >69 yrs + CIBH = 85 (NR) Due to cancer + CIBH = 87 (NR) Study 2 new or changed bleeders Age >69 yrs + CIBH = 87 (NR) Due to cancer + CIBH = 86 (NR) |
Payne 198337 (PPV) | CEA Leucocyte adherence inhibition |
NA | NA | 91 (NR) | 68 (NR) | 54 (NR) | 95 (NR) |
Rai 200838 (validation; Selva score) | Weighted numerical score (WNS); See Selvachandran 2002. | NR | NR | WNS cut off 40 = 95.2 (NR) WNS cut off 50 = 78.3 (NR) WNS cut off at 60 = 77.1 (NR) WNS cut off at 70 = 63.9 (NR) |
WNS cut off 40 = 36.3 (NR) WNS cut off 50 = 52.7 (NR) WNS cut off at 60 = 68.5 (NR) WNS cut off at 70 = 82.7 (NR) |
WNS cut off 40 = 8.5 (NR) WNS cut off 50 = 10.7 (NR) WNS cut off at 60 = 13.2 (NR) WNS cut off at 70 = 18.9 (NR) |
NR |
Rasmussen 201782 (development) | Age Sex ccfn containing 5-methylcytosine DNA (5 mC) CEA |
Logistic regression (internal validation by cross-validation) | CRC = 0.736 (NR) CRC + HRA = 0.697 (NR) HRA = 0.646 (NR) |
Specificity at 70a CRC = 61.5 CRC + HRA = 57.1 HRA = 48 |
NR | NR | NR |
Rasmussen 202179 (development) | All models include: Age Sex CRC only: Angiopoietin 2 (ANGPT2) Arginase 1 (ARG1) Colony stimulation factor 1 (CSF-1) Galectin 9(Gal-9) Inducible T-cell costimulatory ligand (ICOSLG) Interleukin 8 (IL8) HRA only: T-cell surface glycoprotein 28 (CD28) CRC or HRA: ICOSLG IL8 |
Logistic regression (internal validation by cross-validation) | CRC only = 0.82 (NR) HRA only = 0.61 (NR) CRC or HRA = 0.73 (NR) |
Sensitivity at varying specificities Specificity 70 CRC only = 58 (NR) HRA only = 43 (NR) CRC or HRA = 54 (NR) Specificity 80 CRC only = 39 (NR) HRA only = 31 (NR) CRC or HRA = 36 (NR) Specificity 90 CRC only = 18 (NR) HRA only = 13 (NR) CRC or HRA = 18 (NR) |
NR | NR | NR |
Selvachandran 200241 (Development; Selva score) | Weighted numerical score Age Sex Blood per rectum Change in bowel habit Tenesmus, urgency, and incomplete emptying Perianal symptoms Abdominal symptoms Weight loss Loss of appetite Tiredness Family history (unspecified) Relevant medical history |
NR | 0.859 (SE = 0.024) | 40+ = 99 (NR) 50+ = 91 (NR) 60+ = 76 (NR) 70+ = 70 (NR) |
40+ = 46 (NR) 50+ = 62 (NR) 60+ = 78 (NR) 70+ = 88 (NR) |
NR | NR |
Simpkins 201742 (PPV) | Combinations stratified by age (only those with 2 symptoms are reported here) Weight loss Abdominal pain Rectal bleeding Change in bowel habit Anaemia |
NA | NA | ≥40 years old + weight loss + abdominal pain = 32.6 (20.5–47.5) ≥50 years old + rectal bleeding + abdominal pain = 12.8 (6–25.2) <50 years old + rectal bleeding + CIBH = 10.6 (4.6–22.6) <50 years old + rectal bleeding + weight loss = 12.8 (6–25.2) <50 years old + rectal bleeding + anaemia = 2.2 (0.4–11.3) |
≥40 years old + weight loss + abdominal pain = 87.1 (85.5–88.5) ≥50 years old + rectal bleeding + abdominal pain = 82 (80.2–83.7) <50 years old + rectal bleeding + CIBH = 87.5 (86–88.9) <50 years old + rectal bleeding + weight loss = 91.4 (90.1–92.6) <50 years old + rectal bleeding + anaemia = 93.6 (92.5–94.7) |
≥40 years old + weight loss + abdominal pain = 5.4 (3.3–8.9) ≥50 years old + rectal bleeding + abdominal pain = 1.7 (0.8–3.7) <50 years old + rectal bleeding + CIBH = 2 (0.9–4.7) <50 years old + rectal bleeding + weight loss = 3.8 (1.7–7.9) <50 years old + rectal bleeding + anaemia = 0.8 (0.1–4.5) |
≥40 years old + weight loss + abdominal pain = 98.3 (97.5–98.8) ≥50 years old + rectal bleeding + abdominal pain = 97.5 (96.6–98.1) <50 years old + rectal bleeding + CIBH = 97.6 (96.7–98.2) <50 years old + rectal bleeding + weight loss = 97.7 (96.9–98.3) <50 years old + rectal bleeding + anaemia = 97.5 (96.7–98.1) |
Stapley 201780 (PPV) | Diarrhoea Abdominal pain Rectal bleeding Change in bowel habit Constipation Nausea/vomiting Rectal mass Raised inflammatory markers (erythrocyte sedimentation rate, CRP, or plasma viscosity) |
Logistic regression (Assessed strength of associations between clinical features and CRC) | NA | NR | NR | PPVs >5% Rectal mass + bleeding = 17 + CIBH = 6.3 + constipation = 6.1 + diarrhoea = 5.1 + abdominal pain = 7 + low Hb = 5.6 + raised inflammatory markers = 7 Rectal bleeding + constipation = 5.8 + low Hb = 13 + low mean red cell volume = 8 CIBH + diarrhoea = 6.1 + low Hb = 5.1 Constipation + low mean red cell volume = 5.1 |
NR |
Steffen 201472 (development and validation) | Age Sex BMI Diabetes Ever had CRC screening Smoking status Alcoholic drinks per day |
Cox's proportional hazards regression | Development = 0.73 (0.72–0.74) Validation = 0.7 (0.66–0.73) |
NR | NR | NR | NR |
Thompson 201757 (development and validation) | Age Sex Change in bowel habit Rectal bleeding Abdominal pain/discomfort Perianal symptoms Rectal mass Abdominal mass Iron deficiency anaemia Change in weight (loss or gain) |
Logistic regression | Development = 0.87 (0.85–0.88) Validation = 0.86 (0.84–0.87) |
23⋅9% when the probability of bowel cancer was over 50% 38⋅3% with a 20% probability of bowel cancer |
99⋅3% when the probability of bowel cancer was over 50% 97⋅1% with a 20% probability of bowel cancer |
NR | NR |
Wells 201473 (development) | Split by male and female: Age Ethnicity BMI Red meat intake per day (male only) Aspirin use (male only) Physical activity hours per day (male only) NSAID use (female only) Oestrogen use (female only) Pack years smoking History of diabetes Years of education Alcoholic drinks per day Family history of CRC Multivitamin use |
Logistic regression (10-fold cross validation) | Men = 0.681 (0.669–0.694) Women = 0.679 (0.665–0.692) Results presented only after internal validation. |
NR | NR | NR | NR |
Whitfield 201858 (development and validation) | Age Indication of bleeding Minimum mean corpuscular Hb Minimum ferritin Median white blood cell count Median platelet count |
Logistic regression | Development = 0.779 (NR) Validation = 0.727 (NR) |
NR | NR | NR | NR |
Wilhelmsen 201739 (development) | Model 1 (full model) Age Sex AFP Ca19-9 CEA Galectin-3 CyFra21-1 Ferritin Hs-CRP TIMP-1 Model 2 (reduced model) Age Sex CEA CyFra21-1 Ferritin Hs-CRP |
Logistic regression | Model 1 CRC = 0.84 (NR) CRC + HRA = 0.76 (NR) Model 2 CRC = 0.83 (NR) CRC + HRA = 0.74 (NR) |
CRC 90 80 70 60 CRC + HRA 90 80 70 60 Reported at varying sensitivities; values are reported in line with sensitivity |
CRC 33 50 66 75 CRC + HRA 48 66 81 89 |
CRC 25 29 34 37 CRC + HRA 18 23 31 41 |
CRC 93 91 90 88 CRC + HRA 97 96 95 95 |
Wilhelmsen 201874 (development) | Model 1 (full model) Age Sex Pepsinogen 2 Huma epidermis antigen 4 (HE4) hs-CRP CEA Ferritin CyFra21-1 Model 2 (reduced model) Age Sex HE4 CEA CyFra21-1 |
Logistic regression | Model 1 = 0.84 (NR) Model 2 = 0.82 (NR) |
NR | NR | NR | NR |
Wilson 201259 (development) | Age Sex Weight loss Blood in stools Harder stools Anal pain/soreness White blood cell count Smoking history Alcohol history Hypertension Serum Matrix Metalloproteinase 9 (MMP9) |
Logistic regression (two-stage process; cut-off of 0.05 on predicted probability of neoplasia, all patients who were positive from this process re-entered for a second stage using the same cut-off) | Stage 1 = 0.77 (NR) Stage 2 = 0.73 (NR) |
Stage 1 = 79% Stage 2 = NR Combined stage 1 & 2 = 79% |
Stage 1 = 63% Stage 2 = NR Combined stage 1 & 2 = 70% |
NR | NR |
CRC = Colorectal Cancer; AA = Advanced Adenoma; HRA = High Risk Adenoma; ACN = Advanced Colorectal Neoplasia; NR = Not Reported; NA = Not Applicable; CI = Confidence Interval; AUC = Area Under the Curve; CEA = Carcinoembryonic Antigen; NSAIDs = Non-steroidal anti-inflammatory drugs; IBS = Irritable Bowel Syndrome; CIBH = Change in Bowel Habit; GI = Gastrointestinal; BMI = Body Mass Index; MCH = Mean cell haemoglobin; CRP = C-reactive protein; SE = Standard Error.
Most accurate model presented.
CAPER development is from original dataset and validation is the THIN database used in Marshal 2011.
Presents two studies, second study refers to new or changed bleeders.
Non-FIT models assessing CRC
Twenty-seven studies reported discriminatory ability of models including a diverse range of variables with the aim of predicting CRC (see Fig. 4).27,28,29,33,39,41,47,48,50,53,56,57,58,59,61,62,66,69,73,74,75,76,78,79,82
Biomarker-based models
Twelve studies reported on models that included one or more tests from routine blood panels or biomarkers.37,39,48,55,59,62,69,74, 75, 76,79,82 The most commonly reported biomarker was carcinoembryonic antigen (CEA; n = 8, three of which had a case–control design).37,39,48,69,74, 75, 76,82 One study assessed the combination of Golgi protein-73 and CEA and reported high discriminatory ability for CRC (AUC = 0.98); but the study included only 90 people and had a case–control design.75 Two studies reported development of models, with no validation, for combinations of other biomarkers (see Table 3).79,82 Three further studies developed and externally validated various biomarker combinations, without including sex and age as factors.48,55,76 All three showed good discriminatory ability for CRC in Danish (AUC = 0.82 and 0.86),48,76 Chinese (AUC = 0.94)55 and patients. Finally, one study that only provided accuracy measures, suggested combining CEA and leucocyte adherence inhibition had a high PPV (54%) for CRC.37 All of these studies were rated as high risk of bias, mainly due to concerns regarding analysis (e.g. lack of appropriate calibration). Four other studies reported varying accuracy in development models using multiple different biomarkers combined with age and sex but did not externally validate results.39,69,74,82
Demographics, symptoms, and medical history-based models
The Bristol–Birmingham (BB) equation was developed and validated using the UK THIN primary care database, identifying multiple symptoms and providing one of the highest discrimination values for CRC (AUC = 0.92).56 However, there were some concerns regarding the identification and applicability of the outcome in the risk of bias assessment. The BB equation was validated within the study and compared against the CAPER (Cancer Prediction in Exeter) score, suggesting it was superior in identifying CRC (validation AUC = 0.79).56
One study developed and validated a model using change in bowel habit (CIBH) and weight loss, although patients must have presented with rectal bleeding.29 Only the validation AUC was reported; this suggested good discrimination for CRC (0.88). Another study that utilised a combination of demographics, symptoms and iron deficiency anaemia suggested good discriminatory ability for CRC in development (AUC = 0.87) and validation (AUC = 0.86) cohorts.57 However, there were concerns regarding the handling of missing data in the analysis, which were coded as absent/missing and meant the predictive value of symptoms may have been overestimated.
A study in Australian patients developed and validated a model using demographics, lifestyle, and past medical history factors for prediction of CRC and colon and rectal cancers separately.72 While the model showed moderate discrimination for all three outcomes in development, and the CRC and colon models maintained adequate discrimination after validation (AUC = 0.7 and 0.72, respectively), the discrimination for rectal cancer was less than adequate after validation (AUC = 0.64).
Two development studies combined medical history, demographics, symptoms and haematological tests, providing good discriminatory ability for CRC (AUC ≥0.83).27,28 Another development model utilised age and sex with CIBH (excluding constipation) and the presence of blood in stool with age and sex and demonstrated good discriminatory ability for CRC (AUC = 0.97).64 An issue of applicability was present in this study; rectal bleeding was a pre-requisite for inclusion.64 Only one of these four studies provided some form of validation (internal).27
Scored-based models
Three papers reported development41 and validation38,61 of a weighted numerical score (also known as the Selva score), which combines demographics, history and symptoms, for CRC prediction. The results suggested a good to moderate discriminatory ability (AUC development = 0.86,41 validation = 0.76)61 in a secondary care setting. A similar score-based model—incorporating age, indication of bleeding, minimum MCH, minimum ferritin, median WBC, and median platelet count–was reported to have adequate discrimination after validation (AUC = 0.73), but was only available as a conference abstract so detail was limited.58 Each of these studies were rated as having a high risk of bias, mainly due to reporting of analysis. One study (of the Selva score) also had concerns regarding patient and outcome applicability.41
The QCancer for CRC risk was developed and validated using the UK QResearch database.47,66 This algorithm, included demographics, history, and symptoms, with some factors only considered for males and some only for females (Table 3).47,66 Results suggested good discriminatory ability for CRC (AUC = 0.91 for men and 0.89 women). Net benefit analysis showed QCancer to be better than an “investigate all” or “investigate none” approach.47 Additionally, the validation study was rated as low risk of bias, only one of two studies to attain this rating.47,73 The other study that attained a low risk of bias was similar to the QCancer algorithm, utilising historical variables to assess male and female risk separately; however, only internal validation was performed and the AUC indicated less than adequate discrimination (0.68).73 Another study developed a score-based algorithm with an array of factors (see Table 3), reporting good discriminatory ability for CRC (AUC = 0.83).33
Machine learning models using GP records
Four studies applied machine learning techniques to medical notes (e.g. GP records).50,53,54 All three models, which were developed in Dutch patients’ records, showed good discrimination for CRC (AUC range = 0.81–0.9). One of these studies utilised the BB equation to aid the development of their most accurate model.53 Another study explicitly focused on non-metastatic CRC using a case–control study design (Swedish cancer registry) to create a model using multiple symptoms and medical history, reporting good discriminatory ability (validation AUC = 0.83).78 There were major concerns regarding these studies and how they identified predictors and outcomes. All studies utilised medical records from their respective countries; three from the Netherlands,50,53,54 and one from Sweden,78 which could limit their.
PPV studies
Eight studies assessed PPV for CRC of combinations of symptoms or haematological tests (Table 3).31,35,37,42,62,77,78,80 The most commonly considered symptoms were rectal bleeding (n = 5),31,42,77,80,83 CIBH (n = 5),31,35,42,80,83 and abdominal pain (n = 4).31,42,77,83 The PPVs varied depending on the combinations of symptoms, with highest PPVs for symptoms alone being for rectal mass and bleeding (17% for CRC).80 All of these studies were rated as high risk of bias, due to analysis concerns and issues of predictor selection80,83 and outcome definitions.35,77,83 Nemlander and colleagues 2023b84 validated the symptom combinations used by Ewing and colleagues,83 in a separate Swedish population with a focus on non-metastatic CRC and found similar PPVs, for example CIBH and rectal bleeding PPVs were 7.8% and 13.7%, rectal bleeding and abdominal pain were 10.7% and 12.2%, respectively.
Non-FIT models assessing CRC and ACP/ACN or colorectal neoplasia alone
Eleven studies reported discriminatory ability of varying models for the identification of other outcomes (e.g. AA) alone or in combination with CRC (see Fig. 4).28,33,39,52,55,59,64,76,79,82
One study assessed the combination of several biomarkers for prediction of AA and reported poor discriminatory ability after validation (Table 3; AUC = 0.65).76 There were concerns about how the predictors where determined. Four other studies combined demographic information (e.g. age) and/or various biomarkers.39,76,79,82 Poor discriminatory ability was observed when assessing only AA (AUC = 0.65)76 and HRAs (AUC = 0.61–0.65).79,82 Discriminatory ability improved when attempting to predict CRC and HRA (AUC = 0.7–0.76).39,79,82 However, poor results were observed for the combination of age, sex, hypertension and abdominal pain for the prediction of CRC and adenoma (AUC = 0.65).52 One study assessed a single biomarker (serum matrix metalloproteinase 9) with age, sex, symptoms, white blood cell count, lifestyle factors and hypertension, and reported adequate discrimination for the prediction of colorectal neoplasia (defined as presence of adenocarcinoma or HRA) (internal validation AUC = 0.73),59 but did not undertake external validation.
One development study combined medical history, demographics, symptoms and haematological tests, providing and adequate discrimination ability for AA (AUC = 0.7).28 A similar study, utilising demographics, history (e.g. family, medication), and symptoms, also reported adequate ability for CRC and AA combined (AUC = 0.76).33 One study, including hypertension and abdominal pain, had poor discrimination for CRC and adenoma prediction (AUC = 0.65).52
One study reported an adjusted model (AUC = 0.73; cross-validation) and a score-based model (AUC = 0.75; cross-validation) combining demographics, family and medical history, and symptoms for the prediction of CRC and AA.33 Calibration was lacking. The highest recorded discriminatory ability for a combined outcome (in this case polyps and CRC) was reported by combining age, sex, blood mixed in stool and CIBH (AUC = 0.92).64 However, there were concerns regarding the participants, outcome identification, analysis, and the applicability of the study.
Discussion
This systematic review identified 62 studies assessing risk prediction models for CRC and/or ACP in symptomatic patients. Of these, 23 assessed models containing tests for blood in stool (21 FIT-based; one gFOBT-based) and 39 assessed non-FIT/gFOBT based models. Twenty-one of the 62 studies were conducted solely in primary care populations. Overall, the evidence suggests prediction models including FIT consistently have good accuracy and discriminatory ability (i.e. AUC > 0.8).
Some models that did not include FIT also had high levels of accuracy and discrimination, but this was not a consistent finding. In addition, eight of the studies assessing non-FIT predictive models had a case–control study design,62,75, 76, 77, 78, 79, 80 which could have overestimated model usefulness. Models, irrespective of whether they included FIT, generally had higher discriminatory ability for CRC than for CRC combined with ACP or ACP alone. For example, the FAST score (FIT, age, and sex) reported AUC of 0.91 for CRC compared to 0.79 for advanced neoplasia in external validation.18 Of note, only two studies in this review had a low risk of bias; neither of those models included FIT.47,73 Moreover, several of the studies (n = 15) which reported AUC or similar measures did not report measures of dispersion. The majority of these were non-FIT models (n = 13).
FIT-based models varied in what other variables they included and, by and large, the number of included variables was unrelated to model performance. This, and the heterogeneity in the variables included, means that it is not possible to recommend to those developing such models on variables they might consider including (with the exception of sex, which is discussed further below). Some FIT-based models (such as the FAST score) contained a small number of simple additional variables which, other issues notwithstanding, would suggest they could fairly easily be implemented in routine clinical practice. In comparison, others, such as COLONPREDICT, which reported similar discriminatory ability for CRC (AUC = 0.92) to the FAST score, utilised eleven variables. Furthermore, the COLONOFIT model required three stool samples for calculation, which would require considerable effort to manage in routine clinical practice, including complex safety-netting should patients not provide all samples required. Simple combinations of tests also showed promising results; for example, FIT and faecal calprotectin was explored in several studies and showed some promise as a predictive test, with good discriminatory ability for CRC and HRA. However, no validation was performed in these studies.43, 44, 45
While FIT-based models generally performed well, there were variations in the cut-off for defining a “positive” FIT across the models, with no single cut-off most favoured. Sometimes this was because of limitations in the analytical performance of the test (e.g. unable to detect below a certain level). The lack of certainty around the optimum cut-off for FIT in models reported to date, and concerns around comparability of different tests in the symptomatic setting,91 has implications for comparison of findings across studies and settings, though this is somewhat averted by studies using FIT as a continuous variable in their modelling. It also has implications for future implementation in that it was not possible to reach a conclusion on which cut-off should be preferred in practice; this remains to be established.
A number of models utilising biomarkers combined with FIT or gFOBT (n = 5)34,36,45,65,70 or other factors excluding FIT (n = 13)37,39,48,55,58,59,62,69,74,76,79,80,82 were identified. However, most of these studies had no form of validation. Commonly, such biomarker studies assessed two or more biomarkers either alone or in conjunction with age and sex. The main concern with these models was that many of the biomarkers assessed are not readily available in a clinical setting, having not progressed beyond the research arena. For example, one biomarker model included Septin 9 (SEPT9), Syndecan 2 (SDC2) and Secreted frizzled-related protein 2 (SFRP2), which are not routinely available.55 The feasibility of using such models is currently low.
Many models included sex as a predictive factor while some, such as the QCancer for CRC risk, went further and utilised different variables for males and females.66 The QCancer model was the only model to present a net-benefit of using the model: this suggested it was more accurate than the (unrealistic) scenarios of “test nobody” or “test everyone”. The attraction of sex-stratified models is clear given the higher incidence rate of CRC in males than females1 but the acceptability to patients, health professionals and health service decision-makers of different referral algorithms by sex requires investigation.
An important factor to consider when evaluating the potential utility of a risk prediction model is the setting for potential use. For example, three models that applied machine learning techniques to medical notes were developed in Dutch patients’ records and, although the studies showed good discriminatory ability, it is not known if these models are applicable in other healthcare systems, where medical documentation styles may differ.50,53,54 Such models require further external validation to demonstrate their generalisability to other data outside that used to develop the model. Related to this, few of the studies reported the ethnicity of the individuals in the population(s) in which they developed or validated their models. Therefore, an important caveat on the conclusions of the review is that, while some models perform well (and are validated), it is generally uncertain how they would perform in a population with a very different ethnic make-up.
In this review we also included studies where the outcome measure was PPV for combinations of variables; the rationale for this was our desire to provide a comprehensive overview of the current state of the evidence-base. All of these studies were classed as high risk of bias as PPV (a measure of diagnostic accuracy) is not considered to be an adequate outcome measure for risk prediction models, though is widely used by clinicians and policy makers. These studies were included because previous UK guidance for investigation of symptomatic patients has been based on PPVs.92 Studies without FIT presented an array of different symptom combinations and identified some combinations with a high predictive value (e.g. rectal mass and bleeding had a PPV of 17% in one study).80 Those which included FIT generally combined it with other blood or stool test results (e.g. faecal calprotectin, iron deficiency) and mostly reported high PPVs. Given these findings, and the fact that some of these other test results would either be available routinely as part of primary care blood panels or could be assessed in stool samples, future work assessing calibration and validation of models including FIT, other standard blood/stool test results and, potentially, combinations of symptoms, is warranted.
This review was conducted using a comprehensive search strategy, developed in combination with an information specialist, and utilised rigorous systematic review methodology. By focussing on risk prediction models published up to 2023, it both updates and extends a past systematic review on this topic (which included papers published to March 2014)93 and the systematic review that informed the 2022 British Society of Gastroenterology/Association of Coloproctology of Great Britain and Ireland guidance on use of FIT in symptomatic patients, which focussed on diagnostic accuracy studies.94 However, there are some limitations. Firstly, we excluded non-English language studies. While this, in theory, may have introduced some selection bias, research suggests that the chances of this are low.95 Secondly, we did not perform data extraction in blinded duplicate: this could increase data extractions errors. However, a second reviewer assessed the data extraction for accuracy minimising or eliminating such error. Thirdly, studies utilising primary care databases/cancer registries to identify CRC diagnoses were considered eligible for inclusion unless it was explicitly stated that the study population included asymptomatic or screening patients. The rationale for this was two-fold: firstly, the review sought to be comprehensive and excluding these studies would have limited scope and introduced an element of selection bias and, secondly, in primary care, most CRCs are diagnosed through symptomatic services (even in settings with well-organised population-based screening programmes). However, it is possible these studies may have included a small proportion of asymptomatic patients. Fourthly, we included studies with a case–control design; while this was in order to be comprehensive, such studies may be more prone to bias and can over-estimate model usefulness. These limitations were reflected in the risk of bias assessment for the relevant studies. Also considered in the risk of bias assessment was the method of investigation for neoplasia. Method of identification for the outcome of interest (i.e. CRC and/or ACN) varied. While many studies utilised colonoscopy alone (n = 25), some studies utilised varying methods of identification (e.g. sigmoidoscopy; n = 20) or used a database/registry without providing clarification as to how the outcome was identified in those patients (n = 15). While colonoscopy would generally be considered gold-standard, studies with varying methods of identification were included to reflect real-world practice, but it is possible that model performance may have varied if colonoscopy had been used.
This review was undertaken within a programme of work (COLOFIT) intended to inform optimal use of a FIT-based strategy for managing referral of patients with possible CRC symptoms presenting to primary care in NHS England (https://fundingawards.nihr.ac.uk/award/NIHR133852). The review findings suggest several recommendations for future research on risk prediction models for colorectal neoplasia in symptomatic patients; while some of these will be addressed in COLOFIT, they have internationally applicability. While it may seem obvious, to rigorously evaluate the likely performance of a model, it should be assessed in the population that is the intended target of the algorithm (here, most often, primary care populations); secondary or tertiary care populations are generally enriched for CRC/ACP making models potentially non-generalisable to primary care populations. Ideally, the ethnic composition of the population should be reported. Adequate validation should be undertaken, at a minimum internal validation, though ideally external. Authors should report all available data, including calibration plots and measures of dispersion for AUC, and consider conducting a net-benefit analysis to assess likely model effectiveness and compare their model to existing pathways. If including FIT, if possible, authors should report performance for different cut-offs and, if including symptoms, understanding the predictive value of individual symptoms would be valuable. As is evident from this review, many models have now been developed. However, the lack of data on net-benefit in appropriate target populations and external validation is a significant impediment to their wider implementation. Finally, real world studies of the impact of the use of prediction models on clinical decision-making and patient outcomes are urgently required.96
The use of FIT in the symptomatic setting has significantly increased over recent years and, in some settings, guidance now advocates FIT for use in patients with features of possible CRC to guide referral for urgent investigation. This review shows that there is considerable promise for the use of risk prediction models, both FIT-based and non-FIT based, in identifying those most at risk of colorectal neoplasia. However, there are significant limitations in the evidence base, notably around the lack of net-benefit analysis and external validation, and the real-world impact of such algorithms is not yet understood.
Contributors
James S Hampton (JSH) and Ryan PW Kenny (RPWK) co-authored the first draft of the review protocol, contributed to development of the search strategy, undertook the screening and selection of articles, extracted data, synthesised results and co-authored the first draft of the manuscript.
Claire Eastaugh (CE) and Catherine Richmond (CR) provided expertise in developing and performing the searches and approved final manuscript for submission.
Colin J Rees (CJR) had the idea for the review, secured funding, edited and approved review protocol, contributed to development of the search strategy, edited and approved final manuscript for submission.
William Hamilton (WH) had the idea for the review, secured funding, edited and approved review protocol, contributed to development of the search strategy, edited and approved final manuscript for submission.
Linda Sharp (LS) had the idea for the review, secured funding, edited and approved review protocol, contributed to development of the search strategy, arbitrated any conflicts in the study selection process, edited and approved final manuscript for submission.
JSH and RPWK accessed and verified the data. LS, CJR and WH made the decision to submit the manuscript for publication.
Data sharing statement
All of the relevant data is contained within the manuscript and Supplementary material.
Declaration of interests
JSH, RPK, CE, CR, WH declare no competing interests. CJR has received grant funding from ARC medical, Norgine. Medtronic, 3D Matrix solutions and Olympus medical. He was an expert witness for ARC medical and Olympus medical. LS holds grant funding from Medtronic and 3D Matrix.
Acknowledgements
This project was funded by the National Institute for Health and Care Research (NIHR) [Health Technology Assessment (HTA) Programme (Project number 133852); awarded to CJR, WH & LS] and will be published in full in the HTA journal. Further information is available at: [https://fundingawards.nihr.ac.uk/award/NIHR133852]. The views expressed are those of the authors and not necessarily those of the NIHR or Department of Health and Social Care.
We thank Fiona Pearson for her input at the early stages of framing the review and developing the searches.
Footnotes
Supplementary data related to this article can be found at https://doi.org/10.1016/j.eclinm.2023.102204.
Appendix A. Supplementary data
References
- 1.Sung H., Ferlay J., Siegel R.L., et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2021;71(3):209–249. doi: 10.3322/caac.21660. [DOI] [PubMed] [Google Scholar]
- 2.Morgan E., Melina A., Gini A., et al. Global burden of colorectal cancer in 2020 and 2040: incidence and mortality estimates from GLOBOCAN. Gut. 2023;72(2):338. doi: 10.1136/gutjnl-2022-327736. [DOI] [PubMed] [Google Scholar]
- 3.Keum N., Giovannucci E. Global burden of colorectal cancer: emerging trends, risk factors and prevention strategies. Nat Rev Gastroenterol Hepatol. 2019;16(12):713–732. doi: 10.1038/s41575-019-0189-8. [DOI] [PubMed] [Google Scholar]
- 4.East J.E., Atkin W.S., Bateman A.C., et al. British Society of Gastroenterology position statement on serrated polyps in the colon and rectum. Gut. 2017;66(7):1181–1196. doi: 10.1136/gutjnl-2017-314005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Leslie A., Carey F.A., Pratt N.R., Steele R.J.C. The colorectal adenoma-carcinoma sequence. Br J Surg. 2002;89:845–860. doi: 10.1046/j.1365-2168.2002.02120.x. [DOI] [PubMed] [Google Scholar]
- 6.Lauby-Secretan B., Vilahur N., Bianchini F., Guha N., Straif K. The IARC perspective on colorectal cancer screening. N Engl J Med. 2018;378(18):1734–1740. doi: 10.1056/NEJMsr1714643. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.White A., Ironmonger L., Steele R.J.C., Ormiston-Smith N., Crawford C., Seims A. A review of sex-related differences in colorectal cancer incidence, screening uptake, routes to diagnosis, cancer stage and survival in the UK. BMC Cancer. 2018;18(1):906. doi: 10.1186/s12885-018-4786-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Majumdar S.R., Fletcher R.H., Evans A.T. How does colorectal cancer present? Symptoms, duration, and clues to location. Am J Gastroenterol. 1999;94(10) doi: 10.1111/j.1572-0241.1999.01454.x. [DOI] [PubMed] [Google Scholar]
- 9.Rees C.J., Thomas Gibson S., Rutter M.D., et al. UK key performance indicators and quality assurance standards for colonoscopy. Gut. 2016;65(12):1923–1929. doi: 10.1136/gutjnl-2016-312044. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Gavin D.R., Valori R.M., Anderson J.T., Donnelly M.T., Williams J.G., Swarbrick E.T. The national colonoscopy audit: a nationwide assessment of the quality and safety of colonoscopy in the UK. Gut. 2013;62(2):242–249. doi: 10.1136/gutjnl-2011-301848. [DOI] [PubMed] [Google Scholar]
- 11.Laura J.N., Joanne P., von Wagner C., et al. Patient experience of gastrointestinal endoscopy: informing the development of the Newcastle ENDOPREM™. Frontline Gastroenterol. 2020;11(3):209. doi: 10.1136/flgastro-2019-101321. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Intelligence CfW . 2017. Securing the future workforce supply: gastrointestinal endoscopy workforce review. [Google Scholar]
- 13.Ravindran S., Bassett P., Shaw T., et al. National census of UK endoscopy services in 2019. Frontline Gastroenterol. 2020;12 doi: 10.1136/flgastro-2020-101538. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Souza N., Theo Georgiou D., Michelle C., Sally B., Muti A. Faecal immunochemical test is superior to symptoms in predicting pathology in patients with suspected colorectal cancer symptoms referred on a 2WW pathway: a diagnostic accuracy study. Gut. 2021;70(6):1130. doi: 10.1136/gutjnl-2020-321956. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Khan A.A., Klimovskij M., Harshen R. Accuracy of faecal immunochemical testing in patients with symptomatic colorectal cancer. BJS Open. 2020;4(6):1180–1188. doi: 10.1002/bjs5.50346. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Monahan K.J., Davies M.M., Abulafi M., et al. Faecal immunochemical testing (FIT) in patients with signs or symptoms of suspected colorectal cancer (CRC): a joint guideline from the Association of Coloproctology of Great Britain and Ireland (ACPGBI) and the British Society of Gastroenterology (BSG) Gut. 2022;71 doi: 10.1136/gutjnl-2022-327985. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Hull M.A., Rees C.J., Sharp L., Koo S. A risk-stratified approach to colorectal cancer prevention and diagnosis. Nat Rev Gastroenterol Hepatol. 2020;17(12):773–780. doi: 10.1038/s41575-020-00368-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Cubiella J., Digby J., Rodriguez-Alonso L., et al. The fecal hemoglobin concentration, age and sex test score: development and external validation of a simple prediction tool for colorectal cancer detection in symptomatic patients. Int J Cancer. 2017;140(10):2201–2211. doi: 10.1002/ijc.30639. [DOI] [PubMed] [Google Scholar]
- 19.Cubiella J., Vega P., Salve M., et al. Development and external validation of a faecal immunochemical test-based prediction model for colorectal cancer detection in symptomatic patients. BMC Med. 2016;14(1):128. doi: 10.1186/s12916-016-0668-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Page M.J., McKenzie J.E., Bossuyt P.M., et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi: 10.1136/bmj.n71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Debray T.P.A., Damen J.A.A.G., Snell K.I.E., et al. A guide to systematic review and meta-analysis of prediction model performance. BMJ. 2017;356:i6460. doi: 10.1136/bmj.i6460. [DOI] [PubMed] [Google Scholar]
- 22.Geersing G.-J., Bouwmeester W., Zuithoff P., Spijker R., Leeflang M., Moons K. Search filters for finding prognostic and diagnostic prediction studies in Medline to enhance systematic reviews. PLoS One. 2012;7(2) doi: 10.1371/journal.pone.0032844. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Ouzzani M., Hammady H., Fedorowicz Z., Elmagarmid A. Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. doi: 10.1186/s13643-016-0384-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Moons K.G.M., de Groot J.A.H., Bouwmeester W., et al. Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist. PLoS Med. 2014;11(10) doi: 10.1371/journal.pmed.1001744. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Moons K.G.M., Wolff R.F., Riley R.D., et al. PROBAST: a tool to assess risk of bias and applicability of prediction model studies: explanation and elaboration. Ann Intern Med. 2019;170(1):W1–W33. doi: 10.7326/M18-1377. [DOI] [PubMed] [Google Scholar]
- 26.Campbell M., McKenzie J.E., Sowden A., et al. Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline. BMJ. 2020;368:l6890. doi: 10.1136/bmj.l6890. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Adelstein B.A., Irwig L., Macaskill P., Turner R.M., Chan S.F., Katelaris P.H. Who needs colonoscopy to identify colorectal cancer? Bowel symptoms do not add substantially to age and other medical history. Aliment Pharmacol Ther. 2010;32(2):270–281. doi: 10.1111/j.1365-2036.2010.04344.x. [DOI] [PubMed] [Google Scholar]
- 28.Adelstein B.A., Macaskill P., Turner R.M., Katelaris P.H., Irwig L. The value of age and medical history for predicting colorectal cancer and adenomas in people referred for colonoscopy. BMC Gastroenterol. 2011;11:97. doi: 10.1186/1471-230X-11-97. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Alatise O.I., Ayandipo O.O., Adeyeye A., et al. A symptom-based model to predict colorectal cancer in low-resource countries: results from a prospective study of patients at high risk for colorectal cancer. Cancer. 2018;124:2766–2773. doi: 10.1002/cncr.31399. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Cama R., Kapoor N., Zacharopoulou L., et al. Faecal immunochemical test, fast score or NG12 criteria for detection of cancer. Gut. 2021;70(SUPPL 4):A162. [Google Scholar]
- 31.Ellis B.G., Thompson M.R. Factors identifying higher risk rectal bleeding in general practice. Br J Gen Pract. 2005;55(521):949–955. [PMC free article] [PubMed] [Google Scholar]
- 32.Jin P., Wu Z., Meng M., et al. Combined fecal transferrin test and immuno fecal occult blood test for detecting colorectal cancer and advanced adenoma in asymptomatic and symptomatic populations. J Cancer Sci Ther. 2012;4:243–248. [Google Scholar]
- 33.Law C.W., Rampal S., Roslani A.C., Mahadeva S. Development of a risk score to stratify symptomatic adults referred for colonoscopy. J Gastroenterol Hepatol. 2014;29(11):1890–1896. doi: 10.1111/jgh.12638. [DOI] [PubMed] [Google Scholar]
- 34.Malagon M., Ramio-Pujol S., Serrano M., et al. Reduction of faecal immunochemical test false-positive results using a signature based on faecal bacterial markers. Aliment Pharmacol Ther. 2019;49(11):1410–1420. doi: 10.1111/apt.15251. [DOI] [PubMed] [Google Scholar]
- 35.Nørrelund N., Nørrelund H. Colorectal cancer and polyps in patients aged 40 years and over who consult a GP with rectal bleeding. Fam Pract. 1996;13(2):160–165. doi: 10.1093/fampra/13.2.160. [DOI] [PubMed] [Google Scholar]
- 36.Parente F., Marino B., Ilardo A., et al. A combination of faecal tests for the detection of colon cancer: a new strategy for an appropriate selection of referrals to colonoscopy? A prospective multicentre Italian study. Eur J Gastroenterol Hepatol. 2012;24(10):1145–1152. doi: 10.1097/MEG.0b013e328355cc79. [DOI] [PubMed] [Google Scholar]
- 37.Payne J.E., Dent O., Chapuis P.H., Meyer H.J., Sutherland M.A., Ruwoldt A. Leucocyte adherence inhibition and carcinoembryonic antigen in combination for diagnosis of colorectal cancer. J Surg Oncol. 1983;22(3):212–215. doi: 10.1002/jso.2930220315. [DOI] [PubMed] [Google Scholar]
- 38.Rai S., Ballal M., Thomas W.M., Miller A.S., Jameson J.S., Steward W.P. Assessment of a patient consultation questionnaire-based scoring system for stratification of outpatient risk of colorectal cancer. Br J Surg. 2008;95(3):369–374. doi: 10.1002/bjs.5981. [DOI] [PubMed] [Google Scholar]
- 39.Wilhelmsen M., Christensen I.J., Rasmussen L., et al. Detection of colorectal neoplasia: combination of eight blood-based, cancer-associated protein biomarkers. Int J Cancer. 2017;140(6):1436–1446. doi: 10.1002/ijc.30558. [DOI] [PubMed] [Google Scholar]
- 40.Rodriguez-Alonso L., Rodriguez-Moranta F., Ruiz-Cerulla A., et al. An urgent referral strategy for symptomatic patients with suspected colorectal cancer based on a quantitative immunochemical faecal occult blood test. Dig Liver Dis. 2015;47(9):797–804. doi: 10.1016/j.dld.2015.05.004. [DOI] [PubMed] [Google Scholar]
- 41.Selvachandran S.N., Hodder R.J., Ballal M.S., Jones P., Cade D. Prediction of colorectal cancer by a patient consultation questionnaire and scoring system: a prospective study. Lancet. 2002;360(9329):278–283. doi: 10.1016/s0140-6736(02)09549-1. [DOI] [PubMed] [Google Scholar]
- 42.Simpkins S.J., Pinto-Sanchez M.I., Moayyedi P., et al. Poor predictive value of lower gastrointestinal alarm features in the diagnosis of colorectal cancer in 1981 patients in secondary care. Aliment Pharmacol Ther. 2017;45:91–99. doi: 10.1111/apt.13846. [DOI] [PubMed] [Google Scholar]
- 43.Turvill J., Mellen S., Jeffery L., Bevan S., Keding A., Turnock D. Diagnostic accuracy of one or two faecal haemoglobin and calprotectin measurements in patients with suspected colorectal cancer. Scand J Gastroenterol. 2018;53:1526–1534. doi: 10.1080/00365521.2018.1539761. [DOI] [PubMed] [Google Scholar]
- 44.Widlak M.M., Thomas C.L., Thomas M.G., et al. Diagnostic accuracy of faecal biomarkers in detecting colorectal cancer and adenoma in symptomatic patients. Aliment Pharmacol Ther. 2017;45:354–363. doi: 10.1111/apt.13865. [DOI] [PubMed] [Google Scholar]
- 45.Widlak M.M., Neal M., Daulton E., et al. Risk stratification of symptomatic patients suspected of colorectal cancer using faecal and urinary markers. Colorectal Dis. 2018;20:O335–O342. doi: 10.1111/codi.14431. [DOI] [PubMed] [Google Scholar]
- 46.Ayling R.M., Wong A., Cotter F. Use of ColonFlag score for prioritisation of endoscopy in colorectal cancer. BMJ Open Gastroenterol. 2021;8(1):6. doi: 10.1136/bmjgast-2021-000639. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Collins G.S., Altman D.G. Identifying patients with undetected colorectal cancer: an independent validation of QCancer (Colorectal) Br J Cancer. 2012;107(2):260–265. doi: 10.1038/bjc.2012.266. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Croner L.J., Dillon R., Kao A., et al. Discovery and validation of a colorectal cancer classifier in a new blood test with improved performance for high-risk subjects. Clin Proteonomics. 2017;14:28. doi: 10.1186/s12014-017-9163-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Herrero J.M., Vega P., Salve M., Bujanda L., Cubiella J. Symptom or faecal immunochemical test based referral criteria for colorectal cancer detection in symptomatic patients: a diagnostic tests study. BMC Gastroenterol. 2018;18(1):155. doi: 10.1186/s12876-018-0887-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Hoogendoorn M., Szolovits P., Moons L.M.G., Numans M.E. Utilizing uncoded consultation notes from electronic medical records for predictive modeling of colorectal cancer. Artif Intell Med. 2016;69:53–61. doi: 10.1016/j.artmed.2016.03.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Johnstone M.S., Burton P., Kourounis G., et al. Combining the quantitative faecal immunochemical test and full blood count reliably rules out colorectal cancer in a symptomatic patient referral pathway. Int J Colorectal Dis. 2022;37(2):457–466. doi: 10.1007/s00384-021-04079-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Koning N.R., Moons L.M., Buchner F.L., Helsper C.W., Ten Teije A., Numans M.E. Identification of patients at risk for colorectal cancer in primary care: an explorative study with routine healthcare data. Eur J Gastroenterol Hepatol. 2015;27(12):1443–1448. doi: 10.1097/MEG.0000000000000472. [DOI] [PubMed] [Google Scholar]
- 53.Kop R., Hoogendoorn M., Moons L.M.G., Numans M.E., ten Teije A. In: Artificial intelligence in medicine; 2015 2015// Holmes J.H., Bellazzi R., Sacchi L., Peek N., editors. Springer International Publishing; Cham: 2015. On the advantage of using dedicated data mining techniques to predict colorectal cancer; pp. 133–142. [Google Scholar]
- 54.Kop R., Hoogendoorn M., Teije A.T., et al. Predictive modeling of colorectal cancer using a dedicated pre-processing pipeline on routine electronic medical records. Comput Biol Med. 2016;76:30–38. doi: 10.1016/j.compbiomed.2016.06.019. [DOI] [PubMed] [Google Scholar]
- 55.Liu C., Xu L., Li W., Jie M., Xue W., Yu W. Multiple biomarker-combined screening for colorectal cancer based on bisulfate conversion-free detection of fecal DNA methylation. BioMed Res Int. 2021;2021 doi: 10.1155/2021/1479748. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Marshall T., Lancashire R., Sharp D., Peters T.J., Cheng K.K., Hamilton W. The diagnostic performance of scoring systems to identify symptomatic colorectal cancer compared to current referral guidance. Gut. 2011;60(9):1242–1248. doi: 10.1136/gut.2010.225987. [DOI] [PubMed] [Google Scholar]
- 57.Thompson M.R., O'Leary D.P., Flashman K., Asiimwe A., Ellis B.G., Senapati A. Clinical assessment to determine the risk of bowel cancer using Symptoms, Age, Mass and Iron deficiency anaemia (SAMI) Br J Surg. 2017;104(10):1393–1404. doi: 10.1002/bjs.10573. [DOI] [PubMed] [Google Scholar]
- 58.Whitfield A., Lockett B., Irwin J. Prediction of bowel cancer on index colonoscopy in a symptomatic population in a single endoscopy unit in New Zealand. J Gastroenterol Hepatol. 2018;33:25. [Google Scholar]
- 59.Wilson S., Damery S., Stocken D.D., et al. Serum matrix metalloproteinase 9 and colorectal neoplasia: a community-based evaluation of a potential diagnostic test. Br J Cancer. 2012;106(8):1431–1438. doi: 10.1038/bjc.2012.93. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Withrow D.R., Shine B., Oke J., et al. Combining faecal immunochemical testing with blood test results for colorectal cancer risk stratification: a consecutive cohort of 16,604 patients presenting to primary care. BMC Med. 2022;20(1):116. doi: 10.1186/s12916-022-02272-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Ballal M.S., Selvachandran S.N., Maw A. Use of a patient consultation questionnaire and weighted numerical scoring system for the prediction of colorectal cancer and other colorectal pathology in symptomatic patients: a prospective cohort validation study of a Welsh population. Colorectal Dis. 2010;12(5):407–414. doi: 10.1111/j.1463-1318.2009.01984.x. [DOI] [PubMed] [Google Scholar]
- 62.Boulind C.E., Gould O., Costello B.L., et al. Urinary volatile organic compound testing in fast-track patients with suspected colorectal cancer. Cancers. 2022;14(9):2127. doi: 10.3390/cancers14092127. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Fernandez-Banares F., Cleries R., Boadas J., et al. Prediction of advanced colonic neoplasm in symptomatic patients: a scoring system to prioritize colonoscopy (COLONOFIT study) BMC Cancer. 2019;19(1):734. doi: 10.1186/s12885-019-5926-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Fijten G.H., Starmans R., Muris J.W., Schouten H.J., Blijham G.H., Knottnerus J.A. Predictive value of signs and symptoms for colorectal cancer in patients with rectal bleeding in general practice. Fam Pract. 1995;12(3):279–286. doi: 10.1093/fampra/12.3.279. [DOI] [PubMed] [Google Scholar]
- 65.Hijos-Mallada G., Saura N., Lue A., et al. A point-of-care faecal test combining four biomarkers allows avoidance of normal colonoscopies and prioritizes symptomatic patients with a high risk of colorectal cancer. Cancers. 2023;15(3):721. doi: 10.3390/cancers15030721. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Hippisley-Cox J., Coupland C. Identifying patients with suspected colorectal cancer in primary care: derivation and validation of an algorithm. Br J Gen Pract. 2012;62(594):e29–e37. doi: 10.3399/bjgp12X616346. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Hogberg C., Karling P., Rutegard J., Lilja M. Diagnosing colorectal cancer and inflammatory bowel disease in primary care: the usefulness of tests for faecal haemoglobin, faecal calprotectin, anaemia and iron deficiency. A prospective study. Scand J Gastroenterol. 2017;52(1):69–75. doi: 10.1080/00365521.2016.1228120. [DOI] [PubMed] [Google Scholar]
- 68.Hogberg C., Gunnarsson U., Jansson S., Thulesius H., Cronberg O., Lilja M. Diagnosing colorectal cancer in primary care: cohort study in Sweden of qualitative faecal immunochemical tests, haemoglobin levels, and platelet counts. Br J Gen Pract. 2020;70(701):e843–e851. doi: 10.3399/bjgp20X713465. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Johansen J.S., Christensen I.J., Jorgensen L.N., et al. Serum YKL-40 in risk assessment for colorectal cancer: a prospective study of 4,496 subjects at risk of colorectal cancer. Cancer Epidemiol Biomarkers Prev. 2015;24(3):621–626. doi: 10.1158/1055-9965.EPI-13-1281. [DOI] [PubMed] [Google Scholar]
- 70.Mahadavan L., Loktionov A., Daniels I.R., et al. Exfoliated colonocyte DNA levels and clinical features in the diagnosis of colorectal cancer: a cohort study in patients referred for investigation. Colorectal Dis. 2012;14(3):306–313. doi: 10.1111/j.1463-1318.2011.02615.x. [DOI] [PubMed] [Google Scholar]
- 71.Mowat C., Digby J., Strachan J.A., et al. Faecal haemoglobin and faecal calprotectin as indicators of bowel disease in patients presenting to primary care with bowel symptoms. Gut. 2016;65(9):1463–1469. doi: 10.1136/gutjnl-2015-309579. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Steffen A., MacInnis R.J., Joshy G., Giles G.G., Banks E., Roder D. Development and validation of a risk score predicting risk of colorectal cancer. Cancer Epidemiol Biomarkers Prev. 2014;23(11):2543–2552. doi: 10.1158/1055-9965.EPI-14-0206. [DOI] [PubMed] [Google Scholar]
- 73.Wells B.J., Kattan M.W., Cooper G.S., Jackson L., Koroukian S. ColoRectal cancer predicted risk online (CRC-PRO) calculator using data from the multi-ethnic cohort study. J Am Board Fam Med. 2014;27(1):42. doi: 10.3122/jabfm.2014.01.130040. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Wilhelmsen M., Christensen I.J., Jorgensen L.N., et al. Clean colorectum at diagnostic colonoscopy: subsequent detection of extracolonic malignancies by plasma protein biomarkers? Biomarkers Cancer. 2018;10 doi: 10.1177/1179299X18776974. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Abdelhady S.A., Attya H., Abdo M., Attia F.M. Clinical significance of golgi protein-73 as a diagnostic marker for Egyptian patients with colorectal cancer: preliminary study. Cancer Rep. 2021;4 doi: 10.1002/cnr2.1379. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Blume J.E., Wilhelmsen M., Benz R.W., et al. Discovery and validation of plasma-protein biomarker panels for the detection of colorectal cancer and advanced adenoma in a Danish collection of samples from patients referred for diagnostic colonoscopy. J Appl Lab Med. 2016;1(2):181–193. doi: 10.1373/jalm.2016.020271. [DOI] [PubMed] [Google Scholar]
- 77.Hamilton W., Round A., Sharp D., Peters T.J. Clinical features of colorectal cancer before diagnosis: a population-based case–control study. Br J Cancer. 2005;93(4):399–405. doi: 10.1038/sj.bjc.6602714. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Nemlander E., Ewing M., Abedi E., et al. A machine learning tool for identifying non-metastatic colorectal cancer in primary care. Eur J Cancer. 2023;182:100–106. doi: 10.1016/j.ejca.2023.01.011. [DOI] [PubMed] [Google Scholar]
- 79.Rasmussen L., Nielsen H.J., Christensen I.J. Evaluation of a 92 multiplex protein panel in detection of colorectal cancer and high-risk adenoma in 784 symptomatic individuals. Cancer Biomark. 2021;32(1):73–84. doi: 10.3233/CBM-203211. [DOI] [PubMed] [Google Scholar]
- 80.Stapley S.A., Rubin G.P., Alsina D., Shephard E.A., Rutter M.D., Hamilton W.T. Clinical features of bowel disease in patients aged <50 years in primary care: a large case-control study. Br J Gen Pract. 2017;67:e336–e344. doi: 10.3399/bjgp17X690425. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Lucocq J., Barron E., Donnelly P., Cruickshank N. The significance of anaemia and symptoms for the prediction of colorectal cancer in the age of quantitative faecal-immunochemical test. Colorectal Dis. 2022;24(Supplement 3):164. [Google Scholar]
- 82.Rasmussen L., Christensen I.J., Herzog M., Micallef J., Nielsen H.J., on Early Detection of Colorectal Cancer FtDCG Circulating cell-free nucleosomes as biomarkers for early detection of colorectal cancer. Oncotarget. 2017;9 doi: 10.18632/oncotarget.21908. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Ewing M., Naredi P., Zhang C., Mansson J. Identification of patients with non-metastatic colorectal cancer in primary care: a case-control study. Br J Gen Pract. 2016;66(653):e880–e886. doi: 10.3399/bjgp16X687985. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Nemlander E., Rosenblad A., Abedi E., et al. Validation of a diagnostic prediction tool for colorectal cancer: a case-control replication study. Fam Pract. 2023;cmac147 doi: 10.1093/fampra/cmac147. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Digby J., Strachan J.A., Mowat C., Steele R.J.C., Fraser C.G. Appraisal of the faecal haemoglobin, age and sex test (FAST) score in assessment of patients with lower bowel symptoms: an observational study. BMC Gastroenterol. 2019;19(1):213. doi: 10.1186/s12876-019-1135-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Lue A., Hijos G., Sostres C., et al. The combination of quantitative faecal occult blood test and faecal calprotectin is a cost-effective strategy to avoid colonoscopies in symptomatic patients without relevant pathology. Therap Adv Gastroenterol. 2020;13 doi: 10.1177/1756284820920786. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Birks J.A.-O., Bankhead C.A.-O., Holt T.A.-O., Fuller A., Patnick J.A.-O. 2017. Evaluation of a prediction model for colorectal cancer: retrospective analysis of 2.5 million patient records; pp. 2045–7634. [Electronic] [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.Hornbrook M.A.-O., Goshen R., Choman E., et al. 2017. Early colorectal cancer detected by machine learning model using gender, age, and complete blood count data; pp. 1573–2568. [Electronic] [DOI] [PubMed] [Google Scholar]
- 89.Kinar Y., Akiva P., Choman E., et al. Performance analysis of a machine learning flagging system used to identify a group of individuals at a high risk for colorectal cancer. PLoS One. 2017;12(2) doi: 10.1371/journal.pone.0171759. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Kinar Y., Kalkstein N., Akiva P., et al. 2016. Development and validation of a predictive model for detection of colorectal cancer in primary care by analysis of complete blood counts: a binational retrospective study. 1527-974X [Electronic] [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Benton S.C., Piggott C., Zahoor Z., et al. A comparison of the faecal haemoglobin concentrations and diagnostic accuracy in patients suspected with colorectal cancer and serious bowel disease as reported on four different faecal immunochemical test systems. Clin Chem Lab Med. 2022;60(8):1278–1286. doi: 10.1515/cclm-2021-1248. [DOI] [PubMed] [Google Scholar]
- 92.National institute for Health Care and Excellence . 2017. Suspected cancer: recognition and referral. [Google Scholar]
- 93.Williams T.G.S., Cubiella J., Griffin S.J., Walter F.M., Usher-Smith J.A. Risk prediction models for colorectal cancer in people with symptoms: a systematic review. BMC Gastroenterol. 2016;16(1):63. doi: 10.1186/s12876-016-0475-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 94.Booth R., Carten R., D'Souza N., Westwood M., Kleijnen J., Abulafi M. Role of the faecal immunochemical test in patients with risk-stratified suspected colorectal cancer symptoms: a systematic review and meta-analysis to inform the ACPGBI/BSG guidelines. Lancet Reg Health Eur. 2022;23 doi: 10.1016/j.lanepe.2022.100518. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.Morrison A., Polisena J., Moulton K., et al. The effect of English-language restriction on systematic review-based meta-analyses: a systematic review of empirical studies. Int J Technol Assess Health Care. 2012;28(2):138–144. doi: 10.1017/S0266462312000086. [DOI] [PubMed] [Google Scholar]
- 96.Moons K., Andre Pascal K., Mark W., et al. Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker. Heart. 2012;98(9):683. doi: 10.1136/heartjnl-2011-301246. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.