Abstract
Background
Colorectal cancer (CRC) screening reduces the mortality due to CRC. It is important for healthcare providers to be aware of the variation in the products available for CRC screening.
Purpose
The purpose of this study was to summarize the accuracy of results of individual FIT products across pathology proficiency testing programs.
Methods
Secondary data analysis of proficiency testing programs’ FIT results.
Results
Four of seven proficiency testing program’s FIT evaluations were obtained for a two-year period. Fourteen unique FIT brands were evaluated by at least one of the four proficiency testing programs. Five of the products performed similarly with sensitivities ranging from 98.1% to 98.8% and specificities from 98.1% to 99.6%. Ninety-three percent of the FIT tests completed were manual CLIA-waived FITs.
Conclusions
About two-thirds of the commonly used FIT products performed acceptably on spiked samples of human hemoglobin. However, some had low sensitivity and specificity and probably should not be used for population-based or other screening. Further investigation to determine appropriate, reliable products for fecal occult blood testing is warranted.
Keywords: Fecal occult blood test (FOBT), Fecal Immunochemical Test (FIT), Proficiency Testing Programs, Colorectal cancer screening
Colorectal cancer (CRC) screening has increased dramatically as CRC is the second leading cause of cancer death.1–7 Many agencies and organizations are involved in educating individuals about screening and are simultaneously providing fecal occult blood tests (FOBT), using either a guaiac (gFOBT) or fecal immunochemical test (FIT).2,6 The newly emerging FITs are popular, as only one or two stool specimens are needed and there are no dietary or medication restrictions. Another strong incentive for using these gFOBTs or FITs is that they are Clinical Laboratory Improvement Amendments (CLIA)-waived and can be used at the point-of-care.
There are over 108 fecal occult blood tests listed on the Clinical Laboratory Improvement Amendments database of the U.S. Department of Health and Human Services Food and Drug Administration (FDA) web site as of December 28, 2011 (www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfCLIA/search.cfm). As healthcare professionals choose a fecal occult blood test product to use in their health care setting, there is little information on which ones have the best test characteristics. Fecal occult blood test products are either guaiac-based or immunochemical. Of the immunochemical tests, two are automated (Polymedco OC-Sensor DIANA iFOB test and Polymedco OC Auto Micro 80) and not CLIA-waived tests, and the others are manual, CLIA-waived tests.
Several studies have shown that diagnostic accuracy for colorectal cancer is higher when using a FIT rather than a gFOBT.8–13 The immunochemical test detects the globin component of hemoglobin rather than the heme component.12 Thus, it is highly specific for occult lower gastrointestinal bleeding, as globin is largely degraded by upper gastrointestinal enzymes. Using a one-, two-, and three-day FIT (Monohaem), researchers found the 3-day test methods showed 89% sensitivity and 94% specificity for cancer, with slightly lower percentages for the 2-day tests, at 83% and 96% respectively.10
Recently, Allison and colleagues20 determined the manual FIT (Beckman/Coulter Hemoccult ICT) compared to two gFOBTs had higher sensitivity (82%) and specificity (98%) for detecting cancer and may replace the gFOBT. The accuracy and reliability of the FIT product used is the key element for a colorectal cancer screening program. Tests that produce false negative results may lull patients into a false sense of security, while a false positive may lead to unnecessary anxiety.
Laboratories throughout the U.S. participate in peer comparison programs to regularly evaluate their performance and improve the accuracy of results they provide to patients. Individual laboratories are provided with unidentified specimens for testing. The participants analyze the specimens and return the results to the proficiency evaluator. In turn, each participating laboratory receives a report of their performance, as well as a report summarizing the results of all participating laboratories.22
In this manuscript, we have summarized the information on the fecal immunochemical tests analyzed across four proficiency testing programs. Although there were a total of seven testing programs, some consider their information proprietary and would not share it with us. Samples spiked with human blood and control samples are sent to labs for testing, results are sent back to the proficiency testing program, and then summarized. The purpose of this study was to summarize the accuracy of results of 8 individual FIT products across proficiency testing programs, in order to provide information about the validity of results obtained by various FIT products.
METHODS
The University of Iowa Human Subjects Institutional Review Board reviewed this project and found it exempt from full review.
Through CLIA, the Centers for Medicare and Medicaid Services (CMS) regulate all CLIA-approved laboratory testing performed on humans in the U.S. In order to comply with CLIA Laboratory Certificate of Accreditation mandates, approximately 225,000 laboratories participate in proficiency testing for all types of analyses undertaken in a laboratory.22 CMS has approved 14 proficiency testing programs across the United States. We called each testing program and determined the following seven programs conduct fecal occult blood testing: 1) American Academy of Family Physicians Proficiency Testing (AAFP-PT) of Leawood, KS, 2) American Association of Bioanalysts (AAB) of Brownsville, TX, 3) American Proficiency Institute (API) of Traverse City, MI, 4) The College of American Pathologists (CAP)-Surveys (large laboratories) of Northfield, IL, 5) External Comparative Evaluation for Laboratories CAP – Excel (small laboratories) of Northfield, IL, 6) American College of Physicians Medical Laboratory Evaluation (MLE) Program of Washington DC, and 7) Wisconsin State Laboratory of Hygiene (WSLH) of Madison, WI. We were able to obtain results for FIT testing from four testing programs. Three programs refused to provide information (AAFP-PT, CAP-Excel and CAP-Surveys) and thus were not able to be included in our analysis.
Each of the four proficiency testing programs provided a list of all fecal occult blood tests that they perform evaluations which included both guaiac and immunochemical tests. From those four lists, each test name was reviewed to determine if it was a guaiac test or an immunochemical test. The review included 22 products from AAB, 29 products from API, 9 products from MLE and 15 products from WSLH. After the review of the 75 product names, 34 were determined to be FITs. Some FIT products were evaluated by more than one program. After omitting duplicate names, 14 unique FITs remained for testing.
Of the 14 different FITs, six (BTNX Rapid Response iFOBT, Diagnostic Test Group Clarity IFOBT, Henry Schein OneStep+ iFOBT, PSS Consult iFOBT, Select Diagnostics iFOBT, and Wampole Clearview Ultra FOBT) were only evaluated by one proficiency test program and had fewer than 25 results. These six FITs were excluded from analysis. Of the remaining 8 FITs that were evaluated in this study, Polymedco OC-Auto Micro 80 was the only product that is automated, and Beckman/Coulter Hemoccult ICT and Immunostics Hema-Screen Specific were the only products using a dry-slide as opposed to a liquid-based buffer. Four products (Beckman/Coulter Hemoccult ICT, Hemosure iFOB test, Polymedco OC-Light IFOB, and Polymedco OC-Auto Micro 80) were tested by each of the proficiency testing programs.
Each of the four proficiency testing programs was asked how their samples for fecal occult blood testing are prepared. An API representative reported that the formula is proprietary and has a human source for hemoglobin. The WSLH representative said they purchase their samples from a vendor and do not have that information. An MLE representative reported that their samples are a synthetic liquid and the positive samples are spiked with human hemoglobin. An AAB representative reported that their samples are a synthetic liquid stool and the positive specimens contain human blood in large enough quantities to elicit a positive reaction from any test kit.
AAB, API, and MLE proficiency testing programs provided the FIT results every 4 months and WSLH provided the results every 6 months. These four programs provided individual results by product and company.
Data Analysis
For each testing period, proficiency testing programs sent two blinded samples to laboratories to test for the presence of hemoglobin in the sample. Laboratories tested the samples using the fecal occult blood testing product used in their labs and reported results back as either positive (hemoglobin present) or negative (no hemoglobin). The proficiency testing programs listed the positive/negative results by product, indicating if the result was correct or incorrect for each testing period for 2010 and 2011. The results by product for the two years were tallied, and the overall percent correct as well as incorrect for positive and negative results were calculated for each product.
The positive percentage correct and the negative percentage correct can be interpreted as the products’ sensitivity and specificity respectively. The overall sensitivity and specificity for each FIT product across all testing programs along with 95% Agresti-Coull binomial proportion confidence intervals were calculated. Visual comparison of different FIT products’ test characteristics may not be reasonable as the distribution of testing programs contributing to the overall estimates differs greatly between products. The Agresti-Coull confidence interval was used in place of the Wald confidence interval as it is more reliable than the Wald, especially when estimated proportions are near 0 or 1.23 The midpoint of an Agresti-Coull confidence interval is (x+2)/(n+4), where x is the number of events of interest and n is the sample size, and can be interpreted as a point estimate of the true proportion, however, the traditional x/n method for calculating sample proportions was used for all sensitivity and specificity calculations in this paper.23
RESULTS
After tallying the FIT results by correct and incorrect positive and negative results for each product by proficiency testing program, some FITs had perfect results within a proficiency testing program and one time period (See Table 1, Immunostics Hema-Screen Specific, Polymedco OC-Auto Micro 80, and Quidel QuickVue iFOB), but no FIT was perfect across the four proficiency testing programs for the two years (See Table 1). Also, three products were not tested by all four proficiency testing programs, Immunostics Hema-Screen Specific, Inverness Clearview iFOB Complete, and Inverness Clearview Ultra FOB.
Table 1.
API Total Correct |
API Total Incorrect |
AAB Total Correct |
AAB Total Incorrect |
MLE Total Correct |
MLE Total Incorrect |
WSLH Total Correct |
WSLH Total Incorrect |
|||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Pos | Neg | Pos | Neg | Pos | Neg | Pos | Neg | Pos | Neg | Pos | Neg | Pos | Neg | Pos | Neg | |
Beckman/Coulter Hemoccult ICT | 524 | 244 | 5 | 8 | 28 | 20 | 6 | 0 | 172 | 170 | 4 | 2 | 221 | 224 | 2 | 3 |
Hemosure IFOBT | 743 | 349 | 49 | 43 | 73 | 74 | 5 | 6 | 135 | 146 | 4 | 9 | 33 | 41 | 0 | 1 |
Immunostics Hema-Screen Specific | 250 | 302 | 5 | 2 | 18 | 19 | 1 | 0 | NR | NR | NR | NR | 37 | 35 | 0 | 0 |
Inverness Clearview iFOB Complete1 | 106 | 96 | 20 | 13 | 24 | 38 | 1 | 15 | 13 | 22 | 0 | 9 | NR | NR | NR | NR |
Inverness Clearview Ultra FOB | 371 | 176 | 20 | 7 | 130 | 96 | 26 | 10 | NR | NR | NR | NR | NR | NR | NR | NR |
Polymedco OC-Light IFOB | 340 | 152 | 6 | 4 | 13 | 15 | 2 | 0 | 102 | 105 | 1 | 2 | 107 | 126 | 0 | 1 |
Polymedco OC-Auto Micro 80 | 202 | 100 | 2 | 0 | 14 | 15 | 1 | 0 | 52 | 54 | 1 | 1 | 72 | 72 | 0 | 0 |
Quidel QuickVue iFOB | 594 | 284 | 6 | 1 | 105 | 74 | 3 | 4 | 72 | 77 | 5 | 0 | 50 | 46 | 0 | 0 |
Taken off the market in 2011
Shaded column denotes correct response.
For the manual FITs, sensitivity ranged from 87.2% for Inverness Clearview iFOB Complete to 98.4% for the Polymedco OC-Light FOB. For the manual FITs, specificity ranged from 80.8% for Inverness Clearview iFOB Complete to 99.0% for Quidel QuickVue iFOB (See Table 2). Of the 8,089 FITs evaluated, the Hemosure IFOBT and Beckman/Coulter Hemoccult ICT are the most frequently used FITs (See Table 2). The one automated, non-CLIA-waived test, Polymedco OC-AUTO Micro 80, was used for 586 (7%) of the products.
Table 2.
Total Correct (Percentage Correct) |
Total Incorrect (Percentage Incorrect) |
Overall Sensitivity (95% CI)2 |
Overall Specificity (95% CI)2 |
|||
---|---|---|---|---|---|---|
Pos | Neg | Pos | Neg | |||
Beckman/Coulter Hemoccult ICT n = 1633 | 945 (98.2) | 658 (98.1) | 17 (1.8) | 13 (1.9) | 98.2% (97.2 to 98.9) | 98.1% (96.7 to 98.9) |
Hemosure IFOBT n = 1711 | 984 (94.4) | 610 (91.2) | 58 (5.6) | 59 (8.8) | 94.4% (92.9 to 95.7) | 91.2% (88.8 to 93.1) |
Immunostics Hema-Screen Specific n = 669 | 305 (98.1) | 356 (99.4) | 6 (1.9) | 2 (0.6) | 98.1% (95.8 to 99.2) | 99.4% (97.8 to 1.0) |
Inverness Clearview iFOB Complete1 n = 357 | 143 (87.2) | 156 (80.8) | 21 (12.8) | 37 (19.2) | 87.2% (81.1 to 91.5) | 80.8% (74.7 to 85.8) |
Inverness Clearview Ultra FOB n = 836 | 501 (91.6) | 272 (94.1) | 46 (8.4) | 17 (5.9) | 91.6% (88.9 to 93.7) | 94.1 (90.7 to 96.4) |
Polymedco OC-Light IFOB n = 976 | 562 (98.4) | 398 (98.3) | 9 (1.6) | 7 (1.7) | 98.4% (97.0 to 99.2) | 98.3% (96.4 to 99.2) |
Polymedco OC-Auto Micro 80 n = 586 | 340 (98.8) | 241 (99.6) | 4 (1.2) | 1 (0.4) | 98.8% (96.9 to 99.7) | 99.6% (97.5 to 1.0) |
Quidel QuickVue iFOB n = 1321 | 821 (98.3) | 481 (99.0) | 14 (1.7) | 5 (1.0) | 98.3% (97.2 to 99.0) | 99.0% (97.5 to 99.6) |
Taken off the market in 2011
95% Agresti-Coull binomial proportion confidence interval
The width of confidence intervals calculated was variable, as can be seen by looking at Beckman/Coulter Hemoccult ICT, which had a sensitivity of 98.2% and a corresponding confidence interval of 97.2% to 98.9%, and Inverness Clearview iFOB Complete, which had a sensitivity of 87.2% and a wider corresponding confidence interval of 81.1% to 91.5% (See Table 2). An example of interpreting sensitivity and specificity is provided in Table 3.
Table 3.
Total Correct | Total Incorrect | Proportion Correct | ||||
---|---|---|---|---|---|---|
Pos | Neg | Pos | Neg | Pos | Neg | |
Beckman/Coulter Hemoccult ICT | 945 | 658 | 17 | 13 | 98.2% | 98.1% |
Is equivalent to | |||
---|---|---|---|
True Results | |||
Positive | Negative | ||
Beckman/Coulter Hemoccult ICT | Positive | 945 | 13 |
Negative | 17 | 658 |
Sensitivity = 98.2%
Specificity = 98.1%
DISCUSSION
Most FIT products tested reasonably well, but some did not. From this review of eight FITs, it appears that most tests do as they say they will do; i.e., they are positive when hemoglobin is present and negative when it is not present. However, there is no way of knowing how much hemoglobin is in the positively spiked samples and whether this is at the lower limit of the product brochure’s stated sensitivity for hemoglobin. This is the first study we are aware of that has assessed proficiency testing results.
Limitations of this study included being unable to obtain information from three testing programs which assess FITs, thus limiting our generalizability, and proficiency testing programs not disclosing the amount of hemoglobin in their positive samples. Information from proficiency testing programs should be publically available. One would assume that the amount of hemoglobin in the positive samples should be adequate to test positive, but if the samples are stored at high temperatures or for a long period of time prior to testing the level of hemoglobin may decline.24
Non-laboratory healthcare professionals need access to reliable and valid testing results to make informed decisions when selecting a fecal occult blood test product. Many more FIT products are listed on the FDA website than those reported in the four proficiency testing programs’ fecal occult blood analyte summaries, which means that there are many products being sold for which no publically proficiency testing information is available.
As a healthcare worker selecting a product for fecal occult blood testing, this summary of results has provided information about a few FITs that generally produce positive and negative results accurately. The results serendipitously provide information about which tests are popular or more frequently used. However, additional information is still needed for deciding which product to use in a particular screening program. An important issue is determining the advantages and disadvantages of using a quantitative FIT test over a qualitative test. For a quantitative FIT, a fully automated system is necessary, with only two products currently approved by the FDA: the OC-Auto Micro 80 or the OC-Sensor Diana. These systems are expensive, at approximately $30,000 for the testing device and additional costs for the solutions and sample kits.
If an automated system is used, another issue to take into consideration is the cutoff point for hemoglobin detection. Vilkin and colleagues determined a threshold of 100 ng Hb/ml would detect cancers and the majority of advanced adenomas.25 However, higher cutoffs, such as 200 ng/ml, decrease OC Sensor test positivity rates.26 While the threshold of hemoglobin in the blood can be set for the automated FIT testing, it is usually set by the laboratory,
Whether using a quantitative or qualitative FIT, another important issue is the number of FIT samples necessary for optimal sensitivity and specificity. Clinical trials support a 2- or 3-day stool sampling, as detection of occult blood from colorectal polyps and cancer depends on whether the polyp or cancer is bleeding at the time of sampling.27–29 For detecting cancer, the sensitivity is reported at 56% for a one-day FIT, 83% for a 2-day FIT sample, and 89% for a 3-day FIT sample, using the Monohaem (Nihon Pharmaceutical, Japan) product.10 Yet, much of the product literature for FIT promotes a one-day sample, which is going to lead to more falsely negative results.
If physicians and public health personnel are going to advocate for use of fecal immunochemical tests, then information on validity needs to be more readily available. It is nearly impossible to make an informed decision with the information currently available. It is disconcerting that negative samples tested positive.
CONCLUSION
Reviewing proficiency testing programs’ summaries of FITs provides only one narrow assessment of the products and allows lab personnel to know that a product tests positively on a spiked sample of human hemoglobin. It is disturbing to find that some negative samples tested positive. Further investigation for determining appropriate products which give valid results for fecal occult blood testing is warranted, and should include a review of the FIT research literature, discussion with other healthcare providers using the tests, and sample demonstrations. As the recent cascade colorectal cancer screening guidelines are resource driven and emphasize doing what you can for screening with what you have, rather than choosing only one approach or not doing it at all, this additional perspective must be taken into consideration along with the viewpoint of the patient.30
Acknowledgment
National Cancer Institute, 1RC1 CA144907.
Contributor Information
Camden P. Bay, Email: camden-bay@uiowa.edu.
Barcey T. Levy, Email: barcey-levy@uiowa.edu.
References
- 1.CDC Colorectal cancer CDC Vital Signs. http://www.cdc.gov/VitalSigns/CancerScreening/
- 2.Levin TR, Jamieson L, Burley DA, Reyes J, Oehrli M, Caldwell C. Organized colorectal cancer screening in integrated health care systems. Epidemiol Rev. 2011;33(1):101–110. doi: 10.1093/epirev/mxr007. [DOI] [PubMed] [Google Scholar]
- 3.Center MM, Jemal A, Smith RA, Ward E. Worldwide variations in colorectal cancer. CA Cancer J Clin. 2009;59(6):366–378. doi: 10.3322/caac.20038. [DOI] [PubMed] [Google Scholar]
- 4.Potter MB, Walsh JM, Yu TM, Gildengorin G, Green LW, McPhee SJ. The effectiveness of the FLU-FOBT program in primary care a randomized trial. Am J Prev Med. 2011;41(1):9–16. doi: 10.1016/j.amepre.2011.03.011. [DOI] [PubMed] [Google Scholar]
- 5.Potter MB, Phengrasamy L, Hudes ES, McPhee SJ, Walsh JM. Offering annual fecal occult blood tests at annual flu shot clinics increases colorectal cancer screening rates. Ann Fam Med. 2009;7(1):17–23. doi: 10.1370/afm.934. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Levy BT, Daly JM, Luxon B, et al. The "Iowa Get Screened" colon cancer screening program. J Prim Care Com Health. 2010;1(1):43–49. doi: 10.1177/2150131909352191. [DOI] [PubMed] [Google Scholar]
- 7.American Cancer Society. Colorectal cancer facts & figures 2011–2013. [Accessed September 28, 2011]; http://wwwcancerorg/acs/groups/content/@epidemiologysurveilance/documents/document/acspc-028323pdf. Updated 2011. [Google Scholar]
- 8.Cheng TI, Wong JM, Hong CF, et al. Colorectal cancer screening in asymptomatic adults: Comparison of colonoscopy, sigmoidoscopy and fecal occult blood tests. J Formos Med Assoc. 2002;101(10):685–690. [PubMed] [Google Scholar]
- 9.Nakama H, Kamijo N, Abdul Fattah AS, Zhang B. Validity of immunological faecal occult blood screening for colorectal cancer: A follow up study. J Med Screen. 1996;3(2):63–65. doi: 10.1177/096914139600300203. [DOI] [PubMed] [Google Scholar]
- 10.Nakama H, Yamamoto M, Kamijo N, et al. Colonoscopic evaluation of immunochemical fecal occult blood test for detection of colorectal neoplasia. Hepatogastroenterology. 1999;46(25):228–231. [PubMed] [Google Scholar]
- 11.Rozen P, Waked A, Vilkin A, Levi Z, Niv Y. Evaluation of a desk top instrument for the automated development and immunochemical quantification of fecal occult blood. Med Sci Monit. 2006;12(6):MT27–MT32. [PubMed] [Google Scholar]
- 12.Park DI, Ryu S, Kim YH, et al. Comparison of guaiac-based and quantitative immunochemical fecal occult blood testing in a population at average risk undergoing colorectal cancer screening. Am J Gastroenterol. 2010;105(9):2017–2025. doi: 10.1038/ajg.2010.179. [DOI] [PubMed] [Google Scholar]
- 13.Zhu MM, Xu XT, Nie F, Tong JL, Xiao SD, Ran ZH. Comparison of immunochemical and guaiac-based fecal occult blood test in screening and surveillance for advanced colorectal neoplasms: A meta-analysis. J Dig Dis. 2010;11(3):148–160. doi: 10.1111/j.1751-2980.2010.00430.x. [DOI] [PubMed] [Google Scholar]
- 14.Guittet L, Guillaume E, Levillain R, et al. Analytical comparison of three quantitative immunochemical fecal occult blood tests for colorectal cancer screening. Cancer Epidemiol Biomarkers Prev. 2011;20(7):1492–1501. doi: 10.1158/1055-9965.EPI-10-0594. [DOI] [PubMed] [Google Scholar]
- 15.Gimeno-Garcia AZ, Quintero E, Nicolas-Perez D, Hernandez-Guerra M, Parra-Blanco A, Jimenez-Sosa A. Screening for familial colorectal cancer with a sensitive immunochemical fecal occult blood test: A pilot study. Eur J Gastroenterol Hepatol. 2009;21(9):1062–1067. doi: 10.1097/MEG.0b013e3283293797. [DOI] [PubMed] [Google Scholar]
- 16.Launoy GD, Bertrand HJ, Berchi C, Talbourdet VY, Guizard AV, Bouvier VM, et al. Evaluation of an immunochemical fecal occult blood test with automated reading in screening for colorectal cancer in a general average-risk population. Int J Cancer. 2005;115(3):493–496. doi: 10.1002/ijc.20921. [DOI] [PubMed] [Google Scholar]
- 17.Levi Z, Rozen P, Hazazi R, et al. A quantitative immunochemical fecal occult blood test for colorectal neoplasia. Ann Intern Med. 2007;146(4):244–255. doi: 10.7326/0003-4819-146-4-200702200-00003. [DOI] [PubMed] [Google Scholar]
- 18.Itoh M, Takahashi K, Nishida H, Sakagami K, Okubo T. Estimation of the optimal cut off point in a new immunological faecal occult blood test in a corporate colorectal cancer screening programme. J Med Screen. 1996;3(2):66–71. doi: 10.1177/096914139600300204. [DOI] [PubMed] [Google Scholar]
- 19.Allison JE, Tekawa IS, Ransom LJ, Adrain AL. A comparison of fecal occult-blood tests for colorectal-cancer screening. N Engl J Med. 1996;334(3):155–159. doi: 10.1056/NEJM199601183340304. [DOI] [PubMed] [Google Scholar]
- 20.Allison JE, Sakoda LC, Levin TR, et al. Screening for colorectal neoplasms with new fecal occult blood tests: Update on performance characteristics. J Natl Cancer Inst. 2007;99(19):1462–1470. doi: 10.1093/jnci/djm150. [DOI] [PubMed] [Google Scholar]
- 21.Tannous B, Lee-Lewandrowski E, Sharples C, et al. Comparison of conventional guaiac to four immunochemical methods for fecal occult blood testing: Implications for clinical practice in hospital and outpatient settings. Clin Chim Acta. 2009;400(1–2):120–122. doi: 10.1016/j.cca.2008.10.023. [DOI] [PubMed] [Google Scholar]
- 22.Allen TC, Hammond ME, Robboy SJ. Quality and the college of American pathologists. Arch Pathol Lab Med. 2011;135(11):1441. doi: 10.5858/arpa.2011-0287-SA. [DOI] [PubMed] [Google Scholar]
- 23.Agresti A, Coull BA. Approximate is better than “exact” for interval estimation of binomial proportions. The American Statistician. 1998;52(2):119–126. [Google Scholar]
- 24.van Rossum LG, van Rijn AF, van Oijen MG, Fockens P, Laheij RJ, Verbeek AL, et al. False negative fecal occult blood tests due to delayed sample return in colorectal cancer screening. Int. J. Cancer. 2009;125(4):746–750. doi: 10.1002/ijc.24458. [DOI] [PubMed] [Google Scholar]
- 25.Vilkin A, Rozen P, Levi Z, et al. Performance characteristics and evaluation of an automated-developed and quantitative, immunochemical, fecal occult blood screening test. Am J Gastroenterol. 2005;100(11):2519–2525. doi: 10.1111/j.1572-0241.2005.00231.x. [DOI] [PubMed] [Google Scholar]
- 26.Terhaar sive Droste JS, Oort FA, van der Hulst RW, et al. Higher fecal immunochemical test cutoff levels: Lower positivity rates but still acceptable detection rates for early-stage colorectal cancers. Cancer Epidemiol Biomarkers Prev. 2011;20(2):272–280. doi: 10.1158/1055-9965.EPI-10-0848. [DOI] [PubMed] [Google Scholar]
- 27.Young GP, St. John DJB. Faecal occult blood tests: Choice, usage and clinical applications. Clin Biochem Rev. 1992;13:161–167. [Google Scholar]
- 28.Winawer S, Fletcher RH, Rex D, et al. Colorectal cancer screening and surveillance: Clinical guidelines and rationale-update based on new evidence. Gastroenterology. 2003;124(2):544–560. doi: 10.1053/gast.2003.50044. [DOI] [PubMed] [Google Scholar]
- 29.U.S. Preventive Services Task Force. Screening for colorectal cancer: U.S. preventive services task force recommendation statement. Ann Intern Med. 2008;149(9):627–637. doi: 10.7326/0003-4819-149-9-200811040-00243. [DOI] [PubMed] [Google Scholar]
- 30.Winawer SJ, Krabshuis J, Lambert R, O'Brien M, Fried M. World Gastroenterology Organization Guidelines Committee. Cascade colorectal cancer screening guidelines: A global conceptual model. J Clin Gastroenterol. 2011;45(4):297–300. doi: 10.1097/MCG.0b013e3182098e07. [DOI] [PubMed] [Google Scholar]