Abstract
Diagnostic tests commonly are characterized by their true positive (sensitivity) and true negative (specificity) classification rates, which rely on a single decision threshold to classify a test result as positive. A more complete description of test accuracy is given by the receiver operating characteristic (ROC) curve, a graph of the false positive and true positive rates obtained as the decision threshold is varied. A generalized regression methodology, which uses a class of ordinal regression models to estimate smoothed ROC curves has been described. Data from a multi-institutional study comparing the accuracy of magnetic resonance (MR) imaging with computed tomography (CT) in detecting liver metastases, which are ideally suited for ROC regression analysis, are described. The general regression model is introduced and an estimate for the area under the ROC curve and its standard error using parameters of the ordinal regression model is given. An analysis of the liver data that highlights the utility of the methodology in parsimoniously adjusting comparisons for covariates is presented.
Full text
PDF
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Begg C. B. Biases in the assessment of diagnostic tests. Stat Med. 1987 Jun;6(4):411–423. doi: 10.1002/sim.4780060402. [DOI] [PubMed] [Google Scholar]
- Begg C. B., McNeil B. J. Assessment of radiologic tests: control of bias and other design considerations. Radiology. 1988 May;167(2):565–569. doi: 10.1148/radiology.167.2.3357976. [DOI] [PubMed] [Google Scholar]
- Hanley J. A., McNeil B. J. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. 1983 Sep;148(3):839–843. doi: 10.1148/radiology.148.3.6878708. [DOI] [PubMed] [Google Scholar]
- Hanley J. A., McNeil B. J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982 Apr;143(1):29–36. doi: 10.1148/radiology.143.1.7063747. [DOI] [PubMed] [Google Scholar]
- Metz C. E. ROC methodology in radiologic imaging. Invest Radiol. 1986 Sep;21(9):720–733. doi: 10.1097/00004424-198609000-00009. [DOI] [PubMed] [Google Scholar]
- Swets J. A. Indices of discrimination or diagnostic accuracy: their ROCs and implied models. Psychol Bull. 1986 Jan;99(1):100–117. [PubMed] [Google Scholar]
- Tosteson A. N., Begg C. B. A general regression methodology for ROC curve estimation. Med Decis Making. 1988 Jul-Sep;8(3):204–215. doi: 10.1177/0272989X8800800309. [DOI] [PubMed] [Google Scholar]