Abstract
Introduction: Alzheimer's disease, being the most frequent cause of dementia in elderly people, still is difficult to diagnose and to predict its occurrence. The clinical application of biomarkers for diagnosis of Alzheimer's disease has been restricted so far to the analysis of proteins in the cerebrospinal fluid like amyloid β1−42 and p-tau. However, in a recently published nature letter it has been shown that the high-performance measurement of amyloid-β in plasma alone could provide a method well suited for a broad clinical application. The study uses ROC analysis to evaluate the clinical significance of the method but it does not provide likelihood ratios (LR) of the measured results.
Methods: In this article, a newly developed method is used to calculate LRs for any measurement result of a study by approximation of the ROC curves using Bézier curves. Such LRs provide an estimation of the clinical significance of any particular test result by applying Bayes' theorem: Pretest odds for disease multiplied by the LR of the test result give the posttest odds.
Results: The application of the Bézier curve approximation to the data of the plasma amyloid-β study is demonstrated. To generalize the calculation of LRs for all test results, a relation between the test results and the points on the Bézier curve with their LRs is established.
Discussion: The application of Bézier curves in ROC analysis allows calculating LRs for all individual test results when measuring amyloid-β biomarkers for Alzheimer's disease.
Keywords: Alzheimer's disease, Bézier curves, biomarkers, likelihood ratios, ROC curves
Background
The clinical application of biomarkers for diagnosis of Alzheimer's disease (Prince et al., 2013; Scheltens et al., 2016) is mainly based on the analysis of amyloid β1−42 and p-tau in the cerebrospinal fluid (Ewers et al., 2015; Skillbäck et al., 2015). However, to avoid the necessity of gaining cerebrospinal fluid it would be desirable to have diagnostic tests based on peripheral blood. Biomarkers in the peripheral blood have so far only been found with a proteomic approach (Doecke et al., 2012; Lista et al., 2013). Now, in a recent publication it has been shown that the high-performance measurement of amyloid-β in plasma alone could provide a method for clinical application (Nakamura et al., 2018). However, the study using ROC analysis for evaluation of the clinical significance of the method does not provide likelihood ratios (LR) of the measured results. LRs are defined by the frequency of a particular test result in the diseased vs. non-diseased population and are used to estimate the clinical significance of the test results. LRs serve to calculate the posttest odds for Alzheimer's disease by multiplying the pretest odds with the calculated LR of the test according to Bayes' theorem (Van Der Helm and Hische, 1979).
When a cut-off is defined to distinguish positive from negative results of a test, the ROC analysis provides the sensitivity (Se) and specificity (Sp) of such qualitative results. LRs of positive and negative results are LR+ = Se/(1-Sp) and LR− = (1-Se)/Sp. However, these LRs only are an average over all positive or negative results. When looking at a particular quantitative test result, it would be desirable to know the LR of that particular result. On the ROC curve such a LR is equal to the slope of the tangent to the ROC curve at the point that corresponds to the test result (Choi, 1998). LRs of test results higher than the optimal cut-off range between 1 and ∞, whereas LRs of negative test results range between 1 and 1/∞. Remarkably, the plasma amyloid-β study (Nakamura et al., 2018) provides all raw data of the ROC curves, so that such LRs can be calculated based on these data. Here, a newly developed method is used to calculate LRs for any quantitative test results by approximation of the ROC curves using Bézier curves (Fierz, 2018).
Methods
The data used from the plasma amyloid-β study (Nakamura et al., 2018) concern the 11C-labeled Pittsburgh compound-B - positron-emission tomography (PiB-PET) data set, since the primary aim of the study was to assess the performance of plasma-Aβ biomarkers for determining an individual's status of Aβ deposition, using PiB-PET as the standard of truth. The results of the study were externally validated using an independent data set derived from the Australian Imaging, Biomarker and Lifestyle Study of Ageing (AIBL) cohort (Ellis et al., 2009).
In order to calculate the LR of a specific plasma amyloid-β test result, the tangent to the ROC curve at the point corresponding to the point on the ROC curve has to be determined. For this and for calculating the slope of the tangent, Bézier curves can be used, as recently described (Fierz, 2018) and is demonstrated here. The mathematical basis for Bézier curves are the Bernstein polynomials (Casselman, 2008). Bernstein polynomials of degree n are defined by
For the purpose here, cubic Bézier curves are used, which are defined by 4 control points P0, P1, P2, and P3 and a variable t that define the tangent to a specific point on the curve as described in Figure 1. The cubic Bernstein polynomial is
The variable t of the Bernstein polynomials has to be introduced and is defined here by t = (1-Sp+Se)/2 of the empirical ROC points. With the de Casteljau algorithm (Casselman, 2008) it is possible to construct a Bézier curve or to find a particular point on the Bézier curve (Figure 1).
Results
The application of the Bézier curve approximation to the data of the plasma amyloid-β study is demonstrated in Figure 2. The x and y parameters for P0, P1, P2, and P3 are calculated according to the method of (Fierz, 2018) and are displayed in Table 1 for the composite score and Aβ1−40 / Aβ1−42 ratio in the AIBL(PiB) validation data set of the plasma amyloid-β study.
Table 1.
Validation: AIBL(PiB) | Composite score | Ab1−40/Ab1−42 Ratio | ||
---|---|---|---|---|
x | y | x | y | |
P0 | 0.000 | 0.312 | 0.000 | 0.014 |
P1 | 0.039 | 0.727 | −0.007 | 0.755 |
P2 | 0.067 | 0.995 | 0.192 | 1.067 |
P3 | 0.511 | 1.000 | 0.961 | 1.000 |
To generalize the calculation of LRs for all test results, a relation between the test results and the points on the Bézier curve with their LRs had to be found. The best approximation was found by introducing a parameter λ = 1/(1+LR) and using a cubic regression between test results x and λ resulting in:
λ = ax3 + bx2 + cx + d with coefficients given in Table 2.
Table 2.
x | a | b | c | d | R2 |
---|---|---|---|---|---|
Aβ1−40/Aβ1−42 | 0.00015189 | −0.010320125 | 0.154661878 | 0.69895132 | 0.9984 |
Composite score | −1.009861 | 2.267549089 | −2.448933781 | 1.25118718 | 0.9942 |
The thereby calculated LR = (1–λ)/λ are depicted in Figure 3.
In the following, two examples are calculated using Bayes' theorem (Van Der Helm and Hische, 1979):
Pretest odds for disease multiplied by the LR of the test result give the posttest odds.
First, taking the prevalence of ~7% in people over 60 years in Western Europe or North America (Prince et al., 2013) as a pretest probability Table 3 shows the posttest odds and probabilities for various Aβ1−40/Aβ1−42 ratios.
Table 3.
Pretest | Ab1−40/Ab1−42 | Posttest | ||||
---|---|---|---|---|---|---|
Prevalence | Odds | Ratio | λ | LR | Odds | Probability% |
7% | 7:93 = 0.075 | 20 | 0.879 | 0.14 | 0.010 | 1 |
23 | 0.645 | 0.55 | 0.041 | 4 | ||
25 | 0.489 | 1.05 | 0.079 | 7 | ||
27 | 0.341 | 1.93 | 0.145 | 13 | ||
30 | 0.152 | 5.60 | 0.421 | 30 | ||
Probability | Odds | Aβ1−40/Aβ1−42 | λ | LR | Odds | Probability% |
50% | 1:1 = 1 | 20 | 0.879 | 0.14 | 0.137 | 12 |
23 | 0.645 | 0.55 | 0.551 | 36 | ||
25 | 0.489 | 1.05 | 1.047 | 51 | ||
27 | 0.341 | 1.93 | 1.932 | 66 | ||
30 | 0.152 | 5.60 | 5.596 | 85 |
Second, assuming pretest odds of 1:1, Table 3 shows the posttest odds and probabilities for various Aβ1−40/Aβ1−42 ratios.
Conclusions
A distribution-free method, based on Bézier curves, to calculate likelihood ratios for quantitative laboratory test results in medical diagnosis (Fierz, 2018) is applied here for Alzheimer's diagnosis based on the results of the plasma amyloid-β study (Nakamura et al., 2018). The advantage of the method is that it is generally applicable independently and without knowledge of the test parameter distribution in the population. The crucial benefit of this procedure is that Bézier curves are constructed by tangents to the ROC curve, whose slopes immediately provide the likelihood ratios of a specific point on the curve. The merit of using likelihood ratios in addition to or even instead of quantities like mg/L or nmol/L as test results lies in the comparability of different test methods and different test suppliers, which is an unsolved problem of standardization in laboratory medicine.
In conclusion, the application of Bézier curves in ROC analysis (Fierz, 2018) allows to calculate LRs for all individual test results when measuring amyloid-β biomarkers for Alzheimer's disease. LRs allow estimating the posttest odds for Alzheimer's disease by multiplying the pretest odds with the calculated LR. Such LRs provide an estimation of the clinical significance of any particular test result by applying Bayes' theorem (Van Der Helm and Hische, 1979):
Pretest odds for disease multiplied by the LR of the test result give the posttest odds.
Data availability statement
All relevant data are within the paper or in referenced source.
Author contributions
The author confirms being the sole contributor of this work and has approved it for publication.
Conflict of interest statement
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The author would like to extend many thanks to Aki Nakamura and his coworkers for providing the amyloid-β study data.
Glossary
Abbreviations
- ROC
Receiver Operating Characteristics
- LR
Likelihood Ratio
- Se
sensitivity
- Sp
specificity
- PiB-PET
Pittsburgh compound-B - positron-emission tomography
- AIBL
Australian Imaging, Biomarker and Lifestyle Study of Ageing.
References
- Casselman B. (2008). From Bézier to Bernstein. American Mathematical Society. Available online at: http://www.ams.org/publicoutreach/feature-column/fcarc-bezier (Accessed February 11, 2018)
- Choi B. C. (1998). Slopes of a receiver operating characteristic curve and likelihood ratios for a diagnostic test. Am. J. Epidemiol. 148, 1127–1132. 10.1093/oxfordjournals.aje.a009592 [DOI] [PubMed] [Google Scholar]
- Doecke J. D., Laws S. M., Faux N. G., Wilson W., Burnham S. C., Lam C. P., et al. (2012). Blood-based protein biomarkers for diagnosis of Alzheimer disease. Arch. Neurol. 69, 1318–1325. 10.1001/archneurol.2012.1282 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ellis K. A., Bush A. I., Darby D., De Fazio D., Foster J., Hudson P., et al. (2009). The Australian Imaging, Biomarkers and Lifestyle (AIBL) study of aging: methodology and baseline characteristics of 1112 individuals recruited for a longitudinal study of Alzheimer's disease. Int. Psychogeriatrics 21:672. 10.1017/S1041610209009405 [DOI] [PubMed] [Google Scholar]
- Ewers M., Mattsson N., Minthon L., Molinuevo J. L., Antonell A., Popp J., et al. (2015). CSF biomarkers for the differential diagnosis of Alzheimer's disease. A large-scale international multicenter study. Alzheimer's Dement. 11, 1306–1315. 10.1016/j.jalz.2014.12.006 [DOI] [PubMed] [Google Scholar]
- Fierz W. (2018). Likelihood ratios of quantitative laboratory results in medical diagnosis: The application of Bézier curves in ROC analysis. PLoS ONE 13:e0192420. 10.1371/journal.pone.0192420 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lista S., Faltraco F., Prvulovic D., Hampel H. (2013). Blood and plasma-based proteomic biomarker research in Alzheimer's disease. Prog. Neurobiol. 101–102, 1–17. 10.1016/j.pneurobio.2012.06.007 [DOI] [PubMed] [Google Scholar]
- Nakamura A., Kaneko N., Villemagne V. L., Kato T., Doecke J., Doré V., et al. (2018). High performance plasma amyloid-β biomarkers for Alzheimer's disease. Nature 554, 249–254. 10.1038/nature25456 [DOI] [PubMed] [Google Scholar]
- Prince M., Bryce R., Albanese E., Wimo A., Ribeiro W., Ferri C. P. (2013). The global prevalence of dementia: a systematic review and metaanalysis. Alzheimer's Dement. 9, 63–75. 10.1016/j.jalz.2012.11.007 [DOI] [PubMed] [Google Scholar]
- Scheltens P., Blennow K., Breteler M. M. B., de Strooper B., Frisoni G. B., Salloway S., et al. (2016). Alzheimer's disease. Lancet 388, 505–517. 10.1016/S0140-6736(15)01124-1 [DOI] [PubMed] [Google Scholar]
- Skillbäck T., Farahmand B. Y., Rosén C., Mattsson N., Nägga K., Kilander L., et al. (2015). Cerebrospinal fluid tau and amyloid-β 1−42 in patients with dementia. Brain 138(Pt 9), 2716–2731. 10.1093/brain/awv181 [DOI] [PubMed] [Google Scholar]
- Van Der Helm H. J., Hische E. A. (1979). Application of Bayes's theorem to results of quantitative clinical chemical determinations. Clin. Chem. 25, 985–988. [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All relevant data are within the paper or in referenced source.