Skip to main content
Open Research Europe logoLink to Open Research Europe
. 2022 Jan 10;1:146. Originally published 2021 Dec 3. [Version 2] doi: 10.12688/openreseurope.14216.2

Can detection and prediction models for Alzheimer’s Disease be applied to Prodromal Parkinson’s Disease using explainable artificial intelligence? A brief report on Digital Neuro Signatures.

Ioannis Tarnanas 1,a, Panagiotis Vlamos 2, Dr Robbert Harms 1; The RADAR-AD Consortium
PMCID: PMC10445877  PMID: 37645162

Version Changes

Revised. Amendments from Version 1

This version was created to include the addition of the author Dr. Robbert Harms.

Abstract

Parkinson's disease (PD) is the fastest growing neurodegeneration and has a prediagnostic phase with a lot of challenges to identify clinical and laboratory biomarkers for those in the earliest stages or those 'at risk'. Despite the current research effort, further progress in this field hinges on the more effective application of digital biomarker and artificial intelligence applications at the prediagnostic stages of PD. It is of the highest importance to stratify such prediagnostic subjects that seem to have the most neuroprotective benefit from drugs. However, current initiatives to identify individuals at risk or in the earliest stages that might be candidates for future clinical trials are still challenging due to the limited accuracy and explainability of existing prediagnostic detection and progression prediction solutions. In this brief paper, we report on a novel digital neuro signature (DNS) for prodromal-PD based on selected digital biomarkers previously discovered on preclinical Alzheimer's disease. (AD). Our preliminary results demonstrated a standard DNS signature for both preclinical AD and prodromal PD, containing a ranked selection of features. This novel DNS signature was rapidly repurposed out of 793 digital biomarker features and selected the top 20 digital biomarkers that are predictive and could detect both the biological signature of preclinical AD and the biological mechanism of a-synucleinopathy in prodromal PD. The resulting model can provide physicians with a pool of patients potentially eligible for therapy and comes along with information about the importance of the digital biomarkers that are predictive, based on SHapley Additive exPlanations (SHAP). Similar initiatives could clarify the stage before and around diagnosis, enabling the field to push into unchartered territory at the earliest stages of the disease.

Keywords: prediagnostic Parkinson's disease, digital neuro signatures, prodromal Parkinson's disease

Introduction

Parkinson's disease (PD) prevalence rate increases with age and rises from about 1% in individuals aged ≥60 years to 3.5% in older adults of 85–89 years 13 . The complexity of cross-sectional diagnosis is stereotypically exemplified in PD, which happens to be the second-most common neurodegenerative disorder after Alzheimer's disease 46 . The pathological hallmark of PD is misfolded α-synuclein protein (aSyn) structures, and the gold standard for diagnosis is their identification in post mortem pathological examinations of the brain 7 . However, given that most idiopathic patients experience years or sometimes decades of unspecific symptomology, the field of prediagnostic Parkinson's disease (prodromal-PD) is fast-moving with multiple strategies seeking to discover a panel of clinical and laboratory biomarkers for those 'at risk' 8 . Prodromal-PD 9 is when individuals do not fulfill diagnostic criteria for PD ( i.e., bradykinesia and at least one other motor sign) but exhibit signs and symptoms that indicate a higher-than-average risk of developing motor symptoms and a diagnosis of PD in the future. Presently, most imaging markers across a range of modalities and the emerging literature on fluid and peripheral tissue biomarkers is limited in predicting prodromal-PD, pointing to the need to identify robust predictors of change across the entire spectrum from ordinary to symptomatic PD for more realistic primary or secondary preventive trials for PD 10 .

Consequently, longitudinal measures of pre-motor symptoms and behavioral/cognitive decline are essential for evaluating preclinical markers and monitoring prodromal-PD progression. Such longitudinal characterization of non-motor features has been identified by the Movement Disorders Society (MDS) as being valuable for early identification of PD, according to the research criteria for prodromal PD 11 , which include two types of measurements: the delineation of the relative temporal trajectories of specific quiet motor and non-motor features that can be present before diagnosis and the fluctuation of those features over time within and across neurocognitive domains 12 . The utility of such markers in evaluating prodromal-PD progression depends on early symptoms and signs before PD diagnosis is possible and may vary across different primary care settings 12 . The utility of such markers in evaluating prodromal-PD progression depends on early symptoms and signs before PD diagnosis is possible and may vary across different primary care settings 12 . However, intra-individual variability (IIV) across several measurements, called dispersion, is a sensitive marker for detecting change even at prodromal stages of a disease 13 . One digital biomarker tool that utilizes dispersion to provide such measurements is the Altoida Digital Neuro Signatures platform (DNS), a more efficient, accurate, and sensitive assessment of cognitive function than traditional neuropsychological tests, both in cross-sectional and longitudinal evaluations 14 . Previous studies have validated the machine learning model's performance to measure dementia disease progression and detect the biological signature of prodromal AD, which predicts conversion from mild cognitive impairment (MCI) to Alzheimer's disease (AD) with 94% prognostic accuracy 15 .

In this work, we will briefly report on DNS signature similarities from previous studies and the dataset collected in The ANANEOS Project, an ambitious longitudinal community-based study for healthy aging in Greece. The project is part of the GR2021 Priority project Healthy Brains for Life (age 20–99 years) and focuses on the decentralized and remote assessment of the symptoms of preclinical stages in Alzheimer's disease and movement disorders, e.g., Parkinson's, with a rationale and a methodology similar to other international initiatives. Relevant examples of similar large-scale national initiatives can be found in Japan with the IROOP registry system for identifying risk factors for dementia 16 , the Sydney (Australia) memory and ageing study 17 , the Framingham heart study in the USA 18 , the UK Biobank study of lifestyle and genetic factors incidence in dementia 19 , the European Prevention of Alzheimer’s Dementia Longitudinal Cohort Study 20 , the FINGER project in Finland 21 , the INTERCEPTOR Project in Italy 22 or The Vallecas Project in Spain 23 .

The emergence of large longitudinal primary care cohorts, alongside advances in digital biomarkers and artificial intelligence (AI), has allowed detailed exploration of the full range of early motor and non-motor symptoms that predate PD. In contrast, advanced prodromal PD detection and prediction models could become a platform for medical practitioners that plan to diagnose or detect the disease earlier and more accurately. Despite the enthusiasm that objective motor dysfunction occurs prior to diagnosis in PD and the variety of measuring devices, which have been developed, including software applications that harness passive and active digital biomarkers, e.g. activity and motion (and in some cases speech) captured by smartphones and tablet devices, custom-built sensors that measure gait, bradykinesia, dyskinesia, and nocturnal movement detection devices, there are currently very few examples of the application of wearable devices or AI models in prediagnostic PD.

Our goal here was to answer the single question: Can detection and prediction models for Alzheimer's disease be rapidly applied to prodromal Parkinson's disease using explainable artificial intelligence? A major foreseeable hurdle is ensuring that any detection and prediction model focuses both on improving the system performance and AI interpretability, employing natural language explanations, which could help physicians understand the predictions. For the answer above, we focused on DNS signature patterns between our existing databases and ANANEOS using permutation-based techniques to help us understand the actual effect of the predictors (DNS signatures from the existing AD database) in the target database (preclinical markers that predict Prodromal-PD progression).

Methods

Data collection

We used a combination of clinical and population data, collected and provided by Altoida, Inc. The clinical data (n=438) is described in previous studies 15 and consists of controlled tests of elderly (≥50 years) subjects with known biological and psychological biomarkers ( e.g., MCI, amyloid-beta (Ab)+, Ab-, AD). We used the dataset described as "New validation study" (ClinicalTrials.gov Identifier: NCT02843529) for this work, the original purpose of which was to evaluate the performance of Altoida's application as an adjunctive tool for diagnosing AD. This data was collected in various major cities in Italy, Greece, Spain, USA, and Ireland.

The dataset above was enriched with two more databases:

  • 1)

    A clinical dataset called RADAR-AD. RADAR-AD is a multicentre observational, cross-sectional, cohort study in subjects within the preclinical-to-moderate AD spectrum as well as healthy controls. The design entails three tiers: (1) main study, which includes smartphone applications and wearable devices only; (2) first sub-study, which in addition includes fixed sensors at the participant’s home; and (3) second sub-study, which in addition includes fixed sensors in an existing smart home environment. Participating clinical sites were selected based on their geographic location, expertise in digital technologies and disease population of interest, and the availability of clinical cohorts with known AD biomarkers 24 .

  • 2)

    A population dataset collected by Altoida named "healthy basket." A healthy basket is a population sample consisting of middle-aged cognitively healthy Japanese subjects (n=130). The inclusion criteria for participation were age 20–50 years and self-assessed cognitively healthy ( i.e., no known cognitive disorders). The subjects received no stipend for participation, and permission for scientific studies was provided by accepting the terms and conditions of Altoida, Inc. All subject information was anonymized and de-identified. Beyond the digital biomarkers collected by the Altoida application, no further biomarkers were recorded for this population sample. For both datasets, the subject's sex was self-reported. All subjects (of both groups) performed multiple test sessions using Altoida's application.

Finally, the target database was part of the Digitally enhanced, Decentralized, Multi-omics Observational Cohort (ANANEOS) study. ANANEOS is an ongoing single-centre, observational, longitudinal cohort (n=500,000) for individuals (aged ≥50 years) with a ClinicalTrials.gov Identifier: NCT04701177. The participants, recruited initially since March 2021 in Athens, Greece, are home-dwelling volunteers with known biological and psychological biomarkers at the preclinical stages in Alzheimer's disease and movement disorders, e.g., Parkinson's, without relevant psychiatric, neurological, or systemic disorders. The initial cohort size was 2,180 subjects at baseline. At the time of this writing (10/13/2021), the project is in the first wave of the 24-week follow-up visits (n=133).

Table 1 describes our data characteristics for the entire sample and stratified by sex, with univariate comparisons. Our data consists of 788 subjects combined from three datasets, two clinical datasets 15, 24 and a healthy population dataset. Subjects were distributed over several stages of the AD clinical continuum, namely healthy, preclinical AD Ab+, MCI (amyloid-βnegative) Ab-, MCI Ab+, dementia due to AD and prodromal PD as reported by clinical assessment. To counter the imbalance from multiple data points per subject and combining two demographically different datasets, we stratified all analysis by dataset, sex, and number of data points. This ensures that we have exactly the same number of data points from each sex and from each study (clinical and population). The flowchart showing the overall dataset structure and the prelim study purpose is shown in Figure 1.

Figure 1. Flowchart showing the overall dataset structure and the prelim study purpose.

Figure 1.

Table 1. Data characteristics.

P-value is calculated using a two-sided t-test for age, chi2 for status and the Mann-Whitney rank test for the number of data points per subject.

Men Women Total p-value
Population Clinical data N (%) 280 (42%) 378 (58%) 658 1.2e-12
Population data N (%) 94 (72%) 36 (28%) 130
ANANEOS N (%) 66 (50%) 67 (50%) 133
Age Mean (SD) 56.9 (17.4) 62.7 (12.8) 60.1 7.5e-06
Status Healthy N (%) 198 (45%) 237 (55%) 435 0.786
Preclinical AD N (%) 103 (46%) 117 (54%) 220
MCI ab- N (%) 16 (38%) 26 (62%) 42
MCI ab+ N (%) 35 (44%) 43 (56%) 78
AD N (%) 5 (38%) 8 (62%) 13
Prodromal PD N (%) 13 (54%) 11 (46%) 24
Number of DNS trials (data points) N (%) 1448 (52%) 1359 (48%) 2807 -
Number of DNS trials (data points) per subject Median (IQR) 2 (4) 2 (5) 2 (3) 2.8e-05

Digital neuro signatures (DNS)

For this work, we repurposed data from Altoida’s application which collects digital biomarkers for neurocognitive function measurement and predictive diagnosis of AD 15 . Altoida's application collects digital biomarker data for detecting early-onset AD. While holding a tablet or smartphone device, the subject is asked to perform a series of motor functioning tasks and two augmented reality (AR) tasks. In the motor functioning tasks, the subject is required to draw shapes and tap on the (touch)screen using the finger of their dominant hand (see Figure 2 for an illustration of all the motor functioning tasks). In one of the AR tasks, the subject is asked to place three virtual objects in a small space (approximately 3×3 m or 2×4 m) and afterward find them again. The AR task is performed by navigating around the space with the tablet or smartphone in both hands (see Figure 3). During these tasks, the handheld device collects telemetry and touch data from the built-in sensors, enabling profiling of hand micro-movements, screen-touch pressures, walking speed, navigation trajectory, cognitive processing speed, and additional proprietary inputs.

Figure 2. The motoric functioning tasks in the Altoida test.

Figure 2.

These are executed one after another. Using their index finger of their dominant hand, from left to right, the task is to 1) draw a circle, 2) draw a square, 3) draw a rotated W shape within 7 seconds, 4) draw as many circles as possible within 7 seconds, 5) tap the highlighted buttons (left, right, left, right, etc.) 6) tap the highlighted button as fast as possible, the buttons highlight at random.

Figure 3. Illustration of the Augmented Reality (AR) task in the Altoida test.

Figure 3.

During the AR test, the subject is asked to place and find three virtual objects in the room. To do so, the subject is required to walk around the room holding a tablet or smartphone device in front of him/her. While doing so, the camera of the device records the environment and displays it back to the user on the screen, augmented with virtual objects (in this illustration, a teddy bear). The user needs to place the objects on flat surfaces and later recall their position by walking back to that location.

A single test session using Altoida’s application consists of two batches of motor tasks and two AR tasks. After a subject completes all tasks, the recorded digital biomarker data from the onboard electronics sensors is bundled and securely and anonymously uploaded to a server for further processing. Provided the data of multiple subjects, machine learning can be used to detect patterns. In previous work machine learning was either used to classify subjects as healthy or at risk of AD 15 . In this work, we examined DNS signatures from our development dataset for AD to see if they demonstrated preclinical markers that predict prodromal-PD progression, expressed by the capacity of results to inform a novel prodromal-PD DNS signature.

Machine learning

We extracted 793 digital biomarker features from the onboard electronics sensors describing various cognitive, functional, and physiological characteristics of each subject. These features include response times, eye-hand coordination precision, fluctuations in the telemetry (accelerometer and gyroscope) data, Fourier analysis of the telemetry data, step detection, and additional proprietary data. Based on the digital biomarker feature data from a selection of healthy subjects, we trained a DNS-match classifier to distinguish prodromal-PD individuals from any other group. We used the XGBoost algorithm 25 with DNS preclinical markers that predict prodromal-PD as the target variable for the classification.

Performance evaluation

We applied stratified five-fold grouped cross-validation to estimate the generalization performance of the DNS prodromal-PD classifier. We grouped data points by subject to ensure that multiple data points of a single subject were all in the same fold (either training or testing), preventing learning bias. For our prodromal-PD classifier, we measured accuracy and precision averaged over the five cross-validation testing folds. To assess the classifier's performance on different age groups, we trained nine additional classifiers (10 in total), each using different random subsets of the data.

Model explainability

We used the Shapley Additive exPlanations (SHAP) 26 method to better understand the predictions made by the DNS prodromal-PD classifier. The SHAP method allocates to each feature of a classifier a game-theoretical value representing the contribution of that feature towards the classification targets. The sign of the SHAP values indicates the direction of the contribution, and the magnitude of the SHAP value indicates the importance. For our classifier, negative SHAP values contribute to classifying as non-prodromal-PD, positive numbers towards prodromal-PD. SHAP values have an additive property meaning they can be summed together to provide the feature contribution of a group of features 27 .

Results

Common DNS signature for preclinical AD and prodromal PD and features contribution

We wanted to investigate whether detection and prediction models for Alzheimer's Disease can be rapidly applied to prodromal PD using explainable artificial intelligence. The analysis of our prodromal PD classifier revealed at least 20 common features that are the same for both preclinical AD and prodromal PD. After computing a SHAP value for each DNS signature containing more than 793 features from our development dataset, we arrived at this conclusion. We compared them with a novel prodromal-PD classifier, which detected a DNS signature in the ANANEOS validation dataset. We then investigated, which of the 793 features contain the most relevant preclinical markers that predict prodromal-PD. Figure 4 shows a grouping of those features that were ranked as having the highest overall contribution in the classifier.

Figure 4. Feature importance of the Prodromal-PD classifier.

Figure 4.

A) The top twenty feature groups according to the SHAP method. Each bar represents the summed SHAP value of the features in that feature group. B) A feature value SHAP distribution plot for the top five contributing features. Subject specific SHAP values were computed for each datapoint in the classifier training data. For each feature, we then plot for each datapoint a dot with the feature value of that datapoint, with the dot color coded by the relative feature value. The position of each dot on the SHAP value x-axis represents the magnitude and the direction of the contribution of that specific feature value of that specific datapoint towards classifying as female (-1) or male (+1). Acronyms in the plots are Augmented Reality (AR), Fast Fourier Transform (FFT), SHapley Additive exPlanations (SHAP), Accelerometer (ACC), variance (var), first part of a single test (1st) or second part of a single test (2nd).

The primary contributing group of features is named the ignore high tone percentage and the AR object placement directness. This group consists of an interference index (non-motor feature) and a set of frequency magnitudes obtained while the participant moves around trying to find a virtual object in the AR test (motor feature). These features could therefore be interpreted as a brain network function and navigation micro-errors. The second most important group of digital biomarker features is the AR global telemetry variance. The global telemetry variance is the variance in the accelerometer and gyroscope signal over the entire duration of the AR task. It could be interpreted as coarse-scale hand motion micro-movement (motor feature). The third and fourth most essential features are frequency magnitudes during object placement, belonging to the top group placing virtual objects in the AR test, collected using a fast Fourier transform (FFT) on the measured accelerometer and gyroscope signal over 1.28 seconds before placing (motor feature). The remaining elements of the novel DNS prodromal-PD signature are taking into account age and group together "Motor test drawing features" to consider the speed and accuracy of the subject while drawing various patterns with the index finger (motor feature). The "Circle drawing test" measures how long the user spent within the limits of the circle while performing the motor tests.

Conclusion

Our work demonstrates that it is possible to detect a novel DNS signature from existing datasets using digital biomarker data collected from Altoida's application. The intrinsic similarities between preclinical AD markers and preclinical markers that predict prodromal-PD seem to be capturing quiet motor and non-motor features dependent on age. In the prediagnostic Parkinson's Disease population, the primary differentiating features are micro-errors and micro-movements detectable by Fourier analysis on accelerometer data, although they are non-visible to the naked eye. Such prelim results can provide physicians with some insights into driving factors of our prediction model from multiple points of view including visualization, and feature importance based on SHapley Additive exPlanations (SHAP). Further validation is pending upon larger sample size and multiple additional biological markers and endpoints.

Data availability

The data that support the findings of this study are available from Altoida Inc., but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of the RADAR-AD consortium.

Disclaimer

This communication reflects the views of the RADAR-AD consortium and neither IMI nor the European Union and EFPIA are liable for any use that may be made of the information contained herein.

Link to IMI website

www.imi.europa.eu

Acknowledgments

The RADAR-AD project has received funding from the Innovative Medicines Initiative 2 Joint Undertaking under grant agreement No 806999. This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation programme and EFPIA and their associated partners.

Funding Statement

This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No 806999).

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 2; peer review: 2 approved]

References

  • 1. de Lau LM, Breteler MM: Epidemiology of Parkinson's disease. Lancet Neurol. 2006;5(6):525–35. 10.1016/S1474-4422(06)70471-9 [DOI] [PubMed] [Google Scholar]
  • 2. de Rijk MC, Tzourio C, Breteler MM, et al. : Prevalence of parkinsonism and Parkinson's disease in Europe: the EUROPARKINSON Collaborative Study. European Community Concerted Action on the Epidemiology of Parkinson's disease. J Neurol Neurosurg Psychiatry. 1997;62(1):10–5. 10.1136/jnnp.62.1.10 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Twelves D, Perkins KSM, Counsell C: Systematic review of incidence studies of Parkinson's disease. Mov Disord. 2003;18(1):19–31. 10.1002/mds.10305 [DOI] [PubMed] [Google Scholar]
  • 4. Heinzel S, Roeben B, Ben-Shlomo Y, et al. : Prodromal markers in Parkinson's disease: limitations in longitudinal studies and lessons learned. Front Aging Neurosci. 2016;8:147. 10.3389/fnagi.2016.00147 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Obeso JA, Stamelou M, Goetz CG, et al. : Past, present, and future of Parkinson's disease: a special essay on the 200th Anniversary of the Shaking Palsy. Mov Disord. 2017;32(9):1264–310. 10.1002/mds.27115 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Chin-Chan M, Navarro-Yepes J, Quintanilla-Vega B: Environmental pollutants as risk factors for neurodegenerative disorders: Alzheimer and Parkinson diseases. Front Cell Neurosci. 2015;9:124. 10.3389/fncel.2015.00124 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Rees RN, Acharya AP, Schrag A, et al. : An early diagnosis is not the same as a timely diagnosis of Parkinson's disease [version 1; peer review: 2 approved]. F1000Res. 2018;7:F1000 Faculty Rev-1106. 10.12688/f1000research.14528.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Noyce AJ, Lees AJ, Schrag A: The prediagnostic phase of Parkinson's disease. J Neurol Neurosurg Psychiatry. 2016;87(8):871–878. 10.1136/jnnp-2015-311890 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Chaudhuri KR, Sauerbier A: Parkinson disease. Unravelling the nonmotor mysteries of Parkinson disease. Nat Rev Neurol. 2016;12(1):10–1. 10.1038/nrneurol.2015.236 [DOI] [PubMed] [Google Scholar]
  • 10. Noyce AJ, Bestwick JP, Silveira-Moriyama L, et al. : PREDICT-PD: Identifying risk of Parkinson's disease in the community: methods and baseline results. J Neurol Neurosurg Psychiatry. 2013;85(1):31–7. 10.1136/jnnp-2013-305420 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Berg D, Postuma RB, Adler CH, et al. : MDS research criteria for prodromal Parkinson's disease. Mov Disord. 2015;30(12):1600–11. 10.1002/mds.26431 [DOI] [PubMed] [Google Scholar]
  • 12. Schrag A, Horsfall L, Walters K, et al. : Prediagnostic presentations of Parkinson's disease in primary care: a case-control study. Lancet Neurol. 2015;14(1):57–64. 10.1016/S1474-4422(14)70287-X [DOI] [PubMed] [Google Scholar]
  • 13. Balestrino R, Hurtado-Gonzalez CA, Stocchi F, et al. : Applications of the European Parkinson's Disease Association sponsored Parkinson's Disease Composite Scale (PDCS). NPJ Parkinsons Dis. 2019;5:26. 10.1038/s41531-019-0097-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Meier IB, Buegler M, Harms R, et al. : Using a Digital Neuro Signature to measure longitudinal individual-level change in Alzheimer's disease: the Altoida large cohort study. NPJ Digit Med. 2021;4(1):101. 10.1038/s41746-021-00470-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Buegler M, Harms RL, Balasa M, et al. : Digital biomarker-based individualized prognosis for people at risk of dementia. Alzheimers Dement (Amst). 2020;12(1):e12073. 10.1002/dad2.12073 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Ogawa M, Maruo K, Sone D, et al. : Longitudinal analysis of risk factors for dementia based on Mild Cognitive Impairment Screen results and questionnaire responses from healthy Japanese individuals registered in an online database. Alzheimers Dement (N Y). 2019;5:347–353. 10.1016/j.trci.2019.06.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Sachdev PS, Brodaty H, Reppermund S, et al. : The Sydney Memory and Ageing Study (MAS): methodology and baseline medical and neuropsychiatric characteristics of an elderly epidemiological non-demented cohort of Australians aged 70-90 years. Int Psychogeriatr. 2010;22(8):1248–64. 10.1017/S1041610210001067 [DOI] [PubMed] [Google Scholar]
  • 18. Peloso GM, Beiser AS, Satizabal CL, et al. : Cardiovascular health, genetic risk, and risk of dementia in the framingham heart study. Neurology. 2020;95(10):e1341–e1350. 10.1212/WNL.0000000000010306 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Lourida I, Hannon E, Littlejohns TJ, et al. : Association of lifestyle and genetic risk with incidence of dementia. JAMA. 2019;322(5):430–437. 10.1001/jama.2019.9879 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Solomon A, Kivipelto M, Molinuevo JL, et al. : European Prevention of Alzheimer's Dementia Longitudinal Cohort Study (EPAD LCS): study protocol. BMJ Open. 2018;8(12):e021017. 10.1136/bmjopen-2017-021017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Rosenberg A, Mangialasche F, Ngandu T, et al. : Multidomain Interventions to Prevent Cognitive Impairment, Alzheimer's Disease, and Dementia: From FINGER to World-Wide FINGERS. J Prev Alzheimers Dis. 2020;7(1):29–36. 10.14283/jpad.2019.41 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Rossini PM, Cappa SF, Lattanzio F, et al. : The Italian INTERCEPTOR Project: From the Early Identification of Patients Eligible for Prescription of Antidementia Drugs to a Nationwide Organizational Model for Early Alzheimer's Disease Diagnosis. J Alzheimers Dis. 2019;72(2):373–388. 10.3233/JAD-190670 [DOI] [PubMed] [Google Scholar]
  • 23. Olazarán J, Valentí M, Frades B, et al. : The Vallecas Project: A Cohort to Identify Early Markers and Mechanisms of Alzheimer's Disease. Front Aging Neurosci. 2015;7:181. 10.3389/fnagi.2015.00181 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Muurling M, de Boer C, Kozak R, et al. : Remote monitoring technologies in Alzheimer's disease: design of the RADAR-AD study. Alzheimers Res Ther. 2021;13(1):89. 10.1186/s13195-021-00825-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Chen T, Guestrin C: XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York, NY USA: ACM.2016;785–794. 10.1145/2939672.2939785 [DOI] [Google Scholar]
  • 26. Lundberg SM, Lee SI: A Unified Approach to Interpreting Model Predictions.In: Guyon, I.; Luxburg, U. V.; Bengio, S.; Wallach, H.; Fergus, R.; Vishwanathan, S. & Garnett, R. (Ed.), Advances in Neural Information Processing Systems. 30, Curran Associates, Inc.. 2017. Reference Source [Google Scholar]
  • 27. Lundberg SM, Erion G, Chen H, et al. : From Local Explanations to Global Understanding with Explainable AI for Trees. Nat Mach Intell. 2020;2(1):56–67. 10.1038/s42256-019-0138-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
Open Res Eur. 2022 Jan 10. doi: 10.21956/openreseurope.15552.r28293

Reviewer response for version 2

Adria Tort 1

I accept the addition of the new co-author.

Is the study design appropriate and does the work have academic merit?

Yes

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Neuropsychology, Alzheimer's disease, Dementia, Biomarkers, early detection

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Open Res Eur. 2021 Dec 22. doi: 10.21956/openreseurope.15331.r28136

Reviewer response for version 1

Adria Tort 1

Tarnanas et al. present an interesting study on the application of Alzheimer’s disease detection and prediction models for the identification and monitoring of prodromal stages of Parkinson’s disease. The use of IA-driven assessments on these populations provides an alternative method for detecting subtle cognitive deficits preceding the symptomatic phases of Parkinson’s disease in a more sensitive way that the one provided by standard neuropsychological measures. The predictive value of the digital neuro signature (DNS) appears very promising. This is an interesting, well-justified and well-reported and analyzed large-scale study and deserves indexing.

I would like to ask the authors some questions:

  • Cognitive performance is strongly correlated with age. Also, the use of novel devices and techniques in older adults may be mediated by the participant’s skills and familiarization. How do the authors think this could impact task sensitivity and specificity? How easy-to-run is the Altoida’s application and how learning effects were controlled?

  • The present findings are in line with previous studies suggesting that individuals within the preclinical phase of Alzheimer’s disease may exhibit subtle motor dysfunction (Albers et al., 2015; Buchman & Bennett, 2011) and that intrasubject variability (i.e., the inconsistency of performance) might be a more relevant marker of early AD than motor speed (Verghese et al., 2008; Mollica et al., 2019). Also, another less-studied variable such as multitasking performance appears to be a sensitive indicator of subtle dysfunction. Notwithstanding the conclusion that the DNS seems to be a valid probe of early cognitive changes in at-risk populations, do the authors think that further research is needed to isolate the critical elements of presymptomatic evaluation?

  • How do the authors think that their approach could be effectively implemented in both clinical (e.g., primary care) and research (e.g., clinical trials) settings?

Finally, I would like to congratulate the authors for this interesting report and encourage them on providing further insights for this potential digital biomarker.

Is the study design appropriate and does the work have academic merit?

Yes

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Neuropsychology, Alzheimer's disease, Dementia, Biomarkers, early detection

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

References

  • 1. : At the interface of sensory and motor dysfunctions and Alzheimer's disease. Alzheimers Dement .2015;11(1) : 10.1016/j.jalz.2014.04.514 70-98 10.1016/j.jalz.2014.04.514 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. : Loss of motor function in preclinical Alzheimer's disease. Expert Rev Neurother .2011;11(5) : 10.1586/ern.11.57 665-76 10.1586/ern.11.57 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. : Gait dysfunction in mild cognitive impairment syndromes. J Am Geriatr Soc .2008;56(7) : 10.1111/j.1532-5415.2008.01758.x 1244-51 10.1111/j.1532-5415.2008.01758.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. : Early detection of subtle motor dysfunction in cognitively normal subjects with amyloid-β positivity. Cortex .121: 10.1016/j.cortex.2019.07.021 117-124 10.1016/j.cortex.2019.07.021 [DOI] [PubMed] [Google Scholar]
Open Res Eur. 2021 Dec 22.
Ioannis TARNANAS 1

Dear Dr. Tort, many thanks for your thorough review and excellent questions. We would like to address them here for your attention:

  • Learning effects and the influence of tech literacy have indeed being measured through another study performed by an independent third party. Since this is a brief report for the specific finding about PD, we are reserving the right to publish those results at another publication.

  • Similar to the answer above, yes further analysis of the psychometric properties of the test are also being computed. The clinical protocol of that study will be published soon. It has been submitted at another journal.

  • The application of digital biomarkers in clinical practice and clinical trials is actually a very interesting question. Different barriers and opportunities exist in those two areas. For clinical trials, we aim to become a secondary/primary endpoint that could identify and report meaningful change of different groups or patients, e.g. Preclinical PD, Prodromal PD and PD diagnosis for therapeutic clinical trials. In the clinical domain and once the results of the primary endpoint above are satisfactory, we would like to become a companion diagnostic for novel treatments. In general however the barriers of entering clinical practice in the primary care setting is a multifaceted one. It involves a dialogue with regulators, medical associations, healthcare economics (HTA) and other units that spread a long way after the demonstration of the clinical benefits. Therefore, we do believe that the first to benefit are going to be the clinical trials and after a long time also the primary care setting.

Open Res Eur. 2021 Dec 13. doi: 10.21956/openreseurope.15331.r28143

Reviewer response for version 1

Renato Anghinah 1

  1. First of all, I would like to congratulate the authors for the high level of this paper. AI and learning machines have been used to help MD take decisions about diagnosis and treatments in a wide range of diseases.

    A very important area that needs this kind of approach is cognitive disease. The computational solution used to Alzheimer’s Disease (AD) from Altoida device just showed useful and Digital Neuro Signature (DNS), was a good candidate to a new biomarker. The use of XGBoost algorithm is an excellent choice once in my point of view is the best machine learning to be used for structured data, like what we have in this study.

  2. I have two questions for the authors: the first one is how they explain the fact that the same 20 features, in 793 possibilities,  are the best for AD and Parkinson’s disease (PD), when we know that in AD disease the cognitive impairments are more important, instead of in PD the motor ones are the main problem mainly in the beginning of these diseases?

    The second one is: If each one item of the 20 features is compared head to head are there differences between them, and in case of positive answer, what are they?

  3. As explained above, is an excellent paper, well written, with a good methodology, and deserves to be published. My opinion is this paper is approved.    

Is the study design appropriate and does the work have academic merit?

Yes

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Neurology, cognitive and behavioral neurology ,trauma Brain Injury, Clinical Neurophisiology

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    The data that support the findings of this study are available from Altoida Inc., but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of the RADAR-AD consortium.


    Articles from Open Research Europe are provided here courtesy of European Commission, Directorate General for Research and Innovation

    RESOURCES