As a consequence of limitations in current pharmacotherapy, the symptoms of patients with Parkinson’s disease (PD) may fluctuate throughout the day, impacting functional ability and quality of life.1 A diary has been the most common method for assessing fluctuations in symptoms in research settings. Diaries enable patients to monitor daily symptoms at specified intervals and report their severity, frequency, and duration for a limited repertoire of predominantly motor symptoms dichotomized into “ON” (defined variably as “good” response to dopaminergic treatment) or “OFF” (poor response to dopaminergic treatment) states. Prioritizing simplicity, most diaries consider dyskinesia exclusively as an ON-state phenomenon, and divide it into whether it interferes with overall function (troublesome) or does not interfere (nontroublesome).2,3 Emphasis on the development of treatments designed to “reduce OFF” or “increase ON” time has limited attention to common intermediate, transitional, and nonmotor states that may not squarely fall into 1 of these 2 states.
Current Gaps in PD Diaries and Strategies to Address Them in an e-Diary
PD diaries have provided valuable information often as primary end points in clinical trials of symptomatic therapies over the past 20 years. Two diaries (Parkinson Disease Home Diary and CAPSIT-PD Diary) have been designated as “recommended” by the MDS Task Force on Rating Scales. Nonetheless, these 2 diaries have the caveat that limited data exist regarding their validity, compliance, and completion,4 and their assessment is implicitly linked to the presence of motor fluctuations.5,6 A systematic literature search found a total of 12 published PD diaries, for which a narrative review (Supplementary material 1) and quality criteria (Supplementary material 2) are available online. The phenomenological, contextual, and clinimetric gaps identified in existing diaries as well as the potential strategies to correct them are listed in Table 1.
TABLE 1.
Gap in current diaries | Strategies for correction in an e-diary | |
---|---|---|
Essential limitations | Absence of nonmotor fluctuations | Although separate nonmotor fluctuations tools are under development,38 nonmotor fluctuation assessment within a diary is needed. |
Incomplete definitions of OFF and ON states | Expand the repertoire of motor behaviors and include nonmotor fluctuations. Combine real-time assessments with wearable sensors and e-Diary tracking. | |
Underrepresentation of partial states | Partial states can be recognized by patients and add granularity to transitional states. OFF and ON states may be replaced with measurement of symptom and disability severity along a continuum. | |
Inaccurate and partial reporting of motor complications | Allow for independent recognition of peak dose and diphasic dyskinesia and OFF-associated dystonia. Allow for separate/complementary input by spouse or other immediate caregiver. | |
Lack of functional assessment | Allow for quantification of functioning that accounts for the wide nature, duration and severity of OFF periods at any “level” of fluctuation. | |
Contextual limitations | Absent cognitive debriefing | Conduct cognitive debriefing to improve items and increase the precision of self-reported measures. |
Heterogeneous frequency of assessments | Evaluate real-time assessments with or without variably spaced frequency of assessments. | |
Data integrity limitations | Compliance assessment and improved patient interface can be implemented with electronic diaries. | |
Absent medication tracking | Implement medication tracking to correlate with function and assist with management strategies. | |
Absent meal type and sleep quality | Implement meal tracking and sleep quality recording to determine effect on response to medications. | |
Clinimetric limitations | Subjective information without objective measures (trackers) | Implement a smartphone-based application with integrated action-dependent and action-independent (wearable sensors) symptom measures. |
Heterogeneous measurement formats and validation methods | Adopt visual analog scales as measurement format and anchor metrics on patient-relevant outcomes. |
Other limitations for all diaries include episodic and categorical assessment for continuous behaviors, lack of determination when assessment is completed, and undefined time to completion.
In recent years, the advent of new technologies has introduced the opportunity to redesign this diary tool. Current diaries are almost exclusively designed in paper format (or in an electronic format that resembles paper diaries). Newer digital methods should enable the capture of a wider range of individualized motor, nonmotor, and circadian complex fluctuations with greater accuracy as an electronic diary/tracker interface (e-Diary). With the aim of bringing the PD diary into the digital age, the MDS Technology Task Force and the MDS Rating Scales Program Electronic Development Ad-Hoc Committee elaborated a set of desirable characteristics and developmental steps for a technology-enhanced e-Diary, usable in both clinical practice and treatment trials. At the request of Movement Disorders editors, a draft of this article was made available on the MDS website (movementdisorders.org/MDS/Resources/2018/PD-Diary.htm) to facilitate public comments on the proposed road map between October 7 and November 7, 2018. The MDS Secretariat sent an email invitation to MDS members and 2 reminders within that time frame. Supplementary material 3 contains a summary of the feedback, highlighting the suggestions that prompted changes into the final document contained in this article.
Desirable Characteristics of a PD e-Diary
Phenomena recognition. A diary must focus on capturing key symptoms and signs that correlate with clinically pertinent fluctuations in motor and nonmotor function. Two archetypal states have been defined in research settings, anchored on motor fluctuations (MFs) but also adaptable to nonmotor fluctuations (NMFs): “OFF,” the clinical condition reflective of no treatment effect, and “ON,” associated with full and effective treatment. However, patients often experience partial, transitional, or “gray-zone” states throughout the day that cannot be dichotomized into full ON or OFF states. Further, dyskinetic and dystonic behaviors can develop during ON, OFF, and transitional states, so that diaries that restrict them as subcategories of ON are conceptually and operationally inadequate. Another important metric with direct implications in therapeutic decisions is functional status, which can vary independently of the duration and severity of fluctuations. Finally, because the biological, pharmacological, and clinical relationships between MFs and NMFs have not been clarified, an ideal diary tool should not implicitly link them and must allow for independent registration of different symptoms.
Patient language. If the terms “OFF” and “ON” are to be used, definitions must be clearly outlined. The definitions should incorporate both motor and nonmotor symptoms. Testing patients’ understanding of definitions must be conducted during the development phases to ensure adequacy of language, content, and health literacy.7,8 This practice can lead to the modification of items to increase the precision of self-reported measures.9,10 Video-based training sessions and standardized instructions can be developed for ensuring validation.11 Following these steps should render the final diary intuitive for patients, minimizing the need for additional training in subsequent clinical or research uses.
Administration and data collection. The adequate frequency or duration of recording needed to capture MFs and NMFs to define a baseline pattern and to evaluate treatment response is still unknown. Regardless, frequency of assessments and method of state determination (averaged over a period or in real time) must be tailored to clinical or research settings. Current diaries predominantly use the “averaged over a period of time” method. Even with these efforts, however, studies using similar instructions stress the “peak-end rule” that dominates human behavior, judging an epoch for its worst or best point or its state at the moment of the assessment.12 Such averaging can be cognitively challenging and may increase measurement errors and recall bias, even in the absence of cognitive impairment.13,14 Compliance of data recording and frequency of missing or erroneous data collection must be recorded. Accurate sleep and wakefulness detection is necessary. Medication — and possibly meal — intake tracking is required to recognize their influence on MFs and NMFs. One advance of electronic methods is that alerts and interactive involvement may enhance valid data collection. Finally, data should be protected and kept confidential.
Diary format and data visualization. An accessible interface would ideally include visual results and feedback to the patient in the form of percent completed and progress reports, independently tailored for clinical care and research settings. Visualization of the evolution of fluctuations over time could be an added value of such an e-Diary. An inviting interface, such as currently applied by wearable fitness technologies and exercise devices, may serve to stimulate long-term compliance with an e-Diary.15 Flexibility in this capacity (on-off switch for “shared feedback”) could help adaptability for research and clinical settings.
Data and clinimetric properties. Desirable measurement formats include active (requiring input by patients, eg, questions or tasks) and passive data collection (not requiring input by patients). Visual analog scales (VASs) are ideal to use for nondichotomous questions in active data collection, can be used by patients with cognitive impairment, and are very sensitive to small intrapersonal changes.16–19 Wearable sensors (see below) may be ideal for passive MF and NMF assessments. Regardless of the methods employed, understanding the instruments’ clinimetric properties is important. Validation methods may include internal consistency (Cronbach’s alpha), construct validity (convergent, divergent, known groups), patient-clinician agreement, predictive validity calculations, cross-cultural validation, and factor analyses, among other methods. Reliability assessments with test-retest calculations are acceptable, but not desirable as a sole method because of the fluctuating nature of the latent variables. Above all, demonstration of how patients feel or function is of the utmost importance in defining utility and relevance.
Technology-based objective measures. An e-Diary/tracker would allow tools such as surveys and VASs to be administered regardless of time or place. Advanced hardware components, such as accelerometers, gyroscopes, microphones, radio signals, among other wearable sensors, can provide complementary action-dependent and action-independent objective measures.20,21 Active data collection should be tailored for motor and nonmotor symptoms. Examples for motor symptoms include spiral drawing, finger tapping, and voice characteristics and for nonmotor symptoms, assessments of visual performance and short-term memory.20,22–25 Passive measures should be obtained in an unsupervised and unobtrusive fashion,26 recorded preferentially during patients’ daily regular activities. One hope is that in the future, passive tracking should capture a subset of relevant MFs and NMFs.27–30 Smartphones, increasingly being used across all age groups, are ideally suited for the e-Diary development, allowing for an ever-present yet unobtrusive and ecologically valid data collection.6,31,32 Challenges related to the technological development include the costs associated with software and hardware development and maintenance, patient/health provider interface configuration, and regulatory difficulties with data storage, confidentiality, and management. Challenges related to usability, on the other hand, include possible issues of long-term compliance with active measures and the requirement to navigate an application, which might be difficult in the setting of motor disability or poor literacy of digital health technologies.33 Incorporation of artificial intelligence methods would be expected to minimize the need for active measures, as “learning” from their initial integration into passive data serves to eventually “predict,” in their absence, the patient-relevant motor, nonmotor, and functional states.
Next steps: Milestones for the Development of the PD e-Diary
We propose a development plan to construct an e-Diary that harnesses the complementary role of diaries (eg, assessments of data meaningfulness based on patient feedback) and wearable sensors (eg, continuous, objective measures, independent of patient feedback). The scope and features of an e-Diary/tracker will require tight collaboration in all developmental phases between all stakeholders, including clinicians, technology developers, regulatory experts, scientists from industry, caregivers, patient advocacy groups, and especially patients. This tool development may benefit from guidelines from the Food and Drug Administration,34 the Clinical Trials Transformation Initiative,35 and the Electronic Patient-Reported Outcome Consortium,36 among others. The new e-Diary should be built on an open-access data management concept, preferentially with the endorsement of the International Parkinson and Movement Disorders Society to standardize the mechanism for technology developers to gain regulatory approval, assist in improvements of the instrument over time, and contribute to its wide acceptance and adherence. Here, we outline the specific developmental milestones suggested by consensus.
First milestone: minimal viable product. A fully functional “minimal viable product” would consist of a wireless-enabled, secured, web-based e-Diary of patient-reported outcomes. The elements to be considered for this first step will require the prioritization of patient-relevant outcomes, as outlined in a parallel ongoing effort by the MDS Task Force on Technology. Optimization of existing data-capturing methods and technologies could facilitate the assessment of partial medication states, NMF reporting, medication tracking, and functional assessments. Some existing instruments (eg, NMSQuest,37 NoMoFa,38 Wearing-Off Questionnaire39) and PROMIS (Patient-Reported Outcomes Measurement Information System) could assist this process by providing relevant items to the construction of the e-Diary. Verification and validation processes should start at this step and continue throughout the development.35
Second milestone: integration of action-dependent metrics. Selection of hardware components (eg, accelerometers, gyroscopes, microphones, among others) and development of software will be tailored to acquire action-dependent data. Individualized assessments for motor (eg, spiral drawing, finger tapping) and nonmotor (eg, visual performance, memory) symptoms could be selected according to patient-reported relevance and feasibility.
Third milestone: incorporation of action-independent metrics. Hardware components selected in previous steps, potentially including available wearable devices, could be optimized for passive data gathering, enabling the “tracker” functionality.
Fourth milestone: algorithm development, improvement, and simplification. A desired final step will be the analysis and integration of diary data and active and passive recordings with hypothesis-driven and machine learning algorithms. Such algorithms must control for the state and setting in which patients enter action-dependent measures into the diary (for instance, dyskinesia might be interpreted differently in a patient with versus without anxiety, the former possibly magnifying its severity). The end point is the transformation of patient data into individualized current and predictive feedback to patients themselves, providers, and caregivers for both self-guided behavioral changes and facilitation of personalized management decisions by clinicians.
The feasibility of an e-Diary has been demonstrated by recent smartphone-based “rating scores.” A recently introduced mobile application combines active and passive data gathering,40 whereas another mobile application uses active-only data.25 In both cases, data were processed with machine-learning algorithms, yielding adequate reliability and validity metrics.25,40 Major unknown variables include the heterogeneity of PD and the extent to which integration of an e-Diary, daily or intermittently, is capable of enhancing patient empowerment for long-term sustainability. Further, the use of a new tool will be different if applied in clinical research (limited time) or in “real life,” both for patients and, through a separate interface, for their caregivers.
Conclusions
The highly dynamic and user-friendly technological advances of recent years enable the development and validation of an accepted e-Diary/tracker that simultaneously assesses MFs and NMFs and uses action-dependent and action-independent end points for clinical management and research efforts. An e-Diary can be patient-friendly and intuitive as well as capable of providing real-time feedback to the patient (empowered to influence any state) and clinician to ensure widespread use and long-term adherence. The time has come to move beyond the simplistic dualism of “ON” and “OFF” states of paper diaries and reconfigure this important source of clinical information for care and research.
Supplementary Material
Acknowledgments:
We thank all MDS members who provided feedback during the public comment phase.
Funding agencies: Nothing to declare.
Footnotes
Relevant conflicts of interest/financial disclosures: None of the authors have anything to declare.
Supporting Data
Additional Supporting Information may be found in the online version of this article at the publisher’s web-site.
References
- 1.Aquino CC, Fox SH. Clinical spectrum of levodopa-induced complications. Mov Disord 2015;30(1):80–89. [DOI] [PubMed] [Google Scholar]
- 2.Hauser RA, Friedlander J, Zesiewicz TA, et al. A home diary to assess functional status in patients with Parkinson’s disease with motor fluctuations and dyskinesia. Clin Neuropharmacol 2000;23 (2):75–81. [DOI] [PubMed] [Google Scholar]
- 3.Reimer J, Grabowski M, Lindvall O, Hagell P. Use and interpretation of on/off diaries in Parkinson’s disease. J Neurol Neurosurg Psychiatry 2004;75(3):396–400. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Antonini A, Martinez-Martin P, Chaudhuri RK, et al. Wearing-off scales in Parkinson’s disease: Critique and recommendations. Mov Disord 2011;26(12):2169–2175. [DOI] [PubMed] [Google Scholar]
- 5.Storch A, Schneider CB, Klingelhöfer L, et al. Quantitative assessment of non-motor fluctuations in Parkinson’s disease using the Non-Motor Symptoms Scale (NMSS). J Neural Transm 2015;122 (12):1673–1684. [DOI] [PubMed] [Google Scholar]
- 6.Ossig C, Sippel D, Fauser M, et al. Assessment of nonmotor fluctuations using a diary in advanced Parkinson’s disease. J Parkinsons Dis 2016;6(3):597–607. [DOI] [PubMed] [Google Scholar]
- 7.Hersh L, Salzman B, Snyderman D. Health Literacy in Primary Care Practice. Am Fam Physician 2015;92(2):118–24. [PubMed] [Google Scholar]
- 8.Collins D. Pretesting survey instruments: An overview of cognitive methods. Qual Life Res 2003;12(3):229–238. [DOI] [PubMed] [Google Scholar]
- 9.Ploughman M, Austin M, Stefanelli M, Godwin M. Applying cognitive debriefing to pre-test patient-reported outcomes in older people with multiple sclerosis. Qual Life Res 2010;19(4):483–487. [DOI] [PubMed] [Google Scholar]
- 10.Welch L, Trudeau J, Silverstein S, Sand M, Henderson D, Rosen R. Initial development of a patient-reported outcome measure of experience with cognitive impairment associated with schizophrenia. Patient Relat Outcome Meas 2017;8:71–81. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Goetz CG, Stebbins GT, Blasucci LM, Grobman MS. Efficacy of a patient-training videotape on motor fluctuations for on-off diaries in parkinson’s disease. Mov Disord 1997;12(6):1039–1041. [DOI] [PubMed] [Google Scholar]
- 12.Kahneman D Evaluation by moments: past and future. In: Kahneman D, Tversky A, eds. Choices, values, and frames. New York: Cambridge University Press and the Russell Sage Foundation; 2000:673–692. [Google Scholar]
- 13.Ding W, Ding L-J, Li F-F, Han Y, Mu L. Neurodegeneration and cognition in Parkinson’s disease: a review. Eur Rev Med Pharmacol Sci 2015;19(12):2275–2281. [PubMed] [Google Scholar]
- 14.Coughlin SS. Recall bias in epidemiologic studies. J Clin Epidemiol 1990;43(1):87–91. [DOI] [PubMed] [Google Scholar]
- 15.AA Shiffman S, Schwartz JE, Broderick JE, Hufford MR. Patient compliance with paper and electronic diaries. Control Clin Trials 2003;24(2):182–199. [DOI] [PubMed] [Google Scholar]
- 16.DeVellis RF. Scale development: theory and applications. 2nd ed. Thousand Oaks, Sage Publications; 2003:171. [Google Scholar]
- 17.Price D, Staud R, Robinson M. How should we use the visual analogue scale (VAS) in rehabilitation outcomes? II: Visual analogue scales as ratio scales: An alternative to the view of Kersten et al et al. J Rehabil Med 2012;44(9):800–801. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Arons A, Krabbe P, van der Wilt G, Olde Rikkert M, Adang E. Visual analogue scales: scale recalibration by patients with dementia and their proxies. Qual Life Res 2013;22(5):979–986. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Klimek L, Bergmann K-C, Biedermann T, et al. Visual analogue scales (VAS): Measuring instruments for the documentation of symptoms and therapy monitoring in cases of allergic rhinitis in everyday health care. Allergo J Int 2017;26(1):16–24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Bot B, Suver C, Neto E, et al. The mPower study, Parkinson disease mobile data collected using ResearchKit. Sci Data 2016;3:1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Zhao M, Li T, Abu Alsheikh M, et al. Through-wall human pose estimation using radio signals. CVPR 2018;7356–7365. [Google Scholar]
- 22.Aghanavesi S, Nyholm D, Senek M, Bergquist F, Memedi M. A smartphone-based system to quantify dexterity in Parkinson’s disease patients. Informatics Med Unlocked 2017;9(March):11–17. [Google Scholar]
- 23.Kostikis N, Hristu-Varsakelis D, Arnaoutoglou M, Kotsavasiloglou C. A Smartphone-Based Tool for Assessing Parkinsonian Hand Tremor. IEEE J Biomed Heal Informatics 2015;19(6):1835–1842. [DOI] [PubMed] [Google Scholar]
- 24.Haubenberger D, Kalowitz D, Nahab FB, et al. Validation of digital spiral analysis as outcome parameter for clinical trials in essential tremor. Mov Disord 2011;26(11):2073–2080. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Zhan A, Mohan S, Tarolli C, et al. Using Smartphones and Machine Learning to Quantify Parkinson Disease Severity. JAMA Neurol 2018;75(7):876. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Fisher JM, Hammerla NY, Ploetz T, Andras P, Rochester L, Walker RW. Unsupervised home monitoring of Parkinson’s disease motor symptoms using body-worn accelerometers. Park Relat Disord 2016;33:44–50. [DOI] [PubMed] [Google Scholar]
- 27.Ossig C, Antonini A, Buhmann C, et al. Wearable sensor-based objective assessment of motor symptoms in Parkinson’s disease. J Neural Transm 2016;123(1):57–64. [DOI] [PubMed] [Google Scholar]
- 28.Hssayeni MD, Burack MA, Ghoraani B. Automatic assessment of medication states of patients with Parkinson’s disease using wearable sensors. 2016 38th Annu Int Conf IEEE Eng Med Biol Soc 2016;2016:6082–6085. [DOI] [PubMed] [Google Scholar]
- 29.Roy SH, Cole BT, Gilmore LD, et al. High-resolution tracking of motor disorders in Parkinson’s disease during unconstrained activity. Mov Disord 2013;28(8):1080–1087. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Patel S, Lorincz K, Hughes R, et al. Monitoring Motor Fluctuations in Patients With Parkinson’s Disease Using Wearable Sensors. IEEE Trans Inf Technol Biomed 2009;13(6):864–873. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Maetzler W, Domingos J, Srulijes K, Ferreira JJ, Bloem BR. Quantitative wearable sensors for objective assessment of Parkinson’s disease. Mov Disord 2013;28(12):1628–1637. [DOI] [PubMed] [Google Scholar]
- 32.Papapetropoulos SS. Patient Diaries as a Clinical Endpoint in Parkinson’s Disease Clinical Trials. CNS Neurosci Ther 2012;18(5):380–387. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Broderick JE. Electronic Diaries: Appraisal and Current Status. Pharmaceut Med 2008;22(2):69–74. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.U.S. Food & Drug Administration. Clinical Outcome Assessment Qualification Program [Internet]. www.fda.gov/drugs/developmentapprovalprocess/drugdevelopmenttoolsqualificationprogram/ucm284077.htm. Accessed December 6, 2018.
- 35.Clinical Trials Transformation Initiative. CTTI Recommendations: Identifying Qualified Investigators and Their Delegates to Conduct Sponsored Clinical Trials [Internet]. www.ctti-clinicaltrials.org/briefingroom/recommendations. Accessed December 6, 2018.
- 36.Critical Path Institute. Electronic Patient-Reported Outcome Consortium [Internet]. www.c-path.org/programs/eproc. Accessed December 6, 2018.
- 37.Chaudhuri KR, Martinez-Martin P, Schapira AHV, et al. International multicenter pilot study of the first comprehensive self-completed nonmotor symptoms questionnaire for Parkinson’s disease: The NMSQuest study. Mov Disord 2006;21(7):916–923. [DOI] [PubMed] [Google Scholar]
- 38.Kleiner-Fisman G, Martine R, Lang AE, Stern MB. Development of a non-motor fluctuation assessment instrument for Parkinson disease. Parkinsons Dis 2011;2011:292719. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Stacy MA, Murphy JM, Greeley DR, Stewart RM, Murck H, Meng X. The sensitivity and specificity of the 9-item Wearing-off Questionnaire. Parkinsonism Relat Disord 2008;14(3): 205–212. [DOI] [PubMed] [Google Scholar]
- 40.Lipsmeier F, Taylor KI, Kilchenmann T, et al. Evaluation of smartphone-based testing to generate exploratory outcome measures in a phase 1 Parkinson’s disease clinical trial. Mov Disord 2018;33(8):1287–1297. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.