Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2018 Jan 1.
Published in final edited form as: J Parkinsons Dis. 2017;7(3):533–543. doi: 10.3233/JPD-161055

A Consensus Set of Outcomes for Parkinson’s Disease from the International Consortium for Health Outcomes Measurement

Paul de Roos a,c,*, Bastiaan R Bloem b, Thomas A Kelley c, Angelo Antonini d, Richard Dodel e, Peter Hagell f, Connie Marras g, Pablo Martinez-Martin h, Shyamal H Mehta i, Per Odin j, Kallol Ray Chaudhuri k, Daniel Weintraub l,m, Bil Wilson n, Ryan J Uitti o
PMCID: PMC5685544  NIHMSID: NIHMS917894  PMID: 28671140

Abstract

Background

Parkinson’s disease (PD) is a progressive neurodegenerative condition that is expected to double in prevalence due to demographic shifts. Value-based healthcare is a proposed strategy to improve outcomes and decrease costs. To move towards an actual value-based health care system, condition-specific outcomes that are meaningful to patients are essential.

Objective

Propose a global consensus standard set of outcome measures for PD.

Methods

Established methods for outcome measure development were applied, as outlined and used previously by the International Consortium for Health Outcomes Measurement (ICHOM). An international group, representing both patients and experts from the fields of neurology, psychiatry, nursing, and existing outcome measurement efforts, was convened. The group participated in six teleconferences over a six-month period, reviewed existing data and practices, and ultimately proposed a standard set of measures by which patients should be tracked, and how often data should be collected.

Results

The standard set applies to all cases of idiopathic PD, and includes assessments of motor and non-motor symptoms, ability to work, PD-related health status, and hospital admissions. Baseline demographic and clinical variables are included to enable case mix adjustment.

Conclusions

The Standard Set is now ready for use and pilot testing in the clinical setting. Ultimately, we believe that using the set of outcomes proposed here will allow clinicians and scientists across the world to document, report, and compare PD-related outcomes in a standardized fashion. Such international benchmarks will improve our understanding of the disease course and allow for identification of ‘best practices’, ultimately leading to better informed treatment decisions.

MESH terms: Delivery of Health Care*/economics, Delivery of Health Care*/standards, Efficiency, Organizational, International Cooperation, Health Care Costs Health Status, Health Surveys, Health Surveys/Health Status Indicators, Humans, Outcome Assessment (Health Care), Quality of Health Care, Quality Indicators, Health Care/standards, Quality of Life, Aged, Middle Aged, Disability Evaluation, Disease Progression, Female, Male, Parkinsonian Disorders, Parkinson Disease, Parkinson Disease/epidemiology, Parkinson Disease, Psychometrics, Activities of Daily Living, Outcome and Process Assessment (Health Care)/standards, Parkinson Disease/therapy*

INTRODUCTION

Parkinson’s disease (PD) is a common and progressive neurodegenerative disease [1]. In the USA, PD has an estimated prevalence of 0.3% and an estimated healthcare cost per patient of 10,000 USD/year [2]. Prevalence and costs are similar in Europe [3]. Due to the aging global population, the prevalence of PD is expected to increase significantly [4], leading to greater disease-associated burden and higher care expenditures. Optimizing the quality of PD care and minimizing the expense of care delivery are therefore essential.

Increasing value, defined as a patient’s outcomes divided by the cost to achieve those outcomes, has been proposed as a mechanism to improve the quality of care [5]. A systematic measurement of outcomes can guide improvement and enable dissemination of best practices. In order to move towards an actual value-based health care system, having condition-specific outcomes that are meaningful to patients and their care providers is crucial. Transparency regarding outcomes and costs is essential to help reduce unwanted variations in healthcare delivery, and to increase the overall quality of care. This need has been recognized in the PD community for some time. Efforts to identify outcomes that are meaningful to patients and caregivers have led to the establishment of various national assessment programs [69].

However, across the world, PD outcomes remain inconsistently defined, collected and reported. This limits our ability to make reliable national and international comparisons, which in turn obscures our ability to learn from best practices, a necessary step to improve global healthcare.

The International Consortium for Health Outcomes Measurement (ICHOM) was formed to develop global consensus sets of outcomes that reflect patients’ concerns and experiences. ICHOM has already developed international sets of outcomes for 21 medical conditions [10]. We here report the results of an ICHOM initiative to develop a similar set of outcomes for PD. To achieve this, ICHOM brought together an International Working Group, representing patients, neurology, psychiatry, nursing and existing outcome measurement efforts, to develop a parsimonious standard set of outcome indices for PD, with the aim of proposing the product for international use. This paper describes the development process and the resultant set.

METHODS

Working group

The formation of the Working Group was based on the principles of previous ICHOM working groups [11]. The PD Working Group consisted of 12 members from eight countries (USA, Canada, UK, Spain, Italy, Germany, Netherlands, and Sweden) and included expert neurologists (n = 9), a psychiatrist, and a nurse specializing in PD, as well as an experienced patient advocate (Table 1). Working Group members were identified by reviewing authors of leading papers on PD care quality, and by identifying members of international patient advocacy groups, leading international PD scientific organizations, and leading physicians in existing national and international quality measurement efforts.

Table 1.

Working Group members

Working Group member Expertise
Bas Bloem Professor of Neurology, focusing on movement disorders.
Lead of National Parkinson’s Disease Registry in Netherlands.
Angelo Antonini Professor of Neurology, focusing on Parkinson’s disease and measurement of outcomes that matter to patients.
Richard Dodel Professor of Neurology with interest in Parkinson’s disease and measurement of patient outcomes.
Member of MDS-UPDRS revision taskforce
Peter Hagell Professor of Neurological Caring Science, with a focus on outcomes measurement in Parkinson’s disease.
Connie Marras Associate Professor of Neurology, focusing on Movement Disorders and the evaluation of clinical assessment tools.
Pablo Martinez-Martin Neurologist, interest in Parkinson’s disease and development of clinical evaluation tools.
Shyamal Mehta Assistant Professor of Neurology, focusing on movement disorders and measuring outcomes in the Parkinson’s disease clinic.
Per Odin Professor of Neurology, focusing on movement disorders.
Developed Swedish National Parkinson’s disease registry.
K Ray Chaudhuri Professor of Neurology, focusing on movement disorders.
Expertise in developing clinical evaluation tools.
Daniel Weintraub Professor of Psychiatry, with interest in psychiatric and cognitive complications of Parkinson’s disease.
Bill Wilson Experienced Parkinson’s disease patient advocate. Part of the Parkinson’s Disease Foundation.
Ryan Uitti Professor of Neurology focusing on movement disorders with an academic interest in measuring patient outcomes relative to cost.
Paul de Roos Neurology Resident. Research Fellow, providing literature review expertise.

Process

Following the process used in earlier ICHOM work [10, 11], a modified Delphi technique was employed to define the outcomes and case-mix variables. Case mix variables are defined as those variables that capture the state of the patient independent of the medical condition for which they are being treated. This includes demographic factors, health status (e.g. co-morbidities) and treatments. The process is a structured, consensus-driven approach, with teleconferences and post-teleconference surveys to reach decisions. Proposals for each teleconference were generated in advance by a core ICHOM project team (RU, TAK, PdR). These were based on a literature review of existing guidelines and standards, as well as individual interviews with each Working Group member.

The Working Group was officially announced in December 2013 and launched with an in-person meeting at the conference of the International Association of Parkinsonism and Related Disorders (IAPRD). This was followed by five 75-minute teleconferences, which took place every month between January and May 2014. All of these teleconferences were followed by a survey of the Working Group members to make decisions on key discussion areas. A 2/3 majority was required, being a commonly used threshold for Delphi and modified Delphi processes, on each survey question to reach consensus. Shifting the threshold a bit did not have an impact on the selection process. When a 2/3 majority was not reached, the topic was brought up for re-discussion at the following teleconference. The standard set of outcomes was then launched at the International Parkinson and Movement Disorder Society (MDS) Conference in June 2014.

The process began with defining the scope of the Working Group by deciding which causes of parkinsonism to include in the set. Subsequently, key outcome domains that are meaningful to patients were identified based on relevant literature and outcome measurement programmes [611]. These were then reviewed with each Working Group member individually to determine if additional domains, not identified by the search, should be considered. The resultant list of outcome domains was then organized based on four criteria. Each criterion was rated on a Likert scale of 1–4, where one was the lowest and four was the highest score given: (1) Frequency of the outcome domain in the patient population – an important consideration for a set that aims to be parsimonious; (2) Impact of the outcome domain on the patient – an essential consideration for a set that aims to reflect what is most meaningful to patients; (3) Preventability/treatability of the outcome domain – a necessary consideration for a set that aims to be used in the clinic to generate meaningful data on which clinicians can act to modify their practice; and (4) Feasibility to capture the outcome domain in clinical practice – this is essential as the set is designed to be used in routine clinical practice. This formed the basis for the first teleconference discussion.

Once the outcome domains were decided, the tools for data collection were determined. Relevant scales or items were identified and prioritized using specific criteria. Again, each criterion was rated on a Likert scale of 1–4, where one was the lowest and four was the highest score given. The criteria were as follows: (1) Domain coverage – this set aims to be of minimal burden and complexity. Thus, tools that cover many domains were preferable; (2) Psychometric properties – the data collected must be accurate, and thus patient-reported tools were prioritized based on psychometric properties; (3) Feasibility to implement – the tool must be practical for day-to-day use in the clinic; and (4) Clinical interpretability – clinical teams must be able to understand the results. This formed the basis for the second teleconference discussion. Finally, we sought to reach agreement on the frequency of data collection, balancing comprehensiveness, practicalities for clinics, and what would be best for patients.

This was followed by identification of the baseline case-mix variables, which are necessary to make meaningful comparisons between patients. Case-mix variables to measure were prioritized based on three criteria. Each criterion was rated on a Likert scale of 1–4, where one was the lowest score and four was the highest score given. The criteria were as follows: (1) Relevance (strength of association between the case-mix variable and the outcome) – we aimed to identify case-mix variables that could strongly affect the outcome; (2) Case-mix variable independency –given the aim to collect a minimum set of case-mix variables, the aim was to identify variables that would independently affect the outcome; (3) Feasibility to collect – the set must be practical for use in the clinic. This formed the basis for the third teleconference discussion.

The fourth teleconference focused on reaching agreement around internationally acceptable ways to measure case mix adjustment variables. The fifth teleconference focused on reviewing the set prior to its launch to the international community.

Literature search strategy

The following PubMed MeSH terms and Boolean logic were used to perform a search to identify outcomes that matter to PD patients, as well as scales to collect those outcomes: (“Parkinson’s disease” OR “Parkinson disease” OR “Parkinsonism”) AND (“critique” OR “recommendation” OR “review”) AND (“scale” OR “scales” OR “instrument” OR “instruments” OR “questionnaire” OR “questionnaires”). Limitations were applied, which included the need to be review articles, written in the English language, and published in the 10 years preceding January 2015.

From this search, article titles and abstracts were reviewed to identify those that had a clear focus on scales used in clinical practice. From these results, references to scales were extracted and through targeted searches, original validation studies and use of the respective instruments were identified.

RESULTS

Scope

The set was designed to cover all cases of adult (>18 years of age) idiopathic PD. Atypical parkinsonism was excluded, as the consensus was that this would require different outcome measures. We recommend that atypical causes of parkinsonism be considered in future outcome sets. This set is intended to be relevant to PD patients receiving all common treatment options for motor and non-motor symptoms, including pharmacotherapy (including infusion or injection-based delivery), deep brain stimulation, and rehabilitation-based therapy (including allied health interventions, nursing, and behavioral therapy).

Outcomes

A series of motor, non-motor and other outcomes were agreed upon by the Working Group as essential to collect.

Non-motor symptoms

Non-motor outcomes impact the ability of patients with PD to carry out normal day-to-day activities [12] and are key determinants of their perceived health [13, 14]. Based on the current literature, non-motor symptoms that are most important for PD patients were listed [6, 7, 11, 15, 16]. As described in Methods, the project team then prioritized this list and suggested the following outcome domains for inclusion in the standard set: depression, anxiety, cognitive function, urinary function, gastrointestinal function, pain, sleep, sexual function, treatment complications (hemorrhage and behavior change). These were deemed frequent, of high impact on patients, treatable and feasible to capture in clinical practice. During the teleconference, the group agreed with their inclusion but additionally felt that fatigue, hallucinations and sweating should also be included, due to their impact on patients. In the survey following the teleconference, the voting confirmed inclusion of the aforementioned outcomes with the exception of treatment complications – specifically, hemorrhage, as it is very uncommon, and behavior change, as this is captured under the cognitive and psychiatric domains. Additionally, the survey revealed that psychosis, apathy, impulse control disorder and dizziness/syncope were further domains deemed necessary to be part of the standard set, again due to their impact on patients. These were reviewed at the next teleconference and agreed by all WG members to be included in the Set. (See Table 2 for the full list of outcome domains and suggested scales).

Table 2.

Summary of the Parkinson’s disease Standard Set. Full set can be found: http://www.ichom.org/wp-content/uploads/2014/08/PD-Reference-Guide-6.11.14-KL.pdf

Category Domain Tool Data source
Cognitive and psychiatric symptoms/functioning Cognitive impairment MDS-UPDRS Part 1 Physician reported
Hallucinations & psychosis
Depressed mood
Anxious mood
Apathy
Features of dopamine dysregulation syndrome (including impulse control disorders)
Non-motor functioning Sleep problems MDS-UPDRS Part 1 – patient questionnaire part 1 Patient and/or caregiver reported
Daytime sleepiness
Pain & other sensations
Urinary problems
Constipation problems
Light headedness on standing
Fatigue
Sexual function Non Motor Symptoms Questionnaire Patient and/or caregiver reported
Sweating
Motor functioning Speech MDS-UPDRS Part 1 – Patient questionnaire part 2 Patient and/or caregiver reported
Saliva & drooling
Chewing & swallowing
Eating tasks
Dressing
Hygiene
Handwriting
Doing hobbies & other activities
Turning in bed
Tremor
Getting out of bed, a car, or a deep chair
Walking & balance
Freezing
Additional health outcomes Ability to work Does your PD limit your ability to work? Patient reported
Hospital admissions
  1. Admitted to hospital in last 12 months and how many times?

  2. Number of times related to PD?

Patient and/or carer reported
PD-related health status PDQ-8 Patient and/or carer reported
Falls Fall within last year and did it cause a fracture? Patient and/or carer reported
Case-mix variables Age In years Patient reported
Sex Male or female Patient reported
Level of education Defined using International Standard Classification of Education (ISCED) Patient reported
Living status Who currently lives with you? Patient reported
Marital status Indication of marital status. Patient reported
Depression/anxiety/REM sleep behavior disorder prior to PD? Yes/No Patient reported
Age at PD diagnosis Age in years Patient reported
Age at onset of PD symptoms Age in years Patient reported
Comorbidities NHS comorbidity tool Patient reported

NB: All outcomes are collected annually.

A range of tools for data collection were identified. These included the Scale for Outcomes of Parkinson’s disease (SCOPA-AUT) [17], the Non-Motor Symptom Questionnaire (NMSQuest) [18], the Non-Motor Symptoms Scale (NMSS) [19], the Movement Disorder Society – Unified Parkinson’s Disease Rating Scale (MDS-UPDRS) [20], as well as specific scales relating to depression [21, 22], anxiety [23], apathy [24], psychosis [25], fatigue [26], sleep [27] and cognition [28, 29].

It was felt that it would be simpler and less burdensome for patients and health systems to have a single instrument rather than many individual patient-reported outcome measurements. A number of scales were considered, including NMSS [19], NMSQuest [19, 30], SCOPA-AUT [17] and MDS-UPDRS Part 1 [31, 32]. Ultimately, the MDS-UPDRS part 1 was chosen, as it has the highest test-retest reliability and internal consistency (as measured by Cronbach’s alpha), in comparison to the other tools, as well as having acceptable construct validity. Additionally, it poses minimal burden on the health system, with the clinician-recorded component taking <10 minutes to complete and the rest being patient reported [32]. Additionally, the MDS-UPDRS Part 2 (see below) is recommended for collection of the motor outcomes and thus it was felt simpler for clinics to use the MDS-UPDRS for both motor and non-motor assessment.

Two of the selected domains (sweating and sexual function) are not covered in the MDS-UPDRS part 1 survey, so it was decided to use the questions addressing these issues that are in the NMSQuest [21]. While not a perfect solution, the Working Group prioritized the selection of two simple, easy to administer, patient-reported questions. The Working Group encourages the MDS to consider including questions relating to sweating and sexual dysfunction in future iterations of the MDS-UPDRS.

We initially considered using the MDS-UPDRS part 1 as a screening tool for anxiety, depression and cognitive symptoms, and to use domain specific scales such as Beck Depression Inventory (depression) [33], State Trait Anxiety Inventory (anxiety) [34] and Montreal Cognitive Assessment (cognition) [35] to investigate these non-motor symptoms in more detail. However, it was decided that this would miss a key principle underpinning the work (i.e., to produce a practical, minimum set of outcomes that is of minimal burden to patients and staff). Therefore, only the MDS-UPDRS part 1 was included as part of the set.

Motor symptoms

Motor symptoms are an important problem in PD and their presence is relied upon to make a clinical diagnosis of PD. Motor features that were considered to be most important to the PD patient were identified and listed [6, 7, 11]. The outcome domains that the project team suggested including in the standard set (following the process set out under the methods) included: mobility – ability to walk; activities of daily living – living independently, handwriting and keyboard capabilities; ability to self-care; tremor; speech; swallowing; treatment complications (dyskinesia and dystonia).

During the teleconference (and confirmed by the post-teleconference survey) it was agreed to include these proposed outcome domains, and it was suggested and agreed upon in the post-call survey to include additional ones. The additional outcomes included: leisure activities, saliva and drooling, and ability to move in bed at night. These were agreed upon as they are domains that can have a significant impact on the patient’s quality of life. Ultimately, the only outcome domains from the initial list not to be included in the standard set were treatment complications – specifically, dyskinesia and dystonia – as it was felt that we should focus on motor function, not specific symptoms or side effects.

A wide variety of rating instruments were identified for different motor symptoms, including the Hoehn and Yahr staging [36, 37], the Schwab and England ADL scale [38], PD-related health status questionnaires [39] such as PDQ39 [40], the MDS-UPDRS, and scales which can be used to report motor complications, such as “wearing off” [41], risk of falling (including the Berg Balance Scale [42] and others [43, 44]) and mobility (Timed Get Up and Go Test) [45]. During the teleconference discussions it was agreed that many domain-specific scales would be needed and that this would be too burdensome and complicated for patients and clinical teams. Therefore, the MDS-UPDRS and the PDQ-39 were ultimately identified as the potential tools for data collection. The PDQ-39 is available in multiple languages and is free to use, but only covers 6/10 motor domains that we identified as being important. In contrast, the MDS-UPDRS part 2 questionnaire is also available in multiple languages and is free to use clinically but covers 10/10 domains. MDS-UPDRS part 2 has excellent psychometric properties [20]. Therefore, the MDS-UPDRS part 2 was decided as the motor tool of choice by the Working Group.

Additional health outcomes

We identified four additional domains as important for patients with PD: ability to work, hospital admissions, overall PD-related health status, and falls. These were selected by the group, particularly the patient representative, as important outcomes to assess. To assess ability to work, hospital admissions, and falls, the questions currently used in the recently developed Dutch National Parkinson’s Disease Registry (www.ParkinsonInzicht.nl), which cover these domains, were selected for use in the ICHOM set. The Dutch registry uses the PDQ-39 to assess PD-related health status. The PDQ-8 and PDQ-39 are comparable as health status indices, but the PDQ-8 is significantly less burdensome to complete [4648]. We recognize the value of having a single PD-related health status score and decided to include the PDQ-8.

Finally, there was also a discussion around the assessment of cost of accessing care for the patient. While we agreed that cost is vitally important, it was best included not as an outcome but rather the denominator of the value equation. Reporting cost was therefore seen as out of the scope of this work.

Case-mix variables

Patients with PD have a broad range of characteristics both related and unrelated to their neurodegenerative disease that may influence their outcomes. A parsimonious set of case-mix variables (Table 2) that were felt to strongly impact outcomes, based on existing literature [49, 50] and informal discussions, was proposed. For demographic variables: age, gender, level of education, and living status (i.e. whether the patient was living alone) were proposed. Age and gender are associated with anxiety, cognitive function, urinary function, GI function, pain, sexual function and fatigue. Gender is associated with depression [51]. Level of education, gender and living status are associated with cognitive function [49, 52]. For baseline health status: early age at onset of PD, depression earlier in life, PD motor subtype, non-PD related cognitive dysfunction, non-PD related co-morbidities, and non-PD related medication affecting sleep, sexual function, and dizziness were proposed. During the teleconference it was suggested and agreed upon to include marital status as an additional demographic variable, as not being married is known to be associated with the risk for cognitive decline in the elderly general population [53]. Other constructs such as loneliness and social networks in late life also include marital status and are known to be correlated to cognitive function [50]. There was unanimous agreement to remove PD motor subtype and all medication side effects due to the difficulty of recording this information accurately. There was agreement to change early age at diagnosis of PD to age at diagnosis of PD, as there are conflicting views on the definition of “early”, while age would provide a more specific time point assuring less ambiguity in the data collected. For baseline health status, the age of PD onset and diagnosis, the diagnosis of depression, anxiety or rapid eye movement (REM) sleep behavior disorder (RBD) before PD diagnosis [53], and comorbidities were included. We agreed on definitions for each of the case-mix variables. For marital status and living status we decided to use the widely accepted definitions developed by the European Social Survey [54]. For level of education, the United Nations Educational, Scientific and Cultural Organization (UNESCO) definitions of education levels, which allow for international and cross-cultural comparisons, were selected [55]. We decided to change the term “tertiary” to “University or equivalent” as it was felt that this wording would be easier for patients and care providers to understand. For the case-mix variables, depression and anxiety, we developed two new yes/no questions. We agreed to include a single baseline patient-reported question used to assess previous REM sleep behavior disorder [53]. A validated patient-reported Charlson Comorbidity Index currently in use by the United Kingdom National Health Service [56] was chosen to reduce data collection burden on physicians.

Data collection

In order to be able to easily compare between providers, centers and countries, the use of established instruments with multiple translations was prioritized and data collection methods that can be applied across different countries and settings were proposed. We aimed to reduce the reporting burden on clinicians and as such the vast majority of outcomes in the set are patient-reported, with the exception of the cognitive and mental health outcomes. We recommend all outcomes to be recorded annually.

DISCUSSION

We have produced a standard set of outcomes, intended for international use to monitor the quality of clinical management of patients with PD. The set includes validated indicators of motor and non-motor symptoms and health status. Additional case-mix variables have been included to enable case mix adjustment so that inter-center and international comparisons can be performed. It aims to build on existing outcome measurement work [610] and additionally brings the perspective of leading clinicians and a patient advocate from around the world to ensure a global perspective.

The aim was parsimony, so more detailed symptom-specific scales (e.g., the Beck Depression Inventory and the Montreal Cognitive Assessment) were not selected. Additionally, not all possible outcome domains were included, but rather a focus on those essential outcomes that really reflect what matters to most people with Parkinson’s disease in most places. For example, driving is key component of the patient’s independence, and a frequently volunteered priority in clinical practice [57]. The fact that driving was not mentioned suggests that not all elements that matter to patients came to light in this project, and consequently did not make it to the final instrument. We therefore encourage teams to use this dataset as the basis on which other outcome domains can be added.

Ultimately, the MDS-UPDRS parts 1 and 2, three questions from the NMSQuest, the PDQ-8, and six questions from the Dutch National PD registry were chosen, as their questions represent all of the domains that the Working Group identified as being important. We realize that some health care providers currently use different scales and that there may be challenges in switching to the present recommendation, but we feel that the prospective benefit of being able to perform cross-provider comparisons and to collaboratively learn and improve patient care will encourage universal adoption of this set over time. We also recognize that computer-adaptive patient-reported outcome measures are currently under investigation, and that they may eventually replace the scales included in this set. To ensure continuity of the set over time, a subset of Working Group members has formed a Steering Committee to review and update the set on an annual basis.

This set aims to be used on a day-to-day basis in the clinic, as a useful tool to help guide management decisions for clinicians and patients. It is also hoped that it will be used to compare the quality of care provided by different centers around the world, stimulating discussion and learning from those centers with the best outcomes. For the MDS-UPDRS, the NMSQuest and the questions from the Dutch registry, it is envisaged that the results of each individual question will be the unit of comparison. For the PDQ-8, an overall score can be calculated, which will be used for comparison.

We are recommending existing validated instruments, and as such this dataset can be used immediately by teams across the world in pilot experiments. Specifically, before this ICHOM approach to outcome measurement can be recommended fully to international communities of clinicians, we recommend that pilot experiments should be performed in a cohort of individuals with PD. The results of such pilot studies should be evaluated using established psychometric approaches to further optimize the question set. Accordingly, we actively seek such feedback from teams to ensure that the set remains practical and relevant for people living with Parkinson’s disease. For most institutions, implementation into routine clinical practice may be challenging, not in the least because it may require new resource commitments and infrastructure development. ICHOM has developed an expert implementation team to assist institutions in figuring out how to overcome these challenges. While we recognize the challenges, we are encouraged by the increasing availability of electronic health records and communication technologies that enable outcome reporting directly into the patient’s medical record. We hope that this set will further spur development in this area. We also recognize that in some languages, validated translations of the proposed scales do not yet exist and will need to be undertaken. Finally, we note that valid comparisons of outcomes across countries are in their infancy and will require further methodological development to ensure validity [58].

A methodological draw back to the project was the absence of physiotherapy and rehabilitation expertise in the Working Group, as well as absence of representation from Asia, Oceania and South America. This will be addressed by identifying appropriate expertise to join the steering committee, which is charged with monitoring and updating the set on an ongoing basis.

In summary, we have developed a simple, relatively easy to implement, set of outcome indices that we believe should, after piloting testing, be collected and tracked for all patients with PD. This is an initial step towards driving meaningful and significant improvements in the care of patients with PD around the world.

Acknowledgments

We would like to thank all authors for the time and effort contributed without financial compensation.

SOURCES OF SUPPORT

This project was funded by the International Consortium for Health Outcome Measurement.

Footnotes

CONFLICT OF INTEREST

No conflicts of interest to report: De Roos, Martinez Martin, Antonini, Ray Chaudhuri, Uitti, Wilson, Hagell, Weintraub, Mehta, Marras, Kelley.

Per Odin has given lectures with honorarium and/or had expert advisor role for the following companies: Abbott/AbbVie, Britannia, Bayer, Lund-beck, Orion Pharma, UCB.

Bas Bloem, See separate file attached.

Richard Dodel, See separate file attached.

References

  • 1.Lees AJ, Hardy J, Revesz T. Parkinson’s disease. Lancet. 2009;373:2055–2066. doi: 10.1016/S0140-6736(09)60492-X. [DOI] [PubMed] [Google Scholar]
  • 2.Kowal SL, Dall TM, Chakrabarti R, Storm MV, Jain A. The current and projected economic burden of Parkinson’s disease in the United States. Mov Disord. 2013;28:311–318. doi: 10.1002/mds.25292. [DOI] [PubMed] [Google Scholar]
  • 3.Gustavsson A, Svensson M, Jacobi F, Allgulander C, Alonso J, Beghi E, Dodel R, Ekman M, Faravelli C, Fratiglioni L, Gannon B, Jones DH, Jennum P, Jordanova A, Jönsson L, Karampampa K, Knapp M, Kobelt G, Kurth T, Lieb R, Linde M, Ljungcrantz C, Maercker A, Melin B, Moscarelli M, Musayev A, Norwood F, Preisig M, Pugliatti M, Rehm J, Salvador-Carulla L, Schlehofer B, Simon R, Steinhausen H-C, Stovner LJ, Vallat J-M, Van den Bergh P, den Bergh PV, van Os J, Vos P, Xu W, Wittchen H-U, Jönsson B, Olesen J. Cost of disorders of the brain in Europe 2010. Eur Neuropsychopharmacol. 2011;21:718–779. doi: 10.1016/j.euroneuro.2011.08.008. [DOI] [PubMed] [Google Scholar]
  • 4.Dorsey ER, Constantinescu R, Thompson JP, Biglan KM, Holloway RG, Kieburtz K, Marshall FJ, Ravina BM, Schifitto G, Siderowf A, Tanner CM. Projected number of people with Parkinson disease in the most populous nations, 2005 through 2030. Neurology. 2007;68:384–386. doi: 10.1212/01.wnl.0000247740.47667.03. [DOI] [PubMed] [Google Scholar]
  • 5.Porter ME. What is value in health care? N Engl J Med. 2010:2477–2481. doi: 10.1056/NEJMp1011024. [DOI] [PubMed] [Google Scholar]
  • 6.Cheng EM, Siderowf A, Swarztrauber K, Eisa M, Lee M, Vickrey BG. Development of quality of care indicators for Parkinson’s disease. Mov Disord. 2004;19:136–150. doi: 10.1002/mds.10664. [DOI] [PubMed] [Google Scholar]
  • 7.Cheng EM, Tonn S, Swain-Eng R, Factor SA, Weiner WJ, Bever CT. Quality improvement in neurology: AAN Parkinson disease quality measures: Report of the Quality Measurement and Reporting Subcommittee of the American Academy of Neurology. Neurology. 2010;75:2021–2027. doi: 10.1212/WNL.0b013e3181ff96dd. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Nijkrake MJ, Keus SHJ, Ewalds H, Overeem S, Braspenning JCC, Oostendorp RAB, Hendriks EJM, Bloem BR, Munneke M. Quality indicators for physiotherapy in Parkinson’s disease. Eur J Phys Rehabil Med. 2009;45:239–245. [PubMed] [Google Scholar]
  • 9.National Parkinson Foundation. Parkinson’s Outcomes Project: Report to the Community. 2012. [Google Scholar]
  • 10.Our Standard Sets | ICHOM – International Consortium for Health Outcomes Measurement.
  • 11.Martin NE, Massey L, Stowell C, Bangma C, Briganti A, Bill-Axelson A, Blute M, Catto J, Chen RC, D’Amico AV, Feick G, Fitzpatrick JM, Frank SJ, Froehner M, Frydenberg M, Glaser A, Graefen M, Hamstra D, Kibel A, Mendenhall N, Moretti K, Ramon J, Roos I, Sandler H, Sullivan FJ, Swanson D, Tewari A, Vickers A, Wiegel T, Huland H. Defining a standard set of patient-centered outcomes for men with localized prostate cancer. Eur Urol. 2015;67:460–467. doi: 10.1016/j.eururo.2014.08.075. [DOI] [PubMed] [Google Scholar]
  • 12.Chaudhuri KR, Prieto-Jurcynska C, Naidu Y, Mitra T, Frades-Payo B, Tluk S, Ruessmann A, Odin P, Macphee G, Stocchi F, Ondo W, Sethi K, Schapira AHV, Martinez Castrillo JC, Martinez-Martin P. The nondeclaration of nonmotor symptoms of Parkinson’s disease to health care professionals: An international study using the nonmotor symptoms questionnaire. Mov Disord. 2010;25:704–709. doi: 10.1002/mds.22868. [DOI] [PubMed] [Google Scholar]
  • 13.Martinez-Martin P, Rodriguez-Blazquez C, Kurtis MM, Chaudhuri KR. The impact of non-motor symptoms on health-related quality of life of patients with Parkinson’s disease. Mov Disord. 2011;26:399–406. doi: 10.1002/mds.23462. [DOI] [PubMed] [Google Scholar]
  • 14.Müller B, Assmus J, Herlofson K, Larsen JP, Tysnes O-B. Importance of motor vs. non-motor symptoms for health-related quality of life in early Parkinson’s disease. Parkinsonism Relat Disord. 2013;19:1027–1032. doi: 10.1016/j.parkreldis.2013.07.010. [DOI] [PubMed] [Google Scholar]
  • 15.Chaudhuri KR, Odin P, Antonini A, Martinez-Martin P. Parkinson’s disease: The non-motor issues. Parkinsonism Relat Disord. 2011;17:717–723. doi: 10.1016/j.parkreldis.2011.02.018. [DOI] [PubMed] [Google Scholar]
  • 16.van der Eijk M, Faber MJ, Al Shamma S, Munneke M, Bloem BR. Moving towards patient-centered health-care for patients with Parkinson’s disease. Parkinsonism Relat Disord. 2011;17:360–364. doi: 10.1016/j.parkreldis.2011.02.012. [DOI] [PubMed] [Google Scholar]
  • 17.Visser M, Marinus J, Stiggelbout AM, Van Hilten JJ. Assessment of autonomic dysfunction in Parkinson’s disease: The SCOPA-AUT. Mov Disord. 2004;19:1306–1312. doi: 10.1002/mds.20153. [DOI] [PubMed] [Google Scholar]
  • 18.Chaudhuri KR, Martinez-Martin P, Schapira AHV, Stocchi F, Sethi K, Odin P, Brown RG, Koller W, Barone P, MacPhee G, Kelly L, Rabey M, MacMahon D, Thomas S, Ondo W, Rye D, Forbes A, Tluk S, Dhawan V, Bowron A, Williams AJ, Olanow CW. International multicenter pilot study of the first comprehensive self-completed nonmotor symptoms questionnaire for Parkinson’s disease: The NMSQuest study. Mov Disord. 2006;21:916–923. doi: 10.1002/mds.20844. [DOI] [PubMed] [Google Scholar]
  • 19.Chaudhuri KR, Martinez-Martin P, Brown RG, Sethi K, Stocchi F, Odin P, Ondo W, Abe K, Macphee G, Macmahon D, Barone P, Rabey M, Forbes A, Breen K, Tluk S, Naidu Y, Olanow W, Williams AJ, Thomas S, Rye D, Tsuboi Y, Hand A, Schapira AHV. The metric properties of a novel non-motor symptoms scale for Parkinson’s disease: Results from an international pilot study. Mov Disord. 2007;22:1901–1911. doi: 10.1002/mds.21596. [DOI] [PubMed] [Google Scholar]
  • 20.Goetz CG, Tilley BC, Shaftman SR, Stebbins GT, Fahn S, Martinez-Martin P, Poewe W, Sampaio C, Stern MB, Dodel R, Dubois B, Holloway R, Jankovic J, Kulisevsky J, Lang AE, Lees A, Leurgans S, LeWitt PA, Nyenhuis D, Olanow CW, Rascol O, Schrag A, Teresi JA, van Hilten JJ, LaPelle N. Movement Disorder Society-sponsored revision of the Unified Parkinson’s Disease Rating Scale (MDS-UPDRS): Scale presentation and clinimetric testing results. Mov Disord. 2008;23:2129–2170. doi: 10.1002/mds.22340. [DOI] [PubMed] [Google Scholar]
  • 21.Schrag A, Barone P, Brown RG, Leentjens AFG, Mcdonald WM, Starkstein S, Weintraub D, Poewe W, Rascol O, Sampaio C, Stebbins GT, Goetz CG. Depression rating scales in Parkinson’s disease: Critique and recommendations. Mov Disord. 2007;22:1077–1092. doi: 10.1002/mds.21333. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Williams JR, Hirsch ES, Anderson K, Bush AL, Goldstein SR, Grill S, Lehmann S, Little JT, Margolis RL, Palanci J, Pontone G, Weiss H, Rabins P, Marsh L. A comparison of nine scales to detect depression in Parkinson disease: Which scale to use? Neurology. 2012;78:998–1006. doi: 10.1212/WNL.0b013e31824d587f. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Leentjens AFG, Dujardin K, Marsh L, Martinez-Martin P, Richard IH, Starkstein SE, Weintraub D, Sampaio C, Poewe W, Rascol O, Stebbins GT, Goetz CG. Anxiety rating scales in Parkinson’s disease: Critique and recommendations. Mov Disord. 2008;23:2015–2025. doi: 10.1002/mds.22233. [DOI] [PubMed] [Google Scholar]
  • 24.Leentjens AFG, Dujardin K, Marsh L, Martinez-Martin P, Richard IH, Starkstein SE, Weintraub D, Sampaio C, Poewe W, Rascol O, Stebbins GT, Goetz CG. Apathy and anhedonia rating scales in Parkinson’s disease: Critique and recommendations. Mov Disord. 2008;23:2004–2014. doi: 10.1002/mds.22229. [DOI] [PubMed] [Google Scholar]
  • 25.Fernandez HH, Aarsland D, Fénelon G, Friedman JH, Marsh L, Tröster AI, Poewe W, Rascol O, Sampaio C, Stebbins GT, Goetz CG. Scales to assess psychosis in Parkinson’s disease: Critique and recommendations. Mov Disord. 2008;23:484–500. doi: 10.1002/mds.21875. [DOI] [PubMed] [Google Scholar]
  • 26.Friedman JH, Alves G, Hagell P, Marinus J, Marsh L, Martinez-Martin P, Goetz CG, Poewe W, Rascol O, Sampaio C, Stebbins G, Schrag A. Fatigue rating scales critique and recommendations by the Movement Disorders Society Task Force on rating scales for Parkinson’s disease. Mov Disord. 2010;25:805–822. doi: 10.1002/mds.22989. [DOI] [PubMed] [Google Scholar]
  • 27.Högl B, Arnulf I, Comella C, Ferreira J, Iranzo A, Tilley B, Trenkwalder C, Poewe W, Rascol O, Sampaio C, Stebbins GT, Schrag A, Goetz CG. Scales to assess sleep impairment in Parkinson’s disease: Critique and recommendations. Mov Disord. 2010;25:2704–2716. doi: 10.1002/mds.23190. [DOI] [PubMed] [Google Scholar]
  • 28.Watson GS, Cholerton BA, Gross RG, Weintraub D, Zabetian CP, Trojanowski JQ, Montine TJ, Siderowf A, Leverenz JB. Neuropsychologic assessment in collaborative Parkinson’s disease research: A proposal from the National Institute of Neurological Disorders and Stroke Morris K. Udall Centers of Excellence for Parkinson’s Disease Research at the University of Pennsylvania. Alzheimers Dement. 2013;9:609–614. doi: 10.1016/j.jalz.2012.07.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Kulisevsky J, Pagonabarraga J. Cognitive impairment in Parkinson’s disease: Tools for diagnosis and assessment. Mov Disord. 2009;24:1103–1110. doi: 10.1002/mds.22506. [DOI] [PubMed] [Google Scholar]
  • 30.Evatt ML, Chaudhuri KR, Chou KL, Cubo E, Hinson V, Kompoliti K, Yang C, Poewe W, Rascol O, Sampaio C, Stebbins GT, Goetz CG. Dysautonomia rating scales in Parkinson’s disease: Sialorrhea, dysphagia, and constipation — critique and recommendations by Movement Disorders Task Force on Rating Scales for Parkinson’s Disease. 2009;24:635–646. doi: 10.1002/mds.22260. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Martinez-Martin P, Rodriguez-Blazquez C, Alvarez-Sanchez M, Arakaki T, Bergareche-Yarza A, Chade A, Garretto N, Gershanik O, Kurtis MM, Martinez-Castrillo JC, Mendoza-Rodriguez A, Moore HP, Rodriguez-Violante M, Singer C, Tilley BC, Huang J, Stebbins GT, Goetz CG. Expanded and independent validation of the Movement Disorder Society-Unified Parkinson’s Disease Rating Scale (MDS-UPDRS) J Neurol. 2013;260:228–236. doi: 10.1007/s00415-012-6624-1. [DOI] [PubMed] [Google Scholar]
  • 32.Gallagher DA, Goetz CG, Stebbins G, Lees AJ, Schrag A. Validation of the MDS-UPDRS Part I for nonmotor symptoms in Parkinson’s disease. Mov Disord. 2012;27:79–83. doi: 10.1002/mds.23939. [DOI] [PubMed] [Google Scholar]
  • 33.Beck AT, Steer RA, Carbin MG. Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clin Psychol Rev. 1988;8:77–100. [Google Scholar]
  • 34.Spielberger CD, Gorsuch RL, Lushene R. Manual for the state-trait anxiety inventory. Consulting Psychologists’ Press; 1983. [Google Scholar]
  • 35.Koski L, Xie H, Finch L. Measuring cognition in a geriatric outpatient clinic: Rasch analysis of the Montreal Cognitive Assessment. J Geriatr Psychiatry Neurol. 2009;22:151–160. doi: 10.1177/0891988709332944. [DOI] [PubMed] [Google Scholar]
  • 36.Goetz CG, Poewe W, Rascol O, Sampaio C, Stebbins GT, Counsell C, Giladi N, Holloway RG, Moore CG, Wenning GK, Yahr MD, Seidl L. Movement Disorder Society Task Force report on the Hoehn and Yahr staging scale: Status and recommendations. Mov Disord. 2004;19:1020–1028. doi: 10.1002/mds.20213. [DOI] [PubMed] [Google Scholar]
  • 37.Hoehn MM, Yahr MD. Parkinsonism: Onset, progression and mortality. Neurology. 1967;17:427–442. doi: 10.1212/wnl.17.5.427. [DOI] [PubMed] [Google Scholar]
  • 38.McRae C, Diem G, Vo A, O’Brien C, Seeberger L. Reliability of measurements of patient health status: A comparison of physician, patient, and caregiver ratings. Parkinsonism Relat Disord. 2002;8:187–192. doi: 10.1016/s1353-8020(01)00009-8. [DOI] [PubMed] [Google Scholar]
  • 39.Martinez-Martin P, Jeukens-Visser M, Lyons KE, Sampaio C, Stebbins GT, Goetz CG, Schrag A. Health-related quality-of-life scales in Parkinson’s disease: Critique and recommendations. Mov Disord. 2011;26:2371–2380. doi: 10.1002/mds.23834. [DOI] [PubMed] [Google Scholar]
  • 40.Jenkinson C, Fitzpatrick R, Peto V, Greenhall R, Hyman N. The Parkinson’s Disease Questionnaire (PDQ-39): Development and validation of a Parkinson’s disease summary index score. Age Ageing. 1997;26:353–357. doi: 10.1093/ageing/26.5.353. [DOI] [PubMed] [Google Scholar]
  • 41.Antonini A, Martinez-Martin P, Chaudhuri RK, Merello M, Hauser R, Katzenschlager R, Odin P, Stacy M, Stocchi F, Poewe W, Rascol O, Sampaio C, Schrag A, Stebbins GT, Goetz CG. Wearing-off scales in Parkinson’s disease: Critique and recommendations. Mov Disord. 2011;26:2169–2175. doi: 10.1002/mds.23875. [DOI] [PubMed] [Google Scholar]
  • 42.Qutubuddin AA, Pegg PO, Cifu DX, Brown R, McNamee S, Carne W. Validating the Berg Balance Scale for patients with Parkinson’s disease: A key to rehabilitation evaluation. Arch Phys Med Rehabil. 2005;86:789–792. doi: 10.1016/j.apmr.2004.11.005. [DOI] [PubMed] [Google Scholar]
  • 43.Schlenstedt C, Brombacher S, Hartwigsen G, Weisser B, Möller B, Deuschl G. Comparing the Fullerton Advanced Balance Scale with the Mini-BESTest and Berg Balance Scale to assess postural control in patients with Parkinson disease. Arch Phys Med Rehabil. 2015;96:218–225. doi: 10.1016/j.apmr.2014.09.002. [DOI] [PubMed] [Google Scholar]
  • 44.Foreman KB, Addison O, Kim HS, Dibble LE. Testing balance and fall risk in persons with Parkinson disease, an argument for ecologically valid testing. Parkinsonism Relat Disord. 2011;17:166–171. doi: 10.1016/j.parkreldis.2010.12.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Morris S, Morris ME, Lansek R. Reliability of measurements obtained with the Timed “Up & Go” test in people with Parkinson disease. Phys Ther. 2001;81:810–818. doi: 10.1093/ptj/81.2.810. [DOI] [PubMed] [Google Scholar]
  • 46.Jenkinson C, Fitzpatrick R, Peto V, Greenhall R, Hyman N. The PDQ-8: Development and validation of a short-form Parkinson’s disease questionnaire. Psychol Health. 1997;12:805–814. [Google Scholar]
  • 47.Peto V, Jenkinson C, Fitzpatrick R. PDQ-39: A review of the development, validation and application of a Parkinson’s disease quality of life questionnaire and its associated measures. J Neurol. 1998;245(Suppl 1):S10–S14. doi: 10.1007/pl00007730. [DOI] [PubMed] [Google Scholar]
  • 48.Tan LCS, Luo N, Nazri M, Li SC, Thumboo J. Validity and reliability of the PDQ-39 and the PDQ-8 in English-speaking Parkinson’s disease patients in Singapore. Parkinsonism Relat Disord. 2004;10:493–499. doi: 10.1016/j.parkreldis.2004.05.007. [DOI] [PubMed] [Google Scholar]
  • 49.Poletti M, Emre M, Bonuccelli U. Mild cognitive impairment and cognitive reserve in Parkinson’s disease. Parkinsonism Relat Disord. 2011;17:579–586. doi: 10.1016/j.parkreldis.2011.03.013. [DOI] [PubMed] [Google Scholar]
  • 50.Bennett DA, Arnold SE, Valenzuela MJ, Brayne C, Schneider JA. Cognitive and social lifestyle: Links with neuropathology and cognition in late life. Acta Neuropathol. 2014;127:137–150. doi: 10.1007/s00401-013-1226-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Guo X, Song W, Chen K, Chen X, Zheng Z, Cao B, Huang R, Zhao B, Wu Y, Shang H-F. Gender and onset age-related features of non-motor symptoms of patients with Parkinson’s disease - a study from Southwest China. Parkinsonism Relat Disord. 2013;19:961–965. doi: 10.1016/j.parkreldis.2013.06.009. [DOI] [PubMed] [Google Scholar]
  • 52.Lipnicki DM, Sachdev PS, Crawford J, Reppermund S, Kochan NA, Trollor JN, Draper B, Slavin MJ, Kang K, Lux O, Mather KA, Brodaty H. Risk factors for late-life cognitive decline and variation with age and sex in the Sydney Memory and Ageing Study. PLoS One. 2013;8:e65841. doi: 10.1371/journal.pone.0065841. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Postuma RB, Arnulf I, Hogl B, Iranzo A, Miyamoto T, Dauvilliers Y, Oertel W, Ju Y-E, Puligheddu M, Jennum P, Pelletier A, Wolfson C, Leu-Semenescu S, Frauscher B, Miyamoto M, Cochen De Cock V, Unger MM, Stiasny-Kolster K, Fantini ML, Montplaisir JY. A single-question screen for rapid eye movement sleep behavior disorder: A multicenter validation study. Mov Disord. 2012;27:913–916. doi: 10.1002/mds.25037. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.European Social Survey. APPENDIX A4 The measurement of legal marital and relationship status in the ESS. 2012. [Google Scholar]
  • 55.UNESCO. International Standard Classification of Education (ISCED) 2011. UNESCO Institute for Statistics; 2011. [Google Scholar]
  • 56.Patient Reported Outcome Measures (PROMs) in England: The case-mix adjustment methodology. Department of Health, prepared by the PROMs team, Policy, Strategy and Finance Directorate; 2012. [Google Scholar]
  • 57.Crizzle AM, Classen S, Uc EY. Parkinson disease and driving: An evidence-based review. Neurology. 2012;79:2067–2074. doi: 10.1212/WNL.0b013e3182749e95. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Tennant A, Penta M, Tesio L, Grimby G, Thonnard J-L, Slade A, Lawton G, Simone A, Carter J, Lundgren-Nilsson A, Tripolski M, Ring H, Biering-Sørensen F, Marincek C, Burger H, Phillips S. Assessing and adjusting for cross-cultural validity of impairment and activity limitation scales through differential item functioning within the framework of the Rasch model: The PRO-ESOR project. Med Care. 2004;42:I37–I48. doi: 10.1097/01.mlr.0000103529.63132.77. [DOI] [PubMed] [Google Scholar]

RESOURCES