Is ioflupane I123 injection diagnostically effective in patients with movement disorders and dementia? Pooled analysis of four clinical trials

Abstract

Objectives

To pool clinical trials of similar design to assess overall sensitivity and specificity of ioflupane I123 injection (DaTSCAN or ioflupane (¹²³I)) to detect or exclude a striatal dopaminergic deficit disorder (SDDD), such as parkinsonian syndrome and dementia with Lewy bodies.

Design

Pooled analysis of three phase 3 and one phase 4 clinical trials. These four trials were selected because they were the four studies used for the US new drug application to the Food and Drug Administration (FDA).

Setting

Multicentre, open-label, non-randomised.

Participants

Patients with either a movement disorder or dementia, and healthy volunteers.

Interventions

Ioflupane (¹²³I) was administered.

Outcome measures

Images were assessed by panels of 3–5 blinded experts and/or on-site nuclear medicine physicians, classified as normal or abnormal and compared with clinical diagnosis (reference standard) to determine sensitivity and specificity.

Results

Pooling the four studies, 928 participants were enrolled, 849 were dosed and 764 completed their study. Across all studies, when images were assessed by on-site readers, ioflupane (¹²³I) diagnostic effectiveness had an overall (95% CI) sensitivity of 91.9% (88.7% to 94.5%) and specificity of 83.6% (78.7% to 87.9%). When reads were conducted blindly by a panel of independent experts, the overall sensitivity was 88.7% (86.8% to 90.4%) and specificity was 91.2% (89.0% to 93.0%).

Conclusions

In this pooled analysis, the visual assessment of ioflupane (¹²³I) images provided high levels of sensitivity and specificity in detecting the presence/absence of an SDDD. Ioflupane (¹²³I) imaging has the potential to improve diagnostic accuracy in patients with signs and symptoms of a movement disorder and/or dementia.

Trial registration number

NCT00209456.

Strengths and limitations of this study.

• This study provides the largest and most definitive set of clinical evidence to date, summarising experience from three phase 3 and one phase 4 trials with all data pooled for a new statistical analysis, N=726, showing that ioflupane (¹²³I) single-photon emission CT imaging has high sensitivity and specificity for detecting the presence or absence of a striatal dopaminergic deficit in patients with movement disorders and dementia (intent to diagnose and per protocol populations). Differences among different patient populations and inter-reader blinded image evaluation results are reported.

• Well-designed, prospective studies with 12–36 months of clinical follow-up after ioflupane (¹²³I) imaging, in which blinded image evaluation by 3–5 independent nuclear medicine physicians (no access to clinical information) was used for image assessment.

• Studies did not have autopsy confirmation of diagnosis (found to be impractical for up to 36 months of follow-up in the majority of patients in early stage of the disease), though the standard of expert clinical diagnosis, particularly at follow-up after 12 months or later, is an accepted reference standard for biomarker validation studies.

• Only two of the studies (PDT301 and PDT304) used expert clinical panels to establish the clinical diagnosis; the others relied on on-site investigator diagnosis (though made blind to imaging findings, except one clinical utility study PDT408).

Introduction

Despite the development of consensus clinical diagnostic criteria,^1–5 early and accurate diagnosis of common neurodegenerative conditions like Parkinson's disease (PD) and dementia with Lewy bodies (DLB) continues to present challenges. Delays in diagnosis cause unnecessary distress and uncertainty for patients and their families, increase healthcare use through additional appointments and investigations and increase the risk that patients will develop preventable disabilities.⁶ Not surprisingly, the longer a patient is observed and the greater the amount of accumulated clinical information, such as response to medications and progression of signs and symptoms, the greater the accuracy of the diagnosis.⁷ Inaccurate diagnoses may result in prescription of inappropriate medications, needlessly exposing patients to potentially harmful side effects, while denying patients treatment of symptoms.⁶ Furthermore, diagnostic discrimination between degenerative and non-degenerative diseases is important because disease course, therapy and prognosis differ considerably among patients.^{6 8}

Differential diagnosis of movement disorders may be confounded by presence of inconsistent parkinsonian features and/or atypical presentation of classic symptoms. Differentiation of Alzheimer's disease (AD) from DLB is also difficult, even after multiple evaluations. Consensus clinical criteria^{2–5 9} without imaging results have good specificity (80–90%), but sensitivity is highly variable and can be as low as 30%, with the most common misdiagnosis being AD.^{9 10}

The advent of in vivo visualisation of striatal dopamine transporter using the radiopharmaceutical ioflupane (¹²³I) (iodine-123-fluoropropyl (FP)-carbomethoxy-3β-(4-iodophenyltropane) (CIT) or ioflupane I123 injection or [¹²³I] ioflupane or [¹²³I] FP-CIT or DaTSCAN or DaTscan, GE Healthcare, Amersham, UK) and single-photon emission CT (SPECT) imaging has enhanced clinicians’ ability to differentiate diseases that involve loss of dopaminergic nigrostriatal neurons from those that do not. Throughout this paper we will refer to these disorders as striatal dopaminergic deficit disorders (SDDDs), which is the clinicopathoanatomical term used here as a group term for the clinical reference diagnoses of parkinsonian syndrome (PS) and/or DLB, by virtue of them being recognised as clinical disorders that are known to have striatal dopaminergic deficit. Ioflupane (¹²³I) is the only approved imaging agent for this purpose; the European Medicines Agency (EMA) approved it under the trade name DaTSCAN (ioflupane (¹²³I)) in 2000,¹¹ and the US Food and Drug Administration (FDA) approved it under the trade name DaTscan (ioflupane I123 injection) in 2011.¹² It is currently approved in 33 countries. We searched the literature and found numerous clinical trials that have been performed to establish the technical feasibility, diagnostic effectiveness, sensitivity and specificity of ioflupane (¹²³I).^13–43 However, each trial had limited numbers of participants for whom results were available, ranging from 16 to 326.^{37 15} Our search revealed that two meta-analyses have been performed evaluating diagnostic accuracy of SPECT imaging in DLB and in PSs.^{44 45} However, no previous pooled data analysis had been undertaken and the aim of this study was to undertake a pooled analysis using the four clinical studies that were the large, multisite efficacy trials submitted to support the new drug application filing in the USA (three of them for EU) for licensing. They were conducted to the Good Clinical Practice (GCP) standards in predefined populations. Meta-analyses do not allow combination of individual participant's data; only mean values from each study publication are used, rather than maximising information from the raw data. Meta-analyses include all available studies, and may include small, exploratory, non-GCP studies; and may include tracer prototypes (eg, non-approved tracers such as β-CIT) that are not manufactured to commercial tracer quality, with robust, regulatory-accepted good manufacturing practice processes.

Although two of our studies had been included in each of the meta-analyses (PDT301 baseline¹⁴ in,⁴⁴ and DP008-003¹³ in⁴⁵), the other two had not. Performing a pooled analysis would provide a large body of evidence on the diagnostic performance of ioflupane (¹²³I) in participants with movement disorders or dementia.

Methods

Participants

The research question was to determine the pooled diagnostic accuracy (sensitivity and specificity) of the four trials submitted to the US FDA application for ioflupane (¹²³I).^13–18 All studies tested the effectiveness of ioflupane (¹²³I) (for the purposes of this report, ioflupane (¹²³I) will be used throughout the paper) in detecting the loss of dopaminergic nigrostriatal neurons in participants with symptoms and signs of movement disorders and/or dementia. The reference standard was the final clinical diagnosis of a disease that is known to have or not have a striatal dopaminergic deficit (hereafter called reference clinical diagnosis).⁴⁶ This clinical diagnosis was made blind to imaging results in three of the four studies (phase 3 studies DP008-003, PDT301, PDT304 (also elsewhere sometimes known as PDT03004)). In two of the four studies (PDT301 and PDT304), the final clinical diagnosis was made by a panel of experts. Table 1 summarises the attributes of the four studies. Although phase 4 study PDT408 was designed to assess the clinical utility of ioflupane (¹²³I) image assessments as the primary end point, sensitivity and specificity were secondary end points, and the image results were included in the pooled analysis. The investigators who participated in each of the four studies are listed in online supplementary table S1.

Table 1.

Summary of studies included in pooled analysis

	Principal study
	DP008-003	PDT304	PDT301	PDT408
Study design	▸ Phase 3 ▸ Multicentre, open-label, non-randomised ▸ Single-dose ▸ Expert clinical diagnosis at baseline according to published consensus criteria as the RCD	▸ Phase 3 ▸ Multicentre, open-label, non-randomised ▸ Repeat-dose (maximum of 3) ▸ Expert clinical diagnosis at 36 months as the RCD	▸ Phase 3 ▸ Multicentre, open-label, non-randomised ▸ Single-dose ▸ Expert clinical diagnosis at 12 months as the RCD	▸ Phase 4 ▸ Multicentre, open-label, non-randomised ▸ Single-dose ▸ Expert clinical diagnosis at 24 months as the RCD
Dates study was conducted	▸ August 1997 to February 1998	▸ January 1999 to June 2005	▸ December 2003 to June 2006	▸ November 2000 to November 2003
Population	▸ Healthy volunteers ▸ Participants with a clinical diagnosis of: ▸ Parkinson's disease ▸ Multiple system atrophy ▸ Progressive supranuclear palsy or ▸ Essential tremor	▸ Healthy volunteers ▸ Participants with the clinical features of: ▸ Early Parkinson's disease or ▸ Tremor (mainly essential tremor)	▸ Participants with dementia (features of possible DLB or with features of other dementia (AD, VaD))	▸ Participants with movement disorders (an uncertain clinical diagnosis as to PS or non-PS)
Efficacy objectives	▸ Primary ▸ Sensitivity and specificity for detecting or excluding an SDDD ▸ Secondary ▸ Inter-reader agreement	▸ Primary ▸ Sensitivity and specificity for detecting or excluding an SDDD ▸ Secondary ▸ Inter-reader agreement	▸ Primary ▸ Sensitivity and specificity for detecting or excluding an SDDD ▸ Secondary ▸ Inter-reader agreement	▸ Primary* ▸ Impact of ioflupane (123I) image assessments on patient diagnoses, confidence that patient had PS, and planned management ▸ Secondary ▸ Sensitivity and specificity for detecting or excluding an SDDD
Type of control	No control used	No control used	No control used	No control used
Investigational product	Ioflupane (123I) 111–185 MBq (3–5 mCi) iv, 1 dose	Ioflupane (123I) 111–185 MBq (3–5 mCi) iv, 3 doses 18 months apart	Ioflupane (123I) 111–185 MBq (3–5 mCi) iv, 1 dose	Ioflupane (123I) 111–185 MBq (3–5 mCi) iv, 1 dose (73 participants) or 2 doses 24 months apart (14 participants)
Number of study centres	6	10	40	15
Number of participants enrolled	250	202	351	125
Age of ITD population, range (mean)	40, 80 (62.7)	33, 79 (60.4)	54, 90 (73.9)	25, 84 (64.2)
Gender	62% male, 38% female	56% male, 44% female	57% male, 43% female	58% male, 42% female
Race	Caucasian 98% Black 1% Asian <1%	Caucasian 100%	Caucasian 100%	Caucasian 99% Asian 1%
Number of participants evaluable for efficacy	220	102	288	118
Blinded reads performed	Yes	Yes	Yes	No

*Primary objective was to assess clinical utility of ioflupane (¹²³I) images; however, images were used for pooled efficacy analysis.

AD, Alzheimer's disease; DLB, dementia with Lewy bodies; ITD, intent to diagnose; MBq, megabecquerel; PS, parkinsonian syndrome; RCD, reference clinical diagnosis; SDDD, striatal dopaminergic deficit disorder; VaD, vascular dementia.

All studies were conducted in accordance with the current revision of the Declaration of Helsinki; the GCP: Consolidated Guideline, approved by the International Conference on Harmonisation and applicable national and local laws. Participants or their guardians gave written informed consent after the aims, methods, anticipated benefits and potential hazards were explained, and prior to starting any study procedures or assessments. The informed consent for each study included a provision for subsequent analyses, of which this pooled analysis is an example. Study PDT301 is identified in clinicaltrials.gov as NCT00209456. All other trials began enrolling prior to 1 July 2005, the cut-off date for the initiation of the requirement by the International Committee of Medical Journal Editors for trials to be registered, so are not associated with any public database identifiers.

Procedures

All studies, including each study's inclusion and exclusion criteria, have been published^13–18; a brief overview of the methods follows. All four studies were open-label, non-randomised, phase 3 or 4 clinical trials to determine the sensitivity (positive per cent agreement (PPA)) and specificity (negative per cent agreement (NPA)) of ioflupane (¹²³I) SPECT imaging to detect or exclude an SDDD in participants with various movement disorders (PS, including PD, multiple system atrophy (MSA) and progressive supranuclear palsy (PSP); or essential tremor (ET)) and/or dementia (DLB, AD or vascular dementia (VaD)), and healthy volunteers. Participants received either a single or repeat (up to three doses total) dose of 111–185 MBq of ioflupane (¹²³I). SPECT imaging was performed between 3 and 6 h after injection. Ioflupane (¹²³I) images were read on-site (institutional reads), as well as by three or five independent blinded readers (blinded image evaluation (BIE)) in three of the studies, and classified as normal (SDDD absent) or abnormal (SDDD present). Abnormal images were further classified as type 1, 2 or 3.¹² Expert clinical diagnosis using a blinded panel of three neurologists or dementia specialists established whether the participant had an SDDD (PD, PS, PSP, MSA or DLB) or a non-SDDD (ET, AD or VaD and healthy volunteers). Expert clinical diagnosis was established at various time points across the four studies: DP008-003 at baseline, PDT301 at baseline and month 12, PDT408 at baseline and month 24 and PDT304 at baseline and months 18 and 36. In PDT408, the final diagnosis was made with access to the ioflupane (¹²³I) SPECT images.

Each ioflupane (¹²³I) image result was compared with the corresponding reference clinical diagnosis, and classified as a true-positive (TP), true-negative (TN), false-positive (FP) or false-negative (FN) scan to allow calculation of sensitivity and specificity. Sensitivity was calculated as nTP/(nTP+nFN), (n=number of participants). Specificity was calculated as nTN/(nTN+nFP).

Additional efficacy end points included inter-reader agreement between BIE readers, as well as BIE readers versus on-site institutional readers (DP008-003, PDT304 and PDT301).

Statistical analysis

All statistical analyses were performed using Statistical Analysis Software (SAS Institute Inc, Cary, North Carolina, USA). Demographic data were collected and are presented using descriptive statistics. Populations analysed included enrolled (all participants who were enrolled in any one of the four studies), dosed (all enrolled participants who received ioflupane (¹²³I)), intent to diagnose (ITD; all dosed participants who underwent SPECT imaging and underwent the reference clinical diagnosis assessment for the relevant analysis) and per protocol (PP; all participants in the ITD population with no major protocol violations). Sensitivity and specificity were calculated for the ITD and PP populations, and are reported with 95% CIs. For the purpose of this report, we will be using sensitivity and specificity (equivalent to PPA and NPA). Pairwise inter-reader and BIE versus on-site reader agreement were analysed using Cohen's κ statistic. Inter-reader agreement across all BIE readers was analysed using Fleiss’ κ statistic.

Results

Participant disposition and characteristics

Participant disposition for each study and for the pooled analysis is shown in figure 1. Of the 928 participants enrolled, 849 (91%) were dosed, and 764 (82%) completed their study. The most common reasons for not completing a study included participant request/withdrew consent (85 participants, 9%), lost to follow-up (34 participants, 4%) and protocol violation (14 participants, 2%). Eleven participants (1%) did not complete due to safety concerns, including adverse events.

Figure 1.

Participant disposition. AE, adverse event; ITD, intent to diagnose; PP, per protocol.

Medical history data were not collected consistently across studies and could not be pooled for this analysis.

By-study and pooled participant baseline demographics are shown in table 2 (ITD population; PP population in online supplementary table S3). No meaningful differences were noted in baseline demographics between the ITD and PP populations. Age was similar in three of the four studies, with participants in PDT301 being older—unsurprisingly because this study only included people with dementia. In all studies, there were more men than women, with a similar ratio across studies. The majority was Caucasian, with African-Americans and/or Asians representing 1% or less in any single study. Clinical diagnoses represented in each study are tabulated in table 2 (ITD population) and online supplementary table S4 (PP population), and are presented graphically in figure 2A (ITD population) and figure 2B (PP population). Overall, 393 (54%) of participants in the ITD population were classified as having SDDD (SDDD present), while 249 (34%) were classified with conditions that did not have an SDDD (SDDD absent).

Table 2.

Demographic characteristics and clinical diagnosis (per reference clinical diagnosis) by study—ITD population (N=726)

	Study				Total (N=726)
	DP008-003 (N=220)	PDT304 (N=102)	PDT301 (N=326)	PDT408 (N=78)
Age (year)
Mean (SD)	62.7 (8.87)	60.4 (10.91)	73.9 (7.17)	64.2 (11.99)	67.6 (10.60)
Minimum, Maximum	40, 80	33, 79	54, 90	25, 84	25, 90
Median	63.5	61.0	75.0	67.0	69.0
Gender
Male	136 (62%)	57 (56%)	187 (57%)	41 (53%)	421 (58%)
Female	84 (38%)	45 (44%)	139 (43%)	37 (47%)	305 (42%)
Race
Caucasian	216 (98%)	102 (100%)	326 (100%)	77 (99%)	721 (99%)
Black	3 (1%)	0 (0%)	0 (0%)	0 (0%)	3 (<1%)
Asian	1 (<1%)	0 (0%)	0 (0%)	1 (1%)	2 (<1%)
Other	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
PS (SDDD)	158 (72%)	71 (70%)	0 (0%)	48 (62%)	277 (38%)
Possible PS	158 (72%)	5 (5%)	0 (0%)	48 (62%)	211 (29%)
Probable PS	0 (0%)	66 (65%)	0 (0%)	0 (0%)	66 (9%)
DLB (SDDD)	0 (0%)	0 (0%)	116 (36%)	0 (0%)	116 (16%)
Possible DLB	0 (0%)	0 (0%)	27 (8%)	0 (0%)	27 (4%)
Probable DLB	0 (0%)	0 (0%)	89 (27%)	0 (0%)	89 (12%)
Non-PS/non-DLB (no SDDD)	62 (28%)	31 (30%)	126 (39%)	30 (38%)	249 (34%)
ET	27 (12%)	14 (14%)	0 (0%)	23 (29%)	64 (9%)
AD	0 (0%)	0 (0%)	125 (38%)	0 (0%)	125 (17%)
Other	35 (16%)	17 (17%)	1 (<1%)	7 (9%)	60 (8%)
SDDD present*	158 (72%)	71 (70%)	116 (36%)	48 (62%)	393 (54%)
SDDD absent	62 (28%)	31 (30%)	126 (39%)	30 (38%)	249 (34%)

*Includes possible and probable PS and possible and probable DLB diagnoses.

AD, Alzheimer's disease; DLB, dementia with Lewy bodies; ET, essential tremor; ITD, intent to diagnose; N, number of participants in the study; PS, parkinsonian syndrome; SDDD, striatal dopaminergic deficit disorder.

Figure 2.

Summary of clinical diagnosis (per reference clinical standard) by study. (A) ITD population. (B) PP population. AD, Alzheimer's disease; DLB, dementia with Lewy bodies; ET, essential tremor; ITD, intent to diagnose; PP, per protocol; PS, parkinsonian syndrome; SDD, striatal dopaminergic deficit.

Sensitivity (PPA) and specificity (NPA)

Sensitivity and specificity for ioflupane (¹²³I) to detect SDDD (abnormal scan) or non-SDDD (normal scan) using the mean of BIE reads is displayed in figure 3. Online supplementary tables S4 and S5 (ITD and PP populations, respectively) show the means and 95% CI for the individual reads for PSs, DLB and total. Figure 3A shows high sensitivity and specificity in the ITD population for both movement disorders (PS) and the total pooled analysis, with a slightly lower sensitivity value (78.5%) when assessing participants with dementia. Sensitivity and specificity did not change substantially when reference clinical diagnoses were made for DLB at month 12. Sensitivity decreased when reference clinical diagnoses were made for PS at months 18 and 36 (78.9% and 76.6%), but specificity values increased slightly, exceeding 95% at each time point. Overall, the sensitivity of BIE reads of ioflupane (¹²³I) SPECT images in the ITD population for PS and dementia at all diagnosis time points ranged from 76.6% to 91.1%, and specificity ranged from 90.1% to 96.7%; PP population results (figure 3C, D) were very similar. Figure 4A–D displays the same analyses using the on-site read results. Overall, sensitivity in the ITD population (figure 4A, B) ranged from 81.4% to 89.9%, and tended to be higher for on-site reads compared with the BIE reads. Specificity ranged from 81.6% to 90.3%, and tended to be lower compared with BIE reads. No meaningful differences were noted in the values when analysing the PP population (figure 4C, D). Tables 3 and 4 (ITD and PP populations, respectively) summarise the sensitivity and specificity by expert clinical diagnosis for on-site, institutional reads.

Figure 3.

Summary of sensitivity (PPA) and specificity (NPA) by expert clinical diagnosis—mean of blind reads. (A) ITD population—summary results calculated across all studies and readers at baseline. DLB is calculated based on probable DLB versus non-DLB. Total is calculated based on SDDD present versus SDDD absent. (B) ITD population—DLB at month 12 calculated for all readers in study PDT301. PS at month 18 and 36 calculated for all readers in study PDT304. (C) PP population—summary results calculated across all studies and readers at baseline. DLB is calculated based on probable DLB versus non-DLB. Total is calculated based on SDDD present versus SDDD absent. (D) PP population—DLB at month 12 calculated for all readers in study PDT301. PS at month 18 and 36 calculated for all readers in study PDT304. DLB, dementia with Lewy bodies; ITD, intent to diagnose; NPA, negative per cent agreement; PP, per protocol; PPA, positive per cent agreement; PS, parkinsonian syndrome; SDDD, striatal dopaminergic deficit disorder.

Figure 4.

Summary of sensitivity (PPA) and specificity (NPA) by expert clinical diagnosis—on-site institutional reads. (A) ITD population—summary results calculated across all studies and time points. For PDT301, month 12 reference clinical diagnosis was used in this analysis. DLB is calculated based on probable DLB versus non-DLB. Total is calculated based on SDDD present versus SDDD absent. (B) ITD population—DLB at month 12 calculated for on-site readers in study PDT301. PS at month 18 and 36 calculated for on-site readers in study PDT304. (C) PP population—summary results calculated across all studies and time points. For PDT301, month 12 reference clinical diagnosis was used in this analysis. DLB is calculated based on probable DLB versus non-DLB. Total is calculated based on SDDD present versus SDDD absent. (D) PP population—DLB at month 12 calculated for on-site readers in study PDT301. PS at month 18 and 36 calculated for on-site readers in study PDT304. DLB, dementia with Lewy bodies; ITD, intent to diagnose; NPA, negative per cent agreement; PP, per protocol; PPA, positive per cent agreement; PS, parkinsonian syndrome; SDDD, striatal dopaminergic deficit disorder.

Table 3.

Summary of sensitivity (PPA) and specificity (NPA) by expert clinical diagnosis—on-site institutional reads—ITD population (N=726)

Response	Expert clinical diagnosis
	PS; SDDD		DLB; SDDD		Total
	Sensitivity	Specificity	Sensitivity	Specificity	Sensitivity	Specificity
	(%, 95% CI)	(%, 95% CI)	(%, 95% CI)	(%, 95% CI)	(%, 95% CI)	(%, 95% CI)
Pooled studies*	93.1 (89.5 to 95.8)	91.1 (84.6 to 95.5)	88.3 (80.0 to 94.0)	77.4 (69.7 to 83.9)	91.9 (88.7 to 94.5)	83.6 (78.7 to 87.9)
Study PDT301—month 12			89.9 (81.7 to 95.3)	81.6 (73.7 to 88.0)
Study PDT304—month 18	81.4 (70.3 to 89.7)	90.3 (74.2 to 98.0)
Study PDT304—month 36	83.8 (72.9 to 91.6)	86.2 (68.3 to 96.1)
Mean results†	89.6 (86.3 to 92.4)	90.2 (84.9 to 94.1)	89.9 (81.7 to 95.3)	81.6 (73.7 to 88.0)	89.7 (86.7 to 92.2)	86.7 (82.4 to 90.3)

Sensitivity/specificity for DLB is calculated based on probable DLB versus non-DLB.

Sensitivity/specificity for total is calculated based on SDDD versus non-SDDD.

*Pooled studies include on-site ioflupane (¹²³I) reads for DP008-003, PDT304 (at baseline), PDT301 (baseline reference clinical diagnosis) and PDT408.

†Summary results calculated across all studies and time points. For PDT301, the month 12 reference clinical diagnosis was used.

DLB, dementia with Lewy bodies; ITD, intent to diagnose; NPA, negative per cent agreement; PPA, positive per cent agreement; PS, parkinsonian syndrome; SDDD, striatal dopaminergic deficit disorder.

Table 4.

Summary of sensitivity (PPA) and specificity (NPA) by expert clinical diagnosis—on-site institutional reads—PP population (N=622)

Response	Expert clinical diagnosis
	PS; SDDD		DLB; SDDD		Total
	Sensitivity	Specificity	Sensitivity	Specificity	Sensitivity	Specificity
	(%, 95% CI)	(%, 95% CI)	(%, 95% CI)	(%, 95% CI)	(%, 95% CI)	(%, 95% CI)
Pooled studies*	91.8 (87.5 to 95.0)	90.3 (82.9 to 95.2)	87.5 (78.7 to 93.6)	77.1 (69.3 to 83.7)	90.6 (86.8 to 93.6)	82.6 (77.3 to 87.1)
Study PDT301—month 12			89.4 (80.8 to 95.0)	81.3 (73.3 to 87.8)
Study PDT304—month 18	80.9 (69.5 to 89.4)	90.3 (74.2 to 98.0)
Study PDT304—month 36	83.3 (72.1 to 91.4)	86.2 (68.3 to 96.1)
Mean results†	88.2 (84.5 to 91.3)	89.6 (83.8 to 93.8)	89.4 (80.8 to 95.0)	81.3 (73.3 to 87.8)	88.4 (85.1 to 91.2)	86.0 (81.4 to 89.8)

Sensitivity/specificity for DLB is calculated based on probable DLB versus non-DLB.

Sensitivity/specificity for total is calculated based on SDDD versus non-SDDD.

*Pooled studies include on-site [¹²³I] FP-CIT reads for DP008-003, PDT304 (at baseline), PDT301 (baseline reference clinical diagnosis) and PDT408.

†Summary results calculated across all studies and time points. For PDT301, the month 12 reference clinical diagnosis was used.

DLB, dementia with Lewy bodies; FP-CIT, fluoropropyl-carbomethoxy-3β-(4-iodophenyltropane); NPA, negative per cent agreement; PP, per protocol; PPA, positive per cent agreement; PS, parkinsonian syndrome; SDDD, striatal dopaminergic deficit disorder.

Inter-reader agreement

Three of the studies had BIE readers, and study PDT304 had three sets of images to be read. Overall, the agreement between the BIE reader pairs was good, and ranged from 0.81 (95% CI 0.73 to 0.90) to 1.00 (1.00 to 1.00). The Fleiss’ κ for all BIE readers in a study ranged from 0.88 (0.84 to 0.92) to 0.99 (0.87 to 1.10). Agreement between the BIE readers and the on-site read was similar for two of the studies, and ranged from 0.82 (0.73 to 0.90) to 0.94 (0.87 to 1.01); for study PDT301, the agreement for this comparison was not as good, with κ ranging from 0.60 (0.51 to 0.69) to 0.68 (0.60 to 0.76). Inter-reader agreement for the PP population was comparable to that determined for the ITD population (data not shown).

Discussion

The current pooled analysis provides the largest data set of clinical evidence (N=726 in the ITD population) to date showing that ioflupane (¹²³I) SPECT imaging has high sensitivity and specificity for detecting the presence or absence of a striatal dopaminergic deficit in ITD and PP population of patients with movement disorders and/or dementia. Another strength of this study is that we pooled well-designed, prospective studies with 12–36 months of clinical follow-up after ioflupane (¹²³I) imaging in which BIE by 3–5 independent nuclear medicine physicians (no access to clinical information) was used for image assessment. Overall, sensitivity for detecting the presence or absence of an SDDD ranged from 75% to 96.5%, and specificity ranged from 83% to 100%. Inter-reader agreement was high, with κ for blinded reader pairs ranging from 0.81 to 1, indicating that diagnostic accuracy is not dependent on individual expert performance.

When BIE reads were compared with on-site reads, specificity was higher for the BIE reads, whereas sensitivity was higher for the on-site reads. BIE versus on-site reader agreement was lower in the PDT301 study. This study focused on participants with dementia, whereas the other studies focused primarily on participants with movement disorders. Clinical diagnosis of DLB tends to be less accurate than PS.^{10 13 16 47} On-site readers had access to patient clinical information, whereas BIE readers did not. This likely contributed to the observed increase in sensitivity and decrease in specificity when images were read by the on-site readers compared with BIE readers, resulting in lower agreement between the two reader groups in this study.

A limitation of this study is that the four studies in the pooled analysis used expert clinical diagnosis as a reference standard for the presence or absence of an SDDD. Two of the studies (PDT301 and PDT304) used expert panels to establish the clinical diagnosis. In DP008-003, enrolled participants had established diagnoses, so an expert panel was not considered necessary. In PDT408, the final diagnosis was made with access to the ioflupane (¹²³I) SPECT images, which was required to assess the test clinical utility. The truth standard for diagnosing movement disorders and dementia is neuropathological confirmation of brain tissue at autopsy. However, with a slowly progressive, mostly benign course of these disorders, these patients are unlikely to die during the course of relatively short clinical trial duration and be participants for autopsy assessment. Previous postmortem studies demonstrated a good correlation between ioflupane (¹²³I) SPECT imaging with neuropathological findings.^{19 46} In a study by Walker et al,¹⁹ when validation was by autopsy diagnosis, sensitivity and specificity of initial clinical diagnoses in DLB were 75% and 42%, respectively, whereas sensitivity and specificity of ioflupane (¹²³I) imaging were higher, with values of 88% and 83%, respectively (88% and 100% for semiquantitative analysis of scans). Therefore, the use of clinical diagnosis as the non-perfect reference standard rather than neuropathological confirmation at autopsy may have contributed to the sensitivity and specificity values obtained in this pooled analysis. Another limitation of the study is that study PDT408 was not designed specifically to assess the sensitivity and specificity of ioflupane (¹²³I) SPECT imaging for detecting or excluding an SDDD. However, they were secondary end points, and expert clinical diagnosis and ioflupane (¹²³I) images were available on these participants, so it was deemed appropriate to include this study in the pooled analysis. Of note, the sensitivity and specificity values for this study fell within the range for the other three studies in which clinical diagnoses were made blinded to ioflupane (¹²³I) images, and exclusion of this study would not have altered the main findings reported here.

Substantial clinical need has been established for an adjunct to existing diagnostic tools for differentiating PD from ET, and DLB from AD. Examiner expertise affects diagnostic accuracy, with subspecialists having the highest accuracy, followed by general neurologists; primary care physicians tend to have the lowest.⁴⁸ In a general practice setting (N=202), 15% of patients who had been diagnosed with parkinsonism had tremor with onset after the age of 50, or who had ever received parkinsonism drugs had their diagnosis unequivocally rejected when strict clinical diagnostic criteria were applied and they completed a detailed neurological interview.²³ On the other hand, 13 patients (19%) not previously diagnosed with PD received this diagnosis following use of strict clinical diagnostic criteria.⁴⁹ In another general practice setting in Scotland (N=610), 5% of patients taking antiparkinson therapy for a diagnosis of PD had their medication successfully withdrawn following evaluation by two movement disorder specialists; ioflupane (¹²³I) scanning was performed if there was uncertainty.⁵⁰ General neurologists changed the diagnosis in 75% and movement disorder specialists in 47% of clinically uncertain PS cases after ioflupane (¹²³I) imaging results became available.^{6 51} These studies highlight the frequency of PD or PS misdiagnosis, and illustrate how using ioflupane (¹²³I) scanning can result in corrections to treatment. Early diagnosis is confounded by the fact that these diseases are progressive, and it may take time for the signs and symptoms to worsen until they clearly point to one disease.⁷ The choice of consensus criteria also affects the sensitivity and specificity of the clinical diagnosis.^{52 53} All these factors contribute to clinical diagnosis failing to align with autopsy findings up to 25% of the time.⁵² Ioflupane (¹²³I) SPECT imaging does not diagnose disease; rather, it is used to determine the presence or absence of a striatal dopaminergic deficit. The performance of ioflupane (¹²³I) reported here may have been lower than expected, particularly in patients with DLB, because we were comparing it to clinical diagnosis based on consensus criteria, known to be imprecise.

Regulatory approval of ioflupane (¹²³I) in Europe and the USA has facilitated meeting the clinical need to improve the accuracy of clinical diagnosis. Adoption and utilisation of this new technology is expanding, and several professional societies and organisations are supporting ioflupane (¹²³I) imaging as a useful and validated diagnostic tool. These include mention in the 2013 EFNS/MDS-ES/ENS guideline (Category A),⁵⁴ the Society of Nuclear Medicine,⁵⁵ the UK's National Institute for Health and Care Excellence (NICE) 2006 guidance,⁵⁶ the Scottish Intercollegiate Guidelines Network (SIGN)⁵⁷ and the EFNS-ENS guidelines.⁴ The Parkinson Progression Marker Initiative (PPMI) is adding ioflupane (¹²³I) imaging to be included in study inclusion criteria, as well as during a 5-year study of PD biomarker progression.⁵⁸

Research is needed to more fully elucidate future applications of ioflupane (¹²³I) SPECT imaging. While not currently licensed for this application, discussions have recently focused on the possibility of whether quantitative analysis of ioflupane (¹²³I) binding might further increase the sensitivity and specificity of SDDD detection and enable differentiation of other PS, such as PSP, MSA or vascular parkinsonism from PD.^{20 59 60} Additional studies that compare ioflupane (¹²³I) imaging results with postmortem neuropathology rather than expert clinical diagnosis may document better the accuracy of estimates of sensitivity and specificity. Our use of expert clinical diagnosis as the standard of truth, while validated, was not as perfect as autopsy. In addition, not all patients with DLB have nigrostriatal degeneration, and a small percentage of these patients may have primarily cortical degeneration.⁶¹ Finally, ioflupane (¹²³I) imaging may be helpful in identifying dopaminergic nigrostriatal degeneration in the prodromal stages, such as rapid-eye-movement sleep behaviour disorder of α-synucleinopathies (PD, MSA, DLB) and tauopathies (PSP, corticobasal degeneration).^{62 63}