Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2025 Jan 10;20(1):e0315712. doi: 10.1371/journal.pone.0315712

Ultrasound pupillometry for the detection of a relative afferent pupillary defect (RAPD): Systematic evaluation in patients with optic neuritis and comparison with infrared video pupillometry

Franziska Siebald 1, Ulrike Grittner 2, Carolin Otto 1, Charlotte Bereuter 3,4, Hanna G Zimmermann 3,4, Lutz Harms 1, Jan Klonner 5, Stephan J Schreiber 6, Friedemann Paul 1,3,4, Klemens Ruprecht 1,#, Felix A Schmidt 1,7,8,9,*,#
Editor: Tudor C Badea10
PMCID: PMC11723539  PMID: 39792831

Abstract

Purpose

A relative afferent pupillary defect (RAPD) is a characteristic clinical sign of optic neuritis (ON). Here, we systematically evaluated ultrasound pupillometry (UP) for the detection of an RAPD in patients with ON, including a comparison with infrared video pupillometry (IVP), the gold standard for objective pupillometry.

Materials and methods

We enrolled 40 patients with acute (n = 9) or past (n = 31) ON (ON+), 31 patients with multiple sclerosis (MS) without prior ON, and 50 healthy controls (HC) in a cross-sectional observational study. Examinations comprised the swinging flashlight test, B-mode UP, IVP, autorefraction to assess the best-corrected visual acuity, optical coherence tomography to determine peripapillary retinal nerve fiber layer thickness, and the 51-item National Eye Institute-Visual Function Questionnaire to determine the vision-related quality of life.

Results

While UP and IVP measurements of pupil diameter (PD) at rest correlated in ON+ eyes (n = 52, r = 0.56, 95% CI: 0.35; 0.72) and in HC eyes (n = 100, r = 0.60, 95% CI: 0.47; 0.72), PD at rest was smaller in UP than in IVP measurements (difference, mean (SD) ON+ eyes: 0.44 (0.87) mm, HC eyes: 0.69 (0.80) mm). RAPD assessment by UP sharply discriminated acute ON eyes (n = 9) and HC eyes (n = 100, AUC = 1, 95%CI: 1; 1). UP detected an RAPD in 5/31 (16%) patients with MS without prior ON who had not exhibited an RAPD during the swinging flashlight test. In ON+ eyes (n = 52), UP showed stronger correlations with visual acuity (r = 0.66, 95% CI: 0.50; 0.78) and vision-related quality of life (r = 0.47, 95% CI: 0.24; 0.66) than IVP (r = 0.52, 95% CI: 0.36; 0.67 and r = 0.27, 95% CI: 0.03; 0.51).

Conclusions

B-mode UP allows for objective detection and quantification of an RAPD with performance characteristics similar to IVP. RAPD assessment by UP may detect subclinical optic nerve damage in patients with MS. We propose a standardized protocol for RAPD detection by UP that can be used in routine clinical evaluation of patients with ON or other optic neuropathies.

Introduction

Optic neuritis (ON) is a common manifestation of inflammatory diseases of the central nervous system, such as multiple sclerosis (MS), neuromyelitis optica spectrum disorder (NMOSD), or myelin oligodendrocyte glycoprotein antibody associated disease and can result in substantial visual impairment and diminished quality of life [13]. Clinical symptoms of ON include subacute unilateral vision loss, blurred vision, pain during eye movement, and loss of color vision [4]. A characteristic clinical sign of unilateral ON is a relative afferent pupillary defect (RAPD), defined as an asymmetric pupillary response to identical light stimuli [4, 5]. An RAPD can be evaluated at the bedside by the swinging flashlight test (SFLT), which involves observing the pupillary light reflex (PLR) while swinging a penlight from the healthy to the affected eye and vice versa [6]. In case of a unilateral ON, a direct light stimulus (Lstim) of the affected eye results in a reduced and slowed constriction or even paradoxical dilatation of both pupils, referred to as RAPD. In contrast, after a consensual Lstim of the contralateral unaffected eye, both pupils constrict simultaneously and equally [7]. However, accurate and reproducible assessment of an RAPD by the SFLT depends on the examiner’s expertise and can be impeded by lighting conditions, dark eye color, or limited eyelid retraction [8].

We previously developed a strategy to objectively assess the PLR using B-mode ultrasound pupillometry (UP) and showed that UP can be used to detect an RAPD [9, 10]. In UP, patients are examined with their eyes closed to prevent contact of the ultrasound gel with the eye, while the examiner uses an external manual light source (penlight).

Infrared video pupillometry (IVP), the current gold standard for objective assessment of the PLR, provides precise quantitative measurements and allows hereby for the analysis of the PLR through high-resolution video imaging [11]. For IVP, the infrared video camera records the PLR of the ipsilateral open eye after an Lstim of the integrated light diode with a fixed distance between the eye and the light source. IVP has previously been applied for the detection of an RAPD in patients with ON where it was shown to detect an RAPD with high sensitivity and specificity [12, 13]. However, unlike ultrasound, IVP devices are rarely available in non-specialized clinical settings. Furthermore, IVP assessment requires the ability to fixate on a target and to keep the eyes open throughout the examination, whereas UP does not require active patient cooperation, provided that the patient is able to remain seated or lie quietly during the procedure. A recent study found a strong correlation (Pearson’s correlation coefficient, r = 0.831, p < 0.01) between UP- and IVP-based PLR assessments in healthy subjects [14]. However, comparative studies of UP and IVP for the assessment of RAPD in patients with ON have hitherto not been performed.

In this exploratory study, we systematically evaluated UP for the detection of an RAPD in patients with ON, including a comparison with IVP. We also investigated whether UP might be more sensitive than the SFLT for the detection of subclinical optic nerve damage in patients with MS. Finally, we put results of UP and IVP into perspective with other visual endpoints of ON, namely visual acuity (VA), absolute peripapillary retinal nerve fiber layer thickness (pRNFLT), and vision-related quality of life (vQoL).

Materials and methods

Study design

This cross-sectional observational study was approved by the Institutional Review Board of Charité –Universitätsmedizin Berlin (EA1/190/15) and was conducted in accordance with the current applicable ethical guidelines of the Declaration of Helsinki and German law. Written informed consent was obtained from all participants prior to inclusion into the study and patient confidentiality was ensured throughout the study.

Study participants

Patients with acute or past ON were recruited from the Departments of Neurology and Ophthalmology at Charité –Universitätsmedizin Berlin, Berlin, Germany, between September 24th, 2019 and December 9th, 2020. We defined acute ON as symptom onset <30 days and past ON as symptom onset ≥30 days before the examination day. Patients with more than one episode of ON were also included. We also recruited patients with a diagnosis of MS according to the McDonald 2017 criteria [15] who had no clinical history of ON (MS ON-). Healthy controls (HC), with sex and age distribution comparable to the patient groups, were recruited from hospital staff or medical students. Participants had to be ≥18 and ≤70 years of age.

Exclusion criteria were ophthalmologic diseases other than ON, such as amblyopia, significant anisocoria, efferent defects, use of medication known to affect pupillary function, recent ocular surgery, or optical laser treatment <6 months before the examination date, and an Expanded Disability Status Scale (EDSS) score ≥6 in patients with MS or NMOSD [16].

All participants underwent a standardized examination procedure in the order described below. All tests were performed by the same examiner (FrS).

Swinging flashlight test

The examination room was darkened during SFLT, UP, and IVP testing. Adequate adaptation time was allowed before and between the different tests. SFLT was assessed with a standard penlight (70,000 lux).

Ultrasound pupillometry

B-mode UP was performed with an Esaote Mylab 25 system (Esaote, Genova, Italy) with a 10 MHz linear probe, as previously described in detail [9, 10]. Participants were examined in the recumbent position with the eyes closed and the probe initially placed on the left lower eyelid, focused on the pupil. We performed SFLT with the same penlight as for bedside SFLT, with an approximative distance of 2.5 cm between the eye and the penlight, while recording a 5-second video of the left PLR. After 2 minutes of recovery, the right eye was examined in the same manner. Pupil diameter (PD) at rest and PD after direct and consensual Lstim were assessed with the built-in measuring device. To facilitate the introduction of UP into routine clinical practice, we developed a short clinical examination protocol, which we added as a separate section after the discussion.

Infrared video pupillometry

We used an NPi-200 pupillometer (NeurOptics, Irvine, CA, USA). After an Lstim of 800 milliseconds (ms) with a light diode (1,100 lux), an integrated infrared camera recorded the ipsilateral PLR with a fixed distance of 2.5 cm between the eye and the light source. We evaluated PD at rest and PD after direct Lstim for both eyes.

Visual acuity

Best-corrected monocular VA was assessed with an AR-1s autorefractor (Oculus/Nidek, Wetzlar, Germany). The optotype charts with letters and numbers allowed for VA assessment from 0.1 to 1.25 dec in logarithmic steps. We considered VA = 0 if the participant could not perceive 0.1 dec.

Peripapillary retinal nerve fiber layer thickness

We evaluated the absolute pRNFLT by retinal optical coherence tomography (OCT) with a CIRRUS HD-OCT (Carl Zeiss Meditec AG, Jena, Germany) using Optic Disc Cube 200x200 scans. We calculated the intereye absolute difference (IEAD) in μm and the intereye percentage difference (IEPD) in percent of both eyes of an individual. We considered IEAD≥5 μm and IEPD≥5% as indicative of a history of unilateral ON in patients with MS or NMOSD with onset of the last ON episode ≥3 months before the examination day [17, 18].

Vision-related quality of life

We assessed vQoL using the German adaptation [19] of the National Eye Institute-Visual Function Questionnaire (NEI-VFQ) [20]. The results of 51 questions with 12 subscales were averaged to obtain a final score of vQoL ranging from 0 to 100 [21]. The NEI-VFQ is a reliable and valid tool to assess vQoL in a variety of chronic eye conditions. Its strong psychometric properties make it suitable for group-level comparisons in clinical research, offering precise and consistent evaluation of how visual impairment affects the patients’ daily life [22]. To provide an understanding of the items included in the NEI-VFQ, we here present a sample question and the Likert scale of the possible responses. Question: How much difficulty do you have reading street signs or the names of stores? Answers: No difficulty at all, a little difficulty, moderate difficulty, extreme difficulty, stopped doing this because of your eyesight, stopped doing this for other reasons or not interested in doing this [20].

Analysis of pupillometry data

The constriction amplitude was defined as the difference between PD at rest and PD after Lstim (direct or consensual). The constriction ratio (CR) is the quotient of the consensual and direct constriction amplitudes and is a quantitative measure of an RAPD [10]. We previously proposed CR = 1.3 as a threshold to differentiate between eyes with (CR>1.3) and without (CR≤1.3) RAPD [10].

The constriction range in percent describes the degree of pupil constriction after Lstim, calculated as follows:

Constrictionrange=1PDafterLstimPDatrest×100

Pupil constriction time (PCT) is the time in ms between an Lstim and maximum miosis and was manually evaluated using AVSVideoConverter12.1 freeware (Online Media Technologies Ltd., London, UK) on recorded video sequences of UP [9].

Statistics

To compare UP and IVP, we calculated differences, means, and standard deviations (SD). We evaluated the correlation (r) between the two methods by using the square root of the marginal r2 values based on simple linear mixed models that account for repeated measures within individuals (right and left eye) [23, 24]. Similarly, we calculated the correlation of PLR assessments with VA, pRNFLT, and vQoL. We visualized individual differences in PD in UP and IVP using a Bland-Altman plot to assess possible systematic deviations. We determined the area under the curve (AUC) by receiver operating characteristic (ROC) curves to assess the diagnostic accuracy of the CR method in UP to detect an RAPD by using binary logistic regression models with random intercepts to account for repeated measures within individuals. To analyze mean differences between study groups and HC in PCT, VA, and pRNFLT, we used linear mixed models with random intercepts for participants to account for repeated measures within individuals. These models were additionally adjusted for age. For internal reliability analysis of the vQoL, we calculated Cronbach’s alpha to assess the internal reliability of the NEI-FVQ. We used one-factor analysis of variance (ANOVA) followed by Dunnett’s test to compare IEAD, IEPD, and vQoL of the study groups with HC. Except for ANOVA, results were not adjusted for multiple testing. A two-sided significance level of α = 0.05 was considered. P-values (p) should be interpreted with caution in this exploratory study. Interpretation of results was based on effect estimates, 95% confidence intervals (95% CI) and effect size measures. We performed statistical analyses and graphs with SPSS 27 (IBM SPSS Statistics, Armonk, NY, USA) and R version 4.3.0 (R Foundation for Statistical Computing, Vienna, Austria) [25].

Results

All data used in the study are fully documented and available in S1 Table in the Supporting information.

Participants

In this study, we included 9 patients with acute ON, 31 patients with past ON (collectively referred to as ON+ patients), 31 MS ON- patients, and 50 HC.

All 9 patients with acute ON had unilateral ON (acute ON eyes, n = 9). In 4/9 (44%) of these patients, this was the first episode of ON, and 5/9 (56%) had experienced previous episodes of ON (3 patients with one and 2 with three previous episodes of ON in the currently affected eye, respectively). In addition, 2/9 (22%) patients had experienced previous ON episodes in the contralateral (currently unaffected) eye.

In patients with past ON (n = 31), the mean (SD) time since last ON was 81.7 (86.7) months with a minimum of 3 months. Of these, 5/31 (16%) patients had bilateral ON with an equal number of ON episodes in both eyes. Specifically, 1/5 had two bilateral simultaneous ON episodes and 4/5 had bilateral sequential ON episodes, with one ON episode per eye. In addition, 5/31 (16%) had past bilateral ON but with an unequal number of ON episodes in both eyes, and 21/31 (68%) had past unilateral ON, resulting in a total number of n = 43 eyes with past ON. Altogether, there were n = 52 eyes with acute or past ON (ON+ eyes) in 40 individuals.

Unaffected eyes of patients with acute (n = 7) and past ON (n = 21), all eyes of MS ON- patients (n = 62) and HC (n = 100) were defined as ON- eyes (total n = 190).

The demographic and clinical characteristics of the study participants are shown in Table 1.

Table 1. Demographic and clinical characteristics of the study participants.

Study group acute ON
(n = 9)
past ON
(n = 31)
MS ON-
(n = 31)
HC
(n = 50)
Sex male/female, n (% female) 4/5 (56) 7/24 (77) 13/18 (58) 20/30 (60)
Age years, mean (SD) 34 (11) 42 (11) 39 (12) 44 (14)
Ethnicity Asian, n (%) 1 (11) 2 (7) 1 (3) 2 (4)
Black, n (%) 0 (0) 0 (0) 1 (3) 1 (2)
White, n (%) 8 (89) 29 (93) 29 (94) 47 (94)
Diagnosis CIS, n (%) 1 (11) 2 (7) 0 (0) n.a.
NMOSD, n (%) 4 (44) 1 (3) 0 (0) n.a.
PPMS, n (%) 0 (0) 0 (0) 3 (10) n.a.
RRMS, n (%) 4 (44) 27 (87) 28 (90) n.a.
SPMS, n (%) 0 (0) 1 (3) 0 (0) n.a.
EDSS median (Q1-Q3) 3.0 (1.8–4.0) 2.0 (1.5–3.0) 1.5 (1.0–2.3) n.a.
Time since last ON months, mean (SD) 0.4 (0.3) 81.7 (86.7) n.a. n.a.

CIS = clinically isolated syndrome, EDSS = Expanded Disability Status Scale, HC = healthy controls, ON = optic neuritis, MS ON- = patients with multiple sclerosis without a history of ON, n.a. = not applicable, NMOSD = neuromyelitis optica spectrum disorder, PPMS = primary progressive multiple sclerosis, Q1/3 = first/third quartile, RRMS = relapsing remitting multiple sclerosis, SD = standard deviation, SPMS = secondary progressive multiple sclerosis.

Prevalence of an RAPD as assessed by the swinging flashlight test

All 9 patients with acute ON and 5/31 (16%) with past ON showed an RAPD on bedside SLFT. In contrast, none of the MS ON- patients and none of the HC had an RAPD on bedside SLFT.

Comparative analysis of pupil diameter as assessed by ultrasound pupillometry and infrared video pupillometry

All participants tolerated UP and IVP well and none of the UP examinations had to be terminated prematurely. In one HC, IVP could not be performed due to repetitive blinking. Results of PLR assessment by IVP and UP in ON+ eyes and HC eyes are shown in Table 2.

Table 2. Infrared video pupillometry vs. ultrasound pupillometry in ON+ and HC eyes.

ON+ eyes
(n = 52, 40 individuals)
HC eyes
(n = 100, 50 individuals)
Method IVP (n = 52) UP (n = 52) IVP-UP (n = 52) IVP (n = 98) UP (n = 100) IVP-UP (n = 98)
PD at rest, mm, mean (SD) 5.23 (1.11) 4.80 (0.78) 0.44 (0.87) 5.55 (1.05) 4.86 (0.85) 0.69 (0.80)
Correlation of IVP and UPA, r (95% CI), p 0.56 (0.35; 0.72)
p = 0.001
0.60 (0.47; 0.72)
p = 0.001
PD after direct Lstim, mm, mean (SD) 3.33 (0.70) 3.03 (0.70) 0.30 (0.59) 3.27 (0.67) 3.01 (0.65) 0.26 (0.52)
Correlation of IVP and UPA, r (95% CI), p 0.64 (0.47; 0.77)
p = 0.001
0.63 (0.50; 0.74)
p = 0.001
Constriction range, %, mean (SD) 36.0 (6.1) 36.9 (10.4) -0.9 (9.4) 41.2 (4.0) 38.0 (6.9) 3.2 (6.4)
CorrelationA of IVP and UP, r (95% CI), p 0.49 (0.27; 0.66)
p = 0.001
0.34 (0.13; 0.52)
p = 0.001

CorrelationA = correlation coefficient calculated from marginal r2 values of linear mixed models accounting for repeated measures, HC = healthy controls, IVP = infrared video pupillometry, Lstim = light stimulus, mm = millimeters, ON+ eyes = eyes with optic neuritis, PD = pupil diameter, SD = standard deviation, UP = ultrasound pupillometry, 95% CI = 95% confidence interval.

PD at rest measured by UP and IVP correlated well in ON+ eyes (r = 0.56, 95% CI: 0.35; 0.72, Fig 1a) and in HC eyes (r = 0.60, 95% CI: 0.47; 0.72, Fig 1b). Similarly, PD after direct Lstim correlated in both methods (ON+ eyes: r = 0.64, 95% CI: 0.47; 0.77, Fig 2a and HC eyes: r = 0.63, 95% CI: 0.50; 0.74, Fig 2b). However, the PD at rest was generally smaller in UP than in IVP measurements (difference, mean (SD), ON+ eyes: 0.44 (0.87) mm, HC eyes: 0.69 (0.80) mm, Table 2).

Fig 1. Correlation of pupil diameter at rest as measured by UP and IVP.

Fig 1

a) ON+ eyes Black line = regression line, grey area = 95% confidence interval, IVP = infrared video pupillometry, ON+ eyes = eyes with optic neuritis, PD = pupil diameter in millimeters, r = correlation coefficient of PD at rest in IVP and UP, UP = ultrasound pupillometry, 95% CI = 95% confidence interval. Individuals are represented by different colors; two dots of the same color represent both ON+ eyes (right and left) of one individual. b) HC eyes Black line = regression line, grey area = 95% confidence interval, HC = healthy controls, IVP = infrared video pupillometry, PD = pupil diameter in millimeters, r = correlation coefficient of PD at rest in IVP and UP, UP = ultrasound pupillometry, 95% CI = 95% confidence interval. Individuals are represented by different colors; two dots of the same color represent both ON+ eyes (right and left) of one individual.

Fig 2. Correlation of pupil diameter after direct light stimulus as measured by UP and IVP.

Fig 2

a) ON+ eyes Black line = regression line, grey area = 95% confidence interval, IVP = infrared video pupillometry, ON+ eyes = eyes with optic neuritis, PD = pupil diameter in millimeters, r = correlation coefficient of PD at rest in IVP and UP, UP = ultrasound pupillometry, 95%CI = 95% confidence interval. Individuals are represented by different colors; two dots of the same color represent both ON+ eyes (right and left) of one individual. b) HC eyes Black line = regression line, grey area = 95% confidence interval, HC = healthy controls, IVP = infrared video pupillometry, PD = pupil diameter in millimeters, r = correlation coefficient of PD at rest in IVP and UP, UP = ultrasound pupillometry, 95% CI = 95% confidence interval. Individuals are represented by different colors; two dots of the same color represent both ON+ eyes (right and left) of one individual.

The constriction range measured by UP and IVP correlated moderately in ON+ eyes (r = 0.49, 95% CI: 0.27; 0.66, Fig 3a) and weakly in HC eyes (r = 0.34, 95% CI: 0.13; 0.52, Fig 3b).

Fig 3. Correlation of constriction range as measured by UP and IVP.

Fig 3

a) ON+ eyes Black line = regression line, grey area = 95% confidence interval, IVP = infrared video pupillometry, ON+ eyes = eyes with optic neuritis, r = correlation coefficient of constriction range in IVP and UP, UP = ultrasound pupillometry, 95% CI = 95% confidence interval. Individuals are represented by different colors; two dots of the same color represent both ON+ eyes (right and left) of one individual. b) HC eyes Black line = regression line, grey area = 95% confidence interval, HC = healthy controls, IVP = infrared video pupillometry, r = correlation coefficient of constriction range in IVP and UP, UP = ultrasound pupillometry, 95% CI = 95% confidence interval. Individuals are represented by different colors; two dots of the same color represent both ON+ eyes (right and left) of one individual.

To visualize individual differences in PD measurements by UP and IVP, we analyzed PD after a direct Lstim for all ON- eyes (n = 188) using a Bland-Altman plot (Fig 4). We found a systematic shift with smaller PD after direct Lstim in UP as compared to IVP measurements (difference, mean (SD) 0.27 (0.56) mm) and a remarkable dispersion of individual results (95% CI: -0.83; 1.37 mm) in all groups. The relationship between PD measurements by IVP and UP was approximately linear (locally weighted scatterplot close to the mean difference in Fig 4).

Fig 4. Bland-Altman plot of pupil diameter as measured by UP and IVP after direct light stimulus in ON- eyes.

Fig 4

Green line = mean difference, red lines = 95% confidence interval, blue line = locally weighted scatterplot smoothing, IVP = infrared video pupillometry, Lstim = light stimulus, mm = millimeters, MS = multiple sclerosis, ON = optic neuritis, ON- eyes = eyes without optic neuritis, PD = pupil diameter, UP = ultrasound pupillometry.

Analysis of the constriction ratio by ultrasound pupillometry

UP identified pathologic CRs (CR>1.3) in 21/121 (17%) participants, including all 9 patients with acute ON, 7/31 (23%) patients with past ON (of whom 5/7 also had an RAPD in bedside SFLT), and 5/31 (16%) MS ON- patients (none of whom had an RAPD in bedside SFLT). The CRs of HC (n = 50) were all below the threshold of CR = 1.3 (Fig 5). Since an RAPD is a sign of unilateral ON, patients with past ON were divided into two groups: those with unilateral or bilateral ON with an unequal number of left and right ON episodes (n = 26) and those with bilateral ON with an equal number of ON episodes in both eyes (n = 5). Of note, all HC were also below CR = 1.2 (Fig 5).

Fig 5. Constriction ratios in UP by study groups.

Fig 5

BilateralA = bilateral simultaneous or sequential ON episodes, MS = multiple sclerosis, ON = optic neuritis, n(ON_L/R) = number of left/right ON episodes, RAPD = relative afferent pupillary defect, SFLT = swinging flashlight test, UP = ultrasound pupillometry. The x-axis represents the study groups: patients with acute ON (n = 9), patients with past unilateral ON or bilateral ON with n(ON_L)≠n(ON_R) (n = 26), patients with past bilateral ON with n(ON_L) = n(ON_R) (n = 5), patients with MS without ON (n = 31), and healthy controls (n = 50). The y-axis represents the participant’s constriction ratio in UP.

To confirm that MS ON- patients with a CR>1.3 indeed had no history of ON, we re-evaluated the patients’ medical history and medical records. This revealed no evidence of previous ON in any of the 5 patients. In a detailed analysis of the MS ON- patients with CR>1.3, all 5 patients had pathologic CR in the right eye. Only 1/5 (20%) had a worse VA in the right eye compared to the left eye (0.63 vs. 1.25). However, in 4/5 (80%) patients the right absolute pRNFLT was mildly reduced with IEAD≥5 μm and IEPD≥5%. Taken together, these findings suggest a history of subclinical unilateral ON (Table 3).

Table 3. Demographic and clinical data of MS ON- patients with pathologic constriction ratio in UP.

Patient Sex Age (years) MS type EDSS CR, right/ left VA, right/ left pRNFLT, right/left (μm) IEAD (μm) IEPD (%)
1 male 32 RRMS 1.0 1.60/ 0.92 1.25/ 1.25 97/ 96 1 1
2 female 39 RRMS 2.5 1.31/ 0.85 1.25/ 1.25 90/ 95 5 5
3 male 49 PPMS 4.0 1.38/ 0.55 0.63/ 1.25 87/ 96 9 9
4 male 50 RRMS 2.0 1.40/ 0.71 1.25/ 1.25 89/ 94 5 5
5 female 62 RRMS 4.0 1.31/ 0.85 1.00/ 1.00 81/ 87 6 7

CR = constriction ratio, EDSS = Expanded Disability Status Scale, IEAD = intereye absolute difference, IEPD = intereye percentage difference, MS = multiple sclerosis, MS ON- = patients with multiple sclerosis without a history of ON, μm = micrometers, pRNFLT = absolute peripapillary retinal nerve fiber layer thickness, RRMS = relapsing remitting multiple sclerosis, PPMS = primary progressive multiple sclerosis, UP = ultrasound pupillometry, VA = visual acuity.

Analysis of CRs by ROC curves showed high discriminatory power to distinguish between eyes with acute ON (n = 9) and HC eyes (n = 100, AUC = 1, 95% CI: 1; 1). However, CRs showed low discriminatory power to differentiate between HC eyes (n = 100) and eyes with past ON (n = 43, AUC = 0.52, 95% CI: 0.37; 0.68) or eyes of MS ON- patients (n = 62, AUC = 0.45, 95% CI: 0.33; 0.58).

Comparison of pupil constriction time in eyes with ON and eyes of HC

In UP, PCT was longer in eyes with acute (n = 9, mean (SD): 1020 (77) ms) and past ON (n = 43, 879 (68) ms) compared to HC eyes (n = 100, 831 (51) ms, age-adjusted mean difference (95% CI): acute ON: 195 (158; 233) ms, p<0.001, past ON: 46 (25; 68) ms, p<0.001).

Correlation of PLR assessments with visual endpoints

VA and absolute pRNFLT in ON+ and ON- eyes are shown in Tables 4 and 5. While VA was measured in all participants, OCT data were only available in 84/121 (69%) participants.

Table 4. Visual acuity in ON+ and ON- eyes.

Study group ON+ eyes
(n = 52, 40 individuals)
ON- eyes
(n = 190, 111 individuals)
acute ON (n = 9) past ON (n = 43) unaffected eyes acute ON (n = 7) unaffected eyes past ON (n = 21) MS ON- (n = 62) HC (n = 100)
VA, mean (SD) 0.50
(0.33)
0.78
(0.40)
1.21
(0.09)
1.06
(0.24)
1.12
(0.20)
1.12
(0.23)
Difference vs. HC
(95% CI)
-0.68
(-0.86; -0.51)
-0.33
(-0.44; -0.22)
-0.03
(-0.23; 0.16)
-0.09
(-0.21; 0.03)
-0.03
(-0.14; 0.08)
n.a.
p-value, vs. HCA <0.001 <0.001 0.725 0.138 0.586 n.a.

Difference vs. HC = model based mean difference comparing each group to HC adjusted for age, HC = healthy controls, MS ON- = patients with multiple sclerosis without a history of ON, n.a. = not applicable, ON+/- eyes = eyes with or without optic neuritis, p-value vs. HCA = p-values based on age-adjusted linear mixed model for comparing each group with HC, SD = standard deviation, VA = visual acuity, 95% CI = 95% confidence interval.

Table 5. Absolute peripapillary retinal nerve fiber layer thickness in ON+ and ON- eyes.

Study group ON+ eyes
(n = 27, 22 individuals)
ON- eyes
(n = 141, 79 individuals)
acute ON (n = 8) past ON (n = 19) unaffected eyes acute ON (n = 6) unaffected eyes past ON (n = 11) MS ON- (n = 46) HC (n = 78)
pRNFLT, μm, mean (SD) 82 (18) 81 (19) 97 (6) 93 (21) 93 (11) 95 (10)
Difference vs.
HC (95% CI)
-15
(-24; -6)
-12
(-20; -5)
-7
(-17; 2)
-2
(-10; 6)
-3
(-9; 4)
n.a.
p-value, vs. HCA 0.001 0.001 0.144 0.601 0.383 n.a.

Difference vs. HC = model based mean difference comparing each group to HC adjusted for age, HC = healthy controls, MS ON- = patients with multiple sclerosis without a history of ON, μm = micrometers, n.a. = not applicable, ON+/- eyes = eyes with or without optic neuritis, pRNFLT = peripapillary retinal nerve fiber layer thickness, p-value vs. HCA = p-values based on age-adjusted linear mixed model for comparing each group with HC, SD = standard deviation, 95% CI = 95% confidence interval.

As expected, VA of eyes with acute (n = 9, mean (SD): 0.50 (0.33)) and past ON (n = 43, 0.78 (0.40)) was lower compared to HC eyes (n = 100, 1.12 (0.23), age-adjusted mean difference (95% CI): acute ON: -0.68 (-0.86; -0.51), p<0.001, past ON: -0.33 (-0.44; -0.22), p<0.001, Table 4).

As also expected, absolute pRNFLT was lower in eyes with acute (n = 8, mean (SD): 82 (18) μm) and past ON (n = 19, 81 (19) μm) compared to HC eyes (n = 78, 95 (10) μm, age-adjusted mean difference (95% CI): acute ON: -15 (-24; -6), p = 0.001, past ON: -12 (-20; -5), p = 0.001, Table 5).

Accordingly, patients with unilateral past ON or an unequal number of past ON episodes in both eyes (n = 14) had higher IEAD (mean (SD): 13 (12) μm) and IEPD (15 (13) %) than HC (n = 39, IEAD: 3 (2) μm, IEPD: 3 (2) %, mean differences (95% CI): IEAD: 10 (6; 14) μm, p<0.001, IEPD: 11 (7; 16) %, p<0.001).

As shown in Tables 4 and 5, eyes of MS ON- patients did not differ substantially from HC eyes in terms of VA (p = 0.586) or absolute pRNFLT (p = 0.383).

The results of the NEI-VFQ, assessing the vQoL, showed very strong internal consistency (Cronbach’s alpha = 0.968). The vQoL scores of MS ON- patients (n = 31, mean (SD): 94 (5)) did not differ notably from HC (n = 50, 91 (8), mean difference (95% CI): 2 (-4; 8), p = 0.688). In contrast, patients with acute (n = 9, mean (SD): 65 (20)) and past ON (n = 31, 80 (15)) reported lower vQoL scores than HC (n = 50, 91 (8), mean difference (95% CI): acute ON: -26 (-35; -17), p<0.001, past ON: -11 (-17; -5), p<0.001).

We evaluated the association of PLR assessment by UP or IVP with VA, absolute pRNFLT, and vQoL scores. In ON+ eyes (n = 52 eyes in 40 individuals), the correlations of the constriction range with VA and vQoL were stronger for UP assessments (VA: r = 0.66, 95% CI: 0.50; 0.78, vQoL: r = 0.47, 95% CI: 0.24; 0.66) than for IVP assessments (VA: r = 0.52, 95% CI: 0.36; 0.67, vQoL: r = 0.27, 95% CI: 0.03; 0.51) as demonstrated in Figs 6 and 7.

Fig 6. Correlation of constriction range as measured by UP and IVP with visual acuity in ON+ eyes.

Fig 6

a) UP Black line = regression line, grey area = 95% confidence interval, ON+ eyes = eyes with optic neuritis, r = correlation coefficient of constriction range in UP and visual acuity, UP = ultrasound pupillometry, 95% CI = 95% confidence interval. Individuals are represented by different colors; two dots of the same color represent both ON+ eyes (right and left) of one individual. b) IVP Black line = regression line, grey area = 95% confidence interval, IVP = infrared video pupillometry, ON+ eyes = eyes with optic neuritis, r = correlation coefficient of constriction range in IVP and visual acuity, 95% CI = 95% confidence interval. Individuals are represented by different colors; two dots of the same color represent both ON+ eyes (right and left) of one individual.

Fig 7. Correlation of constriction range as measured by UP and IVP in ON+ eyes with vision-related quality of life scores.

Fig 7

a) UP Black line = regression line, grey area = 95% confidence interval, ON+ eyes/ patients = eyes/ patients with optic neuritis, r = correlation coefficient of constriction range in UP and vision-related quality of life score, UP = ultrasound pupillometry, 95% CI = 95% confidence interval. Individuals are represented by different colors; two dots of the same color represent both ON+ eyes (right and left) of one individual. b) IVP Black line = regression line, grey area = 95% confidence interval, IVP = infrared video pupillometry, ON+ eyes/ patients = eyes/ patients with optic neuritis r = correlation coefficient of constriction range in IVP and vision-related quality of life score, 95% CI = 95% confidence interval. Individuals are represented by different colors; two dots of the same color represent both ON+ eyes (right and left) of one individual.

Furthermore, VA of ON+ eyes inversely correlated with PCT (n = 52 eyes in 40 individuals, r = -0.44, 95% CI: -0.58; -0.29, Fig 8) and CR (eyes with unilateral ON or unequal number of left and right ON episodes, n = 35 in 35 individuals, r = -0.67, 95% CI: -0.81; -0.42, Fig 9) as measured by UP. Note that PCT and CR could not be obtained with the NPi-200 pupillometer.

Fig 8. Correlation of pupil constriction time as measured by UP with visual acuity in ON+ eyes.

Fig 8

Black line = regression line, grey area = 95% confidence interval, ms = milliseconds, ON+ eyes = eyes with optic neuritis, r = correlation coefficient of pupil constriction time in UP and visual acuity, UP = ultrasound pupillometry, 95% CI = 95% confidence interval. Individuals are represented by different colors; two dots of the same color represent both ON+ eyes (right and left) of one individual.

Fig 9. Correlation of constriction ratio as measured by UP with visual acuity in unilateralA ON+ eyes.

Fig 9

Black line = regression line, grey area = 95% confidence interval, ON = optic neuritis, r = correlation coefficient of constriction ratio in UP and visual acuity, unilateralA ON+ eyes = eyes with unilateral ON or bilateral ON episodes with an unequal number of ON episodes in the left and right eye, UP = ultrasound pupillometry, 95% CI = 95% confidence interval.

We found no substantial correlations between absolute pRNFLT and the constriction range as measured by UP or IVP.

Discussion

In this study, we systematically evaluated UP as a diagnostic tool for RAPD detection in patients with ON. The main findings of this work are: (i) Strong correlation between PD measurements by UP and IVP, while the overall PD was slightly smaller in UP than in IVP assessments; (ii) UP detected an RAPD in some patients with MS, who had no clinical history of ON and no RAPD as assessed by bedside SFLT; (iii) The CR as determined by UP clearly discriminated between acute ON and HC eyes; (iv) in ON+ eyes, constriction range measured by UP showed stronger correlations with VA and vQoL than constriction range measured by IVP.

The good correlation of PD measurements by UP and IVP in ON+ patients observed in the present study is consistent with previous findings in HC [14]. The systematic shift with smaller PD values in UP than in IVP measurements was most likely due to differences in the examination techniques. In fact, the eyes were closed for UP, whereas they were open for IVP. In addition, the light intensity of the penlight used in UP was much higher than that of the light diode used in IVP (70,000 vs. 1,100 lux). Finally, the scatter between UP and IVP measurements of some individual results may be due to measurement inaccuracies.

The PCT measured by UP was longer in ON+ eyes than in HC eyes, which is consistent with our previous findings [10]. Also, PCT measurements of HC were in line with the reference values (mean, (SD) left eye: 970 (261.6) ms; right eye: 967 (220) ms) for healthy subjects from our previous study [9]. PCT is a dynamic parameter to evaluate an RAPD, a clear advantage of UP over the IVP device used in this study, which could not measure PCT. Furthermore, the NPi-200 pupillometer can only illuminate and examine one eye at a time. Hence, the SFLT, which includes illumination of one eye and assessment of the consensual PLR in the contralateral eye, and which can easily be assessed by UP, could not be performed with the NPi-200 pupillometer.

All 14 patients with an RAPD as determined by bedside SFLT also had a pathologic CR as determined by UP. However, importantly, we identified 7 additional patients with pathologic CRs who did not have an RAPD as assessed by SFLT, suggesting that UP may be more sensitive in detecting an RAPD than SFLT. UP is an objective and precise measuring tool, providing consistent and reliable measurements [9], whereas the SFLT relies on subjective visual evaluation by the examiner [6, 7]. In the SFLT, results depend on the examiner’s experience and judgment [8]. In contrast, UP can detect subtle changes in pupil size that might be overlooked during the SFLT. Also, UP offers the possibility to document and save results on frozen images and video sequences of the PLR, which allows for re-analysis. All these factors may contribute to the higher detection sensitivity of UP for an RAPD.

Despite no significant differences between MS ON- patients and HC in terms of VA, pRNFLT, or vQoL, 5/31 (16%) MS ON- patients had pathologic CRs as measured by UP. Of these, one patient had reduced VA and four had slightly reduced absolute pRFNLT with increased IEAD and IEPD in the affected eye [17], altogether indicating subtle optic nerve damage. In conclusion, these results suggest that UP may detect an RAPD with a higher sensitivity than the SFLT and that UP may be able to detect subclinical optic nerve damage in patients with MS.

All HC had CR<1.3, confirming the reliability of this threshold [10]. However, CR = 1.3 appears to be a conservative cut-off value, as CR = 1.2 still separated patients with acute ON from HC.

ROC curves of CRs discriminated patients with acute ON from HC with high discriminatory power. UP also discriminated patients with past ON and MS ON- patients from HC. Thus, the CR method has a high diagnostic potential to separate pathologic eyes from healthy eyes.

As expected, ON+ patients had reduced VA, pRNFLT, and vQoL compared to HC [21, 26]. Of note, acute ON typically causes a swelling of the pRNFLT [27]. Here, patients with acute ON had reduced absolute pRNFLT. We attribute this to previous episodes of ON and the time elapsed between symptom onset and the examination. Importantly, correlations of VA and vQoL in ON+ eyes were stronger with UP than with IVP. Additionally, PCT and CR as measured by UP correlated well with VA in ON+ eyes.

Altogether, our results suggest that UP can detect an RAPD with similar performance characteristics as IVP. We consider the wider availability of this easy to perform diagnostic method and the possibility to perform UP in cases of obstructed eyelid retraction [28] as advantages of UP over IVP.

Among the strengths of this study is the inclusion of various objective (VA, OCT) and subjective (VQoL) visual outcome parameters for ON. VQoL is a subjective measure that captures the patient’s perspective on the impact of visual impairments on their daily life and overall well-being. The correlation of UP and IVP parameters with VQoL therefore indicates that these parameters may reflect the real-world impact of ON on a patient’s daily life. Changes in the pRNFLT, as measured by OCT, indicates structural optic nerve damage. Altogether, our multifaceted approach enabled cross-validation of UP and IVP findings with other established objective and subjective outcome measures of ON, enhancing the clinical relevance of our findings.

A potential limitation of this study is observer bias, as all examinations and interpretations were performed by the same examiner (FrS). Furthermore, inclusion of patients with bilateral ON may have made the detection of an RAPD more difficult. Another possible limitation of our study is that we could not systematically control for potential effects of stimulants, such as caffeine or nicotine, on the pupillary reaction. However, we consider it unlikely that any possible use of stimulants might have significantly affected the results of our study, as the RAPD detects relative differences of the pupillary reaction of both eyes. While stimulants could possibly affect pupillary reactions globally, they appear unlikely to affect relative differences of pupillary reactions of both eyes. Finally, the analysis of pRNFLT in patients with acute ON may have limited interpretability.

To further evaluate the diagnostic accuracy of UP, blinded case-control studies with larger numbers of cases would be of interest. Future studies could also utilize recently emerging wireless portable ultrasound and IVP devices capable of assessing consensual Lstim and PCT to facilitate comparison between both methods and to determine in which setting IVP or UP may be preferable to assess an RAPD.

Conclusions

This study shows that UP is a suitable method for objective detection and quantification of an RAPD with similar performance characteristics as IVP. RAPD detection by UP is more accurate and sensitive than clinical SFLT examination with a penlight and may therefore be able to detect subclinical optic nerve damage in patients with MS. Our results suggest that UP is a valuable diagnostic tool, which can be used in clinical routine for objective detection of an RAPD. We propose a rapid and simplified standardized protocol for RAPD detection by UP to be used in clinical routine for the detection of unilateral ON, but also other optic neuropathies.

Clinical examination protocol for UP

  1. Place a linear ultrasound probe on the closed lower left eyelid, focusing on the pupil.

  2. Perform the SFLT with a penlight illuminating first the contralateral (right) eye and then the ipsilateral (left) eye, while recording a 5-second video of the left PLR.

  3. Repeat the same procedure with the probe on the right eye.

  4. Measure PD at rest and PD after direct and consensual Lstim on frozen images of the video sequences.

  5. Compute the direct and consensual constriction amplitudes and determine the CR, the quotient of the consensual and direct constriction amplitude.

  6. A CR>1.3 indicates an ipsilateral RAPD.

Supporting information

S1 Table. Data set.

CIS = clinically isolated syndrome, EDSS = Expanded Disability Status Scale, HC = healthy controls, IVP = infrared video pupillometry, mm = millimeters, MS = multiple sclerosis, ms = milliseconds, μm = micrometers, NMOSD = neuromyelitis optica spectrum disorder, OCT = optical coherence tomography, ON = optic neuritis, PCT = pupil constriction time, PD = pupil diameter, PPMS = primary progressive multiple sclerosis, pRNFLT = absolute peripapillary retinal nerve fiber layer thickness, RAPD = relative afferent pupillary defect, RRMS = relapsing remitting multiple sclerosis, SPMS = secondary progressive multiple sclerosis, UP = ultrasound pupillometry.

(XLSX)

pone.0315712.s001.xlsx (59.6KB, xlsx)

Data Availability

All relevant data are within the manuscript and its Supporting information files, see document 'Data Table' uploaded as Supporting information item.

Funding Statement

Felix A. Schmidt received funding from the Berlin Institute of Health (https://www.bihealth.org/) and the Stiftung Charité, Berlin, Germany (https://www.stiftung-charite.de/) in the Clinician Scientist programm. Klemens Ruprecht was a participant in the BIH Clinical Fellow Program funded by Stiftung Charité, Berlin, Germany. None of the funding organizations had a role in the design or conduct of this study".

References

  • 1.Bennett JL, de Seze J, Lana-Peixoto M, Palace J, Waldman A, Schippling S, et al. Neuromyelitis optica and multiple sclerosis: Seeing differences through optical coherence tomography. Mult Scler. 2015;21(6):678–88. doi: 10.1177/1352458514567216 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Banwell B, Bennett JL, Marignier R, Kim HJ, Brilot F, Flanagan EP, et al. Diagnosis of myelin oligodendrocyte glycoprotein antibody-associated disease: International MOGAD Panel proposed criteria. Lancet Neurol. 2023;22(3):268–82. doi: 10.1016/S1474-4422(22)00431-8 [DOI] [PubMed] [Google Scholar]
  • 3.Petzold A, Fraser CL, Abegg M, Alroughani R, Alshowaeir D, Alvarenga R, et al. Diagnosis and classification of optic neuritis. Lancet Neurol. 2022;21(12):1120–34. doi: 10.1016/S1474-4422(22)00200-9 [DOI] [PubMed] [Google Scholar]
  • 4.Bennett JL. Optic Neuritis. Continuum (Minneapolis, Minn). 2019;25(5):1236–64. doi: 10.1212/CON.0000000000000768 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Younis AA, Eggenberger ER. Correlation of relative afferent pupillary defect and retinal nerve fiber layer loss in unilateral or asymmetric demyelinating optic neuropathy. Invest Ophthalmol Vis Sci. 2010;51(8):4013–6. doi: 10.1167/iovs.09-4644 [DOI] [PubMed] [Google Scholar]
  • 6.Broadway DC. How to test for a relative afferent pupillary defect (RAPD). Community Eye Health. 2012;25(79–80):58–9. [PMC free article] [PubMed] [Google Scholar]
  • 7.Thompson HS, Corbett JJ, Cox TA. How to measure the relative afferent pupillary defect. Surv Ophthalmol. 1981;26(1):39–42. doi: 10.1016/0039-6257(81)90124-7 [DOI] [PubMed] [Google Scholar]
  • 8.Beisse F, Ring A, Wilhelm H, Beisse C. The Swinging Flashlight Test—Flawed Execution and Interpretation in Ophthalmological Routine. Klin Monbl Augenheilkd. 2020;237(11):1278–85. doi: 10.1055/a-1271-6993 [DOI] [PubMed] [Google Scholar]
  • 9.Schmidt FA, Ruprecht K, Connolly F, Maas MB, Paul F, Hoffmann J, et al. B-mode ultrasound assessment of pupillary function: Feasibility, reliability and normal values. PLoS One. 2017;12(12):e0189016. doi: 10.1371/journal.pone.0189016 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Schmidt FA, Connolly F, Maas MB, Grittner U, Harms L, Brandt A, et al. Objective assessment of a relative afferent pupillary defect by B-mode ultrasound. PLoS One. 2018;13(8):e0202774. doi: 10.1371/journal.pone.0202774 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Meeker M, Du R, Bacchetti P, Privitera CM, Larson MD, Holland MC, et al. Pupil examination: validity and clinical utility of an automated pupillometer. J Neurosci Nurs. 2005;37(1):34–40. doi: 10.1097/01376517-200502000-00006 [DOI] [PubMed] [Google Scholar]
  • 12.Blazek P, Davis SL, Greenberg BM, Conger A, Conger D, Vernino S, et al. Objective characterization of the relative afferent pupillary defect in MS. J Neurol Sci. 2012;323(1–2):193–200. doi: 10.1016/j.jns.2012.09.015 [DOI] [PubMed] [Google Scholar]
  • 13.Cohen LM, Rosenberg MA, Tanna AP, Volpe NJ. A Novel Computerized Portable Pupillometer Detects and Quantifies Relative Afferent Pupillary Defects. Curr Eye Res. 2015;40(11):1120–7. doi: 10.3109/02713683.2014.980007 [DOI] [PubMed] [Google Scholar]
  • 14.Farina F, Vosko MR, Baracchini C, Ermani M, Sommer P, Greisenegger S, et al. Ultrasound Examination of the Pupil—A New Tool for the Neuro-Ophthalmological Assessment. Ultraschall in Med. 2021;42(1):84–91. doi: 10.1055/a-1208-1482 [DOI] [PubMed] [Google Scholar]
  • 15.Thompson AJ, Banwell BL, Barkhof F, Carroll WM, Coetzee T, Comi G, et al. Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria. Lancet Neurol. 2018;17(2):162–73. doi: 10.1016/S1474-4422(17)30470-2 [DOI] [PubMed] [Google Scholar]
  • 16.Kurtzke JF. Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology. 1983;33(11):1444–52. doi: 10.1212/wnl.33.11.1444 [DOI] [PubMed] [Google Scholar]
  • 17.Nolan-Kenney RC, Liu M, Akhand O, Calabresi PA, Paul F, Petzold A, et al. Optimal intereye difference thresholds by optical coherence tomography in multiple sclerosis: An international study. Ann Neurol. 2019;85(5):618–29. doi: 10.1002/ana.25462 [DOI] [PubMed] [Google Scholar]
  • 18.Oertel FC, Zimmermann HG, Motamedi S, Chien C, Aktas O, Albrecht P, et al. Diagnostic value of intereye difference metrics for optic neuritis in aquaporin-4 antibody seropositive neuromyelitis optica spectrum disorders. Journal of Neurology, Neurosurgery & Psychiatry. 2023:jnnp-2022-330608. doi: 10.1136/jnnp-2022-330608 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Franke G, Esser J, Voigtländer A, Mähner N. Der National Eye Institute Visual Function Questionnaire (NEI-VFQ)—Erste Ergebnisse zur psychometrischen Überprüfung eines Verfahrens zur Erfassung der Lebensqualität bei Sehbeeinträchtigten. 1998;7:178–84. [Google Scholar]
  • 20.Mangione CM, Lee PP, Berry SH, Spritzer K, Janz NK, Klein R, et al. The NEI VFQ 51-item test version and its relationship with visual acuity across 5 diseases. Investigative Ophthalmology and Visual Science. 1996;37(3). [Google Scholar]
  • 21.Schmidt F, Zimmermann H, Mikolajczak J, Oertel FC, Pache F, Weinhold M, et al. Severe structural and functional visual system damage leads to profound loss of vision-related quality of life in patients with neuromyelitis optica spectrum disorders. Mult Scler Relat Disord. 2017;11:45–50. doi: 10.1016/j.msard.2016.11.008 [DOI] [PubMed] [Google Scholar]
  • 22.Mangione CM, Lee PP, Pitts J, Gutierrez P, Berry S, Hays RD. Psychometric properties of the National Eye Institute Visual Function Questionnaire (NEI-VFQ). NEI-VFQ Field Test Investigators. Arch Ophthalmol. 1998;116(11):1496–504. doi: 10.1001/archopht.116.11.1496 [DOI] [PubMed] [Google Scholar]
  • 23.Lüdecke D, Ben-Shachar MS, Patil I, Waggoner P, Makowski D. Performance: An R Package for Assessment, Comparison and Testing of Statistical Models. Journal of Open Source Software. 2021;6(60):3139. doi: 10.21105/joss.03139 [DOI] [Google Scholar]
  • 24.Bates D, Mächler M, Bolker B, Walker S. Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software. 2015;67(1):1–48. doi: 10.18637/jss.v067.i01 [DOI] [Google Scholar]
  • 25.R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2023. [Google Scholar]
  • 26.Fernandes DB, Raza AS, Nogueira RG, Wang D, Callegaro D, Hood DC, et al. Evaluation of inner retinal layers in patients with multiple sclerosis or neuromyelitis optica using optical coherence tomography. Ophthalmology. 2013;120(2):387–94. doi: 10.1016/j.ophtha.2012.07.066 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Chen JJ, Sotirchos ES, Henderson AD, Vasileiou ES, Flanagan EP, Bhatti MT, et al. OCT retinal nerve fiber layer thickness differentiates acute optic neuritis from MOG antibody-associated disease and Multiple Sclerosis: RNFL thickening in acute optic neuritis from MOGAD vs MS. Mult Scler Relat Disord. 2022;58:103525. doi: 10.1016/j.msard.2022.103525 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Harries A, Shah S, Teismann N, Price D, Nagdev A. Ultrasound assessment of extraocular movements and pupillary light reflex in ocular trauma. Am J Emerg Med. 2010;28(8):956–9. doi: 10.1016/j.ajem.2009.06.026 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Manabu Sakakibara

30 Apr 2024

PONE-D-24-06833Ultrasound pupillometry for the detection of a relative afferent pupillary defect (RAPD): systematic evaluation in patients with optic neuritis and comparison with infrared video pupillometryPLOS ONE

Dear Dr. Schmidt,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jun 14 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Manabu Sakakibara, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following in the Competing Interests section: 

"I have read the journal's policy and the authors of this manuscript have the following competing interests: Felix A. Schmidt received support from the Berlin Institute of Health (BIH) and the Stiftung Charité, Berlin, Germany (Clinician Scientist Grant). Klemens Ruprecht received research support from Novartis, Basel, Switzerland, Merck Serono, German Ministry of Education and Research, Stiftung Charité (BIH Clinical Fellow Program), Germany, European Union (821283-2), Guthy Jackson Charitable Foundation, Beverly Hills, CA, USA, and Arthur Arnstein Foundation, Berlin, Germany; received speaker honoraria from Novartis and Virion Serion, Würzburg, Germany, and travel grants from Guthy Jackson Charitable Foundation. 

All other authors have declared that no competing interests exist."

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: ""This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared. 

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

3. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

Additional Editor Comments:

Two experts in the field have carefully reviewed the manuscript entitled "Ultrasound pupillometry for the detection of a relative afferent pupillary defect (RAPD): systematic evaluation in patients with optic neuritis and comparison with infrared video pupillometry". Their comments are appended below.

The first referee raised several serious concerns which should be considered before publication, especially Introduction section for more easy understanding.

The second reviewer pointed out that there are many mistakes in the manuscript.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: No

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: It has been a pleasure to review the authors’ manuscript. In this exploratory experiment, the authors evaluated the optic neuritis (ON) diagnostic utility of B-mode ultrasound pupillometry (UP) against infrared video pupillometry (IVP) across multiple visual endpoints of ON. The authors concluded that UP performed similarly to IVP and RAPD assessment by UP may detect subclinical ON damage in patients with multiple sclerosis. They also offered a standardized protocol for RAPD detection by UP in routine clinical evaluation. Multiple merits are present in the manuscript including detailed descriptions of the methods and report of the results. However, several areas of improvement need to be addressed until I endorse the publication.

Major points:

- The first paragraph in the introduction section has a strong flow. To aid in readers’ understanding, could the authors include a brief review of how the gold standard IVP has been applied to detect ON? Additional background information on the technical differences and general pros and cons in the clinical settings between IVP and UP in measuring PLR would be valuable (even though some information was discussed in the discussion section). Please also highlight the benefits of discussing other visual endpoints of ON (including both objective and subjective measures).

- Line 475: Could the authors elaborate on the possible factors in the higher detection sensitivity of UP?

- In addition to the quality plots, as part of good practice in pupillometry studies, could the authors also provide the aggregated waveform of pupillary changes during the tests?

Minor points:

- Line 81-82: there appears to be only one sentence in a paragraph.

- Line 85 (citation 12): please provide the correlation value of the strong correlation as a reference for the effect size in the present study.

- Line 115: did the authors also control for the use of stimulants as caffeine in the sample?

- Line 155: please provide one sample item from the questionnaire and report the likert scale as well as its psychometric properties based on literature. Please also state internal reliability as Cronbach’s alpha.

- Line 190-191: please discuss the exploratory nature of this study in the introduction.

- Could the authors also provide reference values of the key ON related measures (e.g., PCT) from much larger datasets for readers to compare with the sample in this study?

Reviewer #2: 1.The author mentioned the data in tables and figure in result section to support the conclusion under discussion section of manuscript.

2.The explained this in 'Statistics' section of 'Materials and methods' in manuscript.

3.The author mentioned it in "Data Availability Statement in the manuscript PDF file".

4.There are many mistakes in subheading and text of manuscript.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Xi Yang

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: 240331_PLOS_Review.docx

pone.0315712.s002.docx (16.9KB, docx)
Attachment

Submitted filename: correction.docx

pone.0315712.s003.docx (14.5KB, docx)
PLoS One. 2025 Jan 10;20(1):e0315712. doi: 10.1371/journal.pone.0315712.r002

Author response to Decision Letter 0


13 Jul 2024

Response to Journal Requirements:

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming.

Response:

We confirm that our manuscript meets PLOS ONE's style requirements, including those for file naming.

2. Thank you for stating the following in the Competing Interests section:

"I have read the journal's policy and the authors of this manuscript have the following competing interests: Felix A. Schmidt received support from the Berlin Institute of Health (BIH) and the Stiftung Charité, Berlin, Germany (Clinician Scientist Grant). Klemens Ruprecht received research support from Novartis, Basel, Switzerland, Merck Serono, German Ministry of Education and Research, Stiftung Charité (BIH Clinical Fellow Program), Germany, European Union (821283-2), Guthy Jackson Charitable Foundation, Beverly Hills, CA, USA, and Arthur Arnstein Foundation, Berlin, Germany; received speaker honoraria from Novartis and Virion Serion, Würzburg, Germany, and travel grants from Guthy Jackson Charitable Foundation.

All other authors have declared that no competing interests exist."

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: ""This does not alter our adherence to PLOS ONE policies on sharing data and materials.”

If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

Response:

We updated the Competing Interests as follows:

"I have read the journal's policy and the authors of this manuscript have the following competing interests: Felix A. Schmidt received support from the Berlin Institute of Health (BIH) and the Stiftung Charité, Berlin, Germany (Clinician Scientist Grant). Klemens Ruprecht received research support from Novartis, Basel, Switzerland, Merck Serono, German Ministry of Education and Research, Stiftung Charité (BIH Clinical Fellow Program), Germany, European Union (821283-2), Guthy Jackson Charitable Foundation, Beverly Hills, CA, USA, and Arthur Arnstein Foundation, Berlin, Germany; received speaker honoraria from Novartis and Virion Serion, Würzburg, Germany, and travel grants from Guthy Jackson Charitable Foundation.

All other authors have declared that no competing interests exist."

"This does not alter our adherence to PLOS ONE policies on sharing data and materials.”

3. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly.

Response:

We have included captions for the Supporting Information files and updated in-text citations.

Response to Reviewers

Reviewer #1:

Reviewer’s point:

It has been a pleasure to review the authors’ manuscript. In this exploratory experiment, the authors evaluated the optic neuritis (ON) diagnostic utility of B-mode ultrasound pupillometry (UP) against infrared video pupillometry (IVP) across multiple visual endpoints of ON. The authors concluded that UP performed similarly to IVP and RAPD assessment by UP may detect subclinical ON damage in patients with multiple sclerosis. They also offered a standardized protocol for RAPD detection by UP in routine clinical evaluation. Multiple merits are present in the manuscript including an interesting experimental design, a coherent introduction section, detailed descriptions of the methods and report of the results, as well as a thorough discussion of the limitations.

Response:

We would like to thank the Reviewer for this comment.

Reviewer’s point:

The first paragraph in the introduction section has a strong flow. To aid in readers’ understanding, could the authors include a brief review of how the gold standard IVP has been applied to detect ON?

Response:

We appreciate this thoughtful feedback. In response to this point, we added the following sentences as well as two additional references, i.e. Blazcek et al. (2012) and Cohen et al. (2015), to the introduction section:

"Infrared video pupillometry (IVP), the current gold standard for objective assessment of the PLR, provides precise quantitative measurements and allows for the analysis of the PLR through high-resolution video imaging [11]. For IVP, the infrared video camera records the PLR of the ipsilateral open eye after an Lstim of the integrated light diode with a fixed distance between the eye and the light source. IVP has previously been applied for the detection of an RAPD in patients with ON where it was shown to detect an RAPD with high sensitivity and specificity [12, 13]." (pages 5-6, lines 86-95)

Reviewer’s point:

Additional background information on the technical differences and general pros and cons in the clinical settings between IVP and UP in measuring PLR would be valuable (even though some information was discussed in the discussion section).

Response:

We appreciate this suggestion. To provide more background information on the technical differences and general pros and cons in the clinical settings between IVP and UP in measuring PLR we have added the following sentence to the introduction:

"In UP, patients are examined with their eyes closed to prevent contact of the ultrasound gel with the eye, while the examiner uses an external manual light source (penlight)." (page 5, lines 82-84)

Furthermore, we added the following passage:

"However, unlike ultrasound, IVP devices are rarely available in non-specialized clinical settings. Furthermore, IVP assessment requires the ability to fixate on a target and to keep the eyes open throughout the examination, whereas UP does not require patient cooperation." (page 6, lines 95-98)

Reviewer’s point:

Please also highlight the benefits of discussing other visual endpoints of ON (including both objective and subjective measures).

Response:

We thank the Reviewer for this comment. In response, we added the following passage to the discussion section:

"Among the strengths of this study is the inclusion of various objective (VA, OCT) and subjective (VQoL) visual outcome parameters for ON. VQoL is a subjective measure that captures the patient's perspective on the impact of visual impairments on their daily life and overall well-being. The correlation of UP and IVP parameters with VQoL therefore indicates that these parameters may reflect the real-world impact of ON on a patient’s daily life. Changes in the pRNFLT, as measured by OCT, indicates structural optic nerve damage. Altogether, our multifaceted approach enabled cross-validation of UP and IVP findings with other established objective and subjective outcome measures of ON, enhancing the clinical relevance of our findings." (page 27, lines 568-576)

Reviewer’s point:

Line 475: Could the authors elaborate on the possible factors in the higher detection sensitivity of UP?

Response:

Yes, we have now included the following sentences in the discussion section:

"UP is an objective and precise measuring tool, providing consistent and reliable measurements, whereas the SFLT relies on subjective visual evaluation by the examiner. In the SFLT, results depend on the examiner’s experience and judgment. In contrast, UP can detect subtle changes in pupil diameter that might be overlooked during the SFLT. Also, UP offers the possibility to document and save results on frozen images and video sequences of the PLR, which allows for re-analysis. All these factors may contribute to the higher detection sensitivity of UP for an RAPD." (page 25, lines 532-538)

Reviewer’s point:

In addition to the quality plots, as part of good practice in pupillometry studies, could the authors also provide the aggregated waveform of pupillary changes during the tests?

Response:

We concur with the Reviewer's assertion that the aggregation of pupillary changes during the tests would be interesting. However, in this study, we employed pupillometry assessments by ultrasound pupillometry (UP) and infrared video pupillometry (IVP) to measure two metric values: the maximum pupil diameter (PD) at rest and the minimum PD after a light stimulus. As a result, we did not record continuous data, which precluded analyses of the aggregated waveform of pupillary changes.

Reviewer’s point:

Line 81-82: there appears to be only one sentence in a paragraph.

Response:

We thank the Reviewer for bringing this formatting issue to our attention. To provide further clarification regarding the technical application of ultrasound pupillometry (UP), we have added another sentence to the respective paragraph.

“In UP, patients are examined with their eyes closed to prevent contact of the ultrasound gel with the eye, while the examiner uses an external manual light source (penlight).” (page 5, lines 82-84)

Reviewer’s point:

Line 85 (citation 12): please provide the correlation value of the strong correlation as a reference for the effect size in the present study.

Response:

We agree with the Reviewer that the actual correlation coefficient is a crucial information. We now included the correlation coefficient from the mentioned study (Farina et al., 2021):

“(Pearson’s correlation coefficient, r=0.831, p < 0.01)” Page 6, lines 98-99

Reviewer’s point:

Line 115: did the authors also control for the use of stimulants as caffeine in the sample?

Response:

We thank the Reviewer for this very helpful comment. In this study, we could not systematically control for potential effects of stimulants, such as caffeine or nicotine, on the pupillary reaction. However, while this is a possible limitation of our study, we consider it unlikely that any possible use of stimulants might have significantly affected the results of our study, as the RAPD detects relative differences of the pupillary reaction of both eyes. While stimulants could possibly affect pupillary reactions globally, they appear unlikely to affect relative differences of pupillary reactions of both eyes.

In response to this point, we added the following to the limitation section of the discussion:

„Another possible limitation of our study is that we could not systematically control for potential effects of stimulants, such as caffeine or nicotine, on the pupillary reaction. However, we consider it unlikely that any possible use of stimulants might have significantly affected the results of our study, as the RAPD detects relative differences of the pupillary reaction of both eyes. While stimulants could possibly affect pupillary reactions globally, they appear unlikely to affect relative differences of pupillary reactions of both eyes.” (page 27, line 580-586)

Reviewer’s point:

Line 155: please provide one sample item from the questionnaire and report the Likert scale as well as its psychometric properties based on literature.

Response:

According to the Reviewer’s request, we now provide a sample question from the NEI-VFQ and report the Likert scale as well as its psychometric properties based on literature (Mangione et al., 1998) in the revised manuscript:

“The NEI-VFQ is a reliable and valid tool to assess vQoL in a variety of chronic eye conditions. Its strong psychometric properties make it suitable for group-level comparisons in clinical research, offering precise and consistent evaluation of how visual impairment affects the patients’ daily life [22]. To provide an understanding of the items included in the NEI-VFQ, we here present a sample question and the Likert scale of the possible responses. Question: How much difficulty do you have reading street signs or the names of stores? Answers: No difficulty at all, a little difficulty, moderate difficulty, extreme difficulty, stopped doing this because of your eyesight, stopped doing this for other reasons or not interested in doing this." (page 9, lines 179-187)

Furthermore, we specified that the questionnaire utilized in this study was the German adaptation (Franke et al. 1998) of the National Eye Institute-Visual Function Questionnaire:

“We assessed vQoL using the German adaptation [19] of the National Eye Institute-Visual Function Questionnaire (NEI-VFQ) [20].” (page 9, lines 177-178)

Reviewer’s point:

Please also state internal reliability as Cronbach’s alpha.

Response:

We thank the Reviewer for suggesting to use this statistical measure to state internal reliability of the NEI-VFQ. In response, we added the following sentence to the statistics section:

“For internal reliability analysis of the vQoL, we calculated Cronbach’s alpha to assess the internal reliability of the NEI-FVQ.” (page 10, lines 219-221)

Additionally, in the results section, we stated the internal reliability as Cronbach’s alpha by including the following sentence:

“The results of the NEI-VFQ, assessing the vQoL, showed very strong internal reliability (Cronbach’s alpha=0.968).” (page 22, lines 436-437)

Reviewer’s point:

Line 190-191: please discuss the exploratory nature of this study in the introduction.

Response:

We agree with the Reviewer's recommendation to mention the exploratory nature of this cross-sectional observational study. To address this point, we have added the following statement to the introduction:

“In this exploratory study, we systematically evaluated UP for the detection of an RAPD in patients with ON, including a comparison with IVP.” (page 6, lines 103-104)

Reviewer’s point:

Could the authors also provide reference values of the key ON related measures (e.g., PCT) from much larger datasets for readers to compare with the sample in this study?

Response:

To address this point, we performed a literature search, which, however, did not identify large and comprehensive datasets that could provide reference values for the PCT. The largest currently available set of reference values for UP is derived from our own previous study, which included a total study population of n=100. We now refer to these reference values in the following sentence:

“Also, PCT measurements of HC were in line with the reference values (mean, (SD) left eye: 970 (261.6) ms; right eye: 967 (220) ms) for healthy subjects from our previous study [9].” (page 25, lines 520-522)

Reviewer #2 Response to 'correction' document:

Reviewer’s point:

The subheading “Swinging flashlight test” and “Ultrasound pupillometry vs. infrared video pupillometry” in the results section (line 226 and 231 respectively) lack clarity regarding the type of analysis conducted.

Response:

We thank the Reviewer for identifying potential sources of ambiguity. In response to this point, we clarified the respective subheadings:

“Prevalence of an RAPD as assessed by the swinging flashlight test” (page 13, lines 264-265)

and

“Comparative analysis of pupil diameter as assessed by ultrasound pupillometry and infrared video pupillometry” (page 14, lines 270-271)

Reviewer’s point:

Table 2 fails to include the p-value for the correlation coefficient between UP and IVP.

Response:

We thank the Reviewer for bringing this to our attention. In response, we included the missing p-values in Table 2 (page 15).

Reviewer’s point:

The legend of Figure 4 does not specify the pupillometry method used to measure the pupillary diameter of ON- eyes.

Response:

We thank the Reviewer for raising this point. Of note, Bland-Altman plots are used to graphically illustrate the comparison of two different methods for measuring the same parameter. In this case, the pupil diameter (PD) is being measured by ultrasound pupillometry (UP) and by infrared video pupillometry (IVP). The x-axis reports the difference in PD measurements between the two methods (PD in IVP - PD in UP), while the y-axis shows the mean PD of both methods ((PD in IVP + PD in UP)/2).

To clarify this aspect, we have added both pupillometry assessments in the figure’s caption:

“Fig 4. Bland-Altman plot of pupil diameter as measured by UP and IVP after direct light stimulus in ON- eyes.” (page 17, lines 341-342)

Reviewer’s point:

The legend of Figure 5 does not pr

Attachment

Submitted filename: Response to Reviewers.docx

pone.0315712.s004.docx (38KB, docx)

Decision Letter 1

Tudor C Badea

28 Oct 2024

PONE-D-24-06833R1Ultrasound pupillometry for the detection of a relative afferent pupillary defect (RAPD): systematic evaluation in patients with optic neuritis and comparison with infrared video pupillometryPLOS ONE

Dear Dr. Schmidt,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

Please address the minor, but significant issues raised by the reviewers regarding publication ethics, in particular dual publication of data, ethics protocols, and proper referencing of literature.

==============================

Please submit your revised manuscript by Dec 12 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Tudor C. Badea, M.D., M.A., Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors have thoroughly responded to and tried to address all my comments. Thank you for your effort!

Reviewer #2: Dual Publication: Ensure that the findings and data presented in this manuscript have not been published elsewhere or submitted to another journal simultaneously, as this would constitute dual publication, which violates ethical standards in research publishing.

Research Ethics: The author should confirm that all patient data was handled in accordance with ethical guidelines, including obtaining informed consent and ensuring patient confidentiality.

Publication Ethics: Proper credit should be given through citations to all relevant sources in the literature review. Furthermore, the manuscript should be checked for any potential conflicts of interest or ethical concerns.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Xi Yang

Reviewer #2: Yes: Priyanka Modi

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: plos review final.docx

pone.0315712.s005.docx (14.2KB, docx)
PLoS One. 2025 Jan 10;20(1):e0315712. doi: 10.1371/journal.pone.0315712.r004

Author response to Decision Letter 1


27 Nov 2024

"Ultrasound pupillometry for the detection of a relative afferent pupillary defect (RAPD): systematic evaluation in patients with optic neuritis and comparison with infrared video pupillometry"

Manuscript ID: PONE-D-24-06833R2

Journal Requirement:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Response:

We confirm that all relevant sources are correctly cited in the reference list of the manuscript.

Journal Requirement:

We note that your Data Availability Statement is currently as follows: [Add Data Availability statement here].

Please confirm at this time whether or not your submission contains all raw data required to replicate the results of your study. Authors must share the “minimal data set” for their submission. PLOS defines the minimal data set to consist of the data required to replicate all study findings reported in the article, as well as related metadata and methods.

Response:

We would like to refer to PLOS ONE policy about data availability: ‘All data and related metadata underlying reported findings should be deposited in appropriate public data repositories, unless already provided as part of a submitted article.’

The complete data set was provided as a separate file in the initial submission of the article, see document ‘Data Table’ (Name: Data Table.xlsx) as part of the uploaded Supporting Information in February 2024. This was done in accordance with the journal's data policy. Should this be insufficient, we kindly request that you inform us.

Journal Requirement:

Please include a copy of Table 2 which you refer to in your text on page xx.

Response:

We would like to thank for this remark and provide a revised manuscript with the requested Table 2 entitled ‘Table 2. Infrared video pupillometry vs. ultrasound pupillometry in ON+ and HC eyes.’ (page 14)

Response to Reviewers

Reviewer #1:

Reviewer’s point:

The authors have thoroughly responded to and tried to address all my comments. Thank you for your effort!

Response:

We appreciate this comment.

Reviewer #2:

Reviewer’s point:

Dual Publication: Ensure that the findings and data presented in this manuscript have not been published elsewhere or submitted to another journal simultaneously, as this would constitute dual publication, which violates ethical standards in research publishing.

Response:

We herewith confirm that the findings and data presented in this manuscript are original and have not been published elsewhere or submitted to another journal simultaneously, as already stated in the original Cover Letter from February 2024. We are fully aware of and adhered to the ethical standards in research publishing, including the guidelines concerning dual publication, and we are committed to maintaining the integrity of the scientific literature.

Reviewer’s point:

Research Ethics: The author should confirm that all patient data was handled in accordance with ethical guidelines, including obtaining informed consent and ensuring patient confidentiality.

Response:

We herewith confirm that all patient data were handled in strict accordance with the ethical guidelines that govern our research. As already stated in the manuscript, written informed consent was obtained from all participants prior to inclusion into the study and patient confidentiality was ensured throughout the study. In response to the Reviewer’s comment, we have amended the respective passage in the Methods Section of the manuscript to mention more explicitly that patient confidentiality was ensured throughout the study:

“This cross-sectional observational study was approved by the Institutional Review Board of Charité – Universitätsmedizin Berlin (EA1/190/15) and was conducted in accordance with the current applicable ethical guidelines of the Declaration of Helsinki and German law. Written informed consent was obtained from all participants prior to inclusion into the study and patient confidentiality was ensured throughout the study.” (page 6, lines 110-114)

Reviewer’s point:

Publication Ethics: Proper credit should be given through citations to all relevant sources in the literature review. Furthermore, the manuscript should be checked for any potential conflicts of interest or ethical concerns.

Response:

We concur with the Reviewer's comment and thank them for raising this important point. We confirm that all relevant sources have been subjected to a comprehensive review and cited in accordance with the standards set forth in the literature review. In instances where citations were absent, we have duly added them. Furthermore, the manuscript has been meticulously examined for any potential conflicts of interest or ethical concerns, and all necessary disclosures have been included to ensure compliance with the standards set forth in the publication ethics code.

Reviewer’s point:

In the comment regarding page 6, lines 95-98: "The author states that 'UP does not require patient cooperation.' However, there is no discussion about the feasibility of UP in agitated patients. This statement is only partially correct, as UP does not fully eliminate the need for patient cooperation."

Response:

We thank the Reviewer for bringing this to our attention. In response, we included the following additional statement:

“(…) UP does not require active patient cooperation, provided that the patient is able to remain seated or lie quietly during the procedure.” (page 6, lines 95-96)

Reviewer’s point:

In the comment regarding page 25, lines 532-538: "The author has not provided citations to support the literature review in this section."

Response:

We thank the Reviewer for highlighting this important point. In response, we have incorporated the missing references into the manuscript (Schmidt et al. 2017; Broadway, 2012; Thompson et al. 1981; Beisse et al. 2020).

“UP is an objective and precise measuring tool, providing consistent and reliable measurements [9], whereas the SFLT relies on subjective visual evaluation by the examiner [6, 7]. In the SFLT, results depend on the examiner’s experience and judgment [8].” (page 25, lines 513-516)

Attachment

Submitted filename: Response to Reviewers.docx

pone.0315712.s006.docx (27.2KB, docx)

Decision Letter 2

Tudor C Badea

2 Dec 2024

Ultrasound pupillometry for the detection of a relative afferent pupillary defect (RAPD): systematic evaluation in patients with optic neuritis and comparison with infrared video pupillometry

PONE-D-24-06833R2

Dear Dr. Schmidt,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Tudor C. Badea, M.D., M.A., Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Tudor C Badea

27 Dec 2024

PONE-D-24-06833R2

PLOS ONE

Dear Dr. Schmidt,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Tudor C. Badea

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Data set.

    CIS = clinically isolated syndrome, EDSS = Expanded Disability Status Scale, HC = healthy controls, IVP = infrared video pupillometry, mm = millimeters, MS = multiple sclerosis, ms = milliseconds, μm = micrometers, NMOSD = neuromyelitis optica spectrum disorder, OCT = optical coherence tomography, ON = optic neuritis, PCT = pupil constriction time, PD = pupil diameter, PPMS = primary progressive multiple sclerosis, pRNFLT = absolute peripapillary retinal nerve fiber layer thickness, RAPD = relative afferent pupillary defect, RRMS = relapsing remitting multiple sclerosis, SPMS = secondary progressive multiple sclerosis, UP = ultrasound pupillometry.

    (XLSX)

    pone.0315712.s001.xlsx (59.6KB, xlsx)
    Attachment

    Submitted filename: 240331_PLOS_Review.docx

    pone.0315712.s002.docx (16.9KB, docx)
    Attachment

    Submitted filename: correction.docx

    pone.0315712.s003.docx (14.5KB, docx)
    Attachment

    Submitted filename: Response to Reviewers.docx

    pone.0315712.s004.docx (38KB, docx)
    Attachment

    Submitted filename: plos review final.docx

    pone.0315712.s005.docx (14.2KB, docx)
    Attachment

    Submitted filename: Response to Reviewers.docx

    pone.0315712.s006.docx (27.2KB, docx)

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting information files, see document 'Data Table' uploaded as Supporting information item.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES