Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2024 Jun 1.
Published in final edited form as: Ophthalmic Genet. 2023 Feb 22;44(3):218–225. doi: 10.1080/13816810.2023.2179074

The validation of inherited retinal disease-specific patient-reported outcome measures in adolescent patients

Kavin Selvan a,b,c, Rebhi Abuzaitoun d, Maria Fernanda Abalem d,e, Ajoy Vincent a,b,c, Chris A Andrews d, Gabrielle D Lacy d, Rafid Farjo d, Karissa Kao d, Krystal Kao d, Gislin Dagnelie f, David C Musch d,g, K Thiran Jayasundera d,+, Elise Héon a,b,c,*
PMCID: PMC10198816  NIHMSID: NIHMS1873224  PMID: 36974468

Abstract

Purpose

To determine the validity of the validate the adult patient-reported outcome measure tools, the Michigan Retinal Degeneration Questionnaire (MRDQ) and Michigan Vision-Related Anxiety Questionnaire (MVAQ), in adolescent patients with inherited retinal diseases (IRDs).

Methods

Ninety-one adolescent patients diagnosed with IRDs were recruited at the Hospital for Sick Children (University of Toronto) and the Kellogg Eye Center (University of Michigan). The patients were administered the MRDQ, MVAQ, and Patient Health Questionnaire-4 (PHQ-4). Test-retest variability was assessed in eighteen patients within 14 days of the initial administration. Adolescent responses were analyzed for validity and reliability. As a further validation step, comparisons were made to adult data from the original MRDQ and MVAQ studies to ensure consistency in response ranges.

Results

The existing MRDQ and MVAQ content and format could accurately detect the impact of IRD on activities of daily living in adolescents with IRDs. No floor/ceiling effects were identified, test-retest reliability was established (r = 0.73–0.86), and no items were excluded after differential item functioning analysis. Domain and trait associations with visual acuity and IRD phenotypes were similar between adolescents and adults.

Conclusions

The MRDQ and MVAQ are psychometrically validated questionnaires for which we have shown validity for use in adolescent patients with IRDs.

INTRODUCTION

Inherited retinal diseases (IRDs) refer to a diverse group of rare hereditary diseases with photoreceptor malfunction that can lead to blindness (1). IRDs are genetically heterogeneous and show variability in the severity of signs and symptoms, such as photophobia and nyctalopia. The visual impairment of patients with IRDs is most often silent and invisible, even though these changes impact patients’ daily lives and their ability to perform activities of daily living (24). These challenges and health outcomes meaningful to patients with IRDs are not captured by routine ophthalmic clinical tests, which are primarily retinal functional and structural tests (57). This requires the development of patient-reported outcome measures (PROMs); questionnaires that assess the preferred health needs and outcomes of patients (79). PROMs provide an important insight into the impact of a condition on patient experience, translating to a meaningful assessment that optimizes clinician decision-making (2,7,10). This could involve measuring the impact of IRDs on a patient’s activities of daily living (1113), which could then be used to best interpret outcomes (2).

Over the years, several PROMs were developed to assess for meaningful changes in vision; however, until recently, the tools available were not developed or validated for patients with IRDs (2,5). Only recently was a set of IRD-specific tools designed for adult patients: the Michigan Retinal Degeneration Questionnaire (MRDQ) (3) and Michigan Vision-Related Anxiety Questionnaire (MVAQ) (4). PROMs like the MRDQ and MVAQ are becoming critical for patients with IRDs, given challenges to the recent U.S. Food and Drug Administration (FDA), European Medical Agency, and Health Canada approvals of novel therapies such as gene replacement therapy for the RPE65-related IRD and the many other upcoming therapeutic trials for IRDs (1). MRDQ and MVAQ assess the impact of an IRD on adult patients’ daily activities. However, many IRDs manifest in childhood and, therefore, most amenable to gene therapy treatment also in childhood. There remains a great unmet need to develop PROMs tailored to pediatric patients with IRDs (1,9).

Considering the original development of MRDQ and MVAQ included 18-year-old patients with IRD, the present study aims to determine if these tools are valid PROMs for adolescent patients. While children and adults have different experiences with their conditions (14), we hypothesize that the MRDQ and MVAQ can be used as patient-reported outcome measures (PROMs) in adolescents with inherited retinal disorders (IRDs) because of the similarities in the functional vision-related difficulties and limitations between adolescents and adults with IRDs (1517). Novel PROMs for children are being created in a separate study. As with the development of the MRDQ and MVAQ, these tools were validated in accordance with FDA guidelines (10,18) and addressed a critical unmet need in clinical practice and research.

METHODS

This study was jointly approved by the Institutional Review Boards of the Hospital for Sick Children (HSC), Toronto, Ontario, and the University of Michigan (UM), Ann Arbor, Michigan. Informed consent and informed assent were obtained as required by the local institutions. All research procedures respected the tenets of the Declaration of Helsinki.

Participants

Adolescent patients (aged 13 to <18 years) with IRD were recruited between March and December 2021 at two collaborative sites: the Department of Ophthalmology and Vision Sciences (HSC, Toronto) and Kellogg Eye Center (UM, Michigan). Participants at HSC were recruited during their routine clinic visits or from the Fighting Blindness Canada (FBC) patient registry (19), which provides information for patients with IRDs, either consented by the patient or their caregivers. Patients at Kellogg Eye Center were identified by searching the electronic medical records for patients with IRDs. Potential participants were then sent invitation letters, including the consent form, and were later contacted by telephone.

Inclusion criteria were adolescents aged 13 to <18 years with an IRD diagnosis per clinical evaluation by a fellowship-trained IRD specialist. Information collected included age, sex, full-field electroretinogram (ERG), retinal imaging (optical coherence tomography and fundus autofluorescence), widefield perimetry, and genetic testing results from CLIA-approved laboratories when available. According to established guidelines, participants’ phenotypes (hereafter “IRD phenotype”) were classified as rod-cone dystrophy, cone/cone-rod dystrophy, or macular dystrophy (20). Of note, transsynaptic-retinal dystrophies (X-linked retinoschisis and X-linked congenital stationary night blindness) were included in the above three phenotypes based on ERG amplitude evaluation and categorization. Patients were excluded if they had insufficient command of the English language, were unable to complete the PROM according to the judgment of their caregivers, or had an impairment that affected their ability to understand and provide informed assent.

Interview Protocols

The Michigan Retinal Degeneration Questionnaire (MRDQ) measures the impact of visual disability on activities of daily living in patients with IRDs (3). The questionnaire consists of 59 Likert-scaled items spanning seven scored domains: Central Vision (11 questions), Color Vision (4 questions), Contrast Sensitivity (7 questions), Scotopic Function (12 questions), Photopic Peripheral Vision (9 questions), Mesopic Peripheral Vision (9 questions), and Photosensitivity (7 questions). The Michigan Vision-Related Anxiety Questionnaire (MVAQ) assesses the patient’s psychosocial well-being associated with their IRD condition (4). This tool consists of 14 Likert-scaled items spanning two separately scored domains: Rod Function Anxiety (6 questions) and Cone Function Anxiety (8 questions). The MRDQ and MVAQ contain maintained appropriate language for the adolescent population, as evidenced by a Flesch-Kincaid reading score of 8 for participants 13 and up (21,22). This was reaffirmed by administering both tools to an independent set of unaffected adolescents (n=5) to verify the relevance and comprehensibility of items to their age group prior to the larger study. Items from the MRDQ and MVAQ are detailed in Lacy et al. (3) and Lacy et al. (4), respectively.

In addition to the MRDQ and MVAQ, the participants completed the shortened version of the Patient Health Questionnaire (PHQ-4), a validated tool for detecting clinical depression and anxiety that is widely used and designed to minimize respondent burden. The PHQ-4 questionnaire provides a total score of 0–12 and two subscales: depression (0–6) and anxiety (0–6) (23,24).

This study occurred during the COVID-19 pandemic, and adaptations were made to the methodology to minimize infection risk. The MRDQ and MVAQ were administered verbally by research assistants in-person, over the phone, or on the institution-provided ZOOM (Zoom Video Communications, Inc., San Jose, CA, USA) video call. Subjects had the option to complete a second administration 14 days following their initial interview to assess the test-retest variability of the two patient-reported outcome measures. If the visual acuity had not been assessed within six months before the first interview, it was measured using one of three teleophthalmic visual acuity tests based on patient preference and access to devices (laptop/tablet, android phone, or iOS phone): Freiburg Vision Test (‘FrACT’, http://michaelbach.de/fract/) (25), Verana Vision Test (Verana Health, NYC, NY, USA) (26), or Peek Acuity (Peek Vision Ltd, Berkhamstead, England, UK) (27).

Data Analysis

Analysis was conducted in R (4.1.2, R Foundation for Statistical Computing, Vienna, Austria). Patient responses were input to the existing MRDQ and MVAQ graded response models to calculate nine domain scores. Results from this study were then compared to the findings in the original adult patient with IRDs cohort used for the creation and psychometric validation of MRDQ and MVAQ (3,4).

Graded response model

Building the MRDQ and MVAQ models is detailed previously (3,4). Briefly, graded response models were built using Cai’s Metropolis-Hastings Robbins-Monro algorithm (28), implemented in the R (version 3.6.3) package mirt.(29) A graded response model gives each person one parameter score (θ) that quantifies their visual disability (for MRDQ) or vision-related anxiety (for MVAQ). The scales were created with a mean of 0 and a variance of 1 from the original adult population. Higher person scores indicate greater disability or anxiety in relation to IRD. These models were used to score the adolescent responses (3,4).

Performance by measure domain

The presence of floor or ceiling effects was investigated for each domain of the MRDQ and MVAQ to establish whether the questionnaires were properly centered, ensuring the domain’s ability to capture different levels of visual disability and vision-related anxiety within the IRD population.

Test-retest variability

Test-retest reliability was quantified for each domain using the Pearson correlation between participants’ scores on the first and second tests, the mean change between administrations, and the estimated standard deviation (SD) of measurement error (30). The measurement error SD estimate is based on the bias-corrected Bland-Altman difference scores method, and confidence intervals (CI) were computed by jackknife resampling (31).

Differential item functioning

Differential item functioning (DIF) was investigated to determine whether responses to an item depended on a covariate after controlling for overall disability or anxiety. DIF was independently investigated for each of the 73 items (59 MRDQ and 14 MVAQ) and each of 7 covariates: logMAR corrected visual acuity in the better eye (logMAR BE) and worse eye (logMAR WE), age, sex, administration site (HSC and UM), IRD phenotype (rod-cone, cone/cone-rod, and macular dystrophy), and total PHQ-4 scores (0–12 scale). Multiple linear regression was used for each item and covariate combination to quantify the correlation between the mean response to the item and the covariate, controlling for the domain score. The P value of the coefficient of the covariate was used to judge DIF. Only item/covariate combinations with a P < .001 were reported due to the many comparisons that were conducted.

Domain and trait associations

Patient covariates were summarized by counts and percentages or medians and ranges. The proportion of missing data was summarized for each item. Coefficients of determination quantified correlation between domains and covariates. Domain correlations with covariates were assessed by simple linear models: regression for continuous covariates and ANOVA for categorical covariates. The following traits were investigated for known-group validity: logMAR BE, logMAR WE, age (13 to <18 years), sex, administration site (HSC and UM), and IRD phenotype (rod-cone, cone/cone-rod, and macular dystrophy). Comparing domain scores between different phenotypes was done as a test of instrument validity.

Patient Health Questionnaire-4 and Michigan Vision-Related Anxiety Questionnaire association.

After completing the MVAQ, participants were asked items from the validated PHQ-4 to assess symptoms of depression and anxiety (23,24). Responses were compared with MVAQ using linear regression to establish convergent validity.

Comparison to adults with inherited retinal diseases

Results from the univariate analyses of domain and trait associations in adolescents were compared to those from adults who had participated in the original validation studies (Supplementary Material 1) (3,4). Additionally, nine (one for each scale) multivariable regression models were used to assess the equality of associations between the MRDQ/MVAQ domains and visual acuity (logMAR BE), age, sex, and IRD phenotype in adults and adolescents using interaction terms. Differences in coefficients (adolescent minus adult) are reported with 95% confidence intervals.

RESULTS

Participants

Ninety-one adolescent patients with clinically diagnosed IRDs were administered the MRDQ and MVAQ (Supplementary Material 2). Participants took, on average, approximately 13 minutes to complete the MRDQ and 4 minutes to complete the MVAQ. The sample consisted of 51 males (56%), and the ages ranged from 13 to 17.9 years (mean 16.0) years old. Forty-seven (51.6%) presented with a rod-cone dystrophy phenotype, while 33 (36.3%) and 11 (12.1%) presented with cone/cone-rod and macular dystrophy phenotypes, respectively. Seventy-nine patients had conclusive genetic testing available (Supplementary Material 3).

Data Analysis

All items considered for analysis were answered by 97% of participants on average. Questions deemed not applicable by the participants were considered unanswered. No items were removed, and no domains were adapted in the analysis.

Performance by measure domain

The presence of floor or ceiling effects was not identified from any domain score (θ) distributions for the MRDQ and MVAQ (Figure 1).

Figure 1.

Figure 1.

Distribution of domain (θ) scores in adolescents.

Test-retest variability

Eighteen subjects from the initial sample participated in a second administration to measure test-retest reliability. There was low variability observed in the mean change in patient responses across repeat administrations of both PROMs obtained in 12–15 days across all domains. The MRDQ’s and MVAQ’s Pearson correlations between the first and second administrations exceed 0.7, the average changes in θ between administrations are less than 0.2, and the SDs of measurement error are less than <0.34 (Table 1). All values are comparable to the initial adult studies (3,4).

Table 1.

Test-Retest Variability of Domain Scores (θ)

Domain (θ) Number of Questions Initial Measurement Test-Retest (95% CI) (n = 18)

n Mean SD ρ Correlation Mean Change SD ME

Michigan Retinal Degeneration Questionnaire (MRDQ)
 Central Vision 11 91 −0.06 0.84 0.83 (0.59, 0.93) −0.13 (−0.27, 0.02) 0.20 (0.13, 0.28)
 Color Vision 4 91 0.02 1.01 0.74 (0.41, 0.90) 0.02 (−0.22, 0.26) 0.34 (0.21, 0.47)
 Contrast Sensitivity 7 91 −0.06 0.90 0.75 (0.43, 0.90) −0.17 (−0.38, 0.03) 0.29 (0.15, 0.43)
 Scotopic Function 12 90 −0.04 0.87 0.84 (0.62, 0.94) −0.05 (−0.25, 0.15) 0.29 (0.20, 0.38)
 Photopic Peripheral Vision 9 90 0.03 0.83 0.83 (0.58, 0.93) −0.16 (−0.33, 0.01) 0.24 (0.16, 0.33)
 Mesopic Peripheral Vision 9 90 −0.15 0.81 0.73 (0.40, 0.89) −0.05 (−0.27, 0.18) 0.32 (0.22, 0.42)
 Photosensitivity 7 90 −0.22 0.98 0.82 (0.57, 0.93) −0.04 (−0.24, 0.16) 0.29 (0.15, 0.43)

Michigan Vision-Related Anxiety Questionnaire (MVAQ)
 Rod Function Anxiety 6 89 0.02 0.58 0.78 (0.50, 0.92) 0.04 (−0.18, 0.26) 0.31 (0.13, 0.50)
 Cone Function Anxiety 8 90 0.17 0.81 0.86 (0.67, 0.95) −0.19 (−0.36, −0.02) 0.24 (0.13, 0.36)

95% CI = 95% confidence interval; ρ Correlation = Pearson correlation coefficient; SD ME = standard deviation of measurement error.

Three test-retest statistics (Pearson correlation, mean difference, and standard deviation of measurement error) and their 95% confidence intervals were computed from 18 pairs of tests taken approximately 2 weeks apart).

Differential item functioning

DIF was not found in any item for covariates, such as age, sex, and site. Five items were significantly correlated with visual acuity (MRDQ items 26 and 29 from the Scotopic Function domain, item 30 from the Mesopic Peripheral Vision domain, and items 2 and 3 from the MVAQ Cone Function Anxiety domain), and two items (MRDQ items 29 and 30) were associated with IRD phenotype (rod-cone, cone/cone-rod, or macular dystrophy). No items were removed or domains adapted.

Domain and trait associations

The correlations between domain scores (θ) and patients’ clinical characteristics (logMAR BE, logMAR WE, age, sex, IRD phenotype) are summarized in Table 2. The Central Vision domain had a statistically significant positive correlation with logMAR BE and logMAR WE but not with the IRD phenotype. The Color Vision, Contrast Sensitivity, Scotopic Function, Photopic Peripheral Vision, and Mesopic Peripheral Vision domains had statistically significant positive correlations with logMAR BE, logMAR WE, and IRD phenotype.

Table 2.

Associations Between Domain Scores (θ) and Participant Characteristics Measured by Adjusted R2 with 95% Confidence Interval of the Linear Model and by the P Value of the F Test of no Association

Domain (θ) Visual Acuity in Better Eye (logMAR) Visual Acuity in Worse Eye (logMAR) Age Sex IRD Phenotype

R2 P Value R2 P Value R2 P Value R2 P Value R2 P Value

Michigan Retinal Degeneration Questionnaire (MRDQ)
 Central Vision 64.1 (50.4, 74.4) <.001 60.4 (46.0, 71.6) <.001 2.4 (0.0, 12.1) .100 3.6 (0, 14.3) .070 2.6 (0.0, 11.1) .310
 Color Vision 38.7 (22.5, 53.5) <.001 32.8 (17.2, 48.3) <.001 1.9 (0.0, 11) .200 8.5 (0.8, 21.8) <.010 1.2 (0.0, 7.6) .590
 Contrast Sensitivity 53.8 (38.4, 66.3) <.001 50.2 (34.4, 63.4) <.001 3.6 (0.0, 14.3) .070 8.0 (0.6, 21.1) <.010 1.5 (0.0, 8.4) .520
 Scotopic Function 22.5 (8.7, 38.2) <.001 18.9 (6.2, 34.4) <.001 0.1 (0.0, 5.5) .700 8.0 (0.6, 21.2) <.010 18.8 (5.3, 33.5) <.001
 Photopic Peripheral Vision 41.1 (24.8, 55.8) <.001 34.0 (18.1, 49.4) <.001 2.6 (0.0, 12.7) .100 9.7 (1.2, 23.6) <.010 1.4 (0.0, 8.2) .550
 Mesopic Peripheral Vision 32.0 (16.3, 47.5) <.001 27.1 (12.2, 42.8) <.001 0.9 (0.0, 8.6) .400 4.8 (0.0, 16.4) .040 8.9 (0.2, 21.4) .020
 Photosensitivity 10.8 (1.7, 24.9) <.010 9.1 (1.0, 22.8 <.010 0.1 (0.0, 4.9) .800 1.6 (0.0, 10.5) .230 4.9 (0.0, 15.4) .110

Michigan Vision-Related Anxiety Questionnaire (MVAQ)
 Rod Function Anxiety 7.3 (0.4, 20.4) .010 6.9 (0.3, 19.8) .010 2.2 (0.0, 11.9) .200 16.5 (4.6, 31.8) <.001 7.9 (0.0, 20) .030
 Cone Function Anxiety 14.6 (3.5, 29.5) <.001 15.2 (3.9, 30.3) <.001 8 (0.0, 21.3) <.100 10.1 (1.4, 24) <.010 4.7 (0.0, 15) .120

IRD = inherited retinal disease.

Patient Health Questionnaire-4 and Michigan Vision-Related Anxiety Questionnaire association.

A statistically significant relationship was observed between each of the two domains of anxiety (Rod Function Anxiety and Cone Function Anxiety) and PHQ-4 screening scores in adolescents (Table 3). A positive linear correlation was observed between PHQ-4 total scores and both Rod Function Anxiety (R2 = 11.8%, P = .001) and Cone Function Anxiety (R2 = 9.7%, P = .003).

Table 3.

MVAQ Domain Score Correlations with PHQ-4

Rod Function Anxiety Cone Function Anxiety

PHQ-4 Domains R2 (Range) P Value R2 (Range) P Value

 Depression 5.0% (0.0%, 16.9%) 0.036 5.9% (0.0%, 18.3%) 0.023
 Anxiety 14.1% (3.2%, 29.2%) 0.000 9.4% (1.1%, 23.4%) 0.004
 Total 11.8% (2.0%, 26.3%) 0.001 9.7% (1.2%, 23.7%) 0.003

MVAQ = Michigan Vision-Related Anxiety Questionnaire; PHQ-4 = Patient Health Questionnaire-4.

Comparison to adults with inherited retinal diseases

Univariate analyses were performed to identify the presence of an association between the PROM’s domains and each covariate (Table 2). The association between the Central Vision domain and the logMAR BE differed statistically between adults and adolescents (P = .049), as did the association between age and the Cone Function Anxiety domain (P = .029), the association between the Color Vision domain and sex (P = .009), and the association between the Mesopic Peripheral domain and IRD phenotype (P = .024). However, when controlling for variables altogether in the multivariate analysis, there were no differences (P > .05) found between adults and adolescents when comparing domain and trait associations (Table 4). Supplementary Material 4 shows the relationship of domain scores (θ) of each MRDQ/MVAQ domain with logMAR BE, sex, and IRD phenotype (rod-cone, cone/cone-rod, and macular dystrophy) between adolescents and adults upon multivariate analysis (3,4).

Table 4.

Multivariate Analysis for Differences of Beta Coefficients with 95% Confidence Intervals Between Adolescent and Adults

Domain (θ) Vision in Better Eye Age Sex Macular vs Cone/Cone-Rod Dystrophy Rod-Cone vs Cone/Cone-Rod Dystrophy

Michigan Retinal Degeneration Questionnaire (MRDQ)
 Central Vision 0.08 (−0.01, 0.17) −0.07 (−0.39, 0.25) 0.07 (−0.44, 0.57) 0.05 (−0.31, 0.41) −0.21 (−0.45, 0.04)
 Color Vision 0.10 (−0.01, 0.21) −0.43 (−0.84, −0.03) −0.53 (−1.17, 0.11) −0.12 (−0.58, 0.34) 0.08 (−0.23, 0.39)
 Contrast Sensitivity 0.11 (0.00, 0.21) −0.15 (−0.54, 0.24) 0.31 (−0.30, 0.92) 0.16 (−0.28, 0.61) 0.11 (−0.19, 0.41)
 Scotopic Function 0.01 (−0.10, 0.12) 0.21 (−0.22, 0.63) 0.76 (0.10, 1.43) 0.30 (−0.18, 0.78) 0.11 (−0.22, 0.43)
 Photopic Peripheral Vision 0.09 (−0.02, 0.19) −0.07 (−0.46, 0.31) 0.19 (−0.42, 0.80) −0.32 (−0.76, 0.12) 0.11 (−0.19, 0.41)
 Mesopic Peripheral Vision 0.04 (−0.07, 0.15) 0.27 (−0.14, 0.69) 0.68 (0.02, 1.33) 0.06 (−0.41, 0.53) 0.19 (−0.13, 0.51)
 Photosensitivity 0.02 (−0.11, 0.16) 0.23 (−0.27, 0.74) −0.11 (−0.91, 0.69) 0.01 (−0.57, 0.59) 0.20 (−0.19, 0.59)

Michigan Vision-Related Anxiety Questionnaire (MVAQ)
 Rod Function Anxiety 0.06 (−0.05, 0.17) −0.02 (−0.44, 0.39) 0.25 (−0.40, 0.89) −0.15 (−0.62, 0.32) −0.13 (−0.45, 0.18)
 Cone Function Anxiety 0.16 (0.05, 0.28) −0.17 (−0.61, 0.26) 0.16 (−0.53, 0.84) 0.17 (−0.32, 0.67) −0.06 (−0.40, 0.27)

Beta coefficients of adults were from participants of the original validation study (3,4).

DISCUSSION

Considering the growing number of novel therapeutic opportunities being assessed, there is an urgent need for tailored PROMs to assess the impact of IRD on the daily living of affected adolescents. As such, this study validated the MRDQ and MVAQ as useful PROMs for adolescent patients with IRD. This new knowledge addresses a pressing need as IRDs are most often of early onset, and there are no other tailored tools currently available for this group.

The strength of the MRDQ and MVAQ is that the validation in adolescents was performed using a graded response model (GRM)––this was built in the original studies (3,4). Unlike a Rasch model, which requires uniform item discrimination, a GRM accounts for variance and distribution of patient responses when fitting the model. Further, the MRDQ and MVAQ provided response scales anchored in a contextual meaning rather than a simple numerical Likert scale, which provided to establish consistency across the population and over time.

The GRM analysis gives an overall person score (θ), the numerical equivalent of an individual’s ability or disability in a domain/trait. With scores captured from each domain of MRDQ and MVAQ, participants’ responses underwent rigorous testing against different validity and reliability guidelines to establish their suitability in adolescent patients with IRDs. Importantly, the tools’ performance in adolescents did not show any floor or ceiling effects, therefore showing a sufficient ability to capture the range of vision-related disabilities (MRDQ) and vision-related anxieties (MVAQ) in adolescent patients with IRDs. Additionally, both tools (domain correlations with covariates) performed similarly in the adolescent participants and the adults who participated in the original validation of MRDQ and MVAQ (3,4).

The MRDQ and MVAQ domain test-retest reliability measurements were very similar in adolescent patients compared to the previously published results in adult patients (3,4). Verifying test-retest reliability in adolescents was an essential metric for validating functional outcome measures in the IRD populations, as it allows interpretation of change in a given functional ability over time in the setting of a clinical trial or natural history study (2). The test-retest variability of adolescents is comparable to that of adults with IRDs (3,4).

Correlations between domain scores and clinical characteristics were found in adolescents with IRDs. Of note, visual acuity only modestly correlated with different domains (Table 2), highlighting that each domain measures a form of functional vision beyond visual acuity and foveal function per se (32). Furthermore, differential item functioning measures confirms that individual items in each domain of these PROMs are not specifically affected by covariates such as age and sex. Upon multivariate analysis, no differences were found for any domain regarding their trait associations between adolescents and the previously studied adult cohort (3,4), further supporting that MRDQ and MVAQ are suitable for use in adolescents with IRDs.

The traits measured by MVAQ agreed with symptoms of clinical depression and anxiety in adolescents. This was verified through correlations identified between MVAQ and PHQ-4 scores, confirming convergent validity. Furthermore, this correlation was also found in the adult population utilized for the original validation of MVAQ (4).

There are a few limitations to the study. This study was conducted during the COVID-19 pandemic, which challenged recruitment and forced remote assessment. As most participants preferred to be assessed remotely, different visual acuity assessment tools had to be used based on the accessibility of devices by the patients. Additionally, participants were provided a choice from different modes of test administration (i.e., in-person, over the phone, or on the institution-provided Zoom). A minor limitation is our cohort did not include all genetic subtypes of IRDs; however, it reflects the general distribution of clinical phenotypes for a group of diseases classified as orphan diseases (20,33). It is worth noting that the macular dystrophy group had a small sample size (n=11) compared to the other IRD phenotypes, which is consistent with the typical distribution of IRD phenotypes.

The domain/trait correlations for MRDQ and MVAQ in adolescents were similar to those previously published in adults (3,4). Although adolescents and the previously studied adults evaluated were at different stages of their disease process, the domains of MRDQ and MVAQ capture the degree of disability and distress in both groups. Hence, these two tools can be used to longitudinally track the self-reported impact of visual disability and vision-related anxiety into adulthood without the difficulty of having different scoring systems.

In summary, there is an urgent need for to integrate adolescent IRD patients’ perspectives and preferences into their care alongside measuring their vision function and structure (7,1113). Adolescence is a stressful physical, social, and emotional transition period, which an IRD diagnosis and progressive vision loss can significantly impact. As most IRDs are of early onset, adolescence seems to be a strategic period to initiate a potential therapy. Understanding the impact of an IRD on the patient’s activities of daily living and distress using tools such as the MRDQ and MVAQ can assist eye care providers in optimizing the management of their patient’s needs and better understanding of response to any intervention. The MRDQ and MVAQ are now validated to reliably assess for vision-related disability and IRD-related distress in adolescents with IRDs.

Supplementary Material

1

Acknowledgements:

The authors would like to thank Abigail Fahim, Kari Branham, Naheed Khan, and Dana Schlegel for their contributions to the work.

Funding:

This research was supported by the Henry Brent Chair in Innovative Pediatric Ophthalmology Research and Fighting Blindness Canada (EH), Vision Science Research Program (KS), Foundation Fighting Blindness grant CD-CL-0617-0727-HSC (AV), and National Institute of Health grants K23EY026985 (KTJ) and TL1TR002242 (GDL).

Footnotes

Disclosure Statement: EH is consultant for Novartis, Janssen, and on a DSMB (for Sanofi Atsena). AV is a consultant for Novartis and Adverum Biotechnologies, Inc. DCM is a consultant for Editas Medicine, Inc. KTJ, GDL, and MFA are the co-inventors of the Michigan Retinal Degeneration Questionnaire and Michigan Vision-Related Anxiety Questionnaire, which are licensed and copyrighted by the University of Michigan. The remaining authors indicate no financial support or conflicts of interest.

REFERENCES

  • 1.Prado DA, Acosta-Acero M, Maldonado RS. Gene therapy beyond luxturna: a new horizon of the treatment for inherited retinal disease. Curr Opin Ophthalmol. 2020. May;31(3):147–54. [DOI] [PubMed] [Google Scholar]
  • 2.Lacy GD, Abalem MF, Musch DC, Jayasundera KT. Patient-reported outcome measures in inherited retinal degeneration gene therapy trials. Ophthalmic Genet. 2020. Jan 2;41(1):1–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Lacy GD, Abalem MF, Andrews CA, Popova LT, Santos EP, Yu G, et al. The Michigan Retinal Degeneration Questionnaire: A Patient-Reported Outcome Instrument for Inherited Retinal Degenerations. Am J Ophthalmol. 2021. Feb 1;222:60–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Lacy GD, Abalem MF, Andrews CA, Abuzaitoun R, Popova LT, Santos EP, et al. The Michigan Vision-related Anxiety Questionnaire: A Psychosocial Outcomes Measure for Inherited Retinal Degenerations. Am J Ophthalmol [Internet]. 2020. Dec 9 [cited 2021 Mar 15];0(0). Available from: https://www.ajo.com/article/S0002-9394(20)30658-9/abstract [DOI] [PMC free article] [PubMed]
  • 5.Selvan K, Abalem MF, Lacy GD, Vincent A, Héon E. The State of Patient-Reported Outcome Measures for Pediatric Patients with Inherited Retinal Disease. Ophthalmol Ther. 2022. Jun;11(3):1031–46. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.El-Alti L, Sandman L, Munthe C. Person Centered Care and Personalized Medicine: Irreconcilable Opposites or Potential Companions? Health Care Anal. 2019. Mar 1;27(1):45–59. [DOI] [PubMed] [Google Scholar]
  • 7.Dean S, Mathers JM, Calvert M, Kyte DG, Conroy D, Folkard A, et al. “The patient is speaking”: discovering the patient voice in ophthalmology. Br J Ophthalmol. 2017. Jun 1;101(6):700–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Poochikian-Sarkissian S, Sidani S, Ferguson-Pare M, Doran D. Examining the relationship between patient-centred care and outcomes. Can J Neurosci Nurs. 2010. Dec;32(4):14–21. [PubMed] [Google Scholar]
  • 9.Napier MP, Selvan K, Hayeems RZ, Shuman C, Chitayat D, Sutherland JE, et al. Gene therapy: perspectives from young adults with Leber’s congenital amaurosis. Eye. 2021. Sep 16;1–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Patrick DL, Burke LB, Powers JH, Scott JA, Rock EP, Dawisha S, et al. Patient-Reported Outcomes to Support Medical Product Labeling Claims: FDA Perspective. Value Health. 2007. Nov;10:S125–37. [DOI] [PubMed] [Google Scholar]
  • 11.Aarts JWM, Huppelschoten AG, van Empel IWH, Boivin J, Verhaak CM, Kremer JAM, et al. How patient-centred care relates to patients’ quality of life and distress: a study in 427 women experiencing infertility. Hum Reprod. 2012. Feb 1;27(2):488–95. [DOI] [PubMed] [Google Scholar]
  • 12.Apers S, Dancet EAF, Aarts JWM, Kluivers KB, D’Hooghe TM, Nelen WLDM. The association between experiences with patient-centred care and health-related quality of life in women with endometriosis. Reprod Biomed Online. 2018. Feb 1;36(2):197–205. [DOI] [PubMed] [Google Scholar]
  • 13.Spertus JA. Quality of life in EMPEROR-Reduced: emphasizing what is important to patients while identifying strategies to support more patient-centred care. Eur Heart J. 2021. Apr 1;42(13):1213–5. [DOI] [PubMed] [Google Scholar]
  • 14.Rokach A, Parvini M. Experience of adults and children in hospitals. Early Child Dev Care. 2011. Jun;181(5):707–15. [Google Scholar]
  • 15.Solans M, Pane S, Estrada MD, Serra-Sutton V, Berra S, Herdman M, et al. Health-related quality of life measurement in children and adolescents: a systematic review of generic and disease-specific instruments. Value Health. 2008;11(4):742–64. [DOI] [PubMed] [Google Scholar]
  • 16.Varni JW, Limbers CA, Burwinkle TM. How young can children reliably and validly self-report their health-related quality of life?: An analysis of 8,591 children across age subgroups with the PedsQL 4.0 Generic Core Scales. Health Qual Life Outcomes. 2007;5(1):1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Juniper EF, Guyatt GH, Feeny DH, Griffith LE, Ferrie PJ. Minimum skills required by children to complete health-related quality of life instruments for asthma: comparison of measurement properties. Eur Respir J. 1997;10(10):2285–94. [DOI] [PubMed] [Google Scholar]
  • 18.U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes. 2006. Oct 11;4(1):79. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Patient Registry | Fighting Blindness Canada [Internet]. Fighting Blindness Canada (FBC). [cited 2022 Apr 16]. Available from: https://www.fightingblindness.ca/patient-registry/ [Google Scholar]
  • 20.Thompson DA, Ali RR, Banin E, Branham KE, Flannery JG, Gamm DM, et al. Advancing Therapeutic Strategies for Inherited Retinal Degeneration: Recommendations From the Monaciano Symposium. Invest Ophthalmol Vis Sci. 2015. Feb;56(2):918–31. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Williamson JM, Martin AG. Analysis of patient information leaflets provided by a district general hospital by the Flesch and Flesch–Kincaid method. Int J Clin Pract. 2010;64(13):1824–31. [DOI] [PubMed] [Google Scholar]
  • 22.Nickles MA, Ramani SL, Tegtmeyer K, Zhao J, Lio PA. Readability of online patient education materials for juvenile dermatomyositis. Pediatr Dermatol. 2021;38(2):544–6. [DOI] [PubMed] [Google Scholar]
  • 23.Kroenke K, Spitzer RL, Williams JBW, Löwe B. An Ultra-Brief Screening Scale for Anxiety and Depression: The PHQ–4. Psychosomatics. 2009. Nov 1;50(6):613–21. [DOI] [PubMed] [Google Scholar]
  • 24.Watson SE, Spurling SE, Fieldhouse AM, Montgomery VL, Wintergerst KA. Depression and Anxiety Screening in Adolescents With Diabetes. Clin Pediatr (Phila). 2020. May;59(4–5):445–9. [DOI] [PubMed] [Google Scholar]
  • 25.Kollbaum PS, Jansen ME, Kollbaum EJ, Bullimore MA. Validation of an iPad test of letter contrast sensitivity. Optom Vis Sci. 2014;91(3):291–6. [DOI] [PubMed] [Google Scholar]
  • 26.Khurana RN, Hoang C, Khanani AM, Steklov N, Singerman LJ. A Smart Mobile Application to Monitor Visual Function in Diabetic Retinopathy and Age-Related Macular Degeneration: The CLEAR Study. Am J Ophthalmol. 2021. Jul 1;227:222–30. [DOI] [PubMed] [Google Scholar]
  • 27.Satgunam P, Thakur M, Sachdeva V, Reddy S, Rani PK. Validation of visual acuity applications for teleophthalmology during COVID-19. Indian J Ophthalmol. 2021. Feb;69(2):385–90. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Cai L High-dimensional exploratory item factor analysis by a Metropolis–Hastings Robbins–Monro algorithm. Psychometrika. 2010;75(1):33–57. [Google Scholar]
  • 29.Chalmers RP. mirt: A multidimensional item response theory package for the R environment. J Stat Softw. 2012;48(1):1–29. [Google Scholar]
  • 30.Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8(2):135–60. [DOI] [PubMed] [Google Scholar]
  • 31.Abou-Hanna JJ, Andrews CA, Khan NW, Musch DC, Jayasundera KT. Calculation of test-retest variability in phase I/IIa clinical trials for Inherited Retinal Degenerations. Ophthalmic Genet. 2021. Jun;42(3):283–90. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Wojciechowski R. Nature and nurture: the complex genetics of myopia and refractive error. Clin Genet. 2011;79(4):301–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Hardcastle AJ, Sieving PA, Sahel JA, Jacobson SG, Cideciyan AV, Flannery JG, et al. Translational retinal research and therapies. Transl Vis Sci Technol. 2018;7(5):8–8. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

1

RESOURCES