Abstract
Background and hypothesis
Substantive inquiry into the predictive power of eye movement (EM) features for clinical high-risk (CHR) conversion and their longitudinal trajectories is currently sparse. This study aimed to investigate the efficiency of machine learning predictive models relying on EM indices and examine the longitudinal alterations of these indices across the temporal continuum.
Study design
EM assessments (fixation stability, free-viewing, and smooth pursuit tasks) were performed on 140 CHR and 98 healthy control participants at baseline, followed by a 1-year longitudinal observational study. We adopted Cox regression analysis and constructed random forest prediction models. We also employed linear mixed-effects models (LMMs) to analyze longitudinal changes of indices while stratifying by group and time.
Study results
Of the 123 CHR participants who underwent a 1-year clinical follow-up, 25 progressed to full-blown psychosis, while 98 remained non-converters. Compared with the non-converters, the converters exhibited prolonged fixation durations, decreased saccade amplitudes during the free-viewing task; larger saccades, and reduced velocity gain during the smooth pursuit task. Furthermore, based on 4 baseline EM measures, a random forest model classified converters and non-converters with an accuracy of 0.776 (95% CI: 0.633, 0.882). Finally, LMMs demonstrated no significant longitudinal alterations in the aforementioned indices among converters after 1 year.
Conclusions
Aberrant EMs may precede psychosis onset and remain stable after 1 year, and applying eye-tracking technology combined with a modeling approach could potentially aid in predicting CHRs evolution into overt psychosis.
Keywords: eye movement, longitudinal modeling, early psychosis, clinical high risk for psychosis, transition
Introduction
In early intervention studies of psychosis, the clinical high risk for psychosis syndrome (CHR)1,2 is now used to describe the potential risk stage for the development of psychotic disorders, and individuals in this stage exhibit attenuated psychotic symptoms and reduced functioning, but do not yet meet the criteria for first-episode psychosis.3 The results of the Chinese epidemiological survey showed that the detection rate of CHR was 4.2% among outpatients who first sought help4 and about 1.4% among general college students.5 Fourteen to 21 years of age was the peak age group and the proportion of minors was 50%.4 Due to the poor understanding of the pathological mechanisms of CHR, the highly variable clinical symptoms, and individual heterogeneity in the CHR population,6,7 psychopathology assessed by symptom rating instruments remains the only diagnostic strategy available. Recent studies have adopted multivariate prediction models or risk calculators, which may remain limited by the lack of specificity, principal reliance on clinical or other primarily phenomenological data, and the difficulty of rapid application due to the substantial standardized training and specialization.8 A review9 demonstrated that combining or sequentially using clinical data with neurobiological and physiological indexes optimizes risk prediction among CHR populations. Therefore, combining biomarkers with multivariate prediction models and risk calculators can help address the limitations mentioned above.8
Recent research has indicated that eye movement (EM) abnormalities, an endophenotype of schizophrenia,10 are also detected in CHR populations. Initial studies focused on the performances of CHR under saccadic tasks and found that the error rates of anti-,3 pro-,11 and memory-guided saccades,12 were higher than that of healthy controls (HC). However, 2 studies compared the anti-saccade accuracies of the CHR and HC groups but reported negative results.12,13 Saccade latency as another critical indicator has been discovered to be prolonged in CHR individuals.14 In addition, EM deficits of CHR also appeared in other paradigms, which were specifically manifested as more and larger saccades,15 more and shorter fixations16 under the fixation stability task; increased corrective and non-corrective saccadic rates,17 as well as lower velocity gains16 under the smooth pursuit test; and fewer fixations and saccades, prolonged fixation duration and shortened saccade amplitude, along with decreased scan path lengths and saccade velocity under the free-viewing task.15,16,18
Four studies have explored the ability of EM measures to diagnose and predict clinical conversion. Caldani et al. reported a receiver operating characteristic (ROC) area of 0.77 to distinguish 23 CHR individuals from 47 HCs by memory-guided error rates.12 In addition, a recent study reported that the gradient-boosted decision tree model developed by Lyu et al.16 identified 88% CHR cases (16 CHR participants vs 104 HCs). Furthermore, Kleineidam et al.13 found that the indexes obtained from the anti- and pro-saccade tasks failed to predict clinical outcomes after 2 years (23 converters vs 137 non-converters). However, a recent study of ours,15 which included 21 converters and 87 non-converters, discovered that the saccade frequency from the fixation stability task and the saccade amplitude from the free-viewing test could predict the psychosis transition within 3 years, with an area under the logistic regression ROC curve of 0.80. Therefore, the performance of machine learning prediction models based on multidimensional EM indexes along with the longitudinal trajectory of EM characteristics of CHR populations remain unclear and necessitate further in-depth inquiry.
Building on existing research,15 we aimed to investigate EM characteristics of CHR under 3 tasks at baseline and after 1 year of follow-up, explore EM measurements associated with CHR conversion, establish machine learning prediction models, and evaluate the longitudinal trajectory of EM metrics.
Methods
Participants
This study was approved by the Ethics Committee of Shanghai Mental Health Center. All participants signed the informed consent (minors were required to sign both by themselves and their guardians).
One hundred and forty CHR individuals were enrolled in the outpatient department of Shanghai Mental Health Center. The inclusion criteria: (a) aged between 15 and 45 years old; (b) more than 6 years of education; (c) compliance with the CHR criteria was evaluated by a professional clinician using the Structured Interview for Psychosis-risk Syndromes (SIPS) and Scale of Psychosis-risk Symptoms (SOPS) assessment. Participants were diagnosed with at least 1 of 3 prodromal syndromes, including brief intermittent psychotic syndrome, attenuated positive symptom syndrome, or genetic risk and deterioration syndrome; (d) drug-naïve before entering the study. Exclusion criteria encompassed the following: (a) with DSM-IV-I axis psychiatric disorders, such as schizophrenia, affective disorders, and anxiety spectrum disorders, assessed using the Mini International Neuropsychiatric Interview (MINI); (b) IQ score below 70, as measured by the Wechsler Intelligence Scale for Children/Adult-Chinese Revised19,20 during the enrollment screening stage; (c) with severe medical diseases, such as neurological disorders, cancer, heart failure, immune deficiency; (d) with symptoms caused by drug abuse or dependence; (e) with audio-visual disorders (abnormal hearing, high myopia, color blindness, and other eye diseases that affected vision).
Ninety-eight HCs were recruited through online advertising in Shanghai and screened to exclude the presence of any mental disorders or prodromal symptoms/syndromes using MINI and SIPS. The inclusion and exclusion criteria for HC were the same as for CHR, except that HCs did not meet the criteria for the prodrome syndrome.
Conversion to Psychosis
At follow-up, based on information from face-to-face or telephone interviews (patient and family reports) along with clinician reports, the clinical outcome of CHR was gauged via the operational definition of SIPS psychotic episodes. Specifically, the conversion was defined as the presence of at least 1 psychotic symptom (a score of “6” on at least 1 item on the positive symptom scale) at the 1-year follow-up time point.21
EM Measures
Fixation Stability Test
The participants were asked to keep looking at a black dot (size 0.5°) in the center of the computer screen and ignore interference signals (“*” mark, size 0.5°) from the side. During the first 5 s, only the black dot appeared (simple task); for 5–10 s, the distractor appeared randomly (direction: left and right; distance: near and far) next to the black dot for a specified duration (distracted task). There were 10 trials and 4 indexes were analyzed, including fixation number, fixation duration, saccade number, and saccade amplitude.
Free-viewing Test
The participants were instructed to relax and freely view 35 still black and white pictures, with each presented for 10 s. The pictures involved 4 types of content: natural scenery, social scenes, still objects, and meaningless images, and were presented in a random order. We analyzed 6 variables: the fixation number, the fixation duration, the saccade number, the saccade amplitude, the scan path length, and the saccade velocity.
Smooth Pursuit Test
The participants were required to keep their heads motionless and their eyes to follow the black dots on the screen, which moved at a certain frequency and trajectory. The target moved horizontally and vertically with a sinusoidal trajectory for 2.5 s each (horizontal/vertical pursuit paradigm), or it moved both horizontally and vertically with Lissajous trajectories of different frequencies (slow Lissajous paradigm: 20 s; fast Lissajous paradigm: 10 s). Each trial was repeated once. We measured the horizontal velocity gain, the vertical velocity gain, the fixation number, the saccade number, and the saccade amplitude. See supplementary materials, table S1 for the explanations for all EM variables.
EM Tracking
Eye Link 1000 desktop eye tracker from SR Research Canada was applied to collect EM data. The eye tracker set to pupillary reflex tracking mode had a 17-in. display with a resolution of 1024 × 768 pixels. An adjustable chair was positioned 90 cm in front of the display, and a jaw rest stabilized the participant’s head to align their eyes with the center of the display. EM data were tracked within a range of 30± degrees horizontally and vertically. Furthermore, data were collected from dominant eyes with a 500 Hz sampling frequency.
Data Analysis
Prior to the analysis, EM data cleaning was conducted by eliminating blink artifacts, fixations with duration below 20 ms or outside the screen, and saccades moving from inside or outside the screen.22 Univariate extreme outliers were identified by evaluating histograms and box plots, and the Winsorization method was used to replace the outliers with the nearest highest or lowest observation to minimize the impact on the results of the parametric statistical tests.23
Statistical analysis was performed using R Studio software, version 4.3.1. Demographic and clinical data were compared using a 1-way ANOVA/independent t-test for continuous variables and a chi-square test for categorical variables. One-way Multivariate Analysis of Variance (MANOVA) was used to compare differences in EM variables between groups, followed by post hoc multiple comparisons using the Bonferroni correction (the effect size being measured by Cohen d). Cox regression with forward stepwise selection (likelihood ratio) was applied for survival analysis.
The caret and e1071 packages of R were applied for feature selection and machine learning model construction. All EM variables were used as features and underwent column normalization as a preprocessing step before learning to improve convergence speed. The recursive feature elimination (RFE) algorithm coupled with random forest (RF) (5-fold cross-validation) was employed as the feature selection function to identify the most predictive subset of features. Next, the new data set was randomly divided into a training data set with 60% of the sample and a test data set with 40% of the sample.
The training data were balanced with the Synthetic Minority Oversampling Technique (SMOTE) via the DMwR package of R. SMOTE is a data augmentation technique that creates synthetic samples based on information from existing data, effectively addressing class imbalance and promoting balanced representation across categories with varying observations. This method helps achieve a more robust and reliable predictive model by mitigating the impact of imbalanced datasets.24 The perc. over parameter was set to 200%, resulting in the positive class samples being oversampled by 200%. Additionally, the k parameter was set to 5, implying that the latest 5 samples of each positive category were selected for replication.
We employed RF classification models to distinguish between CHR-C and CHR-NC, and the optimal parameter combination was determined through grid search and cross-validation techniques. Accuracy, sensitivity, specificity, and the area under the ROC curve were adopted to evaluate the performance of the model on the test data set.
Linear mixed-effects models (LMMs) were conducted to examine the different groups’ longitudinal trajectories in EM measures via R package lme4. When fitting the LMM, we considered group (CHR-C, CHR-NC, and HC), time (baseline, follow-up), and their interaction as fixed effects, and subject ID as a random effect. Additionally, baseline gender, age, education year, along with dosage, and duration of antipsychotic use within the past year were included as covariates for control. The simple effects were analyzed by R package emmeans with P values adjusted using Bonferroni correction.
Lastly, partial correlation analysis was used to reveal the relationship between baseline EM characteristics and clinical symptoms, with age, gender, and education years controlled and the false discovery rate corrected.
Result
Sample Characteristics
At baseline, 140 drug-naïve CHR participants and 98 HCs were enrolled. 123 CHR participants (87.86%) completed a 1-year clinical follow-up. Among them, 25 cases were converted to psychosis (CHR-C) (15 were hospitalized for treatment during a first psychotic episode, 60%), and 98 cases were not converted (CHR-NC), with a conversion rate of 20.33%. There were no significant differences in demographic data or clinical symptoms between CHR cases who completed follow-up (n = 123) and those who were lost to follow-up (n = 17).
The CHR-C, CHR-NC, and HC groups were matched in age (F = 2.293, P = .103), gender (χ2 = 1.000, P = .606), and years of education (F = 2.831, P = .061) at baseline. Independent sample T-test demonstrated that the CHR-C group exhibited significantly higher scores for negative symptoms (t = 3.903, P < .001), disorganized symptoms (t = 2.234, P = .027), and total SOPS score (t = 2.737, P = .007) compared with the CHR-NC group.
At the follow-up assessment, 21 CHR-Cs (85%) and 57 CHR-NCs (58.16%) reported the use of antipsychotics within 1 year. Notably, there were no significant group differences in daily dosage (equivalent use of olanzapine25) (t = −1.105, P = .273), but distinctions did emerge in the duration of usage (t = 2.608, P = .011) (see more information on medication in supplementary materials). Demographic data and clinical characteristics of the 3 groups are shown in table 1.
Table 1.
Demographic and Clinical Characteristics of the 3 Groups
| CHR-C (n = 25) | CHR-NC (n = 98) | HC (n = 98) | F/t/χ 2 | P value | |
|---|---|---|---|---|---|
| Baseline demographic and clinical characteristics | |||||
| Age, years, M (SD) | 18.44 (5.27) | 20.21 (5.92) | 18.96 (3.19) | 2.293 | .103 |
| Gender (male/female) | 15/10 | 48/50 | 49/49 | 1.000 | .606 |
| Education year, years, M (SD) | 10.56 (2.50) | 11.92 (3.24) | 12.14 (2.82) | 2.831 | .061 |
| SOPS positive scores, M (SD) | 9.20 (3.35) | 9.28 (4.19) | — | −0.083 | .934 |
| SOPS negative scores, M (SD) | 15.56 (6.89) | 10.36 (5.69) | — | 3.903 | <.001*** |
| SOPS disorganized scores, M (SD) | 7.12 (3.33) | 5.44 (3.36) | — | 2.234 | .027* |
| SOPS general scores, M (SD) | 9.40 (3.03) | 8.48 (3.37) | — | 1.244 | .216 |
| SOPS total scores, M (SD) | 41.28 (10.73) | 33.55 (13.03) | — | 2.737 | .007** |
| Follow-up medication information | |||||
| Use of antipsychotics, n (%)a | 21 (85%) | 57 (58.16%) | — | 5.731 | .017* |
| Daily antipsychotic dose in OLAequ, mg/d, M (SD) | 12.59 (9.82) | 10.16 (8.13) | −1.105 | .273 | |
| Use duration of antipsychotics within 1 year, weeks, M (SD) | 29.24 (18.98) | 39.72 (14.41) | — | 2.608 | .011* |
aMore information on follow-up medication can be found in the supplementary material.
Abbreviations: CHR, clinical high risk; CHR-C, CHR-converter CHR-NC, CHR-nonconverter; HC, healthy control; SOPS, Scale of Psychosis-risk Symptoms; OLAequ, equivalent use of olanzapine. *P < .05, **P < .01, ***P < .001.
EM Characteristics
MANOVA reported that 13 indexes differed by the group, including 2 of the fixation stability test, 5 of the free-viewing test, and 6 of the smooth pursuit test (table 2). See supplementary materials, table S2 for all EM variable information. Figure 1 gives representative examples of the differences in fixation trajectories and distribution among the 3 groups.
Table 2.
Eye Movement Variables with Significant Between-group Effects
| CHR-C (n = 25) |
CHR-NC (n = 98) |
HC (n = 98) |
F value | P value | Post hoc contrast Cohen d (Bonferroni corrected P value) |
|||
|---|---|---|---|---|---|---|---|---|
| CHR-C vs CHR-NC | CHR-C vs HC | CHR-NC vs HC | ||||||
| Fixation stability (simple) | ||||||||
| Saccade amplitude | 1.78 (1.02) | 2.16 (1.70) | 1.45 (1.11) | 6.394 | .002** | 0.27 (.680) | 0.31 (.862) | 0.49 (.001**) |
| Fixation stability (distracted) | ||||||||
| Saccade amplitude | 1.89 (0.67) | 2.15 (1.26) | 1.61 (0.84) | 6.570 | .002** | 0.26 (.811) | 0.37 (.688) | 0.50 (.001**) |
| Free-viewing test | ||||||||
| Fixation number | 20.32 (4.91) | 22.15 (4.30) | 22.48 (3.16) | 3.059 | .049* | 0.40 (.114) | 0.52 (.043*) | 0.09 (1.000) |
| Fixation duration | 354.74 (99.37) | 307.61 (60.85) | 313.13 (71.79) | 4.489 | .012* | 0.57 (.010*) | 0.48 (.028*) | 0.08 (1.000) |
| Saccade number | 20.55 (4.63) | 22.80 (4.97) | 23.63 (3.94) | 4.708 | .010* | 0.47 (.079) | 0.72 (.008**) | 0.19 (.605) |
| Saccade amplitude | 4.51 (1.26) | 5.38 (0.92) | 5.15 (0.90) | 8.244 | <.001*** | 0.79 (<.001***) | 0.58 (.010*) | 0.25 (.290) |
| Scan path length | 103.00 (37.09) | 120.39 (33.55) | 122.27 (30.80) | 3.546 | .031* | 0.49 (.056) | 0.57 (.028*) | 0.06 (1.000) |
| Smooth pursuit test (vertical) | ||||||||
| Vertical velocity gain | 0.40 (0.13) | 0.48 (0.16) | 0.49 (0.16) | 3.227 | .042* | 0.55 (.087) | 0.62 (.037*) | 0.06 (1.000) |
| Saccade number | 8.64 (1.82) | 8.34 (1.95) | 7.78 (1.79) | 3.303 | .039* | 0.16 (1.000) | 0.48 (.119) | 0.30 (.109) |
| Smooth pursuit test (horizontal) | ||||||||
| Saccade amplitude | 2.98 (1.36) | 2.39 (0.92) | 2.58 (1.10) | 3.238 | .041* | 0.51 (.039*) | 0.32 (.267) | 0.19 (.645) |
| Smooth pursuit test (slow Lissajous) | ||||||||
| Horizontal velocity gain | 0.89 (0.09) | 0.91 (0.09) | 0.93 (0.08) | 3.286 | .039* | 0.22 (.605) | 0.47 (.057) | 0.23 (.274) |
| Vertical velocity gain | 0.82 (0.09) | 0.88 (0.09) | 0.88 (0.11) | 3.913 | .021* | 0.67 (.033*) | 0.60 (.021*) | 0 (1.000) |
| Smooth pursuit test (fast Lissajous) | ||||||||
| Vertical velocity gain | 0.67 (0.15) | 0.74 (0.14) | 0.75 (0.14) | 3.172 | .044* | 0.48 (.090) | 0.55 (.040*) | 0.07 (1.000) |
Note: This table only shows the eye movement variables that differed significantly between the 3 groups, and see supplementary table S2 for other variable information. Continuous variables are expressed as M (SD).
Abbreviations: CHR, clinical high risk; CHR-NC, CHR-nonconverter, CHR-C, CHR-converter, HC, healthy controls. Bolded numbers indicate statistical significance: *P < .05, **P < .01, ***P < .001.
Fig. 1.
Illustrative fixation stability (distracted task), free-viewing, and smooth pursuit (slow Lissajous). These example trials illustrate the types of idiosyncrasies, features, and errors that are commonly observed amongst the respective groups of participants.
The post hoc analysis showed that 11 indexes survived after the Bonferroni correction. For the fixation stability test, compared with HCs, the CHR-NC group showed higher saccade amplitudes in both simple and distracted conditions (Cohen d = 0.49, P = .001; Cohen d = 0.50, P = .001). Follow-up comparison of variables of the free-viewing test revealed fewer saccades and fixation, decreased saccade amplitude and scan path length, and longer fixation duration of the CHR-C group relative to HCs (Cohen d = 0.48–0.72, P < .05). Furthermore, the CHR-C group showed prolonged fixation duration and reduced saccade amplitude (Cohen d = 0.57, P = .010; Cohen d = 0.79, P < .001).
As for the smooth pursuit task, the CHR-C group manifested lower vertical velocity gain than HCs under the vertical, slow, and fast Lissajous pursuit tasks (Cohen d = 0.55–0.62, P < .05). In addition, increased saccade amplitude (horizontal) and lower vertical velocity gain (slow Lissajous) were detected in the CHR-C group compared with the CHR-NC group (Cohen d = 0.51, P = .039; Cohen d = 0.67, P = .033).
Prediction of EM Measures for Psychosis Conversion
Cox regression with forward stepwise selection (likelihood ratio) was used to explore the EM variables associated with CHR conversion. Four EM measures differed between the CHR-C and CHR-NC groups were chosen as possible candidates, including the fixation duration and the saccade amplitude from the free-viewing test, the saccade amplitude from the Horizontal pursuit task, and the vertical velocity gain from the slow Lissajous pursuit task. The analysis reduced the 4 measures to 3, which were the fixation duration (β = 0.008, OR = 1.008, P = .004) and the saccade amplitude (β = −0.707, OR = 0.493, P = .001) from the free-viewing test, as well as the vertical velocity gain (β = −4.313, OR = 0.010, P = .018) from the slow Lissajous pursuit (supplementary materials, table S3).
Prediction Models
RFE combined with RF revealed that the model based on the 4 predictive features could achieve accurate predictions (supplementary materials, figure S1). Subsequently, we selected a specific subset of the 4 features based on their F-scores, namely the fixation duration and the saccade amplitude (the free-viewing test), the saccade amplitude (horizontal pursuit), and the vertical velocity gain (slow Lissajous pursuit), to construct a new dataset for subsequent modeling and analysis.
Upon performing grid search and cross-validation, the RF model’s optimal parameters were identified as follows: Num Trees: 300, Max Depth: 9, and Max Num Splits: 1. The performance of the model on the test data set is as follows: an accuracy of 0.776 (95% CI: 0.633, 0.882), a sensitivity of 0.800, a specificity of 0.769, and a ROC area of 0.854.
In addition, we also evaluated the predictive performance of EM variables combined with demographic and clinical data. The selected features included the above 4 EM variables, age, gender, education year, SOPS total, and subscale scores. Similarly, the data set was divided into a training data set (60%) and a test data set (40%). The hyperparameters were optimized with the following values: Num Trees: 300, Max Depth: 5, and Max Num Splits: 1. The RF model achieved an accuracy of 0.776 (95% CI: 0.634, 0.882), a sensitivity of 0.700, a specificity of 0.795, and a ROC area of 0.854 on the test set. Figure 2 displays the ROC curves of 2 classification models.
Fig. 2.
ROC curves of the prediction models. Eye movement data refers to a combination of 4 eye movement features. Eye movement, demographic, and clinical data refers to the 4 eye movement features, age, gender, education year, SOPS total score, and subscale scores.
Longitudinal Changes in EM Variables
A total of 114 participants (CHR-C: n = 12; CHR-NC: n = 67; HC: n = 35) underwent a 1-year follow-up for EM assessments, with a completion rate of 51.58% (114/221). Results from the linear mixed models revealed significant main effects of time in 3 EM variables, including the fixation number (β = 1.06, SE = 0.51, P = .040) and the saccade number (β = 1.05, SE = 0.53, P = .049) of the distracted fixation stability test, as well as the scan path length (β = −13.82, SE = 4.60, P = .003) from the free-viewing test.
Furthermore, there were significant group × time interaction effects from 1 year to baseline between the CHR-NC and HC groups in 3 EM measures, including the saccade amplitude (β = −0.71, SE = 0.26, P = .007) from the simple fixation stability test, the saccade amplitude (β = −0.64, SE = 0.19, P < .001) and the scan path length (β = −12.09, SE = 5.74, P = .037) from the free-viewing test. See supplementary materials, table S4 for the linear mixed effects of all EM measures.
The simple effects pairwise comparisons revealed a significant decrease in saccade amplitudes (simple fixation stability; free-viewing) within the CHR-NC group after 1 year from baseline (baseline—1 year: β = 0.64, SE = 0.16, P < .001; β = 0.70, SE = 0.12, P < .001, Bonferroni corrected). The scan path length of all 3 groups showed a significant reduction after 1 year (CHR-C: β = 21.30, SE = 8.08, P = .009; CHR-NC: β = 25.90, SE = 3.53, P < .001; HC: β = 13.80, SE = 4.67, P = .004, Bonferroni corrected) (figure 3).
Fig. 3.
Estimated marginal means of variables with significant interactions. Error bars indicate the standard error. Abbreviations: CHR, clinical high risk; CHR-C, CHR-Converters; CHR-NC, CHR-Non converters; FS(S), the fixation stability test (simple); FV, free-viewing test; HC, healthy controls.
Relationship Between Baseline EM Characteristics and Clinical Symptoms
With age, gender, and education years controlled and the false discovery rate corrected, only the general symptom score of the CHR-NC group was negatively correlated with the saccade velocity of the free-viewing test (r = −0.375, P < .001) (supplementary materials, tables S5–7).
Discussion
The present study demonstrated that free-viewing and smooth pursuit abnormalities were associated with the clinical progression of CHR, accentuating their potential utility as promising biomarkers. Furthermore, the performance of the EM-based prediction models was relatively outstanding, and the EM alterations of the CHR-C group remained relatively stable over the course of 1 year.
The role of fixation is to fix the image of the target stimulus in the fovea,26 examining the individual’s attentional control. Prior studies reported more and larger saccades in CHR,15,16 but in this study we observed an increase in saccade amplitude specifically within the CHR-NC group, implying that saccade abnormalities may not yet be evident in CHR-C at baseline. Furthermore, maintenance of fixation stability involved visual areas (V2 and V4)27 and visual processing and sensorimotor transformation,28 and abnormalities in these structures and functions have been reported in schizophrenia.29,30 Furthermore, maintaining stable fixations might mirror the visual field dependence ability and involve the visuospatial cognitive function, which was found to be impaired in CHR.31
The free-viewing task embodied visual search features32 and involved more complex cognitive processes than the other 2 paradigms,33 and the free-viewing mode was divided into the focal and the ambient modes.34 Our study found that the CHR-C group might adopt the focal mode, as evidenced by fewer fixations and saccades, prolonged fixation duration, shorter saccade amplitude and scan path length, which was consistent with previous studies.14–16 Of note, the fixation duration and the saccade amplitude also differed between the CHR-C and the CHR-NC groups. Similar to patients with schizophrenia,35 those at CHR might depend more on focal patterns for local scanning than global exploration.18 Reliance on the focal mode might be attributed to the impaired top-down attention mechanisms,36 and 1 study37 exploring mechanisms of lateralization of language function and auditory attention impairment in CHR suggested that the top-down attention mechanism of CHR might be impaired. Moreover, the ambient mode involved the dorsal visual pathway that was impaired in schizophrenia,38 which might also account for CHR’s reliance on focal scanning.
The smooth pursuit predicted the speed and direction of the target and adjusted the speed and amplitude of EMs to ensure that the target was positioned in the fovea central region of the retina.33 Partially aligning with prior findings,16,17 the CHR populations manifested increased saccade amplitudes and reduced velocity gain. Of note, the above alterations might vary depending on the trajectory of movement exhibited by the target stimulus. Reduced velocity gains meant a poorer ability to reconcile EM velocity and target speed,33 and larger saccade amplitudes implied a deficiency in saccade suppression.17 Abnormalities in brain structures such as area V5 (involved in motion perception)39 and frontal visual field (involved in target prediction)40 were associated with smooth pursuit deficits in schizophrenia. Structural abnormalities in the frontal lobe were also found among the CHR populations, which might be related to the observed abnormal smooth pursuits.17
Cox regression analysis found 3 predictors significantly associated with higher risk of psychosis conversion, including the fixation duration and the saccade amplitude of the free-viewing task, and the vertical velocity gain from the slow Lissajous pursuit. The confined scan pattern of free-viewing represented a broad defect in schizophrenia and contributed the most to distinguishing schizophrenia from HCs.41–43 This view corresponded to the current study: 2 predictors were derived from the free-viewing test.
Studies have highlighted the effectiveness of position and velocity gains obtained from the smooth pursuits in differentiating between schizophrenia patients and HCs. The calculation of EM variables is sensitive, so slight modifications to the paradigm location22,44 and velocity gains45 were effective in the diagnosis of schizophrenia. The sensitivity of EM variables meant that even minor changes to experimental conditions could significantly affect results,46 underscoring the need for more refined indicators to accurately detect biomarkers.
The prediction models constructed using the EM parameters performed well, with an accuracy of 0.776 and a ROC area of 0.854. The feature screening analysis showed that the 4 EM measures served as crucial factors in the prediction of clinical transition. The model in this study outperformed our previous prediction models,15 possibly due to different metrics and larger sample size, while also noting that a more sensitive and objective machine learning approach47 might help facilitate the discrimination.22 In short, the application of RFE for feature selection (note that these features differed between groups), coupled with dataset partitioning and cross-validation, oversampling techniques, and hyperparameter tuning collectively emphasized the robustness of the model in forecasting the evolution into psychosis.
As previous research has indicated,15 the model accuracy did not demonstrate a significant improvement upon the simultaneous inclusion of combined demographic, clinical, and EM variables. There are 3 explanations for the observed result: (a) EM-based models were relatively robust, (b) previous studies have shown that the demographic and clinical data were primarily predictive of outcomes 2–3 years later,48 so their predictability might not be evident during the 1-year follow-up period, and (c) it is plausible that the limited inclusion of demographic and clinical data might not have been adequate to enhance the predictive performance.
One major contribution of this study is the comprehensive analysis of how EM characteristics evolve over time, revealing valuable insights into the underlying dynamics. Despite the lack of EM follow-up results for CHR, schizophrenia research essentially explained the observed results. In partial agreement with the schizophrenia patients,49 the saccades of the simple fixation task of CHR-NC were temporally unstable, showing a decline after 1 year. Furthermore, the CHR-NC group also demonstrated a decrease in the saccade amplitude under the free-viewing task. Our Cox regression analysis showed that the saccade amplitude during the free-viewing task was a predictor in predicting conversion. As the study’s follow-up period was only 1 year, it is possible that this metric will be critical in identifying new CHR-C cases in future follow-ups.
In addition, the scan path length in all 3 groups showed a decline after 1 year, albeit with varying degrees, implying this metric showed variations across time, and this trend might reflect adjustments or adaptations in EM control and attention mechanisms within 1 year. The different degrees of change might be related to baseline EM characteristics, suggesting that this metric might play a significant role in disease progression. Notably, the smooth pursuit parameters displayed good temporal stability, thus strengthening the current view that this task could be used as endophenotypes.49
Importantly, 3 factors should be accounted for the interpretation of the above longitudinal changes: the small sample size of CHR-C, the comparison of changes at only 2-time points which might not exclude natural fluctuations, and potential selection bias due to certain CHR cases not completing the EM follow-up.50 Moreover, our findings demonstrated that the absence of significant longitudinal variations in other metrics for the CHR-C group suggested a relative stability in the EM impairments observed at baseline. In conclusion, EM impairments among CHR individuals were relatively stable over time, thereby bolstering the perspective that such aberrations were potential endophenotypic markers of schizophrenia.10
Several limitations need to be taken into account. Primarily, an incomplete follow-up assessment of EM might have introduced selection bias, reinforcing the need for larger sample sizes to validate future studies. Additionally, the predictive models in this investigation have not been externally validated, meriting future research to confirm their reproducibility across different data sets.
Conclusion
In summary, the aberrant manifestations of free-viewing and smooth pursuit were shown to be significantly correlated with the clinical transition among CHR individuals for psychosis, thereby highlighting their potential utility as accurate, presymptomatic biomarkers. Furthermore, it was observed that the EM anomalies within the CHR cohort exhibited sustained stability over the duration of 1 year. This study thus elucidates the plausibility and practicality of applying eye-tracking modalities for assessing the vulnerability of developing psychosis within a clinical context.
Supplementary Material
Supplementary material is available at https://academic.oup.com/schizophreniabulletin/.
Acknowledgments
The authors have declared that there are no conflicts of interest in relation to the subject of this study.
Contributor Information
Dan Zhang, Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China.
Lihua Xu, Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China.
Xu Liu, Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China.
Huiru Cui, Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China.
Yanyan Wei, Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China.
Wensi Zheng, Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China.
Yawen Hong, Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China.
Zhenying Qian, Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China.
Yegang Hu, Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China.
Yingying Tang, Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China.
Chunbo Li, Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China.
Zhi Liu, Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, PR China; School of Communication and Information Engineering, Shanghai University, Shanghai, PR China.
Tao Chen, Labor and Worklife Program, Harvard University, Cambridge, MA, USA; Big Data Research Lab, University of Waterloo, Waterloo, ON, Canada; Niacin (Shanghai) Technology Co., Ltd., Shanghai, PR China.
Haichun Liu, Department of Automation, Shanghai Jiao Tong University, Shanghai, PR China.
Tianhong Zhang, Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Engineering Research Center of Intelligent Psychological Evaluation and Intervention, Shanghai Jiaotong University School of Medicine, Shanghai, PR China.
Jijun Wang, Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China; CAS Center for Excellence in Brain Science and Intelligence Technology (CEBSIT), Chinese Academy of Science, Shanghai, PR China; Institute of Psychology and Behavioral Science, Shanghai Jiao Tong University, Shanghai, PR China.
Funding
This work was supported by the National Natural Science Foundation of China (82151314, 81901832, 81871050, 82171497, and 82101623); Clinical Research Plan of SHDC (SHDC2022CRD026, SHDC2020CR4066).
References
- 1. Yung AR, McGorry PD.. The initial prodrome in psychosis: descriptive and qualitative aspects. Aust N Z J Psychiatry. 1996;30(5):587–599. [DOI] [PubMed] [Google Scholar]
- 2. Collin G, Seidman LJ, Keshavan MS, et al. Functional connectome organization predicts conversion to psychosis in clinical high-risk youth from the SHARP program. Mol Psychiatry. 2020;25(10):2431–2440. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Nieman D, Becker H, van de Fliert R, et al. Antisaccade task performance in patients at ultra high risk for developing psychosis. Schizophr Res. 2007;95(1–3):54–60. [DOI] [PubMed] [Google Scholar]
- 4. Zhang T, Li H, Woodberry KA, et al. Prodromal psychosis detection in a counseling center population in China: an epidemiological and clinical study. Schizophr Res. 2014;152(2–3):391–399. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Wang L, Shi J, Chen F, et al. Family perception and 6-month symptomatic and functioning outcomes in young adolescents at clinical high risk for psychosis in a general population in China. PLoS One. 2015;10(9):e0138361. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Zhang T, Tang X, Li H, et al. Clinical subtypes that predict conversion to psychosis: a canonical correlation analysis study from the ShangHai At Risk for Psychosis program. Aust N Z J Psychiatry. 2020;54(5):482–495. [DOI] [PubMed] [Google Scholar]
- 7. Fusar-Poli P, Bonoldi I, Yung AR, et al. Predicting psychosis: meta-analysis of transition outcomes in individuals at high clinical risk. Arch Gen Psychiatry. 2012;69(3):220–229. [DOI] [PubMed] [Google Scholar]
- 8. Kegeles LS, Ciarleglio A, León-Ortiz P, et al. An imaging-based risk calculator for prediction of conversion to psychosis in clinical high-risk individuals using glutamate (1)H MRS. Schizophr Res. 2020;226:70–73. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Schmidt A, Cappucciati M, Radua J, et al. Improving prognostic accuracy in subjects at clinical high risk for psychosis: systematic review of predictive models and meta-analytical sequential testing simulation. Schizophr Bull. 2017;43(2):375–388. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Kacur J, Polec J, Smolejova E, Heretik A.. An analysis of eye-tracking features and modelling methods for free-viewed standard stimulus: application for schizophrenia detection. IEEE J Biomed Health Inform. 2020;24(11):3055–3065. [DOI] [PubMed] [Google Scholar]
- 11. Obyedkov I, Skuhareuskaya M, Skugarevsky O, et al. Saccadic eye movements in different dimensions of schizophrenia and in clinical high-risk state for psychosis. BMC Psychiatry. 2019;19(1):110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Caldani S, Bucci MP, Lamy JC, et al. Saccadic eye movements as markers of schizophrenia spectrum: exploration in at-risk mental states. Schizophr Res. 2017;181:30–37. [DOI] [PubMed] [Google Scholar]
- 13. Kleineidam L, Frommann I, Ruhrmann S, et al. Antisaccade and prosaccade eye movements in individuals clinically at risk for psychosis: comparison with first-episode schizophrenia and prediction of conversion. Eur Arch Psychiatry Clin Neurosci. 2019;269(8):921–930. [DOI] [PubMed] [Google Scholar]
- 14. Zhang D, Guo Q, Xu L, et al. The impact of COVID-19 pandemic on individuals at clinical high-risk for psychosis: evidence from eye-tracking measures. Prog Neuropsychopharmacol Biol Psychiatry. 2022;118:110578. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Zhang D, Xu L, Xie Y, et al. Eye movement indices as predictors of conversion to psychosis in individuals at clinical high risk. Eur Arch Psychiatry Clin Neurosci. 2023;273(3):553–563. [DOI] [PubMed] [Google Scholar]
- 16. Lyu H, St Clair D, Wu R, et al. Eye movement abnormalities can distinguish first-episode schizophrenia, chronic schizophrenia, and prodromal patients from healthy controls. Schizophr Bull Open. 2023;4(1):sgac076. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. van Tricht MJ, Nieman DH, Bour LJ, et al. Increased saccadic rate during smooth pursuit eye movements in patients at Ultra High Risk for developing a psychosis. Brain Cogn. 2010;73(3):215–221. [DOI] [PubMed] [Google Scholar]
- 18. Zhang T, Yang Y, Xu L, et al. Inefficient integration during multiple facial processing in pre-morbid and early phases of psychosis. World J Biol Psychiatry. 2022;23(5):361–373. [DOI] [PubMed] [Google Scholar]
- 19. Li D, Jin Y, Vandenberg SG, Zhu YM, Tang CH.. Report on shanghai norms for the Chinese translation of the Wechsler intelligence scale for children-revised. Psychol Rep. 1990;67(2):531–541. [DOI] [PubMed] [Google Scholar]
- 20. Yao S, Chen H, Jiang L, Tam WC.. Replication of factor structure of Wechsler Adult Intelligence Scale-III Chinese version in Chinese mainland non-clinical and schizophrenia samples. Psychiatry Clin Neurosci. 2007;61(4):379–384. [DOI] [PubMed] [Google Scholar]
- 21. McGlashan T, Walsh B, Woods S.. The Psychosis-risk Syndrome: Handbook for Diagnosis and Follow-up. New York: Oxford University Press; 2010. [Google Scholar]
- 22. Morita K, Miura K, Fujimoto M, et al. Eye movement as a biomarker of schizophrenia: using an integrated eye movement score. Psychiatry Clin Neurosci. 2017;71(2):104–114. [DOI] [PubMed] [Google Scholar]
- 23. Tabachnick BG, Fidell LS, Ullman JB.. Using Multivariate Statistics. Vol 5. Boston, MA: Pearson; 2007. [Google Scholar]
- 24. da Cunha Leme DE, De Oliveira C.. Machine learning models to predict future frailty in community-dwelling middle-aged and older adults: the ELSA cohort study. J Gerontol A Biol Sci Med Sci. 2023;78:2176–2184. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Leucht S, Samara M, Heres S, et al. Dose equivalents for second-generation antipsychotic drugs: the classical mean dose method. Schizophr Bull. 2015;41(6):1397–1402. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Tsitsi P, Benfatto MN, Seimyr G, Larsson O, Svenningsson P, Markaki I.. Fixation duration and pupil size as diagnostic tools in Parkinson’s disease. J Parkinsons Dis. 2021;11(2):865–875. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Pirdankar OH, Das VE.. Influence of target parameters on fixation stability in normal and strabismic monkeys. Invest Ophthalmol Vis Sci. 2016;57(3):1087–1095. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Macedo AF, Crossland MD, Rubin GS.. The effect of retinal image slip on peripheral visual acuity. J Vis. 2008;8(14):16.1–16.11. [DOI] [PubMed] [Google Scholar]
- 29. Hong LE, Turano KA, O’Neill HB, et al. Is motion perception deficit in schizophrenia a consequence of eye-tracking abnormality? Biol Psychiatry. 2009;65(12):1079–1085. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Mwansisya TE, Hu A, Li Y, et al. Task and resting-state fMRI studies in first-episode schizophrenia: a systematic review. Schizophr Res. 2017;189:9–18. [DOI] [PubMed] [Google Scholar]
- 31. Cui H, Giuliano AJ, Zhang T, et al. Cognitive dysfunction in a psychotropic medication-naïve, clinical high-risk sample from the ShangHai-At-Risk-for-Psychosis (SHARP) study: associations with clinical outcomes. Schizophr Res. 2020;226:138–146. [DOI] [PubMed] [Google Scholar]
- 32. Roux P, Brunet-Gouet E, Passerieux C, Ramus F.. Eye-tracking reveals a slowdown of social context processing during intention attribution in patients with schizophrenia. J Psychiatry Neurosci. 2016;41(2):E13–E21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Morita K, Miura K, Kasai K, Hashimoto R.. Eye movement characteristics in schizophrenia: a recent update with clinical implications. Neuropsychopharmacol Rep. 2020;40(1):2–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Ito J, Yamane Y, Suzuki M, et al. Switch from ambient to focal processing mode explains the dynamics of free viewing eye movements. Sci Rep. 2017;7(1):1082. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Sprenger A, Friedrich M, Nagel M, Schmidt CS, Moritz S, Lencer R.. Advanced analysis of free visual exploration patterns in schizophrenia. Front Psychol. 2013;4:737. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Gold JM, Fuller RL, Robinson BM, Braun EL, Luck SJ.. Impaired top-down control of visual search in schizophrenia. Schizophr Res. 2007;94(1–3):148–155. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Aase I, Kompus K, Gisselgård J, Joa I, Johannessen JO, Brønnick K.. Language lateralization and auditory attention impairment in young adults at ultra-high risk for psychosis: a dichotic listening study. Front Psychol. 2018;9:608. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Butler PD, Javitt DC.. Early-stage visual processing deficits in schizophrenia. Curr Opin Psychiatry. 2005;18(2):151–157. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Keedy SK, Ebens CL, Keshavan MS, Sweeney JA.. Functional magnetic resonance imaging studies of eye movements in first episode schizophrenia: smooth pursuit, visually guided saccades and the oculomotor delayed response task. Psychiatry Res. 2006;146(3):199–211. [DOI] [PubMed] [Google Scholar]
- 40. Levy DL, Sereno AB, Gooding DC, O’Driscoll GA.. Eye tracking dysfunction in schizophrenia: characterization and pathophysiology. Curr Top Behav Neurosci. 2010;4:311–347. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Zhang T, Xu Y, Li, Yu, Wang J.. The prospects for the clinical application of exploratory eye movement among patients with psychotic disorders. Gen Psychiatry. 2016;28:218–221. [Google Scholar]
- 42. Benson PJ, Beedie SA, Shephard E, Giegling I, Rujescu D, St Clair D.. Simple viewing tests can detect eye movement abnormalities that distinguish schizophrenia cases from controls with exceptional accuracy. Biol Psychiatry. 2012;72(9):716–724. [DOI] [PubMed] [Google Scholar]
- 43. Diamond A, Silverstein SM, Keane BP.. Visual system assessment for predicting a transition to psychosis. Transl Psychiatry. 2022;12(1):351. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Miura K, Hashimoto R, Fujimoto M, et al. An integrated eye movement score as a neurophysiological marker of schizophrenia. Schizophr Res. 2014;160(1–3):228–229. [DOI] [PubMed] [Google Scholar]
- 45. Lencer R, Sprenger A, Reilly JL, et al. Pursuit eye movements as an intermediate phenotype across psychotic disorders: evidence from the B-SNIP study. Schizophr Res. 2015;169(1–3):326–333. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46. Ziermans TB, Schothorst PF, Sprong M, Magnée MJ, van Engeland H, Kemner C.. Reduced prepulse inhibition as an early vulnerability marker of the psychosis prodrome in adolescence. Schizophr Res. 2012;134(1):10–15. [DOI] [PubMed] [Google Scholar]
- 47. Corcoran CM, Carrillo F, Fernández-Slezak D, et al. Prediction of psychosis across protocols and risk cohorts using automated language analysis. World Psychiatry. 2018;17(1):67–75. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48. Zhang T, Xu L, Tang Y, et al. Duration of untreated prodromal symptoms in a Chinese sample at a high risk for psychosis: demographic, clinical, and outcome. Psychol Med. 2018;48(8):1274–1281. [DOI] [PubMed] [Google Scholar]
- 49. Kallimani D, Theleritis C, Evdokimidis I, Stefanis NC, Chatzimanolis I, Smyrnis N.. The effect of change in clinical state on eye movement dysfunction in schizophrenia. Eur Psychiatry. 2009;24(1):17–26. [DOI] [PubMed] [Google Scholar]
- 50. Jahshan C, Heaton RK, Golshan S, Cadenhead KS.. Course of neurocognitive deficits in the prodrome and first episode of schizophrenia. Neuropsychology. 2010;24(1):109–120. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.



