Abstract
Background/Objective. This study aims to investigate how complex visuospatial neglect behavioural phenotypes predict long-term outcomes, both in terms of neglect recovery and broader functional outcomes after 6 months post-stroke. Methods. This study presents a secondary cohort study of acute and 6-month follow-up data from 400 stroke survivors who completed the Oxford Cognitive Screen’s Cancellation Task. At follow-up, patients also completed the Stroke Impact Scale questionnaire. These data were analysed to identify whether any specific combination of neglect symptoms is more likely to result in long-lasting neglect or higher levels of functional impairment, therefore warranting more targeted rehabilitation. Results. Overall, 98/142 (69%) neglect cases recovered by follow-up, and there was no significant difference in the persistence of egocentric/allocentric (X2 [1] = .66 and P = .418) or left/right neglect (X2 [2] = .781 and P = .677). Egocentric neglect was found to follow a proportional recovery pattern with all patients demonstrating a similar level of improvement over time. Conversely, allocentric neglect followed a non-proportional recovery pattern with chronic neglect patients exhibiting a slower rate of improvement than those who recovered. A multiple regression analysis revealed that the initial severity of acute allocentric, but not egocentric, neglect impairment acted as a significant predictor of poor long-term functional outcomes (F [9,300] = 4.742, P < .001 and adjusted R2 = .098). Conclusions. Our findings call for systematic neuropsychological assessment of both egocentric and allocentric neglect following stroke, as the occurrence and severity of these conditions may help predict recovery outcomes over and above stroke severity alone.
Keywords: visuospatial neglect, stroke, cognitive assessment, recovery, neuropsychology
Introduction
Visuospatial neglect is a common neuropsychological syndrome characterised by consistently lateralised perceptual deficits.1,2 The neglect syndrome is represented by a highly heterogeneous group of symptoms and contains many subtypes.3-5 Although visuospatial neglect is a common consequence of stroke, it is not yet clear whether different subtypes of neglect follow similar recovery trajectories or whether neglect subtypes are differentially associated with poor long-term functional outcomes.
The occurrence of post-stroke cognitive impairments has been strongly associated with reduced quality of life throughout recovery.6-9 However, not all cognitive deficits appear to affect quality of life and functional recovery to the same extent. Previous research has demonstrated that patients who experience visuospatial neglect following stroke are significantly more likely to report higher levels of functional impairment and lower quality of life than patients without visuospatial neglect impairment.6,7,10 This particularly robust effect has been documented across multiple different timepoints using a wide range of functional outcome measures. For example, Jehkonen et al.6 found that performance on the Behavioural Inattention Test was the single best predictor (compared to hemianopia, age and verbal memory) of poor functional outcome at 3-, 6- and 12-month follow-up appointments. Cherney et al.10 determined that higher neglect severity was predictive of lower Functional Independence Measure scores at admission, discharge and 3-month follow-up. Katz et al.7 found that acute neglect was associated with lower scores on various activities of daily living measurements as well as on standardised cognitive measures throughout the first 5 months following stroke. Similarly, Buxbaum et al.11 concluded that the occurrence of neglect deficits predicted poor recovery outcome following stroke over and above general stroke severity metrics. These findings demonstrate that the occurrence of visuospatial neglect acts as a significant predictor of functional recovery outcome.
However, neglect is not a unitary syndrome. Following stroke, patients can exhibit visuospatial neglect within a self-centred (egocentric) and/or object-centred reference frame (allocentric neglect).3,3,4,12-16 For example, a patient with egocentric neglect might fail to notice objects presented on their neglected side while a patient with allocentric neglect might fail to perceive features appearing on the neglected side of individual objects, regardless of where these objects are presented in space.17 While egocentric and allocentric neglect do frequently co-occur, these conditions have been demonstrated to represent doubly dissociated, independent cognitive impairments.3,14,18,19 Importantly, additional subtypes of neglect have been documented. Patients can selectively exhibit neglect within peri-personal (near space) and extra-personal space.20-23 Patients have also been found to exhibit spatial attentional biases in additional sensory modalities including auditory neglect24-26 and motor neglect.27-29 However, standardised neuropsychological tests which can reliably detect and differentiate between these additional neglect subtypes are not commonly employed in clinical environments.30-32 For this reason, this analysis will focus on exploring the recovery trajectories of egocentric and allocentric neglect. The present study aims to investigate only differences between egocentric and allocentric neglect with the implication being that if these two subtypes recover differentially, additional research will be needed to investigate whether these differences are also present within other subtypes of neglect.
Previous research has suggested that patients with egocentric and allocentric neglect may exhibit differing levels of functional impairment. Bickerton et al.3 found that patients with allocentric neglect scored significantly lower (e.g. worse functional performance) on the Barthel Index activities of daily life measurement33 compared to patients with egocentric neglect at a single, subacute timepoint. In this study, patients with both allocentric and egocentric neglect also reported significantly higher levels of depression on the Hospital Anxiety and Depression Scale than patients with either egocentric or allocentric neglect alone.3
Similarly, although neglect is most commonly thought of as a left-lateralised impairment occurring following unilateral right hemisphere damage, recent research has demonstrated that right-lateralised neglect impairments also frequently occur following stroke.34-39 Patients with left and right neglect may exhibit differing levels of functional impairment. Ten Brink et al.40 investigated the relationship between neglect lateralisation and performance on various cognitive and physical independence measures in a cohort of 335 acute stroke survivors. This study found that left-lateralised neglect impairment was more severe than right-lateralised neglect as assessed by both neuropsychological and observational measures. However, patients with right neglect exhibited lower scores on the Mini Mental State Examination41,42 than patients without neglect (potentially through a co-occurring language deficit) and were more likely to exhibit impaired balance than patients with left neglect.40 These findings suggest that the association between neglect and functional impairment may depend on the reference frame and lateralisation of neglect. However, these studies only employed data from a single timepoint acutely post-stroke.
Overall, previous studies which have tracked neglect recovery over time have found that the majority of neglect cases recover within the first 6 months following stroke.36,39,43 Nijboer et al.43 found that time post-stroke was a key and independent predictor of visuospatial neglect recovery, with 54% of patients recovering within the first 12 weeks and around 60% recovered within the first year. A subsequent study found that clinical characteristics including neglect severity, stroke severity, and severity of comorbid stoke deficits did not act as significant predictors of neglect recovery over the first 26 weeks following stroke.44 These studies provide important insights into the recovery trajectory of neglect as a whole, but do not distinguish between egocentric and allocentric neglect deficits. Several previous studies have investigated how different neglect subtypes recover over time. Stone et al.,39 in a group of 68 patients with neglect, found that neglect following right hemisphere damage (N = 34) was significantly slower to improve and less likely to fully recover than neglect following left hemisphere lesions (N = 34) over the first 6 months following stroke. Demeyere and Gillebert36 found that of the 160 patients with follow-up data 81% of egocentric neglect (11 impaired at follow up vs 55 impaired at the stage) and 71% of allocentric neglect cases (10 chronic vs 39 acute) recovered within 6 months following stroke. Overall, a high proportion of visuospatial neglect cases were found to spontaneously recover within the first 6 months following stroke,14,39 but this relationship may not be equivalently true for different neglect lateralisations and reference frames.
Previous research has suggested that some stroke-related deficits follow a proportional recovery rule in which the amount of improved function is proportional to the initial degree of function loss.45,46 However, it is not yet clear whether egocentric and allocentric visuospatial neglect follow this proportional recovery pattern.47,48 If neglect impairments follow a proportional recovery rule, neglect cases which are initially more severe should be less likely to fully recover than less severe cases.45,46 Conversely, if neglect does not follow a proportional recovery pattern, the initial severity of neglect would not be expected to differentiate between patients who do and do not recover over time. Similarly, it is important to investigate differences in rates of improvement over time across different neglect subtypes. For example, it is possible that patients with milder deficits improve gradually over time while patients with severe impairments do not experience any improvement. Alternatively, it is possible that all patients with neglect exhibit the same rate of change in severity over time, regardless of the severity of their initial deficits. It is therefore critically important to better characterise recovery trajectories in different neglect subtypes in order to identify the specific patients who are least likely to fully recover.
Previous investigations into neglect recovery trajectories have not considered the interaction between neglect subtype and lateralisation when attempting to elucidate the predictive relationships between these acute factors and long-term recovery outcomes. Here, for the first time, we present data from a large and representative longitudinal sample of stroke survivors to attempt to disentangle how complex acute neglect behavioural phenotypes predict longer-term recovery outcomes, both in terms of long-lasting neglect symptoms as well as broader functional outcomes related to activities of daily life and participation 6 months after stroke. The present study aims to investigate which specific attributes of acute neglect impairment are related to a low likelihood of neglect recovery 6 months later and which are associated with worse functional outcomes. Importantly, this study does not aim to develop a quantitative prognostic model, but instead to investigate whether specific neglect subtypes are differentially associated with lasting impairment and functional outcomes. This, in turn, may help identify which specific patients are the most likely to benefit from targeted rehabilitation strategies.
Materials and Methods
Participants
This project represents a secondary analysis of data collected within the Oxford Cognitive Screen (OCS),49 OCS-Tablet and OCS-Care50 studies from 2015–2019. These study protocols were reviewed and approved by the National Research Ethics Committee (UK) (References: 11/WM/0299, 14/LO/0648 and 12/WM/00335, respectively). Each study included acute cognitive screening (T1) and 6-month follow-ups (T2). Patients were included in this analysis if Cancellation Task data were available from both timepoints and they had completed the Stroke Impact Scale (SIS) at timepoint 2 (Figure 1). A total of 400 patients (mean age = 70.6 [SD = 12.2], 47% female, mean years of education = 12 years [SD = 2.78], 6% left handed) were included in this study. As reported by patient clinical notes, this sample included 322 ischemic, 57 haemorrhagic and 21 not reported stroke types (Figure 1). Lesion sides were reported as 197 right, 157 left, 29 bilateral and 17 not reported. The average stroke-test interval was 9.9 (SD = 11.9) and the average National Institutes of Health Stroke Scale (NIHSS) total scores was found to be 3.82 (SD = 3.94 and range = 0–22). Table 1 presents a full summary of demographic and stroke information for the patients in this study with and without significant neglect impairment.
Table 1.
Neglect (n = 142) | No Neglect (n = 258) | |
---|---|---|
Age (years) | 72.1 (12.6) | 69.8 (11.9) |
Percent female (%) | 47.90 | 46.50 |
Education (years) | 11.6 (2.5) | 12.2 (2.9) |
Percent left-handed (%) | 7.80 | 11.30 |
Stroke side | ||
Right | 58 | 76 |
Left | 42 | 76 |
Bilateral | 6 | 11 |
NR/Unknown | 36 | 95 |
Stroke type | ||
Ischemic | 89 | 158 |
Haemorrhagic | 14 | 34 |
NR | 39 | 66 |
Stroke/Test interval (days) | 9.4 (10.9) | 10.2 (12.3) |
NIHSS (Median (interquartile range)) | 3 (6) | 2 (4) |
Abbreviation: NR, not reported.
Due to the high exclusion rate within this secondary analysis (60.8%), a series of analyses were conducted to determine whether the included neglect sample was representative of the full acute cohort assessed. The proportion of patients with neglect within all acute patients (n = 1020, 44.5%) was found to be significantly higher than that within the included sample (n = 400, 35.5%) (X2 = 5.579 and P = .0182). However, there was no significant difference between the egocentric (t [265.79] = .627, P = .5312 and 95% CI = −.974 to 1.884) or allocentric (t [230.24] = .720, P = .472 and 95% CI = −.563 to 1.211) asymmetry scores between neglect patients who were and were not included in the final sample.
Procedures
The behavioural analyses conducted in this investigation aim to (1) determine which neglect factors predict presence of chronic neglect and (2) investigate the interaction between acute neglect type, lateralisation and severity with long-term SIS score. Data from standardised Cancellation Tasks and the SIS questionnaire were considered in this investigation. Participants completed either the OCS or Birmingham Cognitive Screen Cancellation Task3,51 in pen-and-paper format. These assessments are parallel versions of a standardised assessment aiming to detect egocentric and allocentric visuospatial neglect and do not aim to quantify additional neglect impairments (e.g. motor or auditory neglect). Each Cancellation Task consists of similarly structured search matrices containing complete, right-gap, and left-gap line drawings. In these tasks, patients were instructed to mark complete drawings while ignoring incomplete stimuli. Patients completed two practice trials and were given 3 minutes to complete the Cancellation Task. These Cancellation Tasks have been demonstrated to be sensitive and reliable measures for detecting and differentiating between allocentric and egocentric deficits3,36 (Figure 2). The SIS is a self-report questionnaire assessing stroke-specific functional outcome domains.52,53 This investigation employed version 3.0 of this scale, which includes 59 questions across 8 domains (physical weakness, memory, mood, communication, activities of daily living, mobility, affected hand and participation). Each question is responded to on a 5-level Likert scale. The SIS exhibits high test–retest validity, correlates strongly with other established measures and is sensitive to changes.35
Participants completed the Cancellation Task at timepoints 1 and 2. The presence of egocentric neglect is scored by subtracting the number of targets identified on the left from those on the right. Egocentric asymmetry more extreme than +3(left neglect)/−3(right neglect) in conjunction with total scores of less than 42/50 was considered to represent significant neglect impairment.36 Egocentric neglect severity was calculated though a centre of cancellation (CoC) score.38-40 This score was calculated by assigning each response a numerical weight according to its horizontal location,40 the average response weight determines the CoC. Allocentric neglect impairment was quantified by subtracting the number of right-gap and left-gap false positives. Allocentric asymmetry more extreme than −1 (right neglect) or 1 (left neglect) represents significant impairment.49 Allocentric severity is scored as the proportion of allocentric errors committed to number of targets successfully identified.
Participants also completed the SIS at timepoint 2. Total SIS score was calculated by formatting all Likert responses so that low scores represent poor outcomes (e.g. 1 = ‘could not do at all’ and 5 = ‘not difficult at all’) and subsequently summing all numeric responses.52 All data collected in this investigation have been made openly available on the Open Science Framework54 (https://osf.io/wm8v3/). This project adheres to STROBE reporting guidelines.
Statistical Analysis
All comparisons control for age, sex, stroke severity (NIHSS total), education and stroke side when applicable. First, two chi-squared tests were performed to determine whether the proportion of patients whose neglect impairment was unrecovered versus recovered at follow-up assessment was equivalent across neglect subtypes and lateralisations. Next, two t-tests (separately for egocentric and allocentric) were conducted to determine whether unrecovered patients initially had more severe impairments at T1. Finally, two repeated-measures ANOVAs (one for egocentric and allocentric) were performed to investigate whether the magnitude of the change in neglect severity between T1 and T2 is proportional for patients with different impairment lateralisation and with/without chronic neglect. Each ANOVA included presence/absence of chronic neglect, neglect lateralisation, age, sex, education and stroke severity (NIHSS total).
To investigate the second research question, a multiple regression was performed to determine the relationship between acute neglect severity and follow-up functional outcome (SIS score). This regression includes egocentric and allocentric severity, impairment lateralisation, age, sex, stroke severity, handedness and education as covariates and evaluates these metrics for co-linearity using Durbin–Watson testing and variance inflation factor analyses. Finally, an ANOVA was conducted to determine whether patients exhibiting different acute neglect subtypes/lateralisations reported significantly different follow-up SIS scores.
Results
Neglect Prevalence and Recovery
142/400 (35.5%) patients exhibited significant neglect at T1. 71 (50%) of these cases involved only egocentric neglect, 41 (28.9%) only allocentric and 30 (21.1%) cases involved co-occurring egocentric and allocentric impairments. 78 (54.9%) cases were left-lateralised, 57 (40.1%) impacted the right side of space and 7(4.9%) involved right and left deficits which co-occurred.18,55 There was a significant difference in stroke severity between patients with egocentric (mean NIHSS score = 4.22) and allocentric (mean NIHSS score = 11.96) in this sample (t[36.64] = −3.306, P = .002 and CI: −12.48 to 2.99). At follow-up, 98/142 (69%) neglect cases had fully recovered. There was no significant difference in the proportion of patients recovered between egocentric and allocentric neglect (X2[1] = .66 and P = .418). Similarly, there was no significant association between the lateralisation of neglect and probability of neglect recovery (X2[2] = .781 and P = .677) (Figure 3).
Patients with chronic egocentric neglect had significantly more severe acute impairment than those who recovered (t [34.933] = −2.288 and P = .028), suggesting that egocentric neglect follows a proportional recovery pattern. However, there was no difference in the severity of acute impairment between allocentric patients who did and did not recover (t[22.633] = −1.373 and P = .183), suggesting that allocentric neglect follows a non-proportional recovery pattern.
Within egocentric neglect, there was a significant main effect of neglect recovery outcome with more severe cases being less likely to recover than milder cases (F[1,190] = 18.311, P < .001 and ηp2 = .115). There was also a significant main effect of stroke severity (F [1,190] = 8.576, P = .004 and ηp2 = .54). However, no significant interaction effects were present between change in neglect severity over time and the presence of chronic neglect (F [1,190] = .003 and P = .985) or between neglect lateralisation and the presence of chronic neglect (F [1,190] = .2003 and P = .6556). These findings suggest that patients with egocentric neglect exhibit proportional recovery and that the rate of recovery is not different for patients with more and less severe neglect, regardless of lateralisation (see Figure 4).
Within allocentric neglect, there was a significant interaction effect of change in neglect severity between timepoints and the presence of chronic neglect (F [1,130] = 9.1927, P = .004 and ηp2 = .096), demonstrating that allocentric cases do not recover at the same rate. In this analysis, there was no significant main effect of stroke severity (F [1,130] = 3.65, P = .611 and ηp2 = .004). Finally, there was no significant interaction effect between lateralisation and the incidence of chronic neglect (F [1,130] = .136, P = .713 and ηp2 = .001), suggesting that patients with right and left allocentric neglect do recover at similar rates.
Which Factors Predict Chronic SIS Scores?
At the 6-month follow-up, patients reported an average SIS total score of 223/300 (SD = 44.3 and Range = 41–295), with lower scores indicating poorer outcome. A multiple regression was performed to investigate the relationship between neglect severity and functional outcome (SIS). This regression included egocentric and allocentric severity, impairment lateralisation, age, sex, stroke severity (NIHSS Score), handedness and education as covariates (max VIF = 1.28 and Durbin–Watson = 2.17). Overall, this model was found to be significant (F [9,300] = 4.742, P < .001 and adjusted R2 = .098, Figure 5). Acute allocentric neglect severity (P = .006 and Cohen’s f = .15) and stroke severity (P < .001 and Cohen’s f = .23) were found to be significant predictors of lower functional outcome. Notably, acute egocentric severity did not act as a significant predictor of long-term SIS (P = .217).
Finally, an ANOVA was conducted to investigate the interactions between acute neglect category/lateralisation and chronic SIS. There was a significant overall effect between neglect subtype and SIS score (F [9,300] = 2.918, P = .034 and ηp2 = .026). However, there were no significant post-hoc paired differences between different neglect categories (Figure 6).
Discussion
This study aimed to determine whether visuospatial neglect subtypes act as predictors of long-term outcomes, both with regards to neglect recovery and to broad functional outcomes. Egocentric and allocentric neglect occurred frequently in the acute stroke population and represented doubly dissociated conditions. Both left- and right-lateralised neglect deficits were common, and in line with expectations,40 left-lateralised neglect was more severe than right neglect. Egocentric neglect exhibited proportional recovery with the severity of acute impairment, predicting the severity of chronic impairment. However, allocentric neglect was not found to recover proportionally with a subset of patients remaining unchanged or getting worse over time, regardless of initial severity. The severity of acute allocentric, but not egocentric, neglect acted as a significant predictor of long-term functional outcome. These results highlight the importance of standardised, neuropsychological assessment of post-stroke visuospatial impairments to improve the sensitivity of neglect detection and provide quantitative severity information which can be used to predict functional outcome trajectory and guide intervention pathways.
The results of the present study suggest that egocentric neglect’s initial severity modulates the probability of its recovery. Egocentric patients who recovered had less severe acute neglect than patients presenting with chronic neglect at 6 months. Importantly, the rate of egocentric improvement was not different between patients whose impairments did and did not recover. This effect held for patients exhibiting right and left egocentric neglect and remained significant over and above generalised stroke severity. These findings align with previous studies documenting proportional recovery in egocentric neglect and suggesting that acute severity may be the best indicator of the probability of egocentric neglect recovery.39,45
However, proportional recovery was not found to be present within patients with allocentric neglect. Allocentric patients who recovered by 6 months were not initially less severely impaired than patients whose allocentric neglect did not recover. This pattern is characteristic of non-proportional recovery.46-48 This non-proportional recovery pattern within allocentric neglect aligns well with recent research suggesting that not all post-stroke impairments follow the proportional recovery rule.47,48 Additionally, unrecovered allocentric patients were found to exhibit a significantly different recovery rate than patients whose allocentric neglect did recover. Notably, although patients with allocentric neglect had significantly higher stroke severity than patients with egocentric neglect, stroke severity was not found to significantly predict which cases of allocentric neglect recovered over time. Considered cumulatively, these findings suggest that it is not yet clear how to predict which patients with allocentric neglect will and will not recover from their neglect impairment. Future research can aim to investigate the recovery of allocentric neglect in more detail, as it appears that this subtype of neglect is more likely to lead to a chronic neglect impairment. Similarly, it is important for future studies to aim to identify additional factors such as behavioural profile or co-morbid cognitive impairments which may help distinguish between allocentric neglect patients who do and do not spontaneously recover.
This investigation also considered the impact of neglect lateralisation and severity on functional outcome. With regards to lateralisation, interestingly, there was no significant difference in functional impairment levels reported by patients with right- and left-lateralised neglect despite the finding that left neglect was significantly more severe than right neglect on neuropsychological assessments. This effect has been previously identified,40 but it is not clear which factors are responsible for driving it. It seems plausible that right neglect may result in a disproportionally high impact on functional activity relative to impairment severity, as left hemisphere damage may be more likely to reduce the patient’s ability to use their dominant hand, and include language and communication impairments which may affect overall functional outcomes in a broad measure such as the SIS. Further research is needed to investigate this possibility in detail.
The quantitative severity of acute allocentric neglect impairment was found to act as a significant predictor of poor long-term functional outcome, while the severity of acute egocentric neglect was not. Patients with more severe allocentric neglect at the acute timepoint were found to report higher levels of domain-general functional impairment at chronic assessment, regardless of whether or not their neglect had recovered. This effect could potentially be explained by a comparatively severe impact of allocentric neglect impairment on daily life activities. Patients with egocentric neglect may be able to orient or adjust their environments to help compensate for their neglect, but it is unclear whether patients with allocentric-level deficits would benefit from similar compensation strategies. Similarly, allocentric neglect may impact performance within specific activities (e.g. reading individual words and identifying/manipulating objects) which may be comparatively unaffected by egocentric neglect. Additional research is needed to clarify how egocentric and allocentric neglect deficits differentially impact functional activities.
Considered cumulatively, the findings of this study emphasise the importance of employing standardised, neuropsychological assessments of neglect within clinical environments. Detecting and determining the severity of allocentric neglect can help identify patients which are least likely to spontaneously recover and are most likely to experience lower levels of functional outcome, but this impairment is not commonly screened for after stroke. However, many commonly used neglect assessments are not able to reliably detect allocentric neglect, resulting in the omission of information which can help identify patients likely to experience poorer functional outcomes. Implementing standardised administration of neuropsychological neglect assessments is critically important in order to sensitively detect neglect impairments, to assign quantitative neglect severity scores and to identify neglect patients who are most likely to benefit from targeted neglect-specific rehabilitation programmes.3,16,49 Based on the current data, neglect intervention research may need to focus on rehabilitation specifically for those with more severe neglect impairments and those with allocentric neglect.
This investigation also highlights the need for future neglect research to accurately represent the diversity of neglect behavioural impairments to produce generalisable findings. Studies which consider only a restricted subset of neglect impairment (e.g. restricting sample to only left egocentric neglect after right hemisphere damage) are likely not representative of neglect as a whole and as it presents in acute clinical settings. Differences in patient-inclusion criteria can help explain why many past investigations have provided conflicting findings pertaining to the prevalence,5,56,57 underlying neural mechanisms12,58,59 and functional impact of neglect impairment.6,7,10 Similarly, future investigations should aim to determine whether neglect uniformly impacts across all aspects of functional recovery or whether a single component of this broad, encompassing concept (e.g. activities of daily living and mood) may be responsible for driving the predictive relationship between neglect and poor functional outcome. It is therefore critically important for future neglect research to adequately represent this syndrome’s behavioural diversity as conceptualising neglect as a unitary syndrome rather than a cluster of interrelated impairments which may preclude valid conclusions about the disorder as a whole.
Most importantly, the findings of this investigation reveal that patients with allocentric neglect may represent a key group for research for targeted, neglect-specific rehabilitation. The vast majority of existing neglect rehabilitation strategies are designed to ameliorate the effects of egocentric neglect.60-62 It seems likely that many of these strategies would be ineffective for patients with allocentric impairment. For example, rehabilitation strategies such as prism adaptation help shift attention towards a neglected hemifield but would likely not impact an attentional bias which is not mediated by viewer-centred impairments.60 Pharmaceutical and transcranial stimulation based rehabilitation strategies may face similar challenges.62 However, some rehabilitation studies which could plausibly impact the severity of both egocentric and allocentric neglect have been proposed.62 Approaches based on phasic alerting,63 vestibular stimulation,64 neck muscle vibration65 or motor feedback training66 seem potentially appropriate for ameliorating allocentric neglect symptoms. However, the impact of these rehabilitation therapies on allocentric-level attentional biases have not yet been adequately investigated in large and representative samples of neglect patients. It is not clear how allocentric neglect impacts behaviour, and understanding this impact is likely a necessary precursor to identifying effective rehabilitation strategies.
Limitations
SIS scores are self-reported and are therefore vulnerable to response biases. In addition, some visuospatial neglect patients may also exhibit anosognosia.67 Nevertheless, this association may influence functional self-report data and lead to some underestimation of functional impairment levels. Given that this study is a secondary analysis, the large sample data came at the cost of detailed stroke and additional potentially informative data. For example, T1 functional assessments, tests for additional neglect signs (e.g. anosognosia), rehabilitation programme information, detailed stroke anatomy or diagnoses of additional neglect subtypes were not available. Additionally, the cohort included in this study demonstrated comparatively moderate to low overall stroke severity (average NIHSS = 3.8 and range = 0-22). Future research can aim to investigate whether the effects documented in this study can be generalised to more severe stroke.
Importantly, egocentric and allocentric neglect are not the only subtypes of visuospatial neglect. Given that this investigation demonstrated that egocentric and allocentric neglect may follow different recovery trajectories, it seems plausible that other neglect subtypes, not considered within this investigation, may be differentially associated with long-term recovery as well. Future research should therefore aim to elucidate the recovery trajectories associated with additional visuospatial neglect subtypes. Critically, this investigation aimed to determine predictors rather than causes of poor recovery outcome. The identified significant relationship between acute allocentric neglect and poor recovery outcome should therefore not be interpreted as a causal relationship but instead as a correlational effect which may help clinicians predict which patients may experience reduced functional outcome in later stroke recovery phases. A number of factors including overall stroke severity, age of onset, cognitive reserve and psychosocial factors have been shown to be significantly related to stroke recovery trajectories.68–70 For this reason, any individual factor noted here should not be understood as a stand-alone predictor of stroke recovery but instead as a factor which only explains a small portion of variance. Clinicians should therefore employ a holistic approach considering the impact multiple factors such as overall stroke severity, age of onset, co-morbid impairments, cognitive reserve and psychosocial factors rather than any one source of information to make informed prognoses. Importantly, this study does not aim to develop a quantitative prognostic model, but instead to investigate whether specific neglect subtypes are differentially associated with lasting impairment and functional outcomes.
Finally, the results of any individual analysis are determined by the specific combination of inclusion criteria, impairment definitions and outcome measures employed.71,72 Additional research employing multiverse analysis techniques is needed to determine the degree to which the findings of this investigation are robust and generalisable across many different potential patient groups and outcome measures (e.g. SIS sub-domains) (see Moore and Demeyere (Under Review)73).
Conclusion
The findings of this investigation illustrate that considering the subtype and quantitative severity of visuospatial neglect provides information which can be applied to identify patients who are more likely to end up living with chronic neglect. These findings highlight the need for standardised neuropsychological neglect assessments and for the development of allocentric-specific rehabilitation strategies.
Acknowledgements
We would like to express our sincere gratitude and admiration to the late Prof Glyn W Humphreys, who initiated the OCS work and led the OCS-Care study. The OCS study was supported by the National Institute for Health Research Clinical Research Network. We also acknowledge the contributions to data collection and curation for the OCS data made by Ms Ellie Slavkova, Ms Grace Chiu and Ms Romina Basting.
Footnotes
Author Contributions: Margaret J. Moore conducted analysis and drafted manuscript. Kathleen Vancleef aided in study design, analysis and manuscript preparation. M. Jane Riddoch set up data collection collaborations. Celine R. Gillebert conceived the study and aided in manuscript revision. Nele Demeyere conceived the study, coordinated data collection, assisted in analysis planning and revised the manuscript.
Declaration of Conflicting Interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was funded by Stroke Association UK awards to ND (TSA2015_LECT02; TSA 2011/02), MJM (SA PGF 18\100031), KV (TSA PDF 2017/03), the Wellcome Trust award to CRG (101253/A/13/Z) and was supported by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC) based at Oxford University Hospitals NHS Trust.
ORCID iDs
Margaret J. Moore https://orcid.org/0000-0001-6914-5978
Nele Demeyere https://orcid.org/0000-0003-0416-5147
References
- 1.Heilman KM, Valenstein E. Mechanisms underlying hemispatial neglect. Ann Neurol. 1979;5(2):166-170. doi: 10.1002/ana.410050210 [DOI] [PubMed] [Google Scholar]
- 2.Parton A, Malhotra P, Husain M. Hemispatial neglect. J Neurol Neurosurg Psychiatr. 2004;75(1):13-21. [PMC free article] [PubMed] [Google Scholar]
- 3.Bickerton W-L, Samson D, Williamson J, Humphreys W. Separating forms of neglect using the apples test: Validation and functional prediction in chronic and acute stroke. Neuropsychology. 2011;25(5):567-580. 10.1037/a0023501 [DOI] [PubMed] [Google Scholar]
- 4.Li D, Karnath H-O, Rorden C. Egocentric representations of space co-exist with allocentric representations: Evidence from spatial neglect. Cortex. 2014;58:161-169. doi: 10.1016/j.cortex.2014.06.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Stone SP, Halligan PW, Greenwood RJ. The incidence of neglect phenomena and related disorders in patients with an acute right or left hemisphere stroke. Age Ageing. 1993;22(1):46-52. doi: 10.1093/ageing/22.1.46 [DOI] [PubMed] [Google Scholar]
- 6.Jehkonen M, Ahonen J-P, Dastidar P, et al. Visual neglect as a predictor of functional outcome one year after stroke. Acta Neurol Scand. 2000;101(3):195-201. doi: 10.1034/j.1600-0404.2000.101003195.x [DOI] [PubMed] [Google Scholar]
- 7.Katz N, Hartman-Maeir A, Ring H, Soroker N. Functional disability and rehabilitation outcome in right hemisphere damaged patients with and without unilateral spatial neglect. Arch Phys Med Rehabil. 1999;80(4):379-384. doi: 10.1016/S0003-9993(99)90273-3 [DOI] [PubMed] [Google Scholar]
- 8.Langhammer B, Fugl-Meyer K, Sallstrom S, Sunnerhagen SK, Bushnik T, Stanghelle KJ. Activities of daily living and life satisfaction -what influence and predict outcomes? Sunnaas International Network (SIN) stroke study. Arch Phys Med Rehabil. 2016;97(10):e98. doi: 10.1016/j.apmr.2016.08.303 [DOI] [Google Scholar]
- 9.Nys GMS, van Zandvoort MJE, van der Worp HB, et al. Early cognitive impairment predicts long-term depressive symptoms and quality of life after stroke. J Neurol Sci. 2006;247(2):149-156. doi: 10.1016/j.jns.2006.04.005 [DOI] [PubMed] [Google Scholar]
- 10.Cherney LR, Halper AS, Kwasnica CM, Harvey RL, Zhang M. Recovery of functional status after right hemisphere stroke: Relationship with unilateral neglect. Arch Phys Med Rehabil. 2001;82(3):322-328. doi: 10.1053/apmr.2001.21511 [DOI] [PubMed] [Google Scholar]
- 11.Buxbaum LJ, Ferraro MK, Veramonti T, et al. Hemispatial neglect: Subtypes, neuroanatomy, and disability. Neurology. 2004;62(5):749-756. doi: 10.1212/01.WNL.0000113730.73031.F4 [DOI] [PubMed] [Google Scholar]
- 12.Chechlacz M, Rotshtein P, Humphreys GW. Neuroanatomical dissections of unilateral visual neglect symptoms: ALE meta-analysis of lesion-symptom mapping. Front Hum Neurosci. 2012;6:230. doi: 10.3389/fnhum.2012.00230 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Chechlacz M, Rotshtein P, Roberts KL, Bickerton W-L, Lau JKL, Humphreys GW. The prognosis of allocentric and egocentric neglect: Evidence from clinical scans. PLoS One. 2012;7(11):e47821. doi: 10.1371/journal.pone.0047821 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Demeyere N, Gillebert C. Dissociating ego- and allocentric neglect after stroke: Prevalence, laterality and outcome predictors. bioRxiv. Published online October 9, 2017:200386. doi: 10.1101/200386 [DOI]
- 15.Humphreys GW, Gillebert CR, Chechlacz M, Riddoch MJ. Reference frames in visual selection. Ann N Y Acad Sci. 2013;1296(1):75-87. doi: 10.1111/nyas.12256 [DOI] [PubMed] [Google Scholar]
- 16.Ota H, Fujii T, Suzuki K, Fukatsu R, Yamadori A. Dissociation of body-centered and stimulus-centered representations in unilateral neglect. Neurology. 2001;57(11):2064-2069. doi: 10.1212/WNL.57.11.2064 [DOI] [PubMed] [Google Scholar]
- 17.Driver J, Halligan PW. Can visual neglect operate in object-centred co-ordinates? An affirmative single-case study. Cogn Neuropsychol. 1991;8(6):475-496. doi: 10.1080/02643299108253384 [DOI] [Google Scholar]
- 18.Costello AD, Warrington EK. The dissociation of visuospatial neglect and neglect dyslexia. J Neurol Neurosurg Psychiatr. 1987;50(9):1110-1116. doi: 10.1136/jnnp.50.9.1110 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Cubelli R, Nichelli P, Bonito V, De Tanti A, Inzaghi MG. Different patterns of dissociation in unilateral spatial neglect. Brain Cognit. 1991;15(2):139-159. doi: 10.1016/0278-2626(91)90023-2 [DOI] [PubMed] [Google Scholar]
- 20.Committeri G, Piervincenzi C, Pizzamiglio L. Personal neglect: A comprehensive theoretical and anatomo-clinical review. Neuropsychology. 2018;32(3):269-279. doi: 10.1037/neu0000409 [DOI] [PubMed] [Google Scholar]
- 21.Committeri G, Pitzalis S, Galati G, et al. Neural bases of personal and extrapersonal neglect in humans. Brain. 2007;130(Pt 2):431-441. doi: 10.1093/brain/awl265 [DOI] [PubMed] [Google Scholar]
- 22.Ten Brink AF, Biesbroek JM, Oort Q, Visser-Meily JMA, Nijboer TCW. Peripersonal and extrapersonal visuospatial neglect in different frames of reference: A brain lesion-symptom mapping study. Behav Brain Res. 2019;356:504-515. doi: 10.1016/j.bbr.2018.06.010 [DOI] [PubMed] [Google Scholar]
- 23.Vallar G. Extrapersonal visual unilateral spatial neglect and its neuroanatomy. Neuroimage. 2001;14(1):S52-S58. doi: 10.1006/nimg.2001.0822 [DOI] [PubMed] [Google Scholar]
- 24.Guilbert A, Clément S, Senouci L, Pontzeele S, Martin Y, Moroni C. Auditory lateralisation deficits in neglect patients. Neuropsychologia. 2016;85:177-183. 10.1016/j.neuropsychologia.2016.03.024 [DOI] [PubMed] [Google Scholar]
- 25.Bellmann A, Meuli R, Clarke S. Two types of auditory neglect. Brain. 2001;124(Pt 4):676-687. doi: 10.1093/brain/124.4.676 [DOI] [PubMed] [Google Scholar]
- 26.Gutschalk A, Dykstra A. Auditory neglect and related disorders. Handb Clin Neurol. 2015;129:557-571. doi: 10.1016/B978-0-444-62630-1.00031-7 [DOI] [PubMed] [Google Scholar]
- 27.Laplane D, Degos JD. Motor neglect. J Neurol Neurosurg Psychiatr. 1983;46(2):152-158. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Punt TD, Riddoch MJ. Motor neglect: Implications for movement and rehabilitation following stroke. Disabil Rehabil. 2006;28(13-14):857-864. [DOI] [PubMed] [Google Scholar]
- 29.Triggs WJ, Gold M, Gerstle G, Adair J, Heilman KM. Motor neglect associated with a discrete parietal lesion. Neurology. 1994;44(6):1164-1166. [DOI] [PubMed] [Google Scholar]
- Evald L, Wilms I, Nordfang M. Assessment of spatial neglect in clinical practice: A nationwide survey. Neuropsychol Rehabil 2020;1-16. doi: 10.1080/09602011.2020.1778490. [DOI] [PubMed] [Google Scholar]
- Checketts M, Mancuso M, Fordell H, et al. Current clinical practice in the screening and diagnosis of spatial neglect post-stroke: Findings from a multidisciplinary international survey. Neuropsychol Rehabil 2020;1-32. doi: 10.1080/09602011.2020.1782946. [DOI] [PubMed] [Google Scholar]
- 32.Rabin LA, Paolillo E, Barr WB. Stability in test-usage practices of clinical neuropsychologists in the United States and Canada over a 10-year period: A follow-up survey of INS and NAN members. Arch Clin Neuropsychol. 2016;31(3):206-230. doi: 10.1093/arclin/acw007 [DOI] [PubMed] [Google Scholar]
- 33.Quinn TJ, Langhorne P, Stott DJ. Barthel index for stroke trials: Development, properties, and application. Stroke. 2011;42(4):1146-1151. doi: 10.1161/STROKEAHA.110.598540 [DOI] [PubMed] [Google Scholar]
- 34.Becker E, Karnath H-O. Incidence of visual extinction after left versus right hemisphere stroke. Stroke. 2007;38(12):3172-3174. doi: 10.1161/STROKEAHA.107.489096 [DOI] [PubMed] [Google Scholar]
- 35.Beis J-M, Keller C, Morin N, et al. Right spatial neglect after left hemisphere stroke: Qualitative and quantitative study. Neurology. 2004;63(9):1600-1605. doi: 10.1212/01.WNL.0000142967.60579.32 [DOI] [PubMed] [Google Scholar]
- 36.Demeyere N, Gillebert CR. Ego-and allocentric visuospatial neglect: Dissociations, prevalence, and laterality in acute stroke. Neuropsychology. 2019;33(4):490-498. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Lee BH, Kim E-J, Ku BD, et al. Cognitive impairments in patients with hemispatial neglect from acute right hemisphere stroke. Cogn Behav Neurol. 2008;21(2):73-76. doi: 10.1097/WNN.0b013e3181772101 [DOI] [PubMed] [Google Scholar]
- 38.Moore MJ, Vancleef K, Shalev N, Husain M, Demeyere N. When neglect is neglected: NIHSS observational measure lacks sensitivity in identifying post-stroke unilateral neglect. J Neurol Neurosurg Psychiatry. 2019;90:1070-1071. doi: 10.1136/jnnp-2018-319668 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Stone S, Patel P, Greenwood R, Halligan P. Measuring visual neglect in acute stroke and predicting its recovery: The visual neglect recovery index. J Neurol Neurosurg Psychiatry. 1992;55(6):431-436. doi: 10.1136/jnnp.55.6.431 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Ten Brink AFT, Verwer JH, Biesbroek JM, Visser-Meily JMA, Nijboer TCW. Differences between left- and right-sided neglect revisited: A large cohort study across multiple domains. J Clin Exp Neuropsychol. 2017;39(7):707-723. doi: 10.1080/13803395.2016.1262333 [DOI] [PubMed] [Google Scholar]
- 41.Folstein MF, Robins LN, Helzer JE. The mini-mental state examination. Arch Gen Psychiatr. 1983;40(7):812. [DOI] [PubMed] [Google Scholar]
- 42.Tombaugh TN, McIntyre NJ. The mini-mental state examination: A comprehensive review. J Am Geriatr Soc. 1992;40(9):922-935. [DOI] [PubMed] [Google Scholar]
- 43.Nijboer TCW, Kollen BJ, Kwakkel G. Time course of visuospatial neglect early after stroke: A longitudinal cohort study. Cortex. 2013;49(8):2021-2027. doi: 10.1016/j.cortex.2012.11.006 [DOI] [PubMed] [Google Scholar]
- 44.Nijboer TCW, Winters C, Kollen BJ, Kwakkel G. Impact of clinical severity of stroke on the severity and recovery of visuospatial neglect. PLoS One. 2018;13(7):e0198755. doi: 10.1371/journal.pone.0198755 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Marchi NA, Ptak R, Di Pietro M, Schnider A, Guggisberg AG. Principles of proportional recovery after stroke generalize to neglect and aphasia. Eur J Neurol. 2017;24(8):1084-1087. [DOI] [PubMed] [Google Scholar]
- 46.Smith M-C, Byblow WD, Barber PA, Stinear CM. Proportional recovery from lower limb motor impairment after stroke. Stroke. 2017;48(5):1400-1403. [DOI] [PubMed] [Google Scholar]
- 47.Hope TMH, Friston K, Price CJ, Leff AP, Rotshtein P, Bowman H. Recovery after stroke: Not so proportional after all? Brain. 2019;142(1):15-22. doi: 10.1093/brain/awy302 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Bonkhoff AK, Hope T, Bzdok D, et al. Bringing proportional recovery into proportion: Bayesian hierarchical modelling of post-stroke motor performance. Brain. 2019;143(7):2189-2206. doi: 10.1101/19009159 [DOI] [PubMed] [Google Scholar]
- 49.Demeyere N, Riddoch MJ, Slavkova ED, Bickerton W-L, Humphreys GW. The Oxford Cognitive Screen (OCS): Validation of a stroke-specific short cognitive screening tool. Psychol Assess. 2015;27(3):883-894. doi: 10.1037/pas0000082 [DOI] [PubMed] [Google Scholar]
- 50.Demeyere N, Sun S, Milosevich E, Vancleef K. Post-stroke cognition with the Oxford Cognitive Screen vs Montreal Cognitive Assessment: A multi-site randomized controlled study (OCS-CARE). AMRC Open Research. 2019;1(12):12. [Google Scholar]
- 51.Humphreys GW, Bickerton W-L, Samson D, Riddoch MJ. BCoS Cognitive Screen. https://dial.uclouvain.be/pr/boreal/object/boreal:111528. 2012. Accessed June 12, 2018. [Google Scholar]
- 52.Duncan PW, Lai SM, Bode RK, Perera S, DeRosa J. A brief assessment of physical function. Neurology. 2003;60:291-296. [DOI] [PubMed] [Google Scholar]
- 53.Duncan PW, Wallace D, Lai SM, Johnson D, Embretson S, Laster LJ. The stroke impact scale version 2.0. Evaluation of reliability, validity, and sensitivity to change. Stroke. 1999;30(10):2131-2140. doi: 10.1161/01.STR.30.10.2131 [DOI] [PubMed] [Google Scholar]
- 54.Foster ED, Deardorff A. Open Science Framework (OSF). J Med Libr Assoc. 2017;105(2):203-206. doi: 10.5195/jmla.2017.88 [DOI] [Google Scholar]
- 55.Humphreys GW, Riddoch MJ. Attention to within-object and between-object spatial representations: Multiple sites for visual selection. Cogn Neuropsychol. 1994;11(2):207-241. doi: 10.1080/02643299408251974 [DOI] [Google Scholar]
- 56.Bowen A, McKenna K, Tallis RC. Reasons for variability in the reported rate of occurrence of unilateral spatial neglect after stroke. Stroke. 1999;30(6):1196-1202. doi: 10.1161/01.STR.30.6.1196 [DOI] [PubMed] [Google Scholar]
- 57.Rorden C, Karnath H-O. A simple measure of neglect severity. Neuropsychologia. 2010;48(9):2758-2763. doi: 10.1016/j.neuropsychologia.2010.04.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Karnath H-O, Himmelbach M, Rorden C. The subcortical anatomy of human spatial neglect: Putamen, caudate nucleus and pulvinar. Brain. 2002;125(2):350-360. doi: 10.1093/brain/awf032 [DOI] [PubMed] [Google Scholar]
- 59.Karnath H-O, Rorden C. The anatomy of spatial neglect. Neuropsychologia. 2012;50(6):1010-1017. doi: 10.1016/j.neuropsychologia.2011.06.027 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Bowen A, Lincoln N. Cognitive rehabilitation for spatial neglect following stroke. Cochrane Database Syst Rev. 2013;2013(7): CD003586. doi: 10.1002/14651858.CD003586.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Ten Brink AFT, Visser-Meily JMA, Schut MJ, Kouwenhoven M, Eijsackers ALH, Nijboer TCW. Prism adaptation in rehabilitation? No additional effects of prism adaptation on neglect recovery in the subacute phase poststroke: A randomized controlled trial. Neurorehabil Neural Repair. 2017;31(12):1017-1028. doi: 10.1177/1545968317744277 [DOI] [PubMed] [Google Scholar]
- 62.Yang NYH, Zhou D, Chung RCK, Li-Tsang CWP, Fong KNK. Rehabilitation interventions for unilateral neglect after stroke: A systematic review from 1997 through 2012. Front Hum Neurosci. 2013;7:187. doi: 10.3389/fnhum.2013.00187 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Robertson IH, Mattingley JB, Rorden C, Driver J. Phasic alerting of neglect patients overcomes their spatial deficit in visual awareness. Nature. 1998;395(6698):169-172. doi: 10.1038/25993 [DOI] [PubMed] [Google Scholar]
- 64.Ruet A, Jokic C, Denise P, Leroy F, Azouvi P. Preliminary study using galvanic vestibular stimulation (GVS) to reduce unilateral spatial neglect (USN). Ann Phys Rehabil Med. 2013;56(suppl 1):e337. doi: 10.1016/j.rehab.2013.07.1081 [DOI] [PubMed] [Google Scholar]
- 65.Johannsen L, Ackermann H, Karnath H-O. Lasting amelioration of spatial neglect by treatment with neck muscle vibration even without concurrent training. J Rehabil Med. 2003;35(6):249-253. doi: 10.1080/16501970310009972 [DOI] [PubMed] [Google Scholar]
- 66.Rossit S, Benwell CS, Szymanek L, et al. Efficacy of home-based visuomotor feedback training in stroke patients with chronic hemispatial neglect. Neuropsychol Rehabil. 2019;29(2):251-272. [DOI] [PubMed] [Google Scholar]
- 67.Vossel S, Weiss PH, Eschenbeck P, Fink GR. Anosognosia, neglect, extinction and lesion site predict impairment of daily living after right-hemispheric stroke. Cortex. 2013;49(7):1782-1789. doi: 10.1016/j.cortex.2012.12.011 [DOI] [PubMed] [Google Scholar]
- 68.Colantonio A, Kasl SV, Ostfeld AM, Berkman LF. Psychosocial predictors of stroke outcomes in an elderly population. J Gerontol. 1993;48(5):S261-S268. [DOI] [PubMed] [Google Scholar]
- 69.Hankey GJ, Spiesser J, Hakimi Z, Bego G, Carita P, Gabriel S. Rate, degree, and predictors of recovery from disability following ischemic stroke. Neurology. 2007;68(19):1583-1587. [DOI] [PubMed] [Google Scholar]
- 70.Loewen SC, Anderson BA. Predictors of stroke outcome using objective measurement scales. Stroke. 1990;21(1):78-81. [DOI] [PubMed] [Google Scholar]
- 71.Steegen S, Tuerlinckx F, Gelman A, Vanpaemel W. Increasing transparency through a multiverse analysis. Perspect Psychol Sci. 2016;11(5):702-712. doi: 10.1177/1745691616658637 [DOI] [PubMed] [Google Scholar]
- 72.Dragicevic P, Jansen Y, Sarma A, Kay M, Chevalier F. Increasing the transparency of research papers with explorable multiverse analyses. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems; May 4–9, 2019; Glasgow, Scotland, UK:1-15. [Google Scholar]
- 73.Moore MJ, Demeyere N. Multiverse to inform neurological research: An example using functional impact of neglect. J Neurol 2021. doi: 10.1007/s00415-021-10612-8. [DOI] [PMC free article] [PubMed] [Google Scholar]