Skip to main content
VA Author Manuscripts logoLink to VA Author Manuscripts
. Author manuscript; available in PMC: 2023 Dec 1.
Published in final edited form as: J Occup Environ Med. 2022 Oct 3;64(12):e799–e804. doi: 10.1097/JOM.0000000000002706

Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) Clinical Normative Data for Gulf War Veterans

Mathew J Reinhard 1, Nathaniel Allen 1, Lucas E Crock 1, Kelly K McCarron 2, Gladys M Veltkamp 3, Ryan C Brewster 1
PMCID: PMC9729373  NIHMSID: NIHMS1835150  PMID: 36190917

Abstract

Objective

Heterogenous test batteries and methods applied in neurocognitive research on Gulf War Veterans (GWVs) limit the translation of findings to clinical practice. A clinical data set is necessary.

Methods

Neurocognitive screening data from treatment-seeking GWVs were collected from multiple sites and compiled, informed by consideration of performance validity.

Results

Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) scores revealed the cognitive profile for GWVs (n = 189) as poorer across multiple domains when compared to similarly educated, non-veteran peers. However, mean scores generally remained within normal clinical limits. Data tables are presented to establish a comparison group for use in clinical care.

Conclusions

When assessing cognitive symptoms in GWVs, attention to education level and interpretation of subtle deficits is warranted. Current results highlight the importance of nuanced translation of neurocognitive research findings into clinical practice with GWVs.

Keywords: Gulf War Illness, Veterans, Military, Cognitive, Neuropsychological

Introduction

Although it has been 30 years since Operations Desert Shield and Desert Storm (ODS/S), there is still a lack of consistent guidance regarding how to interpret Gulf War Veteran (GWV) cognitive profiles in a clinical setting. A preliminary study of neuropsychological data collected from a small sample of GWVs found that despite many cognitive complaints, the ODS/S group did not differ significantly from matched controls on standardized measures.1 However, an impairment index (i.e., the number of tests performed at least one standard deviation below the mean of the control group) showed that GWVs performed more poorly than controls. Other early papers studying cognitive concerns in this population were published in the Journal of the American Medical Association by the Iowa Persian Gulf Study Group (1997).2 In that issue, Haley, Kurt, and Hom reported the results of a factor analysis of self-reported symptoms that comprised a syndrome of “impaired cognition.”3 This syndrome was characterized by problems with attention, memory, reasoning, insomnia, depression, daytime sleepiness, and headaches. A separate syndrome of “confusion-ataxia,” characterized by problems with thinking, disorientation, balance disturbances, vertigo, and impotence and significant neuropsychological impairment in GWVs involving “abstraction, problem-solving, complex flexibility of thought, and intelligence” compared to controls was also detailed. They hypothesized that chronic neuropsychological impairment was a result of service-related neurotoxic injury.

Early reviews noted variability in the detection of cognitive dysfunction despite consistent self-reported cognitive complaints in this cohort. Significant methodological flaws and a lack of evidence for impairment were noted.46 Some studies have suggested that when psychiatric variables (e.g., posttraumatic stress disorder [PTSD] and depression) or multiple comparisons are accounted for, most group differences in cognitive functioning disappear.7,8 In contrast, other authors have presented evidence that PTSD does not influence cognitive outcomes in treatment seeking samples.9 Deployed GWVs have also demonstrated poorer scores compared to non-deployed GWVs in sustained attention and motor functioning overall, although the means for both groups were well within the normal range of functioning as defined by generally accepted clinical standards (i.e., 25th-75th percentile).10 The authors described depressive symptoms as a negative influence that affected sustained attention, but not motor function. A National Academy of Sciences report (2016) reviewed the neurocognitive and neurobehavioral research up to that point and concluded “there is inadequate/insufficient evidence to determine whether an association exists between deployment to the Gulf War and neurocognitive and neurobehavioral performance” (p. 138).11

However, a more recent meta-analysis on published GWV studies utilizing cognitive measures and found significantly decreased performances in several domains including attention, executive functioning, visuospatial skills, learning, and memory.12 A subsequent review expanded on these findings to suggest that deficits in neuropsychological and motor functioning may be exacerbated by chemical exposures and comorbid mood disorders.13 In addition, a higher-than-expected rate of mild cognitive impairment (MCI) and a related concern about high rates of dementia in later life for a sample of GWVs have been suggested.14

Given the somewhat equivocal findings highlighted in the extant literature above, clinicians treating GWVs with cognitive concerns are presented with a nebulous evidence base for clinical decision-making. Although cognitive deficits are thought by many to be a core feature of GWI, clinically derived neurocognitive data sets of widely used measures are unavailable. The objective of the current study is to provide useful clinical comparison group data of ODS/S deployed veterans presenting for care. Clinical group data is immediately translatable in applied settings and supports both individual case conceptualization and feedback to veterans about their cognitive performance compared to their treatment-seeking peers.

It is well known in the literature that GWVs report multiple comorbid conditions, many with potential to impact cognitive performance (e.g., pain, sleep apnea, insomnia, depression, PTSD, chronic fatigue).15 It is beyond the scope of the current study to investigate the contribution of multiple conditions on cognitive outcome in this population. Rather, the current aim is to provide a clinical profile of GWV patients as they are, enabling comparisons to other clinical groups (depression, dementia, Parkinson’s disease, etc.) as is often useful in clinical practice. The question of cognitive impairment can often be addressed by comparing individual performances on objective measures to data from a healthy normative population. However, it is also important to determine whether an individual veteran’s performance differs from what we might expect from the population of GWVs presenting for care. This information is currently unknown, is not available in existing meta-analytic research, and underscores the utility of a clinically-derived approach to data collection.

Methods

Participants

The current project was approved (#01719) by the Institutional Review Board at the Washington DC Veterans Affairs Medical Center and participants gave written informed consent to participate. Authors received no specific funding for this study. The current sample included 194 GWVs deployed to ODS/S. Participants were referred to the War Related Illness and Injury Study Center (WRIISC) between 2008–2018. Of note, more than 95% of the current sample includes participants assessed between 2013–2018. The WRIISC is a national program that has three locations at VA medical centers across the United States: Washington, DC, Palo Alto, CA, and East Orange, NJ. These centers provide comprehensive clinical assessments for unexplained symptoms, chronic multi-symptom illnesses, treatment-resistant illness, or injuries potentially related to environmental exposures during military deployment. Veterans from a catchment area encompassing all U.S. states and territories are referred to the appropriate WRIISC by VA healthcare providers. Veterans from all branches of the U.S. Armed Forces are evaluated at the WRIISC, contributing to a diverse sample (Table 1).

Table 1.

GWV Sample Characteristics

Demographics (N = 194)
Sex (Percentage) 23 F (12%), 171 M (88%)
Mean Age in Years (SD) 49.4 (6.06 years)
Age Range 34–68 years
Mean Years of Education (SD) 13.93 (2.35)
Education Years Completed
(Percentage of Sample)
<HS: 14 (7%)
HS: 50 (26%)
13–14: 51 (27%)
15–16: 43 (22%)
17–23: 31 (16%)
No response: 4 (2%)
Ethnicity
(Percentage of Sample)
Caucasian: 140 (72%)
African American: 19 (10%)
Native Americans: 15 (8%)
Hispanic: 10 (5%)
Native Americans: 6 (5%)
Native Hawaiian or Pacific Islander: 2 (1%)
Asian: 2 (1%)
Psychological Measures (N= 189) *
PHQ-8 14.64 (5.95)
PCL Total 36.83 (19.61)
NSI 41.34 (15.43)
CDS 57.40 (18.60)

Note: SD = Standard Deviation; SF-36 PCS = SF-36 Physical Component Score; SF-36 MCS = SF-36 Mental Component Score; PHQ-8 = Modified Patient Health Questionnaire; PCL = PTSD Checklist; NSI = Neurobehavioral Symptom Inventory.

*

Five cases excluded from analysis due to incomplete data.

Data Collection

Data was collected from clinical neuropsychology assessment reports written by neuropsychologists, post-doctoral psychology fellows supervised by neuropsychologists, or psychologists with post-doctoral training in neuropsychology across three sites in Washington, DC, East Orange, NJ, and Palo Alto, CA. All cognitive data were interpreted in the context of each GWVs clinical presentation, and all participants received a written report in their medical records and completed a clinical feedback appointment to discuss results. This information was then accessed retrospectively to build the current data set, which allows access to retrospective clinical interpretation decisions from reports, including behavioral observations, cognitive test performance including performance validity testing, and psychological/psychiatric data. The initial data set included all participants with complete Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) data.16 The RBANS Effort Index (EI) was then applied per the method described by Silverberg et al. and participants with poor EI scores were removed from the dataset.17 Cases were also excluded when neuropsychological reports described behavioral observation of suboptimal engagement, diminished effort, or poor scores on a variety of performance validity measures including the Test of Memory Malingering (TOMM),18 Victoria Symptom Validity Test (VSVT),19 Medical Symptom Validity Test (MSVT),20 WAIS-IV Reliable Digit Span (RDS),21 and Rey 15 Item Test (FIT).22 All participant data included a combination of these validity measures, but specific application varied across the sample due to individual clinician preference and clinical decision-making based on participant performance and presentation. GWVs that did not complete the full battery of psychological questionnaires were also excluded.

Gulf War Illness Classification

The current cohort consists of GWVs referred to WRIISC sites for multiple health complaints, including self-report of cognitive symptoms, limited to cases where complete RBANS data was available. From a clinical perspective, a formal medical/psychiatric GWI diagnostic classification or associated code does not currently exist. It is also important to note that there is no current consensus on GWI definition in the research literature. Of note, VA clinical case definition projects are underway, primarily utilizing WRIISC-collected data. However, to be accepted for a WRIISC evaluation, veterans must present with multiple chronic symptoms following military deployment that can include fatigue, headaches, joint pain, gastrointestinal symptoms, and cognitive concerns. It is likely that GWVs in the current clinical sample would meet IOM research criteria.23 However, the current cohort was derived from clinical cases, and no formal classification of Gulf War Illness (GWI) per Institute of Medicine (IOM) recommendations for research was conducted at the point of their care.

Measures of Cognitive and Emotional Functioning

Available neuropsychological data for GWVs were compiled from the three WRIISC sites. Only cases with complete data from the RBANS Form A16 were included in the current sample. The RBANS is a widely used screening battery that efficiently (20–30 minutes of administration time) assesses functioning with 12 subtests in five key cognitive domains: Attention, Immediate Memory, Delayed Memory, Visuospatial/Constructional, and Language. The RBANS normative sample was based on the 1995 USA Census percentage distributions for race/ethnicity, with roughly 80% Caucasian, 12% African American, and 6% Hispanic participants.24 This measure has previously demonstrated adequate reliability and convergent validity in multiple clinical samples.25,26 All RBANS measures were administered and scored using standardized procedures detailed in the most recent manual.27

The Neurobehavioral Symptom Inventory (NSI) is a measure of post-concussive symptoms (PCS) in rehabilitation settings and is a reliable and valid instrument for self-reported cognitive symptoms.28 The Cognitive Difficulties Scale (CDS) is a 38-item self-report measure of subjective complaints regarding immediate and delayed memory, attention, language, temporal orientation, and psychomotor abilities.29

Level of posttraumatic stress was evaluated with the use of the 17-item Posttraumatic Stress Disorder Checklist – Civilian Version (PCL-C).30 This Likert-type scale assesses symptoms of PTSD based on Diagnostic and Statistical Manual of Mental Disorders, 4th Edition criteria.31 The scale has high internal consistency, good test-retest reliability, and convergent and discriminant validity.32,33 Symptoms of depression were assessed with the Patient Health Questionnaire (PHQ-8), a widely used self-report measure which has demonstrated strong construct validity.34 Although this version of the measure excludes an item about suicidal ideation, it was demonstrated to have a very strong correlation (.998) with the original PHQ-9 that includes this item in a study of 1044 veterans.35 The potential for suicidal ideation was addressed in-person as part of routine clinical care with patients.

Statistical Analysis

Continuous variables in the current analyses were presented as means and standard deviations (SD). Categorical variables were expressed as percentages (%) and sample size (n). For comparative analyses, the index and subtest scores for the education-matched participants were compared via independent-samples t-tests with effect sizes (Cohen’s d) for each comparison. Pearson’s two-tailed correlation coefficients were calculated to study the relationships between RBANS scores, demographic variables, and clinical variables. Two-tailed p-values <0.05 were considered statistically significant.

Results

The RBANS EI excluded 14 of 212 (7%) cases. Four of the remaining 198 (2%) cases were removed from analyses following a review of neuropsychological reports that described poor performance on performance validity measures and/or suboptimal engagement per behavioral observations. Demographic data for the resulting GWV sample (n=194) are displayed in Table 1. An additional five cases were excluded from some analyses due to incomplete psychological questionnaires.

RBANS index scores were calculated using age-based norms. An overall RBANS GWV sample profile collapsed across age and education level was plotted (Figure 1). Compared to clinical samples with neurologic and psychiatric disorders described in the RBANS normative sample, the cognitive profile of the current sample is most similar to a subsample of 13 older adults (mean age 69.9) diagnosed with major depressive disorder (MDD).24 Notably, significant levels of depression in the GWV sample are reflected by the sample mean PHQ-8 score in Table 1. The total index score for the GWV group was 90.75 compared to 91.4 for the MDD group in the original RBANS sample. Other more impacted groups described in the manual including groups with Alzheimer’s disease or schizophrenia reported total index score means of 58.4 and 72.8 respectively.

Figure 1.

Figure 1.

RBANS Mean Index Scores for GWV sample (N=194).

To facilitate clinical normative comparisons with the original RBANS sample, GWV data was split into individuals with a high school education and individuals that completed greater than a high school education. Index scores were calculated using age-band norms appropriate to each participant. No statistically significant differences in cognitive functioning were noted when GWV participants were compared by education group (Table 2). However, GWVs with more years of formal education achieved better cognitive performance. Index and Total scores (i.e., standard scores) were all well within 1 SD of the mean. Comparing standard scores, GWVs demonstrated statistically significantly worse performance on most RBANS indices and total score when compared to their education-matched normative sample peers (Table 3). RBANS scores across age ranges are presented in Table 4.

Table 2.

GWV RBANS Performance Split by Education Level

HS or less
(N=64)
>12 years
(N=125)
Combined
(N=189)

RBANS Index Score Mean Score (SD) Mean Score (SD) Mean Score (SD)
 Immediate Memory Index 87.66 (16.98) 92.08 (15.60) 90.55 (16.23)
 Visuospatial Index 98.72 (16.53) 98.63 (17.37) 98.65 (17.08)
 Language Index 93.31 (10.16) 94.48 (7.80) 94.07 (8.70)
 Attention Index 89.99 (15.01) 90.57 (15.89) 90.37 (15.60)
 Delayed Memory Index 91.31 (16.21) 92.63 (16.12) 92.17 (16.16)
 Total Score Index 89.52 (12.91) 91.40 (13.68) 90.75 (13.45)

Note. RBANS Index scores are standardized, M = 100, SD = 15.

Table 3.

Comparison of RBANS Normative and GWV Samples on RBANS Index Scores

RBANS Normative
Sample Mean (SD)
Gulf War Normative
Sample Mean (SD)***
Effect
Size (d)

Education =Highschool
RBANS (N=187) (N=50)
  Immediate Memory Index 99.50 (15.80) 88.12 (16.75) 0.71**
  Visuospatial Index 99.00 (15.10) 96.70 (15.84) 0.15
  Language Index 98.20 (13.50) 92.54 (10.89) 0.45**
  Attention Index 98.40 (15.30) 89.12 (14.71) 0.61**
  Delayed Memory Index 98.90 (15.20) 90.94 (15.59) 0.52**
  Total Score Index 98.20 (14.50) 88.60 (12.56) 0.69**
Education >Highschool
RBANS (N=244) (N=125)
  Immediate Memory Index 104.20 (13.40) 92.08 (15.60) 0.82**
  Visuospatial Index 103.60 (14.10) 98.63 (17.37) 0.31**
  Language Index 105.60 (14.70) 94.48 (7.80) 0.96**
  Attention Index 104.50 (13.70) 90.57 (15.89) 0.92**
  Delayed Memory Index 103.80 (14.20) 92.63 (16.12) 0.72**
  Total Score Index 106.00 (13.50) 91.40 (13.68) 1.06**

Note:

*

= p < .05

**

= p < .01

***

14 cases that with less than a HS diploma not included in this analysis to allow for direct comparison to the RBANS sample.

Table 4.

GWV RBANS Performance Split by Age

34–44
(N=40)
45–59
(N=136)
60–68
(N=18)

RBANS Index Score Mean Score (SD) Mean Score (SD) Mean Score (SD)
 Immediate Memory Index 94.05 (16.42) 89.67 (15.82) 90.33 (18.83)
 Visuospatial Index 94.75 (18.03) 100.23 (16.36) 97.06 (20.23)
 Language Index 93.70 (7.68) 93.63 (9.08) 97.06 (8.99)
 Attention Index 90.08 (14.18) 90.38 (16.51) 90.17 (10.66)
 Delayed Memory Index 91.13 (18.88) 91.35 (15.41) 101.56 (12.57)
 Total Score Index 90.23 (13.84) 90.64 (13.51) 93.50 (12.52)

Note. RBANS Index scores are standardized, M = 100, SD = 15.

Post hoc analysis revealed that when all cases, including 18 participants that were found to have suboptimal effort per the RBANS EI and/or neuropsychology report review were included in analyses, the RBANS Total Index Score (i.e., Standard Score) for GWVs fell to 88.92 (SD = 14.45) (z-score −0.75). Isolating performance for just the group of 18 suspected sub-optimal effort cases was a Standard Score of 66.15, which is more than two standard deviations below the mean. There were no significant differences between education groups on the PCL, PHQ-8, the NSI, or CDS.

Correlation analyses were applied to assess the relationship between RBANS performance and both demographic variables and psychological health indicators. Years of education was not associated with RBANS Total Index score. Depressive symptoms (PHQ-8) were negatively associated with RBANS Total Index scores (r = −.218, p < .01), PCL Total scores (r = −.263, p < .01), the Cognitive Difficulties Scale (CDS) (r = −.235, p < .01), and scores on the Neurobehavioral Symptom Inventory (NSI) (r = −.311, p < .01).

Discussion

The current study informs and refines clinical care of GWVs by providing tailored clinical normative comparison data (Tables 23) for healthcare providers working with this unique population. The current results demonstrate that subtle but statistically significant cognitive differences across multiple cognitive indices exist regardless of education and GWVs perform significantly poorer than the similarly educated RBANS normative sample. However, GWV performance on cognitive measures generally remained within the Average/expected range of clinical classification.

It is possible that subtle cognitive changes in GWVs are emphasized when matching to a higher education civilian normative group, where improved cognitive performance is generally expected with increased education. When interpreting results in a clinical setting, a college-educated GWV scaled score that may initially appear normal (e.g., a standard score of 91.04) may reflect a significant discrepancy compared to education-matched healthy norms where an average standard score over 100 is common (Table 3), potentially reflecting a clinically significant decline in cognitive function. This 10+ point standard score difference may reflect cognitive symptoms commonly reported by GWVs.1 It is possible that GWVs are perceiving a subtle reduction in cognitive ability, however their performance on objective testing still appears within the “Average Range” and can be clinically considered “intact.” However, it is important to note when comparing treatment-seeking to normative samples, slightly poorer performance, which can be due to multiple variables associated with ill populations seeking help (i.e., coping with chronic disease, depression, pain, fatigue) is expected.

Results partially support the findings of Janulewicz et al., whose meta-analytic effort was an important step towards ameliorating the significant heterogeneity in tests and methods that preceded their study.12 The advantage of current study is homogeneity of methods across the entire study sample and age-correction of raw scores that allowed for direct comparison to the original normative test sample. Meta-analytic studies have inherent bias that cannot be avoided (i.e., publication bias in that studies that tend to show significant findings tend get published). Our findings revealed statistically significant but subtle differences which may otherwise go unnoticed in some clinical settings, given that results generally fall within one standard deviation from the mean, which is commonly considered “normal” performance. While our results may reflect important deviations, they do not support multiple studies that suggest pronounced and clinically significant cognitive impairment across multiple domains of functioning for GWVs.13 Our findings do not indicate cognitive impairment in GWVVs. Some previous studies that included data from neurocognitive measures in the GWV population did not describe efforts to assess and exclude cases based on performance validity. As recommended in a recent review of the GWV neuropsychological literature, the current study included effort measures to allow for the exclusion of cases with less-than-optimal effort, increasing the validity of our data. Our post-hoc analysis suggests that identifying and excluding profiles with validity concerns could influence conclusions about cognitive deficits that appear in the published literature.

Although the scope of the current study was not intended to determine a specific etiology for any cognitive differences in this population, it is notable that the overall RBANS neurocognitive profile for the GWV sample is most consistent with a small subgroup of older adults (mean age 70 years) diagnosed with major depressive disorder selected from the RBANS normative sample (Figure 1). Although the small size (13 participants) of this subsample should be underscored as a major limitation and there are other important differences between this subsample and the present sample that limit direct comparison (e.g., mean age difference and differing levels of comorbidity and diagnostic complexity between groups), recent studies have found that the RBANS is sensitive to the neuropsychological deficits found in current and remitted depression.36,37 In addition, a comparison between depressed deployed and non-deployed GWVs found deployed veterans had significantly higher rates of comorbid cognitive dysfunction than non-deployed controls.38 Although the potential for depressive symptoms to go underreported or misattributed to other deployment-related concerns in this population has previously been discussed,39 the possible contribution of specific GW exposures (e.g., organophosphate pesticides) to cognitive and emotional functioning (e.g., mood complaints should also be considered.40

Given that myalgic encephalomyelitis/chronic fatigue syndrome, fibromyalgia, and irritable bowel syndrome are medical conditions that fall under the umbrella of Gulf War Illness and are each independently associated with cognitive dysfunction, it is important to note that the present findings are also somewhat consistent with the literature on cognitive functioning in these conditions. Chronic fatigue syndrome is known to be associated with difficulties in attention, memory, and reaction time, including decreased cognitive capacity following physical exercise, and some of these difficulties may be more apparent subjectively to the patient than on formal neurocognitive testing.4143 Fibromyalgia is known to be associated with difficulties in concentration, pain attention, wakefulness, effort, working memory, episodic memory, semantic memory, verbal fluency, and executive function.44 Irritable bowel syndrome has been conceptualized as a microbiome-gut-brain axis disorder that can include neuropsychiatric manifestations such as mood disorders, anxiety, and cognitive symptoms.45 These findings highlight the importance of addressing cognitive concerns as part of routine clinical care for veterans with chronic multisymptom illnesses.

Current results cannot be interpreted as a complete neurocognitive profile for GWVs, or an adequate substitution for data from a more comprehensive evaluation, especially given that the RBANS is intended to be a screening measure and normative data for some RBANS measures (e.g., Line Orientation and List Recall) is non-normally distributed. In addition, direct measurement of executive functioning, an especially sensitive domain of cognitive functioning that requires careful assessment and nuanced interpretation, is difficult with current RBANS subtests. A method of analyzing errors on the RBANS to assess for executive dysfunction has been developed, but this approach is not yet established as a replacement for more direct measures of this complex construct.46 In addition, as the RBANS can be completed in less than an hour, certain concerns common in this population fluctuate and may not present during the short window during which the GWV is being assessed (e.g., cognitive fatigue may require longer than 30 minutes to manifest). A common data elements (CDE) project for research measures has recently been completed, which may further address current heterogeneity in cognitive testing that may have confounded previous efforts to study neuropsychological differences in this population.47 Although the RBANS was not included in recommended research CDEs, the current data can refine RBANS utility for neuropsychological assessment of GWVs given its widespread use in neuropsychology clinics. It is also our opinion that future GWV research CDEs include the RBANS to support translational study of GWI where bedside findings also influence research measurement. An additional limitation of the current study is the lack of a GWV comparison group. Although control participant inclusion was limited by the clinical nature of the current setting, a comparison to GWVs that denied cognitive or emotional symptoms as opposed to published norms could have significantly strengthened current conclusions about subtle differences in cognitive functioning. Despite these limitations, results suggest that the RBANS may be sensitive enough to detect subtle cognitive differences in the GWV population, especially in individuals with greater than high school education, where better performance is expected. Current findings are in line with research describing the utility of neurocognitive screening in some difficult to diagnose populations such as older adults with mild cognitive impairment and support previous work suggesting that the RBANS is an effective screening tool with a range of populations.48 Similar normative data tables from these studies have also been presented for clinical utility.49,50 The clinical profile presented in the current study may aid interpretation of impaired performance beyond what would be expected from GWVs. Current results from a widely-used screening instrument suggest some evidence against expectations of severe impairment of cognitive functioning in GWVs with multiple concerns, at least in domains excluding executive functioning. This may be helpful in reducing concerns about and misinterpretations of dementia as a direct manifestation of common GWV exposures. Clinical data is an educational tool that can help explain significant cognitive decline to patients and their families and can assist with false attribution errors (e.g., Gulf War Illness vs. early-onset dementia).

Possible relationships between exposures sustained during the Gulf War, differences in brain morphology, emotional distress, and MCI as GWVs age have been explored in recent GWV studies14. As GWVs represent a closed cohort from a specific point in history, the cognitive age-corrected profile presented in the current study may serve as a useful yardstick comparison for future studies continuing this line of investigation into potential decline beyond what might be expected with normal aging (e.g., further exploration of factors related to a suggested trend towards earlier onset of MCI in this cohort). Additionally, post-9/11 veterans present with high rates of environmental exposure concerns and a chronic multisymptom illnesses that include cognitive concerns.51 Thus, findings from GWVs may be beneficial for post-9/11 veterans as well. Further inquiry into how particular comorbidities (e.g., fatigue, sleep disorder diagnoses, chronic pain) contribute to specific aspects of cognitive outcome could help further refine clinical decision-making and feedback at a more granular level.

Footnotes

Conflicts of Interest for All Authors: None Declared. The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the United States government. There are no financial, consultant, institutional, or other conflicts of interest to disclose. The manuscript below has not been published elsewhere and it has not been submitted simultaneously for publication in another source.

Ethical Considerations & Disclosure: The current project was approved (#01719) by the Institutional Review Board at the Washington DC Veterans Affairs Medical Center and participants gave written informed consent to participate.

References

  • 1.Goldstein G, Beers SR, Morrow LA, Shemansky WJ, & Steinhauer SR (1996). A preliminary neuropsychological study of Persian Gulf veterans. Journal of the International Neuropsychological Society, 2, 368–371. 10.1017/S1355617700001399 [DOI] [PubMed] [Google Scholar]
  • 2.Iowa Persian Gulf Study Group (1997). Self-reported illness and health status among Gulf War veterans: A population-based study. Journal of the American Medical Association, 277, 238–245. 10.1001/jama.277.3.238 [DOI] [PubMed] [Google Scholar]
  • 3.Haley RW, Kurt TL, & Hom J (1997). Is there a Gulf War Syndrome? Searching for syndromes by factor analysis of symptoms. Journal of the American Medical Association, 277, 215–222. 10.1001/jama.1997.03540270041025 [DOI] [PubMed] [Google Scholar]
  • 4.Axelrod BN, and Milner Boaz. (2000). Gulf war illness research: Separating the wheat from the chaff. The Clinical Neuropsychologist, 14, (3), 344–348. 10.1076/1385-4046(200008)14:3;1-P;FT344 [DOI] [PubMed] [Google Scholar]
  • 5.Bieliauskas LA, and Turner RS (2000). What Persian gulf syndrome?. The Clinical Neuropsychologist, 14, (3), 341–343. 10.1076/1385-4046(200008)14:3;1-P;FT341 [DOI] [PubMed] [Google Scholar]
  • 6.Vasterling JJ, Brailey K, Tomlin H, Rice J, and Sutker PA (2003). Olfactory functioning in Gulf War-era veterans: Relationships to war-zone duty, self-reported hazards exposures, and psychological distress. Journal of the International Neuropsychological Society, 9, 407–418. 10.1017/S1355617703930062 [DOI] [PubMed] [Google Scholar]
  • 7.David AS, Farrin L, Hull L, Unwin C, Wessely S, and Wykes T. 2002. Cognitive functioning and disturbances of mood in UK veterans of the Persian Gulf War: A comparative study. Psychological Medicine 32(8):1357–1370. 10.1017/S0033291702006359 [DOI] [PubMed] [Google Scholar]
  • 8.White RF, Proctor SP, Heeren T, Wolfe J, Krengel M, Vasterling J, Lindem K, Heaton KJ, Sutker P, and Ozonoff DM. 2001. Neuropsychological function in Gulf War veterans: Relationships to self-reported toxicant exposures. American Journal of Industrial Medicine 40(1):42–54. 10.1002/ajim.1070 [DOI] [PubMed] [Google Scholar]
  • 9.Sullivan K, Krengel M, Proctor SP, Devine S, Heeren T, & White RF (2003). Cognitive functioning in treatment-seeking Gulf War veterans: Pyridostigmine bromide use and PTSD. Journal of Psychopathology and Behavioral Assessment, 25(2), 95–103. 10.1023/A:1023342915425 [DOI] [Google Scholar]
  • 10.Toomey R, Alpern R, Vasterling JJ, Baker DG, Reda DJ, Lyons MJ, Henderson WG, Kang HK, Eisen SA, and Murphy FM. (2009). Neuropsychological functioning of US Gulf War veterans 10 years after the war. Journal of the International Neuropsychological Society 15(5):717–729. 10.1017/S1355617709990294 [DOI] [PubMed] [Google Scholar]
  • 11.National Academies of Sciences, Engineering, and Medicine 2016. Gulf War and Health: Volume 10: Update of Health Effects of Serving in the Gulf War, 2016.Washington, DC: The National Academies Press. 10.17226/21840. [DOI] [PubMed] [Google Scholar]
  • 12.Janulewicz PA, Krengel MH, Maule A, White RF, Cirillo J, Sisson E, et al. (2017) Neuropsychological characteristics of Gulf War illness: A meta-analysis. PLoS ONE 12(5): e0177121. 10.1371/journal.pone.0177121 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Jeffrey MG, Krengel M, Kibler J, Zundel C, Klimas NG, Sullivan K, & Craddock TJ (2019). Neuropsychological Findings in Gulf War Illness: A Review. Frontiers in Psychology, 10, 2088. 10.3389/fpsyg.2019.02088 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Chao LL (2020). The Prevalence of Mild Cognitive Impairment in a Convenience Sample of 202 Gulf War Veterans. International Journal of Environmental Research and Public Health, 17(19), 7158. 10.3390/ijerph17197158 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Dursa EK, Barth SK, Schneiderman AI, and Bossarte RM. 2016. Physical and mental health status of Gulf War and Gulf era veterans. Journal of Occupational and Environmental Medicine 58(1):41–46. 10.1097/JOM.0000000000000627 [DOI] [PubMed] [Google Scholar]
  • 16.Randolph C (1998). Repeatable battery for the assessment of neuropsychological status manual. San Antonio, TX: The Psychological Corporation. [Google Scholar]
  • 17.Silverberg ND, Wertheimer JC, & Fichtenberg NL (2007). An effort index for the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS). The Clinical Neuropsychologist, 21(5), 841–854. 10.1080/13854040600850958 [DOI] [PubMed] [Google Scholar]
  • 18.Tombaugh TN (1997). The Test of Memory Malingering (TOMM): Normative data from cognitively intact and cognitively impaired individuals. Psychological Assessment, 9(3), 260. [Google Scholar]
  • 19.Slick D, Hopp G, Strauss E, & Thompson G (1997). The Victoria symptom validity test. Odessa, FL: Psychological Assessment Resources, 10, 01688639608408313. [Google Scholar]
  • 20.Green P (2004). Medical Symptom Validity Test (MSVT) for microsoft windows: User’s manual. Paul Green Pub. [Google Scholar]
  • 21.Larrabee GJ (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17(3), 410–425. [DOI] [PubMed] [Google Scholar]
  • 22.Rey A 1964. L’examen clinique en psychologie, Paris: Presses Universitaires de France. [Google Scholar]
  • 23.Fukuda K, Nisenbaum R, Stewart G, et al. (1998). Chronic Multisymptom Illness Affecting Air Force Veterans of the Gulf War. JAMA, 280(11), 981–988. 10.1001/jama.280.11.981 [DOI] [PubMed] [Google Scholar]
  • 24.Randolph C (2008). Repeatable battery for the assessment of neuropsychological status (RBANS) Supplement 1. Perason Education, Chicago, IL. [Google Scholar]
  • 25.Mckay C, Casey J, Wertheimer J, & Fichtenberg N (2007). Reliability and validity of the RBANS in a traumatic brain injured sample. Archives of Clinical Neuropsychology, 22(1), 91–98. 10.1016/j.acn.2006.11.003 [DOI] [PubMed] [Google Scholar]
  • 26.Wilk CM, Gold JM, Bartko JJ, Dickerson F, Fenton WS, Knable M, Randolph C, & Buchanan RW (2002). Test-retest stability of the repeatable battery for the assessment of neuropsychological status in schizophrenia. American Journal of Psychiatry, 159(5), 838–844. [DOI] [PubMed] [Google Scholar]
  • 27.Randolph C (2012). Repeatable battery for the assessment of neuropsychological status update (RBANS® update). San Antonio, TX: The Psychological Corporation. [Google Scholar]
  • 28.Cicerone KD, & Kalmar K (1995). Persistent postconcussion syndrome: the structure of subjective complaints after mild traumatic brain injury. The Journal of head trauma rehabilitation, 10, 1–17. [Google Scholar]
  • 29.McNair DM, & Kahn RJ (1983). Self-assessment of cognitive deficits. Assessment in geriatric psychopharmacology, 137, 143. [Google Scholar]
  • 30.Weathers FW, Litz BT, Huska JA, & Keane TM (1994). The PTSD Checklist–Civilian Version (PCL–C) for DSM-IV. Boston: National Center for PTSD. Behavioral Science Division. VA Boston Healthcare System. Psychological reports, 105, 1248–1254. [Google Scholar]
  • 31.American Psychiatric Association (2000). Diagnostic and statistical manual of mental disorders (4th ed., Text Revision). Washington, DC: Author. [Google Scholar]
  • 32.Ruggiero KJ, Ben KD, Scotti JR, & Rabalais AE (2003). Psychometric properties of the PTSD checklist—civilian version. Journal of Traumatic Stress, 16(5), 495–502. doi: 10.1023/a:1025714729117 [DOI] [PubMed] [Google Scholar]
  • 33.Pratt EM, Brief DJ, & Keane TM (2006). Recent advances in psychological assessment of adults with posttraumatic stress disorder. Cognitive-behavioral therapies for trauma, 2, 34–61. [Google Scholar]
  • 34.Kroenke K, Strine TW, Spitzer RL, Williams JB, Berry JT, Mokdad AH: The PHQ-8 as a measure of current depression in the general population. J Affect Disord. 2009, 114: 163–173. 10.1016/j.jad.2008.06.026. [DOI] [PubMed] [Google Scholar]
  • 35.Corson K, Gerrity MS, & Dobscha SK (2004). Screening for depression and suicidality in a VA primary care setting: 2 items are better than 1 item. Am J Manag Care, 10(11 Pt 2), 839–845. [PubMed] [Google Scholar]
  • 36.Faust K, Nelson BD, Sarapas C, & Pliskin NH (2017). Depression and performance on the repeatable battery for the assessment of neuropsychological status. Applied Neuropsychology: Adult, 24(4), 350–356. 10.1080/23279095.2016.1185426 [DOI] [PubMed] [Google Scholar]
  • 37.Cambridge OR, Knight MJ, Mills N, & Baune BT (2018). The clinical relationship between cognitive impairment and psychosocial functioning in major depressive disorder: a systematic review. Psychiatry research, 269, 157–171. 10.1016/j.psychres.2018.08.033. [DOI] [PubMed] [Google Scholar]
  • 38.Black DW, Carney CP, Forman-Hoffman VL, Letuchy E, Peloso P, Woolson RF, & Doebbeling BN (2004). Depression in veterans of the first Gulf War and comparable military controls. Annals of Clinical Psychiatry, 16(2), 53–61. 10.1080/10401230490452645 [DOI] [PubMed] [Google Scholar]
  • 39.Blore JD, Sim MR, Forbes AB, Creamer MC & Kelsall HL (2015). Depression in Gulf War veterans. Psychological Medicine, 45(8), 1565 1580. 10.1017/S0033291714001913. [DOI] [PubMed] [Google Scholar]
  • 40.Sullivan K, Krengel M, Bradford W, Stone C, Thompson TA, Heeren T, & White RF (2018). Neuropsychological functioning in military pesticide applicators from the Gulf War: Effects on information processing speed, attention and visual memory. Neurotoxicology and teratology, 65, 1–13. 10.1016/j.ntt.2017.11.002 [DOI] [PubMed] [Google Scholar]
  • 41.Cockshell SJ, & Mathias JL (2010). Cognitive functioning in chronic fatigue syndrome: A meta-analysis. Psychological Medicine, 40, 1253–1267. 10.1017/S0033291709992054 [DOI] [PubMed] [Google Scholar]
  • 42.Cockshell SJ, & Mathias JL (2014). Cognitive functioning in people with chronic fatigue syndrome: A comparison between subjective and objective measures. Neuropsychology, 28, 394–405. 10.1016/j.psychres.2018.08.033 [DOI] [PubMed] [Google Scholar]
  • 43.LaManca JJ, Sisto SA, DeLuca J, Johnson SK, Lange G, Pareja J, Cook S, & Natelson BH (1998). Influence of exhaustive treadmill exercise on cognitive functioning in chronic fatigue syndrome. Pathophysiology, 105, 59S–65S. 10.1016/s0002-9343(98)00171-5 [DOI] [PubMed] [Google Scholar]
  • 44.Bertolucci PHF, & de Oliveira FF (2013). Cognitive Impairment in Fibromyalgia. Current Pain and Headache Reports, 17(7), 344. 10.1007/s11916-013-0344-9 [DOI] [PubMed] [Google Scholar]
  • 45.Kennedy PJ, Cryan JF, Dinan TG, & Clarke G (2014). Irritable bowel syndrome: A microbiome-gut-brain axis disorder?. World Journal of Gastroenterology, 20, 14105–14125. 10.3748/wjg.v20.i39.14105 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Spencer RJ, Kitchen Andren KA, & Tolle KA (2017). Development of a scale of executive functioning for the RBANS. Applied Neuropsychology: Adult, 25(3), 231–236. 10.1080/23279095.2017.1284664 [DOI] [PubMed] [Google Scholar]
  • 47.Cohen DE, Sullivan KA, McNeil RB, Gulf War Illness Common Data Elements Working Group:, Symptoms Assessment Working Group:, McNeil RB, Ashford W, Bested A, Bunker J, Cheema A, Cohen DE, Cook D, Cournoyer J, Craddock T, Golier J, Hardie A, Helmer D, Lindheimer JB, Lloyd PJ, Kerr K, … Younger J (2022). A common language for Gulf War Illness (GWI) research studies: GWI common data elements. Life sciences, 290, 119818. 10.1016/j.lfs.2021.119818 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Duff K, Hobson VL, Beglinger LJ, & O’Bryant SE (2010). Diagnostic accuracy of the RBANS in mild cognitive impairment: limitations on assessing milder impairments. Archives of Clinical Neuropsychology, 25(5), 429–441. 10.1093/arclin/acq045 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Wilk CM, Gold JM, Humber K, Dickerson F, Fenton WS, & Buchanan RW (2004). Brief cognitive assessment in schizophrenia: normative data for the Repeatable Battery for the Assessment of Neuropsychological Status. Schizophrenia research, 70(2–3), 175–186. 10.1016/j.schres.2003.10.009 [DOI] [PubMed] [Google Scholar]
  • 50.Iverson GL, Brooks BL, & Haley GM (2009). Interpretation of the RBANS in inpatient psychiatry: clinical normative data and prevalence of low scores for patients with schizophrenia. Applied neuropsychology, 16(1), 31–41. 10.1080/09084280802644128 [DOI] [PubMed] [Google Scholar]
  • 51.DeBeer BB, Davidson D, Meyer EC, Kimbrel NA, Gulliver SB, & Morissette SB (2017). The association between toxic exposures and chronic multisymptom illness in veterans of the wars of Iraq and Afghanistan. Journal of Occupational and Environmental Medicine, 59, 54–60. 10.1097/JOM.0000000000000922 [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES