Abstract
The Quality of Life after Brain Injury (QoLIBRI) questionnaire was developed and validated to assess disease-specific health-related quality of life (HRQoL) in individuals after TBI. The present study aims to determine its longitudinal validity by assessing its responsiveness and response shift from 3 to 6 months post-injury. Analyses were based on data from the European longitudinal observational cohort Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury study. A total of 1659 individuals recovering from TBI were included in the analyses. Response shift was assessed using longitudinal measurement invariance testing within the confirmatory factor analyses framework. Responsiveness was analyzed using linear regression models that compared changes in functional recovery as measured by the Glasgow Outcome Scale–Extended (GOSE) with changes in the QoLIBRI scales from 3 to 6 months post-injury. Longitudinal tests of measurement invariance and analyses of discrepancies in practical significance indicated the absence of response shift. Changes in functional recovery status from three to six months were significantly associated with the responsiveness of the QoLIBRI scales over the same time period. The QoLIBRI can be used in longitudinal studies and is responsive to changes in an individual’s functional recovery during the first 6 months after TBI.
Keywords: traumatic brain injury, disease-specific health-related quality of life, QoLIBRI, responsiveness, response shift
1. Introduction
Health-related quality of life (HRQoL) refers to the assessment of an individual’s perceived mental, physical, and social well-being and the overall ability to perform daily life activities [1]. Ideally, HRQoL instruments provide standardized information about the status and extent of limitations in a patient’s subjective experience of a medical condition or its treatment [2], capturing valuable insight into self-perceived health status and recovery patterns [3]. Measures of HRQoL can be generic or disease-specific. While generic measures allow for comparisons between different conditions and the general population, disease-specific instruments are more sensitive to selected health conditions, more precise in assessing their symptoms [4], and allow for a better prognosis, therapy, and rehabilitation recommendation compared with generic HRQoL measures. Due to this gain in nuanced information, disease-specific HRQoL is a recommended outcome that should be assessed in complex, heterogeneous diseases, such as traumatic brain injury (TBI) [3,5].
TBI is a significant cause of death and disability worldwide [6,7,8]. A recent epidemiological study reported almost 1.5 million hospital discharges and over 56,000 deaths due to TBI in Europe within 1 year, with TBI accounting for 37% of all injury-related deaths [9]. Despite the critical impact TBI has on society, public health, patients, and their next of kin, its effect is often insufficiently recognized [10,11]. TBI is considered an essential factor for decreased life expectancy, especially in young people [7,9,12], and is associated with increased morbidity and long-term disabilities in surviving individuals [8,13,14]. It can lead to lifelong limitations in daily activities due to lasting interference with cognitive, emotional, and physical functioning [15,16,17], including the development of post-concussion symptoms [18], impairments in motor functioning [19], and increased prevalence of mental health conditions such as anxiety [20,21,22], depression [21,22,23], or posttraumatic stress disorder [24]. These persistent medical and psychological repercussions often affect the HRQoL of individuals after TBI and their families [25].
The Quality of Life after Brain Injury (QoLIBRI) [26,27] is a TBI-specific patient-reported outcome measure (PROM) validated in more than 20 languages [26,28,29,30]. Its reliability and validity have been previously described in cross-sectional studies ranging from 3 months to 15 years after TBI [27,29,31,32,33,34,35]. The QoLIBRI is able to detect finer nuances between specific patient groups than the SF-36 measuring generic HRQoL [36], which is an important advantage for its use in clinical settings [4,37].
To date, little is known about the longitudinal association of disease-specific HRQoL after TBI. Some studies suggest a somewhat paradoxical increase in HRQoL despite disability [38]. Approaches to explain such a phenomenon include psychological processes such as reappraisal and adaption to the challenge of facing limiting health conditions [39]. These observed changes in perception of HRQoL after an adverse health event can likely be attributed to the adjustment of an individual’s internalized judgment of satisfactory health and HRQoL, usually referred to as a response shift [39,40]. While a response shift in assessing one’s health after a severe illness can be considered a common consequence of successful coping or intervention, it can also influence the psychometric indices of instruments assessing HRQoL [41,42]. Therefore, it is important to assess whether long-term evaluations with HRQoL instruments, like the QoLIBRI, reflect a true change in TBI or are susceptible to a potential response shift.
Response shifts may arise as a result of (1) a change in the responding individual’s internal standards of measurement, such as a recalibration, (2) a change in the values of the individual, such as reprioritization, or (3) a redefinition of the measured construct by the responding individual, such as reconceptualization [43]. The absence of a response shift legitimates comparing instruments’ scores at different time points to evaluate the long-term impact of disease and the efficacy of available treatments. In the case of PROMs such as QoLIBRI, careful assessment of potential response shift is a critical but rarely applied element in establishing the longitudinal validity of the instrument.
Another central characteristic of PROMs is their ability to detect actual change over time, referred to as responsiveness. The exact definition of responsiveness varies in the literature between (1) the ability to detect change in general, (2) measuring clinically meaningful change, and (3) assessing real change in the measured concept [44]. The first definition focuses on assessing the magnitude of a potential treatment effect and creates a lack of information about the instruments’ ability to detect the absence of a treatment effect correctly [44]. The second and third definitions face methodological challenges due to an insufficient classification of the term “clinically important change” and a lack of feasibility to measure the real change in the individuals’ HRQoL due to a scarcity of appropriate instruments. This results in a substantial overlap in measurement procedures. In both cases, researchers usually infer changes in HRQoL from clinical variables, a patient’s perception, or a doctor’s evaluation of change. Therefore, the evaluation of the responsiveness of an instrument varies across the literature, with the significance of change being potentially susceptible to the evaluator’s subjective judgment [44,45].
The present study aims to evaluate the longitudinal internal validity of the QoLIBRI. The assessment is conducted in two steps:
Evaluation of response shift from three to six months after TBI using the longitudinal measurement invariance testing approach;
Assessment of responsiveness as the ability of the QoLIBRI to detect changes in the patient’s functional recovery status, as measured by the Glasgow Outcome Scale–Extended (GOSE) [46], 3 to 6 months after injury.
Evidence of the absence of response shifts and the presence of responsiveness would suggest that the QoLIBRI can be used for longitudinal assessment of disease-specific HRQoL after TBI.
2. Materials and Methods
The present study utilizes data (core data set 3.0) from the prospective, longitudinal, observational Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury study (CENTER-TBI; EC grant 602150; clinicaltrials.gov NCT02210221) aimed to improve characterization and classification of TBI. Inclusion criteria were a clinical diagnosis of TBI, clinical indication for a CT scan, presentation within 24 h after injury, and informed consent which was obtained according to local and national requirements. To avoid confounding outcome assessments, individuals with severe preexisting neurological disorders were excluded from the study [47]. Overall, N = 4509 (99.9% civilians) eligible patients included in the core study were stratified into 3 strata based on the clinical care pathways: emergency room (ER; discharge after ER admission), ward (admission to a hospital ward), and intensive care unit (ICU; admission to the ICU). Details on core sample characteristics are described elsewhere [48].
The present study focused on individuals after TBI who were at least 16 years old and had a GOSE status of 3 or higher at 3 and 6 months after injury. Responsiveness analyses were conducted with individuals for whom the QoLIBRI total score and 6 scale scores could be calculated at 3 and 6 months after injury (Sample 1: N = 1659). Confirmatory factor analyses and measurement invariance analyses were conducted only with complete QoLIBRI item data at 3 and 6 months post-injury (Sample 2: N = 1390). For more details on study sample attrition, see Figure 1.
2.1. Measures
2.1.1. Sociodemographic Data
Sociodemographic data used in the present study were collected at enrollment and included the age, sex, marital status, educational level, and employment status of the study participants.
2.1.2. Injury-Related Data
The severity of TBI was assessed using the Glasgow Coma Scale (GCS) [49], with values of 13–15 indicating mild, 9–12 moderate, and 3–8 severe TBI. It is often accessed several times within the first 24 h after injury (at the scene of the accident, in the first hospital, if the patient did not arrive directly at the study hospital, at the ER of the study hospital, and by post-stabilization). The GCS score was centrally imputed using IMPACT methodology [50]: The first post-stabilization value was taken and, if absent, the next available value back in time towards values at the accident scene. The GCS score was combined with the presence of intracranial abnormalities (ICA) detected by CT. Individuals were grouped into 4 categories according to the following cut-offs: uncomplicated mild (GCS ≥ 13 without ICA), complicated mild (GCS ≥ 13 with ICA), moderate (9 ≤ GCS ≤ 12), and severe TBI (GCS ≤ 8).
Injury severity was measured with the Injury Severity Score (ISS) [51], identifying three of twelve mostly injured body regions. The ISS is calculated as a sum of squares of the three body regions with the highest score. The maximal score for the ISS is 75. If any of the regions are assigned a score of 6, the ISS is automatically set to 75. Other TBI-related factors included the cause of injury (fall, road traffic accident, violent/other), clinical care pathways (emergency room (ER), admission, intensive care unit (ICU)), and the length of the hospital stay (in days).
Functional recovery status after TBI was rated using the GOSE [46] at three and six months after injury. The GOSE scores range from 1 to 8, covering the following functional recovery status: 1 = death, 2 = vegetative state, 3–4 = severe disability, 5–6 = moderate disability, and 7–8 = good recovery. The GOSE score was computed as a composite score combining information from the interview or, if not available, from the postal questionnaire (GOSE-Q [52] completed either by individuals after TBI or caretakers) or based on interviewer ratings for survivors. Since the GOSE-Q cannot distinguish between a vegetative state (score of 2) and a lower severe disability (score of 3), both categories were collapsed into one. Only patients with values of three and above participated in our study. Based on changes in the recovery status between three and six months post-injury, individuals after TBI were divided into three groups: if recovery status had changed to better, they were assigned to the “improved” group. Those with unchanged recovery status were attributed to the “stable” group, and the remainder to the “worsened” group.
The QoLIBRI [26,27] was used to assess TBI-specific HRQoL. The instrument comprises 37 Likert-type scaled items with five response options (“Not at all”, “Slightly”, “Moderately”, “Quite”, and “Very”) forming six domains (Cognitive, Self, Autonomy & Daily Life, Social Relationships, Emotions, and Physical Problems). The total score can be calculated with more than one-third of the responses and scaled to vary from 0 (worst possible HRQoL) to 100 (best possible HRQoL).
2.2. Statistical Analyses
2.2.1. Sample Characteristics
We tested if patients who responded to the QoLIBRI at 3 and 6 months post-injury assessment differed from other TBI patients within six months after injury concerning age, sex, and injury-related characteristics such as clinical care pathways, TBI, and injury severity. The Welch two-sample t-test was applied for metric variables and Pearson’s chi-squared tests or permutation-based chi-squared tests (n < 5 observations per cell; N = 5000 permutations) for categorical ones. The significance level was set to α = 0.05.
2.2.2. Confirmatory Factor Analysis
An optimal instrument structure at 3- and 6-month assessments was tested via confirmatory factor analysis (CFA) with the robust weighted least squares estimator (WLSMV) using the lavaan-package [53] in R [54]. Model fit was assessed with the scaled chi-square statistics, comparative fit index (CFI), root mean square error of approximation (RMSEA) with a 90-percent confidence interval, and standardized root mean square residual (SRMR). The standard cut-offs for CFI (>0.95), RMSEA (<0.06 for an excellent and 0.05 < RMSEA < 0.10 for a mediocre fit), and SRMR (<0.08) [55,56,57], indicating good model fit, have not been yet validated for the WLSMV estimator. Therefore, we tested four concurrent factorial structures (with 1. one factor, 2. two correlated factors, one factor that underlies positively formulated items and one negatively, 3. six correlated factors corresponding to QoLIBRI scales, 4. six correlated factors, and one common factor of higher order) and compared all fit indices across models. For the scaled chi-square difference test, α-level was set to 0.05.
2.2.3. Response Shift
Response shift of each QoLIBRI scale was determined by testing for measurement invariance across the two time points within the framework of CFA for ordinal variables [58]. The content interpretation was performed based on Oort (2005) [59].
First, we tested a configural model with the same number of latent factors and the same pattern of zero and non-zero loadings across two time points. Failure of the model would indicate that participants reconceptualized their understanding of the HRQoL construct by the follow-up, attributing items to other factors.
Next, a loading model, constraining loadings of the configural model to be equal across time points, was investigated. The scaled chi-square test (α = 0.05) was used for model comparison. A worsened model fit would mean a response shift due to reprioritization: by the follow-up, the importance of some items has changed for the construct estimation.
Then, in the threshold model, we constrained the loading model’s thresholds to be equal across time points. A worsened model fit would mean a response shift due to recalibration (i.e., a change in the interpretation of response options): even if a participant reports the same level of HRQoL, he or she would score differently at the second time point. Invariance on the threshold level would be sufficient to conclude that the observed differences in the score means are due to the differences in the latent factor means [60].
Finally, in the residual model, we additionally constrained residual variances to be equal across time points. In the case of invariance, one can conclude that the responses showed no response shift, and all observed differences in the score means, variances, and covariances came from the corresponding differences in the latent factors.
In all models, latent factors were allowed to freely covary across time points. Residuals were allowed to freely correlate with themselves but not with other residuals across time points. The model specification was based on the marker item approach implying selecting marker variables based on the smallest difference in loadings over time [58]. In case where the loading, threshold, or residual model is non-invariant, Liu et al. (2017) [58] suggest testing if violations of invariance have a practical significance. The estimated parameters of each invariance model can be applied to calculate probabilities of choosing a particular response category under the corresponding model. In the case that, for example, the loading model holds, but the threshold model does not, the practical significance of an invariance violation can be attached through the differences in estimated response probabilities under the loading and threshold model for each item and all time points. Differences not exceeding 5% were considered negligible.
2.2.4. Responsiveness
Responsiveness of an instrument reflects the extent to which changes in the measure relate to corresponding changes in an external reference measure over a defined time course. Regression analyses have proven useful in assessing responsiveness, as the regression coefficient (b) provides an easily interpretable index, and a goodness-of-fit assessment can be employed to check for the plausibility of the model [45]. Therefore, to evaluate the responsiveness of the QoLIBRI, linear regressions were calculated to find associations between the change in the QoLIBRI total and scale scores from three to six months post-injury and the change in the GOSE score from three to six months, using the R-package ‘lme4’ [61]. The GOSE change was included as an ordinal variable using two orthogonal contrasts to detect linear and non-linear (i.e., quadratic) associations with the QoLIBRI scores. Age, sex, marital status, education level, employment status, TBI severity, ISS, cause of injury, clinical care pathways, and length of hospital stay were used as covariates. Multiple imputations with the R-package ‘mice’ [62] was used to handle missing covariate data. The level of significance was set to α = 0.05 for the total score and was Bonferroni-corrected for the scale scores (α = 0.05/6 = 0.008).
The reliability of change scores was evaluated by receiver operating characteristic (ROC) curves with the R-package ’pROC’ [63] containing information on the sensitivity and specificity of the QoLIBRI change scores by discrimination between stable and improved patients. The area under the curve (AUC) was calculated; its values can vary between 0.5 and 1.0, with 1.0 indicating perfect discrimination and 0.5 discrimination not better than by chance [64].
Finally, we compared QoLIBRI total and scale scores between three and six months post-TBI using the Wilcoxon signed rank test for dependent samples to provide an overview of changes in the reported scores. The effect size r was calculated using the ‘wlicox_effsize’ function from the R package ‘rstatix’ [65]. Interpretation of values was based on conventional cut-offs: 0.10 ≤ r < 0.30 (small effect), 0.30 ≤ r < 0.50 (medium effect), and r ≥ 0.50 (large effect) [66]. Visualization was performed using strip plots showing trajectories of changes in HRQoL from three to six months.
3. Results
3.1. Study Participants
A total of 1659 patients (64.9% male) with a mean age of 49.61 years (SD = 19.15) were included in the present study (Sample 1, see Figure 1). The majority (approx. 77%) were either admitted to a hospital ward or an ICU after injury, while the remaining 23% were discharged after visiting the ER. Based on the GCS and information on intracranial abnormalities on the CT scans, 32.9% of the sample were diagnosed with uncomplicated mild TBI (i.e., GCS ≥ 13 and no abnormalities), 30.2% with complicated TBI (i.e., GCS ≥ 13 and visible intracranial abnormalities), 6.8% with moderate, and 14.2% with severe TBI; 6 months after TBI, 13.6% of participants showed a worsened functional state as rated by the GOSE, while for 55.3%, a stable, and for 31.1%, an improved functional status was observed. The patients’ mean ISS score was 18.04 (SD = 14.85). Participants included in the analysis sample differed significantly from those not included in all characteristics except for age. For more details, see Table 1. For the sample characteristics of the reduced sample (Sample 2, see Figure 1) as well as for the comparison between included and excluded individuals, see Appendix A, Table A1.
Table 1.
Included in the Study Sample | ||||
---|---|---|---|---|
Value/Group | Yes (n = 1659) | No (n = 2850) | p | |
Age | M (SD) | 49.61 (19.15) | 48.59 (22.45) | 0.219 |
Sex | Male | 1077 (64.92%) | 1946 (68.28%) | 0.022 |
Female | 582 (35.08%) | 904 (31.72%) | ||
Marital status | Partnered | 889 (53.59%) | 1181 (41.44%) | <0.001 |
Single | 767 (46.23%) | 1647 (57.79%) | ||
Missing | 3 (0.18%) | 22 (0.77%) | ||
Education level | At least secondary/high school | 547 (32.97%) | 832 (29.19%) | <0.001 |
College/university | 464 (27.97%) | 386 (13.54%) | ||
None/primary school | 207 (12.48%) | 434 (15.23%) | ||
Post-high school training | 293 (17.66%) | 403 (14.14%) | ||
Missing | 148 (8.92%) | 795 (27.90%) | ||
Employment status | Full-time employed | 718 (43.28%) | 867 (30.42%) | <0.001 |
In training | 154 (9.28%) | 332 (11.65%) | ||
Part-time employed | 196 (11.82%) | 195 (6.84%) | ||
Retired | 389 (23.45%) | 723 (25.37%) | ||
Unemployed | 123 (7.41%) | 283 (9.93%) | ||
Missing | 79 (4.76%) | 450 (15.79%) | ||
TBI severity (Glasgow Coma Scale; GCS) |
Uncomplicated mild | 546 (32.91%) | 729 (25.58%) | <0.001 |
Complicated mild | 501 (30.20%) | 563 (19.75%) | ||
Moderate | 113 (6.81%) | 276 (9.68%) | ||
Severe | 236 (14.23%) | 750 (26.32%) | ||
Missing | 263 (15.85%) | 532 (18.67%) | ||
Injury severity score (ISS) | M (SD) | 18.04 (14.85) | 22.72 (17.79) | <0.001 |
Functional status change (Glasgow Outcome Scale–Extended; GOSE) |
Improved | 516 (31.10%) | 494 (17.33%) | <0.001 |
Stable | 918 (55.34%) | 1521 (53.37%) | ||
Worsened | 225 (13.56%) | 113 (3.97%) | ||
Missing | 0 (0%) | 722 (25.33%) | ||
Cause of injury | Fall | 715 (43.10%) | 1309 (45.93%) | <0.001 |
Road traffic accident | 692 (41.71%)) | 990 (34.74%) | ||
Violent/other | 251 (15.13%) | 532 (18.67%) | ||
Missing | 1 (0.06%) | 19 (0.66%) | ||
Clinical care pathways | ER | 383 (23.09%) | 465 (16.32%) | <0.001 |
Admission | 640 (38.58%) | 883 (30.98%) | ||
ICU | 636 (38.34%) | 1502 (52.70%) | ||
Length of hospital stay (in days) | M (SD) | 10.56 (18.18) | 13.30 (22.60) | <0.001 |
Missing | 29 (1.75%) | 89 (3.12%) |
Note. n = absolute frequencies, p = p-value, M = mean, SD = Standard deviation. Welch’s t-test was used for all continuous variables due to non-normal distribution; χ2-tests and permutation-based χ2-tests (n < 5 observations per cell; N = 5000 permutations) were used for categorical data.
3.2. Confirmatory Factor Analysis
Table 2 provides the CFA results for 3 and 6 months post-injury, respectively. At both time points, model fit indices remarkably improved by the 6-factor and second-order models with CFIs above 0.949 and RMSEA values under 0.069. The scaled chi-square test identified that the 6-factorial structure fits best the QoLIBRI data at time points 3 (χ2(614) = 4121.54, p < 0.001, CFI = 0.954, RMSEA = 0.064, CI90% [0.062; 0.066]) and 6 months post-injury (χ2(614) = 3775.89, p < 0.001, CFI = 0.963, RMSEA = 0.061, CI90% [0.059; 0.063]). Therefore, this model was used for further analyses.
Table 2.
Confirmatory Factor Analysis | χ2 Difference Test | |||||
---|---|---|---|---|---|---|
Model | χ 2 | CFI | RMSEA [CI90%] | SRMR | ∆χ2 (∆df) | p |
3 months post-injury | ||||||
One Factor | 15,281.52 (629) | 0.821 | 0.130 [0.128; 0.131] | 0.096 | - | - |
Two Factor | 10,939.70 (628) | 0.874 | 0.109 [0.107; 0.111] | 0.078 | 460.77 (1) | <0.001 |
Six Factor | 4121.54 (614) | 0.954 | 0.064 [0.062; 0.066] | 0.041 | 1766.03 (14) | <0.001 |
Two Level | 4532.72 (623) | 0.949 | 0.067 [0.065; 0.069] | 0.052 | 251.92 (9) | <0.001 |
6 months post-injury | ||||||
One Factor | 14,024.43 (629) | 0.842 | 0.124 [0.122; 0.126] | 0.086 | - | - |
Two Factor | 10,358.82 (628) | 0.885 | 0.106 [0.104; 0.107] | 0.070 | 414.20 (1) | <0.001 |
Six Factor | 3775.89 (614) | 0.963 | 0.061 [0.059; 0.063] | 0.037 | 1854.56 (14) | <0.001 |
Two Level | 4153.73 (623) | 0.958 | 0.064 [0.062; 0.066] | 0.047 | 229.28 (9) | <0.001 |
Note. CFI = comparative fit index (>0.95), RMSEA = root mean square error of approximation (<0.06) with a 90-percent confidence interval, SRMR = standardized root mean square residual (<0.08). Model in bold shows the best fit.
3.3. Response Shift
Table 3 presents the results from the longitudinal measurement invariance test for the QoLIBRI scales from three to six months after TBI. For each scale, we estimated four invariance models. In all cases, the CFI was high (≥0.971), and the SRMR did not exceed the cut-off of 0.06. Both indices showed minimal variation across invariance models for each scale, suggesting an adequate fit. However, the RMSEA of the scales Self (configural and loading model) and Social Relationships (configural model) was slightly increased (>0.10), indicating a worse model fit.
Table 3.
Measurement Invariance Analysis | χ2 Difference Test | |||||
---|---|---|---|---|---|---|
Model | χ2 (df) | CFI | RSMEA [CI90%] | SRMR | ∆χ2 (∆df) | p |
Cognition | ||||||
Configural | 594.04 (69) | 0.988 | 0.074 [0.069; 0.080] | 0.027 | - | - |
Loading | 598.08 (75) | 0.988 | 0.071 [0.066; 0.076] | 0.027 | 3.34 (6) | 0.766 |
Threshold | 577.46 (95) | 0.989 | 0.060 [0.056; 0.065] | 0.027 | 14.50 (20) | 0.804 |
Residual | 545.55 (102) | 0.990 | 0.056 [0.051; 0.061] | 0.028 | 27.26 (7) | <0.001 |
Self | ||||||
Configural | 1357.32 (69) | 0.971 | 0.116 [0.111; 0.121] | 0.039 | - | - |
Loading | 1372.96 (75) | 0.971 | 0.112 [0.106; 0.117] | 0.039 | 5.63 (6) | 0.466 |
Threshold | 1397.01 (95) | 0.972 | 0.099 [0.095; 0.104] | 0.039 | 31.11 (20) | 0.054 |
Residual | 1260.64 (102) | 0.980 | 0.090 [0.086; 0.095] | 0.040 | 20.41 (7) | 0.005 |
Daily Life & Autonomy | ||||||
Configural | 558.81 (69) | 0.988 | 0.071 [0.066; 0.077] | 0.027 | - | - |
Loading | 565.64 (75) | 0.988 | 0.069 [0.063; 0.074] | 0.027 | 6.69 (6) | 0.350 |
Threshold | 592.84 (95) | 0.989 | 0.061 [0.057; 0.066] | 0.027 | 33.41 (20) | 0.030 |
Residual * | - | - | - | - | - | - |
Social Relationships | ||||||
Configural | 718.35 (47) | 0.971 | 0.101 [0.095; 0.108] | 0.039 | - | - |
Loading | 736.49 (52) | 0.971 | 0.097 [0.091; 0.104] | 0.039 | 7.06 (5) | 0.216 |
Threshold | 728.63 (68) | 0.972 | 0.084 [0.078; 0.089] | 0.039 | 31.13 (16) | 0.010 |
Residual * | - | - | - | - | - | - |
Emotions | ||||||
Configural | 196.23 (29) | 0.988 | 0.064 [0.056; 0.073] | 0.024 | - | - |
Loading | 198.94 (33) | 0.988 | 0.060 [0.052; 0.068] | 0.024 | 3.74 (4) | 0.443 |
Threshold | 195.40 (47) | 0.989 | 0.048 [0.041; 0.055] | 0.024 | 13.02 (14) | 0.525 |
Residual | 200.39 (52) | 0.990 | 0.045 [0.039; 0.052] | 0.025 | 15.10 (5) | 0.010 |
Physical Problems | ||||||
Configural | 228.77 (29) | 0.988 | 0.070 [0.062; 0.079] | 0.035 | - | - |
Loading | 228.48 (33) | 0.988 | 0.065 [0.057; 0.073] | 0.034 | 3.86 (4) | 0.426 |
Threshold | 259.25 (47) | 0.989 | 0.057 [0.050; 0.064] | 0.035 | 30.04 (14) | 0.008 |
Residual * | - | - | - | - | - | - |
* Residual invariance for Daily Life & Autonomy, Social Relationships, and Physical problems scales not reported; practical significance examined instead (see Supplemental Material S1). Note. χ2 = chi-square value, df = degrees of freedom, CFI = comparative fit index (>0.95), RMSEA = root mean square error of approximation (<0.06) with a 90-percent confidence interval, SRMR = standardized root mean square residual (<0.08). Values in italic are significant at 5%.
The scaled chi-square difference test indicated for all scales that adding loading invariance constraints did not significantly worsen the model fit when compared to the configural baseline model. For three of the six scales (Daily Life & Autonomy, Social Relationships, and Physical Problems), the scaled chi-square difference test indicated that the threshold model fit does significantly worsen the data in comparison to the loading invariance model. As the threshold invariance model did not hold up, an analysis of practical significance was conducted for all three scales [58]. Predicted probabilities for each of the scales showed only minimal differences between invariance models cross-sectionally and longitudinally. Analysis of the practical significance of invariance violation identified that the discrepancies in the estimated probabilities to choose a particular response option under concurrent models (e.g., loading and threshold invariance models for the Social Relationships scale) showed absolute differences not exceeding 2% (see Supplemental Material S2, Practical Significance–Discrepancies between Invariance Models). According to Liu and colleagues [58], small discrepancies in the predicted probabilities (<0.05) can be neglected as they only represent relatively few individuals. Therefore, we can assume that violations from threshold invariance for the Daily Life & Autonomy, Social Relationships, and Physical Problems scales were not caused by a response shift from three to six months post injury, and threshold invariance can be assumed.
For the remaining scales (Cognition, Self, and Emotions), the threshold invariance model held up compared to the loading invariance model. Consequently, the residual (unique factor) invariance model was tested. Scaled chi-square difference analysis indicated non-invariant residuals for all three scales. Again, an analysis of the practical significance of the failure of the residual invariance model was conducted. Predicted probabilities for each of the scales showed only minimal differences from three to six months (see Supplemental Material S2, Practical Significance–Discrepancies between Invariance Models). Consequently, their contribution to the latent construct HRQoL assessed by the QoLIBRI remained unchanged between the two measurement occasions, and observed differences in the scores over time can be attributed to true changes in the HRQoL.
The most pronounced changes between three and six months were observed on the Daily Life & Autonomy scale, where the participants became more likely to choose a higher response category. For instance, the predicted probability of choosing the answer “very” to the question “How satisfied are you with your ability to carry out domestic activities?” increased from 0.41 to 0.47 in the loading invariance model. The predicted probability for the question “How satisfied are you with the extent of your independence from others?” changed from 0.36 to 0.42 from 3 to 6 months in the response category “very” in the loading invariance mode. Furthermore, the item “How satisfied are you with your ability to get out and about” showed an increase in the endorsement of the higher response category from 0.46 to 0.52. For details, see Supplemental Material S2, Practical significance (Daily Life & Autonomy). These two questions represent the largest deviations in predicted probabilities for all scales over time, indicating that the scale may be more sensitive to measure change.
3.4. Responsiveness
According to the change in GOSE score between 3 and 6 months after TBI, recovery improved in 31.1% (n = 516) of our sample, 55.3% (n = 918) were classified as stable, and 13.6% (n = 225) had worsened recovery status. Change in the GOSE score, considered as a linear effect, contributed significantly to the change in the QoLIBRI total score, B = 4.129, t(1637) = 6.073, p < 0.001. At the scale level, a significant effect of GOSE change was observed for all scales except the Emotions scale. The proportion of variance in the change of the QoLIBRI score explained by the change in the GOSE scores was 4% for the total score and varied from 1% (Emotions scale) to 6% (Daily Life & Autonomy scale). Results showed no significant influence of the change in the GOSE score, considered as a quadratic effect. For details, see Table 4 and Appendix A, Table A2.
Table 4.
Scale | Predictor | B (SE) | b | t | p |
---|---|---|---|---|---|
Total | GOSE (linear) | 4.129 (0.680) | 0.344 | 6.073 | <0.001 |
GOSE (quadratic) | 0.223 (0.511) | 0.019 | 0.436 | 0.663 | |
Cognition * | GOSE (linear) | 3.365 (0.904) | 0.213 | 3.722 | <0.001 |
GOSE (quadratic) | −0.758 (0.680) | −0.048 | −1.114 | 0.265 | |
Self * | GOSE (linear) | 4.725 (0.932) | 0.289 | 5.070 | <0.001 |
GOSE (quadratic) | −0.223 (0.701) | −0.014 | −0.318 | 0.750 | |
Daily Life & Autonomy * | GOSE (linear) | 6.384 (0.977) | 0.365 | 6.536 | <0.001 |
GOSE (quadratic) | 1.204 (0.735) | 0.069 | 1.639 | 0.102 | |
Social Relationships * | GOSE (linear) | 2.646 (0.900) | 0.168 | 2.942 | 0.003 |
GOSE (quadratic) | 0.035 (0.676) | 0.002 | 0.051 | 0.959 | |
Emotions * | GOSE (linear) | 2.985 (1.177) | 0.145 | 2.536 | 0.011 |
GOSE (quadratic) | 0.259 (0.886) | 0.013 | 0.293 | 0.770 | |
Physical Problems * | GOSE (linear) | 3.960 (1.024) | 0.219 | 3.866 | <0.001 |
GOSE (quadratic) | 1.207 (0.771) | 0.067 | 1.565 | 0.118 |
Note. Results of regression analyses controlling for the following variables: age, sex, marital status, education level, employment status, TBI severity, injury severity (ISS), cause of injury, clinical care pathways, length of hospital stay (for details, see Appendix A-Table A2). B = unstandardized regression coefficient, SE = standard error, b = standardized regression coefficient, t = t-value, p = p-value. Values in bold are significant at 5% (total score) or at 0.8% (scale scores; Bonferroni-adjusted marked with *).
The average scores for the change in the QoLIBRI in relation to the change in the GOSE scores are shown in Figure 2. The most pronounced increase in the QoLIBRI score in relation to the GOSE score was observed in the Daily Life & Autonomy scale, followed by the Physical scale for those with improved functional recovery. For those with a worsened recovery status, the greatest decrease in the QoLIBRI scores was found in the Cognition and Self scales.
Additional ROC analysis showed that based on the QoLIBRI change scores, 60.4% of the individuals after TBI were correctly classified as presenting an improved vs. a not improved (i.e., stable or worsened) recovery status. The cut-off for the QoLIBRI change score, which maximizes sensitivity (55.4%) and specificity (63.9%) by distinguishing between improved and non-improved patients, was 2.5. For details, see Figure 3. The correctness of patients’ classification for scales ranged from 55.1% (Social Relationships) to 62.7% (Daily Life & Autonomy). The results of ROC analyses on the scale level are shown in Appendix A, Figure A1.
We observed a significant difference in the QoLIBRI total score from 3 to 6 months after TBI (V = 518408, p < 0.001, r = 0.12 corresponding to a small effect). The effect was mainly driven by the difference in the Daily Life & Autonomy and Physical Problems scales, both showing significant improvement from 3 to 6 months (p < 0.001). For visualization, see Figure 4 (QoLIBRI total score) and Figure A2 (for the scale scores).
4. Discussion
The present study aimed to assess the longitudinal internal validity of the QoLIBRI measuring TBI-specific HRQoL. This is the first study to assess response shift and responsiveness of the QoLIBRI for individuals between 3 and 6 months post TBI. This time frame is critical for patients as recovery mostly occurs in the first six months. For example, Gardner et al. [67] found that the majority of individuals after TBI achieve good to moderate recovery within the first half year after injury, with 70.9% following a gradual trajectory between the time points. Other studies also suggest that at least moderate recovery is reached within six months across all TBI severity groups [68,69].
However, most research has focused on functional recovery, thus neglecting domains that are additionally relevant to better understanding patients’ needs and facilitating the recuperation process [35]. In this context, especially the administration of PROMs (e.g., HRQoL measurement) can be considered as a comprehensive, economical, and reliable source of information complementary to the GOSE. Assessing both potential response shifts and responsiveness is critical to learning about actual changes over time when using PROMs longitudinally. In the present study, the absence of response shift and the demonstrated responsiveness of the QoLIBRI to the GOSE-assessed recovery status suggest that the instrument is useful for follow-up assessments during at least the first six months after injury. Some further aspects will be discussed in the following paragraphs.
4.1. Response Shift
For three QoLIBRI scales (i.e., Daily Life & Autonomy, Social Relationships, and Physical Problems), the longitudinal loading invariance model was attained, indicating that changes over time in the expected means measured by these QoLIBRI scales are entirely attributable to changes in the common latent factors over time [58]. Thus, the latent construct “HRQoL” estimated by the QoLIBRI remained unchanged between two measurement occasions, and observed differences in the scores over time can be attributed to true changes in the HRQoL. The other three scales (i.e., Cognition, Self, and Emotions) reached threshold invariance, pointing out that the observed differences in the score means are due to the differences in the latent factor means [60].
To better understand the discrepancies in response behavior from three to six months, a sensitivity analysis of the practical significance of the failure of invariance was conducted for all scales. The predicted probabilities revealed minor changes in response categories from three to six months post-TBI, with the largest variations on the Daily Life & Autonomy scale, where participants tended to endorse higher response categories indicating better HRQoL at six months post-TBI compared to three months. This may be explained by the progressive recovery process increasing their satisfaction with the autonomy they have gained during recovery. In our study, items measuring satisfaction with the level of ability to perform domestic activities, the level of independence from others, and the ability to get out and about showed increased endorsement six months after TBI. These findings are supported by previously published research suggesting considerable improvement in daily living activities during the first year post-injury [70].
In addition, discrepancies in the predicted probabilities between the retained and rejected measurement invariance models were calculated for each scale. However, none of the discrepancies between invariance models exceeded the 5% threshold, indicating that these differences can be neglected and the assumption of longitudinal measurement invariance can be retained.
The absence of response shift may also be explained by our study sample characteristics, as most of our patients had experienced a mild TBI. The intensive recovery processes for mild TBI occurs within the first weeks/months after injury [71]. In our sample, almost 60% of the individuals after TBI presented a good recovery at 3 months post-injury, which is comparable to other studies [67,68]. Moreover, patients after moderate and severe TBI who participated in the study might have felt generally better already when entering the study than those who did not take part. Therefore, adaptation and coping processes, which generally cause response shifts [43], might not have been pronounced in the individuals in our study sample.
4.2. Responsiveness
Linear regression modeling indicated that the linear change in the GOSE from three to six months was significantly associated with the change in HRQoL. This is in line with a recent study showing that the QoLIBRI was one of the most sensitive instruments for recovery status at 3 different time points (3, 6, and 12 months after TBI) across different patient groups [35]. Furthermore, some other studies have shown a significant association between unfavorable recovery and reduced (TBI-specific) HRQoL [29,48,72,73,74].
The only exception among the QoLIBRI scales was the change in the Emotions scale, which showed no significant association with the change in recovery status after Bonferroni adjustment for multiple testing. This may be explained by the fact that the GOSE focuses rather on functional (dis)ability, independence, social and leisure activities, and return to normal life after TBI and neglects the emotional status. As emotional well-being is crucial for the healing and recovery process and improvement of HRQoL in individuals after TBI [75], its assessment and, if necessary, treatment are mandatory in individuals after TBI. However, recent rehabilitation studies indicate a lack of services and treatment for post-TBI mental health conditions at all levels of severity [76,77].
Overall, the QoLIBRI and its scales appear to be sensitive to positive and negative changes in the participants’ HRQoL. Additional ROC analysis indicated that a QoLIBRI change score of 2.5 or higher could indicate significantly improved functional status and vice versa. Overall, a QoLIBRI change score of 2.5 correctly identified a significant change in recovery status in 60% of participants.
Finally, since the QoLIBRI can be considered responsive to changes in recovery from TBI and since we can assume that it measures true changes in TBI-specific HRQoL longitudinally (i.e., in a time frame of six months after injury), we can conclude that HRQoL improves significantly between three and six months, especially in terms of autonomy in daily living and physical problems.
4.3. Strengths and Limitations
To our knowledge, this is the first study systematically analyzing response shifts and responsiveness of the QoLIBRI and its scales. The main advantage is the large sample size, which also reflects the epidemiological distribution of the TBI severity in the general TBI population, allowing us to draw reliable conclusions. Some limitations should nevertheless be mentioned. Although advantageous for comparing with the general TBI population, the uneven distribution of TBI severity may pose some problems. The relatively small number of individuals after moderate and severe TBI does not allow for additional investigation of response shifts and responsiveness in these groups. Considering that higher TBI severity may be associated with a more pronounced decrease in TBI-specific HRQoL [78], additional analyses within the severe TBI group would be beneficial to gain more insight into potential changes in their HRQoL over time and the ability of the QoLIBRI to capture them. Furthermore, as participants included in the sample differed significantly from those not included concerning all characteristics except for age, the results should be interpreted with caution. Finally, the proportion of variance explained (4%) in the change in QoLIBRI score by the change in GOSE suggests that other factors not considered in the present study also contribute to changes in HRQoL. Therefore, the results should not be overinterpreted.
Future research using instruments other than QoLIBRI to assess TBI-specific HRQoL (e.g., TBI-QOL [79]) and data from other studies for external validation should be conducted to provide further evidence of the longitudinal validity of the QoLIBRI. Furthermore, the inclusion of additional time points after TBI would be beneficial to gain more insight into the variability of changes in TBI-specific HRQoL. Due to the design of the CENTER-TBI study, individuals after TBI who were admitted to an ER and subsequently discharged were only included in follow-up analyses up to six months after injury. Therefore, we were unable to perform analyses with this substantial group (i.e., 23%) beyond this time frame, which would have introduced sample bias due to the overrepresentation of severe or complex cases [80]. Thus, we decided to limit our analyses to the first six months after TBI. In addition, analyses of responsiveness to other relevant clinical comorbid conditions (e.g., depression, anxiety, post-traumatic stress disorder, post-concussion symptoms) may provide a more complete picture of how changes in TBI-specific HRQoL are related to outcomes other than post-TBI functional recovery. First, studies on the simultaneous consideration of these outcome domains point to their relevant impact on TBI-specific HRQoL [35,74]. Additional evidence of recovery using objective approaches such as CT and/or MRI, which were not available in the present study sample, would be beneficial for a more accurate, externally validated assessment of recovery.
5. Conclusions
Given the long-term impact of TBI on an individual’s life, and the heterogeneous pathways to symptom resolution and its potential negative impact on HRQoL, it is crucial to monitor outcomes such as HRQoL over time and not to rely solely on changes in functional status (i.e., the GOSE). To evaluate developmental trends straightforward, longitudinal validity, including response shift and responsiveness of the instruments, had to be established. Our results indicate the QoLIBRI can detect a true change in the underlying HRQoL construct and is sensitive to detecting changes in functional recovery status. The QoLIBRI, therefore, can be considered a valuable instrument to gain nuanced insight into the longitudinal development of recovery patterns and self-perceived health status in patients affected by TBI.
Acknowledgments
The authors would like to thank all study participants and investigators of the CENTER-TBI study. The authors would also like to thank Anastasia Gorbunova for the very helpful preparatory work she did for this publication.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm12093197/s1, File S1: CENTER-TBI Participants and Investigators; File S2: Practical Significance.
Appendix A
Table A1.
Sample 1 * | ||||
---|---|---|---|---|
Value/Group | Sample 2 ** (n = 1390) |
Excluded (n = 269) |
p | |
Age | M (SD) | 47.51 (18.13) | 60.42 (20.61) | <0.001 |
Sex | Male | 928 (66.76%) | 149 (55.39%) | <0.001 |
Female | 462 (33.24%) | 120 (44.61%) | ||
Marital status | Partnered | 757 (54.46%) | 132 (49.07%) | 0.128 |
Single | 631 (45.40%) | 136 (50.56%) | ||
Missing | 2 (0.14%) | 1 (0.37%) | ||
Education level | At least secondary/high school | 463 (33.31%) | 84 (31.23%) | 0.004 |
College/university | 413 (29.71%) | 51 (18.96%) | ||
None/primary school | 165 (11.87%) | 42 (15.61%) | ||
Post-high school training | 238 (17.12%) | 55 (20.45%) | ||
Missing | 111 (7.99%) | 37 (13.75%) | ||
Employment status | Full-time employed | 661 (47.55%) | 57 (21.19%) | <0.001 |
In training | 132 (9.50%) | 22 (8.18%) | ||
Part-time employed | 180 (12.95%) | 16 (5.95%) | ||
Retired | 246 (17.70%) | 143 (53.16%) | ||
Unemployed | 106 (7.62%) | 17 (6.32%) | ||
Missing | 65 (4.68%) | 14 (5.20%) | ||
TBI severity (GCS) | Uncomplicated mild | 411 (29.57%) | 90 (33.46%) | 0.463 |
Complicated mild | 94 (6.76%) | 19 (7.06%) | ||
Moderate | 191 (13.74%) | 45 (16.73%) | ||
Severe | 464 (33.38%) | 82 (30.48%) | ||
Missing | 230 (16.55%) | 33 (12.27%) | ||
Injury Severity Score (ISS) | M (SD) | 17.93 (15.03) | 18.59 (13.88) | 0.077 |
Functional status change (Glasgow Outcome Scale–Extended; GOSE) |
Improved | 436 (31.37%) | 80 (29.74%) | 0.001 |
Stable | 785 (56.47%) | 133 (49.44%) | ||
Worsened | 169 (12.16%) | 56 (20.82%) | ||
Missing | 0 | 0 | ||
Cause of injury | Fall | 572 (41.15%) | 143 (53.16%) | 0.001 |
Road traffic accident | 595 (42.81%) | 97 (36.06%) | ||
Violent/other | 222 (15.97%) | 29 (10.78%) | ||
Missing | 1 (0.07%) | 0 | ||
Clinical care pathways | ER | 335 (24.10%) | 48 (17.84%) | 0.049 |
Admission | 536 (38.56%) | 104 (38.66%) | ||
ICU | 519 (37.34%) | 117 (43.49%) | ||
Length of hospital stay (in days) | M (SD) | 10.25 (18.16) | 12.17 (18.25) | 0.045 |
Missing | 24 (1.73%) | 5 (1.86%) |
* Sample 1 was used for the responsiveness analyses (N = 1659). ** Sample 2 was used for the CFA and measurement invariance analyses (N = 1390). Note. n = absolute frequencies, p = p-value, M = mean, SD = Standard deviation. Welch’s t-test was used for all continuous variables due to non-normal distribution; χ2-tests and permutation-based χ2-tests (n < 5 observations per cell; N = 5000 permutations) were used for categorical data.
Table A2.
Variable | Group | B (SE) | b | t | p |
---|---|---|---|---|---|
Total Score | |||||
GOSE (linear) | - | 4.129 (0.680) | 0.344 | 6.073 | <0.001 |
GOSE (ordinal) | - | 0.223 (0.511) | 0.019 | 0.436 | 0.663 |
Age | - | −0.026 (0.027) | −0.042 | −0.960 | 0.337 |
Sex (Ref: Female) | Male | −0.093 (0.635) | −0.008 | −0.147 | 0.883 |
Marital status (Ref: Partnered) | Partnered | 0.191 (0.657) | 0.016 | 0.290 | 0.772 |
Education level (Ref: College/university) | At least secondary/high school | −1.222 (0.806) | −0.102 | −1.515 | 0.132 |
None/primary school | −1.289 (1.035) | −0.107 | −1.245 | 0.214 | |
Post-high school training | −2.070 (0.880) | −0.172 | −2.354 | 0.019 | |
Employment status (Ref: Full-time employed) | In training | −0.043 (1.279) | −0.004 | −0.034 | 0.973 |
Part-time employed | 0.323 (1.001) | 0.027 | 0.323 | 0.747 | |
Retired | 1.138 (1.044) | 0.095 | 1.090 | 0.276 | |
Unemployed | −0.020 (1.206) | −0.002 | −0.017 | 0.986 | |
TBI Severity (Ref: Uncomplicated mild) | Complicated mild | 0.147 (0.805) | 0.012 | 0.183 | 0.855 |
Moderate | 0.170 (1.404) | 0.014 | 0.121 | 0.904 | |
Severe | 0.945 (1.375) | 0.079 | 0.687 | 0.493 | |
Injury severity score (ISS) | - | 0.042 (0.032) | 0.052 | 1.315 | 0.189 |
Cause of injury (Ref: Road traffic accident) | Fall | 0.621 (0.676) | 0.052 | 0.920 | 0.358 |
Violence/other | 0.436 (0.898) | 0.036 | 0.485 | 0.628 | |
Clinical care pathways (Ref: ER) | Admission | 0.483 (0.870) | 0.040 | 0.556 | 0.579 |
ICU | 0.473 (1.265) | 0.039 | 0.374 | 0.709 | |
Length of hospital stay | - | −0.024 (0.021) | −0.036 | −1.154 | 0.249 |
Cognition * | |||||
GOSE (linear) | - | 3.365 (0.904) | 0.213 | 3.722 | <0.001 |
GOSE (ordinal) | - | −0.758 (0.680) | −0.048 | −1.114 | 0.265 |
Age | - | 0.025 (0.036) | 0.031 | 0.704 | 0.482 |
Sex (Ref: Female) | Male | −1.030 (0.846) | −0.065 | −1.218 | 0.223 |
Marital status (Ref: Partnered) | Partnered | 1.244 (0.871) | 0.079 | 1.429 | 0.153 |
Education level (Ref: College/university) | At least secondary/high school | −1.153 (1.114) | −0.073 | −1.035 | 0.304 |
None/primary school | −2.023 (1.337) | −0.128 | −1.514 | 0.131 | |
Post-high school training | −1.930 (1.207) | −0.122 | −1.599 | 0.111 | |
Employment status (Ref: Full-time employed) | In training | 0.714 (1.689) | 0.045 | 0.423 | 0.673 |
Part-time employed | 0.757 (1.396) | 0.048 | 0.542 | 0.589 | |
Retired | −0.269 (1.369) | −0.017 | −0.196 | 0.845 | |
Unemployed | −0.023 (1.600) | −0.001 | −0.014 | 0.989 | |
TBI Severity (Ref: Uncomplicated mild) | Complicated mild | 0.687 (1.060) | 0.043 | 0.648 | 0.517 |
Moderate | −0.510 (1.945) | −0.032 | −0.262 | 0.794 | |
Severe | 2.033 (1.788) | 0.129 | 1.137 | 0.257 | |
Injury severity score (ISS) | - | −0.004 (0.042) | −0.003 | −0.085 | 0.932 |
Cause of injury (Ref: Road traffic accident) | Fall | −0.634 (0.899) | −0.040 | −0.705 | 0.481 |
Violence/other | -0.763 (1.195) | -0.048 | -0.639 | 0.523 | |
Clinical care pathways (Ref: ER) | Admission | 0.342 (1.159) | 0.022 | 0.295 | 0.768 |
ICU | 1.143 (1.675) | 0.072 | 0.682 | 0.495 | |
Length of hospital stay | - | −0.035 (0.028) | −0.040 | −1.252 | 0.211 |
Self * | |||||
GOSE (linear) | - | 4.725 (0.932) | 0.289 | 5.070 | <0.001 |
GOSE (ordinal) | - | −0.223 (0.701) | −0.014 | −0.318 | 0.750 |
Age | - | 0.011 (0.037) | 0.012 | 0.284 | 0.777 |
Sex (Ref: Female) | Male | −0.176 (0.871) | −0.011 | −0.202 | 0.840 |
Marital status (Ref: Partnered) | Partnered | 0.639 (0.900) | 0.039 | 0.710 | 0.478 |
Education level (Ref: College/university) | At least secondary/high school | −0.655 (1.048) | −0.040 | −0.625 | 0.532 |
None/primary school | −0.948 (1.356) | −0.058 | −0.699 | 0.485 | |
Post-high school training | −1.908 (1.210) | −0.117 | −1.577 | 0.115 | |
Employment status (Ref: Full-time employed) | In training | −0.993 (1.715) | −0.061 | −0.579 | 0.563 |
Part-time employed | −0.554 (1.361) | −0.034 | −0.407 | 0.684 | |
Retired | −0.015 (1.441) | −0.001 | −0.010 | 0.992 | |
Unemployed | 0.255 (1.642) | 0.016 | 0.155 | 0.877 | |
TBI Severity (Ref: Uncomplicated mild) | Complicated mild | 0.107 (1.103) | 0.007 | 0.097 | 0.923 |
Moderate | 0.454 (1.822) | 0.028 | 0.249 | 0.803 | |
Severe | −0.632 (1.884) | −0.039 | −0.336 | 0.738 | |
Injury severity score (ISS) | - | −0.034 (0.028) | −0.038 | −1.196 | 0.232 |
Cause of injury (Ref: Road traffic accident) | Fall | 1.240 (0.926) | 0.076 | 1.339 | 0.181 |
Violence/other | 0.560 (1.229) | 0.034 | 0.456 | 0.649 | |
Clinical care pathways (Ref: ER) | Admission | 0.706 (1.193) | 0.043 | 0.591 | 0.554 |
ICU | 0.777 (1.730) | 0.048 | 0.449 | 0.653 | |
Length of hospital stay | - | −0.034 (0.028) | −0.038 | −1.196 | 0.232 |
Daily Life & Autonomy * | |||||
GOSE (linear) | - | 6.384 (0.977) | 0.365 | 6.536 | <0.001 |
GOSE (ordinal) | - | 1.204 (0.735) | 0.069 | 1.639 | 0.102 |
Age | - | −0.072 (0.038) | −0.079 | −1.875 | 0.061 |
Sex (Ref: Female) | Male | 0.004 (0.916) | 0.000 | 0.005 | 0.996 |
Marital status (Ref: Partnered) | Partnered | −1.174 (0.948) | −0.067 | −1.239 | 0.216 |
Education level (Ref: College/university) | At least secondary/high school | −0.796 (1.116) | −0.045 | −0.713 | 0.476 |
None/primary school | 0.498 (1.545) | 0.028 | 0.323 | 0.748 | |
Post-high school training | −2.608 (1.275) | −0.149 | −2.046 | 0.041 | |
Employment status (Ref: Full-time employed) | In training | −1.046 (1.784) | −0.060 | −0.586 | 0.558 |
Part-time employed | 0.474 (1.449) | 0.027 | 0.327 | 0.744 | |
Retired | 2.578 (1.497) | 0.147 | 1.721 | 0.086 | |
Unemployed | 0.768 (1.680) | 0.044 | 0.457 | 0.648 | |
TBI Severity (Ref: Uncomplicated mild) | Complicated mild | 1.277 (1.223) | 0.073 | 1.044 | 0.298 |
Moderate | 1.369 (2.141) | 0.078 | 0.640 | 0.524 | |
Severe | 2.013 (1.952) | 0.115 | 1.031 | 0.304 | |
Injury severity score (ISS) | - | 0.086 (0.046) | 0.073 | 1.878 | 0.061 |
Cause of injury (Ref: Road traffic accident) | Fall | −0.386 (0.971) | −0.022 | −0.398 | 0.691 |
Violence/other | −0.266 (1.289) | −0.015 | −0.207 | 0.836 | |
Clinical care pathways (Ref: ER) | Admission | 1.713 (1.263) | 0.098 | 1.356 | 0.175 |
ICU | 2.060 (1.846) | 0.118 | 1.116 | 0.265 | |
Length of hospital stay | - | −0.024 (0.029) | −0.025 | −0.832 | 0.405 |
Social Relationships * | |||||
GOSE (linear) | - | 2.646 (0.900) | 0.168 | 2.942 | 0.003 |
GOSE (ordinal) | - | 0.035 (0.676) | 0.002 | 0.051 | 0.959 |
Age | - | −0.035 (0.036) | −0.042 | −0.965 | 0.335 |
Sex (Ref: Female) | Male | 0.203 (0.841) | 0.013 | 0.242 | 0.809 |
Marital status (Ref: Partnered) | Partnered | 1.192 (0.865) | 0.076 | 1.377 | 0.169 |
Education level (Ref: College/university) | At least secondary/high school | −0.237 (1.056) | −0.015 | −0.225 | 0.822 |
None/primary school | −1.068 (1.418) | −0.068 | −0.753 | 0.453 | |
Post-high school training | −2.181 (1.151) | −0.139 | −1.895 | 0.058 | |
Employment status (Ref: Full-time employed) | In training | 0.408 (1.654) | 0.026 | 0.247 | 0.805 |
Part-time employed | −0.350 (1.295) | −0.022 | −0.270 | 0.787 | |
Retired | 2.075 (1.410) | 0.132 | 1.472 | 0.142 | |
Unemployed | 0.458 (1.568) | 0.029 | 0.292 | 0.770 | |
TBI Severity (Ref: Uncomplicated mild) | Complicated mild | −0.912 (1.267) | −0.058 | −0.720 | 0.477 |
Moderate | −0.353 (1.976) | −0.022 | −0.178 | 0.859 | |
Severe | 0.489 (1.969) | 0.031 | 0.248 | 0.805 | |
Injury severity score (ISS) | - | 0.055 (0.042) | 0.052 | 1.305 | 0.192 |
Cause of injury (Ref: Road traffic accident) | Fall | 0.771 (0.894) | 0.049 | 0.862 | 0.389 |
Violence/other | 1.047 (1.187) | 0.067 | 0.883 | 0.378 | |
Clinical care pathways (Ref: ER) | Admission | 0.645 (1.185) | 0.041 | 0.544 | 0.587 |
ICU | −1.019 (1.758) | −0.065 | −0.580 | 0.563 | |
Length of hospital stay | - | −0.008 (0.027) | −0.009 | −0.296 | 0.767 |
Emotions * | |||||
GOSE (linear) | - | 2.985 (1.177) | 0.145 | 2.536 | 0.011 |
GOSE (ordinal) | - | 0.259 (0.886) | 0.013 | 0.293 | 0.770 |
Age | - | −0.038 (0.047) | −0.035 | −0.803 | 0.422 |
Sex (Ref: Female) | Male | 0.901 (1.101) | 0.044 | 0.818 | 0.414 |
Marital status (Ref: Partnered) | Partnered | 0.481 (1.132) | 0.023 | 0.425 | 0.671 |
Education level (Ref: College/university) | At least secondary/high school | −2.149 (1.360) | −0.105 | −1.580 | 0.115 |
None/primary school | −1.548 (1.745) | −0.075 | −0.887 | 0.375 | |
Post-high school training | −1.348 (1.493) | −0.066 | −0.903 | 0.367 | |
Employment status (Ref: Full-time employed) | In training | 1.807 (2.222) | 0.088 | 0.813 | 0.417 |
Part-time employed | −0.334 (1.675) | −0.016 | −0.200 | 0.842 | |
Retired | 1.127 (1.805) | 0.055 | 0.624 | 0.532 | |
Unemployed | 1.514 (2.059) | 0.074 | 0.735 | 0.462 | |
TBI Severity (Ref: Uncomplicated mild) | Complicated mild | −0.800 (1.436) | −0.039 | −0.557 | 0.578 |
Moderate | −1.690 (2.412) | −0.082 | −0.701 | 0.484 | |
Severe | 0.075 (2.172) | 0.004 | 0.035 | 0.972 | |
Injury severity score (ISS) | - | 0.052 (0.056) | 0.038 | 0.928 | 0.354 |
Cause of injury (Ref: Road traffic accident) | Fall | 1.728 (1.173) | 0.084 | 1.473 | 0.141 |
Violence/other | 1.182 (1.560) | 0.058 | 0.757 | 0.449 | |
Clinical care pathways (Ref: ER) | Admission | 0.237 (1.513) | 0.012 | 0.157 | 0.875 |
ICU | −0.779 (2.186) | −0.038 | −0.357 | 0.722 | |
Length of hospital stay | - | −0.019 (0.035) | −0.017 | −0.532 | 0.595 |
Physical Problems * | |||||
GOSE (linear) | - | 3.960 (1.024) | 0.219 | 3.866 | <0.001 |
GOSE (ordinal) | - | 1.207 (0.771) | 0.067 | 1.565 | 0.118 |
Age | - | −0.059 (0.040) | −0.063 | −1.471 | 0.141 |
Sex (Ref: Female) | Male | 0.095 (0.958) | 0.005 | 0.099 | 0.921 |
Marital status (Ref: Partnered) | Partnered | −1.675 (0.991) | −0.093 | −1.689 | 0.091 |
Education level (Ref: College/university) | At least secondary/high school | −2.352 (1.209) | −0.130 | −1.945 | 0.053 |
None/primary school | −3.125 (1.506) | −0.173 | −2.075 | 0.038 | |
Post-high school training | −2.365 (1.397) | −0.131 | −1.692 | 0.092 | |
Employment status (Ref: Full-time employed) | In training | −0.444 (1.869) | −0.025 | −0.238 | 0.812 |
Part-time employed | 2.336 (1.551) | 0.129 | 1.506 | 0.134 | |
Retired | 1.498 (1.563) | 0.083 | 0.958 | 0.338 | |
Unemployed | −2.687 (1.841) | −0.149 | −1.459 | 0.146 | |
TBI Severity (Ref: Uncomplicated mild) | Complicated mild | 0.059 (1.377) | 0.003 | 0.043 | 0.966 |
Moderate | 1.819 (2.153) | 0.101 | 0.845 | 0.399 | |
Severe | 1.909 (1.973) | 0.106 | 0.967 | 0.334 | |
Injury severity score (ISS) | - | 0.032 (0.048) | 0.026 | 0.665 | 0.506 |
Cause of injury (Ref: Road traffic accident) | Fall | 1.692 (1.018) | 0.094 | 1.662 | 0.097 |
Violence/other | 1.249 (1.353) | 0.069 | 0.923 | 0.356 | |
Clinical care pathways (Ref: ER) | Admission | −1.375 (1.337) | −0.076 | −1.028 | 0.304 |
ICU | −0.395 (1.942) | −0.022 | −0.203 | 0.839 | |
Length of hospital stay | - | −0.023 (0.031) | −0.023 | −0.726 | 0.468 |
Note. B = unstandardized regression coefficient, SE = standard error, b = standardized regression coefficient, t = t-value, p = p-value. Values in bold are significant at 5% (total score) or at 0.8% (scale scores; Bonferroni-adjusted marked with *). ER = emergency room, ICU = intensive care unit.
Author Contributions
Conceptualization, M.Z., S.H. and I.M.; Data curation, M.Z. and S.H.; Formal analysis, M.Z., S.H. and I.M.; Funding acquisition, N.v.S.; Methodology, M.Z., S.H. and I.M.; Resources, N.v.S.; Software, M.Z., S.H. and I.M.; Supervision, N.v.S.; Visualization, M.Z. and S.H.; Writing—original draft, M.Z., S.H., I.M., U.K. and N.v.S.; Writing—review and editing, M.Z., S.H., I.M., U.K., F.B. and N.v.S. All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
The CENTER-TBI study (EC grant 602150) has been conducted in accordance with all relevant laws of the European Union (EU) if directly applicable or of direct effect and all relevant laws of the country where the recruiting sites were located. Informed consent by the patients and/or the legal representative/next of kin was obtained, accordingly to the local legislation, for all patients recruited in the Core Dataset of CENTER-TBI and documented in the electronic case report form (e-CRF). For the full list of sites, ethical committees, and ethical approval details, see the official CENTER-TBI website (https://www.center-tbi.eu/project/ethical-approval, accessed on 4 November 2021).
Informed Consent Statement
Written informed consent was obtained from all subjects involved in the study.
Data Availability Statement
All relevant data are available upon request from CENTER-TBI, and the authors are not legally allowed to share it publicly. The authors confirm that they received no special access privileges to the data. CENTER-TBI is committed to data sharing and, in particular, to responsible further use of the data. Hereto, we have a data sharing statement in place: https://www.center-tbi.eu/data/sharing (accessed on 27 April 2023). The CENTER-TBI Management Committee, in collaboration with the General Assembly, established the Data Sharing policy and Publication and Authorship Guidelines to ensure the correct and appropriate use of the data as the dataset is hugely complex and requires the help of experts from the Data Curation Team or Bio-Statistical Team for correct use. This means that we encourage researchers to contact the CENTER-TBI team for any research plans and the Data Curation Team for any help in the appropriate use of the data, including sharing of scripts. Requests for data access can be submitted online: https://www.center-tbi.eu/data (accessed on 27 April 2023). The complete Manual for data access is also available online: https://www.center-tbi.eu/files/SOP-Manual-DAPR-2402020.pdf (accessed on 27 April 2023).
Conflicts of Interest
The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.
Funding Statement
CENTER-TBI was supported by the European Union 7th Framework programme (EC grant 602150). Additional funding was obtained from the Hannelore Kohl Stiftung (Germany), from OneMind (USA), from Integra LifeSciences Corporation (USA), and from NeuroTrauma Sciences (USA).
Footnotes
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
References
- 1.Hays R.D., Morales L.S. The RAND-36 Measure of Health-Related Quality of Life. Ann. Med. 2001;33:350–357. doi: 10.3109/07853890109002089. [DOI] [PubMed] [Google Scholar]
- 2.Cella D.F., Bonomi A.E. Measuring Quality of Life: 1995 Update. Oncol. Williston Park N. 1995;9:47–60. [PubMed] [Google Scholar]
- 3.Maas A.I.R., Menon D.K., Adelson P.D., Andelic N., Bell M.J., Belli A., Bragge P., Brazinova A., Büki A., Chesnut R.M., et al. Traumatic Brain Injury: Integrated Approaches to Improve Prevention, Clinical Care, and Research. Lancet Neurol. 2017;16:987–1048. doi: 10.1016/S1474-4422(17)30371-X. [DOI] [PubMed] [Google Scholar]
- 4.von Steinbuechel N., Covic A., Polinder S., Kohlmann T., Cepulyte U., Poinstingl H., Backhaus J., Bakx W., Bullinger M., Christensen A.-L., et al. Assessment of Health-Related Quality of Life after TBI: Comparison of a Disease-Specific (QOLIBRI) with a Generic (SF-36) Instrument. Behav. Neurol. 2016;2016:7928014. doi: 10.1155/2016/7928014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.von Steinbuechel N., Petersen C., Bullinger M., the QOLIBRI Group Assessment of Health-Related Quality of Life in Persons after Traumatic Brain Injury—Development of the Qolibri, a Specific Measure. Acta Neurochir. Suppl. 2005;93:43–49. doi: 10.1007/3-211-27577-0_6. [DOI] [PubMed] [Google Scholar]
- 6.Maas A.I.R., Stocchetti N., Bullock R. Moderate and Severe Traumatic Brain Injury in Adults. Lancet Neurol. 2008;7:728–741. doi: 10.1016/S1474-4422(08)70164-9. [DOI] [PubMed] [Google Scholar]
- 7.Coronado V.G., Xu L., Basavaraju S.V., McGuire L.C., Wald M.M., Faul M.D., Guzman B.R., Hemphill J.D., Centers for Disease Control and Prevention (CDC) Surveillance for Traumatic Brain Injury-Related Deaths—United States, 1997–2007. Morb. Mortal. Wkly. Rep. Surveill. Summ. 2011;60:1–32. [PubMed] [Google Scholar]
- 8.Brooks J.C., Strauss D.J., Shavelle R.M., Paculdo D.R., Hammond F.M., Harrison-Felix C.L. Long-Term Disability and Survival in Traumatic Brain Injury: Results from the National Institute on Disability and Rehabilitation Research Model Systems. Arch. Phys. Med. Rehabil. 2013;94:2203–2209. doi: 10.1016/j.apmr.2013.07.005. [DOI] [PubMed] [Google Scholar]
- 9.Majdan M., Plancikova D., Brazinova A., Rusnak M., Nieboer D., Feigin V., Maas A. Epidemiology of Traumatic Brain Injuries in Europe: A Cross-Sectional Analysis. Lancet Public Health. 2016;1:e76–e83. doi: 10.1016/S2468-2667(16)30017-2. [DOI] [PubMed] [Google Scholar]
- 10.Hyder A.A., Wunderlich C.A., Puvanachandra P., Gururaj G., Kobusingye O.C. The Impact of Traumatic Brain Injuries: A Global Perspective. NeuroRehabilitation. 2007;22:341–353. doi: 10.3233/NRE-2007-22502. [DOI] [PubMed] [Google Scholar]
- 11.Reilly P. Progress in Brain Research. Volume 161. Elsevier; Amsterdam, The Netherlands: 2007. The Impact of Neurotrauma on Society: An International Perspective; pp. 3–9. [DOI] [PubMed] [Google Scholar]
- 12.Brooks J.C., Shavelle R.M., Strauss D.J., Hammond F.M., Harrison-Felix C.L. Long-Term Survival After Traumatic Brain Injury Part II: Life Expectancy. Arch. Phys. Med. Rehabil. 2015;96:1000–1005. doi: 10.1016/j.apmr.2015.02.002. [DOI] [PubMed] [Google Scholar]
- 13.Langlois J.A., Rutland-Brown W., Wald M.M. The Epidemiology and Impact of Traumatic Brain Injury: A Brief Overview. J. Head Trauma Rehabil. 2006;21:375–378. doi: 10.1097/00001199-200609000-00001. [DOI] [PubMed] [Google Scholar]
- 14.Ma V.Y., Chan L., Carruthers K.J. Incidence, Prevalence, Costs, and Impact on Disability of Common Conditions Requiring Rehabilitation in the United States: Stroke, Spinal Cord Injury, Traumatic Brain Injury, Multiple Sclerosis, Osteoarthritis, Rheumatoid Arthritis, Limb Loss, and Back Pain. Arch. Phys. Med. Rehabil. 2014;95:986–995.e1. doi: 10.1016/j.apmr.2013.10.032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Dawson D.R., Schwartz M.L., Winocur G., Stuss D.T. Return to Productivity Following Traumatic Brain Injury: Cognitive, Psychological, Physical, Spiritual, and Environmental Correlates. Disabil. Rehabil. 2007;29:301–313. doi: 10.1080/09638280600756687. [DOI] [PubMed] [Google Scholar]
- 16.Draper K., Ponsford J., Schönberger M. Psychosocial and Emotional Outcomes 10 Years Following Traumatic Brain Injury. J. Head Trauma Rehabil. 2007;22:278–287. doi: 10.1097/01.HTR.0000290972.63753.a7. [DOI] [PubMed] [Google Scholar]
- 17.Wood R.L., Rutterford N. Psychosocial Adjustment 17 Years after Severe Brain Injury. J. Neurol. Neurosurg. Psychiatry. 2006;77:71–73. doi: 10.1136/jnnp.2005.065540. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Polinder S., Cnossen M.C., Real R.G.L., Covic A., Gorbunova A., Voormolen D.C., Master C.L., Haagsma J.A., Diaz-Arrastia R., von Steinbuechel N. A Multidimensional Approach to Post-Concussion Symptoms in Mild Traumatic Brain Injury. Front. Neurol. 2018;9:1113. doi: 10.3389/fneur.2018.01113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Walker W.C., Pickett T.C. Motor Impairment after Severe Traumatic Brain Injury: A Longitudinal Multicenter Study. J. Rehabil. Res. Dev. 2007;44:975–982. doi: 10.1682/JRRD.2006.12.0158. [DOI] [PubMed] [Google Scholar]
- 20.Moore E.L., Terryberry-Spohr L., Hope D.A. Mild Traumatic Brain Injury and Anxiety Sequelae: A Review of the Literature. Brain Inj. 2006;20:117–132. doi: 10.1080/02699050500443558. [DOI] [PubMed] [Google Scholar]
- 21.Teymoori A., Real R., Gorbunova A., Haghish E.F., Andelic N., Wilson L., Asendorf T., Menon D., von Steinbüchel N. Measurement Invariance of Assessments of Depression (PHQ-9) and Anxiety (GAD-7) across Sex, Strata and Linguistic Backgrounds in a European-Wide Sample of Patients after Traumatic Brain Injury. J. Affect. Disord. 2020;262:278–285. doi: 10.1016/j.jad.2019.10.035. [DOI] [PubMed] [Google Scholar]
- 22.Wang B., Zeldovich M., Rauen K., Wu Y.-J., Covic A., Muller I., Haagsma J.A., Polinder S., Menon D., Asendorf T., et al. Longitudinal Analyses of the Reciprocity of Depression and Anxiety after Traumatic Brain Injury and Its Clinical Implications. J. Clin. Med. 2021;10:5597. doi: 10.3390/jcm10235597. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Jorge R.E., Robinson R.G., Moser D., Tateno A., Crespo-Facorro B., Arndt S. Major Depression Following Traumatic Brain Injury. Arch. Gen. Psychiatry. 2004;61:42–50. doi: 10.1001/archpsyc.61.1.42. [DOI] [PubMed] [Google Scholar]
- 24.van der Vlegel M., Polinder S., Mikolic A., Kaplan R., von Steinbuechel N., Plass A., Zeldovich M., van Praag D., Bockhop F., Cunitz K., et al. The Association of Post-Concussion and Post-Traumatic Stress Disorder Symptoms with Health-Related Quality of Life, Health Care Use and Return-to-Work after Mild Traumatic Brain Injury. J. Clin. Med. 2021;10:2473. doi: 10.3390/jcm10112473. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Verhaeghe S., Defloor T., Grypdonck M. Stress and Coping among Families of Patients with Traumatic Brain Injury: A Review of the Literature. J. Clin. Nurs. 2005;14:1004–1012. doi: 10.1111/j.1365-2702.2005.01126.x. [DOI] [PubMed] [Google Scholar]
- 26.von Steinbuechel N., Wilson L., Gibbons H., Hawthorne G., Höfer S., Schmidt S., Bullinger M., Maas A., Neugebauer E., Powell J., et al. Quality of Life after Brain Injury (QOLIBRI): Scale Development and Metric Properties. J. Neurotrauma. 2010;27:1167–1185. doi: 10.1089/neu.2009.1076. [DOI] [PubMed] [Google Scholar]
- 27.von Steinbuechel N., Wilson L., Gibbons H., Hawthorne G., Höfer S., Schmidt S., Bullinger M., Maas A., Neugebauer E., Powell J., et al. Quality of Life after Brain Injury (QOLIBRI): Scale Validity and Correlates of Quality of Life. J. Neurotrauma. 2010;27:1157–1165. doi: 10.1089/neu.2009.1077. [DOI] [PubMed] [Google Scholar]
- 28.von Steinbuechel N., Rauen K., Krenz U., Wu Y.-J., Covic A., Plass A., Cunitz K., Mueller I., Bockhop F., Polinder S., et al. Translation and Linguistic Validation of Outcome Instruments for Traumatic Brain Injury Research and Clinical Practice: A Step-by-Step Approach within the Observational CENTER-TBI Study. J. Clin. Med. 2021;10:2863. doi: 10.3390/jcm10132863. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.von Steinbuechel N., Rauen K., Bockhop F., Covic A., Krenz U., Plass A., Cunitz K., Polinder S., Wilson L., Steyerberg E., et al. Psychometric Characteristics of the Patient-Reported Outcome Measures Applied in the CENTER-TBI Study. J. Clin. Med. 2021;10:2396. doi: 10.3390/jcm10112396. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Giustini M., Longo E., Azicnuda E., Silvestro D., D’Ippolito M., Rigon J., Cedri C., Bivona U., Barba C., Formisano R. Health-Related Quality of Life after Traumatic Brain Injury: Italian Validation of the QOLIBRI. Funct. Neurol. 2014;29:167–176. [PMC free article] [PubMed] [Google Scholar]
- 31.Hawthorne G., Kaye A.H., Gruen R., Houseman D., Bauer I. Traumatic Brain Injury and Quality of Life: Initial Australian Validation of the QOLIBRI. J. Clin. Neurosci. 2011;18:197–202. doi: 10.1016/j.jocn.2010.06.015. [DOI] [PubMed] [Google Scholar]
- 32.Siponkoski S., Wilson L., Steinbüchel N., Sarajuuri J., Koskinen S. Quality of Life after Traumatic Brain Injury: Finnish Experience of the QOLIBRI in Residential Rehabilitation. J. Rehabil. Med. 2013;45:835–842. doi: 10.2340/16501977-1189. [DOI] [PubMed] [Google Scholar]
- 33.Soberg H.L., Roe C., Brunborg C., von Steinbüchel N., Andelic N. The Norwegian Version of the QOLIBRI—A Study of Metric Properties Based on a 12 Month Follow-up of Persons with Traumatic Brain Injury. Health Qual. Life Outcomes. 2017;15:14. doi: 10.1186/s12955-017-0589-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Castaño-León A.M., Navarro-Main B., Gomez P.A., Gil A., Soler M.D., Lagares A., Bernabeu M., Steinbüchel N.v., Real R.G.L. Quality of Life After Brain Injury: Psychometric Properties of the Spanish Translation of the QoLIBRI. Eval. Health Prof. 2018;41:456–473. doi: 10.1177/0163278717702696. [DOI] [PubMed] [Google Scholar]
- 35.von Steinbuechel N., Rauen K., Covic A., Krenz U., Bockhop F., Mueller I., Cunitz K., Polinder S., Steyerberg E.W., Vester J., et al. Sensitivity of Outcome Instruments in a Priori Selected Patient Groups after Traumatic Brain Injury: Results from the CENTER-TBI Study. PLoS ONE. 2023;18:e0280796. doi: 10.1371/journal.pone.0280796. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Brazier J.E., Harper R., Jones N.M., O’Cathain A., Thomas K.J., Usherwood T., Westlake L. Validating the SF-36 Health Survey Questionnaire: New Outcome Measure for Primary Care. BMJ. 1992;305:160–164. doi: 10.1136/bmj.305.6846.160. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.von Steinbüchel N., Meeuwsen M., Zeldovich M., Vester J.C., Maas A., Koskinen S., Covic A. Differences in Health-Related Quality of Life after Traumatic Brain Injury between Varying Patient Groups: Sensitivity of a Disease-Specific (QOLIBRI) and a Generic (SF-36) Instrument. J. Neurotrauma. 2020;37:1242–1254. doi: 10.1089/neu.2019.6627. [DOI] [PubMed] [Google Scholar]
- 38.Albrecht G.L., Devlieger P.J. The Disability Paradox: High Quality of Life against All Odds. Soc. Sci. Med. 1999;48:977–988. doi: 10.1016/S0277-9536(98)00411-0. [DOI] [PubMed] [Google Scholar]
- 39.Ahmed S., Mayo N.E., Wood-Dauphinee S., Hanley J.A., Robin Cohen S. Response Shift Influenced Estimates of Change in Health-Related Quality of Life Poststroke. J. Clin. Epidemiol. 2004;57:561–570. doi: 10.1016/j.jclinepi.2003.11.003. [DOI] [PubMed] [Google Scholar]
- 40.Ring L., Höfer S., Heuston F., Harris D., O’Boyle C.A. Response Shift Masks the Treatment Impact on Patient Reported Outcomes (PROs): The Example of Individual Quality of Life in Edentulous Patients. Health Qual. Life Outcomes. 2005;3:55. doi: 10.1186/1477-7525-3-55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Postulart D., Adang E.M.M. Response Shift and Adaptation in Chronically III Patients. Med. Decis. Mak. 2000;20:186–193. doi: 10.1177/0272989X0002000204. [DOI] [PubMed] [Google Scholar]
- 42.Schwartz C.E., Sprangers M.A.G., editors. Adaptation to Changing Health: Response Shift in Quality-of-Life Research. 1st ed. American Psychological Association; Washington, DC, USA: 2000. [Google Scholar]
- 43.Schwartz C.E., Andresen E.M., Nosek M.A., Krahn G.L. Response Shift Theory: Important Implications for Measuring Quality of Life in People with Disability. Arch. Phys. Med. Rehabil. 2007;88:529–536. doi: 10.1016/j.apmr.2006.12.032. [DOI] [PubMed] [Google Scholar]
- 44.Terwee C.B., Dekker F.W., Wiersinga W.M., Prummel M.F., Bossuyt P.M.M. On Assessing Responsiveness of Health-Related Quality of Life Instruments: Guidelines for Instrument Evaluation. Qual. Life Res. Int. J. Qual. Life Asp. Treat. Care Rehabil. 2003;12:349–362. doi: 10.1023/A:1023499322593. [DOI] [PubMed] [Google Scholar]
- 45.Husted J.A., Cook R.J., Farewell V.T., Gladman D.D. Methods for Assessing Responsiveness: A Critical Review and Recommendations. J. Clin. Epidemiol. 2000;53:459–468. doi: 10.1016/S0895-4356(99)00206-1. [DOI] [PubMed] [Google Scholar]
- 46.Wilson J.T.L., Pettigrew L.E.L., Teasdale G. Structured Interviews for the Glasgow Outcome Scale and the Extended Glasgow Outcome Scale: Guidelines for Their Use. J. Neurotrauma. 1998;15:573–585. doi: 10.1089/neu.1998.15.573. [DOI] [PubMed] [Google Scholar]
- 47.Maas A.I.R., Menon D.K., Steyerberg E.W., Citerio G., Lecky F., Manley G.T., Hill S., Legrand V., Sorgner A. Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI): A Prospective Longitudinal Observational Study. Neurosurgery. 2015;76:67–80. doi: 10.1227/NEU.0000000000000575. [DOI] [PubMed] [Google Scholar]
- 48.Steyerberg E.W., Wiegers E., Sewalt C., Buki A., Citerio G., De Keyser V., Ercole A., Kunzmann K., Lanyon L., Lecky F., et al. Case-Mix, Care Pathways, and Outcomes in Patients with Traumatic Brain Injury in CENTER-TBI: A European Prospective, Multicentre, Longitudinal, Cohort Study. Lancet Neurol. 2019;18:923–934. doi: 10.1016/S1474-4422(19)30232-7. [DOI] [PubMed] [Google Scholar]
- 49.Teasdale G., Jennett B. Assessment of Coma and Impaired Consciousness. A Practical Scale. Lancet. 1974;2:81–84. doi: 10.1016/S0140-6736(74)91639-0. [DOI] [PubMed] [Google Scholar]
- 50.Marmarou A., Lu J., Butcher I., McHugh G.S., Murray G.D., Steyerberg E.W., Mushkudiani N.A., Choi S., Maas A.I.R. Prognostic Value of The Glasgow Coma Scale and Pupil Reactivity in Traumatic Brain Injury Assessed Pre-Hospital and on Enrollment: An IMPACT Analysis. J. Neurotrauma. 2007;24:270–280. doi: 10.1089/neu.2006.0029. [DOI] [PubMed] [Google Scholar]
- 51.Baker S.P., O’Neill B., Haddon W., Long W.B. The Injury Severity Score: A Method for Describing Patients with Multiple Injuries and Evaluating Emergency Care. J. Trauma. 1974;14:187–196. doi: 10.1097/00005373-197403000-00001. [DOI] [PubMed] [Google Scholar]
- 52.Wilson J.T.L., Edwards P., Fiddes H., Stewart E., Teasdale G.M. Reliability of Postal Questionnaires for the Glasgow Outcome Scale. J. Neurotrauma. 2002;19:999–1005. doi: 10.1089/089771502760341910. [DOI] [PubMed] [Google Scholar]
- 53.Rosseel Y. Lavaan: An R Package for Structural Equation Modeling. J. Stat. Softw. 2012;48:1–36. doi: 10.18637/jss.v048.i02. [DOI] [Google Scholar]
- 54.R Core Team . R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing; Vienna, Austria: 2022. [(accessed on 27 April 2023)]. Available online: https://www.R-project.org/ [Google Scholar]
- 55.Hu L., Bentler P. Evaluating Model Fit. In: Hoyle R.H., editor. Structural Equation Modeling. Sage Publications; Thousand Oaks, CA, USA: 1995. pp. 76–99. [Google Scholar]
- 56.Brown T.A. Confirmatory Factor Analysis for Applied Research. 2nd ed. The Guilford Press; New York, NY, USA: London, UK: 2015. Methodology in the Social Sciences. [Google Scholar]
- 57.Hu L., Bentler P.M. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Struct. Equ. Model. Multidiscip. J. 1999;6:1–55. doi: 10.1080/10705519909540118. [DOI] [Google Scholar]
- 58.Liu Y., Millsap R.E., West S.G., Tein J.-Y., Tanaka R., Grimm K.J. Testing Measurement Invariance in Longitudinal Data with Ordered-Categorical Measures. Psychol. Methods. 2017;22:486–506. doi: 10.1037/met0000075. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Oort F.J. Using Structural Equation Modeling to Detect Response Shifts and True Change. Qual. Life Res. Int. J. Qual. Life Asp. Treat. Care Rehabil. 2005;14:587–598. doi: 10.1007/s11136-004-0830-y. [DOI] [PubMed] [Google Scholar]
- 60.Wu H., Estabrook R. Identification of Confirmatory Factor Analysis Models of Different Levels of Invariance for Ordered Categorical Outcomes. Psychometrika. 2016;81:1014–1045. doi: 10.1007/s11336-016-9506-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Bates D., Mächler M., Bolker B., Walker S. Fitting Linear Mixed-Effects Models Using Lme4. J. Stat. Softw. 2015;67:48. doi: 10.18637/jss.v067.i01. [DOI] [Google Scholar]
- 62.Van Buuren S., Groothuis-Oudshoorn K. Mice: Multivariate Imputation by Chained Equations in R. J. Stat. Softw. 2011;45:1–67. doi: 10.18637/jss.v045.i03. [DOI] [Google Scholar]
- 63.Robin X., Turck N., Hainard A., Tiberti N., Lisacek F., Sanchez J.-C., Müller M. PROC: An Open-Source Package for R and S+ to Analyze and Compare ROC Curves. BMC Bioinform. 2011;12:77. doi: 10.1186/1471-2105-12-77. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.van der Windt D.A.W.M., van der Heijden G.J.M.G., de Winter A.F., Koes B.W., Deville W., Bouter L.M. The Responsiveness of the Shoulder Disability Questionnaire. Ann. Rheum. Dis. 1998;57:82–87. doi: 10.1136/ard.57.2.82. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Kassambara A. Rstatix: Pipe-Friendly Framework for Basic Statistical Tests. 2022. R Package Version 0.7.2. [(accessed on 27 April 2023)]. Available online: https://CRAN.R-project.org/package=rstatix.
- 66.Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. L. Erlbaum Associates; Hillsdale, NJ, USA: 1988. [Google Scholar]
- 67.Gardner R.C., Cheng J., Ferguson A.R., Boylan R., Boscardin J., Zafonte R.D., Manley G.T., The Citicoline Brain Injury Treatment Trial Investigators. Zafonte R.D., Bagiella E., et al. Divergent Six Month Functional Recovery Trajectories and Predictors after Traumatic Brain Injury: Novel Insights from the Citicoline Brain Injury Treatment Trial Study. J. Neurotrauma. 2019;36:2521–2532. doi: 10.1089/neu.2018.6167. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Losoi H., Silverberg N.D., Wäljas M., Turunen S., Rosti-Otajärvi E., Helminen M., Luoto T.M., Julkunen J., Öhman J., Iverson G.L. Recovery from Mild Traumatic Brain Injury in Previously Healthy Adults. J. Neurotrauma. 2016;33:766–776. doi: 10.1089/neu.2015.4070. [DOI] [PubMed] [Google Scholar]
- 69.Vedantam A., Robertson C.S., Gopinath S.P. Clinical Characteristics and Temporal Profile of Recovery in Patients with Favorable Outcomes at 6 Months after Severe Traumatic Brain Injury. J. Neurosurg. 2018;129:234–240. doi: 10.3171/2017.3.JNS162720. [DOI] [PubMed] [Google Scholar]
- 70.McCrea M.A., Giacino J.T., Barber J., Temkin N.R., Nelson L.D., Levin H.S., Dikmen S., Stein M., Bodien Y.G., Boase K., et al. Functional Outcomes Over the First Year After Moderate to Severe Traumatic Brain Injury in the Prospective, Longitudinal TRACK-TBI Study. JAMA Neurol. 2021;78:982. doi: 10.1001/jamaneurol.2021.2043. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Cassidy J.D., Boyle E., Carroll L.J. Population-Based, Inception Cohort Study of the Incidence, Course, and Prognosis of Mild Traumatic Brain Injury After Motor Vehicle Collisions. Arch. Phys. Med. Rehabil. 2014;95:S278–S285. doi: 10.1016/j.apmr.2013.08.295. [DOI] [PubMed] [Google Scholar]
- 72.von Steinbuechel N., Real R.G.L., Sasse N., Wilson L., Otto C., Mullins R., Behr R., Deinsberger W., Martinez-Olivera R., Puschendorf W., et al. German Validation of Quality of Life after Brain Injury (QOLIBRI) Assessment and Associated Factors. PLoS ONE. 2017;12:e0176668. doi: 10.1371/journal.pone.0176668. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Wilson L., Marsden-Loftus I., Koskinen S., Bakx W., Bullinger M., Formisano R., Maas A., Neugebauer E., Powell J., Sarajuuri J., et al. Interpreting Quality of Life after Brain Injury Scores: Cross-Walk with the Short Form-36. J. Neurotrauma. 2017;34:59–65. doi: 10.1089/neu.2015.4287. [DOI] [PubMed] [Google Scholar]
- 74.von Steinbuechel N., Hahm S., Muehlan H., Arango-Lasprilla J.C., Bockhop F., Covic A., Schmidt S., Steyerberg E.W., Maas A.I.R., Menon D., et al. Impact of Sociodemographic, Premorbid, and Injury-Related Factors on Patient-Reported Outcome Trajectories after Traumatic Brain Injury (TBI) J. Clin. Med. 2023;12:2246. doi: 10.3390/jcm12062246. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Williams M.W., Rapport L.J., Millis S.R., Hanks R.A. Psychosocial Outcomes after Traumatic Brain Injury: Life Satisfaction, Community Integration, and Distress. Rehabil. Psychol. 2014;59:298–305. doi: 10.1037/a0037164. [DOI] [PubMed] [Google Scholar]
- 76.Andelic N., Røe C., Tenovuo O., Azouvi P., Dawes H., Majdan M., Ranta J., Howe E.I., Wiegers E.J.A., Tverdal C., et al. Unmet Rehabilitation Needs after Traumatic Brain Injury across Europe: Results from the CENTER-TBI Study. J. Clin. Med. 2021;10:1035. doi: 10.3390/jcm10051035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Howe E.I., Zeldovich M., Andelic N., von Steinbuechel N., Fure S.C.R., Borgen I.M.H., Forslund M.V., Hellstrøm T., Søberg H.L., Sveen U., et al. Rehabilitation and Outcomes after Complicated vs. Uncomplicated Mild TBI: Results from the CENTER-TBI Study. BMC Health Serv. Res. 2022;22:1536. doi: 10.1186/s12913-022-08908-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Born K., Amsler F., Gross T. Prospective Evaluation of the Quality of Life after Brain Injury (QOLIBRI) Score: Minor Differences in Patients with Major versus No or Mild Traumatic Brain Injury at One-Year Follow Up. Health Qual. Life Outcomes. 2018;16:136. doi: 10.1186/s12955-018-0966-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Tulsky D.S., Kisala P.A., Victorson D., Carlozzi N., Bushnik T., Sherer M., Choi S.W., Heinemann A.W., Chiaravalloti N., Sander A.M., et al. TBI-QOL: Development and Calibration of Item Banks to Measure Patient Reported Outcomes Following Traumatic Brain Injury. J. Head Trauma Rehabil. 2016;31:40–51. doi: 10.1097/HTR.0000000000000131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.McCullagh S. Outcome after Mild Traumatic Brain Injury: An Examination of Recruitment Bias. J. Neurol. Neurosurg. Psychiatry. 2003;74:39–43. doi: 10.1136/jnnp.74.1.39. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All relevant data are available upon request from CENTER-TBI, and the authors are not legally allowed to share it publicly. The authors confirm that they received no special access privileges to the data. CENTER-TBI is committed to data sharing and, in particular, to responsible further use of the data. Hereto, we have a data sharing statement in place: https://www.center-tbi.eu/data/sharing (accessed on 27 April 2023). The CENTER-TBI Management Committee, in collaboration with the General Assembly, established the Data Sharing policy and Publication and Authorship Guidelines to ensure the correct and appropriate use of the data as the dataset is hugely complex and requires the help of experts from the Data Curation Team or Bio-Statistical Team for correct use. This means that we encourage researchers to contact the CENTER-TBI team for any research plans and the Data Curation Team for any help in the appropriate use of the data, including sharing of scripts. Requests for data access can be submitted online: https://www.center-tbi.eu/data (accessed on 27 April 2023). The complete Manual for data access is also available online: https://www.center-tbi.eu/files/SOP-Manual-DAPR-2402020.pdf (accessed on 27 April 2023).