Abstract
This study investigated the effects of hierarchical cognitive training using the categorization program (CP), designed initially for adults with cognitive deficits associated with traumatic brain injury (TBI). Fifty-eight participants were included: a group of fifteen young adults with TBI (ages 18-48), another group of fifteen noninjured young adults (ages 18-50), and two groups of adults over 60 randomly assigned into the experimental group (n = 14) or the control group (n = 14). Following neuropsychological testing, the two young adult groups and the experimental older adult group received the CP training for 10-12 weeks. The CP training consisted of 8 levels targeting concept formation, object categorization, and decision-making abilities. Two CP tests (administered before and after the training) and three probe tasks (administered at specified intervals during the training) assessed skills relating to categorization. All treated groups showed significant improvement in their categorization performance, although younger participants (with or without TBI) demonstrated greater gains. Gains on the categorization measures were maintained by a subgroup of older adults up to four months posttraining. Implications of these findings in terms of adult cognitive learning and directions for future research on adult cognitive rehabilitation and cognitive stimulation programs are discussed.
1. Introduction
Several studies demonstrated that older adults benefit from cognitive training efforts that target specific processes. These findings create a paradigm shift because they suggest that the aging brain continues to be somewhat plastic and adaptable in old age. Improvement associated with training could be attributed to the development of a new skill or the facilitation of existing cognitive mechanisms and capacities [1, 2] that may be affected due to the aging process. Ultimately, cognitive training in aging could contribute to the increase of cognitive reserve, the brain's ability to withstand pathology [3].
Age-related cognitive changes are generally highly heterogeneous and are typically noted in tasks with high demands on speed of information processing and executive control (such as complex working memory tasks requiring manipulation of information), as compared to simple or automatic tasks (such as digit recall tasks) [3–6]. These changes in episodic memory can be measurable starting at age 30, and the rate of age-related decline in verbal episodic memory is normally mediated by working memory capacity [7]. The goal of cognitive training is to reduce the impact of the aging process on the cognitive system, [8] and in order to be successful, training programs should be based on sound theoretical models of cognition.
Contemporary cognitive theory organizes human cognition into a hierarchy of basic and complex processes or systems. Basic processes such as sensory perception, attention, and memory underlie more complex systems such as language, categorization, and executive functioning (for an extensive review, refer to Constantinidou and Thomas [9]). Deficits in categorization could interfere with the successful execution of daily activities because categorization skills are integral to memory and learning of new information and are essential processes for decision-making and successful problem-solving. Given the fundamental importance of categorization to all of intelligent behavior, it is surprising to observe the scarcity of investigation specific to the effects of aging on classification behavior. This is in contrast to other domains such as speed of processing and memory for which a substantial body of work can be found [10, 11]. The current study proposes to fill some of this gap in knowledge and is part of a systematic research program on the effects of categorization training on cognitive performance. Our previous research suggests that the CP is effective in young adults with TBI [12, 13]. The next paragraphs provide the theoretical framework for categorization-classification behavior relevant to this study.
The literature on categorization, especially that which is focused on visual object classification, divides into two largely nonoverlapping areas: those studies concerned with how we go about recognizing and categorizing ordinary objects in the world [14, 15] and those studies whose purpose is primarily to explain how novel situations or categories are acquired and later used to classify novel instances [16–18].
Regarding object perception, recognition, and categorization, semantic knowledge models support a bilateral temporal lobe hub which links object properties and conceptual understanding [19]. Furthermore, evidence in vision indicates the presence of a hierarchical recognition process that begins with early feature processing (such as orientation, motion, and color) and leads to the processing and representation of objects and object classes in the inferotemporal cortex [15, 20, 21]. Existing research suggests that both healthy aging and TBI result in changes in object classification [22, 23], indicating that treatment of object classification behavior should begin with feature identification in order to retrain the passive object recognition system [9].
For new category learning and classification of novel instance, empirical evidence suggests that people recruit one of two explicit systems (i.e., their processes and outputs are consciously available to the individual). The rule-based or rule-governed category system is the most important of the two. It involves the use of explicit verbalizable rules and hypothesis testing to determine category membership. This system relies heavily on executive functioning for its operation and engages frontal-subcortical networks. The other explicit system that requires significant episodic memory in that categorization is accomplished by the recall of previously experienced category members, or exemplars, that are similar to the present novel object [9, 17]. This latter system works by evaluating similarity, in terms of object or situation features, of to-be-categorized instances to those encountered previously [24], and its operation is sometimes labeled as procedural or nonexplicit, in the sense that one cannot easily describe the strategy used. Our knowledge of natural categories and common objects is likely to have been acquired through the use of the similarity-based system [20, 21, 25]. A long list of neuropsychological and experimental studies supports the above distinction [26–30]. The categorization program implemented in this study is organized hierarchically in order to address these two distinct areas of classification.
While the process of healthy aging is different from the pathology of TBI, healthy aging results in changes in categorization abilities, similar to TBI [22, 23]. Even though higher levels of cognitive reserve result in improved neurocognitive performance and moderate the effects of aging, age continues to be a robust predictor of neurocognitive functioning [3, 31].
Both TBI and age have been established as significant risk factors for the development of pathological aging resulting in dementia. TBI is now viewed as a chronic condition, and there is accumulating evidence suggesting that TBI and dementia of the Alzheimer's type share a common neuropathologic sequelae, such as chronic neuroinflammation (see review by Breunig et al. [32]), tauopathy [33], and the accumulation of beta amyloid (Aβ) [34], leading to significant neurocognitive impairment. Moderate-severe TBI sets off a neurodegenerative cascade as manifested by significant reductions in brain volume and lingering neurocognitive deficits [35] associated with longer time since injury placing the survivor at risk for dementia in middle/later life [36].
The current project responds to the challenge set by the NIH consensus report on preventing AD and cognitive decline [37]. The primary objective of this project was to investigate the utility of intense neurocognitive training in healthy older adults who experience neurocognitive changes associated with the normal aging process, using the categorization program (CP). A secondary objective was to compare the performance of older adults to younger healthy adults and to adults with cognitive deficits secondary to brain injury. Results from this study could guide future research investigating the effects of intense neurocognitive training on older adults with TBI and adults with mild cognitive impairment, the prodromal phase to dementia.
The CP is a rigorous systematic, hierarchical, eight-level program initially designed as a restorative cognitive rehabilitation program in adults with acquired brain injury. It addresses the aforementioned two distinct areas of human categorization, i.e., passive object recognition and new category learning. Initial research findings [12] and a subsequent randomized controlled trial [13] indicate that the CP is an effective therapy tool for adults with brain injury who exhibit categorization deficits. Constantinidou et al. [13] offered the following explanations regarding the active ingredients of the CP:
The CP addresses both aspects of categorization, novel category learning, and categorization of established concepts or categories. It incorporates concrete visual stimuli and gradually progresses into abstract concepts through the use of repetition, cueing, and strategy building
The CP was built using a very systematic hierarchical structure that corresponds to the neurodevelopmental order of categorization and classification process hierarchy
Tasks gradually increase in difficulty and cognitive abstraction. CP tasks begin with basic feature identification and feature extraction (such as color, shape, and size) and progress to higher levels of concept formation and abstraction (such as rule-based decision-making) [38, 39]
The program integrates cognitive processes such as executive skills, attention, organization, conceptual reasoning, linguistic flexibility, and explicit memory for the completion of the categorization tasks
The redundancy and the repetition integrated in each level, along with the extensive cueing systems and errorless learning principles, provide support and organization for participants with more passive learning styles. The program provides a standardized approach to categorization training; yet, it incorporates mastery criteria for each level in order to account for individual differences. In conclusion, the CP targets cognitive domains such as complex working memory, information processing, and fluid intelligence that traditionally have been associated with age-related cognitive decline
The present study investigated categorization abilities and the effects of training on healthy older adults over 60 and in a group of young adults with moderate to severe TBI. In order to account for previous methodological flaws in adult training studies and determine the true effects of training, this study incorporated an older adult control group (who did not receive the training) and a young adult group who received training. The primary hypotheses were the following:
All participants who receive the CP training would demonstrate improvements in their categorization performance as measured by gains on the CP-dependent measures
Participants who receive the CP training would be able to generalize their knowledge to other categorization tasks not directly related to the CP, to a greater degree than participants who do not receive the CP training
Performance of older adults on formal neuropsychological measures measuring memory, executive function, perception, conceptual reasoning, and attention would correlate significantly with performance on categorization tests
Older adults who receive the CP training would be able to maintain their gains on categorization performance at one and four months posttraining
2. Materials and Methods
2.1. Participants
Fifty-eight participants were included in the study. One group consisted of young adults with TBI who received the CP training (n = 15), a second group of young healthy adults who also received the CP training (n = 15), a third group of healthy older adults who received the training (n = 14), and a fourth group of healthy older adults who did not receive the training (n = 14). Participants with TBI were recruited from brain injury rehabilitation centers collaborating in the project. The rest of the participants (groups 2-4) were volunteers from southwest Ohio areas. Recruitment of the TBI and noninjured groups was done in parallel and in a rolling admission process. All work was conducted in accordance with the Declaration of Helsinki (1964), and the project was approved by the Miami University Institutional Review Board for Human Subjects in Research. All study participants provided written informed consent prior to participation. Study participants were English-speaking adults and met the study's inclusion/exclusion criteria as follows.
2.2. Young Adults with TBI
The following are the inclusion/exclusion criteria for participants with TBI, which are consistent with the Constantinidou et al. [12] criteria.
2.2.1. Inclusion Criteria
Adult males and females between 18 and 55 years of age
Primary diagnosis of moderate to severe CHI. The indication of an initial moderate to severe head injury was determined by the presence of three or more of the following severity indices: (a) initial Glasgow Coma Scale score less than 12, (b) abnormal initial computed tomography (CT) findings indicating acute central nervous system pathology, (c) length of impaired consciousness greater than 20 minutes as specified by the emergency records, (d) length of posttraumatic amnesia greater than 24 hours as specified in the acute hospital/emergency records, (e) length of acute hospital stay greater than 3 days, (f) positive neurological examination on hospital admission and discharge indicating focal sensory and motor neurological deficits or changes in the mental status attributed to brain injury, (g) medical complications secondary to the injury, and (h) head injury severity classification according to hospital records [40, 41]
Rancho Los Amigos Scale [42] Level VI or higher (which indicates appropriate, goal-oriented behavior and posttraumatic amnesia (PTA) resolution)
No aphasia present with the exception of mild to moderate word-finding problems due to cognitive deficits
Resolution of PTA as evidenced by a score of 76 or higher on the Galveston Orientation and Amnesia Test [43]
Enrollment in a residential comprehensive postacute rehabilitation program at the onset of the study
Participants were within 4 years of their injury
2.2.2. Exclusion Criteria
Penetrating head injuries
Diagnosis of stroke at the time of injury
Premorbid central nervous system disorder or learning disability
Documentation of premorbid major depression or other significant psychiatric disorders as defined by the Diagnostic and Statistical Manual of Mental Disorders [DSM-IV] [44] that resulted in hospitalization and/or incapacity to work or perform activities of daily living
Current Beck Depression II [45] score of 25 or higher indicating the presence of depression that could interfere with performance on the protocol. This score is higher than the typical cut-off score of 15 because as previously described [12], TBI results increased symptomatology for reasons relevant to TBI and not because of clinical depression. A score of 25 or higher indicates clinical depression in this population
Active or current alcohol, drug, or other controlled substance abuse that interferes with participation
Deficits in auditory comprehension and moderate to severe word-finding problems, two standard deviations below the mean on the Boston Naming Test [46], which could interfere with the subject's ability to follow test or task instructions
English as a second language
Color blindness as measured by the Ishihara test for color blindness [47]
Seventy percent of the participants were injured in motor vehicle accidents, and another 30% were injured as a result of falls. All participants received comprehensive rehabilitation at the time of participation in the project.
2.3. Noninjured Adult Groups
2.3.1. Inclusion Criteria
Adult males and females between 18 and 55 years of age for the young adult group
Adults over 60 for the older adult groups
2.3.2. Exclusion Criteria
A medical history of a central nervous system trauma, disorder, or organic brain disease, learning disability, or language learning disability
Documentation of psychological or psychiatric disorder as defined by the DSM-IV [44] that resulted in hospitalization for major depression and/or incapacity to work
Current Beck Depression II [45] score of 15 or higher indicating the presence of depression that could interfere with performance on the protocol
Mini-Mental State Examination score of 25 or lower [48]
Active or current alcohol, drug, or other controlled substance abuse
Uncorrected visual or hearing deficits
Color blindness as measured by the Ishihara test for color blindness [47]
2.4. Group 1: Experimental Young Adult Group with TBI (n = 15)
Participants were residents of postacute rehabilitation centers and were enrolled in the project through a rolling admission process. They remained in the study for an average of 10-12 weeks which coincided with their length of stay at the rehabilitation centers. Participants in this group ranged in age from 18 to 48 years with a mean age of 28.13 (SD = 9.21). Education ranged from 12 to 17 years, with a mean of 13.67 (SD = 1.78).
2.5. Group 2: Young Adult Group (n = 15)
The ages of the participants ranged from 19 to 50 years with a mean age of 29.73 years (SD = 10.89). Education ranged from 12 to 18 years, with a mean of 14.16 (SD = 1.87).
2.6. Group 3: Experimental Older Adult Group (n = 14)
Participants ranged in age from 60 to 82 years with a mean age of 67.28 years (SD = 10.47). Education ranged from 12 to 19 years, with a mean of 13.9 (SD = 2.15). Their average MMSE score was 28.5 (SD = 1.55).
2.7. Group 4: Older Adult Control Group (n = 14)
Their ages ranged from 60 to 88 years with a mean age of 68.64 years (SD = 9.72). Education ranged from 10 to 18 years, with a mean of 13.92 (SD = 2.05). Their average MMSE score was 29.42 (SD = .85).
Healthy older adults who met the inclusion/exclusion criteria for the project were randomly assigned to either the experimental or the control group. The two older adult groups did not differ significantly in age or education level, t(26) = .355, p = .725 and t(26) = .043, p = .966. There was no difference in their gross cognitive ability as measured by the MMSE t(26) = 1.958, p = .061. Finally, there was no significant difference between the four groups on the years of education, F(3, 54) = .154, p = .927.
2.8. Procedures
Participants were administered a neuropsychological assessment at the beginning of their participation in the project. Following the neuropsychological testing, participants were administered two categorization tests designed for this project and the first probe task (see sections 2.11 and 2.12 for a description of the tests and probe tasks). All participants remained in the study for 10-12 weeks. Participants who received the CP training (groups 1, 2, and 3) participated in individualized hourly sessions for a total of 2-4 hours of training per week until they completed the CP protocol. On average, participants required 27 hours to complete the CP training. Table 1 displays the experimental design.
Table 1.
Part A | Part B | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Pretests | Probe 1 | Perceptual feature training Level 1 |
Similarities and differences Level 2 |
Probe 2 | Functional categorization Level 3 |
Analogies Level 4 |
Abstract concepts Level 5 |
Probe 3 | Levels 1-3 | Posttests | |
Group 1: young adults with TBI (treated) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
Group 2: young uninjured adults (treated) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
Group 3: older adults (treated) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
Group 4: older adults (untreated) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
Note: pre/posttests include the neuropsychological assessment and the 2 tests of the categorization program. Probe 2 was inserted at about 5 weeks after the onset of treatment and probe 3 at 8 weeks for the control group.
2.9. Experimental Items
The experimental items are consistent with the materials described previously [12, 13], and the description partly reproduces their wording:
2.10. The Categorization Program (CP)
The CP was based on theories of implicit and explicit categorization systems. Therefore, tasks were grouped into two major parts: (1) recognition and categorization of everyday objects and (2) new category learning [12]. Principles of learning, concept formation, and rehabilitation were incorporated in order to develop the hierarchical tasks [49–52]. Table 2 presents the 8 levels of the CP.
Table 2.
Part A: object categorization tasks | This part consists of 5 different levels. The tasks begin with teaching perceptual features in order to describe objects or living things and move to higher levels of abstraction. |
Level 1: perceptual feature training and application | The purpose of this section is to train perceptual feature identification thereby building a framework for cognitive structures. The retraining of basic categorization abilities will build the foundation for more abstract functions and will facilitate communication during word-finding difficulties. The patient will learn eight perceptual features and then consistently apply all the features to describe common objects. Objects are presented via a range of stimulus types including real objects, color photos, line drawings, written words, and spoken words. |
Level 2: similarities and differences | The purpose of this level is to apply the eight perceptual features trained in Level 1 to compare objects. Identification of similarities and differences between two objects of the same and of different categories using the eight perceptual features is utilized in order to train conceptual thinking. The process of applying the trained perceptual features is the next layer of the continuum of concrete to abstract functional abilities. Stimulus types include colored photos, written words, and spoken words. |
Level 3: functional categorization | The purpose of this task is to identify functional categories and maintain the delineations within that category. There are two specific foci in this level which require the consideration of the features of the objects trained and applied in Levels 1 and 2: the application of retrieval strategies to generate novel items that belong in a given category and the mental flexibility required to generate alternate uses for the objects in a given category. This task enhances functional problem-solving and mental flexibility. |
Level 4: analogies | The purpose of this level is to apply both the categorization abilities trained in Levels 1-3 and inductive reasoning skills in order to identify and match the concepts represented in analogies. The analogies progress from concrete to abstract in order to train word abstraction. Stimulus materials include multiple choice responses for each analogy that will aid in the training process of word abstraction as needed. |
Level 5: abstract word categorization | This level further develops concept formation and abstract conceptual thinking. The goal is to identify similarities and differences in abstract verbal concepts. The generation of similar word pairs using synonyms that represent the relationship between the words is incorporated to enhance cognitive and linguistic flexibility. |
Part B: new category learning tasks | Under each level of the new category learning, there are 5 steps that increasingly demand a higher level of rule-governed responses. Errorless learning principles and cueing hierarchies are applied under each step. |
Level 1: progressive rule learning 1 | The stimuli for Level 1 vary along two dimensions: shape and color. The nine stimuli include squares, circles, and triangles that are red, white, and black. Each stimulus is presented individually, and a formulation of the rule that classifies each stimulus into either Category A or Category B follows. |
Level 2: progressive rule learning 2 | The stimuli for Level 2 of Part B are gauges that include two dials that must be interpreted as a single unit. This level forces generalization into a real world situation by simulating the reading of gauges at a power plant. The determination of operational or not operational for each stimulus is utilized, and the cumulative interpretation of each judgment leads to the formulation of the rule that classifies the stimuli for each of the five conditions. |
Level 3: progressive rule learning 3 | The final explicit rule task contains the same underlying structure as the earlier two levels; however, this time, a judgment is made using stimuli constructed from dimensions of language. This further abstracts the rule formulation and forces generalization of training to a real world situation. The stimuli in this task consist of a summary of three laboratory tests (lung capacity, heart fluid, and bone marrow count) and their orthogonal combination with two measurement adjectives (low and high). |
2.10.1. Part A: Object Categorization Tasks
This part consists of 5 different levels. The tasks begin with teaching perceptual features in order to describe objects or living things and move to higher levels of cognition including analyses, synthesis, linguistic flexibility, and abstract reasoning.
2.10.2. Part B: New Category Learning Tasks
The new category learning tasks consist of three levels. Under each level, there are 5 steps that increasingly demand a higher level of rule-governed responses. Errorless learning principles and cueing hierarchies are applied under each step.
The CP-dependent measures were developed to measure the effectiveness of the CP program. These were the CP Test 1, CP Test 2, and probe tasks 1, 2, and 3.
2.11. CP Tests 1 and 2
CP Test 1 relates to the categorization of common objects (Part A of the CP). Participants were required to describe pictures of objects and identify core attributes such as their primary function and alternate uses of the object. These objects were not part of the CP training. There were a total of 10 objects; five have high frequency and five have low frequency in occurrence [53]. The number correctly obtained from 120 possible was recorded for each subject. Cronbach's alpha for the 10 items is .90.
The second test relates to the new category learning portion (Part B of the CP). Participants were required to follow a logical rule in categorizing objects. These objects were not part of the CP. There were a total of 5 rules with increased complexity. For instance, the first rule asks the subject to “put all red items in the basket.” The last rule is more complex and requires that participants to “put all things that are blue but not used for coffee in the basket.” Both informal tests were administered at the beginning and at the end of the study. The number correctly obtained from 36 possible was recorded for each subject. Cronbach's alpha for CP Test 2 was .69.
2.12. CP Probe Tasks
The probe tasks were designed to assess how participants generalize information learned on the CP to other tasks not directly related to the CP training tasks. Participants were presented with an array of 10 objects and were required to categorize objects based on a self-generated rule. Following that, they were asked to categorize the same objects twice, each time using a different self-generated rule.
The probe tasks were administered at 3 different times during the study. The first probe task was administered prior to the CP training, the second after Level 2 (Part A), and the third after Level 5 (Part A). For the treated control group participants, the first probe was administered prior to the onset of therapy, the second after 5 weeks of treatment, and the third after 8 weeks of treatment. Each of the probe task uses a set of 10 different objects, equal in familiarity and frequency of occurrence. The three different sets of probe tasks are of similar difficulty, and analyses of variance yielded no statistical difference in performance (p > .05) between the three different sets of items. The order of administration was counterbalanced to avoid order effects. Participants obtained one point for each object they sorted correctly by their self-generated rule. The subject was asked to sort the items three times under each probe task, each time using a different rule. Hence, each probe trial was worth 10 points with a total of 30 points for each probe task.
2.13. CP Stimuli and Scoring System
The CP protocol was provided in a manualized format in order to ensure consistency. The CP packet included the administration manual with cueing instructions, the CP stimuli (objects, photos, written words, etc.), and score sheets.
2.14. Neuropsychological Tests
The following tests were administered at pre- and posttesting.
Wechsler Abbreviated Scale of Intelligence (WASI) [54]
Mini-Mental State Examination [55]
Rey Complex Figure Test [56]
Trail Making Tests A and B [57]
Digit Span Forward and Backwards and Visual Span Forward and Backwards—Wechsler Memory Scale-III (WMS-III) [58]
California Verbal Learning Test-II [59]
Wisconsin Card Sorting Test [60]
The Booklet Category Test [61]
Symbol Digit Modalities Test [62]
Control Oral Word Association [63]
The Picture Recognition, Spatial Relations, Analysis and Synthesis, Concept Formation, Decision Speed, and Verbal Comprehension Subtests from the Woodcock-Johnson III (WJIII, Tests of Cognitive Abilities) [64]
2.15. Data Scoring and Analyses
Data were included in the analyses to the fullest extent possible. The primary statistical design was a multivariate mixed model design followed by preplanned univariate comparisons. The alpha level was set at .05.
3. Results
Participants who received the CP protocol required about 27 hours of treatment spread over 10-12 weeks. The participants in the control group did not receive any cognitive treatment other than information regarding memory strategies and a list of suggested activities for cognitive stimulation.
3.1. Performance on CP Measures
CP measures consisted of the CP Test 1 (pre and post), CP Test 2 (pre and post), and the three probe tasks (Probe 1, Probe 2, and Probe 3).
3.1.1. CP Test 1
The first CP test assessed the ability to categorize common objects. In order to determine the effects of the CP training on categorizing familiar objects, a mixed model analyses of variance (a = .05) compared the pre- and postperformance of the four groups on the CP Test 1 with time (pre/post) as the within-subjects factor and group as the between-subjects factor. The analyses revealed a significant time effect (F(1, 54) = 146.14, p = .0001, ηρ2 = .730, power = 1.000), group by time interaction (F(3, 54) = 24.72, p = .0001, ηρ2 = .579, power = 1.0), and an overall group effect (F(3, 54) = 11.411, p = .0001, ηρ2 = .388, power = .999).
Planned lower-order ANOVAs indicated that there was an overall group difference on the CP Test 1 baseline performance (F(3, 57) = 6.026, p = .001). However, there was no difference at the baseline among the three healthy groups on CP Test 1 accuracy (F(2, 42) = .187, p = .831). Post hoc pairwise Bonferroni comparisons indicated that the baseline difference at CP Test 1 was due to the lower performance of the young group with TBI. Participants with TBI performed significantly lower on CP Test 1 at the baseline as compared to the healthy young adults and the two older adult groups.
At Time 2, there was a significant group main effect (F(3, 54) = 19.785, p = .0001). Post hoc pairwise Bonferroni comparisons revealed no difference between the TBI and the healthy young adult or the TBI and the older experimental group at Time 2. However, healthy young adults performed significantly better than their older counterparts who received the CP training. The older untreated group had the lowest performance among all groups at Time 2, and their performance was significantly lower than that of participants in the other groups (e.g., TBI, young adult, and older experimental groups). While all treated groups demonstrated significant growth from Time 1 to Time 2, the young adults (TBI and healthy young adults) demonstrated the most significant growth as compared to the older treated group, t(27) = 3.585, p = .001 and t(27) = 3.576, p = .001. The degree of improvement on CP Test 1 (i.e., difference score between pre-post performance) between the two young adult groups was similar (t(28) = .209, p = .836). Figure 1 displays time by group interaction depicting the change in performance from Time 1 to Time 2 on the CP Test 1 tasks. Table 3 presents the performance of each group on the CP-dependent measures.
Table 3.
CP Test 1 | CP Test 2 | Probes | |||||
---|---|---|---|---|---|---|---|
Pre | Post | Pre | Post | Probe 1 | Probe 2 | Probe 3 | |
Group 1: young adults with TBI (treated) (n = 15) | 59.13 (9.47) | 94.26 (17.91) | 29.26 (3.82) | 32.46 (2.29) | 22.26 (7.59) | 27.8 (4.07) | 29.86 (.51) |
Group 2: young uninjured adults (treated) (n = 15) | 70.13 (8.77) | 104.21 (14.75) | 31.06 (3.39) | 32.93 (3.43) | 29.64 (.84) | 29.33 (.25) | 29.78 (.57) |
Group 3: older adults (treated) (n = 14) | 69.0 (7.93) | 84.21 (12.02) | 27.07 (4.40) | 28.35 (5.13) | 25.78 (6.11) | 29.28 (2.67) | 28.57 (3.63) |
Group 4: older adults untreated (n = 14) | 68.50 (4.76) | 67.50 (3.67) | 27.28 (4.81) | 28.28 (5.41) | 26.71 (6.0) | 28.5 (2.67) | 29.28 (2.67) |
Note: the maximum possible score on CP Test 1 is 120, and on CP Test 2 is 36. The total number of possible points for each probe task is 30.
3.1.2. CP Test 2
The second CP test assessed the ability to implement logical rules to categorize objects consistent with theories of category learning. In order to determine the effects of the CP training on implementing logical rules, a mixed model analyses of variance (a = .05) compared the pre- and postperformance of the four groups on the CP Test 2 with time (pre/post) as the within-subjects factor and group as the between-subjects factor. There was a time main effect (F(1, 53) = 13.521, p = .001, ηρ2 = .203, power = .950) and a group main effect (F(3, 53) = 4.830, p = .005, ηρ2 = .215, p = .883). The group by time interaction was not significant (F(3, 53) = .756, p = .524, ηρ2 = .041, power = .201). Results indicate that the patterns of performance were similar among the groups. Planned lower-order ANOVAs indicated that there was a difference at the baseline between the four groups (F(3, 53) = 2.964, p = .040). The only significant difference was between the noninjured young adults and the two older adult groups (F(2, 41) = 4.086, p = .024). There were no other significant group differences at the baseline.
At Time 2, there was a significant group simple main effect (F(3, 54) = 5.223, p = .003). A priori pairwise comparisons (α = .01) revealed significant differences between the young TBI group and the treated older adult group (t(27) = 2.814, p = .009) and between the healthy young adult group and the treated older adult group and untreated older adult groups (t(27) = 2.839, p = .009 and t(27) = 2.78, p = .010, respectively). Figure 2 displays group performance on the CP Test 2.
3.2. Probe Tasks
The probe tasks were designed to assess the participants' ability to implement skills learned during the CP training and categorize new objects. The three probe tasks were administered at three different intervals: before the CP training, after Level 2 (at 5 weeks after the onset of treatment), and after Level 5 (at 8 weeks after the onset of treatment). Participants in the control group received the probes before the onset of the study (i.e., baseline), at 5 weeks, and at 8 weeks.
A mixed model analysis of variance was performed with probe as the within-subjects factor and groups as the between-subjects factor. There was a significant probe effect (F(2, 51) = 8.536, p = .001, ηρ2 = .251, power = .958), group by probe interaction (F(6, 104) = 2.422, p = .032, ηρ2 = .127, power = .801), and a significant group main effect (F(3, 52) = 3.238, p = .029, ηρ2 = .158, power = .715).
Pairwise analyses (mean difference estimations, a = .01) indicate that there was a significant improvement between the first and second probe administrations (p = .001). There was also a significant difference between the first and third probes (p = .0001). However, there was no significant difference between the second and third probes (p = .291).
The groups demonstrated different patterns on performance on the probe tasks. The greatest gain in performance was obtained by the young adult group with TBI (F(2, 13) = 7.734, p = .006, ηρ2 = .543, power = .887). The performance of young adults with TBI and older adults during Probe 1 was more variable (compared to younger adults). However, their performance during Probes 2 and 3 became more uniformed. The performance of the young adult group was fairly stable across the three probes, probably due to a ceiling effect. Figure 3 displays group performance on the probe task across time.
3.3. Follow-Up Effects of CP Training
Out of the 14 older participants who received the CP training, 9 participants were able to complete follow-up assessments at one month and at 4 months after study completion in order to determine possible long-term effects of the CP training. The remaining five dropped out because they missed one of the two follow-up sessions due to illness, planned surgeries, death in the family, and travel. A repeated measures ANOVA (a = .05) on the CP Test 1 scores obtained during the four different administration times (pretest, posttest, follow-up Time 1, and follow-up Time 2) revealed significant differences in performance (F(3, 24) = 11.69, p = .001, ηρ2 = .593, power = .0001). Preplanned Helmert contrasts indicated a significant difference in performance between the pretest score (x = 72.11, SD = 4.85) and the rest of the posttest scores (F(1, 8) = 16.94, p = .002, ηρ2 = .679, power = .948) (posttest average score = 87.11, SD = 12.91; one − month average score = 95.56, SD = 17.16; and four − month average score = 92.33, SD = 16.04). There was no significant difference between the three posttest scores on CP 1 (F(2, 7) = 3.832, p = .075, ηρ2 = .523, power = .499).
Similar to the CP Test 1, a repeated measures ANOVA (a = .05) on the CP Test 2 scores obtained over four different administration times (pretest, posttest, follow-up Time 1, and follow-up Time 2) revealed a significant overall effect (F(3, 24) = 4.44, p = .013, d = .357, power = .816). There was no significant difference between the three posttest scores on CP Test 2 (F(2, 7) = 1.581, p = .271, ηρ2 = .311, power = .231) (posttest average score = 28.38, SD = 5.13; one − month average score = 30.33, SD = 3.96; and four − month average score = 30.33, SD = 5.26). In summary, the small group of participants who received the follow-up testing maintained their gains on CP Tests 1 and 2 after the training up to 4 months after the study completion.
3.4. Pretest Neuropsychological Measures and Performance on the CP Tests
One objective of the present study was to determine the relationship between neuropsychological performance and the CP-dependent measures for the older adults. Scores from the full set of baseline neuropsychological assessments were combined into a set of five composite scores representing the conceptually motivated constructs [13, 65] of Memory Processing, Executive Functioning, Perceptual/Visual Processing, Conceptual Reasoning, and Organization/Attention using a method advocated by Cahn and colleagues [66] and Cohen and colleagues [67]. Each measure was converted into a z-score. The resulting z-scores for the measures within each construct were then averaged to derive a score for the constructed measure. The two Executive Function measures (Wisconsin Card Sorting Test: Trials to First Category, Total Number of Categories, and Failure to Maintain Set), which were not significantly correlated with the Executive Function composite variable, were removed from the composite, and the Executive Function composite was recomputed from the remaining measures in that set. Table 4 presents the group means on the pre- and postneuropsychological measures. Values under means are standard deviations; Table 5 displays the correlations between individual measures and their composite scores.
Table 4.
Group 1: young adults with TBI (treated) n = 15 |
Group 2: young uninjured adults (treated) n = 15 |
Group 3: older adults (treated) n = 14 |
Group 4: older adults (untreated) n = 14 |
|||||
---|---|---|---|---|---|---|---|---|
Pre | Post | Pre | Post | Pre | Post | Pre | Post | |
California Verbal Learning Test-R (CVLT-R) | ||||||||
Total trials 1-5 | 51.0 | 55.5 | 58.93 | 65.80 | 47.14 | 49.64 | 45.43 | 49.50 |
14.06 | 11.32 | 7.85 | 6.07 | 9.77 | 10.49 | 9.87 | 9.02 | |
Short delay | 8.27 | 11.1 | 12.33 | 14.80 | 8.92 | 10.54 | 9.57 | 11.00 |
4.81 | 5.13 | 2.09 | 2.00 | 3.66 | 4.39 | 3.00 | 3.59 | |
Long delay | 9.27 | 11.6 | 14.93 | 13.60 | 10.92 | 9.00 | 11.14 | 9.50 |
4.45 | 3.89 | 1.53 | 1.72 | 3.50 | 3.94 | 3.44 | 3.16 | |
Rey Complex Figure (RCF) | ||||||||
Copy | 29.61 | 31.09 | 34.90 | 34.53 | 29.82 | 30.36 | 30.00 | 32.00 |
7.38 | 4.67 | 1.56 | 2.36 | 6.47 | 6.72 | 6.10 | 3.68 | |
Immediate | 16.34 | 22.77 | 21.64 | 28.71 | 13.50 | 15.93 | 10.32 | 16.64 |
6.83 | 5.47 | 4.57 | 5.39 | 8.20 | 8.27 | 5.03 | 5.92 | |
Delayed | 17.34 | 22.9 | 21.77 | 27.63 | 12.04 | 15.39 | 10.50 | 16.0 |
6.33 | 5.26 | 4.74 | 6.44 | 5.96 | 8.81 | 5.88 | 5.72 | |
Wechsler Memory Scale-III (WMS-III) | ||||||||
Longest Digit Span Forward | 7.5 | 8.6 | 6.53 | 6.93 | 6.78 | 6.57 | 6.57 | 6.36 |
2.61 | 2.36 | 1.41 | 1.33 | 1.31 | 1.16 | 1.45 | .84 | |
Spatial Span Forward | 8.28 | 9.54 | 8.93 | 9.27 | 7.79 | 8.00 | 7.50 | 7.78 |
1.58 | 1.29 | 2.25 | 2.09 | 2.29 | 1.88 | 1.83 | 1.19 | |
Spatial Span Backward | 7.85 | 8.72 | 8.27 | 8.27 | 7.50 | 7.14 | 6.64 | 6.21 |
1.65 | 1.67 | 2.02 | 1.79 | 1.45 | 1.83 | 1.39 | 1.05 | |
Wisconsin Card Sorting Test (WCST) | ||||||||
Number of Categories Completed | 5.78 | 6.0 | 5.20 | 5.73 | 4.93 | 4.43 | 4.57 | 5.29 |
.42 | .0 | 1.57 | .80 | 1.82 | 2.24 | 1.70 | 1.44 | |
Trials to Complete First Category | 13.21 | 11.36 | 14.67 | 13.27 | 17.43 | 12 | 16.28 | 16.28 |
5.72 | 1.56 | 6.42 | 4.58 | 22.62 | 4.45 | 9.86 | 13.76 | |
Failure to Maintain Set | .57 | .27 | .47 | .27 | 1.14 | 1.14 | .71 | 1.07 |
.64 | .46 | .64 | .59 | 1.29 | 2.03 | 1.07 | 1.64 | |
Booklet Category Test | ||||||||
Total errors | 40.0 | 27.4 | 33.53 | 18.20 | 70.07 | 54.79 | 65.07 | 56.64 |
20.58 | 14.02 | 25.90 | 17.04 | 21.54 | 24.15 | 28.96 | 31.04 | |
Symbol Digits Modality Test | 40.25 | 47.75 | 58.20 | 65.47 | 44.50 | 48.07 | 44.00 | 47.00 |
10.11 | 10.71 | 9.51 | 13.17 | 15.00 | 11.59 | 9.37 | 11.71 | |
Controlled Oral Word Association Test(COWAT) | 33.1 | 41.7 | 42.73 | 49.47 | 39.29 | 39.78 | 41.93 | 41.86 |
8.67 | 13.04 | 9.50 | 9.34 | 8.30 | 10.02 | 17.23 | 17.06 | |
Trail Making Test A (in seconds) | 36.16 | 38.98 | 25.67 | 23.10 | 34.61 | 35.36 | 39.93 | 36.86 |
11.37 | 44.45 | 6.98 | 6.60 | 11.24 | 14.78 | 14.61 | 13.70 | |
Trail Making Test B (in seconds) | 79.5 | 90.54 | 57.45 | 55.80 | 79.43 | 74.57 | 74.21 | 86.57 |
45.5 | 85.4 | 23.20 | 24.90 | 26.42 | 26.37 | 25.82 | 43.95 | |
Woodcock-Johnson III (WJIII-13) | ||||||||
Picture Recognition | 48.42 | 51.42 | 53.33 | 54.53 | 51.86 | 50.43 | 51.21 | 51.86 |
3.36 | 3.75 | 3.02 | 2.75 | 4.15 | 8.91 | 3.98 | 3.35 | |
WJIII-3 | ||||||||
Spatial Relations | 70.21 | 73.64 | 74.07 | 74.87 | 68.50 | 68.64 | 68.29 | 69.50 |
5.1 | 5.41 | 6.28 | 5.45 | 6.34 | 9.64 | 7.18 | 6.46 | |
WJIII-15 | ||||||||
Analysis/Synthesis | 27.78 | 28.71 | 28.67 | 28.93 | 23.37 | 25.00 | 23.71 | 23.36 |
2.42 | 2.16 | 4.35 | 4.68 | 6.06 | 5.72 | 4.07 | 7.24 | |
WJIII-5 | ||||||||
Concept Formation | 28.35 | 34.85 | 36.57 | 37.21 | 28.64 | 29.93 | 28.21 | 28.71 |
5.3 | 4.18 | 2.93 | 5.29 | 7.80 | 6.76 | 6.04 | 7.50 | |
WJIII-16 | ||||||||
Decision Speed | 26.0 | 31.78 | 36.46 | 38.15 | 32.07 | 34.14 | 30.14 | 32.29 |
8.35 | 7.29 | 5.59 | 3.29 | 5.81 | 6.02 | 6.19 | 6.13 | |
WJIII-1 | ||||||||
Verbal Comprehension | 52.92 | 56.14 | 59.57 | 61.50 | 56.43 | 56.78 | 58.28 | 57.93 |
5.99 | 5.9 | 4.62 | 4.83 | 5.65 | 6.18 | 5.65 | 5.30 |
Table 5.
Measure | Composite |
---|---|
Memory Measures | Memory composite |
CVLT Learning Curve: Trial 5-Trial 1 | .487∗∗ |
CVLT Total (Trial 1 through Trial 5) | .804∗∗ |
CVLT Short Delay Free Recall | .853∗∗ |
CVLT Short Delay Cued Recall | .882∗∗ |
CVLT Long Delay Free Recall | .891∗∗ |
CVLT Long Delay Cued Recall | .833∗∗ |
Rey Figure Immediate Recall | .759∗∗ |
Rey Figure Delayed Recall | .767∗∗ |
Rey Figure Recognition | .415∗ |
Digit Span Total Score | .353∗∗ |
Spatial Span Total Score | .343∗ |
Executive Function Measures | Executive composite |
Symbol Digits Correct—Written | .798∗∗ |
Trail Making Test A (seconds) | -.755∗∗ |
Trail Making Test B (seconds) | -.832∗∗ |
Booklet Category Test (total errors) | -.467∗ |
Wisconsin Card Sort—Total # of Categories | .347 |
Wisconsin Card Sort—Trials to 1st Category | .012 |
Wisconsin Card Sort—Failure to Maintain Set | -.108 |
Wisconsin Card Sort—Learning to Learn (%) | .365∗ |
COWAT total Score | .653∗∗ |
Woodcock-Johnson Test 16—Decision Speed | .667∗∗ |
Perception and Visual Processing Measures | Perception composite |
Woodcock-Johnson Test 13 Picture Recognition | .881∗∗ |
Woodcock-Johnson Test 3 Spatial Relations | .874∗∗ |
Conceptual Processing and Reasoning Measures | Concept/reasoning composite |
Woodcock-Johnson Test 15 Analysis/Synthesis | .838∗∗ |
Woodcock-Johnson Test 5 Concept Formation | .813∗∗ |
Woodcock-Johnson Test 1 Verbal Comprehension | .747∗∗ |
Organization and Attention Measures | |
Rey Figure Score to Copy | -.720∗∗ |
Rey Figure Time to Copy (seconds) | -.709∗∗ |
General Cognitive Functioning | |
WASI Verbal | .731∗∗ |
WASI Performance | .831∗∗ |
MMSE | .725∗∗ |
Note: ∗p < .05; ∗∗p < .01.
The correlation between the pretest scores of CP Test 1 and CP Test 2 was weak and nonsignificant (r = .182, p = .087) because the two dependent measures assessed different categorization constructs. The left columns of Table 6 contain the Pearson product-moment correlations between the composite scores and the categorization pretest measures (CP Test 1, CP Test 2, and Probe 1) for both groups of older adults. At Time 1 (pretest), CP Test 1 performance correlated significantly with all five composite indices; CP Test 2 correlated significantly with all indices except the Organization/Attention Composite. Probe 1 correlated with all the composite scores except the Perception/Visual Processing composite.
Table 6.
Measure | CP Test 1 (pre) | CP T2 (pre) | Probe 1 | Probe 2+ | Probe 3+ | CP Test 1 (post)+ | CP Test 2 (post)+ | Post-pre CP Test 1 | Post-pre CP T2 | Probe 3-Probe 1 |
---|---|---|---|---|---|---|---|---|---|---|
Memory composite | .609∗∗ | .530∗∗ | .407∗ | .697∗∗ | .089 | .323 | .277 | .235 | .273 | .461 |
Executive Functioning composite | .398∗ | .446∗ | .365∗ | .342 | .180 | .244 | .510 | .047 | .141 | .458 |
Perception/Visual Processing composite | .673∗∗ | .422∗ | .227 | .824∗∗ | .120 | .740∗∗ | .503 | .064 | .468∗ | .310 |
Conceptual/Reasoning composite | .595∗∗ | .437∗∗ | .614∗∗ | .721∗∗ | .290 | .541∗ | .449 | .064 | .401 | .777∗∗ |
Organization/Attention composite | .290 | .177 | .480∗∗ | .440 | .424 | .484 | .463 | .214 | .174 | .356 |
Global Cognitive composite | .609∗∗ | .517∗∗ | .343∗ | .864∗∗ | .096 | .443 | .537∗ | .004 | .503∗ | .596∗ |
Note: Executive Functioning composite does not include the following Wisconsin Card Sort Measures: Total Number of Categories, Trials to 1st Category, and Failure to Maintain Set. Posttests and pre-post difference scores include the experimental older participants only. ∗p < .05; ∗∗p < .01. + indicates partial correlations holding the corresponding pretest performance as a covariate.
Finally, in order to examine whether neuropsychological measures could predict who benefited most from the categorization program, the z-score composite measures were correlated with the three difference scores (CP Test 1 posttest minus pretest, CP Test 2 posttest minus pretest, and Probe 3 minus Probe 1) using the data from the older adults who received the CP training. Additionally, partial correlations (using the pretest score as a covariate) between the composite scores and the categorization posttest measures (CP Test 1, CP Test 2, Probe 2, and Probe 3) were conducted. As can be seen in Table 6, the Perceptual/Visual, Conceptual/Reasoning, and Global Cognitive were the most useful composites in predicting improvement in performance on the CP-dependent measures.
4. Discussion
The current study is part of a systematic research program exploring the effects of a hierarchical cognitive training program in adult rehabilitation. The primary objective of the present study was to determine the utility of such training in healthy older adults and compare their performance to healthy young adults and to young adults with known neurocognitive deficits resulting from TBI. The results support the notion that older adults similar to adults with TBI can benefit from cognitive activities that enhance organization and conceptual knowledge. Overall, the three groups of participants who received the CP training demonstrated improvement in their categorization performance. Categorization in the project was measured directly by the two CP tests developed specifically for this training program. Participants who received the CP training showed improvement in their ability to categorize common objects as measured by their performance on CP Test 1. During CP Test 1, participants were required to describe objects effectively and to generate creative uses that could improve functional problem-solving abilities. Participants in the experimental groups demonstrated significant gains in describing common objects and in creative uses of objects. In comparison, participants in the control group did not demonstrate significant gains in this area. Greater gains however were noted in the young adults with TBI and young healthy adults, in comparison to the older experiment adult group.
CP Test 2 measures the ability to categorize based on predetermined rules. During this test, participants were provided the rule and asked to classify objects based on the rule. This type of task is considered passive in nature because participants were not required to delineate the rule themselves. In contrast, during the actual training tasks of the CP, participants were required to delineate the rule based on feedback they received from the clinician. While young participants (both with TBI and noninjured young adults) demonstrated significant improvement on the CP Test 2, older adults who received the training did not demonstrate significant gains. Therefore, it appears that older adults demonstrate greater gains in the classification of objects as compared to rule-based learning.
Older adults were followed up to four months upon completion of their training. This was not possible for the TBI group since completion of the CP training also coincided with discharge from the rehabilitation facility. Findings indicated that older adults who received the training were able to maintain their gains at one and four months posttraining. Future studies need to explore the posttraining effects systematically. This information can guide future research on the CP and on potential benefits of “tune-up” sessions at specified intervals.
One of the primary challenges faced by cognitive rehabilitation programs centers on the realization that knowledge acquired during training may not transfer into other novel (untrained) tasks. Transfer success may be influenced by a number of factors stemming from the nature of the tasks, types of stimuli, and cognitive distance between the trained task and the untrained task as well as unfamiliarity with the untrained task itself. This challenge in transferring skills from domain-specific to more general can limit the practical impact of cognitive training programs as well as the motivation of participants to continue their training. An additional variable that contributes to the aforementioned challenge might be the advanced age of some older participants (i.e., over 75), which in turn could create difficulties in learning, speed of information processing, mental flexibility, and reduction in strategy use [8].
Hence, another important objective of the present study was to determine whether the CP training facilitates the ability to generalize categorization skills to novel tasks as measured by the probes. The current results indicated that our older adult group, similarly to adults with TBI, demonstrated gains in the probe performance. However, the gains of the young TBI group were greater than that of the older adult group. This might be due to the fact that the injured TBI group had a greater room for improvement on this task. Future studies may want to increase the complexity of the probe tasks in order to ensure that they provide opportunity for improvement in performance as a result of training.
4.1. Relationship between the CP Measures and Formal Neuropsychological Tests
Given the focus of CP Test 1 on object recognition and categorization, it is understandable that the skills this test measures overlap significantly with those assessed by the neuropsychological tests comprising the Perception Composite score and the Conceptual/Reasoning composite. On the other hand, rule-governed categorization has been consistently related to executive functioning, attention, and reasoning processes using a variety of methodologies [27, 29]. The present findings are largely consistent with this view as can be seen by the fact that composite measures having to do with executive function, attention, and reasoning correlate with performance on CP Test 2 during the pretest and posttest administrations. Probe task improvement is largely related to conceptual/reasoning and perceptual/visual measures, although this task may be affected by a ceiling effect. Finally, the Memory Composite and the Global Cognitive composite scores relate to all CP-dependent measures. The present findings with older adults are consistent with our previous work with the CP and TBI [13].
Future research should continue to explore the interaction between task properties and learner capacity. Evidence suggests [68] that individuals with high working memory capacities (as measured, for instance, by the digit span task) will learn rule-based problems faster than they can learn problems requiring a nonexplicit, similarity reasoning strategy. Alternatively, individuals with lower working memory capacity learn the nonrule-governed category structures faster than they learn those defined by rules. In the present study, baseline performance on the CP-dependent measures was highly correlated with the memory composite scores. This suggests that it may be profitable, in the designing of neurocognitive programs like the CP, to understand the relationship between individual neuropsychological characteristics and performance in categorization retraining tasks. The present study implemented composite scores in order to create theoretically meaningful constructs and also as a strategy to reduce the number of comparisons. Due to the preliminary nature of the findings and the small sample size, further corrections for multiple comparisons were not implemented. This limitation should be taken into consideration when interpreting the above findings.
4.2. Conclusions, Clinical Implications, Limitations, and Future Research
The present results contribute to the growing body of literature supporting cognitive training in healthy older adults. Improvements noted by cognitively healthy older adults and by younger participants with TBI, are consistent with our previous work implementing the CP with younger adults who sustained neuropsychological deficits secondary to closed head injury [12, 13]. However, gains demonstrated by older adults are not as dramatic as those demonstrated by their younger counterparts. Future research needs to determine the utility of the CP in treating older patients with TBI during rehabilitation and in the chronic phase post injury. This is in light of recent evidence on the neurodegenerative effects of chronic TBI on the brain structure and function [35, 69].
The Task Force on Promotion and Dissemination of Psychological Procedures and the World Health Organization define efficacy research as the examination of an intervention's effect under highly controlled experimental conditions [50, 70]. The current results suggest that the CP training is efficacious in enhancing certain aspects of categorization performance. The CP training implemented a standardized, manualized protocol and followed the necessary procedures in order to adhere to the standards and rigor of experimental research. However, given the small sample sizes in the present study, the results should be interpreted with caution and could not be generalized to the larger population of TBI and older adults. Future research should incorporate larger sample sizes to reduplicate these findings and also incorporate quality of life outcome measures in order to determine the potential generalizability of cognitive training in other aspects of daily activities.
One of the strengths of the current project was the careful selection of participants in order to create a homogeneous sample of subjects, improve internal validity, and reduce variability in performance. In addition to determining the utility of the CP training in older adults with TBI, future research should include adults with mild cognitive decline in order to determine the potential utility of this type of training in adults who may be at risk for developing dementia.
Present findings with a small subgroup of older adults demonstrate that the positive effects of CP training last for up to 4 months post treatment. This finding can guide future research on determining the timing and potential benefit of periodic booster sessions. Additionally, the link between CP training and improving cognitive reserve in older adults may be a fruitful line of research. Furthermore, future studies exploring the long-term effects of treatment should incorporate older adults who do not receive the training in addition to both younger and older adults with TBI.
Biological aging does not seem to be a uniformed process; therefore, larger studies (with neurologically healthy and neurologically compromised groups of participants) will afford the necessary statistical power to identify subgroups of older adults and delineate who benefits the most from this type of training. The identification of individuals with specific neuropsychological and genetic (i.e., ApoE allele) profiles, determination of mitigating factors, and the development of predictive models indicating who would demonstrate the greatest gains would be an important contribution of larger scale studies.
In closing, the present results provide additional evidence supporting the continued investigation of the CP training in adult neurorehabilitation. Future larger scale clinical trials would provide stronger evidence for the CP utility. The long-term effects of CP training on categorization performance and the use of CP training in older participants who are at risk for dementia and in older adults with TBI would be a fruitful line of investigation.
Acknowledgments
Special thanks are due to the study volunteers, to the clinical site collaborators at the Center for Neuro Skills (CNS), Bakersfield, CA; Center for Neuro Skills, Dallas, Texas; and Center for Comprehensive Services (CCS, NeuroRestorative), Carbondale, IL, and to the members of the NeuroCognitive Disorders Laboratory at Miami University for their contributions, especially Abigail Migut, Lacy Robinson, and Jessica Schneider. This research was supported in part by a grant from the Committee on Faculty Research at Miami University, Oxford, Ohio, where Constantinidou was Professor of Speech Pathology and Audiology. The statistical analyses, preparation, writing, and editing of this manuscript was supported by the author's current employer, the University of Cyprus, Nicosia, Cyprus.
Data Availability
The data used to support the findings of this study are available from the corresponding author upon request. Availability is dependent upon compliance with personal data protection laws and ethics board laws and regulations.
Conflicts of Interest
There are no conflicts of interest to report, financial or otherwise.
References
- 1.Rebok G. W., Ball K., Guey L. T., et al. Ten-year effects of the advanced cognitive training for independent and vital elderly cognitive training trial on cognition and everyday functioning in older adults. Journal of the American Geriatrics Society. 2014;62(1):16–24. doi: 10.1111/jgs.12607. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Li S.-C., Schmiedek F., Huxhold O., Röcke C., Smith J., Lindenberger U. Working memory plasticity in old age: Practice gain, transfer, and maintenance. Psychology and Aging. 2008;23(4):731–742. doi: 10.1037/a0014343. [DOI] [PubMed] [Google Scholar]
- 3.Giogkaraki E., Michaelides M. P., Constantinidou F. The role of cognitive reserve in cognitive aging: results from the neurocognitive study on aging. Journal of Clinical and Experimental Neuropsychology. 2013;35(10):1024–1035. doi: 10.1080/13803395.2013.847906. [DOI] [PubMed] [Google Scholar]
- 4.Constantinidou F., Baker S. Stimulus modality and verbal learning performance in normal aging. Brain and Language. 2002;82(3):296–311. doi: 10.1016/S0093-934X(02)00018-4. [DOI] [PubMed] [Google Scholar]
- 5.Kaszniak A. W., Poon L. W., Riege W. H. Assessing memory deficits: an information-processing approach. In: Poon L. W., Crook T., Davis K. L., et al., editors. Handbook for Clinical Memory Assessment of Older Adults. Washington D.C.: American Psychological Association; 1986. pp. 168–188. [DOI] [Google Scholar]
- 6.Constantinidou F., Ioannou M. The effects of age and language on paragraph recall performance: findings from a preliminary cross-sectional study. Psychologia. 2008;15(4):342–361. [Google Scholar]
- 7.Constantinidou F., Zaganas I., Papastefanakis E., Kasselimis D., Nidos A., Simos P. G. Age-related decline in verbal learning is moderated by demographic factors, working memory capacity, and presence of amnestic mild cognitive impairment. Journal of the International Neuropsychological Society. 2014;20(8):822–835. doi: 10.1017/S1355617714000678. [DOI] [PubMed] [Google Scholar]
- 8.Ackerman P. L., Kanfer R., Calderwood C. Use it or lose it? Wii brain exercise practice and reading for domain knowledge. Psychology and Aging. 2010;25(4):753–766. doi: 10.1037/a0019277. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Constantinidou F., Thomas R. D. Principles of cognitive rehabilitation in TBI: an integrative neuroscience approach. In: Ashley M. J., Hovda D. A., editors. Traumatic Brain Injury: Rehabilitation, Treatment, and Case Management, Fourth Edition. Taylor & Francis: CRC Press; 2017. pp. 513–540. [DOI] [Google Scholar]
- 10.Karbach J., Verhaeghen P. Making working memory work: a meta-analysis of executive-control and working memory training in older adults. Psychological Science. 2014;25(11):2027–2037. doi: 10.1177/0956797614548725. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Brehmer Y., Westerberg H., Bäckman L. Working-memory training in younger and older adults: training gains, transfer, and maintenance. Frontiers in Human Neuroscience. 2012;6:p. 63. doi: 10.3389/fnhum.2012.00063. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Constantinidou F., Thomas R. D., Scharp V. L., Laske K. M., Hammerly M. D., Guitonde S. Effects of categorization training in patients with TBI during post-acute rehabilitation: preliminary findings. The Journal of Head Trauma Rehabilitation. 2005;20(2):143–157. doi: 10.1097/00001199-200503000-00003. [DOI] [PubMed] [Google Scholar]
- 13.Constantinidou F., Thomas R. D., Robinson L. Benefits of categorization training in patients with Traumatic Brain Injury during post–acute rehabilitation. Journal of Head Trauma Rehabilitation. 2008;23(5):312–328. doi: 10.1097/01.HTR.0000336844.99079.2c. [DOI] [PubMed] [Google Scholar]
- 14.Caramazza A., Shelton J. R. Domain-specific knowledge systems in the brain: the animate-inanimate distinction. Journal of Cognitive Neuroscience. 1998;10(1):1–34. doi: 10.1162/089892998563752. [DOI] [PubMed] [Google Scholar]
- 15.Humphreys G. W., Price C. J., Riddoch M. J. From objects to names: a cognitive neuroscience approach. Psychological Research. 1999;62(2-3):118–130. doi: 10.1007/s004260050046. [DOI] [PubMed] [Google Scholar]
- 16.Ashby F. G., Alfonso-Reese L. A., Turken A. U., Waldron E. M. A neuropsychological theory of multiple systems in category learning. Psychological Review. 1998;105(3):442–481. doi: 10.1037/0033-295X.105.3.442. [DOI] [PubMed] [Google Scholar]
- 17.Nosofsky R. M. Exemplar-based approach to relating categorization, identification, ad recognition. In: Ashby F. G., editor. Multidimensional Models of Perception and Cognition. Hillsdale, NJ: Earlbaum; 1992. pp. 363–393. [Google Scholar]
- 18.Erickson M. A. Executive attention and task switching in category learning: evidence for stimulus-dependent representation. Memory & Cognition. 2008;36(4):749–761. doi: 10.3758/MC.36.4.749. [DOI] [PubMed] [Google Scholar]
- 19.Patterson K., Nestor P. J., Rogers T. T. Where do you know what you know? The representation of semantic knowledge in the human brain. Nature Reviews Neuroscience. 2007;8(12):976–987. doi: 10.1038/nrn2277. [DOI] [PubMed] [Google Scholar]
- 20.Cree G. S., McRae K. Analyzing the factors underlying the structure and computation of the meaning of chipmunk, cherry, chisel, cheese, and cello (and many other such concrete nouns) Journal of Experimental Psychology: General. 2003;132(2):163–201. doi: 10.1037/0096-3445.132.2.163. [DOI] [PubMed] [Google Scholar]
- 21.Humphreys G. W., Forde E. M. Hierarchies, similarity, and interactivity in object recognition:“category-specific” neuropsychological deficits. Behavioral and Brain Sciences. 2001;24(3):453–476. [PubMed] [Google Scholar]
- 22.Constantinidou F., Migut A. Common object categorization in TBI and in normal aging executive network functioning and implications for rehabilitation. Journal of the International Neuropsychological Society. 2008;14(Supplement 1):p. 76. [Google Scholar]
- 23.Constantinidou F., Kreimer L. T. Feature description and categorization of common objects after traumatic brain injury: the effects of a multi-trial paradigm. Brain and Language. 2004;89(1):216–225. doi: 10.1016/S0093-934X(03)00399-7. [DOI] [PubMed] [Google Scholar]
- 24.Ashby F. G., Waldron E. M. The neuropsychological bases of category learning. Current Directions in Psychological Science. 2000;9(1):10–14. doi: 10.1111/1467-8721.00049. [DOI] [Google Scholar]
- 25.Constantinidou F., Thomas R. D. Principles of cognitive rehabilitation in TBI: an integrative neuroscience approach. In: Ashley M., editor. Traumatic Brain Injury: Rehabilitation, Treatment, and Case Management. 3rd edition. Taylor & Francis: CRC Press; 2010. pp. 549–582. [DOI] [Google Scholar]
- 26.Ashby F. G., Noble S., Filoteo J. V., Waldron E. M., Ell S. W. Category learning deficits in Parkinson’s disease. Neuropsychology. 2003;17(1):115–124. doi: 10.1037/0894-4105.17.1.115. [DOI] [PubMed] [Google Scholar]
- 27.Ashby F. G., Spiering B. J. The neurobiology of category learning. Behavioral and Cognitive Neuroscience Reviews. 2004;3(2):101–113. doi: 10.1177/1534582304270782. [DOI] [PubMed] [Google Scholar]
- 28.Maddox W. T., Love B. C., Glass B. D., Filoteo J. V. When more is less: feedback effects in perceptual category learning. Cognition. 2008;108(2):578–589. doi: 10.1016/j.cognition.2008.03.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Maddox W. T., Ashby F. G. Dissociating explicit and procedural-learning based systems of perceptual category learning. Behavioural Processes. 2004;66(3):309–332. doi: 10.1016/j.beproc.2004.03.011. [DOI] [PubMed] [Google Scholar]
- 30.Maddox W. T., Filoteo J. V. Striatal contributions to category learning: quantitative modeling of simple linear and complex nonlinear rule learning in patients with Parkinson’s disease. Journal of the International Neuropsychological Society. 2001;7(6):710–727. doi: 10.1017/S1355617701766076. [DOI] [PubMed] [Google Scholar]
- 31.Brickman A. M., Siedlecki K. L., Muraskin J., et al. White matter hyperintensities and cognition: testing the reserve hypothesis. Neurobiology of Aging. 2011;32(9):1588–1598. doi: 10.1016/j.neurobiolaging.2009.10.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Breunig J. J., Guillot-Sestier M. V., Town T. Brain injury, neuroinflammation and Alzheimer’s disease. Frontiers in Aging Neuroscience. 2013;5:p. 26. doi: 10.3389/fnagi.2013.00026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Iliff J. J., Chen M. J., Plog B. A., et al. Impairment of glymphatic pathway function promotes tau pathology after traumatic brain injury. Journal of Neuroscience. 2014;34(49):16180–16193. doi: 10.1523/JNEUROSCI.3020-14.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Johnson V. E., Stewart W., Smith D. H. Widespread tau and amyloid-beta pathology many years after a single traumatic brain injury in humans. Brain Pathology. 2012;22(2):142–149. doi: 10.1111/j.1750-3639.2011.00513.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Konstantinou N., Pettemeridou E., Seimenis I., et al. Assessing the relationship between neurocognitive performance and brain volume in chronic moderate-severe traumatic brain injury. Frontiers in Neurology. 2016;7:p. 29. doi: 10.3389/fneur.2016.00029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Pettemeridou E., Constantinidou F. Brain reserve as a predictor of functional outcome in chronic moderate-to-severe TBI. Archives of Physical Medicine and Rehabilitation. 2018;99(10, article e39) doi: 10.1016/j.apmr.2018.07.136. [DOI] [Google Scholar]
- 37.Daviglus M. L., Bell C. C., Berrettini W., et al. National Institutes of Health state-of-the-science conference statement: preventing Alzheimer disease and cognitive decline. Annals of Internal Medicine. 2010;153(3):176–181. doi: 10.7326/0003-4819-153-3-201008030-00260. [DOI] [PubMed] [Google Scholar]
- 38.Constantinidou F., Thomas R. D., Best P. Principles of cognitive rehabilitation after traumatic brain injury: a systematic hierarchical approach. In: Ashley M., Constantinidou F. T., editors. Traumatic Brain Injury Rehabilitation. 2nd. Boca Raton, FL: CRC Publishers; 2004. pp. 337–365. [Google Scholar]
- 39.Constantinidou F. This is a copyright protected therapy program and manual designed to treat adults with cognitive-communication disorders. Oxford, OH: Miami University. United States Library of Congress, copyright office (TXU 001345058); 2006. The categorization program. [Google Scholar]
- 40.Gentilini M., Nichelli P., Schoenhuber R. Assessment of attention in mild head injury. In: Levin H. S., Eisenberg H. M., Benton A. L., editors. Mild Head Injury. New York: Oxford University Press; 1989. pp. 163–175. [Google Scholar]
- 41.Kay T., Harrington D. E., Adams R., et al. Definition of mild traumatic brain injury. Journal of Head Trauma Rehabilitation. 1993;8(3):86–87. [Google Scholar]
- 42.Hagen C., Malkmus D., Durham P. Levels of cognitive functioning. In: Downey C. A., editor. Rehabilitation of the Head-Injured Adult: Comprehensive Physical Management. Professional Staff Association of Rancho Los Amigos Hospital; 1972. [Google Scholar]
- 43.Levin H. S., O’Donnell M. A., Grossman R. G. Galveston Orientation and Amnesia Test (GOAT): A Practical Scale to Assess Cognition after Head Injury. Baltimore: Williams & Wilkins; 1979. [DOI] [PubMed] [Google Scholar]
- 44.American Psychiatric Association. DSM-IV: The Diagnostic and Statistical Manual of Mental Disorders. San Antonio: The Psychological Corporation; 1994. [Google Scholar]
- 45.Beck A. T., Steer R. A., Brown G. K. The Beck Depression Inventory-II. San Antonio: The Psychological Corporation; 1996. [Google Scholar]
- 46.Goodglass H., Kaplan E., Barresi B. Boston Diagnostic Aphasia Examination. 3rd. San Antonio, TX: The Psychological Corporation; 2000. [Google Scholar]
- 47.Dutton F. Ishihara test for color blindness. 1999. March 2000, http://www.toledo-bend.com/colorblind/Ishihara.html.
- 48.Folstein M. F., Folstein S. E., McHugh P. R. "Mini-mental state": a practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research. 1975;12(3):189–198. doi: 10.1016/0022-3956(75)90026-6. [DOI] [PubMed] [Google Scholar]
- 49.Adamovich B. B., Henderson J. A., Auerbach S. Cognitive Rehabilitation of Closed Head Injured Patients: A Dynamic Approach. San Diego, Ca: College Hill Press; 1985. [Google Scholar]
- 50.Coelho C. A., DeRuyter F., Stein M. Treatment efficacy: cognitive-communicative disorders resulting from traumatic brain injury in adults. Journal of Speech and Hearing Research. 1996;39(5):S5–S17. doi: 10.1044/jshr.3905.s5. [DOI] [PubMed] [Google Scholar]
- 51.Lezak M. D. Neuropsychological Assessment. 3rd. New York: Oxford University Press; 1995. [Google Scholar]
- 52.Luria A. R. Restoration of Function after Brain Injury. Oxford: Pergamon Press; 1963. [Google Scholar]
- 53.Zeno S. M., Ivens S. H., Millard R. T., Duvvuri R. The Educator’s Word Frequency Guide. New York: Touchstone Applied Science Associates; 1995. [Google Scholar]
- 54.Wechsler D. Wechsler Abbreviated Scale of Intelligence. San Antonio: The Psychological Corporation; 1999. [Google Scholar]
- 55.Folstein M. F., Folstein S. E., McHugh P. R. Mini Mental State Examination. Lutz, FL: Psychological Assessment Resources, Inc.; 2001. [Google Scholar]
- 56.Myers J. E., Meyers K. R. Rey Complex Figure Test and Recognition Trial. Odessa, FL: Psychological Assessment Resources, Inc.; 1995. [Google Scholar]
- 57.Lezak M. D. Neuropsychological Assessment. 2nd. New York: Oxford University Press; 1983. [Google Scholar]
- 58.Wechsler D. Wechsler Memory Scale. 3rd. San Antonio, TX: The Psychological Corporation; 1999. [Google Scholar]
- 59.Delis D. C., Kramer J. H., Kaplan E., Ober B. A. California Verbal Learning Test. 2nd. San Antonio, TX: The Psychological Corporation; 2000. [Google Scholar]
- 60.Grant D. A., Berg E. A. Wisconsin Card Sorting Test. Western Psychological Services: Los Angeles; 1981. [Google Scholar]
- 61.De Filippis N. A., McCambell E. Booklet Category Test. 2nd. Odessa, FL: Psychological Assessment Resources, Inc.; 1998. [Google Scholar]
- 62.Smith A. Symbol Digit Modalities Test. Los Angeles: Western Psychological Services; 1973. [Google Scholar]
- 63.Benton A., Hamsher K. Multilingual Aphasia Examination. Iowa City: University of Iowa Press; 1978. [Google Scholar]
- 64.Woodcock R. W., McGrew K. S., Mather N. Woodcock Johnson Tests of Cognitive Abilities. 3rd. Itasca, IL: Riverside Publishing; 2001. [Google Scholar]
- 65.Lezak M. D., Howieson D. B., Loring D. W. Neuropsychological Assessment. 4th. Oxford: Oxford University Press; 2004. [Google Scholar]
- 66.Cahn D. A., Sullivan E. V., Shear P. K., Pfefferbaum A., Heit G., Silverberg G. Differential contributions of cognitive and motor component processes to physical and instrumental activities of daily living in Parkinson’s disease. Archives of Clinical Neuropsychology. 1998;13(7):575–583. doi: 10.1093/arclin/13.7.575. [DOI] [PubMed] [Google Scholar]
- 67.Cohen J., Cohen P., West S. G., Aiken L. S. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences. 3rd. Hillsdale, NJ: Erlbaum; 2003. [Google Scholar]
- 68.DeCaro M. S., Thomas R. D., Beilock S. L. Individual differences in category learning: sometimes less working memory capacity is better than more. Cognition. 2008;107(1):284–294. doi: 10.1016/j.cognition.2007.07.001. [DOI] [PubMed] [Google Scholar]
- 69.Konstantinou N., Pettemeridou E., Stamatakis E. A., Seimenis I., Constantinidou F. Altered resting functional connectivity is related to cognitive outcome in males with moderate-severe Traumatic Brain Injury. Frontiers in Neurology. 2019;9, article 1163 doi: 10.3389/fneur.2018.01163. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Task Force on Promotion and Dissemination of Psychological Procedures. Training in and dissemination of empirically validated psychological treatments. The Clinical Psychologist. 1995;48:13–23. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data used to support the findings of this study are available from the corresponding author upon request. Availability is dependent upon compliance with personal data protection laws and ethics board laws and regulations.