Abstract
While there is evidence that knowledge influences understanding of health information, less is known about the processing mechanisms underlying this effect and its impact on memory. We used the moving window paradigm to examine how older adults varying in domain-general crystallized ability (verbal ability) and health knowledge allocate attention to understand health and domain-general texts. Participants (n=107, aged 60 to 88 yrs) read and recalled single sentences about hypertension and about non-health topics. Mixed-effects modeling of word-by-word reading times suggested that domain-general crystallized ability increased conceptual integration regardless of text domain, while health knowledge selectively increased resource allocation to conceptual integration at clause boundaries in health texts. These patterns of attentional allocation were related to subsequent recall performance. Although older adults with lower levels of crystallized ability were less likely to engage in integrative processing, when they did, this strategy had a compensatory effect in improving recall. These findings suggest that semantic integration during reading is an important comprehension process that supports the construction of the memory representation and is engendered by knowledge. Implications of the findings for theories of text processing and memory as well as for designing patient education materials are discussed.
Keywords: Knowledge, Reading Comprehension, Cognitive Aging, Resource Allocation, Health Care
Knowledge is a powerful resource for older adults to maintain high levels of performance. For example, knowledge may support strategies that compensate for cognitive limitations in many tasks, such as comprehension and decision-making in health, aviation, and other domains (e.g., Meyer, Talbot & Ranalli, 2007; Morrow et al., 2001). Knowledge helps readers understand information, in part by engendering efficiency in component processes and promoting effective reading strategies (e.g., Stine-Morrow, Miller, Gagne & Hertzog, 2008). Unlike other cognitive resources such as processing capacity (e.g., working memory), knowledge growth is preserved across the life span (Baltes, 1997; Beier & Ackerman, 2005). Hence, it is important to understand the role of knowledge in maintaining comprehension skill as an aspect of successful aging. While studies have investigated how knowledge promotes comprehension (e.g., Miller et al., 2004; Miller, Gibson & Applegate, 2010), our focus was on the distinctive effects of crystallized ability (i.e., verbal ability) and domain-specific knowledge on comprehension.
We investigated the effects of domain-general crystallized ability and health-related knowledge on understanding information about health. While adult development generally affords the growth of knowledge, crystallized abilities (e.g., verbal ability and generalized knowledge structures, such as that measured by vocabulary) and domain-specific knowledge are influenced by different sorts of experiences and have the potential to develop independently (Ackerman, 2008). Crystallized ability grows as a function of broad-based literacy experience (Stanovich, West, & Harrison, 1995). Domain-specific knowledge, on the other hand, requires engagement with activities specific to that domain (Ericsson & Charness, 1994). The importance of understanding health information to older adults' daily functioning is reflected in the large research base on health literacy (Dewalt et al., 2004). Health literacy is defined as the capacity to obtain, understand and use information to make health decisions (DHHS, Healthy People 2010). Because adults with lower health literacy are less likely to comprehend health care information, studies often found that health literacy measures are associated with a wide range of health outcomes (DeWalt et al., 2004). Health literacy is often found to be lower among older adults (e.g., Baker et al., 2000), but a substantial amount of age-related variance in commonly used measures of health literacy can be attributed to domain-general age-related declines in processing capacity necessary for comprehension (Chin et al., 2011). Hence, there is actually very little understanding of how domain-specific health knowledge factors into comprehension and memory of health information among older adults.
We developed the Process-Knowledge Model of health literacy to help explain the interactive contributions of processing capacity, crystallized ability, and health knowledge as determinants of health literacy (Chin et al., 2011). According to this model, there are multiple components contributing to the development of health literacy, including processing capacity (e.g., processing speed and working memory), crystallized ability (as indexed by verbal ability), and health knowledge. We have observed that adequate health-related knowledge and crystallized ability can compensate for declines in processing capacity, allowing older adults to achieve high levels of performance on health literacy measures. In other words, the ability components that contribute to comparable levels of health literacy (as measured by conventional assessments) can vary across individuals. From a process point of view, which is necessary for developing effective interventions in terms of comprehension of health information, varying profiles of processing capacity, crystallized ability, and health knowledge matter. In the current study, we investigated the effects of crystallized ability and health knowledge on strategies in reading health texts to examine the extent to which knowledge may compensate for limited processing capacity to promote high levels of recall of health information among older adults. We focused on hypertension as our health domain because it is a relative common chronic illness among older adults over age 65 (American Heart Association Statistics Committee and Stroke Statistics Subcommittee, 2013).
Processes and Representations in Comprehension
Comprehension entails constructing, updating, and maintaining mental representations at multiple levels, including the word-level, textbase and situation model (Kintsch, 1998). Word-level representations involve decoding orthographic or acoustic information to access word meanings (concepts); textbase representations involve integrating these meanings into a propositional representation of the ideas conveyed by the text; and the situation model involves a more elaborated representation of the situation implied by the text. According to the self-regulated language processing (SRLP) model (Stine-Morrow, Miller & Hertzog, 2006), readers allocate attention differentially to compute these representations so as to be “good enough” to satisfy comprehension goals (Ferreira, Bailey & Ferraro, 2002). Attentional resources allocated to constructing multiple levels of representation can be measured by the reading time individuals spend on different text features reflecting word-level, textbase and situation model processing. Random regression models (Lorch & Myers, 1990; Stine-Morrow, Milinder, Pullara, 2001; Stine-Morrow et al., 2008) or mixed effect models (Payne, Gao, Noh, Anderson, & Stine-Morrow, 2012) can be used to decompose the reading time into components specific to different text features to examine how readers allocate attention to construct different levels of representation. For example, word-level processes include lexical access and decoding. Lexical access is operationally measured by the increase in reading time as a function of the unit change of log word frequency; the orthographic decoding process is operationally measured by the increase in reading time as the number of syllables increase. Readers often slow down for longer or less frequent words to reflect more attentional resources needed to generate word-level representations.
Conceptual integration (CI) is central to creating the textbase representation. Readers often spend extra time (i.e., pause) when encountering the ends of syntactic constituents such as clauses and sentences, reflecting the effort that readers devote to integrate the concepts they have read so far so as to create a coherent mental representation of the meaning of the text (Just & Carpenter, 1982; Kintch, 1980). In fact, the relatively longer times at such boundary sites have been shown to increase as a function of the number of concepts introduced up to that point in the text (Haberlandt & Graesser, 1989). Hence, the term “wrap-up” used to describe this phenomenon, is apt in implying a consolidation process.
There is evidence that CI is functionally important in reading comprehension. For example, the allocation of effort to CI has been shown to result in better recall of the text, presumably because it enables the creation of more elaborate, coherent, and enduring textbase representations (Stine-Morrow et al., 2008). Clause-final CI in particular may be an efficient comprehension strategy because it can facilitate downstream CI processes at the end of the sentence. Stine-Morrow, Shake et al. (2010) manipulated the structures of sentences, so as to encourage reader to engage CI relatively early in the sentence. They found that this early CI decreased allocation to later sentence-final CI, leading to more efficient processing. Thus, clause CI may play a crucial role among older readers in engaging efficient, as well as effective, reading processes.
Impact of Age-Related Changes in Cognition on Comprehension
Cognitive development has distinctive trajectories across the life span (Baltes, 1997), with processing capacity (e.g., working memory and processing speed) declining but knowledge sustained with aging. Domain-specific knowledge and crystallized ability may promote effective learning despite declines in processing capacity (Beier & Ackerman, 2005). For example, older adults with hypertension learn about their illness over time (Chin et al., 2009) and such knowledge might facilitate learning new information about the disease despite the decline in processing capacity (cf. Miller & Stine-Morrow, 1998). Therefore, the interplay between processing capacity constraints and knowledge growth may shape comprehension among older adults (e.g., Stine-Morrow et al., 2006) and may be critical for promoting self-care among older adults with limited health literacy (Chin et al., 2011).
Comprehension processes such as CI are more difficult for older adults because of age-related declines in processing capacity. Previous research has consistently documented that older adults need to invest more time in word-level and textbase processing than younger adults (Stine-Morrow et al., 2008). Older adults have been found to allocate more time to CI than younger adults, especially at the ends of clauses, in order to reach levels of performance comparable to the young. This clause-final integration may serve as a compensatory strategy for older adults (e.g., Miller et al., 2004; Stine-Morrow et al., 2008, 2010).
Comprehension is also shaped by crystallized ability. Crystallized abilities, as operationalized by vocabulary or exposure to print, are related to increased allocation to CI processes among adults (Payne et al., 2012; Stine-Morrow et al., 2008). Older readers with higher levels of crystallized ability tend to allocate more attention to CI than those with lower crystallized ability, an advantage that may be conferred by both practice in creating mental representations from print, and the relative autonomization of word-level processing (e.g., Payne et al., 2012; Stine-Morrow et al., 2001, 2008).
Domain-specific knowledge, on the other hand, would be expected to have effects on comprehension that are distinct from crystallized ability, for example, in expanding the lexicon in particularized ways and in affording access to knowledge that stimulates elaborative inferencing (Graesser, Haberlandt, & Koizumi, 1987). In a study directly relevant to the present experiment, Miller and her colleagues (2004) investigated the impact of health knowledge on age differences in text comprehension. Participants were randomly assigned to a training session in which they learned about the heart and circulatory systems, or to a control group. Trained (high knowledge) older adults allocated more resources to CI than trained younger adults did, with the effects localized to clause-level integration.
Thus, the behavioral signatures of crystallized ability and domain-specific knowledge on sentence processing may be comparable in promoting wrap-up, indicating enhanced elaborative processing and conceptual integration, but to our knowledge, there has been no systematic investigation separating out these effects in a single experiment. It is especially important to understand the interplay of general (crystallized ability) and health-related knowledge on comprehension of health information because both types of knowledge are key components of health literacy (Chin et al., 2011), which predicts health behaviors and outcomes (DeWalt et al., 2004).
Current Study
We examined the distinctive effects of crystallized ability and health knowledge on processing and recall of general and health texts (sentences) among older adults, testing three hypotheses: (1) Crystallized ability would increase conceptual integration across text domains. (2) Health knowledge would increase conceptual integration in health but not general texts. (3) Conceptual integration would promote better recall performance.
Method
Participants
One hundred and eleven older adults were recruited from the community. Four did not finish the study due to fatigue. The analysis was based on the remaining 107 participants. These 107 participants ranged in age from 60 to 88 (Mean Age=70.3, SD=6.6), they were predominately female (62.6%) and varied widely in education (18.7% did not complete high school, 31.8% had graduated with high school degree, and 49.5% had more than high school level of education). Most participants (N=100) were diagnosed with hypertension, for an average duration of 13 years (SD=10.25). More than 90% of participants had adequate health literacy (>22 out of 36) as measured by the STOFHLA (Short Test of Functional Health Literacy in Adults; Baker, Williams, Parker, Gazmararian, & Nurss, 1999).
Measures
Processing speed was measured by Pattern Comparison (Salthouse, 1991) and Identical Pictures tasks (Ekstrom et al., 1976). Working memory was measured by Letter-Number Sequencing (Wechsler, 1997). Processing capacity was measured by a composite score, the sum of z-scores of these three measures (Cronbach's α =0.73). Crystallized ability was measured by the Advanced Vocabulary Task (Ekstrom et al., 1976; α=0.79). Health knowledge was measured by the hypertension knowledge questionnaire, which consisted of 33 true/false and 4 multiple-choice questions and was modified from Gazmararian et al. (2003) (Cronbach α=.90; Chin et al., 2009).
Materials
Experimental stimuli were 48 18-word sentences. Half of the sentences were about hypertension and other topics related to cardiovascular disease. They were modified versions of texts from online articles, pamphlets, or drug prescriptions related to hypertension and cardiovascular disease (e.g., Hypertension is the “silent killer” because it usually has no symptoms until it causes damage to the body). The other half was about general topics in science, nature and history, and adopted from Stine-Morrow, Milinder, Pullara and Herman (2001; e.g., A leopard is strong and agile enough to be able to tackle prey weighing twice its own weight). The words in the health sentences were slightly higher in log word frequency (Balota et al., 2007) than those in the general sentences (t(46)=−2.23, p=.03; general: M=11.38, SD=0.74; health: M=11.87, SD=0.80). However, the two types of sentences did not differ in number of syllables per word (t(46)=−1.29, p=.20; general: M=1.57, SD=0.21; health: M=1.65, SD=0.23), number of propositions (t(46)=−0.21, p=.84; general: M=7.58, SD=1.18; health: M=7.67, SD=1.58), or number of new concepts (t(46)=1.26, p=.21; general: M=6.21, SD=1.61; health: M=5.63, SD=1.58). All participants read both the health and general sentences, with domain blocked and the order of blocks counterbalanced across participants.
Procedure
Sentences were presented one word at a time on a computer screen (using E-Prime 1.2) following the moving window paradigm (Just et al., 1982), with presentation self-paced. Text was displayed in white nonproportional Courier New 24-point font on a black background. Participants were instructed to read the sentences for understanding, and then to recall as much of the information from each sentence as possible. The recall was audio recorded and later transcribed. Based on the gist criterion (Stine-Morrow et al., 2008), proportion of propositions recalled was scored for each participant.
RESULTS
We used linear mixed effects models to analyze the effects of individual difference variables, including processing capacity (PC), crystallized ability (Gc) and health knowledge (HK); text domain (health and general), and text features on individual reading times. This enabled us to model resource allocation to text demands for different types of individuals reading different types of texts. Regression analysis was then used to predict recall performance from individual difference variables and indices of reading strategies derived from the mixed-effects models. Mixed effect models have been applied to many areas of research including education, neuroscience and social science (e.g., Baayen, Davidson & Bates, 2008). Unlike random regression models (Lorch & Myers, 1990), these models estimate both fixed effects and random effects of participants and items in a single step. We used R software and the function lmer in package lme4 (Bates, 2005; Bates & Sarkar, 2007) and Baayens MCMC function to estimate significance intervals for the parameter estimates (Baayen, et al., 2008). The mixed effects model equations are summarized in the appendix.
Reading Strategies
We first screened each participant's reading times for outliers. We replaced values larger than 3SD above the mean with the upper limit (that is, 3SD from the mean; less than 2% of the data were replaced). Values smaller than 200 ms were eliminated because these durations do not likely reflect reading processes (less than 1% of the data were eliminated). Reading time was then log transformed to approximate a normal distribution.
In order to model the reading times, each word in the sentences was coded for text features that index word-level and sentence-level processes. The word-level variables were number of syllables (Mean=1.61, SD=0.89) and log word frequency (Mean=11.63, SD=3.89) (Balota et al., 2007). The textbase level variables were created by assigning dummy codes (0/1) to the presence of intrasentence syntactic (clause) and sentence boundaries weighted by the number of new concepts introduced up to that point (Stine-Morrow et al., 2001). Thus, these indices can be interpreted as the increase in reading time at the boundary (clause or sentence) for each new concept encountered to that point, to operationalize clause (Mean=0.73, SD=1.71) and sentence wrap-up (Mean=0.31, SD=1.32).
The results of our modeling are summarized in Table 1a and Table 1b. We first examined the fixed effects of the four text features on reading time in the resource allocation model (Model 1, first column of Table 1a). The model suggested that these variables captured distinct components of resource allocation to word-level and textbase processing. As expected, participants spent more time reading lower frequency and longer words. They also spent more time at the end of clauses and sentences as the cumulative number of new concepts increased, suggesting that they allocated resources to conceptual integration at the end of syntactic constituents.
Table 1a.
Estimated parameters (with standard error of estimates) of mixed-effects modeling
Model 1 | Model 2 | Model 3 | ||||
---|---|---|---|---|---|---|
Fixed effect | ||||||
B | t | B | t | B | t | |
Intercept | 7.01 (0.05) | 145.02* | 7.08 (0.31) | 22.82 | 7.06 (0.31) | 22.73* |
Item Predictors | ||||||
Domain | −0.14 (0.07) | −2.18* | ||||
LogWF | −0.03 (0.002) | −16.11* | −0.03 (0.002) | −16.10* | −0.03 (0.002) | −14.86* |
Syll | 0.07 (0.01) | 8.88* | 0.07 (0.007) | 8.90* | 0.08 (0.008) | 9.35* |
CCI | 0.02 (0.005) | 4.12* | 0.02 (0.005) | 4.10* | 0.02 (0.005) | 3.97* |
SCI | 0.08 (0.006) | 13.14* | 0.08 (0.006) | 13.06* | 0.08 (0.006) | 13.14* |
Subject Predictors | ||||||
Age | −0.001 (0.004) | −0.22 | −0.001 (0.004) | −0.22 | ||
PC | −0.05 (0.01) | −3.61* | −0.05 (0.01) | −3.61* | ||
Gc | −0.18 (0.04) | −4.88* | −0.18 (0.04) | −4.86* | ||
HK | −0.03 (0.03) | −1.08 | −0.03 (0.03) | −1.08 | ||
Cross Level Interactions | ||||||
Gc × logWF | 0.003 (0.0004) | 7.67* | 0.003 (0.0004) | 7.42* | ||
Gc × Syll | −0.01 (0.002) | −5.43* | −0.01 (0.002) | −5.37* | ||
Gc × CCI | 0.01 (0.001) | 10.29* | 0.01 (0.001) | 10.00* | ||
Gc × SCI | 0.006 (0.001) | 4.33* | 0.007 (0.001) | 4.49* | ||
Domain × logWf | 0.006 (0.004) | 1.51 | ||||
Domain × Styll | 0.02 (0.02) | 1.08 | ||||
Domain × CCI | 0.009 (0.01) | 0.91 | ||||
Domain × SCI | −0.005 (0.01) | −0.40 | ||||
Domain × Gc | 0.004 (0.02) | 0.23 | ||||
Gc × logWF × Dom | −0.001 (0.001) | −1.50 | ||||
Gc × Syll × Dom | 0.002 (0.004) | 0.55 | ||||
Gc × CCI × Dom | 0.00007 (0.002) | 0.03 | ||||
Gc × SCI × Dom | −0.002 (0.003) | −0.65 | ||||
−2 Log Likelihood | 92134 | 91606 | 91568 | |||
Chi-squared | 528.32* | 37.28* |
Note: LogWF=word frequency; syll=number of syllables; CCI= clause conceptual integration; SCI= sentence conceptual integration; dom=domain; HK=studentized residuals of health knowledge on crystallized ability; PC = processing capacity; Gc=crystallized ability. The Chi-Squared is the improvement in model fit relative to the prior model.
p<.05
Table 1b.
Estimated parameters (with standard error of estimates) of mixed-effects modeling
Model 4 | Model 5 | |||
---|---|---|---|---|
Fixed Effect | ||||
B | t | B | t | |
Intercept | 7.08 (0.31) | 22.83* | 7.06 (0.31) | 22.73* |
Item Predictors | ||||
Domain | −0.14 (0.07) | −2.18* | ||
LogWF | −0.03 (0.002) | −16.11* | −0.03 (0.002) | −14.87* |
Syll | 0.07 (0.008) | 8.88* | 0.07 (0.008) | 9.33* |
CCI | 0.02 (0.005) | 4.12* | 0.02 (0.005) | 3.99* |
SCI | 0.08 (0.006) | 13.14* | 0.08 (0.006) | 13.23* |
Subject Predictors | ||||
Age | −0.001 (0.004) | −0.22 | −0.001 (0.004) | −0.22 |
PC | −0.05 (0.01) | −3.62* | −0.05 (0.01) | −3.61* |
Gc | −0.14 (0.04) | −4.05* | −0.14 (0.04) | −4.05* |
HK | −0.04 (0.03) | −1.42 | −0.04 (0.03) | −1.51 |
Cross Level Interactions | ||||
HK × logWF | 0.001 (0.0004) | 2.56* | 0.001 (0.0005) | 2.83* |
HK × Syll | −0.002 (0.002) | −1.01 | −0.001 (0.002) | −0.64 |
HK × CCI | 0.002 (0.001) | 1.61 | 0.002 (0.001) | 1.87 |
HK × SCI | −0.001 (0.001) | −0.69 | −0.001 (0.001) | −0.88 |
Domain × logWF | 0.006 (0.004) | 1.51 | ||
Domain × Syll | 0.02 (0.02) | 1.08 | ||
Domain × CCI | 0.009 (0.01) | 0.91 | ||
Domain × SCI | −0.005 (0.01) | −0.42 | ||
Domain × HK | −0.01 (0.02) | −0.79 | ||
HK × logWF × Domain | 0.0005 (0.0009) | 0.60 | ||
HK × Syll × Domain | 0.0007 (0.004) | 0.18 | ||
HK × CCI × Domain | 0.006 (0.002) | 2.42* | ||
HK × SCI × Domain | −0.009 (0.003) | −3.16* | ||
−2 Log Likelihood | 92058 | 92028 | ||
Chi-squared | 75.50* | 29.93* |
Note: LogWF=word frequency; syll=number of syllables; CCI= clause conceptual integration; SCI= sentence conceptual integration; dom=domain; HK= studentized residuals of health knowledge on crystallized ability; PC = processing capacity; Gc=crystallized ability. The Chi-Squared is the improvement in model fit relative to the prior model.
p<.05
Given that readers allocated resources to word-level and textbase processing in a meaningful pattern, we then conducted analyses to examine whether individual differences in crystallized ability and domain knowledge moderated text features at the word and textbase level to test our hypotheses.
Hypothesis 1. Crystallized ability increases conceptual integration across domains
In Model 2 (2nd column of Table 1a), we tested the effects of Gc and its differential impact on component text processes. Models were adjusted for age, PC and HK. Because HK was moderately correlated with Gc (r=0.57), we computed the studentized residuals of HK on Gc to reduce the overlap of explained variance. The HK residual provides an index of the level of health knowledge at the average level of Gc. Because the variance in HK accounted for by vocabulary was partialed out, the effects of domain knowledge that we report likely represent conservative estimates.
First, we found that the Gc X word frequency and the Gc X number of syllables interactions were significant, showing that crystallized ability facilitated word-level processing. Participants with more crystallized ability spent relatively less time than those with less crystallized ability, reading the lower frequency and longer words. More importantly, the Gc X clause CI and Gc X sentence CI interactions were significant. Older adults with more crystallized ability allocated more time to wrap-up for conceptual integration processes both at the end of clauses and sentences.
To evaluate whether the effect of crystallized ability on word-level and CI processes generalized across the two domains, we added text domain and its interaction term with crystallized ability and text features to the model (Model 3, 3rd column of Table 1a). None of the three-way interactions was significant, suggesting that crystallized ability facilitated word-level processing and increased resource allocation to conceptual integration to the same extent in the general and health sentences (Figure 1). Therefore, the results supported Hypothesis 1 that crystallized ability promotes conceptual integration across domains.
Figure 1.
Domain-general effects of crystallized ability (Gc) in promoting conceptual integration at the end of the clause and the sentence.
Hypothesis 2. Health knowledge increases conceptual integration in health-related texts, but not general texts
We next analyzed the effects of health knowledge on resource allocation. With the effect of crystallized ability controlled, we entered the text features and their interaction terms with health knowledge (HK) to the model (Model 4, Table 1b). The HK X word frequency interaction was significant. Readers with more health knowledge spent less time processing lower frequency words. However, collapsing across text domains, HK X clause CI and HK X sentence CI interactions were not significant.
To evaluate whether health knowledge affects resource allocation differently across the two text domains, we added text domain and its interaction terms with HK and text features to the model (Model 5, 1b). As predicted, the HK X text domain X clause CI and HK X text domain X sentence CI interactions were both significant, suggesting that health knowledge influenced conceptual integration differently across the two text domains. To decompose the three-way interactions, we tested the HK X CI interactions separately for each domain (with covariates of age, PC and Gc). Results showed that there were significant HK X clause CI (t=3.05, p<.05) and HK X sentence CI (t=−2.75, p<.05) interactions in the health texts, but not in the general texts (t=−0.43 and t=1.40, respectively). Therefore, health knowledge only affected conceptual integration in the health-related texts, but did not generalize to the other texts.
The significant effects of HK on conceptual integration at clause and sentence boundaries within health-related texts are plotted in Figure 2. Readers with higher levels of health knowledge allocated more resources to clause CI in the health texts. In absolute terms, the magnitude of effect is small. For example, in health texts, for individuals at the 10th percentile of health knowledge, there was an increase of 21 ms per new concepts at clause boundaries, whereas for individuals in the 90th percentile of health knowledge, there was an increase of 33 ms per new concepts at clause boundaries. Nevertheless, these were reliable effects, and this variation in time allocation had an impact on recall performance. This finding supported Hypothesis 2 that health knowledge would promote CI selectively in domain-relevant text. However, health knowledge had the reverse effect at sentence boundaries, producing facilitated conceptual integration. Collectively, our findings on the effects of health knowledge on CI were only partially consistent with our expectations, a topic to which we will return in the Discussion.
Figure 2.
Health knowledge (HK) promoted clause conceptual integration and facilitated sentence conceptual integration in the health texts.
Recall Performance
The mean propositional recall for health texts was 43.97% (SE=0.03) and mean recall for domain general texts was 50.53% (SE=0.02). Thus, recall was somewhat higher for the domain general texts (t(106)=3.19, p<.002). Our goal in the next analysis was to determine the extent to which resource allocation to CI contributed to recall performance. The clause and sentence CI parameters were the Best Linear Unbiased Predictors (BLUPs) derived from the mixed-effects model (model 6). In spite of the fact that Gc and HK showed distinctive effects on CI, we collapsed across domains because of the high correlation between recall (r=.92), clause CI (r=.72) and sentence CI (r=.72) across domains.
Hypothesis 3. Conceptual integration promotes better recall performance
Pearson correlations among recall, reading process (clause and sentence CI parameters) and individual difference variables are reported in Table 2. We used multivariate regression to examine the effects of age, PC, Gc, HK, and CI at clause and sentence boundaries on recall. We included Gc x clause CI and Gc X sentence CI interactions as predictors to examine whether Gc moderated the effects of conceptual integration on text recall. Variables were centered before creating the interaction terms. Without the interaction terms in the equation, both Gc (B=.65) and clause CI (B=.16) were each significant predictors of recall performance (adjusted R2=0.47, F(6,101)=16.72. When the interaction terms were entered, the effects of Gc and clause remained significant (B=0.63 and 0.23, respectively; adjusted R2=0.50, F(8,99)=14.07). In addition, the, Gc X clause CI interaction was significant (B= −0.21). Age, PC, HK, sentence CI and Gc X Sentence CI did not explain additional variance on recall performance (B=−0.11, −0.02, −0.03, −0.11. and −0.08, respectively).
Table 2.
Correlations among age, processing capacity, crystallized ability, health knowledge, conceptual integration (CI) at the end of clause and sentence, recall performance across two texts.
Mean (S.D.) | Age | Processing capacity | Gc | HK | CCI | SCI | |
---|---|---|---|---|---|---|---|
Age | 70.27 (6.59) | ||||||
Processing capacity | 0.05 (2.43) | −0.04 | |||||
Pattern Comparison | 13.33 (4.04) | ||||||
Identical Picture | 18.88 (5.25) | ||||||
Letter Number Sequencing | 8.30 (2.95) | ||||||
Crystallized ability (Gc) | 0.03 (0.98) | 0.18 | 0.58* | ||||
Health knowledge (HK) | 28.45 (2.39) | 0.15 | 0.46* | 0.57* | |||
Clause CI (CCI) | 0.02 (0.03) | −0.02 | 0.32* | 0.34* | 0.24* | ||
Sentence CI (SCI) | 0.09 (0.07) | −0.07 | 0.08 | 0.08 | 0.04 | −0.20* | |
Recall | 0.49 (0.21) | 0.02 | 0.42* | 0.68* | 0.38* | 0.40* | −0.05 |
p<.05
Note: Processing capacity was a composite score of standardized scores from three processing capacity measures (pattern comparison, identical picture & letter number sequencing). Crystallized ability was a standardized score of verbal ability. Clause CI and Sentence CI were BLUPs (best linear unbiased estimates) estimated from the multilevel models of reading time on the text characteristics.
The simple slope technique (Preacher, Curran, & Bauer, 2006) was used to visualize the Gc X Clause CI interaction (see Figure 3). Clause CI was positively associated with recall for participants with low crystallized ability (i.e., 1 SD below the mean) (t(103)=3.89, B=0.09, p<.001) and those with medium crystallized ability (i.e., mean)(t(103)=3.23, B=0.06. p<.01), but not for those with high crystallized ability (i.e., 1 SD above the mean) (t(103)=0.91, B=0.02, p=0.37). This pattern suggests that readers with lower crystallized ability benefitted from frequent clause CI on recall performance to a greater extent than readers with higher crystallized ability. Although older readers with lower crystallized ability allocated fewer attentional resources to clause CI, they differentially benefitted when they adopted this strategy. Hence, clause CI tended to compensate for the lower crystallized ability. Our findings supported Hypothesis 3 that conceptual integration would promote better recall, but the beneficial effects were restricted to the case when it was conducted more frequently within sentences. Further, these data suggested that the effects of clause CI on recall performance depended on the reader's level of crystallized ability.
Figure 3.
Crystallized ability (Gc) moderates the effect of clause conceptual integration on text recall.
Discussion
Our study used the moving window paradigm to investigate the effects of domain-general (crystallized ability) and domain-specific (health) knowledge, and processing capacity on comprehending general and health texts among older adults with hypertension. Consistent with our hypotheses, after controlling the effects of processing capacity and health knowledge, crystallized ability had domain-general effects in promoting conceptual integration, regardless of text domain. In addition, after controlling the effects of processing capacity and crystallized ability, health knowledge showed selective, domain-specific, effects in promoting conceptual integration. The results are consistent with previous research showing that high-verbal older adults allocate more cognitive resources to conceptual integration (Stine-Morrow et al., 2008); and that older adults with domain knowledge allocate more resources to conceptual integration in domain-related texts (Miller et al., 2004). The current research extends this literature by (a) distinguishing the effects of domain knowledge from those of general verbal (crystallized) ability on comprehension and (b) localizing the effect of knowledge to domain-relevant texts. These data are important in showing that these two sorts of knowledge, while typically correlated, have independent effects in promoting attentional engagement in reading (Stine-Morrow, 2007), which support the creation of more elaborated and enduring mental representations of the ideas contained in the text.
It is important to note that while crystallized ability increased conceptual integration more broadly, at both clause and sentence boundaries, domain knowledge selectively boosted conceptual integration at clause boundaries -- but then facilitated these processes at sentence boundaries. We do not have a ready explanation for these divergent effects of crystallized and domain knowledge. It should be noted that Miller et al. (2004), who experimentally examined the effects of domain knowledge with training, also found enhanced conceptual integration selectively at clause boundaries, as in our data. However, findings have been somewhat mixed; for example, Miller (2001, 2003) has shown effects of cooking knowledge in increasing wrap-up at sentence boundaries for more extended texts. One possibility is that the self-regulation of how knowledge-based integration is conducted depends on the overall length of the text, with clausal integration more likely in relatively short texts that are unsupported by discourse structure, and therefore, more taxing on working memory resources (Stine & Wingfield, 1990; Stine-Morrow et al., 2008).
In the current study, the more frequent consolidation among high-knowledge readers reduced the downstream processing load in the sentence. Such tradeoffs between early and late wrap-up in managing the load of assembling the semantic representation for sentence processing have been demonstrated experimentally (by inducing early wrap-up with small structural changes in the sentence that preserve semantic complexity) and dubbed the “pay-now-or-pay-later” (PNPL) effect (Stine-Morrow et al., 2010). Why domain-specific knowledge would engender this sort of frequent chunking in sentence processing, while verbal ability would engender higher levels of conceptual integration across the board is an interesting question. This may have to do with the distinctive sorts of integration processes that are engendered by different sorts of knowledge. Verbal ability reflects knowledge built on literacy experience (Stanovich et al., 1995), so that increased wrap-up reflects the procedural skill of reading, which requires the regular consolidation of meaning within and between sentences. Domain-related knowledge, on the other hand, reflects declarative knowledge about the topic, so that wrap-up would be expected to reflect an inferencing process in which domain-related ideas are activated and effort is allocated to integrate these ideas with the text content (Graesser et al., 1987). It may be that the inferencing function engendered by domain-related knowledge is relatively sensitive to the PNPL effect, such that early consolidation of ideas reduces the cognitive load of ideas that much be integrated. On the other hand, the procedural skill of opportunistic conceptual integration at syntactic boundaries that is engendered by literacy experience may be a more automatized engagement of resources (a “habit of mind”; Stine-Morrow et al., 2006) that is triggered regardless of cognitive load. This procedural-declarative account of wrap-up would imply that clause wrap-up should be more sensitive to idea consolidation than sentence wrap-up. In fact, we found that it was clause CI that predicted recall and not sentence CI. This explanation is, of course, speculative but does provide an account of the divergent effects of knowledge on reading strategies, as well as the way in which reading strategies predicted recall. Further research is needed to explore semantic consolidation processes in text as both a core reading skill and as an outcome of particularized domain knowledge.
Although research suggests that older adults can be proficient with sentence CI (e.g., Stine-Morrow et al., 2001, 2008), there is also evidence that sentence CI is more of a drain on attentional resources for older readers (Payne & Stine-Morrow, 2012) and that older readers often shift wrap-up to earlier points in sentence processing (e.g., Miller & Stine-Morrow, 1998; Stine-Morrow et al., 2010). Hence, clause CI may be a more robust reading strategy for older adults that compensates for their processing capacity limits. Future study should examine the effects of domain-general and domain-specific knowledge on conceptual integration across a wider age range, as well as a wider range of texts, to better understand the complex relationships among knowledge, processing capacity limits and reading strategy across the life span.
Our findings have implications for developing more effective patient education materials. First, the health knowledge x word feature interactions suggest that older adults with lower health knowledge will benefit from simpler (more common) words, which is consistent with the suggestion that adults with inadequate health literacy will better understand health texts with lower readability scores (simpler language e.g., Wolf et al., 2007). Second, we found that health knowledge promotes clause CI, which is also associated with better recall of health texts. Given this knowledge-driven advantage, older adults' comprehension of health information may be improved by training to engage reading strategies with more frequent integration, or redesigning health texts to encourage more frequent consolidation, for example by signaling important syntactic constituents with punctuation, line breaks, or font variation (e.g., Stine-Morrow et al., 2010). In this way, patients with less health knowledge may be encouraged to use the same strategy of earlier conceptual integration as more knowledgeable adults. This strategy in turn may help patients develop more elaborate knowledge about their illness, which could eventually leverage to more easily learn the information they need for effective self-care.
ACKNOWLEDGEMENT
We thank Maryrose Buttice and research coordinators in OSF Saint Francis Medical Center for their assistance with data collection. This research has been supported by the National Institute of Aging (Grants R01 AG031718 and R01 AG013935). Any opinions, findings, and conclusions or recommendations expressed in this publication are those of the authors and do not necessarily reflect the views of the NIH.
Appendix
This appendix contains the generalized linear mixed effects models used in the current paper.
Model 0: Empty model (Unconditional Means Model)
This model contains the intercept γ000, random effect of each participant U0j0, the random effect of each word item V00k and the residual component eijk in explaining the log transformed reading time Yijk.
Model 1: Resource Allocation Model
where logWF is the natural log of word frequency; Syll is the number of syllables; CCI is the cumulative number of new concepts introduced at the end of a clause; SCI is the cumulative number of new concepts introduced at the end of a sentence.
Model 2: Effects of Crystallized Ability (Gc) on Resource Allocation Model with the Covariates of Age, Processing capacity (PC) and Health Knowledge(HK)
Model 3: Text Domain Moderates the Effects of Crystallized Ability (Gc) on Resource Allocation Model with the Covariates of Age, Processing Capacity (PC) and Health Knowledge (HK)
where domain is a categorical variable with effects coding.
Model 4: Effects of Health Knowledge (HK) on Resource Allocation Model with the Covariates of Age, Processing Capacity (PC) and Crystallized Ability (Gc)
Model 5: Text Domain Moderates the Effects of Crystallized Ability on Resource Allocation Model with the Covariates of Age, Processing Capacity and Health Knowledge
Model 6: Getting Best Linear Unbiased Predictors of Recourse Allocation Parameters
Footnotes
Portions of the data were presented at the Cognitive Aging Conference, Atlanta, Georgia, August 2012 and the 55th Annual Meeting of Human Factors and Ergonomics Society, Las Vegas, Nevada, Oct 2011.
REFERENCES
- Ackerman PL. Knowledge and cognitive aging. In: Craik FIM, Salthouse TA, editors. Handbook of aging and cognition. Third ed. Psychology Press; New York: 2008. [Google Scholar]
- American Heart Association Statistics Committee and Stroke Statistics Subcommittee Heart disease and stroke statistics—2013 update: a report from the American Heart Association. Circulation. 2013;127:6–245. doi: 10.1161/CIR.0b013e31828124ad. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bates DM. Fitting linear mixed models in R. R News. 2005;5:27–30. [Google Scholar]
- Bates DM, Sarkar D. lme4: Linear mixed-effects models using S4 classes. R package version 0.99875-6 2007. [Google Scholar]
- Baayen RH, Davidson DJ, Bates DM. Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language. 2008;59:390–412. [Google Scholar]
- Baker DW, Williams MV, Parker RM, Gazmararian JA, Nurss J. Development of a brief test to measure functional health literacy. Patient Education and Counseling. 1999;38:33–42. doi: 10.1016/s0738-3991(98)00116-5. [DOI] [PubMed] [Google Scholar]
- Baker DW, Gazmararian JA, Sudano J, Patterson M. The association between age and health literacy among elderly persons. Journal of Gerontology: Social Sciences. 2000;55B:S368–S374. doi: 10.1093/geronb/55.6.s368. [DOI] [PubMed] [Google Scholar]
- Balota DA, Yap MJ, Cortese MJ, Hutchison KA, Kessler B, Loftis B, Neely JH, Nelson DL, Simpson GB, Treiman R. The English Lexicon Project. Behavior Research Methods. 2007;39:445–459. doi: 10.3758/bf03193014. [DOI] [PubMed] [Google Scholar]
- Baltes PB. On the incomplete architecture of human ontogeny: Selection, optimization, and compensation as foundation of developmental theory. American Psychologist. 1997;52:366–380. doi: 10.1037//0003-066x.52.4.366. [DOI] [PubMed] [Google Scholar]
- Beier ME, Ackerman PL. Age, ability and the role of prior knowledge on the acquisition of new domain knowledge. Psychology & Aging. 2005;20:341–355. doi: 10.1037/0882-7974.20.2.341. [DOI] [PubMed] [Google Scholar]
- Chin J, D'Andrea L, Morrow D, Stine-Morrow EAL, Conner-Garcia T, Graumlich JF, Murray MD. Cognition and illness experience are associated with illness knowledge among older adults with hypertension. Proceedings of the 53rd HFES Annual Meeting; San Antonio, TX: Human Factors and Ergonomics Society; 2009. [Google Scholar]
- Chin J, Morrow DG, Stine-Morrow EAL, Conner-Garcia T, Graumlich JF, Murray MD. The process-knowledge model of health literacy: evidence from a componential analysis of two commonly used measures. Journal of Health Communication. 2011;16:222–241. doi: 10.1080/10810730.2011.604702. [DOI] [PMC free article] [PubMed] [Google Scholar]
- DeWalt DA, Berkman ND, Sheridan S, Lohr KN, Pignone MP. Literacy and health outcomes: A systematic review of the literature. Journal of General Internal Medicine. 2004;19:1228–1239. doi: 10.1111/j.1525-1497.2004.40153.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ekstrom RB, French JW, Harmon HH, Dermen . Manual for the Kit of Factor-Referenced Cognitive Tests. Educational Testing Service; Princeton, NJ: 1976. [Google Scholar]
- Ericsson KA, Charness N. Expert performance: Its structure and acquisition. American Psychologist. 1994;49:725–747. [Google Scholar]
- Ferreira F, Bailey KGD, Ferraro V. Good-enough representations in language comprehension. Current Directions in Psychological Science. 2002;11:11–15. [Google Scholar]
- Gazmararian JA, Williams MV, Peel J, Baker DW. Health literacy and knowledge of chronic disease. Patient Education and Counseling. 2003;51:267–275. doi: 10.1016/s0738-3991(02)00239-2. [DOI] [PubMed] [Google Scholar]
- Graesser AC, Haberlandt K, Koizumi D. How is reading time influenced by knowledge-based inferences and world knowledge? In: Britton BK, Glynn SM, editors. Executive control processes in reading. Erlbaum; Hillsdale, NJ: 1987. pp. 217–251. [Google Scholar]
- Haberlandt K, Graesser AC. Processing new argument at clause boundaries. Memory and Cognition. 1989;17:186–193. doi: 10.3758/bf03197068. [DOI] [PubMed] [Google Scholar]
- Just MA, Carpenter PA, Wooley JD. Paradigms and processes in reading comprehension. Journal of Experimental Psychology: General. 1982;111:228–238. doi: 10.1037//0096-3445.111.2.228. [DOI] [PubMed] [Google Scholar]
- Kintsch W. Comprehension: A paradigm for cognition. Cambridge University Press; New York, NY: 1998. [Google Scholar]
- Lorch RF, Myers JL. Regression analyses of repeated measures data in cognitive research. Journal of Experimental Psychology: Learning, Memory, and Cognition. 1990;16:149–157. doi: 10.1037//0278-7393.16.1.149. [DOI] [PubMed] [Google Scholar]
- Meyer BJF, Talbot AP, Ranalli C. Why older adults make more immediate treatment decisions about cancer than younger adults. Psychology and Aging. 2007;22:505–524. doi: 10.1037/0882-7974.22.3.505. [DOI] [PubMed] [Google Scholar]
- Miller LMS. The effects of real-world knowledge on text processing among older adults. Aging, Neuropsychology, and Cognition. 2001;8:137–148. [Google Scholar]
- Miller LMS. The effects of age and domain knowledge on text processing. Journal of Gerontology: Psychological Sciences. 2003;58B:P217–P223. doi: 10.1093/geronb/58.4.p217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller LMS, Gibson TN, Applegate EA. Predictors of nutrition information comprehension in adulthood. Patient Education and Counseling. 2010;80(1):107–112. doi: 10.1016/j.pec.2009.09.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller LMS, Stine-Morrow EAL. Aging and the effects of knowledge on on-line reading strategies. Journal of Gerontology: Psychological Sciences. 1998;53B:223–233. doi: 10.1093/geronb/53b.4.p223. [DOI] [PubMed] [Google Scholar]
- Miller LMS, Stine-Morrow EAL, Kirkorian HL, Conroy ML. Adult age differences in knowledge-driven reading. Journal of Educational Psychology. 2004;96:811–821. [Google Scholar]
- Morrow DG, Menard WE, Stine-Morrow EAL, Teller T, Bryant D. The influence of task factors and expertise on age differences in pilot communication. Psychology and Aging. 2001;6:31–46. doi: 10.1037/0882-7974.16.1.31. [DOI] [PubMed] [Google Scholar]
- Payne BR, Gao X, Noh SR, Anderson CJ, Stine-Morrow EAL. The effects of print exposure on sentence processing and memory in order adults: Evidence for efficiency and reserve. Aging, Neuropsychology, and Cognition. 2012;19:122–149. doi: 10.1080/13825585.2011.628376. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Salthouse TA. Mediation of adult age differences in cognition by reductions in working memory and speed of processing. Psychological Science. 1991;2:179–183. [Google Scholar]
- Stine-Morrow EAL. The Dumbledore Hypothesis of cognitive aging. Current Directions in Psychological Science. 2007;16:289–293. [Google Scholar]
- Stine EAL, Wingfield A. How much do working memory deficits contribute to age differences in discourse memory? European Journal of Cognitive Psychology. 1990;2:289–304. [Google Scholar]
- Stine-Morrow EAL, Miller LMS, Hertzog C. Aging and self-regulated language processing. Psychological Bulletin. 2006;132:582–606. doi: 10.1037/0033-2909.132.4.582. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stine-Morrow EAL, Miller LMS, Gagne DD, Hertzog C. Self-regulated reading in adulthood. Psychology and Aging. 2008;23:131–153. doi: 10.1037/0882-7974.23.1.131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stine-Morrow EAL, Milinder L, Pullara O, Herman B. Patterns of resource allocation in reading are reliable among younger and older readers. Psychology and Aging. 2001;16:69–84. doi: 10.1037/0882-7974.16.1.69. [DOI] [PubMed] [Google Scholar]
- Stine-Morrow EAL, Shake MC, Miles JR, Lee K, Gao X, McConkie G. Pay now or pay later: Aging and the role of boundary salience in self-regulation of conceptual integration in sentence processing. Psychology and Aging. 2010;25:168–176. doi: 10.1037/a0018127. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stanovich KE, West RL, Harrison MR. Knowledge growth and maintenance across the life span: The role of print exposure. Developmental Psychology. 1995;31:811–826. [Google Scholar]
- Wechsler D. Wechsler adult intelligence test manual. 3rd ed. Psychological Corporation; San Antonio, TX: 1997. [Google Scholar]
- Wolf MS, Davis TC, Shrank W, Rapp DN, Bass PF, Connor UM, Parker RM. To err is human: Patient misinterpretations of prescription drug label instructions. Patient Education & Counseling. 2007;67:293–300. doi: 10.1016/j.pec.2007.03.024. [DOI] [PubMed] [Google Scholar]
- U.S. Department of Health and Human Services . Understanding and Improving Health and Objectives for Improving Health. 2nd ed. U.S. Government Printing Office; Washington, DC: 2010. Healthy People 2010. [Google Scholar]