Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2018 May 1.
Published in final edited form as: Neuropsychologia. 2017 Mar 27;99:314–325. doi: 10.1016/j.neuropsychologia.2017.03.027

Narratives of Focal Brain Injured Individuals: A Macro-Level Analysis

Ayşenur Karaduman 1,2, Tilbe Göksun 1,*, Anjan Chatterjee 3
PMCID: PMC5479932  NIHMSID: NIHMS863831  PMID: 28347806

Abstract

Focal brain injury can have detrimental effects on the pragmatics of communication. This study examined narrative production by unilateral brain damaged people (n= 36) and healthy controls and focused on the complexity (content and coherence) and the evaluative aspect of their narratives to test the general hypothesis that the left hemisphere is biased to process microlinguistic information and the right hemisphere is biased to process macrolinguistic information. We found that people with left hemisphere damage’s (LHD) narratives were less likely to maintain the overall theme of the story and produced fewer evaluative comments in their narratives. These deficits correlated with their performances on microlinguistic linguistic tasks. People with the right hemisphere damage (RHD) seemed to be preserved in expressing narrative complexity and evaluations as a group. Yet, single case analyses revealed that particular regions in the right hemisphere such as damage to the dorsolateral prefrontal cortex (DLPFC), the anterior and superior temporal gyrus, the middle temporal gyrus, and the supramarginal gyrus lead to problems in creating narratives. Our findings demonstrate that both hemispheres are necessary to produce competent narrative production. LHD people’s poor production is related to their microlinguistic language problems whereas RHD people’s impaired abilities can be associated with planning and working memory abilities required to relate events in a narrative.

Keywords: narrative, focal brain injury, narrative complexity, narrative evaluation

1. Introduction

A narrative develops around characters and events, and has a superstructure that includes establishing the setting of events, relating actions, and resolving themes (Ulatowska, Allard & Chapman, 1990). Speakers express temporal progression, establish and maintain references, and emphasize specific events over others in their narrations. Studying narrative discourse provides rich information that enables us to examine speakers’ communicative competence and their ability to use language in context (for a recent review, see Linnik, Bastiaanse, & Höhle, 2016). This investigation examined the relationship among cognition, the organization of human knowledge, and language production.

Broadly, two levels of analyses are used to study narrative production: (1) a within utterance or a microlinguistic level that mainly focuses on lexical and grammatical processing that contribute to intrasentential structure, and (2) a between-utterance or a macrolinguistic level that focuses on pragmatic and discourse-level processing, responsible for intersentential organization (Andreetta, Cantagallo, & Marini, 2012; Glosser & Deser, 1990; Jakobson, 1980; Kintsch, 1994). This study examines narrative production of both people with left hemisphere damage (LHD) and people with right hemisphere damage (RHD) to test the hypothesis that the left hemisphere is biased to process microlinguistic elements and the right hemisphere is biased to process macrolingustic information.

Even though macrolinguistic level narrative production has been studied previously (Andreetta et al., 2012; Berko-Gleason et al., 1980; Bloom, Borod, Obler & Gerstman, 1992; Coelho et al., 2012; Davis, O’Neil-Pirozzi, & Coon, 1997; Joanette, Goulet, Ska, & Nespoulous, 1986; Marini et al., 2005; Ulatowska et al., 1981, 1983), the current study moves beyond the classical analyses. We address three questions: (1) How do people with LHD and RHD differ in their narrative complexity (indicated by content and coherence) and the richness of expression (e.g., cognitive inferences about the motivation behind protagonists’ actions or references to affective states)? (2) What, if any, is the relationship between microlinguistic and macrolinguistic competence? (3) What brain lesions relate to impairments in narrative complexity and the evaluation?

In the following sections, we first briefly review the current state of the field on microlinguistic language production of unilateral brain damaged people. Then, we focus on macrolinguistic language production and present the current study.

1.1. Microlinguistic level language production

Microlinguistic functions of language production usually depend on the integrity of specialized neural systems within the left hemisphere (Glosser & Deser, 1990). Unsurprisingly, people with LHD can impair verbal communication at almost all intrasentential linguistic levels (phonetic, semantic, and syntactic) (Herrmann, Koch, Johannsen-Horbach, & Wallesch, 1989). For example, people with LHD utter fewer motion sentences, talk with lower mean length of utterance, produce fewer types of verbs and prepositions than controls (Göksun, Lehet, Malykhina, & Chatterjee, 2015). They produce less complex language, demonstrate word-finding difficulties (Dressler & Pleh, 1988, Larfeuil & Le Dorze, 1997), and the words they produce are often indefinite such as “get” as compared to people with RHD (Ulatowska, North & Macaluso-Haynes, 1981). However, previous reports on the LHD-aphasic people’s ability to use linguistic devices that help make the narrative cohesive (e.g., personal pronouns, demonstrative pronouns, conjunctions) are conflicting; some find deficits (Ulatowska et al., 1981), whereas others do not (Bloom, Borod, Santschi-Haywood, Pick & Obler, 1996, Glosser & Deser, 1990).

While the role of the left hemisphere in processing the microlinguistic level is well established, the right hemisphere’s contribution remains uncertain. Several studies report that people with RHD perform adequately with respect to lexical selection and syntactic complexity (Glosser, 1993; Glosser, Deser, & Weisstein, 1992; Rivers & Love, 1980). Others report reduced syntactic complexity (Joanette, Goulet, Ska, & Nespoulous, 1986; Sheratt & Bryan, 2012) and elaborated, imprecise, and repetitive speech (Sheratt & Bryan, 2012). Mixed results have also been reported for the correct use of cohesive markers (e.g., Davis, O’Neil-Pirozzi & Coon, 1997; Marini et al. 2005; Uryase, Duffy & Liles, 1991). The intrasentential level of content relevance during discourse production can be reduced in people with RHD, indicating low level of informativeness for their stories (Bartels-Tobin & Hickley, 2005; Marini et al., 2005). This reduction may indicate problems in global levels of discourse, which is reviewed as macro-linguistic level problems in the next section.

Overall, people with LHD clearly have microlinguistic deficits, whereas reports for people with RHD are inconsistent.

1.2. Macrolinguistic level language production

Macrolinguistic language production emphasizes pragmatic and discourse level analyses, focusing on different aspects such as content and coherence (narrative complexity) and evaluations. The content of a narrative determines if individuals successfully communicate the critical aspects of a story using coherent thematic units (for review see Mar, 2004). A narrative with a thematically coherent plotline includes three components: Plot onset referring to an initiating event, plot unfolding referring to progressing events in the story, and plot resolution referring to arrival at an outcome (Berman & Slobin, 1994).

A narrative is made richer by including evaluative comments, which can suspend describing the sequence of events (Bamberg & Damrad-Frye, 1991; Labov & Waletzky, 1967). In a well-constructed narrative, the narrator comments on the meaning or the significance of the events using particular evaluative devices. These devices might reflect the narrator’s perspective on the characters and their activities such as inferring the motivations or affective states/behaviors of the character. The narrator can also give his/her subjective opinions on the events or use expressions or exclamations to maintain audience interest (see Appendix B for the details of the evaluative devices) (Bamberg & Damrad-Fyre, 1991, Küntay & Nakamura, 2004, Labov & Waletzky, 1967; Reilly et al., 2004). Story actions and resolution are enriched with these evaluative devices (Freedman-Stern, Ulatowska, Baker, & DeLacoste, 1984).

Neuroimaging studies suggest that bilateral medial and lateral frontal and anterior temporal regions and the precuneus are involved in establishing narrative coherence (Fletcher et al., 1995; Ferstl et al. 2008; Xu, Kemeny, Park, Frattali, & Braun, 2005). Troiani and colleagues (2008) suggest that narrative production depends in part on a network involving frontal and temporal brain regions. In particular, narrative production activates the inferior frontal cortex bilaterally, and the left dorsal infero-frontal and left lateral temporal-parietal regions (see also Braun, Guillemin, Hosey, & Varga, 2001; Mar, 2004).

Neuropsychological evidence about narrative production mainly comes from studies with people with aphasia after left brain injury (Andreetta et al., 2012; Christiansen, 1995; Berko-Gleason et al., 1980; Bloom, Borod, Obler & Gerstman, 1992; Huber & Gleber, 1982; Mar, 2004; Marini, Carlomagno, Caltagirone, & Nocentini, 2005; Marini, Andreetta, del Tin, & Carlomagno, 2011; Nicholas & Brookshire, 1993; Ulatowska et al., 1981; Ulatowska et al., 1983) and people with right brain injury (e.g., Bartels-Tobin & Hickley, 2005; Davis, O’Neil-Pirozzi, & Coon, 1997; Joanette, Goulet, Ska, & Nespoulous, 1986; Mar, 2004; Marini, 2012; Marini, Galetto, Zampieri, Vorano, Zettin, & Carlomagno, 2011, Sherratt & Bryan, 2012). As mentioned earlier, people with LHD have more problems at a microlinguistic level compared to people with RHD, in whom the performances for macro-linguistic processes are mixed. Some report simplified content as indicated by the production of fewer episodes (Berko-Gleason et al., 1980; Bloom, Borod, Obler & Gerstman, 1992; Ulatowska et al., 1981; Ulatowska et al., 1983). Individuals with left dorsolateral prefrontal cortex (DLPFC) lesions can omit critical story components and fail to establish global coherence by relating the meaning or content of an utterance to the general topic of the story (Andreetta et al., 2012; Coelho et al., 2012; Christiansen, 1995).

In contrast, others report that LHD-aphasic patients devote normal proportions of their narratives to relevant structural elements, and maintain their order. Story grammar is also relatively preserved (Ulatowska et al., 1981). Counting coherence errors of LHD-nonaphasic people such as absence of a referent, semantic shifts or tangential utterances, Marini and colleagues (2005) revealed preserved coherent organization for LHD-nonaphasic people. They also preserve informativeness as indicated by their use of adequate number of thematic units.

Very few studies assess patients’ use of evaluative utterances in narrative. LHD-aphasic patients produce fewer clauses containing evaluative expressions compared to healthy controls (Ulatowska et al., 1981; Ulatowska et al., 1983). This reduction may not affect the overall plot structure, since evaluation has a secondary role among other narrative structure elements such as setting or resolution, but evaluation contributes to the narrative’s richness in real world communication.

Narrative production deficits in people with RHD include problems in presenting the order of themes, staying on a topic or using nonverbal cues (Bartels-Tobin & Hickley, 2005; Davis, O’Neil-Pirozzi, & Coon, 1997; Joanette, Goulet, Ska, & Nespoulous, 1986; Marini, Carlomagno, Caltagirone, & Nocentini, 2005; Sherratt & Bryan, 2012, for a review see Mar, 2004). Using sequential visual stimuli or videos, studies show that RHD people’s narratives lack critical story elements that are essential to its telling, which results in less informative discourse than those of healthy controls (Bartels-Tobin & Hickley, 2005; Bloom et al., 1992; Davis, O’Neil-Pirozzi, & Coon, 1997; Joanette, Goulet, Ska, & Nespoulous, 1986; Marini et al., 2005; Rivers & Love, 1980; Uryase, Duffy, & Liles, 1991). In addition, people with RHD have problems producing complete stories (i.e. stories with an obvious beginning and end, integrating information from each sequential picture) compared to controls (Rivers & Love, 1980). Similarly, the completeness of episodes and story grammar elements such as setting and initiating event can be missing (Uryase et al., 1991).

On the coherence of narratives, Davis and colleagues (1997) found that people with RHD produce less logical connections between actions in a narrative than controls, indicating deficiency in establishing logical coherence. Based on the analyses of semantic shifts, absence of referent or tangential utterances, Marini and colleagues (2005) found that people with RHD have problems with communicating the relevance and quantity of information. They often insert additional and excessive details, insufficient content or do not include appropriate information in their narratives (Sheratt & Bryan, 2012).

Several explanations are proposed for RHD people’s problems in narratives. Some focus on factors such as stimulus processing and task demands as people with RHD tend to display visuospatial and/or visuoperceptive deficits (Hecaen & Albert, 1978) (Rivers & Love, 1980). Marini and colleagues (2005) concluded that people with RHD have problems in organizing informational content and in retrieving a general story schema from pictorial but not from linguistic information (but see Delis, Wapner, Gardner, & Moses, 1983). Another possibility that may contribute to the RHD people’s discourse deficits is the inability to capture emotional nuances and interpret the emotional importance of pictured scenes (e.g., Cicone, Wapner, & Gardner, 1980; DeKosky, Heilman, Bowers, & Valenstein, 1980; Moscovitch, 1983). Consistent with this interpretation, Bloom and colleagues (1992) reported specific reduction in the production of emotional content relative to neutral/procedural and visual-spatial content, suggesting a distinctive role for the right hemisphere in verbally expressing emotions.

1.3. The present study

Despite accumulating evidence on macrolinguistic level language production abilities for both people with LHD and RHD, results are not conclusive for either group (e.g., Delis, Wapner, Gardner, & Moses, 1983; Marini et al., 2005). In addition, research on aphasia has mainly focused on the production of relatively concrete and factual information while the way the narrator conveys her particular stance or viewpoint on this information and how she engages the audience is understudied (Armstrong & Ulatowska, 2007). Only a few studies examine the evaluative aspect of narration in LHD-aphasic people (e.g., Ulatowska 1981; 1983) or people with RHD (but see Bloom et al., 1992; Cimino, Verfaellie, & Bowers, 1991). Finally, these studies consider left and right brain injured people as whole groups, and do not consider specific areas of vulnerability within hemisphere.

In this study, we will investigate how narrative complexity and richness can be affected by unilateral brain injury. Beyond laterality, we asked whether specific lesion locations are associated with impairments in narrative complexity and the evaluation of narratives and whether microlinguistic and macrolinguistic deficits are related.

We predicted that people with RHD would be less likely to include basic story components into narratives than control participants. LHD people’s narratives may be impaired. However, compared to RHD people’s narratives, they would not have reduced informative components as a primary deficit.

LHD people’s use of evaluative devices would be impaired based on previous reports. We also predicted that the use of affective states and behaviors as a specific subgroup of evaluative devices might differentiate the RHD group from controls because of impairments in extracting emotional information from visual stimuli (e.g., Bloom et al., 1992).

Finally, to investigate individual cases who could have impairments in expressing narrative complexity and evaluation, we applied “Bayesian analysis for a simple difference” (Crawford & Garthwaite, 2007). This case analytic method applies Bayesian Monte Carlo methods to determine whether a subjects’ performance is an observation from the control population, as stated by the null hypothesis. If the test indicates that the patient’s score is significantly below the average scores of control participants, the null hypothesis can be rejected (Ianni, Cardillo, McQuire, & Chatterjee, 2014). For the unilateral brain damaged participants who perform abnormally on a given dependent variable, we report lesion overlays to characterize specific lesions associated with poor performance.

2. Material and Methods

2.1. Participants

Participants were enrolled from the Focal Lesion Subject Database at the University of Pennsylvania (Fellows, Stark, Berg, & Chatterjee, 2008). Eighteen people with LHD and 18 people with RHD were included in the study. They were not chosen based on specific lesion locations or behavioral criteria. Figure 1 displays lesion overlap maps of participants. The patients did not have a history of other neurological disorders, psychiatric disorders, or substance abuse. People with LHD ranged in age from 37 to 79 (M = 64.28, SD = 11.75, 10 females) and people with RHD ranged in age from 45 to 87 (M = 63.33, SD = 12.4, 12 females). The people with LHD and RHD had an average of 13.56 (SD = 2.01) and 15 (SD = 3.33) years of education, respectively. People with LHD and RHD did not differ in lesion size, p > .05. Thirteen age-matched (range: 38–77, M = 60.85, SD = 11.05, 9 females) older adults served as a healthy control group. They had an average of 16 (SD = 2.04) years of education. Education level was significantly different among groups, F(2, 46) = 3.49, p = .04, η2 = .13. People with LHD (M = 13.56, SD = 2.01) had fewer years of education than the controls (M = 16, SD = 2.12). All RHD and control participants were right-handed and one LHD participant was left-handed. All participants were native English-speakers. We limited our participants to individuals with a minimum of 10 years of education. All participants provided written informed consent in accordance with the policies of the University of Pennsylvania’s Institutional Review Board. Participants received $15/h for volunteering their time.

Figure 1.

Figure 1

Coverage map indicating the lesion locations for all participants with brain damage. The colored scale represents the number of lesions for each pixel.

2.2. Materials and Procedure

2.2.1. Neuropsychological tasks

People with LHD and RHD were administered the language comprehension and language production subtests of the Western Aphasia Battery (WAB; Kertesz, 1982). They were also administered the Object and Action Naming Battery (OANB; Druks, 2000). In this task, participants named 50 pictures of actions and 81 pictures of objects. The neuropsychological tests were administered on a different session either before or after the narrative task.

2.2.2. Narrative task

The participants were presented with the 24-page wordless children’s picture book, Frog, Where Are You? (Mayer, 1969) and asked to tell a story to the experimenter. The story is about a boy and his dog, searching for their frog. While they are searching for the frog, the boy and the dog have a series of adventures such as encountering a groundhog, a hive of bees, an owl, and a deer. At the end of the story, they find the lost frog with a female frog and several baby frogs. The boy and the dog take one of the babies as their new pet frog while waving goodbye to the frog family. The book contains no words and has been used to elicit narratives in more than 70 languages and in diverse populations including patients (e.g., Ash et al., 2006; Berman & Slobin, 1994; Reilly et al., 1998, 2004). In addition to the series of temporally sequenced complex events with sketched drawings, the book requires narrators to make inferences about the characters’ relationships, thoughts, feelings, and motivations throughout the story, providing appropriate stimuli for the investigation of evaluative language (Küntay & Nakamura, 2004; Reilly et al., 2004)

Before beginning to tell the story, participants looked through and familiarized themselves with the book. When ready, they started from the beginning and described the story page by page. Sessions were videotaped for further transcriptions of speech. The neuropsychological tasks were administered on a different testing session either before or after the experimental task.

2.3. Coding

Narratives were transcribed word by word by native English speakers. First, event chunks were coded for general features of language production: the number of utterances, the number of words, mean length of utterance (MLU), and the number of nouns and verbs. An utterance was defined as a T-unit that consisted of an independent clause and all clauses or phrases on it (Hunt, 1965). When two independent clauses conjoined by the connective “and”, they were counted as two utterances. MLU was defined as total number of words per utterance (Marini, Tavano & Fabbro, 2008). Number of words included all complete words (repetitions were included). All nouns and verbs (inflected verbs, infinitives, and participles) were also counted (see Ash et al., 2006 for details of speech coding).

Second, the transcriptions were coded for the narrative complexity based on the criteria discussed in Berman and Slobin (1994) and Köksal (2011). Definition and examples of coding for narrative complexity is provided in Appendix A. The narratives were coded for the three main plot components including plot onset, plot unfolding and plot resolution:

  1. The plot onset component was scored based on the presence of the following sub-components: The precedent event (e.g., the boy wakes up), temporal location (in the morning/evening), characters (the boy, the dog, the frog), main characters’ finding out that something has happened to the frog (e.g., the boy noticed that the frog had gone missing), inference about the frog’s disappearance (e.g., the frog escaped the fishbowl) and the response of the protagonist (e.g., the boy was shocked). Thus, one can obtain a score from 0 to 8.

  2. The plot unfolding component included the following sub-components: looking for the lost frog in the home, interaction with bees, with gopher, with owl, with deer and falling down into the lake. The narration of these subcomponents determined the score that ranged from 0 to 6.

  3. The plot resolution component was scored based on the reference to finding the lost frog by the protagonists and the presence of this component received 1 point.

In addition to these three plot components, the narratives were also coded for the search theme to examine the degree to which the subjects understood the motivation for the boy’s actions and the overall theme of the story. We coded 1) whether the subject explicitly mentioned that the frog was missing and that the boy was searching for it (the scores ranged from 0 to 2: 1 point for mentioning each of these two aspects), and 2) whether the search theme was reiterated later in the story: The subjects received 0 points for no additional mention, 1 point for one or two additional mentions and 2 points for multiple additional mentions. This analysis of reiteration of the search theme indicated the extent to which the subjects understood the boy’s continuing behavior (Reilly et al., 1998).

Third, to examine the extent to which subjects evaluated the content of their narratives, we coded the use of specific evaluative devices (cognitive inferences, social engagement devices, references to affective states or behaviors, enrichment expressions, hedges and evaluative remarks) by adapting and combining the schemes used by Reilly and colleagues (2004), Küntay and Nakamura (2004), and Bamberg and Damrad-Fyre (1991). Appendix B presents explanations of these categories and examples from our data. A total evaluation score was obtained by summing across all of the scores from subcategories for each subject.

In addition, an evaluative diversity score was obtained, indicating the range of evaluation subcategories produced in the narrative by assigning 1 to used subcategories and 0 to the unused categories. Thus, the possible score for evaluative diversity ranged from 0 to 5.

2.4. Reliability

Two independent transcribers checked all the transcriptions. To establish reliability, a second person coded randomly selected narratives of 9 out of 36 participants with unilateral brain damage (25%) and 5 healthy controls out of 13 (38.5%) for both narrative complexity and evaluation measures. For narrative complexity, agreement between coders was 98% and for the evaluative devices it was 95%. Agreement for the subcategories of evaluative devices was as follows: Cognitive inferences: 100%, social engagement: 90%, references to affective states and behaviors: 99%, enrichment expressions: 98%, hedges 99%, evaluative remarks 94%.

3. Results

3.1. Neuropsychological Analyses

Most people with LHD and RHD in this study were not severely impaired (only 6 participants were categorized as having anomic aphasia and 1 participant was categorized as having Wernike’s aphasia based on WAB classification. These participants were all in the LHD group). The WAB scores were lower for the people with LHD compared to the people with RHD, F(1, 29) = 6.802, p = .014, η2=.19 (MLHD= 91.75 and MRHD= 97.94). The groups did not differ significantly in terms of naming objects and actions, F(1, 27) = 2.007, p = .168, η2 = .07 and F(1, 28) = 1.428, p = .242, η2 = .05, respectively (see Table 1, for CIs see Table 6).

Table 1.

Demographic and neuropsychological data of people with LHD and RHD

Patient Gender Age Education Lesion Location Lesion Size Cause Chronicity WAB OANB OANB



(years) Side (# of voxels) (A Q) (Action) (Object)
LT_85 F 63 15 L I 13079 Stroke 177 98.8 100 98.8
CD_141 F 52 16 L T 21605 Stroke 143 98.8 100 96
KG_215 M 61 14 L F 17422 Stroke 145 94.4 96 93.8
TO_221 F 77 13 L O 5886 Stroke 160 100 100 100
BC_236 M 65 18 L FP 155982 Stroke 210 80.8 88 94
XK_342 F 57 12 L OT 42144 Stroke 125 91.4 94 93
TD_360 M 58 12 L T BG 38063 Stroke 118 65.3 52 28
IG_363 M 74 16 L F 16845 Stroke 117 91.4 96 95
KD_493 M 68 14 L T 22404 Aneurysm 101 92.1 98 95
DR_529 F 66 12 L PA F 8969 Stroke 100 94.9 94 90.1
DR_565 F 53 12 L PA F 14517 Aneurysm 103 99.8 98 97.5
MC_577 F 79 11 L C 4191 Stroke 50 85.3 82 79
NS_604 F 37 12 L PO 79231 AVM 113 100 100 98
UD_618 M 77 15 L F 48743 Stroke 47 89.4 76 85
KM_642 M 77 12 L P 7996 Stroke 109 96.8 94 98
MR_644 F 74 12 L C - Stroke - - - -
CC_749 F 71 12 L P 34266 Stroke 50 88.8 - -
FC_83 M 70 12 R FTP 8040 Stroke 169 99.8 96 98
MB_101 F 58 18 R T BG 10543 Stroke 426 98.4 98 98
NC_112 F 48 16 R O 4733 Stroke 178 100 98 -
HX_252 M 77 12 R MCA - Stroke - 94.6 78 85
RT_309 F 66 21 R T 79691 Hematoma 128 - - -
DF_316 F 87 12 R P 2981 Stroke 126 97.1 88 93
DC_392 M 56 10 R PT 39068 Stroke 108 97.6 98 95
DX_444 F 80 12 R PT 41172 Stroke 106 95.5 94 93
TS_474 F 51 11 R P 22208 Stroke 100 95.1 98 95
UD_550 F 47 16 R C - Stroke - - - -
NS_569 F 72 18 R FT BG 37366 Stroke 77 100 100 99
DG_592 F 45 12 R PT 130552 Stroke 127 97.8 98 98
KG_593 F 49 12 R FTP BG 170128 Stroke 58 100 90 95
KS_605 M 63 18 R C 23217 Stroke 76 98.8 100 100
ND_640 F 70 18 R PT 64603 Stroke 54 96.8 100 100
CS_657 M 75 18 R PO 33568 Stroke 43 99.2 98 100
KN_675 M 64 18 R FT 23779 Stroke 32 - - -
MN_738 F 62 16 R C 32154 Stroke 25 98.4 100 100
DD_755 F 48 16 L C - Stroke - - - -

Key: F: Frontal; T: Temporal; P: Parietal; O: Occipital; BG: Basal Ganglia; C: Cerebellum; I: Insula; Pe: Perisylvian; PA: Pericallosal artery; ACA: Anterior Cerebral Artery; MCA: Middle Cerebral Artery; AVM: arteriovenous malformations. WAB-AQ indicates a composite language score with a maximum possible score of 100. OANB (action) and OANB (object) demonstrate knowledge of verbs and nouns with a maximum possible score of 100.

Table 6.

Confidence intervals for all F statistics presented, 95% confidence intervals were derived from 1000 bootstrap samples.

Control-left Control-right Left-right

Lower-bound Upper-bound Lower-bound Upper-bound Lower-bound Upper-bound
WAB −11.226 −2.033
OANB_action −11.926 1.903
OANB_object −17.251 −.053
Total utterance −4.011 12.327 −8.149 9.754 −11.136 4.499
Words −5.712 166.699 −78.132 107.624 −143.912 21.392
Nouns −2.423 27.208 −23.813 13.017 −35.995 2.227
Verbs 1.414 31.320 −7.962 21.200 −22.321 2.388
MLU .842 2.786 .027 2.160 −1.445 −.020
Narrative complexity 1.583 6.175 .250 4.227 −4.389 1.263
Plot onset .233 2.105 .048 1.930 −1.434 .965
Plot unfolding .296 1.590 −.212 .953 −1.400 .136
Plot resolution .118 .579 .053 .438 −.407 .186
Search theme .626 2.250 .062 1.472 −1.768 .265
Establishing search theme .084 1.008 −.036 .678 −.786 .310
Maintaining search theme .373 1.307 .012 .818 −.973 .119
Evaluation 6.385 25.557 −6.153 15.491 −21.398 −1.051
Evaluative diversity −.071 1.605 −.125 1.030 −1.035 .428
Cognitive inferences −1.605 7.436 −3.665 4.181 −6.819 1.234
Social engagement −.277 5.346 −1.644 4.286 −2.759 .573
Affective states and behaviors −.104 4.221 −.919 3.461 −2.619 .948
Enrichment expressions .611 4.414 −4.130 2.006 −6.271 −.701
Hedges 1.462 10.651 −1.041 9.116 −5.644 .999
Evaluative remarks −.161 1.035 −1.354 .699 −1.733 .136

3.2. Narrative Length Measures

No main effect of group was found for the total number of utterances they produced (F(2, 46) = .557, p = .577, η2 = .02) or the number of words, (F(2, 46) = 1.814, p = .174, η2 = .07), verbs, (F(2, 46) = 2.697, p = .078, η2 = .11), and nouns they used, (F(2, 46) = 1.790, p = .178, η2 = .07) (for CIs see Table 6). However, the results revealed a significant difference in the mean length of utterance (MLU) score among groups, F(2, 46) = 7.175, p = .002, η2 = .24. Bonferroni t-tests showed that the LHD people’s MLU scores (M = 8.66, SD = .88) were significantly lower than the controls’ (M = 10.42, SD = 1.55) (p = .001). For people with LHD and RHD, the production of nouns in narratives positively correlated with Object and Action Naming Battery’s object scores (r = .438, p = .017) (see Table 2).

Table 2.

Correlations between measures

2 3 4 5 6 7 8 9 10 11 12 13
1. WAB r .839** .874** −.125 .065 .131 .322 .152 .191 .582** .523** .386* .159
N 30 29 30 31 31 31 31 31 31 31 31 31
95% C. I. Lower .466 .524 −.598 −.462 −.437 −.391 −.333 −.134 .084 .083 .077 −.187
Upper .966 .982 .311 .247 .342 .640 .345 .395 .870 .783 .574 .524
2. OANB_action r .920** −.101 .053 .095 .360 .008 .096 .772** .684** .260 .042
N 29 29 30 30 30 30 30 30 30 30 30
95% C. I. Lower .690 −.449 −.525 −.469 −.209 −.468 −.087 .340 .348 −.177 −.295
Upper .985 .156 .207 .323 .657 .200 .395 .887 .837 .517 .324
3. OANB_object r .027 .060 .142 .438* −.008 .169 .643** .548** .277 .017
N 28 29 29 29 29 29 29 29 29 29
95% C. I. Lower −.195 −.512 −.358 −.141 −.439 .035 .224 .319 −.068 −.372
Upper .236 .261 .360 .679 .161 .438 .861 .801 .501 .268
4. Lesion Size r −.026 .031 .113 −.193 .146 −.182 −.197 −.293 −.310
N 32 32 32 32 32 32 32 32 32
95% C. I. Lower −.321 −.228 −.177 −.468 −.282 −.558 −.565 −.487 −.698
Upper .328 .393 .451 .102 .564 .192 .267 .079 .044
5. Total Utterance r .912** .695** .875** .352* .153 −.002 .640** .233
N 49 49 49 49 49 49 49 49
95% C. I. Lower .698 .160 .533 −.324 −.248 −.467 .130 −.097
Upper .936 .729 .930 .499 .353 .042 .688 .624
6. Words r .825** .914** .601** .230 .101 .721** .262
N 49 49 49 49 49 49 49
95% C. I. Lower .521 .535 .311 −.055 −.313 .290 −.111
Upper .849 .965 .801 .549 .341 .810 .575
7. Nouns r .651** .547** .340* .183 .437** .011
N 49 49 49 49 49 49
95% C. I. Lower .166 .110 .160 .186 .191 .185
Upper .062 .373 .089 −.210 −.103 −.394
8. Verbs r .551** .172 .046 .786** .353*
N 49 49 49 49 49
95% C. I. Lower −.013 −.316 −.488 .476 .028
Upper .683 .407 .129 .845 .714
9. MLU r .283* .252 .459** .253
N 49 49 49 49
95% C. I. Lower .133 .049 .092 −.351
Upper .645 .604 .664 .424
10. Narrative Complexity r .927** .435** .211
N 49 49 49
95% C. I. Lower .797 .253 −.217
Upper .955 .681 .577
11. Search Theme r .369** .221
N 49 49
95% C. I. Lower .074 −.288
Upper .596 .602
12. Evaluation r .530**
N 49
95% C. I. Lower .283
Upper .754
13. Evaluative Diversity r 1
N 49
95% C. I. Lower 1
Upper 1
*

Correlation is significant at the 0.05 level (2-tailed).

**

Correlation is significant at the 0.01 level (2-tailed) and 95% confidence intervals were derived from 1000 bootstrap samples.

3.3. The Narrative Complexity

A univariate ANOVA indicated a main effect of group for narrative complexity, F(2, 46) = 3.555, p = .037, η2 = .13. As shown in Figure 2, the LHD people’s narratives included significantly fewer story components (M = 12.56, SD = 4.66) than the controls’ (M = 16.31, SD = 1.25), (Bonferroni, p = .032). After controlling for education, narrative complexity did not differ significantly among groups, F(2, 45) = 2.063, p = .139, η2 = .08. When the scores obtained from each plot component (plot onset, plot unfolding, and resolution) were analyzed separately, the results showed no differences among groups (plot onset: F(2, 46) = 1.977, p = .15, η2 = .08, plot unfolding: F(2, 46) = 3.146, p = .052, η2 = .12, and resolution: F(2, 46) = 2.743, p = .075, η2 = .11, respectively) (for CIs see Table 6). However, a significant difference among groups was found in establishing and maintaining the story’s search theme, F(2, 46) = 4.082, p = .023, η2 = .15. The people with LHD established and maintained the story’s search theme (M = 2.39, SD = .31) significantly less often than the controls (M = 3.77, SD = .37) (Bonferroni, p = .02). Yet, when we looked at each score alone (establishing the initial mention of the search theme and maintaining the theme), no difference was revealed for the initial mention of the search theme among groups, F(2, 46) = 2.110, p = .133, η2 = .08. But a main effect of group was found for maintaining the search theme, F(2, 46) = 4.836, p = .012, η2 = .17. In particular, the people with LHD reiterated the search theme less often (M = 1, SD = .18) than the controls (M = 1.85, SD = .21), (Bonferroni, p = .01).

Figure 2.

Figure 2

Mean number of story components included in the narratives of people with LHD and RHD, and controls. *p < .05.

The narrative complexity was also tested at the level of individual patient using Bayesian single-case statistics. Results revealed that 7 people with LHD (out of 18) and 4 people with RHD (out of 18) were impaired in including story components in their narratives compared to the controls, p < .01 (see Table 3). We then constructed a lesion overlap for these participants who were significantly impaired. As shown in Figure 3, these participants’ lesions maximally overlapped in the right frontal lobe including the dorsolateral prefrontal cortex (DLPFC), both the anterior and superior temporal gyrus, the middle temporal gyrus, and the supramarginal gyrus; in the left hemisphere the middle, inferior and superior frontal gyrus, and left insula.

Table 3.

Single case statistics profile of people with LHD and RHD for narrative complexity

Control Sample Patients

Significance Test Estimated % of control population obtaining lower score than case

n Mean SD Lesion Side ID Scores t p Point (%) 95% CI lower limit (%)
13 16.31 1.25 Left TD_360 3 −10.261 0.000 0.00 0.00
MC_577 5 −8.719 0.000 0.00 0.00
UD_618 6 −7.948 0.000 0.00 0.00
CC_749 6 −7.948 0.000 0.00 0.00
IG_363 9 −5.635 0.000 0.01 0.00
KM_642 12 −3.323 0.006 0.30 0.00
KD_493 12 −3.323 0.006 0.30 0.00
Right HX_252 2 −11.032 0.000 0.00 0.00
KG_593 7 −7.177 0.000 0.00 0.00
RT_309 10 −4.864 0.000 0.02 0.00
DX_444 11 −4.093 0.001 0.07 0.00

Figure 3.

Figure 3

Representative slices from single case analyses for the narrative complexity. The maps show the overlapped lesions among 7 people with LHD and 4 people with RHD (minimally 2 participants have lesions on a specific area).

The narrative complexity score correlated positively with all the neuropsychological test scores; WAB (r = .582, p = .001), Object and Action Naming Battery’s action (r = .772, p < .001) and object scores (r = .643, p < .001). Significant positive correlations were also found between the narrative complexity scores and the production of nouns (r = .34, p = .017), and MLU scores (r = .283, p = .049) (see Table 2).

In sum, the results indicated poorer performance for the people with LHD as a group in narrative complexity compared to the controls. When education level was controlled, this difference was not significant. However, people with LHD were deficient in maintaining the stories’ overall theme. Single case analyses revealed more granular findings. Lesions in the frontotemporal regions of the right hemisphere and frontal regions in the left hemisphere were linked to decreased complexity in narration.

3.4. The Evaluation of the Story

A univariate ANOVA indicated no difference among groups for evaluative diversity, F(2, 46) = 1.684, p = .197, η2 = .07 (for CIs see Table 6). Since the groups’ stories did not differ significantly in length as measured by the total number of utterance, the evaluation scores were analyzed as total raw scores rather than dividing the total number of evaluative devices by the total number of utterances for each subject. Yet, a significant main effect of group on the production of evaluative devices was revealed, F(2, 46) = 4.412, p = .018, η2 = .16 (see Figure 3). The people with LHD produced fewer evaluative devices (M = 21.78, SD = 13.84) than controls (M = 37.85, SD = 13. 78), (Bonferroni, p = .021).

Figure 3.

Figure 3

Mean number of evaluative devices used in the narratives of the people with LHD and RHD, and controls. *p < .05.

Further analyses on subcategories of evaluative devices revealed no significant difference among groups for cognitive inferences, F(2, 46) = 1.521, p = .229, η2 = .06, social engagement devices, F(2, 46) = 1.808, p = .176, η2 = .07, references to affective states and behaviors, F(2, 46) = 1.524, p = .229, η2 = .06, and evaluative remarks, F(2, 46) = 1.121, p = .335, η2 = .05 (for CIs see Table 6). However, the use of enrichment devices differed among groups, F(2, 46) = 3.499, p = .039, η2 = .13. The people with LHD produced fewer enrichment devices (M = 4, SD = 2.50) than the people with RHD (M = 7.39, SD = 5.50), (Bonferroni, p = .039). The use of hedges also differed among groups, p = .033, η2 = .14. The people with LHD produced fewer hedges (M = 4.94, SD = 3.92) than the controls (M = 10.92, SD = 7.98), (Bonferroni, p = .028) (see Table 4).

Table 4.

Production of evaluative devices (1, Control, n = 13; 2, LHD, n = 18; 3, RHD, n = 18).

Group Mean SD Range
Cognitive inferences 1 11.62 5.58 3–24
2 8.33 6.43 0–27
3 11.28 5.83 1–20
Social engagement 1 3.54 4.61 0–13
2 1.33 1.78 0–7
3 2.39 3.07 0–9
Affective states and behaviors 1 4.7 3.17 2–14
2 2.89 2.54 0–10
3 3.67 2.87 0–12
Enrichment expressions 1 6.38 2.72 3–13
2 4 2.5 0–10
3 7.39 5.5 1–18
Hedges 1 10.92 7.98 3–27
2 4.94 3.92 0–12
3 7.11 6.25 0–23
Evaluative remarks 1 .69 1.03 0–3
2 .28 .46 0–1
3 .94 1.98 0–8

The use of evaluative devices correlated positively with WAB scores (r = .386, p = .032), the production of total utterance (r = .64, p < .001), word (r = .721, p < .001), noun (r = .437, p = .002), verb (r = .786, p < .001), and the MLU scores (r = .459, p = .001). A significant correlation was also found between the use of evaluative devices and the narrative complexity (r = .435, p = .002). The evaluative diversity scores were positively correlated with verb production (r = .353, p = .013) (see Table 2).

4. Discussion

The purpose of the study was to investigate the neural underpinnings of macrolinguistic level language production by focusing on complexity and the use of evaluative devices in narration. First, we found that LHD people’s narratives were less complex as indicated by fewer story components included in their narratives compared to control participants, but this effect was influenced by LHD people’s education level. However, lesions to the left middle, inferior and superior frontal gyrus, and left insula were linked to poorer performance in narrative complexity. As establishing and maintaining the story’s search theme is a good index of story coherence (Ash et al., 2006; Reilly et al., 1998), we also compared the groups’ initial and subsequent mention of the search theme. Even though people with LHD could establish the story’s search theme, they did not sustain this theme throughout the story. As a group people with RHD performed similarly to controls, however, analyses of individual cases indicated that people with frontotemporal lesions produced poorer narratives compared to controls. Second, the evaluative aspect of LHD people’s narratives was also found to be impaired compared to controls. When we examined specific evaluative devices, LHD people’s narratives included less hedges (i.e., devices that indicate a level of certainty/uncertainty) compared to controls and less enrichment expressions compared to people with RHD. Our results revealed preserved performance for people with RHD in the evaluative aspect of narratives.

4.1. Narrative Complexity

Complexity in narrative is an indicator of a speaker’s use of proper and rich language and is important for communicative competence. Although telling a story from sequenced pictures may seem simple, it involves many steps such as recognizing the setting, characters, actions, and the outcome while maintaining the overall theme of the story and realizing when a resolution is reached (Ash et al., 2006). People with LHD mention fewer components of a story and have problems maintaining a storyline (even though they do not have a problem in initiating the story theme), and understanding the motivation for the protagonists’ continuing actions, and the overall theme of the story. These results indicate that as a group, people with LHD had difficulty producing coherent and complex narratives that contain basic informational components of the story while keeping in mind the story’s overall theme. It is important to emphasize that even though our results did not indicate poorer performance for people with RHD than controls in these aspects of narratives, the results did not differentiate RHD people’s performance from those of people with LHD either.

Results regarding the reduction in narrative complexity in people with LHD are consistent with previous findings suggesting macrolinguistic level impairments in narrative production for these people (e.g., Bloom et al., 1992; Coelho et al., 2002; Ulatowska et al., 1981, 1983). In particular, lesions to the middle, inferior and superior frontal gyrus, and left insula were linked to poorer performance in narrative complexity as indicated by the analysis of individual cases. The ability to produce and meaningfully organize connected language can be partly predicted by overall linguistic functioning assessed by the standardized tests. Indeed, we found that LHD and RHD people’s narrative complexity scores were related to their aphasia, object, and action naming scores (see also Bloom et al., 1992; Ulatowska et al., 1983). Thus, the quality of the narrative impaired in people with LHD may be an outcome of microlinguistic deficits.

Our results about people with RHD are surprising. The current literature would not predict preserved performance for people with RHD in content and coherence (e.g., Bloom et al., 1996). One difference in our study compared to others could be differences in stimuli used to elicit narrative production. For instance, Uryase, Duffy and Liles (1991) examined narratives of people with aphasia and people with RHD and healthy controls elicited by a video rather than pictures. Both people with aphasia and people with RHD produced less informative narratives compared to controls. The differences in the visual complexity of videos may play a role in RHD people’s narrative performance since the right hemisphere is associated with visual information processing (Meadows, 1974). In addition, even though we did not find any group differences between people with RHD and controls, we found individual cases who were impaired at producing a complex narrative (i.e. people with RHD scoring significantly below the scores of controls). Lesions to the right frontal lobe including the dorsolateral prefrontal cortex, both the anterior and superior temporal gyrus, the middle temporal gyrus, and the supramarginal gyrus were linked to poor performance in narrative complexity.

Consistent with our findings, several fMRI studies investigating processing of narrative coherence showed greater activation in bilateral medial and lateral frontal and anterior temporal and left medial prefrontal regions (Ferstl et al., 2002; Fletcher et al., 1995; Gallagher et al., 2000; Mazoyer et al., 1993; Xu, Kemeny, Park, Frattali, & Braun, 2005, Troiani et al., 2008). Coelho and colleagues (2012) also reported that individuals with left DLPFC lesions have deficits in inclusion of critical story components and in global coherence. Recent tDCS studies also demonstrate that stimulation over the left inferior frontal gyrus improves the cohesion (Marangolo et al., 2014) and informativeness of speech samples (Marangolo et al., 2013). Additionally, Transcranial Magnetic Stimulation (rTMS) stimulation over the dorsal portion of the left anterior inferior frontal gyrus, but not right, diminishes global coherence and lexical informativeness of narratives (Marini & Urgesi, 2012). In a review of fMRI studies on the anatomy of language, Price (2010) identifies several regions in the left hemisphere involved in word retrieval processes that were damaged in our people with LHD, who performed worse than controls in narrative complexity: the inferior and middle frontal area, and both dorsal and ventral pars opercularis. In our data, the narrative complexity scores were related to both object and action naming scores and total number of nouns used. Thus, we might suggest that people with LHD with lesions to these regions in the frontal area have problems producing complex narratives because of their word finding difficulties.

A relationship between lexical access difficulty and production of reduced narrative content was also observed in another study of patients with frontotemporal dementia (Ash et al., 2006). In this study, semantic dementia patients’ narratives had reduced content with a high rate of incomplete and missing elements compared to controls. These findings together with our results suggest that the production of an informative narrative through inclusion of important content elements of the story can depend on the ability to access necessary lexical items to express these contents.

The lesions of people with RHD that we found to be related to reduced narrative complexity are also similar to cortical atrophy profile of frontotemporal dementia patients with social and executive deficits. These patients have damage in their prefrontal, ventral frontal, and anterior temporal brain regions, often more prominently on the right than the left (Grossman et al., 2004; Rosen et al., 2002; Williams, Nestor, & Hodges, 2005). Limited connectedness in those patients’ narratives reflects problems in organizing and relating the events in narratives and maintaining the overall theme (Ash et al., 2006). These impaired abilities can be linked to executive resources such as organization, planning and working memory, which are required to relate the events in the narrative, to infer cause and effect relationship, and to understand the main point or goal of a story (Mar, 2004). Gernsbacher and Kaschak (2003) also identified the right temporal and frontal regions as important areas for the integrative aspects of narrative processing, emphasizing the hypothesis that the activation observed in these areas specific to discourse processing might be a function of memory processes that maintain the coherence of the narrative across sentences. Yet, there is no consensus on the specific cognitive processes involved in global coherence (Kurczek & Duff, 2011; Mar, 2004; Marini et al., 2011; Rogalski & Edmunds, 2008).

In sum, we found that as a group people with LHD had problems in keeping the overall theme in mind. As a group, people with RHD could tell a coherent story and maintaining the overall theme. Nevertheless, we found that lesions to the frontotemporal regions including almost the entire frontal cortex, both the anterior and superior temporal gyrus and the middle temporal gyrus, and supramarginal gyrus were linked to poor performance in narrative complexity. For the left hemisphere, lesions to the frontal cortex including the middle, inferior and superior frontal gyrus, and left insula were related to narrative complexity.

4.2. The Evaluative Aspect of Narratives

The use of evaluative references is an important element of a good narrative that makes events and actions in the story more meaningful and maintains listeners’ attention and involvement (Bamberg & Damrad-Frye, 1991; Labov & Waletzky, 1967; Reilly et al., 2004). Even though people with LHD included diverse types of evaluative devices in their stories, they used fewer evaluative devices compared to controls. While an intact left hemisphere seems to be necessary to produce rich stories in terms of evaluation, our data do not suggest the same for the right hemisphere. We found preserved performance for people with RHD in both diversity and frequency of evaluation.

These findings are consistent with the previous research suggesting impaired performance in using evaluations for people with LHD (Ulatowska et al., 1981; 1983). Patients with aphasia produced fewer evaluations compared to controls both in terms of the number of clauses containing evaluation and the number of evaluative expressions per clause. The propositional analyses also revealed that patients with aphasia often omit propositions that contain inner feelings and motivations of the protagonists in the stories rather than their actions.

The reduction in evaluation might be a reflection of simplification of language since evaluative expressions involve complex syntactic devices. Evaluation also has a secondary role in narrative structure and communicates relatively less important information within a narrative compared to other essential elements of the story such as setting and resolution (Ulatowska et al., 1981). Therefore, the reason for using less evaluative expressions might be related to either their function or form (more complex syntax), or combination of both. In our study, the use of evaluation also correlated with LHD and RHD people’s aphasia scores, suggesting that producing a rich narrative may depend on overall linguistic skills. Indeed, we identified two people with LHD who scored significantly lower for the use of evaluation relative to controls. These participants were quite effortful in their speech, keeping them away from enriching their narratives with the use of evaluative devices.

We expected a specific impairment for people with RHD in mentioning affective states and behaviors of the protagonists in the story based on the role of right hemisphere in detecting emotional nuances and understanding the emotional importance of pictured scenes (e.g., Bloom et al., 1992; Cicone, Wapner, & Gardner, 1980; DeKosky, Heilman, Bowers, & Valenstein, 1980; Moscovitch, 1983), and in lexical emotional expression (Borod et al., 2002). These inconsistencies may result from the differences in measures of emotional expression (Cimino, Verfaellie, & Bowers, 1991; Heberlein, Adolphs, Pennebaker, & Traner, 2003). For instance, Cimino and colleagues (1991) investigated the emotional verbal expression using recalled autobiographical memories, in which participants were asked to produce narratives as a response to a cue word such as “angry” or “surprised”. The RHD people’s reports were rated less on emotionality compared to controls. People with RHD also used fewer appraisals (e.g., affect, judgment) compared to controls in expressing emotions in their personal narratives. This could be due to impairment in talking about authorial (first person) affect as opposed to non-authorial (second or third person) one such as providing information about feelings of others in a retelling or a sequenced picture task (Sherratt, 2007). In our study, participants were required to report on the actions and the feelings/motivations of the protagonists in a pictured story, and we indicated comparable evaluative performance for people with RHD and controls when they provide non-authorial affect.

Future research could focus on a specific point in the narrative structure (e.g., setting), where the evaluative devices are used rather than examining only frequency or diversity of evaluation. Evaluative devices mark and put emphasis on a particular part of a discourse (Cortazzi & Jin, 2000) by usually being used before the peak of the narrative (Labov, 1997). Besides using relatively fewer evaluative devices in their narratives, people with LHD may also use evaluation at unusual points. Likewise, even though people with RHD have comparable frequency of evaluation use to control participants, they might be impaired at using evaluative devices in the proper points in the narrative. Thus, an investigation of the detail points of evaluative devices can be helpful in understanding the nature of macrolevel language problems of focal brain-injured people. The narrative coherence and evaluative devices could also be examined in a larger control group.

Taken together, our results showed that people with LHD, particularly having frontal lesions, were deficient in both macrolinguistic measures, narrative complexity and evaluations, assessed in this paper. These macrolevel deficits correlated with their microlinguistic deficits. We showed that lesions to certain areas of frontotemporal regions of the right hemisphere and frontal regions and insula of the left hemisphere contribute to narrating a complex story. This study adds to the limited amount of literature on the use of evaluation in unilateral brain damaged people and to the literature showing conflicting findings on narrative measures such as informativeness and coherence. We also expand our knowledge on the cortical regions that are essential for the production of complex narratives. These findings suggest that LHD people’s poor production can be related to their overall language problems whereas RHD people’s impaired abilities can be associated with other cognitive impairments such as planning and working memory.

Table 5.

Single case statistics profile of people with LHD and RHD for evaluative devices.

Control Sample Patients

Significance Test Estimated % of control population obtaining lower score than case

n Mean SD Lesion Side ID Scores t p Point (%) 95% CI lower limit (%)
13 37.85 13.78 Left TD_360 6 −2.227 0.046 2.29 0.04
IG_363 0 −2.647 0.021 1.07 0.00

Highlights.

  • We tested narrative production by people with left (LHD) and right hemisphere (RHD) lesions

  • People with LHD could not maintain the overall theme of the narratives

  • Macrolevel narrative deficits correlated with their microlinguistic deficits

  • Lesions to frontotemporal regions of the right hemisphere led problems in creating narratives

  • Both hemispheres are necessary to produce competent narrative production

Acknowledgments

This research was supported in part by NIH RO1DC012511 and grants to the Spatial Intelligence and Learning Center, funded by the National Science Foundation (subcontracts under SBE-0541957 and SBE-1041707). We would like to thank everyone in the Chatterjee Lab for their helpful comments in this research with special thanks to Marianna Stark and Eileen Cardillo for their help in recruiting people with brain injury. We also thank Aylin Küntay, Hande Ilgaz, and Ece Demir for their valuable feedback on the previous versions of the manuscript, Language and Cognition Lab members at Koç University for discussions about the project, and Hilal Demircan for helping with reliability coding.

APPENDIX A. Definition and examples of coding for narrative complexity (adapted from Berman & Slobin, 1994 and Köksal, 2011)

Plot components Plot Sub-Components Examples and Explanations
Plot onset Precedent event -The boy and the dog wakes up
Temporal location -In the morning/evening
The boy/child/kid, the dog, the frog
Characters Scoring ranges between 0–3:
Only one character = 1
Two of the characters = 2
Three characters = 3
-The boy and the dog noticed that the frog had gone missing
The main characters learn something -The boy and the dog wake up and see that the frog is gone
-The frog escaped from the jar
Inference about the frog’s disappearance -The frog is gone
-The jar is empty
-They are fascinated by the frog’s disappearance
The response of protagonist -The boy was shocked
-The boy is looking in his boots
Plot unfolding Searching for the lost frog in the home -The dog is looking in the jar
-The dog is looking into the beehive
Encountering the bees -The bees are chasing the dog
-The boy is looking down a hole and a gopher comes out
Encountering the gopher -The boy gets bitten by a gopher
-The boy falls down because an owl comes out of the tree
Encountering the owl -The boy disturbed an owl in the tree
-The child climbs on the deer
Encountering the deer -The deer tosses the boy over the cliff
Falling down -The boy and the dog falls in the water/pond/lake
Resolution Protagonist finds the lost frog -The kid finds his frog
-Whether the subject explicitly mentions that the frog is missing and the boy is searching for him (range: 0–2). 1 point for mentioning each aspect of initiating the search theme:
Search theme Explicit mention of the lost frog -The frog is missing/gone.
-The boy is looking for the frog.
* Only mentioning that the frog leaves its jar will not get point
-Whether the search theme was reiterated later. (range: 0–2).
Reiteration of search theme No additional mention = 0
1 or 2 additional mentions = 1
Multiple additional mentions = 2.

APPENDIX B. Definition and examples of evaluation coding

  1. Cognitive inferences: inferences of character motivation, causality, and mental states, as in “Little boy climbs up a tree to see if the frog jumped in there” or “He’s wondering what happened to the frog.” Common examples included ‘think’, ‘look for’, ‘because’, ‘investigate’ etc.

  2. Social engagement devices: using phrases or exclamations to capture addressee attention, e.g. sound effects, character speech accompanied by animated speech or intonation, and audience hookers, as in “Voila! He finds the frog!” or “The boy is over by the log saying “shh” to the dog”. Statements of indirect speech were not included in the category.

  3. References to affective states or behaviors, as in “Everyone seems to be happy” or “The boy was crying”.

  4. Enrichment expressions: adverbial phrases such as ‘again’ or ‘quickly’ that reveal the unexpected or inferred nature of an action; intensifiers such as ‘very’ or ‘so’; and repetitions which draw the audience’s attention to a certain event as in “He’s running running running”; connectives such as ‘but’, ‘however’ or ‘instead’ that informs about the unexpected or contrastive occurrences of events.

  5. Hedges: distancing devices that indicate a level of certainty/uncertainty, suggesting the narrator’s non-commitment to the truth value of the proposition. Common examples included ‘seems like’, ‘looks like’, ‘kind of’, ‘probably’, ‘I guess/think’, etc.

  6. Evaluative remarks: the narrators’ reflections about the events of the narrative which communicate a subjective point of view as in “This was something stupid to do” or “The dog isn’t hurt, that’s a good thing”

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

References

  1. Andreetta S, Cantagallo A, Marini A. Narrative discourse in anomic aphasia. Neuropsychologia. 2012;50:1787–1793. doi: 10.1016/j.neuropsychologia.2012.04.003. [DOI] [PubMed] [Google Scholar]
  2. Armstrong E, Ulatowska H. Making stories: Evaluative language and the aphasia experience. Aphasiology. 2007;21(6–8):763–774. [Google Scholar]
  3. Ash S, Moore P, Antani S, McCawley G, Work M, Grossman M. Trying to tell a tale: Discourse impairments in progressive aphasia and frontotemporal dementia. Neurology. 2006;66(9):1405–1413. doi: 10.1212/01.wnl.0000210435.72614.38. [DOI] [PubMed] [Google Scholar]
  4. Bamberg M, Damrad-Frye R. On the ability to provide evaluative comments: Further explorations of children’s narrative competencies. Journal of Child Language. 1991;18(03):689–710. doi: 10.1017/s0305000900011314. [DOI] [PubMed] [Google Scholar]
  5. Bartels-Tobin LR, Hinckley JJ. Cognition and discourse production in right hemisphere disorder. Journal of Neurolinguistics. 2005;18(6):461–477. [Google Scholar]
  6. Berko-Gleason JB, Goodglass H, Obler L, Green E, Hyde MR, Weintraub S. Narrative strategies of aphasic and normal-speaking subjects. Journal of Speech, Language, and Hearing Research. 1980;23(2):370–382. doi: 10.1044/jshr.2302.370. [DOI] [PubMed] [Google Scholar]
  7. Berman RA, Slobin DI. Relating events in narrative: A cross linguistic developmental study. 20–21. Hillsdale, NJ: Erlbaum; 1994. pp. 41–42.pp. 46 [Google Scholar]
  8. Bloom RL, Borod JC, Obler LK, Gerstman LJ. Impact of emotional content on discourse production in patients with unilateral brain damage. Brain and Language. 1992;42(2):153–164. doi: 10.1016/0093-934x(92)90122-u. [DOI] [PubMed] [Google Scholar]
  9. Bloom RL, Borod JC, Santschi-Haywood C, Pick LH, Obler LK. Left and right hemispheric contributions to discourse coherence and cohesion. International Journal of Neuroscience. 1996;88(1–2):125–140. doi: 10.3109/00207459608999818. [DOI] [PubMed] [Google Scholar]
  10. Borod JC, Bloom RL, Brickman AM, Nakhutina L, Curko EA. Emotional processing deficits in individuals with unilateral brain damage. Applied Neuropsychology. 2002;9:23–36. doi: 10.1207/S15324826AN0901_4. [DOI] [PubMed] [Google Scholar]
  11. Braun AR, Guillemin A, Hosey L, Varga M. The neural organization of discourse. Brain. 2001;124:2028–2044. doi: 10.1093/brain/124.10.2028. [DOI] [PubMed] [Google Scholar]
  12. Christiansen JA. Coherence violations and propositional usage in the narratives of fluent aphasics. Brain and Language. 1995;51:291–317. doi: 10.1006/brln.1995.1062. [DOI] [PubMed] [Google Scholar]
  13. Cicone M, Wapner W, Gardner H. Sensitivity to emotional expressions and situations in organic patients. Cortex. 1980;16(1):145–158. doi: 10.1016/s0010-9452(80)80029-3. [DOI] [PubMed] [Google Scholar]
  14. Cimino CR, Verfaellie M, Bowers D, Heilman KM. Autobiographical memory: Influence of right hemisphere damage on emotionality and specificity. Brain and Cognition. 1991;15(1):106–118. doi: 10.1016/0278-2626(91)90019-5. [DOI] [PubMed] [Google Scholar]
  15. Coelho C, Lê K, Mozeiko J, Krueger F, Grafman J. Discourse production following injury to the dorsolateral prefrontal cortex. Neuropsychologia. 2012;50:3564–3572. doi: 10.1016/j.neuropsychologia.2012.09.005. [DOI] [PubMed] [Google Scholar]
  16. Cortazzi M, Jin L. Evaluating evaluation in narrative. In: Hunston S, Thompson G, editors. Evaluation in text: Authorial stance and the construction of discourse. Oxford, UK: Oxford University Press; 2000. [Google Scholar]
  17. Crawford JR, Garthwaite PH, Porter S. Point and interval estimates of effect sizes for the case-controls design in neuropsychology: rationale, methods, implementations, and proposed reporting standards. Cognitive Neuropsychology. 2010;27:245–260. doi: 10.1080/02643294.2010.513967. [DOI] [PubMed] [Google Scholar]
  18. Davis GA, O’Neil-Pirozzi TM, Coon M. Referential cohesion and logical coherence of narration after right hemisphere stroke. Brain and Language. 1997;56:183–210. doi: 10.1006/brln.1997.1741. [DOI] [PubMed] [Google Scholar]
  19. DeKosky ST, Heilman KM, Bowers D, Valenstein E. Recognition and discrimination of emotional faces and pictures. Brain and Language. 1980;9(2):206–214. doi: 10.1016/0093-934x(80)90141-8. [DOI] [PubMed] [Google Scholar]
  20. Delis DC, Wapner W, Gardner H, Moses JA. The contribution of the right hemisphere to the organization of paragraphs. Cortex. 1983;19:43–50. doi: 10.1016/s0010-9452(83)80049-5. [DOI] [PubMed] [Google Scholar]
  21. Druks J. Object and action naming battery. 2000. [Google Scholar]
  22. Fellows LK, Stark M, Berg A, Chatterjee A. Patient registries in cognitive neuroscience research: Advantages, challenges, and practical advice. Journal of Cognitive Neuroscience. 2008;20:1107–1113. doi: 10.1162/jocn.2008.20065. [DOI] [PubMed] [Google Scholar]
  23. Ferstl EC, von Cramon DY. What does the frontomedian cortex contribute to language processing: coherence or theory of mind? Neuroimage. 2002;17:1599–1612. doi: 10.1006/nimg.2002.1247. [DOI] [PubMed] [Google Scholar]
  24. Ferstl EC, Neumann J, Bogler C, Von Cramon DY. The extended language network: a meta-analysis of neuroimaging studies on text comprehension. Human Brain Mapping. 2008;29:581–593. doi: 10.1002/hbm.20422. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Fletcher PC, Happe F, Frith U, Baker SC, Dolan RJ, Frackowiak RS, Frith CD. Other minds in the brain: a functional imaging study of “theory of mind” in story comprehension. Cognition. 1995;57:109–128. doi: 10.1016/0010-0277(95)00692-r. [DOI] [PubMed] [Google Scholar]
  26. Freedman-Stern R, Ulatowska HK, Baker T, DeLacoste C. Disruption of written language in aphasia: A case study. Brain & Language. 1984;22:181–205. doi: 10.1016/0093-934x(84)90089-0. [DOI] [PubMed] [Google Scholar]
  27. Gallagher HL, Happé F, Brunswick N, Fletcher PC, Frith U, Frith CD. Reading the mind in cartoons and stories: an fMRI study of ‘theory of mind’ in verbal and nonverbal tasks. Neuropsychologia. 2000;38:11–21. doi: 10.1016/s0028-3932(99)00053-6. [DOI] [PubMed] [Google Scholar]
  28. Gernsbacher MA, Kaschak MP. Neuroimaging studies of language production and comprehension. Annual Review of Psychology. 2003;54:91. doi: 10.1146/annurev.psych.54.101601.145128. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Glosser G. Discourse production patterns in neurologically impaired and aged populations. In: Brownell H, Joanette Y, editors. Narrative discourse in neurogenically impaired and normally aging adults. San Diego, CA: Singular; 1993. pp. 191–212. [Google Scholar]
  30. Glosser G, Deser T. Patterns of discourse production among neurological patients with fluent language disorders. Brain and Language. 1990;40:67–88. doi: 10.1016/0093-934x(91)90117-j. [DOI] [PubMed] [Google Scholar]
  31. Glosser G, Deser T, Weisstein C. Structural organization of discourse production following right hemisphere damage. Journal of Clinical and Experimental Neuropsychology. 1992;14:40. [Google Scholar]
  32. Göksun T, Lehet M, Malykhina K, Chatterjee A. Spontaneous gesture and spatial language: Evidence from focal brain-injury. Brain and Language. 2015;150:1–13. doi: 10.1016/j.bandl.2015.07.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Grossman M, McMillan C, Moore P, Ding L, Glosser G, Work M, Gee J. What’s in a name: voxel-based morphometric analyses of MRI and naming difficulty in Alzheimer’s disease, frontotemporal dementia and corticobasal degeneration. Brain. 2004;127:628–649. doi: 10.1093/brain/awh075. [DOI] [PubMed] [Google Scholar]
  34. Heberlein AS, Adolphs R, Pennebaker JW, Tranel D. Effects of Damage to Right-Hemisphere Brain Structures on Spontaneous Emotional and Social Judgments. Political Psychology. 2003;24:705–726. [Google Scholar]
  35. Hécaen H, Albert ML. Human neuropsychology. New York: Wiley; 1978. [Google Scholar]
  36. Herrmann M, Koch U, Johannsen-Horbach H, Wallesch CW. Communicative skills in chronic and severe nonfluent aphasia. Brain and Language. 1989;37:339–352. doi: 10.1016/0093-934x(89)90022-9. [DOI] [PubMed] [Google Scholar]
  37. Huber W, Gleber J. Linguistic and nonlinguistic processing of narratives in aphasia. Brain and Language. 1982;16:1–18. doi: 10.1016/0093-934x(82)90069-4. [DOI] [PubMed] [Google Scholar]
  38. Ianni GR, Cardillo ER, McQuire M, Chatterjee A. Flying under the radar: Figurative language impairments in focal lesion patients. Frontiers in Human Neuroscience. 2014:8. doi: 10.3389/fnhum.2014.00871. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Jakobson R. On aphasic disorders from a linguistic angle. The framework of language. 1980:93–111. [Google Scholar]
  40. Joanette Y, Goulet P, Ska B, Nespoulous JL. Informative content of narrative discourse in right-brain-damaged right-handers. Brain and Language. 1986;29:81–105. doi: 10.1016/0093-934x(86)90035-0. [DOI] [PubMed] [Google Scholar]
  41. Kertesz A. Western aphasia battery test manual. Psychological Corp; 1982. [Google Scholar]
  42. Kintsch W. Text comprehension, memory, and learning. American Psychologist. 1994;49:294. doi: 10.1037//0003-066x.49.4.294. [DOI] [PubMed] [Google Scholar]
  43. Köksal . Unpublished Masters Thesis. Koç University; Istanbul-Turkey: 2011. Predictors of Turkish speaking preschoolers’ narrative and vocabulary competence: An ecological approach. [Google Scholar]
  44. Küntay A, Nakamura K. Linguistic strategies serving evaluative functions: A comparison between Japanese and Turkish narratives. In: Strömqvist S, Verhoeven L, editors. Relating events in narrative, Volume 2: Typological and contextual perspectives. Mahwah: Lawrence Erlbaum Associates; 2004. pp. 329–358. [Google Scholar]
  45. Kurczek J, Duff MC. Cohesion, coherence, and declarative memory: Discourse patterns in individuals with hippocampal amnesia. Aphasiology. 2011;25:700–712. doi: 10.1080/02687038.2010.537345. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Labov W. Some further steps in narrative analysis. Journal of Narrative and Life History. 1997;7:395–415. [Google Scholar]
  47. Labov W, Waletzky J. Narrative analysis: Oral versions of personal experience. Seattle: University of Washington Press; 1967. [Google Scholar]
  48. Linnik A, Bastiaanse R, Höhle B. Discourse production in aphasia: a current review of theoretical and methodological challenges. Aphasiology. 2016;30:765–800. [Google Scholar]
  49. Mar RA. The neuropsychology of narrative: Story comprehension, story production and their interrelation. Neuropsychologia. 2004;42:1414–1434. doi: 10.1016/j.neuropsychologia.2003.12.016. [DOI] [PubMed] [Google Scholar]
  50. Marangolo P, Fiori V, Calpagnano MA, Campana S, Razzano C, Caltagirone C, Marini A. tDCS over the left inferior frontal cortex improves speech production in aphasia. Frontiers in Human Neuroscience. 2013;7 doi: 10.3389/fnhum.2013.00539. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Marangolo P, Fiori V, Campana S, Calpagnano MA, Razzano C, Caltagirone C, Marini A. Something to talk about: enhancement of linguistic cohesion through tDCS in chronic non fluent aphasia. Neuropsychologia. 2014;53:246–256. doi: 10.1016/j.neuropsychologia.2013.12.003. [DOI] [PubMed] [Google Scholar]
  52. Marini A. Seminars in Speech and Language. 01. Vol. 33. Thieme Medical Publishers; 2012. Characteristics of narrative discourse processing after damage to the right hemisphere; pp. 68–78. [DOI] [PubMed] [Google Scholar]
  53. Marini A, Urgesi C. Please get to the point! A cortical correlate of linguistic informativeness. Journal of Cognitive Neuroscience. 2012;24:2211–2222. doi: 10.1162/jocn_a_00283. [DOI] [PubMed] [Google Scholar]
  54. Marini A, Carlomagno S, Caltagirone C, Nocentini U. The role played by the right hemisphere in the organization of complex textual structures. Brain and Language. 2005;93(1):46–54. doi: 10.1016/j.bandl.2004.08.002. [DOI] [PubMed] [Google Scholar]
  55. Marini A, Tavano A, Fabbro F. Assessment of linguistic abilities in Italian children with specific language impairment. Neuropsychologia. 2008;46:2816–2823. doi: 10.1016/j.neuropsychologia.2008.05.013. [DOI] [PubMed] [Google Scholar]
  56. Marini A, Andreetta S, del Tin S, Carlomagno S. A multi-level approach to the analysis of narrative language in aphasia. Aphasiology. 2011;25:1372–1392. [Google Scholar]
  57. Marini A, Galetto V, Zampieri E, Vorano L, Zettin M, Carlomagno S. Narrative language in traumatic brain injury. Neuropsychologia. 2011;49:2904–2910. doi: 10.1016/j.neuropsychologia.2011.06.017. [DOI] [PubMed] [Google Scholar]
  58. Mayer M. Frog, where are you? New York: Dial Press; 1969. [Google Scholar]
  59. Mazoyer BM, Tzourio N, Frak V, Syrota A, Murayama N, Levrier O, … Mehler J. The cortical representation of speech. Journal of Cognitive Neuroscience. 1993;5(4):467–479. doi: 10.1162/jocn.1993.5.4.467. [DOI] [PubMed] [Google Scholar]
  60. Meadows J. The anatomical basis of prosopagnosia. Journal of Neurology, Neurosurgery and Psychiatry. 1974;37:489–501. doi: 10.1136/jnnp.37.5.489. [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Moscovitch M. The linguistic and emotional functions of the normal right hemisphere. Cognitive processing in the right hemisphere. 1983:57–82. [Google Scholar]
  62. Nicholas LE, Brookshire RH. A system for scoring main concepts in the discourse of non-brain-damaged and aphasic speakers. Clinical Aphasiology. 1993;21:87–99. [Google Scholar]
  63. Price CJ. The anatomy of language: A review of 100 fMRI studies published in 2009. Annals of the New York Academy of Sciences. 2010;1191(1):62–88. doi: 10.1111/j.1749-6632.2010.05444.x. [DOI] [PubMed] [Google Scholar]
  64. Reilly JS, Bates EA, Marchman VA. Narrative discourse in children with early focal brain injury. Brain and Language. 1998;61(3):335–375. doi: 10.1006/brln.1997.1882. [DOI] [PubMed] [Google Scholar]
  65. Reilly J, Losh M, Bellugi U, Wulfeck B. “Frog, where are you?” Narratives in children with specific language impairment, early focal brain injury, and Williams syndrome. Brain and Language. 2004;88(2):229–247. doi: 10.1016/S0093-934X(03)00101-9. [DOI] [PubMed] [Google Scholar]
  66. Rivers DL, Love RJ. Language performance on visual processing tasks in right hemisphere lesion cases. Brain and Language. 1980;10(2):348–366. doi: 10.1016/0093-934x(80)90061-9. [DOI] [PubMed] [Google Scholar]
  67. Rogalski Y, Edmonds LA. Attentive Reading and Constrained Summarisation (ARCS) treatment in primary progressive aphasia: A case study. Aphasiology. 2008;22(7–8):763–775. [Google Scholar]
  68. Rosen HJ, Gorno–Tempini ML, Goldman WP, Perry RJ, Schuff N, Weiner M, … Miller BL. Patterns of brain atrophy in frontotemporal dementia andsemantic dementia. Neurology. 2002;58:198–208. doi: 10.1212/wnl.58.2.198. [DOI] [PubMed] [Google Scholar]
  69. Sherratt S. Right brain damage and the verbal expression of emotion: A preliminary investigation. Aphasiology. 2007;21(3–4):320–339. [Google Scholar]
  70. Sherratt S, Bryan K. Discourse production after right brain damage: Gaining a comprehensive picture using a multi-level processing model. Journal of Neurolinguistics. 2012;25(4):213–239. [Google Scholar]
  71. Troiani V, Fernández-Seara MA, Wang Z, Detre JA, Ash S, Grossman M. Narrative speech production: An fMRI study using continuous arterial spin labeling. Neuroimage. 2008;40(2):932–939. doi: 10.1016/j.neuroimage.2007.12.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  72. Ulatowska HK, Allard L, Chapman SB. Discourse ability and brain damage. Springer; New York: 1990. Narrative and procedural discourse in aphasia; pp. 180–198. [Google Scholar]
  73. Ulatowska HK, Freedman-Stern R, Doyel AW, Macaluso-Haynes S, North AJ. Production of narrative discourse in aphasia. Brain and Language. 1983;19(2):317–334. doi: 10.1016/0093-934x(83)90074-3. [DOI] [PubMed] [Google Scholar]
  74. Ulatowska HK, North AJ, Macaluso-Haynes S. Production of narrative and procedural discourse in aphasia. Brain and Language. 1981;13(2):345–371. doi: 10.1016/0093-934x(81)90100-0. [DOI] [PubMed] [Google Scholar]
  75. Uryase D, Sr, Duffy RJ, Liles BZ. Analysis and description of narrative discourse in right-hemisphere-damaged adults: a comparison with neurologically normal and left-hemisphere-damaged aphasic adults. In: Prescott TE, editor. Clinical Aphasiology. Vol. 19. Austin, TX: Pro-Ed; 1991. pp. 125–138. [Google Scholar]
  76. Williams GB, Nestor PJ, Hodges JR. Neural correlates of semantic and behavioral deficits in frontotemporal dementia. Neuroimage. 2005;24(4):1042–1051. doi: 10.1016/j.neuroimage.2004.10.023. [DOI] [PubMed] [Google Scholar]
  77. Xu J, Kemeny S, Park G, Frattali C, Braun A. Language in context: emergent features of word, sentence, and narrative comprehension. Neuroimage. 2005;25(3):1002–1015. doi: 10.1016/j.neuroimage.2004.12.013. [DOI] [PubMed] [Google Scholar]

RESOURCES