Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2021 Jan 1.
Published in final edited form as: Top Lang Disord. 2020;40(1):36–53. doi: 10.1097/tld.0000000000000202

A Review of the Application of Distributed Practice Principles to Naming Treatment in Aphasia.

Erica L Middleton 1, Julia Schuchard 1, Katherine A Rawson 2
PMCID: PMC7437680  NIHMSID: NIHMS1548926  PMID: 32831450

Abstract

It is uncontroversial in psychological research that different schedules of practice, which govern the distribution of practice over time, can promote radically different outcomes in terms of gains in performance and the durability of learning. In contrast, in speech-language treatment research, there is a critical need for well-controlled studies examining the impact of the distribution of treatment on efficacy (for reviews, see Cherney, 2012; Warren, Fey, & Yoder, 2007). In this paper, we enumerate key findings from psychological research on learning and memory regarding how different schedules of practice differentially confer durable learning. We review existing studies of aphasia treatment with a focus on naming impairment that have examined how the distribution of practice affects treatment efficacy. We close by discussing potential productive lines of research to elaborate the clinical applicability of distributed practice principles to language treatment.

1. Introduction

In aphasia treatment research, there remain many unanswered questions regarding the optimal distribution of treatment for maximizing efficacy and the retention of gains. This paper explores the potential applicability of principles of distributed practice for enhancing the potency of treatment of naming impairment in aphasia, with a focus on how the principles impact naming accuracy on treated items. The principles of learning indicate that training trials for items are more potent when spaced over time versus massed in close succession (Principle 1), and with increases in spacing within a session (Principle 2). Furthermore, training trials for items are more potent when distributed across sessions rather than within a single session (Principle 3). Lastly, greater time between sessions can enhance learning and retention (Principle 4). We first outline the empirical basis for these four principles in the cognitive and educational psychology literatures. We then review findings of naming treatment studies that have examined how the spacing of trials for trained items within or across sessions impacts later performance on trained items. Findings from studies on speech-language treatment intensity that may relate to the learning principles are also reviewed. The paper concludes with directions for future research to advance the translation of basic learning principles for informing and improving language rehabilitation.

1.1. Psychological Principles of Learning

Because the focus of this paper is application to language treatment, we review evidence relevant to verbal learning. In psychological studies with neurotypical participants, common examples of to-be-learned (i.e., target) information in the verbal domain include learning the association between two words or the translation for foreign words. A large literature in psychology has examined how the scheduling of repeated training trials per item affects learning and retention. This literature has developed in lockstep with research examining how the type of practice affects durable learning. Specifically, countless studies have shown that retrieval practice, or practice retrieving target information (e.g., the English translation of a Swahili word) from long-term memory, confers robust learning relative to restudying that information (for a review, see Rowland, 2014). The primary purpose of the current paper is to examine the state of the field with regard to the applicability of distributed practice principles to aphasia treatment, but new research on retrieval practice effects in aphasia is also briefly discussed to give greater context to our current understanding of how language treatment responds to these related learning principles.

1.2. Scope of the Evidence to be Reviewed

The primary purpose of this review is to discuss the use of distributed practice principles to optimize the scheduling of naming treatment for the promotion of consistent retrieval of trained words for production in people with aphasia. Naming impairment, or difficulty retrieving and producing the words for objects, actions, people, etc., is ubiquitous across the different subtypes of aphasia and commonly a central impediment to successful communication (Goodglass & Wingfield, 1997). Although producing a name requires multiple stages of processing (for overview, see Wilshire, 2008), a common cause of naming difficulty in aphasia is an impaired ability to map from semantics to existing, but inconsistently retrievable, lexical representations (i.e., words; Dell, Schwartz, Martin, Saffran, & Gagnon, 1997; Rapp & Goldrick, 2000; Walker & Hickok, 2016). Similar to methods used in psychological research on learning and memory, naming treatment for aphasia commonly involves practice retrieving specific words such as names for pictured objects or actions in several separate trials over the course of one or more sessions, and a subsequent test can assess the patient’s performance for the trained items. Therefore, in aphasia research, the treatment of naming impairment is an ideal domain for examining how distributed practice principles may impact efficacy.

In addition to these item-specific effects, improved naming of untrained items (i.e., generalization) is often an important goal of naming treatment. Not unlike the distributed practice literature, the applicability of the learning principles outlined in this paper for generalized improvement in naming is less clear than for item-specific improvements in accuracy. It also remains uncertain whether these principles apply in treatments focusing on more complex or abstract linguistic processes (e.g., phrase or sentence production; syntactic parsing). Though we return to these issues in the final sections of the paper, the primary purpose of this review is to discuss how distributed practice principles might optimize naming treatment that focuses on benefits to treated vocabulary for people with aphasia.

1.3. Distributed Practice Effects: Spacing and Lag

A distributed practice effect refers to any result in which the distribution of an item’s practice trials across more (versus less) time or a greater (versus fewer) number of intervening trials for other items confers superior performance at a later test. The voluminous literature on distributed practice generally shows that performance during training is a poor indicator of learning. Greater distribution of an item’s trials is generally associated with more forgetting between trials during training but better long-term retention of information after training (for discussion, see Schmidt & Bjork, 1992). Research on the effects of distributed practice has focused on four basic comparisons summarized in Table 1 and discussed briefly below in order of manipulations involving shorter to longer timescales. For brevity and ease of exposition, we identify each comparison with a learning principle (see Table 1, Column 1) and refer to such principles in relation to the reviewed studies (see Tables 2 and 3, Column 2).

Table 1.

Distributed Practice Comparisons Ordered from Shorter to Longer Timespans with Typical Performance Patterns and Associated Learning Principles.

Learning Principle Condition Description Performance During Training Performance after a Delay
1 massed practice an item’s trials separated by 0 or 1 other trial massed > spaced spaced > massed
spaced practice an item’s trials separated by more than 1 other trial
2 shorter trial lag within a session an item’s trials separated by fewer other trials shorter trial lag > longer trial lag longer trial lag > shorter trial lag
longer trial lag within a session an item’s trials separated by more other trials
3 within-session training an item’s trials trained in one session # of correct retrievals typically controlled across conditions across-session training > within-session training
across-session training an item’s trials trained in two or more sessions
4 shorter intersession lag each session separated by fewer days shorter intersession lag > longer intersession lag longer intersession lag > shorter intersession lag
longer intersession lag each session separated by more days

Table 2.

Characteristics of Naming Treatment Studies and Learning Principles Examined.

Study Learning Principle N Design Type of Treatment Massed/Shorter Lag Condition Spaced/Longer Lag Condition Timing
Raymer et al. (2006) 4 5 C 2 phases (WS) word-picture matching and name repetition 3–4 sessions per week for 12 sessions total 1–2 sessions per week for 12 sessions total throughout treatment; 1 month retention probe
Ramsberger & Marie (2007) 4 4 C 2 phases (WS) cued naming 5 sessions per week 2 sessions per week every fifth treatment session
Sage et al. (2011) 4 8 C 2 phases (WS) confrontation naming followed by cueing 5 sessions per week for 2 weeks 2 sessions per week for 5 weeks immediately post-treatment; 1 month retention probe
Middleton et al. (2016) 1, 2 4 C 1 phase (WS) retrieval practice or name repetition and correct-answer feedback massed practice in 1 session spaced practice in 1 session 1 day and 1 week retention probes
Middleton et al. (in press) 1 4 C 1 phase (WS) retrieval practice or name repetition and correct-answer feedback massed practice in 4 sessions spaced practice in 4 sessions 1 week and 1 month retention probes
Schuchard et al. (2019) 3 9 C 2 phases (WS) retrieval practice and correct-answer feedback retrievals presented within 1 session retrievals distributed across 2 sessions 1 day and 1 week retention probes
4 intersession lag = 1 day for 3 sessions intersession lag = 7 days for 3 sessions 1 month retention probe

Note. N refers to number of participants; in that column, C = aphasia in the chronic phase (>3 months post onset). Design refers to type of experimental design where WS = within-subject. Timing denotes when naming performance was probed during and after treatment.

Table 3.

Characteristics of Other Language Treatment Studies and Learning Principles Examined.

Study Learning Principle N Design Type of Treatment Shorter Lag Condition/Group Longer Lag Condition/Group Timing
Harnish et al. (2008) 4 1 C 2 phases (WS) naming, sentence production, writing 1.5-hour sessions; 5 sessions per week for 2 weeks 1-hour sessions; 2 sessions per week for 7.5 weeks unspecified interval after each treatment phase
Martins et al. (2013) 4 30 (18) A randomized, rater-blinded, parallel trial (BS) Multimodal Stimulation Approach (e.g., Schuell et al., 1955). 5 sessions per week for 10 weeks 1–2 sessions per week for 50 weeks 10, 50, and 62 weeks after initiation of treatment
Mozeiko et al. (2016) 4 8 C modified multiple baseline design across subjects (BS) constraint-induced language therapy 3-hour sessions; 5 sessions per week for 2 weeks 1-hour sessions; 3 sessions per week for 10 weeks after every six hours of treatment; 1 week and 1 month retention probes
Dignam et al. (2015); Dignam et al. (2016) 4 34 (32) C nonrandomized parallel-group trial (BS) Aphasia Language Impairment and Functioning Therapy (Rodriguez et al., 2013) 16 hours per week for 3 weeks 6 hours per week for 8 weeks immediately post-treatment; 1 month retention probe

Note. N refers to number of participants (total participants who completed the study to the primary endpoint); in that column, A = acute or subacute (<3 months post onset) and C = chronic (>3 months post onset). Design refers to type of experimental design where WS = within-subject and BS = between-subjects. Timing denotes when performance was probed during and after treatment.

The first comparison involves spaced versus massed practice within a training session (Principle 1). In massed practice, an item’s trials are presented in close enough succession that the item remains active in working- or short-term memory across its trials. In contrast, spaced practice refers to conditions in which an item’s training trials are separated by enough time and/or trials for other items so that processing of the item on each of its trials requires involvement of long-term memory. When performance during training is probed (e.g., via retrieval practice), a typical finding is that performance is superior during massed versus spaced training. In contrast, on a subsequent test of performance administered after training (i.e., retention test), spaced practice confers an advantage over massed practice. This spacing effect is one of the most replicated and reliable effects in human learning research; one meta-analysis found that 259 of 271 (96%) of comparisons revealed a significant advantage for spaced over massed practice at retention test (Cepeda, Pashler, Vul, Wixted, & Rohrer, 2006; see also Delaney, Verkoeijen, & Spirgel, 2010; Toppino & Gerbier, 2014).

The second comparison involves longer versus shorter spacing within a training session (Principle 2). Within the context of spaced practice, the degree of spacing between an item’s training trials is referred to as lag. Increases in lag typically enhance retention test performance (for review, see Cepeda et al., 2006). For example, Pyc and Rawson (2012) presented learners with foreign language translations for an initial study trial and then three practice trials. Trials for a given item were separated by either 9 or 69 practice trials for other items. On a retention test administered two days later, performance was considerably greater for items that had been practiced with longer versus shorter lags between trials.

The third comparison involves practice that is distributed across two or more training sessions versus completed within a single training session (Principle 3). Real-world learning situations commonly involve training on a set of materials or skills in multiple sessions with an aim to promote maintenance of learned information over intervals of weeks, months, or even years. Yet only a small minority of psychological studies of distributed practice in the verbal domain have included multiple training sessions. Some studies have held the total number of training trials per item constant and manipulated whether the training trials for a given item are all completed in one session or distributed across sessions (e.g., Kornell, 2009). Other studies have presented items for retrieval practice until each is successfully retrieved a pre-determined number of times, and the successful retrievals for a given item are accomplished either in one session or spread across multiple sessions (e.g., Rawson & Dunlosky, 2011; Vaughn, Dunlosky, & Rawson, 2016). Across studies involving these methodologies, the consistent outcome is that retention test performance is greater following practice that was distributed across multiple sessions versus completed in a single session. To illustrate, consider the recall accuracy for trained Swahili-English word pairs reported by Vaughn et al. (2016). Participants’ average accuracy was only 28% one week after items had been practiced to a criterion of four correct trials per item within one session, compared to 74% accuracy one week after items had been practiced to a criterion of one correct trial per item in each of four sessions spaced a week apart.

The fourth comparison involves training sessions that are separated by longer versus shorter intervals (Principle 4). When items are presented for practice in two or more sessions, relatively few studies have examined the effects of increasing the lag between practice sessions (hereafter, intersession lag). For example, in the study by Bahrick, Bahrick, Bahrick and Bahrick (1993), the task involved practice translating unfamiliar foreign vocabulary. Items were practiced in multiple sessions that were separated by intervals of 14, 28, or 56 days. On retention tests administered 1, 2, 3, 4, or 5 years after the last practice session, performance was superior for items in the 56-day lag condition versus the 28-day lag condition, which in turn was superior to the 14-day lag condition. More recently, Rawson, Vaughn, Walsh, and Dunlosky (2018) found modest gains on a retention test administered one month after practice when prior training sessions were separated by 7 versus 2 days (for similar outcomes, see Cepeda, Vul, Rohrer, Wixted, & Pashler, 2008). Taken together, these findings suggest that increasing intersession lag may enhance the durability of learning, although strong conclusions about the magnitude of these benefits and about optimal intersession lags await further research.

1.4. Distributed Practice Principles

To summarize the findings discussed above, psychological learning research with neurotypical adults supports the following principles of distributed practice (Table 1):

  1. Training trials per item within a session are more potent when they are spaced versus massed (Principle 1), and when spaced trials are separated by a longer versus shorter lag (Principle 2).

  2. Training trials per item are more potent when distributed across sessions rather than administered within a single session (Principle 3).

  3. Increasing intersession lag can enhance durable learning (Principle 4).

2. Applicability of Distributed Practice Principles to Aphasia Treatment

There are several potential barriers to the translation of findings from experimental psychology to a language treatment setting. Even among neurotypical populations, there is a pressing need for more research on the relevance of distributed practice principles in the context and timescale of real-world learning (for review, see Dunlosky, Rawson, Marsh, Nathan, & Willingham, 2013). Another barrier may be that the psychology literature has focused on factors that optimize the acquisition of new knowledge, whereas the functional deficit underlying aphasia generally reflects inconsistent or disordered access to existing representations that underpin language use (for review, see Mirman & Brit, 2014). Furthermore, there may be important differences in learning systems between neurologically intact adults and individuals with neurological damage. Stroke-induced neurophysiological changes are likely to affect mechanisms of learning, particularly in the initial months following brain injury (Kleim & Jones, 2008). Brain damage may also cause long-lasting impairments to domain-specific or domain-general learning processes that are relevant to language processing and recovery (e.g., Schuchard & Thompson, 2014; Tuomiranta et al., 2014; Vallila-Rohter & Kiran, 2013). Considering these complicating factors, the optimal learning strategies for at least some individuals with aphasia likely differ from those established by psychological learning research.

Nevertheless, a growing body of research supports the hypothesis that people with aphasia engage learning processes in their recovery of language abilities (for review, see Vallila-Rohter, 2017) and suggests that basic learning principles also apply to naming treatment efficacy in aphasia. Evidence is amassing for the clinical applicability of retrieval practice (see section 1.1) to the treatment of naming impairment in aphasia. Numerous recent studies have contrasted naming treatment that provides retrieval practice (i.e., practice retrieving names for depicted entities from long-term memory) to name repetition training, a parallel to the restudy condition in psychological studies of retrieval practice effects. Name repetition training is a common form of naming treatment that involves practice orally repeating experimenter-provided names for depicted objects, but notably, production does not require retrieval of the name from long-term memory. Consistent with retrieval practice research on neurotypical individuals, these studies have all observed superior naming accuracy after retrieval practice versus name repetition training on retention tests administered at intervals ranging from days to months (Friedman, Sullivan, Snider, Luta, & Jones, 2017; Middleton, Schwartz, Rawson, & Garvey, 2015; Middleton, Schwartz, Rawson, Traut, & Verkuilen, 2016; Middleton, Rawson & Verkuilen, in press). Additional studies have shown that retrieval practice is particularly efficacious for strengthening connections between meaning and words in the course of lexical access (Schuchard & Middleton, 2018a; 2018b). Likewise, as we review below, a growing literature is pointing to the applicability of distributed practice learning principles for enhancing naming treatment benefits.

In the following section, we review the results of aphasia rehabilitation studies that contribute to an understanding of the relationship between distributed practice principles and treatment efficacy. To date, the majority of studies that have examined effects of how treatment is distributed in aphasia can be divided into two general categories. One category consists of naming treatment studies that employ a within-subject design in which sets of items (e.g., depicted objects for naming practice) are assigned to different schedules. Manipulations include the spacing of trials for specific items within or across sessions, or the lag between sessions. These studies primarily evaluate item-specific effects (i.e., naming accuracy for trained items). The second category consists of studies of treatment protocols that address multiple aspects of language and communication, employing a between-subjects design in which participants are assigned to one of two different schedules. These studies typically manipulate the spacing of treatment hours or sessions dedicated to multi-modal speech-language treatment, and evaluate outcomes using relatively comprehensive tests of language and/or functional communication. Although the naming treatment studies are more relevant for the focus of the current paper, we also discuss evidence from other types of language treatment in aphasia to highlight similarities and differences between the two categories of treatment schedule research.

2.1. Distributed Practice Effects in Naming Treatment of Aphasia

We next review evidence from studies examining schedules of practice in naming treatment identified from literature searches conducted in March, 2018. Searches on Web of Science using the conjunction of the terms aphasia, naming, distributed, practice; aphasia, naming, spacing; aphasia, naming, lag; aphasia, naming, schedule returned 43 total articles. An additional search of PubMed of the same combinations of terms (constrained to appear in article abstracts, to focus the search on the most relevant articles) returned no additional articles. We screened the 43 articles for the following inclusion criterion: (a) included adults with aphasia as participants; (b) examined treatment focused on improving naming accuracy in aphasia; (c) controlled the type of treatment across conditions; and, (d) examined spacing or lag effects in the scheduling of specific item trials or sessions of treatment while controlling for the number of trials per item across conditions. The reference lists of articles meeting these criteria were also examined for relevant articles. The articles returned in the search for the review of schedules of practice in other language treatments (section 2.2) were also examined for possible inclusion here, and vice versa. One study (Morrow & Fridriksson, 2006) that examined two spaced schedules in naming treatment was rejected because whether lag differed between schedules was not examined or reported. Because the purpose of this paper is to discuss verbal rather than motor skill learning, we excluded studies focused on speech-motor skills, such as treatment for apraxia of speech. Methodological details of the six studies meeting the inclusion criteria are in Table 2.

Relevant to Principle 1 (section 1.4; Table 1), two studies have examined whether naming treatment benefits are enhanced when items are presented for spaced versus massed practice (Middleton et al., 2016; Middleton et al., in press). In addition, Middleton et al. (2016) examined whether increased lag between trials within a session further enhanced the benefits from spaced naming treatment (Principle 2). In that study, items were presented in a single treatment session for multiple trials of either retrieval practice or name repetition training to examine the effect of type of naming treatment on efficacy. Trials were either spaced or massed. In the massed schedule, one trial intervened between each of the trials for an item (massed condition was presented at a lag of 1, or lag-1). In the spaced schedules, 5, 15, or 30 trials intervened between each of the trials for an item (i.e., lag-5, lag-15, and lag-30). In group analyses on the 4 persons with aphasia (PWA) studied, naming performance on retention tests administered one day and one week post-treatment was significantly higher for items in the spaced conditions relative to the massed condition, constituting a spacing effect. A follow-up group analysis that statistically controlled for training accuracy suggested that increasing the lag of spaced trials (i.e., 5 to 15 to 30 trials) enhanced retention test performance for items trained with name retrieval practice, constituting a lag effect. Extending this work, Middleton et al. (in press) examined spacing effects when items were presented in a more clinic-inspired schedule of delivery. Four PWA completed retrieval practice or name repetition training for items according to a massed (lag-1) or spaced schedule (lag-24) in each of several treatment sessions. A group analysis on a retention test administered one week after the final treatment session showed a significant advantage for spaced versus massed practice. A similar trend was apparent at a retention test administered one month after the final session of treatment.

In a group study of nine PWA, Schuchard et al. (2019) examined effects relevant to Principles 3 and 4. In that study, six item sets per participant were assigned into six conditions formed by crossing a three-level factor of criterion level (Criterion-1, Criterion-2, Criterion-4, defined shortly) and a two-level factor of intersession lag (1-day lag phase and 7-day lag phase). In each of three sessions spaced 1 day apart (1-day lag phase) or 7 days apart (7-day lag phase), items were trained to their assigned criterion level (i.e., how many times an item was successfully retrieved in a session before it was dropped from additional training in that session). The study examined the effect of distributing an item’s retrievals across sessions versus within a single session (Principle 3) by examining naming performance in a subsequent session for (a) items in the Criterion-1 condition trained in two prior sessions compared to items in the Criterion-2 condition trained in one prior session; and, (b) items in the Criterion-2 condition trained in two prior sessions compared to items in the Criterion-4 condition trained in one prior session. The effects of the across- versus within-session factor were assessed at both 1-day (in the 1-day lag phase) and 7-day (in the 7-day lag phase) retention intervals.

Concerning the within- versus across-session comparisons (Principle 3), naming accuracy 1 or 7 days after training was 17–18 percentage points higher for Criterion-1 items trained in two prior sessions compared to Criterion-2 items trained in one prior session. Similarly, naming accuracy 7 days after training was 21 percentage points higher for Criterion-2 items trained in two prior sessions compared to Criterion-4 items trained in one prior session (the corresponding comparison in the 1-day lag phase unexpectedly showed no difference, possibly due to functional ceiling effects). In sum, spacing the same number of retrievals for an item across sessions versus concentrating the retrievals within a session generally conferred a robust increase in later naming accuracy. Because of the focus on equating number of correct retrievals in each comparison, the number of trials per item was not strictly controlled. However, the increase in total trials due to across-session compared to within-session spacing was negligible.

To examine the effect of intersession lag (Principle 4), Schuchard et al. also administered a long-term retention test approximately one month after the final training session in each lag phase. A group analysis revealed a 5% advantage in naming accuracy for the 7-day lag phase over the 1-day lag phase (p=.057) at the one-month long-term retention test. Six of the nine participants scored numerically higher on the long-term retention test in the 7-day lag versus 1-day lag phase.

Three additional studies have tested the effect of intersession lag in naming treatment (Principle 4; Ramsberger & Marie, 2007; Raymer, Kohen, & Saffell, 2006; Sage, Snell, & Lambon Ralph, 2011). Each of these studies administered two lag phases (shorter versus longer lag), controlled for the number of trials per item and the number of sessions per lag condition, and counterbalanced the order of lag phase across participants.

Ramsberger and Marie (2007) studied 4 PWA, each completing two phases of treatment: a shorter lag phase administered 5 times per week, and a longer lag phase administered twice a week. Two participants completed 15 sessions per phase, and the two other participants completed 20 sessions per phase. Primary assessment of improvement in trained items involved multiple statistical indices comparing baseline performance to performance during treatment. Three of four PWA showed consistent benefit in both the shorter and longer lag conditions across all indices; the fourth PWA showed inconsistent benefit across indices for both conditions. However, as discussed in section 1.3, the distributed practice literature suggests that increases in lag generally enhance long-term retention rather than performance during training. Ramsberger and Marie (2007) collected three post-treatment probes for items trained in the shorter lag phase for two participants and for items trained in the longer lag phase for the other two participants. Based on participant-specific averages during treatment and post-treatment, only 85% and 43% of treatment benefits were retained after the shorter lag phase (percent of retained treatment benefits calculated as [1 – (treatment performance – post-treatment performance)/treatment performance]). In contrast, 98% and 106% of treatment benefits were retained after the longer lag phase, consistent with the expectation that longer lags confer more durable learning.1

Raymer et al. (2006) examined the effects of computerized word comprehension practice on naming performance, with treatment conducted in 3–4 sessions per week (shorter lag phase) or 1–2 sessions per week (longer lag phase). A one-month post-treatment probe was administered after each phase. Primary treatment outcomes were assessed by comparing performance during treatment to baseline. Statistics focused on the standardized mean difference within each individual, an effect size calculation developed by Busk and Serlin (1992; for discussion, see Beeson & Robey, 2006). Standardized mean difference is problematic for a variety of reasons, including that it does not provide significance values and that effect size estimates can be inflated if there is little variability in the baseline probes (for discussion see Lee & Cherney, 2018). With this caveat in mind, all 5 PWA showed strong effect sizes for trained items in the shorter lag condition, whereas 2 PWA showed strong effect sizes and 2 PWA showed moderate effect sizes for trained items in the longer lag condition. However, PWA on average retained 114% of treatment benefits at the one-month test in the shorter lag condition, but retained 150% benefits in the longer lag condition (i.e., performance tended to improve post-treatment, but more so in the longer lag condition).

In contrast to Raymer et al. (2006) and Ramsberger and Marie (2007), Sage et al. (2011) employed a more powerful manipulation of intersession lag by comparing naming therapy delivered five times per week for two weeks (shorter lag condition) versus one time per week for ten weeks (longer lag condition). Naming performance was probed immediately after treatment and at one-month post-treatment. Performance in the shorter and longer lag conditions was similar when probed immediately after treatment, but a significant advantage emerged for the longer lag condition at one month post-treatment. Thus, across the four studies reviewed, there is consistent evidence that greater intersession lag can confer more persistent retention of treatment benefits and superior long-term performance on trained items. In section 2.3, we provide a summary of the findings of the studies reviewed in this section and discuss their clinical implications.

2.2. Distributed Practice Effects in Other Language Treatments of Aphasia

Other rehabilitation research in aphasia has examined how the distribution of treatment affects outcomes. Such studies have focused on therapies that address multiple language and communication goals and are seated within the larger literature on ‘treatment intensity’ (for review, see Dignam, Rodriquez, & Copland, 2016b). Intensive treatment has no standard definition but typically refers to large amounts of treatment administered over a relatively short duration, often involving long treatment sessions and short intersession lags. Some researchers have argued that an intensive treatment schedule is supported by neuroscience research at the cellular level (e.g., the Hebbian learning principle that neurons frequently active at the same time become more strongly connected), and by animal models showing that frequent, repetitive training leads to neurological change and functional improvement (e.g., Kleim & Jones, 2008; Pulvermuller & Berthier, 2008; Raymer et al., 2008). For people with aphasia, however, changes in neural activity and behavioral improvements occur following a wide variety of treatment schedules (for review, see Crinion & Leff, 2015). As examples, neurophysiological and behavioral changes in people with aphasia were demonstrated after participants received 10 or more hours of treatment per week (e.g., Fridriksson et al., 2007; Meinzer et al., 2004) as well as after more distributed schedules of 3–4 weekly hours with only two sessions per week (e.g., Sandberg, Bohland, & Kiran, 2015; Thompson, Riley, den Ouden, Meltzer-Asscher, & Lukic, 2013). It remains to be determined which patterns of neural activity are indicative of better language recovery and which treatment schedules may best promote those neural changes. With regard to behavioral improvement, it remains unclear whether an intensive treatment schedule promotes better outcomes than a more distributed schedule because the majority of relevant studies have compared intensive treatment to a period of no treatment or have failed to control the type or total amount of treatment across schedules (e.g., Bakheit et al., 2007; Barthel, Meinzer, Djundja, & Rockstroh, 2008; Berthier et al., 2014; Breitenstein et al., 2017; Hinckley & Craig, 1998; Hinckley & Carr, 2005; Pulvermuller et al., 2001). These studies show that intensive treatment is effective, but this type of schedule may or may not be optimal.

For our goal of examining the relevance of distributed practice principles to aphasia rehabilitation, the subset of studies in the intensity literature that have controlled the amount and type of therapy while manipulating intersession lag (Principle 4; see section 1.4 and Table 1) are most germane. Potential studies for review in this section were identified from literature searches conducted in March, 2018. Searches on Web of Science using the conjunction of the terms aphasia, treatment, intensity; aphasia, treatment, intensive; aphasia, massed, practice; aphasia, schedule, treatment returned 337 articles. An additional search of PubMed of the same combinations of terms (constrained to appear in article abstracts, to focus the search on the most relevant articles) returned an additional 8 articles. We screened the 345 total articles for the following inclusion criterion: (a) examined distributed versus intensive schedules in which the therapy addressed multiple aspects of language functioning; (b) included adults with aphasia as participants; (c) controlled the type of treatment across schedules; (d) controlled the total amount of treatment defined in terms of number of total hours per schedule. The reference lists of articles meeting these criteria were also examined for relevant articles. Across studies, the number of sessions or the number of hours per session were not always controlled between schedules. Methodological details of these studies are in Table 3.

Martins et al. (2013) employed a between-subjects design in which participants were randomly assigned to receive an intensive schedule of 5 days per week for 10 weeks (shorter lags) or a distributed schedule of 1–2 sessions per week for 50 weeks (longer lags) for a total of 100 hours of speech-language treatment. Language test batteries were administered at baseline and at 10, 50, and 62 weeks after the initiation of treatment for each group. The primary outcome was proportion of responders defined as individuals who showed a 15 point increase in aphasia quotient on the Aachen Aphasia battery (Portuguese version, PAAT) (Lauterbach et al. 2008) from baseline to the 50-week assessment. Secondary outcomes included mean change in aphasia quotient and functional communication measures and maintenance of benefits between the 50 to 62 week testpoints. Only 18 of the recruited 30 patients completed the study to the primary endpoint of 50 weeks (9 in each group), and 14 completed the study through the 62 week endpoint. The proportion of responders in the intensive treatment group (88%, or 8 of 9 participants) was not different from the proportion of responders in the distributed treatment group (78%, or 7 of 9 participants), and there were no group differences in the secondary outcomes. However, a limitation of the study is that the interval between the end of treatment and the primary endpoint was 40 weeks in the intensive group and no weeks in the distributed group. Important differences may have emerged at the primary or secondary endpoints if the retention interval had been controlled between groups. Nevertheless, while it is clear participants in each type of schedule demonstrated meaningful change from treatment, there appeared to be no additional benefit from massing the treatment within a short time period.

In Harnish, Neils-Strunjas, Lamy, and Eliassen (2008), one person with aphasia was administered treatment focusing on naming, sentence production and written production first in an intensive treatment phase followed by a distributed treatment phase. The intensive schedule involved 5 treatment sessions per week for 2 weeks and the distributed schedule involved 2 sessions per week for 7.5 weeks. The primary outcome was performance on the Boston Naming Test (Kaplan, Goodglass, & Weintraub, 1983) administered at an unspecified interval after each treatment phase. The study reported numerically greater gains on the Boston Naming Test (i.e., 3 more items) over the first treatment phase (shorter lags) compared to the second phase (longer lags). However, inferential statistics were not applied to test significant differences between the phases and the case study design precludes distinguishing the effects of treatment schedule from the effects of the order of the two conditions.

Mozeiko, Coelho, and Myers (2016) delivered constraint induced language therapy in an intensive or distributed schedule, with four participants per schedule. In the intensive schedule, participants engaged in 3 hour sessions 5 days a week for 2 weeks. In the distributed schedule, participants engaged in therapy 1 hour per session, 3 days a week for 10 weeks. The primary outcome was change in discourse production measures with statistics focusing on participant-specific effect sizes of change from baseline to final probes during treatment (standardized mean difference; see section 2.1 for discussion of limitations of this approach). The small size of the participant groups (n=4 per group) and treatment response heterogeneity rendered the results difficult to interpret. Some participants in both groups showed language improvements, but there were no clear differences in outcomes between the two schedules of treatment.

In Dignam et al. (2015), participants were non-randomly assigned to an intensive or a distributed treatment schedule that involved a variety of types of treatments (e.g., word-retrieval treatment; functional-communication training; group therapy) but the same number of hours per type. In the intensive treatment schedule, 48 hours of treatment were administered over 3 weeks, compared to 48 hours administered over 8 weeks in the distributed treatment schedule. Treatment outcomes were assessed immediately after treatment and after one month. On the primary outcome measure of naming ability measured by the Boston Naming Test (Kaplan et al., 1983), the distributed group showed significantly greater improvement compared to the intensive group both immediately after treatment and after one month. However, in a post-hoc analysis of a subset of participants in Dignam et al. (2015), Dignam et al. (2016a) reported similar gains in the intensive and distributed groups in naming performance on items that were practiced during treatment as well as untreated items. Thus, the effect of schedule on generalized improvement on naming ability was inconsistent across the two studies. Lastly, in Dignam et al. (2015), the intensive and distributed groups showed similar gains on ratings of functional communication, communication confidence, and communication-related quality of life.

2.3. Literature Review Summaries and Clinical Implications

We now briefly summarize the findings of the studies reviewed in section 2.1 and 2.2 as they relate to the distributed practice principles (section 1.4; Table 1), and we consider clinical implications of the findings. Starting with the naming treatment literature (section 2.1), two studies reported spacing effects (Principle 1). After one session of training, Middleton et al. (2016) found that spaced presentation of items’ trials compared to massed presentation enhanced naming accuracy one day and one week post-treatment. After four sessions of training, Middleton et al. (in press) found that spaced presentation of items’ trials compared to massed presentation enhanced naming accuracy one week post-treatment, with a strong trend for a similar advantage at one month. Regarding Principle 2, Middleton et al. (2016) found that the benefits from retrieval practice naming training were enhanced when administered at longer lags within a session. One study (Schuchard et al., 2019) examined the benefit of administering the trials for items within a single session versus across sessions and found robust, superior performance after across-session compared to within-session training (Principle 3). Thus, the results across studies support the recommendation for spaced rather than massed presentation, greater lag between items’ trials within a session, and distribution of items’ trials across multiple sessions rather than in a single session for robust and durable improvements in the naming of treated vocabulary in people with aphasia. It will be important in future work to examine possible boundary conditions to this recommendation. For example, future work could explore applicability of these principles to people with aphasia from across the range of severity of naming impairment and accompanying deficits (e.g., executive control dysfunction; apraxia of speech) or to treatment targets of other types (e.g., verbs; modified noun phrases).

Regarding Principle 4, four naming treatment studies manipulated the lag between sessions (intersession lag). A relatively restricted range of lags was contrasted in Ramsberger and Marie (2007; i.e., 2 versus 5 sessions per week) and in Raymer et al. (2006; 1–2 sessions per week versus 3–4 sessions per week). These two studies showed little difference between the two conditions in terms of performance attained during treatment, whereas there were patterns of retention consistent with more persistent benefits for the longer lag condition. Using a more powerful manipulation of lag (i.e., 1 versus 7 days), Sage et al. (2011) found a significant advantage of longer versus shorter intersession lag at follow-up, and Schuchard et al. (2019) found a trend bordering on statistical significance favoring the longer intersession lag condition after one month.

Thus, effects of intersession lag were not consistently documented across the reviewed naming treatment studies. However, the psychological literature suggests the benefits of increasing lag are generally more apparent after training rather than during acquisition (e.g., Cepeda et al., 2006). It will be important in future treatment studies examining the effects of intersession lag to examine performance on a final retention test administered after a delay as a primary outcome (e.g., Sage et al., 2011; Schuchard et al., 2019) as opposed to focusing on performance during treatment as in Ramsberger and Marie (2007) and Raymer et al. (2006). A broader implication of the timing of measurement of distributed practice effects for clinical practice relates to a pervasive focus by clinicians and insurers on performance during treatment sessions. People with aphasia may be better served by schedules and methods of treatment that lead to sub-optimal performance during treatment in order to capitalize on distributed practice principles for maximizing sustained, long-term improvements.

In the review of studies of other language treatments in the intensity literature (section 2.2), four studies examined outcomes after treatment that was delivered with shorter versus longer intersession lags (Principle 4). In Martins et al. (2013), Harnish et al. (2008), and Mozeiko et al. (2016), there was little difference in outcomes following shorter versus longer intersession lags. However, each study exhibited limitations such as low numbers of observations contributing to key statistical contrasts and failure to equate retention intervals between groups (Martins et al.), possibility of order effects (Harnish et al.), and interpretational difficulties that accompany the use of single-case statistical indices (Harnish et al.; Mozeiko et al.; see section 2.1). Dignam et al. (2015) reported a significant advantage in their primary outcome (naming performance) after treatment delivered with longer compared to shorter intersession lags immediately after post-treatment and at follow-up. However, there was little difference between schedules regarding secondary outcomes, and a post-hoc analysis of naming performance for items administered for treatment and untreated items reflected no effect of schedule (Dignam et al., 2015). In summary, the review of other language treatment studies provided no evidence to suggest that longer treatment sessions and shorter intersession lags were more efficacious than shorter sessions and longer intersession lags.

Regarding the issue of intersession lag for either naming or other language treatment, a pragmatic consideration may be that if more distributed treatment schedules are at least equally effective as the minimized spacing of intensive schedules, then clinicians and patients could avoid the fatigue and other difficulties that clinicians have reported to be associated with the implementation of high-intensity aphasia treatment (Gunning et al., 2017). An additional pragmatic consideration regarding intersession lag concerns the defined timeframe of delivery of speech-language treatment. For example, if insurance providers define time in therapy as a limited term (e.g., 3 months), more therapy sessions at the expense of shorter intersession lags is probably to be preferred for maximizing treatment gains. If, however, limits are set on the number of sessions, the clinician may as well spread out the sessions over a longer period of time because none of the controlled studies we reviewed reported a cost in doing so.

3. Future Directions

Research on formal application of principles of distributed practice to aphasia treatment is in its infancy. There is a great need for further research to advance an understanding of the full clinical applicability of distributed practice principles to the treatment of aphasia. One important goal in future research may be to examine whether distributed practice principles have implications for generalized performance (e.g., to untrained items; to overlapping but non-identical processes). Interestingly, there is an emerging literature showing that distributed practice manipulations can increase generalization defined as abstraction across learning events and application to new contexts. Such effects have been found in the learning of scientific concepts (e.g., Gluckman, Vlach, & Sandhofer, 2014) and natural categories (e.g., Wahlheim, Dunlosky, & Jacoby, 2011) as well as mathematical problem solving (e.g., Hopkins, Lyle, Hieb, & Ralston, 2016). In light of these findings, productive lines of aphasia research may involve examination of whether applying distributed practice principles enhances generalization in language abilities in aphasia, particularly in forms of treatment that show theoretically-grounded and robust generalization (e.g., Des Roches et al., 2016; Kiran, 2008; Thompson, Shapiro, Kiran & Sobecks, 2003).

It will also be important in future work to delineate how distributed practice principles impact language-based processes/representations specifically, as the preponderance of distributed practice studies have focused on novel knowledge or skill acquisition. Some studies in this review (e.g., Middleton et al., 2016; in press; Schuchard et al., 2019) have found applicability of distributed practice principles to lexical access for premorbid vocabulary in aphasia. Additional findings in the distributed practice literature point to relevance to language, such as observations of benefits of distributed practice for the learning of grammatical rules in neurotypical speakers (Bird, 2010; Miles, 2014).

Lastly, it will be important in studies on intensity of treatment to consider distributed practice principles when designing future experiments or trials. Such studies should equate the amount of treatment across schedules, hold the type of treatment constant, and also contrast intersession lags of greater difference than has typically been done. It may also be prudent to consider treatment designs that capitalize on methods that produce high-impact learning effects in the distributed practice literature. For example, although few in number, cognitive psychology studies that tested participants multiple months after training suggest that implementing a long lag (e.g., one month or longer) between initial training and at least one re-training session promotes the maintenance of gains over long retention intervals (Bahrick et al., 1993; Carpenter, Pashler, & Cepeda, 2009; Cepeda et al., 2008, 2009), which is an important goal in applied training settings. A possible treatment strategy in line with these findings would be the addition of at least one “refresher” session administered at a long lag after the initial period of treatment to promote long-term maintenance of gains. In addition, as demonstrated in neurotypical learners (e.g., Rawson et al., 2018; Vaughn et al., 2016) and shown to hold in aphasia (Schuchard et al., 2019), increasing the number of sessions spaced over time strongly enhances learning, whereas increasing the amount of training within the initial training session has relatively weak effects. If similar principles apply to naming or other types of language treatment, language recovery could be enhanced by distributing the amount of treatment dedicated to a specific item or a specific training exercise over more sessions on separate days. Research designed to test these new directions has strong potential to promote persistent learning of trained words, and possibly maximize recovery in other language domains, for people with aphasia.

Conflicts of Interest and Source of Funding

This work was supported by a National Institutes of Health award (R01 DC015516-01A1 to Erica Middleton). Julia Schuchard’s effort was supported by a National Institutes of Health postdoctoral fellowship (T32 HD071844 to John Whyte). The authors have no other financial or nonfinancial relationships to disclose.

Footnotes

1

Values of percent of retained treatment benefits that exceed 100 indicate performance was higher at follow-up compared to during treatment.

REFERENCES

  1. Bahrick HP, Bahrick LE, Bahrick AS, & Bahrick PE (1993). Maintenance of foreign language vocabulary and the spacing effect. Psychological Science, 4(5), 316–321. [Google Scholar]
  2. Bakheit AMO, Shaw S, Barrett L, Wood J, Carrington S, Griffiths S, et al. (2007). A prospective, randomized, parallel group, controlled study of the effect of intensity of speech and language therapy on early recovery from poststroke aphasia. Clinical Rehabilitation, 21(10), 885–894. [DOI] [PubMed] [Google Scholar]
  3. Barthel G, Meinzer M, Djundja D, & Rockstroh B (2008). Intensive language therapy in chronic aphasia: Which aspects contribute most? Aphasiology, 22(4), 408–421. [Google Scholar]
  4. Beeson PM, & Robey RR (2006). Evaluating single-subject treatment research: Lessons learned from the aphasia literature. Neuropsychological Review, 16(4), 161–169. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Berthier ML, Dávila G, Green-Heredia C, Moreno Torres I, Juárez y Ruiz de Mier R, De-Torres I, & Ruiz-Cruces R (2014). Massed sentence repetition training can augment and speed up recovery of speech production deficits in patients with chronic conduction aphasia receiving donepezil treatment. Aphasiology, 28(2), 188–218. [Google Scholar]
  6. Bird S (2010). Effects of distributed practice on the acquisition of second language English syntax. Applied Psycholinguistics, 31(04), 635–650. [Google Scholar]
  7. Breitenstein C, Grewe T, Flöel A, Ziegler W, Springer L, Martus P, et al. (2017). Intensive speech and language therapy in patients with chronic aphasia after stroke: A randomised, open-label, blinded-endpoint, controlled trial in a health-care setting. The Lancet, 389(10078), 1528–1538. [DOI] [PubMed] [Google Scholar]
  8. Busk PL, & Serlin RC (1992). Meta-analysis for single case research. In Kratochwill TR & Levin JR (Eds), Single-case research design and analysis: New directions for psychology and education. Hillsdale, NJ: Lawrence Erlbaum Associates. [Google Scholar]
  9. Carpenter SK, Pashler H, & Cepeda NJ (2009). Using tests to enhance 8th grade students’ retention of U.S. history facts. Applied Cognitive Psychology, 23(6), 760–771. [Google Scholar]
  10. Cepeda NJ, Coburn N, Rohrer D, Wixted JT, Mozer MC, & Pashler H (2009). Optimizing distributed practice. Experimental Psychology, 56(4), 236–246. [DOI] [PubMed] [Google Scholar]
  11. Cepeda NJ, Pashler H, Vul E, Wixted JT, & Rohrer D (2006). Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychological Bulletin, 132(3), 354–380. [DOI] [PubMed] [Google Scholar]
  12. Cepeda NJ, Vul E, Rohrer D, Wixted JT, & Pashler H (2008). Spacing effects in learning: a temporal ridgeline of optimal retention. Psychological Science, 19(11), 1095–1102. [DOI] [PubMed] [Google Scholar]
  13. Cherney LR (2012). Aphasia treatment: Intensity, dose parameters, and script training. International Journal of Speech-Language Pathology, 14(5), 424–431. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Crinion JT, & Leff AP (2015). Using functional imaging to understand therapeutic effects in poststroke aphasia. Current Opinion in Neurology, 28(4), 330–337. [DOI] [PubMed] [Google Scholar]
  15. Delaney PF, Verkoeijen PPJL, & Spirgel A (2010). Spacing and testing effects: A deeply critical, lengthy, and at times discursive review of the literature. Psychology of Learning and Motivation, 53, 63–147. [Google Scholar]
  16. Dell GS, Schwartz MF, Martin N, Saffran EM, & Gagnon DA (1997). Lexical access in aphasic and nonaphasic speakers. Psychological Review, 104(4), 801–838. [DOI] [PubMed] [Google Scholar]
  17. Des Roches CA, Vallila-Rohter S, Villard S, Tripodis Y, Caplan D, et al. (2016). Evaluating treatment and generalization patterns of two theoretically motivated sentence comprehension theories. American Journal of Speech-Language Pathology, 25(4), S743–S757. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Dignam JK, Copland D, McKinnon E, Burfein P, O’Brien K, & Farrell A et al. (2015). Intensive versus distributed aphasia therapy: A nonrandomized, parallel-group, dosage-controlled study. Stroke, 46(8), 2206–2211. [DOI] [PubMed] [Google Scholar]
  19. Dignam JK, Copland D, Rawlings A, O’Brien K, Burfein P, & Rodriguez AD (2016a). The relationship between novel word learning and anomia treatment success in adults with chronic aphasia. Neuropsychologia, 81, 186–197. [DOI] [PubMed] [Google Scholar]
  20. Dignam JK, Rodriquez AD, & Copland DA (2016b). Evidence for intensive aphasia therapy: Consideration of theories from neuroscience and cognitive psychology. PM&R, 8, 254–267. [DOI] [PubMed] [Google Scholar]
  21. Dunlosky J, Rawson KA, Marsh EJ, Nathan MJ, & Willingham DT (2013). Improving students’ learning with effective learning techniques. Psychological Science in the Public Interest, 14(1), 4–58. [DOI] [PubMed] [Google Scholar]
  22. Fridriksson J, Moser D, Bonilha L, Morrow-Odom KL, Shaw H, Fridriksson A, et al. (2007). Neural correlates of phonological and semantic-based anomia treatment in aphasia. Neuropsychologia, 45(8), 1812–1822. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Friedman RB, Sullivan KL, Snider SF, Luta G, & Jones KT (2017). Leveraging the test effect to improve maintenance of the gains achieved through cognitive rehabilitation. Neuropsychology, 31(2), 220–228. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Gluckman M, Vlach HA, & Sandhofer CM (2014). Spacing simultaneously promotes multiple forms of learning in children’s science curriculum. Applied Cognitive Psychology, 28(2), 266–273. [Google Scholar]
  25. Goodglass H, & Wingfield A (1997). Anomia: Neuroanatomical & Cognitive Correlates. San Diego: Academic Press. [Google Scholar]
  26. Gunning D, Wenke R, Ward EC, Chalk S, Lawrie M, Romano M, et al. (2017). Clinicians’ perceptions of delivering new models of high intensity aphasia treatment. Aphasiology, 31(4), 406–426. [Google Scholar]
  27. Harnish SM, Neils-Strunjas J, Lamy M, & Eliassen JC (2008). Use of fMRI in the study of chronic aphasia recovery after therapy: a case study. Topics in Stroke Rehabilitation, 15(5), 468–483. [DOI] [PubMed] [Google Scholar]
  28. Hinckley JJ, & Craig HK (1998). Influence of rate of treatment on the naming abilities of adults with chronic aphasia. Aphasiology, 12(11), 989–1006. [Google Scholar]
  29. Hinckley J, & Carr T (2005). Comparing the outcomes of intensive and non-intensive context-based aphasia treatment. Aphasiology, 19(10–11), 965–974. [Google Scholar]
  30. Hopkins RF, Lyle KB, Hieb JL, & Ralston PAS (2016). Spaced retrieval practice increases college students’ short- and long-term retention of mathematics knowledge. Educational Psychology Review, 28(4), 853–873. [Google Scholar]
  31. Kaplan E, Goodglass H, & Weintraub S (1983). Boston Naming Test (2nd ed.). Philadelphia, PA: Lea and Febriger. [Google Scholar]
  32. Kiran S (2008). Typicality of inanimate category exemplars in aphasia treatment: Further evidence for semantic complexity. Journal of Speech, Language, and Hearing Research, 51(6), 1550–1568. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Kleim JA, & Jones TA (2008). Principles of experience-dependent neural plasticity: Implications for rehabilitation after brain damage. Journal of Speech, Language, and Hearing Research, 51(1), S225–15. [DOI] [PubMed] [Google Scholar]
  34. Kornell N (2009). Optimising learning using flashcards: Spacing is more effective than cramming. Applied Cognitive Psychology, 23, 1297–1317. [Google Scholar]
  35. Lauterbach M, Martins IP, Garcia P, Cabec AJ, Ferreira AC, & Willmes K (2008). Cross linguistic aphasia testing: The Portuguese version of the Aachen Aphasia Test (AAT). Journal of the International Neuropsychological Society, 14 (6), 1046–1056. [DOI] [PubMed] [Google Scholar]
  36. Lee JB, & Cherney LR (2018). Tau-U: A quantitative approach for analysis of single-case experimental data in aphasia. American Journal of Speech-Language Pathology, 27, 495–503. [DOI] [PubMed] [Google Scholar]
  37. Martins IP, Leal G, Fonseca I, Farrajota L, Aguiar M, Fonseca J, et al. (2013). A randomized, rater-blinded, parallel trial of intensive speech therapy in sub-acute poststroke aphasia: the SP-I-R-IT study. International Journal of Language & Communication Disorders, 48(4), 421–431. [DOI] [PubMed] [Google Scholar]
  38. Meinzer M, Elbert T, Wienbruch C, Djundja D, Barthel G, & Rockstroh B (2004). Intensive language training enhances brain plasticity in chronic aphasia. BMC Biology, 2, 20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Middleton EL, Rawson KA, & Verkuilen J (in press). Retrieval practice and spacing effects in multi-session treatment of naming impairment in aphasia. Cortex. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Middleton EL, Schwartz MF, Rawson KA, & Garvey K (2015). Test-enhanced learning versus errorless learning in aphasia rehabilitation: Testing competing psychological principles. Journal of Experimental Psychology: Learning, Memory, and Cognition, 41(4), 1253–1261. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Middleton EL, Schwartz MF, Rawson KA, Traut H, & Verkuilen J (2016). Towards a theory of learning for naming rehabilitation: Retrieval practice and spacing effects. Journal of Speech, Language, and Hearing Research, 59(5), 1111–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Miles SW (2014). Spaced vs. massed distribution instruction for L2 grammar learning. System, 42, 412–428. [Google Scholar]
  43. Mirman D, & Brit A (2014). What we talk about when we talk about access deficits. Philosophical Transactions of the Royal Society B, 369, 20120388. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Mozeiko J, Coelho CA, & Myers EB (2016). The role of intensity in constraint-induced language therapy for people with chronic aphasia. Aphasiology, 30(4), 339–363. [Google Scholar]
  45. Pulvermüller F, & Berthier ML (2008). Aphasia therapy on a neuroscience basis. Aphasiology, 22(6), 563–599. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Pulvermüller F, Neininger B, Elbert T, Mohr B, Rockstroh B, Koebbel P, & Taub E (2001). Constraint-induced therapy of chronic aphasia after stroke. Stroke: A Journal of Cerebral Circulation, 32(7), 1621–1626. [DOI] [PubMed] [Google Scholar]
  47. Pyc MA, & Rawson KA (2012). Why is test-restudy practice beneficial for memory? An evaluation of the mediator shift hypothesis. Journal of Experimental Psychology: Learning, Memory, and Cognition, 38, 737–746. [DOI] [PubMed] [Google Scholar]
  48. Ramsberger G, & Marie B (2007). Self-administered cued naming therapy: a single-participant investigation of a computer-based therapy program replicated in four cases. American Journal of Speech-Language Pathology, 16(4), 343–358. [DOI] [PubMed] [Google Scholar]
  49. Rapp B, & Goldrick M (2000). Discreteness and interactivity in spoken word production. Psychological Review, 107(3), 460–499. [DOI] [PubMed] [Google Scholar]
  50. Rawson KA, & Dunlosky J (2011). Optimizing schedules of retrieval practice for durable and efficient learning: How much is enough? Journal of Experimental Psychology: General, 140(3), 283–302. [DOI] [PubMed] [Google Scholar]
  51. Rawson KA, Vaughn KE, Walsh M, & Dunlosky J (2018). Investigating and explaining the effects of successive relearning on long-term retention. Journal of Experimental Psychology: Applied, 24(1), 57–71. [DOI] [PubMed] [Google Scholar]
  52. Raymer AM, Beeson P, Holland A, Kendall D, Maher LM, Martin N, et al. (2008). Translational research in aphasia: From neuroscience to neurorehabilitation, Journal of Speech, Language, and Hearing Research, 51(1), S259–S275. [DOI] [PubMed] [Google Scholar]
  53. Raymer AM, Kohen FP, & Saffell D (2006). Computerised training for impairments of word comprehension and retrieval in aphasia. Aphasiology, 20(2–4), 257–268. [Google Scholar]
  54. Rodriguez A, Worrall L, Brown K, Grohn B, McKinnon E, & Pearson C, et al. (2013). Aphasia LIFT: Exploratory investigation of an intensive comprehensive aphasia programme. Aphasiology. 27, 1339–1361. [Google Scholar]
  55. Rowland CA (2014). The effect of testing versus restudy on retention: A meta-analytic review of the testing effect. Psychological Bulletin, 140(6), 1432–1463. [DOI] [PubMed] [Google Scholar]
  56. Sage K, Snell C, & Lambon Ralph MA (2011). How intensive does anomia therapy for people with aphasia need to be? Neuropsychological Rehabilitation, 21(1), 26–41. [DOI] [PubMed] [Google Scholar]
  57. Sandberg CW, Bohland JW, & Kiran S (2015). Changes in functional connectivity related to direct training and generalization effects of a word finding treatment in chronic aphasia. Brain and Language, 150, 103–116. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Schmidt RA, & Bjork RA (1992). New conceptualizations of practice: Common principles in three paradigms suggest new concepts for training. Psychological Science, 3(4), 207–217. [Google Scholar]
  59. Schuchard J, & Thompson CK (2014). Implicit and explicit learning in individuals with agrammatic aphasia. Journal of Psycholinguistic Research, 43(3), 209–224. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Schuchard J, & Middleton EL (2018a). The roles of retrieval practice versus errorless learning in strengthening lexical access in aphasia. Journal of Speech, Language, and Hearing Research, 61(7), 1700–1717. [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Schuchard J, & Middleton EL (2018b). Word repetition and retrieval practice effects in aphasia: Evidence for use-dependent learning in lexical access. Cognitive Neuropsychology, 35(5–6), 271–287. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Schuchard J, Middleton EM, & Rawson KA (2019). Effects of distributed practice and criterion level on language recovery in aphasia. Manuscript submitted for publication. [DOI] [PMC free article] [PubMed] [Google Scholar]
  63. Schuell H, Carrol V, & Street B, (1955). Clinical treatment of aphasia. Journal of Speech and Hearing Disorders, 20, 43–53. [DOI] [PubMed] [Google Scholar]
  64. Thompson CK, Riley EA, Ouden, den D, Meltzer-Asscher A, & Lukic S (2013). Training verb argument structure production in agrammatic aphasia: Behavioral and neural recovery patterns. Cortex, 49(9), 2358–2376. [DOI] [PMC free article] [PubMed] [Google Scholar]
  65. Thompson CK, Shapiro LP, Kiran S, & Sobecks J (2003). The role of syntactic complexity in treatment of sentence deficits in agrammatic aphasia: The complexity account of treatment efficacy (CATE). Journal of Speech, Language, and Hearing Research, 46(3), 591–607. [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Toppino TC, & Gerbier E (2014). About practice: Repetition, spacing, and abstraction. Psychology of Learning and Motivation, 60, 63–147. [Google Scholar]
  67. Tuomiranta LM, Càmara E, Froudist Walsh S, Ripollés P, Saunavaara JP, Parkkola R, et al. (2014). Hidden word learning capacity through orthography in aphasia. Cortex, 50, 174–191. [DOI] [PMC free article] [PubMed] [Google Scholar]
  68. Vallila-Rohter S (2017). Considering learning ability in language rehabilitation plans. Perspectives of the ASHA Special Interest Groups, 2(2), 23–30. [Google Scholar]
  69. Vallila-Rohter S, & Kiran S (2013). Non-linguistic learning and aphasia: Evidence from a paired associate and feedback-based task. Neuropsychologia, 51(1), 79–90. [DOI] [PMC free article] [PubMed] [Google Scholar]
  70. Vaughn KE, Dunlosky J, & Rawson KA (2016). Effects of successive relearning on recall: Does relearning override the effects of initial learning criterion? Memory & Cognition, 44(6), 897–909. [DOI] [PubMed] [Google Scholar]
  71. Wahlheim CN, Dunlosky J, & Jacoby LL (2011). Spacing enhances the learning of natural concepts: an investigation of mechanisms, metacognition, and aging. Memory & Cognition, 39(5), 750–763. [DOI] [PMC free article] [PubMed] [Google Scholar]
  72. Walker GM, & Hickok G (2016). Bridging computational approaches to speech production: The semantic-lexical-auditory-motor model (SLAM). Psychonomic Bulletin & Review, 23(2), 339–352. [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. Warren SF, Fey ME, & Yoder PJ (2007). Differential treatment intensity research: A missing link to creating optimally effective communication interventions. Mental Retardation and Developmental Disabilities Research Reviews, 13(1), 70–77. [DOI] [PubMed] [Google Scholar]
  74. Wilshire CE (2008). Cognitive neuropsychological approaches to word production in aphasia: Beyond boxes and arrows. Aphasiology, 22(10), 1019–1053. [Google Scholar]

RESOURCES