Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2023 Jan 24.
Published in final edited form as: J Learn Disabil. 2010 May 5;45(2):99–127. doi: 10.1177/0022219409355472

Multiple-Component Remediation for Developmental Reading Disabilities: IQ, SES, and Race as Factors in Remedial Outcome

Robin D Morris 1, Maureen W Lovett 2, Maryanne Wolf 3, Rose A Sevcik 4, Karen A Steinbach 5, Jan C Frijters 6, Marla Shapiro 7
PMCID: PMC9872281  NIHMSID: NIHMS1622202  PMID: 20445204

Abstract

Results from a controlled evaluation of remedial reading interventions are reported: 279 young disabled readers were randomly assigned to a program according to a 2×2×2 factorial design (IQ, SES, and race). The effectiveness of two multiple-component intervention programs for children with RD [PHAB +RAVE-O (Wolf, Miller, & Donnelly, 2000); PHAST Reading Program (Lovett, Lacerenza, & Borden, 2000)] were evaluated against alternative (CSS, MATH) and phonological control programs. Interventions were taught an hour daily for 70 days on a 1:4 ratio at 3 different sites. Multiple-component programs showed significant improvements relative to control programs on all basic reading skills after 70 hours and at one-year follow-up. Equivalent gains were observed for different racial, SES, and IQ groups. These factors did not systematically interact with program. Differential outcomes for word identification, fluency, comprehension, and vocabulary were found between the multidimensional programs, although equivalent long-term outcomes and equal continued growth confirmed that different pathways exist to effective reading remediation.


The prevalence of reading acquisition failure in the US school-age population continues to be a major social and political concern. Although improvements have been observed since the nation’s original 1992 report card, the National Assessment of Educational Progress [NAEP] in 2007 estimated that 34% of 4th grade children are significantly below average in reading skills (US Department of Education: National Center for Education Statistics, 2007). When these figures are examined according to socioeconomic status (SES) and ethnic group, the results are even more troubling: 50% of children from low-income families read below a basic level, as opposed to 21% of higher-income children. By ethnic group, 54% of children who are African-American, 51% of children who are Hispanic, and 23% of children who are European-American read below the basic level on the NAEP.

If unresolved, the problem of reading acquisition failure will limit the future potential of more than 10 million American youth (National Reading Panel (NRP)—Report of the Subgroups, 2000; Snow, 2002). If the above trends continue, there will be an ever-expanding academic gap according to SES and ethnic grouping. In this paper, we evaluate the efficacy of three reading intervention programs with a particular interest in assessing response to intervention by young impaired readers who differ in race, IQ, and SES.

Developmental reading disability (RD) is a term applied to those children who unexpectedly fail to learn to read, whether defined on the basis of significant reading underachievement or relative to expectations based on IQ, age, or grade-level (Fletcher, Morris, & Lyon, 2003). Recently, there has been an increasing number of well controlled research reports that have focused upon critical components for the effective remediation of children with RD, and of those at-risk for not acquiring fluent reading skills and good reading comprehension. Progress has been achieved in identifying the critical components of effective early reading instruction (Rayner, Foorman, Perfetti, Pesetsky, & Seidenberg, 2001), particularly for teaching basic literacy skills. Although much remains to be investigated regarding the instruction and measurement of higher-order reading fluency and comprehension skills, (Biancorosa & Snow, 2006; NRP, 2000), considerable recent progress has been made in this area as well, particularly for children within the range of normal reading development (Guthrie et al., 2007, 2004; Wigfield et al., 2008; Williams, 2005; Williams et al., 2005, 2007). Issues related to teaching higher-order reading skills to children with reading disabilities have been discussed in recent years (Johnston, Barnes, & Desrochers, 2008; Gersten, Fuchs, Williams, & Baker, 2001).

Much of the early intervention work on reading disabilities investigated disabled readers of average IQ and socioeconomic status (SES). Decades of reliance on IQ-achievement discrepancies in identifying children with RD resulted in the relative exclusion of children with lower IQs and significant reading underachievement from research. Despite increasing recognition that IQ and the IQ-achievement discrepancy do not reliably discriminate children who will respond well to reading intervention (Shaywitz, Morris, & Shaywitz, 2008; Stage, Abbott, Jenkins, & Berninger, 2003; Vellutino, Scanlon, & Lyon, 2000), an implicit assumption persists that children without the advantages of an average to above-average IQ and access to an enriched environment will not respond to the verbally-mediated interventions that are effective with struggling readers of average IQ and SES.

Post hoc analyses of early intervention outcomes for 128 at-risk first-graders revealed that Verbal IQ was a minor contributor to word identification skills relative to specific reading-related language predictors like phonological processing, rapid naming, and orthographic skills (Stage et al., 2003). Indeed, ratings for attention provided greater prediction power than Verbal IQ in this analysis. This study identified three language-related processing deficits that characterized at-risk children in different combinations: deficits in phonological processing skills, slow rapid naming, and deficient orthographic processing skills. Those at-risk children with two or three of these language-processing deficits did not grow as quickly in varied reading skills as at-risk children with relatively intact language skills. Any of these processing deficits was sufficient to slow the growth of word identification skills in intervention, regardless of the child’s IQ at entry (Stage et al., 2003).

Other studies confirm that first graders with and without reading achievement/IQ discrepancies do not show a differential response to early intervention (Vellutino et al., 1996). Similarly, longitudinal data from Francis, Shaywitz, Steubing, Shaywitz, and Fletcher (1996) revealed no real differences in rate of reading growth among Grades 1–9 students, whose reading achievement was and was not discrepant from IQ. To date, however, the relative contributions of IQ and demographic variables like SES and race have never been studied prospectively in a balanced factorial design to determine their relevance in predicting reading intervention outcomes.

Results from three decades of research describe a small set of core deficits in language development and in more global processing abilities that appear consistently associated with reading disabilities, particularly the most severe cases. A majority of children with developmental RDs are characterized by deficits in phonological processing that are demonstrated at both sublexical and lexical levels of processing. Such children exhibit a range of defining deficits in their explicit awareness of, and ability to manipulate, the sound structure of spoken words (Snowling & Hulme, 1993, 2005). Phonological difficulties are known to persist into adulthood for individuals with histories of RD (Shaywitz et al., 1999), and have led both to concerns about their amenability to remediation (e.g., Wagner, Torgesen, & Rashotte, 1994), and to incentives to conduct rigorous research on intervention and prevention for phonologically-based reading disabilities (Lyon & Moats, 1997).

A failure to acquire rapid, context-free, word identification skills appears to be a highly reliable indicator of most cases of severe RD (Fletcher, Lyon, Fuchs, & Barnes, 2007). Results from some intervention studies suggest that a failure to parse a syllable into sub-syllabic units may underlie the difficulties in acquiring an alphabetic decoding strategy and in developing stable word identification and attack skills (Lovett, Warren-Chaplin, Ransby, & Borden, 1990). Because these children do not spontaneously segment spoken syllables into smaller units, they have no basis for i) segmenting orthographic (spelling) patterns corresponding to these units; ii) extracting rules for their synthesis; or iii) using them to decode a new word by analogy to a known word (Gaskins, Downer, & Gaskins, 1986; Lovett et al., 1994). Such deficits in word recognition processes are also thought to contribute to many forms of poor comprehension (Fletcher et al., 2007; Perfetti, 1992).

Many impaired readers are also characterized by deficits in naming speed and a profile of reading comprehension and fluency problems (Wolf, 2007). Extensive evidence from different paradigms and a growing number of languages now suggests that naming-speed deficits (NSD) may represent a second core deficit in reading disability. Some researchers have described naming speed problems as largely independent of phonological skills (Clarke, Hulme, & Snowling, 2005; McBride-Chang & Manis, 1996; Wolf & Bowers, 1999), and more predictive of RD than phoneme awareness in transparent and logosyllabic orthographies (L.H. Tan, Spinks, Eden, Perfetti, & Siok, 2005). Other researchers have contended that naming speed deficits are related to central phonological processing deficits (Compton, DeFries, & Olson, 2001; Schatschneider, Carlson, Francis, Foorman, & Fletcher, 2002; Vukovic & Siegel, 2006; Wagner et al., 1997).

Regardless of their independence, naming speed deficits may be related to problems of dysfluency at several possible levels of print-to-speech mapping. Wolf and Bowers (1999, 2000) describe three potentially interrelated ways in which deficits in the processes underlying letter-naming speed may contribute to word-reading speed problems and to reading acquisition failure: i) by slowing and/or preventing the development and amalgamation of rapid connections between and among orthographic, phonological, and semantic processes at sublexical and word levels (Ehri, 1997); ii) by limiting the quality of representation of common orthographic patterns in memory (Bowers, Golden, Kennedy, & Young, 1994), and iii) by increasing the amount of repeated practice needed to form all types of high-quality representations involved in reading (Collins & Levy, 2008; Levy, 2001; Levy, Abello, & Lysynchuk, 1997). Wolf and Katzir-Cohen (2001) discuss reading fluency as a developing process that is shaped by contributions from phonological, orthographic, semantic, syntactic, and morphological processes. Recent work has highlighted the interdependence of fluency and comprehension growth in the development of reading skill (Collins & Levy, 2008; Klauda & Guthrie, 2008).

Another learning deficit, in strategy learning and executive functioning, is considered an important part of reading acquisition failure. Research with children with RD has produced several reports demonstrating particular difficulties in executive processing and the acquisition of self-regulatory strategies, and these problems appear to exist independent of their phonological processing difficulties (Swanson & Saez, 2003; Swanson & Siegel, 2001). These aspects of metacognitive function are important in the context of understanding children’s lack of transfer and generalization failures (Harris, Graham, & Pressley, 1992) during reading acquisition and reading remediation. It has been suggested that even when a child with RD has received strategy instruction, they may remain novices because they fail to transform simple strategies into more efficient forms (Swanson, Hoskyn, & Lee, 1999). Strategy acquisition, application, and self-monitoring are critical to acquisition of effective word identification and reading comprehension strategies. Strategy use and evaluation are components of reading development that become increasingly significant as the child acquires greater reading skill.

Remediating Core Deficits.

A number of well-controlled research studies have been reported focusing on the remediation of reading problems in the early elementary grades (Foorman, Francis, Fletcher, Schatschneider, & Mehta, 1998; Scanlon & Vellutino, 1997; Torgesen et al., 1999; Torgesen, Wagner, & Rashotte, 1997a; Vellutino, et al., 1996). Converging evidence indicates that significant improvement can be attained on speech-based and phonological reading measures (Foorman, et al., 1998; Lovett et al., 1994; Olson, Wise, Ring, & Johnson, 1997; Torgesen et al., 1999; Torgesen, Alexander, et al., 2001; Torgesen, Wagner, Rashotte, Alexander, & Conway, 1997; Vellutino et al., 1996), confirming that phonologically-based decoding and early reading skills are clearly “teachable aspects of reading for most children” (Moats & Foorman, 1997, p.188).

Despite the improvements observed in children’s phonologically-based word attack and decoding skills, training gains do not always generalize to word identification, text reading, fluency, and comprehension skills. In fact, generalization of remedial gains has proven a formidable hurdle (Lovett, Ransby, Hardwick, Johns, & Donaldson, 1989; Torgesen, Alexander et al., 2001; Torgesen, Wagner, Rashotte et al., 1997), particularly to long-term fluency and comprehension. Other research has characterized transfer-of-learning difficulties in RD as specific to printed language learning; they are not evident on other learning tasks with similar cognitive demands but no phonological processing requirements (Benson, 2000; Benson, Lovett, & Kroeber, 1997).

Torgesen, Wagner, and Rashotte (1997a) suggested that the generalization problem reflects the complexity of the processing impairments seen in more severely disabled readers.. In one of the most influential intervention studies to date, Torgesen et al. (1997a, 2001) found that poor readers made dramatically significant gains for phoneme awareness and word attack, but were essentially unchanged in fluency.

Many questions remain concerning whether or not processing-speed and fluency deficits are amenable to current treatment methods, and whether intervention should focus on connected-text, word-level, and/or underlying, sublexical-lexical processes (e.g., letter-pattern recognition). Some fluency training efforts have targeted the word level and have shown gains in connected text reading, fluency, and comprehension measures (Levy, 2001; A. Tan & Nicholson, 1997); but generally, addressing fluency at the sublexical and lower processing level has received relatively little attention. For years the assumption was that greater accuracy in alphabetic decoding would generalize to improved fluency; increasing evidence, however, failed to support this assumption (Torgesen, Rashotte, & Alexander, 2001).

Relatively more evidence is available regarding the effectiveness of remediation directed to the core deficit in strategy learning and metacognitive control. Meta-analyses have revealed that LD children are closer in performance to their non-disabled peers when intervention programs include explicit strategy instruction (Swanson et al., 1999). The strategy deficits of children at risk for reading acquisition failure encompass all aspects of reading for meaning, expository text comprehension, and written expression. There is growing recent evidence that low-achieving readers can make gains in reading comprehension with systematic instruction and practice on reading comprehension strategies (Mason, 2004; Vaughn et al., 2000). In fact, explicit strategy training and metacognitive instruction can provide an important component of effective remediation for RD in the acquisition of both decoding accuracy and reading comprehension skills.

Evidence from our Toronto site provides strong empirical support for this speculation (Lovett, Lacerenza, Borden, et al., 2000). When phonological reading interventions were combined with the teaching of specific word identification strategies, and these strategies were implemented, practiced, and evaluated using self-directing dialogue, severely disabled readers demonstrated superior outcomes and steeper learning curves than when they received an equal amount of intervention in phonological or strategy training conditions separately. The combined intervention conditions were associated with the greatest generalization of treatment gains for this sample of children with severe RD.

The assessments and interventions included in the present study address the multidimensional nature of reading skills and the heterogeneous profiles of disabled readers. Focus is placed on the need for multiple component interventions for RD, the need to remediate the core deficits that limit reading acquisition, and the importance of facilitating the development of word identification and decoding skills, reading fluency, and reading comprehension abilities. A multidimensional approach to the study of RD and its effective remediation was undertaken within a factorial design that addresses the following questions:

  1. Do multiple component remedial reading interventions produce greater gains than those targeting phonological reading processes alone?

  2. Do multiple component interventions with different metacognitive and language emphases differ from each other in their impact on reading growth and reading outcomes for children with RD?

  3. Do remedial outcomes and rate of growth differ for struggling readers who vary in socioeconomic status, race, and IQ?

  4. Do struggling readers demonstrate remedial growth on all dimensions of reading skill (decoding accuracy, reading rate, comprehension)?

  5. Are intervention-related gains maintained on one year follow-up?

Method

Study Overview

This study was a controlled evaluation of different reading remediation programs offered to children within public schools. Study participants included 2nd and 3rd grade children initially referred by their teachers. Selection was based upon a screening assessment using explicit criteria to define RD. The study design involved random assignment of small groups of struggling readers, and their teachers, to one of four remediation conditions. The factorial design of the study attempted to develop four randomly assigned groups of struggling readers, such that each group included equal numbers of Caucasian and Black students, of students with average or below average family socioeconomic situations, and of students with average or below average IQ. Groups of four children from each sample were taught one of four remedial programs (PHAB+CSS, MATH+CSS, PHAB+WIST (PHAST), PHAB+RAVE-O; conditions described below) by trained teachers for 70 contact hours during the school year. All children were evaluated at the beginning (0 hours), in the middle (35 hours), at the end of the 70 hours of instruction, and at one year follow-up.

Participants

Participants were initially recruited in three large metropolitan areas (Atlanta, Boston, and Toronto) on the basis of teacher identification as struggling readers. General inclusion criteria consisted of: English as a first and primary language, age between 78 months (6–6) and 102 months (8–6), grade level at 1st or 2nd grade at time of screening, and normal hearing and vision. Nine hundred fifty-nine children were referred (see Figure 1). Children were further selected from this pool based on their performance on a screening battery that included the Kaufmann Brief Intelligence Test (K-BIT; Kaufman & Kaufman, 1990), Woodcock Reading Mastery Test-Revised (WRMT-R; Woodcock, 1987), the Wide Range Achievement Test-3rd Edition (WRAT-3; Wilkinson, 1993), and a brief demographic and history form completed by their parents. Children were excluded if they had repeated a grade, achieved a K-BIT Composite score below 70, or had a serious psychiatric or neurological illness. The co-occurrence of a disorder common in RD populations (e.g., ADHD) did not exclude a child. The goal in excluding children who were repeating a grade was to control for the amount of previous educational experience of the children. In practice, however, this was not an issue because in every site, very few children referred to project were repeating a grade.

Figure 1.

Figure 1.

Subject screening, selection, attrition, and final sample that completed 70 hours of remediation.

1Out of 911 participants with K-BIT composite scores greater than 69 and from whom K-BIT and all screening reading scores were obtained. 2Plus 10 non-RD participants. 3 162 participants out of the 211 who completed 1 year of reading intervention (and not including MATH+CSS participants).

Socioeconomic Status (SES):

A parent/guardian was asked to complete a questionnaire that included basic demographic information used to evaluate socioeconomic status. SES data from all sites was derived using two American SES scales (Entwisle & Astone, 1994; Nakao & Treas, 1992) and one SES Canadian scale (Blishen, Carroll, & Moore, 1987; Edwards-Hewitt & Gray, 1995). Our goal was to develop an index for systematically identifying children's families as average to above average SES (classified as Average SES), or below average SES (Low SES). To this end, a systematic evaluation of the reliability and concordance of the different scales and their combination was undertaken and the results used to classify the children (see (Cirino et al., 2002). The particular differences or actual levels of SES provided by the scales were not as critical as an accurate ranking of children.

Selection Criteria for Inclusion in Remediation

Neither universally accepted nor universally validated criteria for defining samples or subtypes of RD children exist (Morris et al., 1998). The current study used a sampling strategy and measurement model that allowed for the objective testing of different conceptual (categorical vs. dimensional), definitional, and subtype models of RD, and comparison of the interaction of such classification results with treatment outcomes.

The K-BIT Composite Standard Score was used in screening as an index of intellectual ability, and reading levels were measured using one or more of the following indexes: (1) a Reading Total score calculated by averaging the standard scores of the WRMT-R Passage Comprehension, WRMT-R Word Identification, WRMT-R Word Attack, and WRAT-3 Reading subtests; (2) the WRMT-R Basic Skills Cluster Score; (3) and/or the WRMT-R Total Short Scale Score. These different options were used to increase the heterogeneity of the samples' reading profiles.

Children were included in the study if they met criteria for either a Low Achievement (LA) or an Ability-Achievement Regression Corrected Discrepancy (DISC) determination of a reading disability (RD) (Fletcher et al., 1994). The LA criteria required that a child's K-BIT Composite standard score was greater than 70, and at least one of their reading standard score indices was 85 (approx. the 16th % tile) or less. The DISC criteria required that at least one of the child's reading standard score indices was at least one standard error of the estimate (approximately 13 standard score points) below their regression-predicted reading score. This was calculated using the K-BIT Composite standard score and an average .60 correlation between the reading and IQ scores. This classification resulted in a broadly defined sample of children with reading problems.

Of the 958 referred children, 565 children met one of these inclusion criteria: 64% met both LA and DISC RD criteria, 8% met only the DISC criteria, and 28% met only the LA criteria. Consistent with previous findings, 72% met the DISC criteria, and 92% the LA criteria.

The study used a 2 X 2 X 2 factorial design, with Race (Caucasian, Black), IQ (Average - >90, Below Average - 70–90), and Socioeconomic Status (Average, Low) as critical sampling factors. The study attempted to obtain at least eight (n=8) children in each factorial cell (total n=64) for each of the four remediation program conditions (total study goal n=256). No site was allowed to provide more than 5 (of the 8) children in any cell in any remediation condition. The final number of participants from each of the three cities was nearly comparable, with Atlanta, Boston, and Toronto contributing 31%, 29%, and 39% of the sample, respectively. Both socioeconomic groups and IQ levels were fairly evenly represented in all three cities. Twice as many participants from Atlanta were Black vs. White, and the reverse pattern was evident in Toronto.

These criteria and sampling requirements resulted in 305 children who were enrolled in one of the four remediation groups, with 279 completing the 70 hours of remediation and relevant remediation-related evaluations. These 279 children are the focus of this report1. Table 1 describes the actual final sample for each condition, and the basic screening and pre-intervention results for each remediation sample.

Table 1.

Demographic Data of n = 279 who were included in growth models

Math + CSS
PHAB/DI + CSS
PHAB/DI + RAVE-O
PHAB/DI + WIST
ATL BOS TOR ATL BOS TOR ATL BOS TOR ATL BOS TOR

Total n 23 16 29 24 13 32 17 32 20 19 23 31
Average age (mos) at BL 94.56 96.76 92.46 94.32 95.02 91.17 93.84 92.48 89.80 94.02 97.29 93.45
Average IQ 89.09 93.00 91.24 89.29 95.08 90.68 89.94 96.55 87.05 88.47 96.61 90.57
IQ Std. Dev. 11.13 13.24 10.86 12.49 10.77 9.13 9.41 14.27 7.52 8.90 14.20 8.51
BL Reading Avg. 76.60 78.90 76.84 77.83 79.40 77.60 81.00 80.44 78.95 78.01 83.18 77.24
BL Reading Avg. Std. Dev. 9.89 8.08 9.48 9.91 9.39 7.46 5.07 7.54 5.73 8.81 9.02 6.27
Ethnicity
 Caucasion 6 11 17 5 9 21 4 11 17 6 8 21
 Black 17 4 12 19 4 10 12 4 12 13 10 9
SES
 Average 9 8 17 12 5 15 12 14 10 9 12 10
 Low 14 7 12 12 8 16 4 15 10 10 6 20
IQ
 Average 10 10 13 9 9 15 9 19 8 7 11 17
 Low 13 5 16 15 4 16 7 10 12 12 7 13

Note. IQ score = K-BIT Composite IQ. Reading Average = average of scores on WRMTR Word Attack, Word Identification, and Passage Comprehension and WRAT-3 Reading at baseline (BL).

Measures

Both nationally normed, standardized, and experimental measures were used (Cirino et al., 2002; Lombardino et al., 1999) to increase sensitivity in monitoring change. This battery was given before remediation began (time 0), immediately following 35 hours of remediation (time 35); at the end of 70 hours of remediation (time 70), and at one year follow-up. Because there was little information regarding the performance of young children with RD on these measures, we performed an extensive test-retest evaluation on a subsample of 78 children from the first year of this study to evaluate their reliability, the impact of practice effects, and their relationship to other related measures. These results, reported in detail in Cirino et al. (2002), indicated that overall test reliability for this group of impaired readers was good, practice effects were minimal, and the experimental and nationally-normed measures showed the expected relationships. Because of the extensiveness of the standardized and experimental evaluations conducted in this study, only results from the standardized, nationally normed reading measures will be reported here, although many of the experimental measures (see Cirino et al., 2002 for listing) showed similar findings.

Woodcock Reading Mastery Test - Revised (WRMT-R).

Three subtests of the WRMT-R (Form G; Woodcock, 1987) were used: non-contextual word reading (Word Identification), non-word decoding (Word Attack), and a cloze comprehension measure (Passage Comprehension). The Basic Skills Cluster Score is the composite of Word Identification and Word Attack; the Total Reading -Short Form is the composite of Word Identification and Passage Comprehension.

Wide Range Achievement Test - 3 (WRAT-3).

The WRAT-3 (Wilkinson, 1993) measures both individual letter identification and word reading (Reading), the writing of letters and words to dictation (Spelling), and the timed solving of oral and written mathematical problems (Arithmetic). The inclusion of this measure was partly to assist with assessing pre-achievement abilities, so as to help address floor effects on other measures for low performing children.

Reading Efficiency Test.

Word Reading Efficiency and Nonword Reading Efficiency (Torgesen, Wagner, & Rashotte, 1997b) were the research versions and predecessor of the Test of Word Reading Efficiency (TOWRE) (Torgesen, Wagner, & Rashotte, 1999). The Word Reading Efficiency measure included two lists of 104 real words (lists A & B) that increased in difficulty. The Nonword Reading Efficiency measure included two lists of 63 pronounceable nonwords (lists A & B). The mean number of words read on both forms in 45 seconds provided a measure of reading rate. Grade level normative data from the research version was used to compute standard scores (Torgesen, 1996).

Gray Oral Reading Test-III (Wiederholt & Bryant, 1992).

This is a test that requires the child to orally read paragraphs of increasing difficulty and then answer comprehension questions. Oral reading rate and accuracy are both evaluated. This measure was completed only at pre- (time 0) and post- (time 70) assessment points.

Teacher considerations.

Two of the most difficult features to control in reading intervention research are teacher background and consistency and quality of program implementation, which frequently interact. Moats (1994) has argued eloquently for the necessity of ensuring that all teachers meet an appropriate level of competence and for ongoing monitoring and feedback to ensure consistent quality of instruction. All teachers in this study were hired specifically to go into one or two schools in a city and provide any of the four instructional programs being evaluated. This helped to control for some of the teacher-specific variance in background and motivation that occurs when using a school’s own teachers, or when embedding teachers within only one intervention condition, thus allowing for a confound between teacher-specific and program-specific effects. The allocation of teachers to all instructional conditions allowed teachers to be based at a specific school and multiple instructional groups from that school to be randomly assigned to different conditions. Another rationale for having all teachers teach all four intervention programs was that three conditions were based on the same core component (PHAB/DI) which, when taught by the same teacher, would guarantee better consistency for that component, allowing the unique components of each of the intervention programs to better differentiate themselves. Concerns regarding cross- condition contamination are complex since the programs were designed to share half their components but also to have unique aspects built upon those shared components.

The teachers in the study were experienced and certified teachers, with a median of 7 years of teaching experience, and most teachers already having, or in the process of obtaining, graduate degrees in education. All were trained a priori to a level of specified competence during an intensive week-long training program held at the Toronto site and led by the developers of the intervention programs. Training activities included (i) an overview of current research related to reading development and reading disabilities, (ii) direct training of the each intervention and its components, (iii) practice followed by immediate feedback on the skills and strategies of the interventions, and (iv) questions and discussion. A senior research teacher at each site served as the Teacher Trainer/Mentor and provided ongoing monitoring and feedback on teachers’ performances. The Teacher Trainer visited the research classrooms a minimum of four times over the 70 hours to view and model lessons and to support the teachers. Independent review, feedback, and corrections were provided as needed. A series of independent videotaped evaluations were also conducted for all teachers to determine if the interventions were being carried out in the prescribed manner. All teachers from all sites, and the instructional program developers, were also part of a project list-serve that provided teachers the opportunity to ask the other teachers or program developers about handling specific instructional components or challenges. The list-serve ensured that all teachers across sites had consistent and timely information.

To increase implementation consistency and program integrity, each intervention program had a day-to-day, explicit Scope and Sequence plan that was followed by all teachers and that allowed for integrity monitoring. Each teacher completed a daily ‘teacher’s log’ which detailed their instructional activities for each lesson period based on the Scope and Sequence; at the end of each instructional period, teachers detailed what content they had completed that day, the children in attendance, children’s response to instruction, and any instructional or behavioral issues that impacted instruction during that period. The teacher logs were reviewed by project staff weekly to ensure adequate progress and integrity of program requirements. Random videotaped observations of the actual instructional lessons confirmed their accuracy. In addition, a senior/lead teacher at each site observed all teachers using an observational checklist 4–5 times during the 70 hours of instruction and provided specific implementation feedback to individual teachers to ensure that they were following the Scope and Sequence plans and instructional program expectations, that there was no cross-intervention program contamination, and that they were actively engaged in positive instructional activities with their students. All teachers were rated on a 5-point scale regarding their ability to follow the Scope and Sequence of the different programs and provide consistent instructional experiences for their groups of children. When evaluated, this rating did not account for significant variance in the remedial outcomes of study participants.

Any teacher unable to consistently and effectively provide the different instructional programs was observed more frequently, given more support and feedback, and if program implementation could not be achieved at expected levels, was discontinued on the project. Discontinuation happened only twice over the course of the project.

Any teacher could be randomly assigned to teach any of the four instructional programs to any of the randomly assigned groups in their city’s schools. Because of this, in our data analysis modeling, we included an “instructional group” factor that captured the systematic variance involved in a specific group of children with a specific teacher in a specific school. Unfortunately, given the sample sizes, number and types of groups taught by specific teachers, and more general design considerations, it was not possible to achieve a complete factorial design that could easily partition teacher or school effect variance from the results.

The rationale and outline of the teacher training and mentoring procedures used in all of our intervention research are described in detail in a recent publication (Lovett et al., 2008). Additional information on training and implementation of the RAVE-O Program components can be found in Wolf, Barzillai, Gottwald, Miller, Spencer, et al. (2009).

Remediation Program Design.

Subjects with similar single word reading levels (WRMT-R and WRAT-3 Reading raw scores) were assigned to an instructional group of four children, and these groups were randomly assigned to one of four intervention programs (see detailed descriptions below). Seventy treatment sessions were conducted within each program during the academic school year. Children were typically seen in a pull-out format for 60 minutes a day, five days a week. Because we were in multiple cities, school districts and schools, we allowed previous and current curriculum to vary randomly to better evaluate the generalizability of our specific program results.

The intervention design included five components (PHAB/DI, WIST, RAVE-O, CSS, MATH) that were combined, two at a time, into four different treatment programs. Two programs were control or contrast conditions (MATH+CSS; PHAB/DI+CSS) and two represented experimental, multidimensional treatment programs (PHAB/DI+WIST which became PHAST; PHAB/DI + RAVE-O which became PHAB +RAVE-O). Every intervention program devoted equal time to its two components. The PHAB/DI in each reading intervention averaged 30 minutes of instructional time in every lesson. This was exactly true for PHAB/DI + CSS and for PHAB/DI + RAVE-O. On average, across the 70 instructional hours of PHAST, exactly half of the instructional time was devoted to PHAB/DI teaching. The distribution of phonological training changed, however, over the course of the 70-hour program. In the early parts of the program, 45 minutes would be devoted to PHAB/DI training and 15 minutes to WIST training; in later parts of the program, the instructional balance shifted such that 15 minutes would be devoted to PHAB/DI and 45 minutes to the strategy training activities of WIST. The phonological parts of the program served as a framework on which the word identification strategies were scaffolded in PHAST.

Remediation Program Components

The Classroom Survival Skills (CSS) Component

The Classroom Survival Skills (CSS) control component was used twice in the present design. The CSS control treatment was paired with the phonological component, PHAB/DI, and with the alternative treatment control program, MATH. Participants received the same amount of intervention time and professional attention as those in the multiple component reading programs, but received no direct reading remediation. The CSS lessons, 30 minutes in length, trained classroom etiquette, life skills, and organizational strategies, with an emphasis on academic problem solving and self-help techniques. Parts of the program were developed using lessons adapted for research purposes from the Skills for School Success Program (Archer & Gleason, 1991).

In terms of experimental design, the inclusion of a CSS component ensures that any reading effects obtained for the PHAB/DI+CSS condition are due just to the PHAB/DI component. When this condition is compared to the PHAST (PHAB/DI+WIST) or the (PHAB/DI+RAVE-O conditions, it allows for a direct comparison of the additional impact of the WIST and RAVE-O components above and beyond the PHAB/DI component alone. In this design, the treatment programs' effectiveness may be attributed to specific program content rather than to involvement in an active academic intervention program or to the benefits of receiving individual attention from an experienced special education teacher.

The Mathematics Program Component (MATH)

It has been estimated that 50–60% of RD children exhibit poor mathematics performance (Badian, 1983). The MATH component thus provided an active, appropriate instructional program to teach a range of basic math concepts, number facts, computational skills, and specific problem-solving strategies through direct instruction and dialogue/metacognitive methods. The inclusion of a math program, paired with the CSS program, provides a stricter control for changes in self-esteem, perception by self and others, and motivation, as well as a more stringent control comparison for the specific effects of the experimental reading intervention programs. After the 70 hours post-treatment assessment, subjects in the MATH+CSS control groups were offered a place in PHAST or PHAB+RAVE-O for ethical reasons.

Phonological Analysis and Blending/Direct Instruction Component (PHAB/DI):

The PHAB/DI program focuses on remediating basic phonological analysis and blending deficits and forms a foundation on which the current multidimensional interventions are based. PHAB/DI trains sound analysis and blending skills, and directly teaches letter-sound and letter-cluster-sound correspondences. Content is introduced in a highly structured, sequence of steps, with multiple opportunities for over-learning, until children reach a defined “mastery” criterion, The PHAB/DI program focuses on instruction in word segmentation and sound blending skills and attempts to remediate the core phonological deficits of disabled readers, so that reliable letter-sound knowledge and effective decoding and word identification skills can be acquired. The program uses many elements of direct instructional materials developed by Engelmann and his colleagues at the University of Oregon, specifically, the Reading Mastery Fast Cycle I/II Program (Engelmann & Bruner, 1988).

Word Identification Strategy Training Component (WIST) (Lovett et al., 1994).

The WIST program instructs children in the acquisition, use, and monitoring of four different word identification strategies: (a) word identification by analogy, (b) seeking the part of the word that you know, (c) attempting variable vowel pronunciations, and (d) "peeling off" prefixes and suffixes in an multisyllabic word. Every WIST lesson begins with instructional time devoted to the prerequisite skills necessary to use the strategies effectively. This skill-building part of the lesson includes learning and practicing 120 key word patterns (Gaskins et al., 1986), learning different vowel pronunciations, instruction in variant vowel combinations (ea, oo, ow, ie) and affixes (pre, re, un, ing, ly, ment). Most of the lesson is reserved for explicit WIST strategy instruction and application, with some discussion of explicit metacognitive issues such as strategy implementation, strategy choice, and self-monitoring. The WIST Program emphasizes explicit training of the specific WIST strategies and extensive dialogue-directed practice with their implementation. In addition, the program teaches a system of metacognitive mnemonics to help the children acquire general routines important to effective strategy application and evaluation (e.g, the SAME (select, apply, monitor, evaluate) Plan).

PHAST Program (PHAB/DI + WIST, Lovett, Lacerenza, & Borden, 2000).

Research findings from the Toronto Site have demonstrated the efficacy of a sequential combination of phonologically- and strategy-based interventions (Lovett, Lacerenza, Borden, et al., 2000) and lend support to an integration of these approaches into a single intervention program. Called PHAST for “The Phonological and Strategy Training Program”, this program uses PHAB/DI’s program of phonological remediation as a framework on which each of the four WIST strategies are introduced and scaffolded. By 70 hours of intervention, children acquire a phonological letter-sound decoding strategy (“Sounding Out”), a word identification-by-analogy strategy (“Rhyming”), a strategy for separating affixes in multisyllabic words (“Peeling 0ff”), a strategy for seeking familiar parts of unfamiliar words (“I Spy”), and a strategy for attempting variable vowel pronunciations (“Vowel Alert”). Thus, the PHAST program allows evaluation of a multidimensional intervention that addresses phonological core deficits, orthographic and morphological components, and the more general strategy learning deficiencies associated with RD.

RAVE-O program (Retrieval, Automaticity, Vocabulary, Engagement with Language, and Orthography; Wolf et al., 2000).

The RAVE-O program extends traditional emphases on phonological decoding processes to incorporate systematic emphases on four other targeted linguistic systems, critical to fluent comprehension. These include orthography, semantics, syntax, and morphology. The program directly addresses processes potentially underlying weaknesses in subtypes of children with RD who exhibit deficits in NSD and fluency (see Wolf & Bowers, 1999; Katzir, Kim, Wolf, Morris, & Lovett,, 2008). Based on theoretical accounts of reading fluency and comprehension (Wolf & Katzir-Cohen, 2001), RAVE-O’s basic premise is that the more the child knows about a word (i.e., phonemes, orthographic patterns, semantic meanings, syntactic uses, and morphological roots and affixes), the faster the word is decoded, retrieved, and comprehended. Children learn a group of core words each week that exemplify these critical linguistic principles and learn daily to make explicit connections across these linguistic systems. Core words are first introduced with their multiple meanings and then the word’s phoneme-level information is connected to its orthographic patterns. Children learn orthographic “chunks” in multiple and creative formats, including specifically designed computerized games that include varying rates of presentation (Wolf & Goodman, 1996).

A range of metacognitive strategies enable children to segment the most common orthographic and morphological units in words. For example, the strategy called “Ender Benders” helps children quickly recognize common morpheme endings that change (that is, “bend”) the word’s meaning. Daily dual instruction in vocabulary and explicit retrieval strategies serves to enhance semantic growth and the speed and accuracy of lexical retrieval, often problematic in RD children. Fluent comprehension for connected text is addressed through metacognitive comprehension strategies implemented with a series of specially written RAVE-O Minute Stories, whose controlled vocabulary incorporates the phonemic and orthographic patterns, multiple meanings, and varied syntactic contexts of core words.

Results

Success of Randomization

Random assignment to intervention condition was designed to ensure equivalent mean baseline skills at the beginning of the intervention year. Multivariate analysis of variance did not indicate significant differences between the four groups at baseline in mean KBIT or WISC-III IQ scores, or on standardized reading measures (WRMT, WRAT, GORT, TOWRE). Overall F tests for group differences were significant, however, for key measures of baseline reading-related skills (Word Blending, Elision, and Test of Word Finding). In all cases, PHAST group means were significantly higher than those for the PHAB+RAVE-O condition. However, differences for remediation condition become non-significant when analyses are run controlling for baseline phonological processing skills (Elision + Word Blending raw scores).

Data Analysis Strategy

Individual growth curve methodology was used to analyze changes on each reading measure, and the correlates of these changes, over the course of the 70-hour remediation and at one-year follow-up. See Table 2 for unadjusted standard score results for all reading measures at all time points, and Table 3 for the unadjusted raw score results for all outcome measures at all time points. Separate models were constructed to analyze growth and outcomes at the 70-hour posttest and at the one-year follow-up. The one-year follow-up models did not include the children participating in the MATH+CSS control group who crossed over following the 70-hours of remediation into one of the multicomponent reading remediation programs for ethical reasons, therefore impacting the overall sample size and total variance estimates and making direct comparisons with the 70-hour outcome results difficult. Post-hoc analysis of the MATH+CSS group’s response to the PHAB+RAVE-O or PHAST remediation program allowed for a within- study replication evaluating the impact of these two remediation programs.

Table 2.

Achievement Measures: Unadjusted Standard Score Means and Standard Deviations for Each Outcome Measure at Each Testing Point

Baseline YR1 Tx-35 End YR1 End YR2

Outcome Measures M SD M SD M SD M SD

WRMT-R Word Attack
  PHAB/DI+WIST 74.01 10.58 80.51 11.32 83.01 9.92 81.20 11.15
  PHAB/DI+RAVEO 75.03 8.06 83.17 9.04 84.45 9.75 84.76 12.61
  PHAB/DI+CSS 72.40 9.64 77.06 11.03 77.88 12.02 75.84 15.83
  MATH+CSS 73.09 11.39 74.00 13.94 73.07 15.22 78.21 14.29
Word Reading Efficiency Nonwords
  PHAB/DI+WIST 81.76 5.56 89.59 9.48 86.27 7.34 85.65 10.69
  PHAB/DI+RAVEO 80.28 3.19 85.61 6.85 88.12 7.59 88.14 11.05
  PHAB/DI+CSS 79.79 4.37 81.39 4.29 83.20 4.88 82.11 10.11
  MATH+CSS 80.32 3.83 84.26 6.61 83.00 6.92 83.05 9.96
WRMT-R Word Identification
  PHAB/DI+WIST 78.29 10.00 80.41 10.52 83.27 10.42 81.27 11.74
  PHAB/DI+RAVEO 79.63 7.81 80.65 9.16 83.81 8.20 82.15 11.77
  PHAB/DI+CSS 77.86 10.53 78.99 11.00 80.48 11.31 75.93 14.96
  MATH+CSS 78.40 10.55 78.09 12.05 77.69 13.46 77.46 14.42
WRAT-3 Reading
  PHAB/DI+WIST 80.48 9.04 82.12 9.44 86.97 10.16 87.16 11.30
  PHAB/DI+RAVEO 77.94 5.75 80.00 8.22 85.29 9.63 89.38 11.05
  PHAB/DI+CSS 77.93 8.72 79.12 8.04 81.32 8.81 82.16 12.96
  MATH+CSS 78.82 9.05 78.75 9.90 77.85 11.27 84.21 12.54
Word Reading Efficiency Real Words
  PHAB/DI+WIST 69.86 9.98 76.31 12.74 81.21 12.44 81.15 15.43
  PHAB/DI+RAVEO 68.43 7.32 74.93 10.04 80.97 10.98 84.12 15.01
  PHAB/DI+CSS 68.32 9.47 72.94 11.10 77.77 12.40 76.76 16.73
  MATH+CSS 67.69 6.75 72.41 9.96 75.65 12.09 76.44 15.73
WRMT-R Passage Comprehension
  PHAB/DI+WIST 77.86 9.55 81.01 10.82 82.86 10.64 81.77 12.46
  PHAB/DI+RAVEO 76.68 10.98 79.39 10.17 82.21 10.26 82.48 12.99
  PHAB/DI+CSS 76.43 12.02 78.80 10.60 79.61 11.24 78.18 15.52
  MATH+CSS 77.04 11.91 75.90 14.32 76.32 14.64 78.35 13.46
Oral Reading Quotient
  PHAB/DI+WIST 74.22 8.62 ---- ---- 77.38 9.98 79.69 14.60
  PHAB/DI+RAVEO 75.33 7.63 ---- ---- 81.73 10.51 80.37 13.74
  PHAB/DI+CSS 74.64 7.20 ---- ---- 77.66 11.87 77.32 14.36
  MATH+CSS 73.20 9.47 ---- ---- 75.32 10.96 75.48 13.33

Table 3.

Achievement Measures: Unadjusted Raw Score Means and Standard Deviations for Outcome Measures at Each Testing Point

Baseline
YR1 Tx-35
End YR1
End YR2

Outcome Measures M SD M SD M SD M SD

WRMT-R Word Attack
  PHAB/DI+WIST 3.26 4.09 8.46 6.04 11.68 6.67 15.28 7.66
  PHAB/DI+RAVEO 1.74 2.24 8.22 5.03 11.65 6.20 16.95 8.70
  PHAB/DI+CSS 1.49 2.19 5.47 4.66 7.49 5.36 12.41 8.56
  MATH+CSS 2.22 3.01 4.77 4.18 5.77 5.47 13.31 7.71
Word Reading Efficiency Nonwords
  PHAB/DI+WIST 4.00 4.54 11.45 8.79 7.42 5.22 13.33 9.47
  PHAB/DI+RAVEO 1.77 1.88 6.66 5.82 8.07 4.99 13.08 9.61
  PHAB/DI+CSS 1.34 1.73 3.50 2.97 4.98 3.81 9.10 8.39
  MATH+CSS 2.40 2.80 5.96 4.92 4.14 3.94 9.93 6.85
WRMT-R Word Identification
  PHAB/DI+WIST 21.51 13.49 30.47 14.37 38.51 12.41 48.22 11.20
  PHAB/DI+RAVEO 16.65 11.01 27.25 11.50 35.70 10.34 47.32 11.12
  PHAB/DI+CSS 17.01 12.63 25.75 13.65 32.21 13.24 41.33 15.77
  MATH+CSS 17.33 11.88 25.41 13.39 29.15 14.73 43.04 14.00
WRAT-3 Reading
  PHAB/DI+WIST 20.36 3.51 22.25 3.89 25.03 4.16 27.30 4.35
  PHAB/DI+RAVEO 18.43 2.53 21.19 3.15 23.84 3.42 27.72 3.98
  PHAB/DI+CSS 18.23 3.60 20.52 3.45 22.31 3.44 25.25 4.87
  MATH+CSS 18.87 3.12 20.57 3.35 21.12 4.00 26.28 4.47
Word Reading Efficiency Real Words
  PHAB/DI+WIST 14.79 10.80 21.15 12.76 25.80 12.31 36.89 13.18
  PHAB/DI+RAVEO 10.41 7.65 16.50 9.59 22.49 10.61 36.08 12.51
  PHAB/DI+CSS 11.46 9.70 16.04 11.32 20.72 12.44 31.16 15.37
  MATH+CSS 11.39 7.64 16.04 10.18 19.18 11.95 31.88 13.93
WRMT-R Passage Comprehension
  PHAB/DI+WIST 10.16 6.97 15.89 8.78 19.68 8.12 25.61 8.52
  PHAB/DI+RAVEO 7.59 6.30 13.01 7.17 17.74 7.61 25.33 9.01
  PHAB/DI+CSS 7.86 6.83 12.96 8.01 15.87 8.44 22.93 10.40
  MATH+CSS 8.15 5.93 12.03 8.44 14.71 8.85 23.00 8.70
WRAT-3 Spelling
  PHAB/DI+WIST 17.35 2.70 18.96 2.87 20.33 2.64 21.89 2.62
  PHAB/DI+RAVEO 16.99 1.87 18.42 1.82 19.48 1.98 21.68 2.30
  PHAB/DI+CSS 16.69 2.67 17.90 2.41 19.10 2.85 20.80 3.11
  MATH+CSS 16.66 2.60 18.07 2.63 18.37 3.13 21.15 2.88
WRAT-3 Arithmetic
  PHAB/DI+WIST 18.07 3.43 19.90 2.94 21.15 3.69 25.14 4.39
  PHAB/DI+RAVEO 17.48 3.17 19.71 2.59 20.76 2.81 23.62 3.38
  PHAB/DI+CSS 17.16 3.65 19.00 4.18 20.43 3.94 23.69 4.27
  MATH+CSS 17.96 3.14 20.10 3.54 21.21 3.79 23.47 3.93

Individual growth parameters were estimated using SAS-Proc Mixed and REML estimation procedures. In addition to time (0-hour baseline, 35-hour, 70-hour posttest, 1 year follow-up) being nested within individual children, individual children were nested within instructional group (groups of four children taught together) and intervention condition (four remediation programs), with IQ (low, average), SES (low, average), and race (Black, Caucasian) as primary factors within the design. Age and initial levels (baseline) of phonological processing and rapid naming were used as covariates. Because of the complexity of this four-level model, the process and results of model-building will be described only for prototypical reading outcome measures, with results from the most parsimonious final models summarized for the remaining variables.

All continuous predictors and covariate variables were grand-mean centered at either the 70-hour posttest or at the 1-year follow-up depending on the analysis. Using this approach, the intercepts in these models represented the children’s expected performance at the end of the remediation program or one year later. Specifically, the intercept is the CSS+Math (control) children’s expected level—so that estimates for the intervention conditions represent raw score differences (increases) for the remediation program groups, as compared to the control children’s mean. Changes over time, or slope, in these models represent mean incremental change in raw scores from one time point to the next, and an interaction with slope suggests different rates of change depending on the children’s characteristics. Initial analysis focused on children’s change over the course of the remediation programs. In general, various models evaluating linear growth with random or fixed intercepts or slopes were evaluated, along with curvilinear components to assess whether the outcome measure or academic skill plateaued over time. The model with random intercepts and growth (slope) terms will be typically presented unless otherwise noted. If significant variance was revealed in the individual intercepts and slopes in the unconditional model, then conditional model-building evaluated the extent that outcomes, or rates of change, varied for instructional conditions or teaching group, as well as for factors such as IQ, SES, race, age, or a child’s initial phonological processing or rapid naming abilities, and various interaction terms. Predictors/covariates with mean parameter values that did not differ from zero in these models were dropped in order to develop the most parsimonious models. Changes in model fit were also evaluated by examining chi square differences in −2 residual LL estimates in nested models.

A final model will be reported which is the most parsimonious conditional model in which only primary factors of focus (IQ, SES, race) and significant fixed effect terms from the fully conditional model were retained. It should be noted that ML estimation procedures were used during earlier model building, but that final estimates were obtained using REML. The decision to include random terms for slope and intercept was determined a priori. Random terms for slope were dropped only for untenable models. Slightly different best reduced models did characterize different outcome measures; overall, however, a highly consistent pattern of results was revealed. In general, after taking into account the influence of instructional condition and teaching group, these predictors reduced the intercept or outcome variance by another 10–25%. Contrasts focused on outcomes (intercepts), investigating whether the interventions resulted in different final levels of performance following remediation, or if the rates of change (slopes) or deceleration in growth (quadratic) varied as a function of treatment condition (intervention condition by slope interaction and intervention condition by quadratic interaction, respectively). Three orthogonal contrasts were specified. The first contrast was the overall contrast between the reading intervention programs and the control condition (MATH+CSS)—i.e., were the reading intervention programs beneficial? The second contrast compared the multidimensional interventions to the phonological-only control program (PHAST and PHAB+RAVE-O vs. PHAB/DI+CSS)—i.e., did the multiple component models produce different results from the phonological control program? The third contrast was between the two multidimensional interventions (PHAST vs. PHAB+RAVE-O)—i.e., did the two multiple component interventions differ from each other? The one-year follow-up models included only the three active reading interventions because the MATH+CSS group was not included. Two program contrasts were available in these models: the contrast between the multidimensional interventions and the phonological-only control program (PHAST and PHAB+RAVE-O vs. PHAB/DI+CSS); and the contrast between the two multidimensional interventions (PHAST vs. PHAB+RAVE-O).

Non-Word Reading Models (WRMT-R Word Attack; TOWRE NWRE)

Results of the first conditional model using Word Attack raw scores as the outcome measure at 70-hours posttest revealed significant fixed effects for intervention condition and for instructional group (both p<.0001), and a significant interaction between the linear growth term and instructional group (p<.05). Adding these fixed effects to the model decreased random variance around the intercept by 60%. These results indicate that outcomes at the end of intervention (the intercept) differed across intervention conditions, and both outcome and rate of change over time (the slope/linear growth) differed by teaching groups. Significant variability remained for the intercept and slope, however, indicating that additional predictors of these parameters were needed for a more complete model.

In the most parsimonious model (Table 4), 70-hour posttest outcome continued to be significantly different across intervention condition (p<.0001). Outcomes and rate of linear growth were also significantly (p<.0001) impacted by teaching group. Outcome and growth rates were not different for the factors of IQ, race, or SES. Outcome was significantly impacted by both initial phonological processing and rapid naming (p<.001), but growth rate was only impacted by initial rapid naming (p<.03). The inclusion of baseline measures of phonological processing and rapid naming reduced unexplained variance around the intercept by an additional 27%, as compared to the first conditional model with instructional condition and teaching group alone.

Table 4.

Significant Fixed effects in Best Reduced Model for WRMT-R Reading Measures

Word Attack
Word ID
Passage Comp.
Basic Skills
Total Reading
70 Hrs 1 Yr 70 Hrs 1 Yr 70 Hrs 1 Yr 70 Hrs 1 Yr 70 Hrs 1 Yr

Fixed Effects
 Intervention 31.08a 6.81 b 19.74a 5.89 b 9.81a 28.96a 7.38 a 19.46a 4.01 c
 Group 2.73a 1.46 c 2.54a 2.02 a 2.11a 2.23 a 2.10a 1.72 b 2.13a 2.11 a
 Intervention x Slope 5.06 b 7.87a 6.75 b 2.17d 4.64 b 3.10c 4.92 b 3.84b 5.71 b
 Group x Slope 1.97a 2.64a 2.23 a 2.37a 2.08 a 2.19a 2.01 a 2.39a 2.64 a
 SES 5.37c 5.35 c 5.41c 2.78 d 4.36c 5.19 c
 IQ 4.92c
 Ethnicity 2.89d 2.77 d 2.83 d
 Age 5.96c 5.28 c
 BL PHON 26.44a 27.46 a 22.35a 15.50 a 4.74c 8.05 b 36.52a 23.75 a 21.82a 15.01 a
 BL RAN Letters 16.38a 6.99 b 38.62a 15.54 a 26.65a 16.34 a 45.00a 20.46 a 46.08a 24.97 a
 Linear Growth 10.03b 12.84 a 100.23a 43.92a 80.38 a 31.96a 12.00 a 60.80a 64.56 a
 Curvilinear Growth 16.83a 52.52 a 24.28a 8.21b 24.90 a 90.08a 293.41 a 49.79a 150.56 a
Other Interactions
 BL RAN x Intervention 4.15b 2.98c 3.45c
 BL RAN x Slope 5.00c 3.65 d
 Ethnicity x Intervention 2.64d 3.27 c 2.28d 3.19 c
 Curvilinear x Intervention 3.17c
 SES x Intervention 3.34c
IIntervention Contrasts (Outcome)
 PHAB/WIST/RAVEOvsMATH 68.15a 52.38a 24.48a 75.00a 51.92a
 WIST/RAVEO vs PHAB 25.36a 10.27 b 5.97b 10.58 b 4.72c 11.76a 12.39 a 4.29c 5.82 c
 PHAST vs PHAB/RAVE-O 3.1 6 d
Intervention Contrasts (Slope)
 PHAB/WIST/RAVEO vs MATH 17.87a 7.06b
 WIST/RAVEO vs PHAB 4.81 c 4.86c 7.63 b 3.85d 6.71c 4.57 c 4.03c
 PHAST vs PHAB/RAVE-O 5.16c 5.74c 8.68b 5.16c 8.93b

Note. Only f values with p < 1.0 are reported. BL = Baseline scores. WIST = PHAST Intervention. RAVEO = PHAB/RAVE-O Intervention. PHAB = CSS/PHAB Intervention. MATH = CSS/MATH Intervention. Group = teaching group.

a

= p < .001;

b

= p < .01;

c

= p < .05;

d

= p < .1

Individual outcome contrast comparisons using model-based means estimates revealed significant differences between the three reading programs and the MATH+CSS control condition, and between the two multidimensional programs and the phonological control condition. PHAST and PHAB+RAVE-O were associated with superior outcomes to the PHAB/DI+CSS condition. Post hoc comparisons indicated that the PHAB/DI+CSS condition was associated with better outcomes on this measure than the MATH+CSS program. Significant differences in WRMT-R Word Attack 70-hour posttest scores were not found for the two multidimensional programs. Contrasts comparing differences in the rate of skill growth between treatment groups were non-significant.

At one year follow-up, the first conditional model again revealed significant outcome differences for intervention condition and teaching group (p<.01), and a significant interaction between intervention condition and rate of linear growth (p<.01). While outcomes continued to be differentiated by intervention condition and teaching group one year later, continued change in long-term growth was still being impacted by intervention condition.

In the most parsimonious one year follow-up model, long-term outcomes were still being impacted by intervention condition (p<.01) and teaching groups (p<.05), and growth rates were different for the intervention conditions (p<.01). One year outcomes showed significant effects for initial phonological processing and naming speed (p<.01), while growth showed a marginal interaction with initial naming speed (.05<p<.06). The effects of baseline naming speed on skill growth were somewhat attenuated by the end of the follow-up year (p = .06). The addition of these baseline covariates reduced the amount of unexplained variance in the intercept by only 8.6% at the one-year follow-up.

At one year follow-up, outcomes (p<.002) and rates of linear growth (p<.03) were significantly different between the two multidimensional programs and the phonological-only control condition. The contrast between the PHAST and PHAB+RAVE-O reflected a faster rate of skill growth for students in the PHAB+RAVE-O condition (p < .03) after one year and a marginally better mean outcome score (.05 < p < .10).

For the TOWRE Nonword Reading Efficiency (NWRE) measure (Table 5), intervention condition (all p’s<.001), teaching group (all p’s≤.05), and initial phonological processing skills and rapid naming speed, but not SES, IQ or Race, significantly affected outcome scores at 70 hours posttest. No other predictors contributed to posttest scores or skill growth on Nonword Reading Efficiency.

Table 5.

Significant Fixed effects in Best Reduced Model

WRAT Reading) Word Rdg Efficiency Nonword Rdg Efficiency WRAT Spelling WRAT Arithmetic





70 Hrs 1 Yr 70 Hrs 1 Yr 70 Hrs 1 Yr 70 Hrs 1 Yr 70 Hrs 1 Yr

Fixed Effects
 Intervention 22.01a 6.12b 9.49a 11.70a 3.87c 17.05a 3.56c
 Group 1.53c 1.96a 2.56a 1.70b 2.11a 2.95a 2.64a 1.46c
 Intervention x Slope 7.04a 6.49b 3.12c 4.51b 4.34c 4.70b
 Group x Slope 1.84b 2.08a 1.45c 1.72b 1.79b 1.52c
 SES 5.79c 6.01c 5.68c 5.18c 9.31b
 IQ 418c
 Ethnicity
 Age 10.36b
 BL PHON 17.65a 19.06a 10.89a 6.87b 12.19a 15.45a 25.56a 12.89a 11.87a
 BL RAN Letters 36.69b 26.19a 37.42a 26.06a 9.11b 9.18b 36.01a 23.46a 12.76a
 Linear Growth 58.56a 101.00a 362.45a 3.40d 42.37a 12.65a 42.88a 8.64b
 Curvilinear Growth 6.38b 11.12a 15.58a 10.23b
 Other Interactions
 BL PHON x Slope 2.89d
 Quadratic x Intervention 2.85c 2.95c
 Ethnicity x Intervention 2.72c 3.36c 3.15c 2.98d 3.85b
 BL RAN x Slope 15.27a 10.61a 4.22c
 IQ x Intervention 2.58d 2.65c
 BL RAN x Intervention 4.52b
Intervention Contrasts (Outcome)
 PHAB/RAVEO/WIST vs MATH 53.03a 25.02a 44.97a
 WIST/RAVEO vs PHAB 9.98b 10.74a 3.91c 7.19b 6.52c
 WIST vs RAVEO 3.27d 3.29d
Intervention Contrasts (Slope)
 PHAB/RAVEO/WIST vs MATH 15.77a 7.29b 13.73a
 WIST/RAVEO vs PHAB 4.28c 3.93c 4.03c 4.95c
 WIST vs RAVEO 8.76b 4.94c 4.12c

Note. Only f values with p < 1.0 are reported. BL = Baseline scores. WIST = PHAST Intervention. RAVEO = PHAB/RAVE-O Intervention. PHAB = CSS/PHAB Intervention. MATH = CSS/MATH Intervention. Group = teaching group.

a

= p < .001;

b

= p < .01;

c

= p < .05;

d

= p < .1

Students participating in one of the multidimensional reading interventions did not outperform math or phonological control students on Nonword Reading Efficiency; results for the PHAST and PHAB/DI+RAVE-O interventions were not significantly different. At the one-year follow-up, students receiving the two multidimensional interventions did not outperform controls on the TOWRE NWRE. To be elaborated in a future study, baseline phonological processing and rapid naming skills remained strongly associated with outcome scores at follow-up as well.

Summary for Non-Word Reading Models

At the end of 70 hours of instruction, students participating in the multidimensional intervention programs (PHAST, PHAB/DI+RAVE-O) demonstrated significantly stronger word attack skills, and these differences continued to be evident upon follow-up testing one year later, although this was not the case in a timed non-word reading task (TOWRE NWRE). The phonological-only control program was significantly stronger than the math control program. Teaching groups impacted both rates of skill growth (slope) and outcome scores (intercept) at the end of intervention, but these effects were attenuated by follow-up one year later. Significant curvilinear growth suggests that the rate of change, overall, slowed somewhat over time. Outcomes (at 70 hours or followup) were not differentially impacted by demographic factors such as ethnicity, IQ and SES, while baseline levels of phonological processing and rapid naming skills impacted outcome both at the end of treatment and at the one-year follow-up. Baseline rapid naming skills impacted rate of non-word reading skill growth during the year of active intervention; these effects were only marginal when follow-up scores were included in the model. PHAST and PHAB+RAVE-O were associated with equivalent but superior outcomes and steeper growth over the course of the interventions, while at one year follow-up PHAB+RAVE-O enjoyed an advantage in continued linear growth. It is noteworthy that children receiving the two multidimensional interventions maintained their gains and demonstrated superior, continued growth a year following the 70-hour interventions.

Word Identification Models (WRMT-R Word Identification, TOWRE WRE, WRAT Reading)

Significant differences among intervention conditions and teaching groups were also found for Word Identification raw scores (Table 4) at the end of 70-hours (p ≤ .01). Curvilinear growth was also significant (p≤.001) suggesting a change in growth rate over the intervention time period. Mean outcome scores and growth rates did not vary systematically as a function of IQ, SES, or race. Initial phonological skills and rapid naming speed significantly impacted outcome scores (p ≤ .01), but not rate of skill growth. The interaction between initial naming speed and intervention condition was also significant (p ≤ .01), indicating that the impact of initial naming speed varied systematically as a function of intervention condition.

Comparisons of adjusted group means indicated higher posttest means and stronger rates of skill growth for students receiving one of the three reading interventions in comparison to the MATH+CSS control condition, and for the PHAST and PHAB+RAVE-O programs relative to the PHAB/DI+CSS control program. Significant differences in mean outcome score or growth rate between the two multidimensional reading interventions were not found.

At one year follow-up, significant differences in outcome score and growth rate were still evident for intervention conditions (p≤.01) and teaching groups (p≤.05). The effects of intervention condition on follow-up outcome score varied significantly as a function of both race (p≤.05) and SES (p≤.05), which was not found during the intervention period. Initial phonological skill and rapid naming speed continued to significantly (p≤.001) predict outcome scores as well.

Students receiving multidimensional interventions continued to demonstrate higher outcome scores (p ≤ .002) and faster rates of skill growth (p ≤ .007) than students receiving the phonological-only control intervention. The contrast between PHAST and the PHAB/DI+RAVE-O Programs was significant for linear slope (p≤.05), and marginal for outcome scores (p <.06), a change from the intervention period results.

Intervention condition (all p’s<.001), teaching group (all p’s≤.05), and initial phonological processing skills and rapid naming speed significantly affected outcome scores on both the TOWRE Word Reading Efficiency and the WRAT Reading measures at 70 hours posttest. Outcome scores on these measures were also significantly associated with SES but did not interact with instructional condition. Linear growth varied systematically as a function of intervention condition also for both measures, and as a function of teaching group on TOWRE Word Reading Efficiency.

Students participating in one of the three reading interventions outperformed math control students on these reading measures. Students in the multidimensional interventions outperformed the phonological control students on only the WRAT Reading subtest, and scores for the PHAST and PHAB+RAVE-O interventions were not significantly different from each other on any measure. Growth rate differences between the reading intervention and the math control groups were demonstrated only on WRAT Reading, although students in the multidimensional reading interventions demonstrated faster skill growth than students in the phonological control condition on both the WRAT Reading and the TOWRE Word Reading Efficiency measures.

At the one-year follow-up, significant differences in outcome scores across intervention conditions persisted for WRAT Reading. Students receiving one of the two multidimensional interventions (PHAB+RAVE-O) outperformed phonological controls on both measures at the one-year follow-up, demonstrating a faster rate of growth on the WRAT Reading and TOWRE WRE measures over the intervention and follow-up period. All posttest differences in adjusted mean scores for the two multidimensional intervention groups were attenuated on follow-up assessment, although growth rate on WRAT Reading and TOWRE WRE still appeared stronger for students receiving PHAB+RAVE-O than for PHAST students. Baseline phonological processing and rapid naming skills remained strongly associated with outcome scores at follow-up as well. Teaching group effects on outcome scores were still evident on both measures, but SES was not associated with either performance on follow-up.

WRMT-R Passage Comprehension Models:

Using Passage Comprehension raw score as the outcome measure at 70-hours posttest (Table 3), significant fixed effects for intervention condition and teaching group were found for all models (Table 4), with teaching group also predicting linear growth rate (all ps≤.01). Outcome scores for the PHAB+ RAVE-O & PHAST interventions were comparable, and both were significantly higher than the mean outcome score for students receiving the phonological control program (p = .03), which was better then the math control program. Students participating in any reading intervention program attained a higher comprehension skill level than students in the math control condition (p ≤ .01). Curvilinear growth was also significant (p≤.001) suggesting a changing growth rate over the intervention time period. Unlike the preceding measures, two of the demographic factors (SES, IQ) predicted (p < .03) outcomes, but did not interact with treatment condition or predict linear growth. Outcomes were also significantly impacted by initial level of phonological skill (p≤.05) and rapid naming speed (p≤.01). Rate of skill growth over the intervention year was not significantly impacted by intervention condition or any of the other covariates.

At one-year follow-up, however, the effects of intervention condition on comprehension skill levels were somewhat attenuated. The association between intervention condition and outcome score was non-significant although, rate of skill growth was still significantly impacted by intervention condition (p ≤ .01). The only significant contrast was a stronger rate of growth over the 2-year period for children in the PHAB+RAVE-O program relative to that for the PHAST program. Outcome score was still impacted by teaching group (p≤.001), SES (p≤.05), and baseline phonological skills and naming speed (p≤.001), however, and the rate of skill growth continued to vary significantly across individual teaching groups (p≤.001). None of these interacted with intervention condition or predicted growth at one year follow-up. The model-adjusted means estimates are presented for Passage Comprehension in Figure 2.

Figure 2.

Figure 2.

WRMT-R Word Attack and Passage Comprehension adjusted raw score by remediation condition over time.

Spelling and Arithmetic Skills

Intervention condition (all p’s<.001), teaching group (all p’s≤.05), and initial phonological processing skills and rapid naming speed significantly affected outcome scores (Table 3) on the WRAT Spelling measure at 70 hours posttest. Outcome scores on WRAT Spelling were also significantly associated with SES but did not interact with instructional condition. Linear growth varied systematically as a function of intervention condition and as a function of teaching group (Table 5).

Teaching group, SES, and initial phonological processing and rapid naming speed were significantly related to posttest WRAT Arithmetic scores. There were no significant contrasts between the intervention groups in either rate of skill growth or 70 hour posttest score on WRAT Arithmetic. Standardized Text Reading Measure

The Gray Oral Reading Test is reported separately because although it has a composite score (Oral Reading Quotient (ORQ)), separate scores are also available for assessment of the accuracy and rate with which connected texts are read aloud, and there is a separate score for Comprehension (Table 6). The GORT data are also described separately because the test was not administered at the 35 hour testing point, and only 75% of the total sample of 279 participants provided pre-, posttest, and follow-up data on the GORT. The models reported below are based on an imbalanced cell distribution; older children with a higher proportion of low SES participants and a lower proportion of African-American children contributed GORT data from the PHAST Program relative to the PHAB+RAVE-O Program. The best reduced models for the ORQ and for the three subcomponents are summarized in Table 7, as well as the associated contrasts at both 70-hour posttest and one-year follow-up outcomes.

Table 6.

GORT-3 Raw Scores and Standardized Oral Reading Quotient (ORQ) at Each Testing Point

Baseline End YR1 End YR2



GORT-3 Scores M SD M SD M SD

Accuracy
  PHAB/DI+WIST 1.02 2.20 3.88 4.68 7.51 6.67
  PHAB/DI+RAVEO 0.36 1.12 3.95 4.93 8.12 6.88
  PHAB/DI+CSS 0.15 0.47 2.54 3.94 7.02 7.17
  MATH+CSS 0.11 0.41 2.31 3.50 6.12 6.36
Rate
  PHAB/DI+WIST 0.44 0.70 2.37 3.03 4.23 4.32
  PHAB/DI+RAVEO 0.26 0.58 1.77 2.10 4.75 4.85
  PHAB/DI+CSS 0.41 0.91 1.33 2.01 4.03 4.35
  MATH+CSS 0.19 0.47 0.91 1.37 3.93 4.07
Comprehension
  PHAB/DI+WIST 5.15 4.93 9.77 6.58 15.18 8.60
  PHAB/DI+RAVEO 5.22 4.67 11.56 6.23 14.67 7.51
  PHAB/DI+CSS 5.02 4.27 9.66 6.38 13.51 8.39
  MATH+CSS 4.46 4.75 8.04 6.44 12.15 7.93
Oral Reading Quotient
  PHAB/DI+WIST 74.22 8.62 77.38 9.98 79.69 14.60
  PHAB/DI+RAVEO 75.33 7.63 81.73 10.51 80.37 13.74
  PHAB/DI+CSS 74.64 7.20 77.66 11.87 77.32 14.36
  MATH+CSS 73.20 9.47 75.32 10.96 75.48 13.33

Table 7.

Significant Fixed effects in Best Reduced GORT Models

ORQ Accuracy Rate Comprehension




70 Hrs 1 Yr 70 Hrs 1 Yr 70 Hrs 1 Yr 70 Hrs 1 Yr

Fixed Effects
 Intervention 6.93a 3.90c 8.64a 10.39a 4.93b
 Group 2.43a 2..68 a 4.90a 3.56 a 5.17a 4.20 a 1.87b 2.86 a
 Intervention x Slope 6.64a 3.20c 3.77b 2.67 d 9.14a 4.38 a 3.99b
 Group x Slope 1.63 c 2.10a 1.90 b 3.48a 2.66 a 1.47 c
 SES
 IQ 3.46d 4.05 c 4.13c
 Ethnicity
 Age 37.83a
 BL PHON 5.65 c
 BL RAN Letters 13.99a 8.92b 13.61a 31.65 a 14.34a 40.40 a 9.38b 7.25 b
 Linear Growth 38.10a 130.37a 42.63 a 183.62a 63..24 a 134.03a 22.86 a
 Curvilinear Growth 5.04 c 3.27 d 11.55 a
 Other Interactions
 Intervention x SES 3.70b 3.72c 3.55 c
 Intervention x IQ 3.83b 2.59d
 BL RAN x Slope 4.57c 19.13 a 4.39c 26.98 a
Intervention Contrasts (Outcome)
 PHAB/RAVEO/WIST vs MATH 13.85a 16.32a 23.06a 10.25
 WIST/RAVEO vs PHAB 3.47d 5.85 c 7.87b 8.31b 3.97 c
 WIST vs RAVEO 4.18c 3.66d
Intervention Contrasts (Slope)
 PHAB/RAVEO/WIST vs MATH 6.15b 13.00a
 WIST/RAVEO vs PHAB 4.95c 3.61d 14.56a
 WIST vs RAVEO 8.91b 5.26c

Note. GORT = Gray Oral Reading Test - 3rd Edition. ORQ = Oral Reading Quotient (Standard Score). Only f values with p < 1.0 are reported. BL = Baseline scores. WIST = PHAST Intervention. RAVEO = PHAB/RAVE-O Intervention. PHAB = CSS/PHAB Intervention. MATH = CSS/MATH Intervention. Group = teaching group.

a

= p < .001;

b

= p < .01;

c

= p < .05;

d

= p < .1

In the most parsimonious model, 70-hour posttest and linear growth continues to be significant for intervention condition on the ORQ and on all three component measures (all p’s≤.01). Teaching group also predicted outcome on all measures, but was predictive of slope on only two measures (Accuracy and Rate). As with the other standardized measures, initial levels of letter naming speed were a significant predictor of 70-hour posttest outcomes on all four GORT scores, and also significantly predicted the amount of linear growth on the Accuracy and Rate component scores. While IQ was related to GORT Comprehension outcomes at 70-hour posttest, IQ did not predict outcomes or slopes on the other GORT scores. Similarly there were no significant fixed SES or race effects in these models, although SES did interact with intervention condition for Accuracy and Reading Rate scores, but not for ORQ or Comprehension.

A number of significant contrasts were revealed in these four sets of models. A significant difference was revealed between the active reading interventions and the CSS+MATH control condition for 70-hour posttest outcomes on all four GORT scores (p’s≤.001), and for linear growth on the Accuracy and Rate component scores (p’s≤.01). Contrasts comparing the two multidimensional interventions to the phonological-only control program were found on Accuracy and Rate for outcome, and were also highly significant for linear growth on the Rate measure (p≤.001), while marginally significant for Accuracy growth (p≤.06). This contrast for ORQ was also marginal for outcome (.05≤p≤.07) but significant for slope (p≤.05). The third contrast, between PHAST and PHAB+RAVE-O was significant for ORQ outcome (p≤.05) and linear growth p≤.01, and for Comprehension linear growth (p≤.05), while outcome was borderline (.05≤p≤.06). The pattern of results from these models for the 70 hour posttest is presented in Figure 3. Superior outcomes and steeper learning curves were found for the two multidimensional interventions, with this advantage seen particularly on the Rate score. Superior growth on the ORQ and the Comprehension scores was found for the PHAB+RAVE-O intervention relative to the PHAST Program, with better ORQ outcomes and a marginally superior outcome on the Comprehension score also associated with the PHAB+RAVE-O program.

Figure 3.

Figure 3.

GORT Text Reading Accuracy and Passage Comprehension adjusted raw by remediation condition over time (only 2 time points).

One year follow-up models revealed a significant effect for intervention condition in predicting outcomes on the composite ORQ (p≤.05). Intervention condition also predicted continued growth over the follow-up year for the ORQ and the Rate scores (p≤.05). Teaching group was highly predictive of long-term follow-up outcomes and linear growth on all four GORT scores (p≤.05). Initial letter naming speed again predicted all four GORT measures at one-year follow-up (p’s≤.01), and continued growth over time on the Accuracy and Rate scores (p’s≤.001). Contrasts at one year follow-up on the ORQ and the Comprehension score demonstrated significant, superior outcomes for the two multidimensional programs. There were no differences between the PHAST and the PHAB+RAVE-O programs in terms of follow-up outcome or growth on any of the GORT measures.

Discussion

As argued in Snow and Juel (2005), comparative intervention studies should not be considered a “horse race”. Rather, we conceptualize the present study as one step towards realizing Lyon’s (1999) goal for reading intervention research: understanding what works best in which programs for what students under which conditions. In this context, the present design allows us to evaluate the relative benefits of different linguistic and metacognitive emphases in interventions for young struggling readers. The issue of whether there exists meaningful subtype x treatment interactions in these data will be the focus of a future report, as will additional outcome data on word identification learning, vocabulary (Barzillai, Wolf et al., in preparation), and other fluency measures.

The present interventions are conceptualized on a continuum, including small group programming using classroom survival skills and math interventions (CSS+MATH, an alternative intervention control group), to intensive phonologically-based reading intervention coupled with classroom survival skills training (PHAB/DI+CSS, the phonological-only control), to two multiple component reading interventions that include the same intensive phonologically-based reading intervention coupled with other intervention approaches (PHAST and PHAB+RAVE-O).

The phonological-only control condition in this design can be questioned on the grounds of not equating the amount of reading instruction offered in the PHAB/DI+CSS Program vs. the two multidimensional reading interventions. A deliberate decision was made to hold the amount of phonological intervention constant among the three active reading interventions. In this way, the present design would allow an evaluation of the specific contributions of the extra-phonological emphases present in PHAB+RAVE-O and PHAST. Previous data from our Toronto site provided a 70-hour phonological-only comparison.

Lovett, Lacerenza, Borden, et al. (2000) reported results from a cross-over design comparing a double dose of PHAB/DI with the PHAB/DI+WIST Program, the precursor to the PHAST Program. This study included random assignment of small groups of disabled readers to one of five conditions: PHAB/DI -> WIST, WIST -> PHAB/DI, PHAB/DI x 2, WIST x 2, or CSS+MATH. Each instructional sequence provided 70 hours of intervention. Superior outcomes and steeper learning curves were observed following both combined interventions, regardless of sequence. While both the double PHAB/DI and double WIST programs yielded positive outcomes on standardized measures of word identification, decoding, and passage comprehension, greater gains were realized by children receiving both phonological and strategy-based interventions. This previous design provided a 70-hour treatment intervention with the same teacher-student ratio as the present study, and therefore is highly relevant to interpretation of the present results.

The multiple component programs used in the present design shared three component emphases (phonology, orthography, and morphology) and the use of metacognitive strategies, but differed in specific instructional emphases on word identification and on semantic development. The PHAST Program integrates phonologically- and strategy-based approaches to word identification learning, focusing extra instructional attention on (i) subsyllabic orthographic patterns; (ii) morphological segments; (iii) variant vowel pronunciations; and (iv) a program of ‘metacognitive decoding’ in the form of direct teaching of five word identification strategies. The PHAB+RAVE-O Program adds to these same phonological, orthographic, and morphological components more emphases on linguistic components involved in word knowledge, specifically: (i) semantic depth, semantic flexibility and lexical-retrieval; (ii) syntactic knowledge, and (iii) morpho-syntactic knowledge (often conveyed using metacognitive strategies). The ultimate goals of both multiple component programs were shared—to improve basic reading skills, to facilitate the development of independent reading, and to lay the groundwork for fluent reading comprehension. Both programs included some shared and some different emphases in intervention, and both programs provided explicit and different motivational components. Including two alternative multidimensional approaches in the present design allowed us to investigate more systematically questions regarding the contribution of different language processes to the development of word identification and reading comprehension skills.

Semantic Development.

The relationship between semantic growth (vocabulary) and reading comprehension is well-documented (Beck, McKeown, & Kucan, 2002; Beck & McKeown, 2006; Biemiller 1999, 2001; Moats, 2001; Stanovich, 1985); the contribution of individual differences in vocabulary knowledge to accuracy and fluency in word recognition, however, is not well understood. As Juel (2005) noted, however, a critical problem in most phonics-based programming is the misguided assumption that struggling readers, particularly those with different dialects, different languages spoken in the home, and/or impoverished language backgrounds, know the meaning of the words they are trying to decode.

There exists a growing body of knowledge about the contribution of different forms of linguistic knowledge to word recognition. Yates, Locker, and Simpson (2003) demonstrated that enhanced semantic knowledge improved the speed of lexical retrieval. Specifically, they found that the richer the “semantic neighborhood” for a given word (i.e., the more associated words, meanings, etc.), the faster the representation of that word was retrieved on lexical decision tasks. Wydell, Vuorinen, Helenius, and Salmelin (2003) found, in an MEG study, that processes recruited in the superior temporal cortex for reading words were significantly faster for known words than for unknown or pseudowords; this cortical region subserves both phonological and semantic processing. Increased semantic knowledge for a given word shortened the time that word was processed both phonologically and semantically.

The multi-layered semantic emphases in the RAVE-O Program allowed us to investigate these contributions to word identification, word attack, and reading comprehension. Explicit instruction in vocabulary, semantic flexibility, and lexical retrieval strategies were components unique to RAVE-O. The approach draws on the premise that more in-depth knowledge of words (e.g., multiple meanings, semantic neighborhood associates, morphosyntactic elements) facilitatesboth accuracy and fluency in word recognition, oral reading fluency, and the comprehension of connected text. The present test battery allowed comparison of speed and accuracy in reading, and thus permitted a first step towards examining this premise in an intervention context.

As expected, the active reading interventions proved superior to the control group on all standardized reading and spelling measures at 70 hours, with the exception of the Nonword Reading Efficiency measure. The two multiple component programs demonstrated superior 70 hour outcomes to the phonological control group on the majority of standardized measures of word identification. Significant contrasts were revealed between the multiple component and phonological-only interventions for posttest outcomes on all WRMT-R measures, WRAT-3 Reading, PIAT-R Spelling, and Accuracy and Rate scores on the GORT. The PHAST and PHAB+RAVE-O Programs were associated with superior outcomes of equivalent magnitude on all standardized measures except the GORT ORQ. On the GORT ORQ composite of fluency plus comprehension, superior outcomes and greater growth during intervention were revealed for children in the PHAB+RAVE-O condition. These latter results may reflect the additional contribution of semantic components to connected text reading.

What is more striking from the present analyses is the extent to which the two multiple component programs demonstrated superior outcomes and continued growth one full year after the interventions ended. At the one year follow-up, children who had received either the PHAST or PHAB+RAVE-O programs continued to show a significant advantage relative to the PHAB/DI+CSS participants on almost all tests of reading and spelling skill, including spelling and word efficiency measures (WRAT-3 Spelling and WRE), which had failed to show this advantage at immediate posttest. The superiority of the PHAST and PHAB/DI+RAVE-O Programs for these disabled readers is well illustrated here, and replicated across multiple measures of reading and spelling achievement one year after the interventions ended.

PHAB+RAVE-O devoted daily time to direct decoding skills, but spent equal time building up semantic, orthographic, and morphosyntactic knowledge. PHAST allocated equivalent time to decoding, but supplemented it with explicit word identification strategies and training on other aspects of orthographic and morphological structure. The immediate and maintained success of both programs suggests that different pathways exist to successful reading remediation.

Semantic instruction in PHAB+RAVE-O contributed to vocabulary growth and improved semantic flexibility. Children in the PHAB+RAVE-O group demonstrated superior vocabulary outcomes, both on instructed words on the RAVE multiple definition task (Barzillai & Wolf, in preparation), and in providing multiple meanings to new vocabulary items on the standardized WORD-R. As testimony to the overall relationship between word identification and word knowledge, both multidimensional programs were superior to the PHAB/DI+CSS Program, which was better than the control program on trained words. Only the PHAB+RAVE-O intervention group demonstrated superiority on the standardized vocabulary measure, both at 70 hours and at one-year follow-up.

Morphology.

An often neglected dimension of language, concerns morphology and its contribution to word identification, vocabulary, syntax, and comprehension development (Berninger, Abbott, Billingsley, & Nagy, 2001; Carlisle & Rice, 2002; Henry, 2003; Moats, 2001, 2004). Both multidimensional programs incorporate considerable emphases on strategies for the quick recognition of morphemes and for understanding how they change the meaning of the word. The term “Ender Benders” was used as a mnemonic strategy in the PHAB+RAVE-O Program to illustrate how different morphemes like “ed”, “er”, and “s” can change a noun to a verb (e.g., “jam” to “jammed”), an action to a person who performs that action (e.g., “move” to “mover”), and a singular word to a plural (e.g., “ram” to “rams”). The metacognitive term “Ender Bender” itself incorporates the principle of morphological transformation.

In PHAST, a somewhat different approach to morphology instruction is employed. One of the five PHAST strategies, Peeling Off, involves recognition and segmentation of morphemes in multisyllabic word identification. Children are taught the prefixes and suffixes of English, beginning with the most frequently occurring affixes. As affixes are introduced, prefixes are mounted as green leaves and suffixes as orange leaves on a ‘peeling off’ tree.

Orthography.

Another shared emphasis by the multidimensional programs is a focus on subsyllabic segments and common orthographic patterns. PHAB+RAVE-O emphasizes rapid recognition and practice of the most frequent orthographic patterns in English through a series of activities and computerized games called Speed Wizards (Wolf & Goodman, 1996) that allow for repeated practice and multiple exposures to these patterns.

Similarly, PHAST integrates work on different levels of subsyllabic segmentation, teaching the phonological Sounding Out strategy with its emphasis on the smallest subsyllabic units, and the Rhyming strategy with its focus on onset-rime segmentation. To learn the Rhyming strategy, children acquire over time 120 keywords representing the 120 most frequently occurring spelling patterns in English1. These keywords are from the list developed for the original Benchmark School Word Identification/Vocabulary Development Program (Gaskins et al., 1986).

It can be speculated that this attention to morphology and orthography in the multidimensional programs, PHAST and PHAB/DI+RAVE-O, facilitated the development not only of word recognition but also of spelling knowledge, and resulted in superior spelling achievement for both programs at one year follow up.

Fluent Comprehension.

A final question is whether the vocabulary, orthographic, syntactic, and morphological emphases of PHAB/DI+-RAVE-O and the orthographic, morphological, and metacognitive emphases of PHAST were associated with advantages in oral reading fluency and reading comprehension greater than that associated with the PHAB/DI+CSS Program. Consistent with recent work on multiple pathways to fluency (Katzir et al., 2008; Wolf & Katzir-Cohen, 2001), both multidimensional programs proved superior to the phonological control program on measures of oral reading fluency, text reading accuracy (GORT subscores), and passage comprehension (WRMT-R) at 70 hrs, and on GORT ORQ and Comprehension at one-year follow-up.

Whether the added vocabulary and syntactic emphases of PHAB+RAVE-O resulted in greater comprehension gains than the metacognitive and strategy instruction focus of PHAST is not resolved by these data. The GORT Reading Quotient represents the best index of fluency and comprehension in the present battery. The PHAB+RAVE-O Program demonstrated superior outcomes and greater linear growth on the ORQ at 70 hours; and a trend favoring PHAB+RAVE-O was found on the Comprehension subscore at posttest. These findings demonstrate the efficacy of PHAB+RAVE-O in facilitating fluent reading comprehension following only 70 hours of intervention.

These two treatment-specific findings are qualified by two other findings. Both multidimensional programs were associated with equivalent outcomes on WRMT-R Passage Comprehension at 70 hour and at one year testing, and achieved equivalent long-term outcomes on the GORT Oral Reading Quotient at follow-up. The WRMT-R Passage Comprehension test employs a “cloze” procedure to measure comprehension, where the child must retrieve a specific one-word answer. Given the lexical retrieval issues identified in previous research on RD (German, 1992; Wolf & Goodglass, 1986; Wolf & Obregon, 1992), the cloze procedure may not be an optimal method for evaluating comprehension in readers with RD. It is certainly confounded with decoding skills. Appropriate measures of reading comprehension for struggling readers are scarce (Keenan, Betjemann, & Olson, 2008). It is not clear whether demonstrated gains in vocabulary for PHAB/DI+RAVE-O children did not improve performance beyond PHAST on this test because of test demands on retrieval skills, or simply that they did not translate into relatively greater comprehension gains than PHAST, because of the extra linguistic and metacognitive emphases of PHAST, which also supported improved comprehension.

Other interpretations may be considered. First, there are alternative pathways to successful comprehension, and both PHAST and RAVE-O demonstrate two effective pathways to improved reading comprehension for young impaired readers. Results at one-year follow-up are equally strong for both multidimensional programs on reading comprehension, and both programs maintain clear superiority over other groups on the ORQ and the GORT Comprehension subscore. PHAB/DI+RAVE-O has a significant advantage over PHAST immediately following intervention: however, this is not maintained on the GORT Reading Quotient at follow-up testing. Two possible interpretations are that the progress made by the PHAST children allows them to catch up with the progress shown earlier by the PHAB/DI+RAVE-O group, perhaps because growth by both groups on word attack and word identification skills resulted in more reading experience over the following year. Another possibility is compatible with one of the theoretical premises of the RAVE-O Program: Fluent comprehension is dependent on evolving word knowledge, particularly semantic and morphosyntactic knowledge, as reading skills becomes more sophisticated in older grades. When there are no active emphases on these skills (as in the follow-up year), the general gains are maintained, but the advantage seen earlier from vocabulary and other linguistic emphases on word knowledge dissipates.

Word Identification Speed and Reading Rate.

All three reading interventions were associated with significant improvement in word reading efficiency on the TOWRE, demonstrating superior outcomes at 70 hours and greater growth during intervention than for the control group. The two multiple component interventions were superior at one-year follow-up on both Word and Nonword Reading Efficiency measures to the phonological control condition; and demonstrated greater continued growth. PHAB+RAVE-O children demonstrated an advantage over children in the PHAST Program in the rate of linear growth over the follow-up period, although actual outcomes for PHAB+RAVE-O and PHAST were equivalent. Finally, the PHAST children demonstrated significantly faster keyword identification immediately after their program ended, but not at follow-up. The only measure of text reading rate was provided by the GORT: On the Reading Rate score, PHAB+RAVE-O and PHAST demonstrated significant improvement in rate relative to the phonological control condition on 70 hour outcomes and linear growth over the course of the intervention. No effects were observed at one-year follow-up.

While both multiple component interventions were associated with improvements in specific dimensions of reading rate at 70 hours, and some at long-term follow-up, treatment-related improvements in word identification processes were easier to measure than growth in specific aspects of reading comprehension and reading fluency.

The Importance of Explicit Strategy Instruction.

The PHAST and the PHAB+RAVE-O Programs both include explicit strategy instruction as part of the intervention, an emphasis supported by previous research (Lovett, Lacerenza, Borden, et al., 2000; Swanson et al., 1999). Explicit strategy training and metacognitive monitoring are necessary to address and prevent generalization failures during remediation, and they provide an important component of effective remediation for RD in the acquisition of both decoding accuracy and reading comprehension skills (Lovett, Lacerenza, Borden, et al., 2000; Mason, 2004; Vaughn et al., 2000).

Young impaired readers in PHAST learned to use a Game Plan to self-direct their selection, implementation, and monitoring of the five PHAST strategies. Struggling readers acquire the prerequisite skills they need for strategy implementation and a self-talk dialogue structure that allows them to become competent independent readers. Subsequent development of the PHAST Comprehension Track in our current research classrooms (Lovett et al., 2005) supplements the word identification strategies with a set of complementary text comprehension strategies. The goal throughout is to equip the children with the skills and strategies they need to become fluent and enthusiastic readers.

In the PHAB+RAVE-O Program, children learn an assortment of metacognitive word-tricks to help them quickly recognize and segment syllable patterns, common affixes, and their associated meanings. The ‘Sam Spade’ strategies target accuracy in lexical retrieval, and three specific comprehension strategies aid prediction, comprehension monitoring, and integration of independent thinking about the text.

Both multiple component programs were successful in demonstrating generalized gains in reading skill that were evident in decoding and word recognition, text reading accuracy, reading rate, and reading comprehension. It might be argued that part of the superiority of both interventions relative to the phonological control condition is directly due to the inclusion of strategy training and metacognitive components in their instructional designs.

Cognitive-Affective and Motivational Elements of Effective Intervention.

There are many aspects of the multiple component interventions to which their efficacy can be attributed. One of the most important may be that different explicit therapeutic elements are woven into the instructional content of lessons in both programs. Integral to the success of the PHAST and the PHAB+RAVE-O Programs are methods to enhance self-esteem around the reading task and to foster engagement with language and print.

The PHAST Program deliberately undertakes the retraining of unproductive attributions and misguided beliefs about efforts and achievement, attempting to build perceptions of self-efficacy around the reading task and other learning challenges. Specific attributional retraining is woven into the strategy dialogue structure in every PHAST lesson format. Children learn that success on a task is a matter of whether the appropriate strategy was selected and applied, and whether they were flexible and persisted when first attempts were unsuccessful. Another therapeutic component of the PHAST Program involves its use of low-frequency complex multisyllabic words as ‘challenge’ words on which the children practice their strategies. Children who previously struggled with one-syllable words work through such ‘college words’ as “unintelligible”, in preparation for more sophisticated texts.

In a similar vein, the power of engagement with language is an implicitly therapeutic focus of the RAVE-O intervention, along with an emphasis on incremental success at each step of learning. Daily lessons include opportunities for the teacher and children to ‘play with’ the multiple dimensions of words, while simultaneously giving them successes in reading them. Imaginative and whimsical activities are incorporated in the instruction, with a “novel mnemonic” provided for each type of metacognitive strategy that helps memory and retrieval. The teacher’s own love and knowledge of language is actively used to engage the children in new attitudes towards language and reading. Children are encouraged to think for themselves while reading text, and in the process to view themselves as successful learners.

Much remains unmeasured that is relevant to understanding individual and group differences in intervention response. Instructional group emerged in our results as an important and highly significant fixed effect in predicting outcomes and growth both during the intervention period and even during the one year following intervention. This cannot be dismissed as a teacher effect, since participating teachers taught multiple programs within the design. Rather the relationships and dynamic within the group and between the group and the teacher likely resulted in differences both in implementation variables, such as pacing of instruction, and in a wealth of contextual, motivational, and relational variables that affected the children’s engagement, motivation, and attributions about the program and their own progress.

Recent work by Frijters at our Toronto site (Frijters et al., 2004; Frijters, De Palma, Barron, & Lovett, 2005) indicates that motivational differences among disabled readers mediates their response to intervention. Frijters’ work confirms that motivation for reading is not a unitary construct and that different pre-intervention motivational profiles can be identified in children with RD. These profiles predict responsiveness to remediation, indicating that motivation mediates remedial response. In addition, motivation appears to be amenable to modification in its interaction with intervention (Frijters et al., 2005; Frijters, Dodsworth, Lovett, Sevcik, & Morris, 2009).

There are significant limitations to the present study that must be acknowledged. As noted earlier, the phonological control condition was not equated for amount of reading intervention time with the two multiple component interventions. We have argued that the 70-hour phonological-only condition from our previous work provides this comparison historically, but the comparison is outside the present design. We are limited therefore in the conclusions we can reach based on results from the phonological-only comparison. We are also limited in our ability to measure changes in reading comprehension and reading fluency. Measures of these aspects of reading skill are not as well-developed as those available for the assessment of word identification and decoding processes. Finally, although we report clear effects attributable to instructional group, we lack the ability to interpret these effects with our current battery, the program observations, and the lesson dairies completed each day.

Despite these limitations, the present research demonstrates generalization of program benefits across a far broader population of disabled readers than ever assessed before. Results reveal that systematic, intense, linguistically-informed interventions are associated with positive outcomes for young impaired readers of high or low IQ and from a range of ethnic backgrounds and environmental circumstances. Interventions that incorporate multiple components of language and that target a range of core deficits consistently produce superior effects to control programs that emphasize predominantly phonologically-based reading instruction or alternative academic programming. These advantages are seen across the entire range of reading skills, including fluency and comprehension, historically the most difficult to facilitate.

Positive results following both PHAB+RAVE-O and PHAST highlight the significance of teaching all struggling readers about the structure of their language from phonological and orthographic structure within syllables, to variable pronunciations of vowels and vowel combinations, to semantic knowledge of words and morphemes. Successful remediation enables language learning across different oral and written language systems, and enhances motivation and involvement. In the process, these forms of multidimensional intervention equip children both with the critical desire to learn and also with a metalinguistic knowledge base that gives them a never before experienced “edge” over many, more able readers in their classrooms.

Acknowledgments

The research reported here was supported by a National Institutes of Child Health and Human Development Grant (HD30970) to Georgia State University, Tufts University and The Hospital for Sick Children/University of Toronto.

In Atlanta, Boston, and Toronto, we are especially grateful for the 305 original children who participated in these remedial programs for their interest, enthusiasm, and effort. There were many other children who were screened to be in this program whom we also thank. We also gratefully acknowledge their parents, teachers, and schools for their commitment and support during the course of this study. The cooperation and contribution of the principals and staff of all participating schools, all of whom offered space and opportunities for our programs, are much appreciated.

In Atlanta, we acknowledge the students and families from the Fulton County School system, administrators, especially Nancy Shelley, participating schools, their principals and staffs, particularly Susan Grabel; our research teachers - Eileen Cohen, Mary Bucklen, Sonja Ross, Marsha Harps, Sharon Hill, Brenda Everson, Phyllis McNeal; and members of our research team - Paul Cirino, Christopher Chin, Fontina Rashid, Heloise Ledesma, Amy Smith, Ayanay Smith, Nicole Mickley, Becky Doyle, Justin Wise, Christopher Wolfe, Hye K. Pae, Cynthia Arrington, Janet Montgomery, Jennifer Harrison, Lisa Norris, Kelly Cukrowicz, and Laina Jones.

In Boston, we acknowledge the students and their families from Medford, Somerville, Dorchester schools; our research teachers - Katharine Donnelly-Adams, Terry Joffe, Joanna Christodoulou, Fran Lunney, Anne Knight, Alice O’Rourke; and members of our research team - Kathleen Biddle, Terry Deeney, Beth O’Brien, Julie Jeffery, Lynne Miller, Alyssa Goldberg O’Rourke, Chip Gidney, Wendy Galante, Tami Katzir, Joanna Christodoulou, and Gordon Goodman.

In Toronto, we acknowledge the students and their families from the Toronto District School Board, the Toronto Catholic District School Board, and the Peel District School Board; our research teachers – Lea Lacerenza, Susan Borden, Loretta Lapa, Phillipa Beggs, Kim Lewis, Gail Markson, Denis Murphy, Jody Chong, Tammy Cohen, Vicky Grondin; our research team members- Maria De Palma, Meredith Temple, Naomi Oton, and the late Nancy Benson.

Footnotes

1

Not all children who met either a LA or DISC criteria were entered into the remediation study, because the study design called for a very explicit sampling strategy. It should be noted that because of some limited attrition (8.5%) during the intervention year (see Figure 1), there was an attempt to replace lost subjects in specific sample cells during the following school year. Data from children who left the study during the remediation program are not included in any results presented here, although attrition analysis did not suggest attrition to be systematic in any obvious way. Eleven percent left the study during the year that followed the remediation; no attempt was made to replace these children in the study because they had received the full remediation program and evaluations related to it. Their data were lost to the follow-up analysis. Attrition analysis did not identify any systematic relationships with these students and other demographic or academic attributes. The stringency of the design resulted at times in situations where no children were available to meet the needs of a particular cell from a given school; over-selection, therefore, occurred in some sampling cells in order to ensure consistent instructional group sizes throughout the study. Out of the 279 students (see Figure 1) who completed the full year of intervention (in either the math or reading groups), 23 (11%) of students were not available for follow-up testing one year later. Out of the 68 students who initially received MATH+CSS, 9 (13%) were not available for the additional year of (reading) intervention and 7 more (10%) were not available for the follow-up testing one year later. Attrition analysis did not identify any systematic relationships with these students and other demographic or academic attributes.

Contributor Information

Robin D. Morris, Department of Psychology, Georgia State University, Atlanta, GA

Maureen W. Lovett, Learning Disabilities Research Program, The Hospital for Sick Children, Toronto, Ontario

Maryanne Wolf, Center for Reading and Language Research, Tufts University, Medford, MA..

Rose A. Sevcik, Department of Psychology, Georgia State University, Atlanta, GA

Karen A. Steinbach, Learning Disabilities Research Program, The Hospital for Sick Children, Toronto, Ontario

Jan C. Frijters, Learning Disabilities Research Program, The Hospital for Sick Children, Toronto, Ontario

Marla Shapiro, Department of Psychology, Georgia State University, Atlanta, GA.

References

  1. Archer A, & Gleason M.(1991). Skills for School Success. North Billerica, MA: Curriculum Associates, Inc. [Google Scholar]
  2. Badian NA (1983). Dyscalculia and nonverbal disorders of learning. In Myklebust HR (Ed.), Progress in Learning Disabilities (Vol. 5, pp. 235–264). New York, NY: Grune & Stratton Publishers. [Google Scholar]
  3. Barzillai M, Wolf M, Lovett MW, & Morris R.(in preparation). The role of semantic processes and semantic flexibility in reading development. [Google Scholar]
  4. Beck IL, & McKeown MG (2006). Improving Comprehension with Questioning the Author. New York, NY: Scholastic Inc. [Google Scholar]
  5. Beck IL, McKeown MG, & Kucan L.(2002). Bringing Words to Life: Robust Vocabulary Instruction. New York, NY: The Guilford Press. [Google Scholar]
  6. Benson NJ (2000). Analysis of specific deficits: Evidence of transfer in disabled and normal readers following oral-motor awareness training. Journal of Educational Psychology, 92(4), 646–658. [Google Scholar]
  7. Benson NJ, Lovett MW, & Kroeber CL (1997). Training and transfer-of-learning effects in disabled and normal readers: Evidence of specific deficits. Journal of Experimental Child Psychology, 64(3), 343–366. [DOI] [PubMed] [Google Scholar]
  8. Berninger VW, Abbott RD, Billingsley F, & Nagy W.(2001). Processes underlying timing and fluency of reading: Efficiency, automaticity, coordination, and morphological awareness. In Wolf M.(Ed.), Dyslexia, Fluency, and the Brain (pp. 383–413). Timonium, MD: York Press, Inc. [Google Scholar]
  9. Biancorosa G, & Snow CE (2006). Reading Next: A Vision for Action and Research in Middle and High School Literacy: Report for the Alliance for Excellent Education to the Carnegie Corporation of New York. http://www.all4ed.org/publications/ReadingNext/ReadingNext.pdf.
  10. Biemiller A.(1999). Language and Reading Success. Cambridge, MA: Brookline. [Google Scholar]
  11. Biemiller A.(2001). Teaching vocabulary: Early, direct, and sequential. American Educator, 25, 24–29. [Google Scholar]
  12. Blishen BR, Carroll WK, & Moore C.(1987). The 1981 socioeconomic index for occupations in Canada. Canadian Review of Sociology and Anthropology, 24, 465–488. [Google Scholar]
  13. Bowers P, Golden J, Kennedy A, & Young A.(1994). Limits upon orthographic knowledge due to processes indexed by naming speed. In Berninger VW (Ed.), The Varieties of Orthographic Knowledge I: Theoretical and Developmental Issues (pp. 173–218). Dordrecht, The Netherlands: Kluwer. [Google Scholar]
  14. Carlisle JF, & Rice MS (2002). Improving reading comprehension: Research-based principles and practices. Baltimore, MD: York Press. [Google Scholar]
  15. Cirino PT, Chin CE, Sevcik RA, Wolf M, Lovett MW, & Morris RD (2002). Measuring socioeconomic status: Reliability and preliminary validity for different approaches. Assessment, 9(2), 145–155. [DOI] [PubMed] [Google Scholar]
  16. Clarke P, Hulme C, & Snowling MJ (2005). Individual differences in RAN and reading: A response timing analysis. Journal of Research in Reading, 28, 73–86. [Google Scholar]
  17. Collins WM, & Levy BA (2008). Developing fluent text processing with practice: Memorial influences on fluency and comprehension. Canadian Psycology, 49(2), 133–139. [Google Scholar]
  18. Compton DL, DeFries JC, & Olson RK (2001). Are RAN- and phonological awareness-deficits additive in children with reading disabilities? Dyslexia, 7, 125–149. [DOI] [PubMed] [Google Scholar]
  19. Edwards-Hewitt T, & Gray JJ (1995). Comparison of measures of socioeconomic status between ethnic groups. Psychological Reports, 77(2), 699–702. [Google Scholar]
  20. Ehri LC (1997). Sight word learning in normal readers and dyslexic. In Blachman BA (Ed.), Foundations of Reading Acquisition and Dyslexia: Implications for Early Intervention (pp. 163–189). Mahwah, NJ: Lawrence Erlbaum Associates. [Google Scholar]
  21. Engelmann S, & Bruner EC (1988). Reading Mastery I/II Fast Cycle: Teacher's Guide. Chicago, IL: Science Research Associates, Inc. [Google Scholar]
  22. Entwisle DR, & Astone NM (1994). Some practical guidelines for measuring youth's race/ethnicity and socioeconomic status. Child Development, 65(6), 1521–1540. [Google Scholar]
  23. Fletcher JM, Lyon GR, Fuchs LS, & Barnes MA (2007). Learning Disabilities: From Identification to Intervention. New York, NY: Guilford Press. [Google Scholar]
  24. Fletcher JM, Morris RD, & Lyon GR (2003). Classification and definition of learning disabilities: An integrative perspective. In Swanson HL, Harris KR & Graham S.(Eds.), Handbook of Learning Disabilities (pp. 30–56). New York, NY: Guilford Press. [Google Scholar]
  25. Fletcher JM, Shaywitz SE, Shankweiler DP, Katz L, Liberman IY, Stuebing KK, et al. (1994). Cognitive profiles of reading disability: Comparisons of discrepancy and low achievement definitions. Journal of Educational Psychology, 86(1), 6–23. [Google Scholar]
  26. Foorman BR, Francis DJ, Fletcher JM, Schatschneider C, & Mehta P.(1998). The role of instruction in learning to read: Preventing reading failure in at-risk children. Journal of Educational Psychology, 90(1), 37–55. [Google Scholar]
  27. Francis DJ, Shaywitz SE, Stuebing KK, Shaywitz BA, & Fletcher JM (1996). Developmental lag versus deficit models of reading disability: A longitudinal, individual growth curves analysis. Journal of Educational Psychology, 88(1), 3–17. [Google Scholar]
  28. Frijters JC, Barron RW, Lovett MW, Steinbach KA, Morris RD, & Wolf M.(2004). Motivational profiles of reading disabled children: Diagnostoc profiles predicting remedial response. Paper presented at the 8th Biennial Meeting of the International Society for the Study of Behavioural Development (ISSBD), Belgium. [Google Scholar]
  29. Frijters JC, De Palma M, Barron RW, & Lovett MW (2005). Motivation as a moderator of response to remedial reading instruction: A (modifiable) aptitude x treatment interaction. Paper presented at the 12th Annual Meeting of the Society for the Scientific Study of Reading, Toronto, ON. [Google Scholar]
  30. Frijters JC, Dodsworth H, Lovett MW, Sevcik RA, & Morris RD (2009). Multiple-component intervention modifies reading-disabled students’ self-reported attributions of success and failure. Paper presented at the 16th Annual Meeting of the Society for the Scientific Study of Reading. [Google Scholar]
  31. Gaskins IW, Downer MA, & Gaskins RW (1986). Introduction to the Benchmark School Word Identification/Vocabulary Development Program. Media, PA: Benchmark School. [Google Scholar]
  32. German DJ (1992). Word-finding intervention for children and adolescents. Topics in Language Disorders, 13(1), 33–50. [Google Scholar]
  33. Gersten R, Fuchs LS, Williams JP, & Baker S.(2001). Teaching reading comprehension strategies to students with learning disabilities: A review of the research. Review of Educational Research, 71, 279–320. [Google Scholar]
  34. Guthrie JT, Hoa ALW, Wigfield A, Tonks SM, Humenick NM, & Littles E.(2007). Reading motivation and reading comprehension growth in the later elementary years. [Journal; Peer Reviewed Journal]. Contemporary Educational Psychology, 32(3), 282–313. [Google Scholar]
  35. Guthrie JT, Wigfield A, Barbosa P, Perencevich KC, Taboada A, Davis MH, et al. (2004). ncreasing reading comprehension and engagement through Concept-Oriented Reading Instruction. Journal of Educational Psychology, 96, 403–423. [Google Scholar]
  36. Harris KR, Graham S, & Pressley M.(1992). Cognitive-behavioral approaches in reading and written language: Developing self-regulated learners. In Singh NN & Beale IL (Eds.), Learning Disabilities: Nature, Theory, and Treatment (pp. 415–451). New York, NY: Springer-Verlag. [Google Scholar]
  37. Henry M.(2003). Unlocking Literacy: Effective Decoding and Spelling Instruction. Baltimore, MD: Brookes Publishing. [Google Scholar]
  38. Johnston AM, Barnes MA, & Desrochers A.(2008). Reading comprehension: Developmental processes, individual differences, and interventions. Canadian Psycology, 49(2), 125–132. [Google Scholar]
  39. Juel C.(2005). The impact of early school experiences on initial reading. In Dickinson DK & Neuman SB (Eds.), Handbook of Early Literacy Research (Vol. II). New York, NY: Guilford Press. [Google Scholar]
  40. Katzir T, Kim Y-S, Wolf M, Morris RD, & Lovett MW (2008). The varieties of pathways to dysfluent reading: Comparing subtypes of children with dyslexia at letter, word, and connected text levels of reading. Journal of Learning Disabilities, 41(1), 47–66. [DOI] [PubMed] [Google Scholar]
  41. Kaufman AS, & Kaufman AL (1990). Kaufman Brief Intelligence Test. Circle Pines, MN: American Guidance Service, Inc. [Google Scholar]
  42. Keenan JM, Betjemann RS, & Olson RK (2008). Reading comprehension tests vary in the skills they assess: Differential dependence on decoding and oral comprehension. Scientific Studies of Reading, 12, 281–300. [Google Scholar]
  43. Klauda SL, & Guthrie JT (2008). Relationships of three components of reading fluency to reading comprehension. Journal of Educational Psychology, 100(2), 310–321. [Google Scholar]
  44. Levy BA (2001). Moving the bottom: Improving reading fluency. In Wolf M.(Ed.), Dyslexia, Fluency, and the Brain (pp. 357–382). Parkton, MD: York Press. [Google Scholar]
  45. Levy BA, Abello B, & Lysynchuk L.(1997). Transfer from word training to reading in context: Gains in reading fluency and comprehension. Learning Disability Quarterly, 20(3), 173–188. [Google Scholar]
  46. Lombardino LJ, Morris D, Mercado L, DeFillipo F, Sarisky C, & Montgomery A.(1999). The Early Reading Screening Instrument: A method for identifying kindergarteners at risk for learning to read. International Journal of Language & Communication Disorders, 34(2), 135–150. [DOI] [PubMed] [Google Scholar]
  47. Lovett MW, Borden SL, DeLuca T, Lacerenza L, Benson NJ, & Brackstone D.(1994). Treating the core deficits of developmental dyslexia: Evidence of transfer-of-learning following phonologically- and strategy-based reading training programs. Developmental Psychology, 30(6), 805–822. [Google Scholar]
  48. Lovett MW, Lacerenza L, & Borden SL (2000). Putting struggling readers on the PHAST track: A program to integrate phonological and strategy-based remedial reading instruction and maximize outcomes. Journal of Learning Disabilities, 33(5), 458–476. [DOI] [PubMed] [Google Scholar]
  49. Lovett MW, Lacerenza L, Borden SL, Frijters JC, Steinbach KA, & De Palma M.(2000). Components of effective remediation for developmental reading disabilities: Combining phonological and strategy-based instruction to improve outcomes. Journal of Educational Psychology, 92(2), 263–283. [Google Scholar]
  50. Lovett MW, Lacerenza L, De Palma M, Benson NJ, Steinbach KA, & Frijters JC (2008). Preparing teachers to remediate reading disabilities in high school: What is needed for effective professional development? Teaching and Teacher Education, 24(4), 1083–1097. [Google Scholar]
  51. Lovett MW, Lacerenza L, Murphy D, Steinbach KA, De Palma M, & Frijters JC (2005). The importance of multiple-component interventions for children and adolescents who are struggling readers. In Gilger J.& Richardson S.(Eds.), Research-Based Education and Intervention: What We Need To Know (pp. 67–102). Baltimore, MD: International Dyslexia Association. [Google Scholar]
  52. Lovett MW, Ransby MJ, Hardwick N, Johns MS, & Donaldson SA (1989). Can dyslexia be treated? Treatment-specific and generalized treatment effects in dyslexic children's response to remediation. Brain and Language, 37, 90–121. [DOI] [PubMed] [Google Scholar]
  53. Lovett MW, Warren-Chaplin PM, Ransby MJ, & Borden SL (1990). Training the word recognition skills of reading disabled children: Treatment and transfer effects. Journal of Educational Psychology, 82, 769–780. [Google Scholar]
  54. Lyon GR (1999). Statement of Dr. G. Reid Lyon. April 28, 1998: Overview of reading and literacy initiatives. Novato, CA: Arena Press. [Google Scholar]
  55. Lyon GR, & Moats LC (1997). Critical conceptual and methodological considerations in reading intervention research. Journal of Learning Disabilities, 30(6), 578–588. [DOI] [PubMed] [Google Scholar]
  56. Mason LH (2004). Explicit self-regulated strategy development versus reciprocal questioning: Effects on expository reading comprehension among struggling readers. Journal of Educational Psychology, 96(2), 283–296. [Google Scholar]
  57. McBride-Chang C, & Manis FR (1996). Structural invariance in the associations of naming speed, phonological awareness, and verbal reasoning in good and poor readers: A test of the double deficit hypothesis. Reading and Writing: An Interdisciplinary Journal, 8, 323–339. [Google Scholar]
  58. Moats LC (2001). When older students canť read. Educational Leadership, 58(6), 36–40. [Google Scholar]
  59. Moats LC (2004). Language Essentials for Teachers of Reading and Spelling (LETRS), Module 2, The Speech Sounds of English, and Module 3, Spellography for Teachers. Longmont, CO: Sopris West Educational Services. [Google Scholar]
  60. Moats LC, & Foorman BR (1997). Introduction to special issue of SSR: Components of effective reading instruction. Scientific Studies of Reading, 1(3), 187–189. [Google Scholar]
  61. Morris RD, Stuebing KK, Fletcher JM, Shaywitz SE, Lyon GR, Shankweiler DP, et al. (1998). Subtypes of reading disability: Variability around a phonological core. Journal of Educational Psychology, 90(3), 1–27. [Google Scholar]
  62. Nakao K, & Treas J.(1992). 1989 Socioeconomic Index of Occupations: Construction from the 1989 Occupational Prestige Scores. General Social Survey Methodological Report No 74. Chicago, IL: National Opinion Research Cener. [Google Scholar]
  63. National Reading Panel (NRP)—Report of the Subgroups (2000). Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction. Washington, DC: National Institute of Child Health and Human Development; (NIH Pub. No. 004754). [Google Scholar]
  64. Olson RK, Wise B, Ring J, & Johnson M.(1997). Computer-based remedial training in phoneme awareness and phonological decoding: Effects on the posttraining development of word recognition. Scientific Studies of Reading, 1(3), 235–254. [Google Scholar]
  65. Perfetti CA (1992). The representation problem in reading acquisition. In Gough PB, Ehri LC & Treiman R.(Eds.), Reading Acquisition (pp. 145–174). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc. [Google Scholar]
  66. Rayner K, Foorman BR, Perfetti CA, Pesetsky D, & Seidenberg MS (2001). How psychological science informs the teaching of reading. Psychological Science in the Public Interest, 2(2), 31–74. [DOI] [PubMed] [Google Scholar]
  67. Scanlon DM, & Vellutino FR (1997). A comparison of the instructional backgrounds and cognitive profiles of poor, average, and good readers who were initially identified as at risk for reading failure. Scientific Studies of Reading, 1(3), 191–216. [Google Scholar]
  68. Schatschneider C, Carlson CD, Francis D J., Foorman, B.R., & Fletcher, J.M. (2002). Relationship of rapid automatized naming and phonological awareness in early reading development: Implications for the double-deficit hypothesis. Journal of Learning Disabilities, 35(3), 245–256. [DOI] [PubMed] [Google Scholar]
  69. Shaywitz SE, Fletcher JM, Holahan JM, Shneider AE, Marchione KE, Stuebing KK, et al. (1999). Persistence of dyslexia: The Connecticut longitudinal study at adolescence. Pediatrics, 104(6), 1351–1359. [DOI] [PubMed] [Google Scholar]
  70. Shaywitz SE, Morris R, & Shaywitz B.(2008). The education of dyslexic children from childhood to young adulthood. Annual Review of Psychology, 59, 451–475. [DOI] [PubMed] [Google Scholar]
  71. Snow CE (2002). Reading for understanding: Toward an R&D program in reading comprehension (pp. Prepared for the Office of Education Research and Improvement, Science and Technology Policy Institute). Santa Monica, CA: RAND Reading Study Group, RAND Corporation. [Google Scholar]
  72. Snow CE, & Juel C.(2005). Teaching children to read: What do we know about how to do it? In Snowling MJ & Hulme C.(Eds.), Science of Reading: A Handbook (pp. 501–520). Malden, MA: Blackwell. [Google Scholar]
  73. Snowling MJ, & Hulme C.(1993). Developmental dyslexia and language disorders. In Blanken G, Dittmann J, Grimm H, Marshall JC & Wallesch C-W (Eds.), Linguistic Disorders and Pathologies: An International Handbook (pp. 724–732). New York: Walter de Gruyter. [Google Scholar]
  74. Snowling MJ, & Hulme C.(2005). Learning to read with a language impairment. In Snowling MJ & Hulme C.(Eds.), The Science of Reading: A Handbook (pp. 397–412). Oxford: Blackwell. [Google Scholar]
  75. Stage SA, Abbott RD, Jenkins JR, & Berninger VW (2003). Predicting response to early reading intervention from verbal IQ, reading-related language abilities, attention ratings, and verbal IQ-word reading discrepancy: Failure to validate discrepancy method. Journal of Learning Disabilities, 36(1), 24–33. [DOI] [PubMed] [Google Scholar]
  76. Stanovich KE (1985). Explaining the variance in reading ability in terms of psychological processes: What have we learned. Annals of Dyslexia, 35, 67–96. [DOI] [PubMed] [Google Scholar]
  77. Swanson HL, Hoskyn M, & Lee C.(1999). Interventions for Students with Learning Disabilities: A Meta-Analysis of Treatment Outcomes. New York, NY: The Guilford Press. [Google Scholar]
  78. Swanson HL, & Saez L.(2003). Memory difficulties in children and adults with learning disabilities. In Swanson HL, Harris KR & Graham S.(Eds.), Handbook of Learning Disabilities (pp. 182–198). New York, NY: Guilford Press. [Google Scholar]
  79. Swanson HL, & Siegel LS (2001). Learning disabilities as a working memory deficit. Issues in Education: Contributions from Educational Psychology, 7(1), 1–48. [Google Scholar]
  80. Tan A, & Nicholson T.(1997). Flashcards revisited: Training poor readers to read words faster improves their comprehension of text. Journal of Educational Psychology, 89(2), 276–288. [Google Scholar]
  81. Tan LH, Spinks JA, Eden G, Perfetti CA, & Siok WT (2005). Reading depends on writing, in Chinese. Proceedings of the National Academy of Science, 102, 8781–8785. [DOI] [PMC free article] [PubMed] [Google Scholar]
  82. Torgesen JK (1996). Phonological Awareness: A Critical Factor in Dyslexia. Baltimore, MD: Orton Dyslexia Society. [Google Scholar]
  83. Torgesen JK, Alexander AW, Wagner RK, Rashotte CA, Voeller KKS, & Conway T.(2001). Intensive remedial instruction for children with severe reading disabilities: Immediate and long-term outcomes from two instructional approaches. Journal of Learning Disabilities, 34(1), 33–58. [DOI] [PubMed] [Google Scholar]
  84. Torgesen JK, Rashotte CA, & Alexander AW (2001). Principles of fluency instruction in reading: Relationships with established empirical outcomes. In Wolf M.(Ed.), Dyslexia, Fluency, and the Brain (pp. 333–355). Timonium, MD: York Press, Inc. [Google Scholar]
  85. Torgesen JK, Wagner RK, & Rashotte CA (1997a). Approaches to the prevention and remediation of phonologically-based reading disabilities. In Blachman BA (Ed.), Foundations of Reading Acquisition and Dyslexia: Implications for Early Intervention (pp. 287–304). Mahwah, NJ: Lawrence Erlbaum Associates, Inc. [Google Scholar]
  86. Torgesen JK, Wagner RK, & Rashotte CA (1997b). Test of Word Reading Efficiency (TOWRE). Austin, TX: Pro-Ed. [Google Scholar]
  87. Torgesen JK, Wagner RK, & Rashotte CA (1999). Test of Word Reading Efficiency (TOWRE). Austin, TX: Pro-Ed. [Google Scholar]
  88. Torgesen JK, Wagner RK, Rashotte CA, Alexander AW, & Conway T.(1997). Preventive and remedial interventions for children with severe reading disabilities. Learning Disabilities: A Multidisciplinary Journal, 8, 51–62. [DOI] [PubMed] [Google Scholar]
  89. Torgesen JK., Wagner R, Rashotte C, Lindamood P, Rose E, Conway T, et al. (1999). Preventing reading failure in young children with phonological processing disabilities: Group and individual responses to instruction. Journal of Educational Psychology, 91(4), 579–593. [Google Scholar]
  90. US Department of Education: National Center for Education Statistics (2007). National Assessment of Educational Progress (NAEP): The Nation's Report Card, Reading 2007. Washington, DC: Institute of Education Sciences, US Department of Education. Retrieved on August 15, 2008 from http://nces.ed.gov/nationsreportcard/pubs/main2007/2007496.asp. [Google Scholar]
  91. Vaughn S, Chard DJ, Pedrotty-Bryant D, Coleman M, Tyler B-J, Linan-Thompson S, et al. (2000). Fluency and comprehension interventions for third-grade students. Remedial and Special Education, 21(6), 325–335. [Google Scholar]
  92. Vellutino FR, Scanlon DM, & Lyon R.(2000). IQ scores do not differentiate between difficult to remediate and readily remediated poor readers: More evidence against the IQ achievement discrepancy definition of reading disability. Journal of Learning Disabilities, 33, 223–238. [DOI] [PubMed] [Google Scholar]
  93. Vellutino FR, Scanlon DM, Sipay ER, Small SG, Pratt A, Chen R, et al. (1996). Cognitive profiles of difficult-to-remediate and readily remediated poor readers: Early intervention as a vehicle for distinguishing between cognitive and experiential deficits as basic causes of specific reading disability. Journal of Educational Psychology, 88(4), 601–638. [Google Scholar]
  94. Vukovic RK, & Siegel LS (2006). The role of working memory in specific reading comprehension difficulties. In Alloway TP & Gathercole SE (Eds.), Working Memory and Neurodevelopmental Disorders (pp. 89–112). New York, NY: Psychology Press. [Google Scholar]
  95. Wagner RK, Torgesen JK, & Rashotte CA (1994). Development of reading-related phonological processing abilities: New evidence of bidirectional causality from a latent variable longitudinal study. Developmental Psychology, 30(1), 73–87. [Google Scholar]
  96. Wagner RK, Torgesen JK, Rashotte CA, Hecht SA, Barker TA, Burgess SR, et al. (1997). Changing relations between phonological processing abilities and word-level reading as children develop from beginning to skilled readers: A five year longitudinal study. Developmental Psychology, 33(3), 468–479. [DOI] [PubMed] [Google Scholar]
  97. Wiederholt JL, & Bryant BR (1992). Gray Oral Reading Tests—3rd Edition (GORT-3). Austin, TX: Pro-Ed. [Google Scholar]
  98. Wigfield A, Guthrie JT, Perencevich KC, Taboada A, Klauda SL, McRae A, et al. (2008). The role of reading engagement in mediating effects of reading comprehension instruction on reading outcomes. Psychology in the Schools, 45, 432–445. [Google Scholar]
  99. Wilkinson GS (1993). Wide Range Achievement Test—3. Wilmington, DE: Jastak Associates. [Google Scholar]
  100. Williams JP (2005). Instruction in reading comprehension for primary-grade students: A focus on text structure. The Journal of Special Education, 39(1), 6–18. [Google Scholar]
  101. Williams JP, Hall KM, Lauer KD, Stafford KB, De Sisto LA, & deCani JS (2005). Expository text comprehension in the primary grade classroom. Journal of Educational Psychology, 97, 538–550. [Google Scholar]
  102. Williams JP, Nubla-Kung AM, Pollini S, Stafford KB, Garcia A, & Snyder AE (2007). Teaching cause-effect structure through social studies content to at-risk second graders. Journal of Learning Disabilities, 40, 111–120. [DOI] [PubMed] [Google Scholar]
  103. Wolf M, & Bowers PG (1999). The double-deficit hypothesis for the developmental dyslexias. Journal of Educational Psychology, 91(3), 415–438. [Google Scholar]
  104. Wolf M, & Bowers PG (2000). Naming-speed processes and developmental reading disabilities: An introduction to the special issue on the double-deficit hypothesis. Journal of Learning Disabilities, 33(4), 322–324. [DOI] [PubMed] [Google Scholar]
  105. Wolf M, & Goodglass H.(1986). Dyslexia, dysnomia, and lexical retrieval: A longitudinal investigation. Brain and Language, 28(1), 154–168. [DOI] [PubMed] [Google Scholar]
  106. Wolf M, & Goodman G.(Artist). (1996). Speed wizards [Computerized reading program]. [Google Scholar]
  107. Wolf M, & Katzir-Cohen T.(2001). Reading fluency and its intervention. Scientific Studies of Reading, 5(3), 211–239. [Google Scholar]
  108. Wolf M, Miller L, & Donnelly K.(2000). Retrieval, Automaticity, Vocabulary Elaboration, Orthography (RAVE-O): A comprehensive, fluency-based reading intervention program. Journal of Learning Disabilities, 33(4), 375–386. [DOI] [PubMed] [Google Scholar]
  109. Wolf M, & Obregon M.(1992). Early naming deficits, developmental dyslexia, and a specific deficit hypothesis. Brain and Language, 42, 219–247. [DOI] [PubMed] [Google Scholar]
  110. Woodcock RW (1987). Woodcock Reading Mastery Tests—Revised (WRMT-R). Circle Pines, MN: American Guidance Service. [Google Scholar]
  111. Wydell T, Vuorinen T, Helenius P, & Salmelin R.(2003). Neural correlates of letter-string length and lexicality during reading in a regular orthography. Journal of Cognitive Neuroscience, 15, 1052–1062. [DOI] [PubMed] [Google Scholar]
  112. Yates M, Locker L, & Simpson GB (2003). Semantic and phonological influences on the processing of words and pseudohomophones. Memory and Cognition, 31, 856–866. [DOI] [PubMed] [Google Scholar]

RESOURCES