Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2019 Jul 1.
Published in final edited form as: J Learn Disabil. 2017 Jun 9;51(4):320–335. doi: 10.1177/0022219417712016

Theorization and an Empirical Investigation of the Component-based and Developmental Text Writing Fluency Construct

Young-Suk Grace Kim 1, Brandy Gatlin 2, Stephanie Al Otaiba 3, Jeanne Wanzek 4
PMCID: PMC5711641  NIHMSID: NIHMS828746  PMID: 28597728

Abstract

We present and test our component-based and developmental view of text writing fluency, using data from children in Grades 2 and 3. We defined text writing fluency as efficiency and automaticity in writing connected texts which acts as a mediator between text generation (oral language) and transcription skills, and writing quality. In the beginning phase, text writing fluency would be largely constrained by transcription skills (spelling and handwriting) whereas oral language would also make an independent contribution to text writing fluency at a later phase. Furthermore, text writing fluency would have a stronger relation with writing quality at a later phase than at an earlier phase. Text writing fluency was operationalized using two CBM writing scores, percent correct word sequences, and correct minus incorrect word sequences. Results revealed that in Grade 2, only transcription skills were uniquely related to text writing fluency whereas in Grade 3, oral language was also related to text writing fluency. Text writing fluency was weakly related to writing quality in Grade 2 but it was strongly related in Grade 3 over and above oral language and transcription skills. In both grades, oral language and handwriting fluency were independently related to writing quality. These results largely support our developmental and component-based view of text writing fluency and its role in writing development. Theoretical and practical implications are discussed.

Keywords: Curriculum-based measures of writing, CBM writing, writing fluency, text writing fluency, writing quality

Theorization and an Empirical Investigation of the Component-based and Developmental Text Writing Fluency Construct

Now more than ever proficient writing is a key skill for academic and career success (Graham, Harris, & Hebert, 2011). However, a meager 30% of students in grades 8 and 12 performed at or above a proficient level on the most recent National Assessment of Educational Progress test (NAEP; National Center for Educational Statistics, 2012). The last time fourth graders were included, only 28% were at a proficient level on the NAEP (National Center for Education Statistics, 2003). Neither of these NAEP reports provided disaggregated writing data for students with learning disabilities, so little is known about their performance, but they are certainly less likely than students without disabilities to succeed in school, graduate from school, attend college, stay out of prison, or to attain jobs earning over $50,000 per year.

In the Writing Next Report, Graham and Perin (2007) argued that it is important to consider not only students identified as having a learning disability, but also those low-achieving writers, defined as “students whose writing skills are not adequate to meet classroom demands" (p. 3). Graham and Perrin also noted that while “some of these low-achieving writers have been identified as having learning disabilities, others are the “silent majority” who lack writing proficiency but do not receive additional help.” (p. 3) Arguably, the NAEP data indicate this is now a majority of students. Thus it is vital to identify struggling writers at the early stages of writing development, regardless of whether they are low-achieving or are identified with a LD, in order to intervene early so they can become proficient writers who will be college and career ready.

The combination of poor performance and a lack of common expectations has led to the Common Core State Standards (CCSS, National Governors Association Center for Best Practices & Council of Chief State School Officers, 2010). Though controversial, these standards remain in effect in more than 40 states and are driving changes to high stakes assessments. In writing, kindergarten students are expected to write several sentences with support by the end of the year. These expectations build across grade levels so that by Grade 4, students are expected to write both informative and exploratory essays to convey ideas, use facts, describe sequences of events, use transition words; and they should produce writing that is appropriate to different tasks and purposes (CCSS, 2010). Furthermore, the CCSS emphasize teachers should provide scaffolding and formative feedback to writers and specify that many of the standards will require adult guidance and support for the early grades (CCSS, 2010). To date, there remains a gap between these writing standards and writing assessments that can guide teachers’ ability to screen and progress monitor students in writing to inform writing instruction and intervention, particularly for low-achieving writers, including students with learning disabilities (Graham, Harris & Santangelo, 2015). In the present study, we conceptualized a theoretical model of writing fluency at the text level (i.e., text writing fluency), and tested it using two of the curriculum-based measurement writing measures.

Definition and theoretical conceptualization of text writing fluency

Two prominent theoretical models of developmental writing are the simple view of writing (Juel, Griffith, & Tunmer, 1986) and the not-so-simple view of writing (Berninger & Winn, 2006). The former states that writing is a function of two key component skills, transcription and ideation (also called text generation) (Berninger et al., 2002; Juel et al., 1986). Text generation is the process of generating ideas and encoding those ideas into oral language at various levels (word, sentence, and discourse), and therefore, necessarily requires oral language skills. Studies indeed have shown the relation of oral language skills to writing (Berninger & Abbott, 2010; Coker, 2006; Juel et al., 1986; Kim et al., 2011, 2014, 2015a, b; Olinghouse, 2008). Transcription, the process of encoding sounds into print including spelling and handwriting, has also been consistently related to writing (Abbott & Berninger, 1993; Berninger, Abbott, Abbott, Graham, & Richards, 2002; Berninger et al., 1997; Graham, Berninger, Abbott, Abbott, & Whitaker, 1997; Kim et al., 2011, 2014, 2015a, b). Thehe not-so-simple view of writing expanded the simple view of writing by adding two more component skills of writing, working memory and self-regulatory processes1, which are also supported by empirical evidence (Graham, McKeown, Kiuhara, & Harris, 2012; Hayes & Chenoweth, 2007; Kellogg, Olive, & Piolat, 2007; Limpo & Alves, 2013).

Although highly influential and instrumental, these models require further development in several aspects, one of which is the role of fluency in writing development. Fluency refers to automaticity and effortlessness in information processing (LaBerge & Samuels, 1974). In the current models of writing, fluency is explicitly recognized at the sublexical level, i.e., handwriting fluency. According to the information processing theory (Posner & Snyder, 1975; LaBerge & Samuels, 1974) and relevant evidence, however, fluency is a developmental phenomenon, encompassing various grain sizes including sublexical, lexical, and text or discourse levels, and fluency at lower level is necessary for achieving fluency at a higher level (Kame’enui, Simmons, Good, & Harn, 2001; Meyer & Felton, 1999; Wolf & Katzir-Cohen, 2001). In reading development, for instance, fluency has been examined at various levels including letter, word, and texts. In particular, fluency at the text or discourse level, text reading fluency (also widely known as oral reading fluency) has received much theoretical and empirical attention (Fuchs, Fuchs, Hosp, & Jenkins, 2001; Jenkins, Fuchs, van den Broek, Espin, & Deno, 2003;Kim, 2015a; Kim, Park, & Wagner, 2014; Kim, Wagner, & Foster, 2011; Kim &Wagner, 2015; Kuhn & Stahl, 2003; National Institute of Child Health and Human Development, 2000; Wolf & Katzir-Cohen, 2001).

The primary goal of the present study was to explore and develop theoretical conceptualization of writing fluency in connected texts (i.e., text writing fluency), and test it with empirical data. Ritchey and her colleagues recently defined writing fluency as “the ease with which an individual produces written text,” (Ritchey et al., 2015, p. 27; italics in original), and hypothesized that writing fluency draws on the two essential component skills of writing according to the simple view of writing, text generation and transcription. In the present study, we expand Ritchey et al.’s important, albeit preliminary, attempt to define, or characterize, writing fluency in several crucial ways. First, building on the Ritchey et al.’s conceptualization, our short definition of text writing fluency is ‘efficiency and automaticity in writing connected texts.’ Efficiency refers to both accuracy and speed of executing a target task (e.g., writing) while automaticity refers to speed, effortlessness, and lack of conscious awareness (Logan, 1997) and does not necessarily imply accuracy. Both efficiency and automaticity are a hallmark of proficiency in skill acquisition.

Writing requires a highly complex set of processes. Because higher-order processes such as producing texts place a great demand on cognitive capacity, it is important to be able to allocate one’s available mental resources to these high-order processes. This is possible when lower-level skills such as transcription (spelling and handwriting) acquire efficiency and automaticity. Although transcription skills are not typically considered attention-demanding for skilled writers (compared to generating and organizing ideas), for children who are developing transcription skills, transcription skills can place a great demand on cognitive capacity. Therefore, until children develop efficiency and automaticity in transcription skills, little cognitive resources may be available for higher-order processes. Effortful and laborious writing of connected text writing would tax and consume attentional resources and working memory capacity (see Perfetti’s [1985, 1992] efficiency account for reading for a similar argument). On the other hand, efficiency and automaticity in writing connected texts would release general cognitive processes to be available for higher-order processes such as planning and revising (e.g., connecting ideas and propositions across text, arranging them in a logical and smooth flow).

A critical point in our conceptualization of text writing fluency is specifying connected text beyond the sublexical and lexical levels (i.e., letter writing or spelling individual words) in efficiency and automaticity. This is theoretically important because inherent in connected texts are meaning processes that originate in context, and this context aspect is what separates text writing fluency from transcription skills (spelling and handwriting fluency). Writing connected texts requires meaning processes beyond the word level to produce cohesive and coherent connected texts. Efficiently producing written connected texts requires and is built not only on transcription skills, but also on meaning-related processes (e.g., producing meaningful, cohesive, and coherent ideas). Therefore, not only transcription skills, but also text generation or oral language would be necessary to support writing fluency. For this reason, the term, ‘text’ writing fluency, is used to accurately reflect our conceptualization because text writing fluency differentiates efficiency and automaticity in writing connected texts from proficiency or fluency in transcription skills which are typically operationalized as lexical or sublexical skills.

Aligned with Ritchey et al.’s speculation, we hypothesize that text writing fluency draws on the two component skills of writing, transcription and text generation. If text writing fluency facilitates writing by enabling cognitive resources to be used for higher order cognitive processes, and it draws on transcription and text generation, then, text writing fluency would play a mediating role, acting as a bridge to connect, at least partially, transcription skills and text generation with a criterion writing skill (i.e., writing quality; see Figure 1). An important corollary, then, is the nature of mediation – whether writing fluency completely or partially mediates the relation of transcription and oral language to writing quality.

Figure 1.

Figure 1

Developmental and component-based models of text writing fluency: Hypothesized relations among text generation (oral language), transcription skills (handwriting fluency and spelling), text writing fluency, and writing quality

Third and importantly, we hypothesize that the nature of these relations (text generation, transcription, text writing fluency, and writing quality) would change as children’s skills develop. In other words, the relations are dynamic as a function of development. During the beginning phase of writing development, children’s transcription skills would constrain their composition processes to a large extent, and therefore, much of children’s cognitive resources would be expended on transcription, leaving little available for higher order meaning related processes such as generating and translating ideas into oral language. Consequently, the relation of text generation to text writing fluency is expected to be weaker in the beginning phase of development. With development of transcription skills, children are able to utilize their cognitive resources for the text generation aspect to a greater extent, resulting in an increased contribution of text generation to text writing fluency. Text writing fluency would make a greater contribution to writing quality at a later phase of writing development because text writing fluency at a later phase captures not only transcription skills but also text generation skills. Therefore, text writing fluency would be a slightly different construct at different phases of writing development. Based on these hypotheses, our longer, developmental and componential definition of text writing fluency is as follows. Text writing fluency is the efficiency and automaticity in writing connected texts, and draws on transcription and text generation (or oral language skills). Fluent writers can write connected texts with accuracy, speed, and ease whereas dysfluent writers have difficulty generating connected texts, characterized by effortful and laborious transcription. In the beginning phase of development, text writing fluency is largely a function of or is constrained by transcription skills. With further development, however, text writing fluency is efficiency and automaticity in writing connected texts where transcription is accurate, rapid, and effortless, and cognitive resources such as attention and working memory can be allocated to meaning related processes, facilitating text generation processes.

Operationalization of text writing fluency

We tested the above noted theoretical model of text writing fluency by using two curriculum-based measurement writing scores, percent correct word sequences (%CWS) and correct minus incorrect word sequences (CIWS), given their alignment with our theorization of text writing fluency and empirical evidence. Curriculum-based measurement writing assessments (CBM writing hereafter) were developed to provide global indicators of children’ writing performance (Deno, Marston, & Mirkin, 1982) and to signal a need for further diagnostic assessments and intervention. In CBM writing assessments, children are typically asked to write for a brief time (e.g., 5 min) in response to prompts or pictures (Coker & Ritchey, 2010; McMaster, Du, & Pestursdottir, 2009; McMaster et al., 2011). Then, their compositions are evaluated using several indicators, including total number of words written, correct word sequences (two adjacent words that are grammatically correct and spelled correctly), incorrect word sequences, words spelled correctly, and derived scores such as %CWS(correct word sequences divided by total number of words written)CIWS (see Graham, Harris, & Hebert, 2011; McMaster & Espin, 2007 for reviews). CBM writing measures have shown to be reliable and valid (see Gansle, Noell, VanDerHeyden, Naquin, & Slider, 2002; Gansle et al., 2004; Jewell & Malacki, 2005; Lembke, Deno, & Hall, 2003; McMaster & Campbell, 2008; McMaster, Du, & Petursdotter, 2009; McMaster & Espin, 2007; McMaster, Ritchey, & Lembke, 2011 for reviews).

Indicators of text writing fluency as defined in this paper have to meet several criteria. First, writing tasks have to be at the connected text level, not at the sublexical or lexical levels. Second, the indicator should capture both speed and accuracy of connected text writing. That is, any measures that capture only speed or accuracy would not be sufficient. Therefore, total number of words written, which is included as part of CBM writing assessments, would be not an appropriate measure of the text writing fluency construct because it captures only the speed or productivity aspect, but not accuracy. In fact, total number of words written has been widely used as an indicator of writing productivity (Abbott & Berninger, 1993; Berman & Verhoevan, 2002; Kim et al., 2011; Kim, Al Otaiba, Sidler, Greulich, & Puranik, 2014; Kim, Al Otaiba, Wanzek, & Gatlin, 2015; Mackie & Dockrell, 2004; Puranik et al., 2008; Wagner et al., 2011) although several previous studies used the term, fluency, to describe the total number of words written (e.g., Abbott & Berninger, 1993; Berninger et al., 2002; Graham et al., 1997).

Third, our conceptualization of text writing fluency as well as Ritchey et al.’s (2015) hypothesize that text writing fluency draws on both transcription and text generation (oral language skills). Indicators such as correct word sequences and incorrect word sequences do capture both transcription and oral language because grammatical accuracy is captured in these indicators. However, correct and incorrect word sequences are confounded by the amount of writing – children who write more are likely to have greater number of correct or incorrect word sequences and the other way around. In contrast, %CWS and CIWS account for amount of writing (see the Method section). Moreover, %CWS and CIWS have been shown to have strong validity evidence (Amato & Watkins, 2011; McMaster & Espin, 2007), including children in primary grades (Jewell & Malacki, 2005; Lembke et al., 2003; Weissenburger & Espin, 2005). For instance, CIWS was moderately to strongly related to teacher’s holistic evaluation of writing (.65 ≤ rs ≤.78) as well as researcher’s evaluation of students’ writing samples for children in Grades 2 and 3 (.53 ≤ rs ≤.84; Lembke et al., 2003). %CWS and CIWS were moderately and fairly strongly (.41 ≤ rs ≤.67) related to SAT language scores (which captures proficiency in mechanics and expression) for students in Grades, 2, 4, and 6 (Jewell & Malacki, 2005). In the present study, we explicitly tested whether writing quality (operationalized as quality of ideas and organization), text writing fluency (operationalized as %CWS and CIWS), and writing productivity (total number of words written) are related but dissociable constructs or they capture a single writing construct, or two constructs composed of writing quality (quality of ideas and organization) versus text writing fluency (%CWS, CIWS, and total number of words written).

In summary, to measure our conceptualization of text writing fluency, writing assessment has to use ‘tasks’ at the connected text level with a reasonable time limit while writing ‘evaluation’ should capture accuracy and speed of transcription and oral language.

Present study

We tested our theorization of text writing fluency by fitting the model shown in Figure 1, using data from children in Grades 2 and 3. Specifically, we hypothesized that text writing fluency draws on text generation and transcription skills. However, text generation may contribute to text writing fluency to a greater extent at a later phase of development (Grade 3) than at an earlier phase of development (Grade 2). Furthermore, text writing fluency was hypothesized to mediate, at least partially, the relation between text generation and transcription skills, and writing quality. Finally, text writing fluency was expected to be more strongly related to writing quality as children develop skills (Grade 3 compared to Grade 2).

As noted above, text generation was operationalized as oral language skills because generated ideas are abstract, preverbal messages, and have to be translated to oral language before transcribed to written composition (Berninger et al., 2002; McCutchen, 2006; Kim et al., 2011). Oral language is a broad construct, encompassing word, sentence, and discourse level skills. Studies have shown that various aspects of oral language skills are related to writing: vocabulary and grammatical knowledge (Kim et al., 2011, 2014; Olinghouse, 2008), sentence comprehension (Berninger & Abbott, 2010), and oral retell and production (Berninger & Abbott, 2010; Juel, Griffith, & Tunmer, 1986; Kim & Schatschneider, in press). However, growing evidence indicates that discourse-level oral language skill such as listening comprehension or oral retell and production are higher-order skills that encompass foundational or lower level oral language skills such as vocabulary and grammatical skills (Florit, Roch, & Levorato, 2011, 2014; Kim, 2015b, 2016; Kim & Schatschneider, in press; Tunmer, 1989), foundational cognitive skills such as working memory, inhibitory control, and attention (Daneman & Merikle, 1996; Florit, Roch, Altoe, & Levorato, 2009; Kim, 2015b, 2016; Kim & Phillips, 2014), and higher-order cognitive skills such as inference, perspective taking and reasoning, and comprehension monitoring (Kendeou, Bohn-Gettler, White, & van den Broek, 2008; Kim, 2015b, 2016; Kim & Phillips, 2014; Kim & Schatschneider, in press; Lepola, Lynch, Laakkonen, Silvén, & Niemi, 2012; Strasser & del Rio, 2014; Tompkins, Guo, & Justice, 2013). In fact, the discourse-level oral language has been shown to completely mediate the relation of vocabulary, grammatical knowledge, inference, and perspective taking to writing (Kim & Schatschneider, in press).

Method

Data were drawn from cross-sectional samples of children in Grades 2 and 3 from 9 schools. Both samples were part of a longer longitudinal study following students reading and writing development across the elementary years. The students attended schools in a southeastern city that were recruited for the study purposefully, because they served a diverse population with a relatively high proportion from low socio-economic backgrounds. The second grade sample was composed of 234 children from 39 classrooms (46% boys; mean age = 8.27, SD = .38). Approximately 77% of the children were eligible for free and reduced lunch, and 6% had speech impairment and 4% had language impairment. Approximately 62% were African Americans, 25% were Caucasians, and 10% were multiracial. The third grade sample consisted of 260 children from 38 classrooms (56% boys; mean age = 9.26, SD = .37), and 74% of whom were eligible for free and reduced lunch. Approximately 3% had speech impairment and 4% had language impairment. The third grade sample was composed of 57% African Americans, 32% African Americans, and 6% multiracial. Less than 5% of the sample across the grades was English language learners.

Measures

Writing assessment

Children were administered three separate writing assessments. Each assessment was given in group format with a ten minute time limit. The first writing prompt was an experimental task used in previous studies (Kim et al., 2013, 2014; McMaster, Du, & Pestursdottir, 2009). In this task, children were instructed to write about a time when something unusual or interesting happened when they got home from school. Children were provided with the words “One day when I got home from school…” on ruled paper (One day prompt hereafter). The second writing task was the Essay Composition task of the Wechsler Individual Achievement Test – Third Edition (WIAT-III; Wechsler, 2005). In this task, children were asked to write about their favorite game and provide three reasons why they like their favorite game. Finally, for the Pet prompt, children were told to write a letter to their parents about an animal that they would like to have as a pet and to give reasons. Children were given 10 minutes to write for each prompt/task. Children’s written compositions were evaluated in terms of quality and CBM measures (see below).

Writing quality

Writing quality was coded on these tasks by examining quality of ideas and organization, based on previous studies (e.g., Graham, Berninger, & Fan, 2007; Graham, Harris, & Chorzempa, 2002; Hooper, Swartz, Wakely, de Kruif, & Montgomery, 2002; Olinghouse, 2008). We adapted the widely-used 6 + 1 Trait Rubric (see Northwest Regional Educational Laboratory, 2011, for scoring guide and examples) on a scale of 1 to 7. A score of 0 was assigned to unscoreable writing samples (e.g., those with random string of letters). Children’s compositions with detailed and rich ideas using unique or interesting perspectives were rated higher. For organization, compositions were evaluated in terms of logical sequence in overall structure (i.e., beginning, middle, and closing) and appropriate transitioning. Although a previous study has shown low reliability and validity of the 6+1 Trait approach (Gansle, VanDerHeyen, Noell, Resetar, & Williams, 2006), recent studies indicate that with rigorous training, high reliability is achievable (Kim et al., 2014, 2015). Furthermore, the four traits of the 6+1 trait approach, ideas, organization, word choice, and sentence fluency were shown to capture a single construct (Kim et al., 2014) and were related to standardized and normed writing tasks (Kim et al., 2015). In the present study, raters were graduate students and trained through several meetings before establishing reliability. In the initial meeting, the raters went over the rubric with the first author, scored sample compositions together. In the second meeting, raters brought independently rated written samples (approximately 15 samples), and discussed rationale for assigning a particular score and discussed discrepancies. Raters reconvened to discuss another set of 15 practice samples, before working on a reliability set. In the present study, inter-rater reliability was established with 45 writing pieces for each prompt2 (Note that this represented approximately 9% per prompt) across grades and ranged between .82 and .88 (Cohen’s kappa).

The Essay Composition subtest of the WIAT-III (Wechsler, 2005) was also scored according to conventional standards provided by the testing manual. Specifically, we used rules provided by the test authors for scoring the Theme Development and Text Organization (TDTO) component of the test. This scoring included an interactive analysis that consisted of assigning points based on each child’s inclusion of an introduction and conclusion and the number of separate paragraphs and transition words. The score also consisted of the number of valid reasons that the student included and elaborations on those reasons. The maximum raw score on TDTO is 20. The publisher reported a test-retest reliability coefficient of .83 for children in the elementary grades (Wechsler, 2005). In our sample, inter-rater reliability was established at the item level at .85 (agreements divided by the sum of agreements and disagreements) on 45 pieces of written sample. The Essay Composition task was moderately related to Sentence Composition (Wechsler, 2005), and a recent study showed that TDTO is best conceptualized as writing quality (Kim et al., 2015). Note that TDTO standard scores are available only for children in Grade 3 and above, and thus, in the present study standard scores are reported for children in Grade 3 only.

Text writing Fluency

As noted above, CIWS and %CWS of CBM writing were used in the present study. These were derived from correct word sequences and incorrect word sequences (Coker & Ritchey, 2010; Lembke, Deno, & Hall, 2003; McMaster, Du, & Pétursdôttir, 2009; McMaster et al., 2011, see Graham et al., 2011, and McMaster & Espin, 2007). %CWS is derived by dividing the number of correct word sequences by the total number of words written. CIWS is derived by subtracting the number of incorrect word sequences from the number of correct word sequences. Raters were trained by a master coder who had an extensive experience on CBM scoring, and went through a similar process described above for the writing quality evaluation.

Reliability was examined using 45 written samples for each writing prompt. The reliability coefficients were calculated by using an equation that produces quotients indicating scorer proximity to a primary coder for each of the components, a method that produces what is referred to as a similarity coefficient (Shrout & Fleiss, 1979). A similarity coefficient is appropriate for CBM writing scores because these data are quantitative (interval) not categorical (e.g., nominal and ordinal; Fleiss & Cohen, 1973). Each rater’s score for each of the components of CBM was compared to the primary coder’s score for the same component. If the two numbers were exactly the same, the reliability coefficient would be 1. If the two numbers were not the same, the smaller of the scores was divided by the larger number, producing a quotient between 0 and 1. For example, the primary rater gave a score of 126 correct word sequences while a second rater gave the same writing sample a score of 129 correct word sequences. The similarity coefficient for correct word sequences for this particular writing piece would be .98. The average coefficient for each of the CBM components among the 45 writing samples was then computed, and these ranged between .92 and .99. Differences found for the reliability set were discussed and resolved. Once reliability was established, the master coder conducted random spot checks throughout the study to ensure consistency in scoring is maintained.

Spelling

The Woodcock-Johnson Tests of Achievement – Third Edition (WJ-III; Woodcock, McGrew, & Gather, 2001) Spelling subtest was used. In this task, an assessor reads aloud an isolated list of words of increasing difficulty to each student. For the purposes of this study, testing procedures were slightly modified in order to accommodate for group testing, with children tested in groups of no more than six children. Children began at the pre-determined starting point for their respective grade provided by the test authors and basal and ceiling were established by carefully monitoring each student’s responses as the testing proceeded. As reported by the testing manual, using the split-half procedure, internal consistency reliability is high for the age group of the children included in this study (.88 – .91; McGrew, Schrank, & Woodcock, 2007). In addition, reliability among the sample was high and similar to that reported by the manual (Cronbach’s alpha = .90).

Handwriting fluency

Two tasks were used to assess handwriting fluency: The Alphabet Writing Fluency task of WIAT-III (Wechsler, 2005), and an experimental paragraph copying task. In the WIAT-III Alphabet Writing Fluency task, children were given 30 seconds to write as many letters of the alphabet as they can. The children were provided with the letter ‘a’ and were given one point for each additional, recognizable and correctly formed letter of the alphabet that they write. The publisher reported a test-retest reliability of .69 for children in Grade 2 and 3. In our sample, inter-rater reliability was established at .88 (Cohen’s kappa) on 45 pieces of children’ work. The Alphabet Writing Fluency task was weakly to fairly strongly related to spelling (r = .36) and written expression (r = .68), respectively (Wechsler, 2005).

In the paragraph copying task, children were instructed to copy words from the story “Can Buster Sleep inside Tonight?” (117 words) as fast and as neatly as they could. They were given one minute to copy as many words from the story which was provided to them on a separate sheet of paper. Scoring procedures for this measure included counting the number of words attempted and subtracting the number of errors, which provided the correct number of words for each student. Children were not given credit for incomplete or misspelled words or words with unrecognizable letters. Inter-rater reliability was established at .91 (Cohen’s kappa).

Oral language

Children’s oral language skill was assessed by two listening comprehension tasks and one vocabulary task: the Narrative Comprehension subtest of the Test of Narrative Language (TNL; Gillam & Pearson, 2004), the Listening Comprehension subtest of the Oral and Written Language Scales-2nd Edition (OWLS-II; Carrow-Woolfolk, 2011), and the Picture Vocabulary subtest of the Woodcock Johnson Test of Achievement – Third Edition (WJ-III; Woodcock, McGrew, & Mather, 2001). In the Narrative Comprehension subtest of TNL (Gillam & Pearson, 2004), the child listened to three short stories and was asked comprehension questions after each story. According to the examiner’s manual, the reported Narrative Comprehension portion of the TNL has an internal consistency of .87 and a test-retest reliability of .85. In the OWLS listening comprehension subtest, children listened to a stimulus sentence and were asked to point to one of four pictures that corresponds to the sentence read aloud by the tester. This subtest’s reported split-half internal reliability ranges from .96 to .97 for the age group of our sample. In the WJ-III Picture Vocabulary task (Woodcock et al., 2001), children were asked to orally identify various pictures of objects that increase in difficulty. Reliability for this subtest for our sample was .76 (Cronbach’s alpha).

Procedures

Children were assessed by trained research assistants in quiet spaces in the schools. Writing, spelling, and handwriting fluency tasks were administered in small groups. Oral language tasks were individually administered.

Data Analysis Strategy

Primary data analytic strategies included confirmatory factory analysis and structural equation modeling, using MPLUS 7.1 (Muthén & Muthén, 2013). Latent variables were created for the following constructs: writing quality, text writing fluency, handwriting fluency, and oral language. For spelling, a single task was used, and therefore, an observed variable was used in structural equation modeling. Model fits were evaluated by multiple indices, including chi-square statistics, comparative fit index (CFI), the Tucker-Lewis index (TLI), root mean square error of approximation (RMSEA), and standardized root mean square residuals (SRMR). Excellent model fits include RMSEA values below .08, CFI and TLI values equal to or greater than .95, and SRMR equal to or less than .05 (Hu & Bentler, 1999). TLI and CFI values greater than .90 are considered to be acceptable (Kline, 2005).

Results

Descriptive statistics and preliminary analysis

Table 1 displays descriptive statistics. Across the grades, children’s mean performances on the normed tasks were in the average range. For instance, children’s mean scores on the OWL-II listening comprehension (M = 101.40 for second graders; M = 98.11 for third graders) and WJ-III picture vocabulary (M = 98.74 for second graders; M = 99.13 for third graders) were in the average range. Similar trends were found for their spelling, alphabet writing fluency as well as WIAT writing score (theme development and text organization; third grade only).

Table 1.

Descriptive statistics

Variables 2nd grade 3rd grade MANOVA

M (SD) Min – Max M (SD) Min – Max Raw Score+
OWLS – raw 82.54 (11.00) 47 – 111 87.09 (10.71) 57 – 115 20.18, < .001
OWLS – SS 101.40 (12.47) 66 – 133 98.11 (13.47) 63 – 135
TNL (Narrative Comprehension) – raw 26.60 (4.89) 9 – 36 28.34 (4.60) 6 – 38 16.35, < .001
TNL (Narrative Comprehension) – SS 8.33 (2.73)++ 1 – 15 8.65 (3.07) 1 – 17
WJ-III Picture Vocabulary – raw 21.50 (3.19) 11 – 32 23.24 (3.16) 15 – 33 35.74, < .001
WJ-III Picture Vocabulary – SS 98.74 (10.61) 63 – 133 99.13 (10.41) 73 – 131
WJ-III Spelling – raw 28.82 (5.52) 14 – 46 32.64 (5.87) 21 – 51 54.81, < .001
WJ-III Spelling – SS 102.58 (13.92) 56 – 143 102.74 (14.45) 71 – 143
WIAT Alphabet Writing Fluency – raw 15.91 (6.04) 0 – 25 17.57 (6.35) 0 – 25 8.46, .004
WIAT Alphabet Writing Fluency - SS 104.62 (17.31) 43 – 136 104.82 (18.90) 40 – 130
Paragraph Copying 6.82 (3.42) 0 – 18 9.34 (4.69) 0 – 27 43.93, < .001
Writing – One day prompt
  %CWS* .66 (.20) .09 – 1.00 .72 (.18) .13 – 1.25 14.47, < .001
  CIWS 17.48 (31.69) −72 – 98 33.99 (36.83) −35 – 153 27.07, < .001
  Ideas 4.10 (1.10) 0 – 6 4.46 (1.00) 2 – 7 14.26, < .001
  Organization 3.16 (0.78) 0 – 6 3.56 (0.87) 1 – 6 27.79, < .001
Writing – WIAT prompt
  %CWS* .70 (.22) .03 – 1.25 .75 (.18) .26 – 1.15 10.34, .001
  CIWS 26.58 (34.84) −50 – 172 37.31 (36.71) −44 – 149 18.39, < .001
  Ideas 3.55 (0.81) 0 – 6 3.76 (080) 2 – 6 35.87, < .001
  Organization 2.67 (0.68) 1 – 5 2.96 (0.69) 1 – 5 21.72, < .001
  WIAT TDTO - raw 5.62 (2.59) 0 – 12 6.58 (2.84) 0 – 15 15.448, < .001
  WIAT TDTO – SS NA** NA** 105.12 (16.02) 66 – 144
Writing – pet prompt
  % CWS* .72 (.22) .13 – 1.12 .78 (.20) .05 – 1.29 8.824, .003
  CIWS 23.60 (34.21) −61 – 134 37.01 (34.98) −46 – 197 10.411, .001
  Ideas 3.44 (0.76) 0 – 5 3.89 (0.88) 2 – 7 7.605, .006
  Organization 2.88 (0.83) 0 – 5 3.25 (0.89) 2 – 6 21.359, < .001

OWLS = Oral and Written Language Scales; TNL = Test of Narrative Language; WJ = Woodcock-Johnson Tests of Achievement – Third Edition; WIAT = Wechsler Individual Achievement Test; TDTO = Theme Development & Text Organization

*

Maximum value for %CWS is occasionally over 1.00 (correct word sequences is larger than that of total words written). This is attributed to the way CWS is scored. For instance, in the following sentence, “^She^ went^ to^ the^ store.^” the child has 5 total words written but her CWS score is 6 (the carets).

**

WIAT TDTO was not normed for children in Grade 2 and therefore standard scores are not available for children in Grade 2.

+

All raw score differences significant (< .006) between grades with the exception of Ideas for the Pet Prompt.

++

TNL has a Mean of 10 and SD of 3.

Raw scores on each of the study measures were compared between grade levels using a multivariate analysis of variance (MANOVA). Given multiple comparisons, a Benjamini-Hochberg linear step-up procedure was used (Benjamini & Hochberg, 1995) to account for Type I error. The Benjamini-Hochberg, or false discovery rate, procedure is appropriate when multiple statistical tests are being performed on the same set of data, but yields greater power than the more conservative Bonferroni technique, which controls for the familywise error rate (see also Thissen, Steinberg, & Kuang, 2002; William, Jones, & Tukey, 1999). As shown in Table 1, the results of the multivariate analysis revealed that third grade children’s raw scores were significantly higher than the second grade children’s scores on all of the measures in the study. Subsequent analyses were conducted using raw scores.

Table 2 shows the correlations between measures for children in Grade 2 (lower diagonal) and those in Grade 3 (upper diagonal). Correlations were in the expected directions and range compared to previous studies (e.g., Berninger & Abbott, 2010; Graham et al., 1997; Kim et al., 2014; Wagner et al., 2011). Oral language measures were moderately related to each other. Writing measures also tended to be moderately related to each other.

Table 2.

Correlation matrix for measures (lower diagonal for second grade, and upper diagonal for third grade)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19
1. OWLS-II - .42 .56 .35 .17 .26 .25 .34 .25 .40 .28 .32 .20 .27 .24 .31 .32 .17 .19
2. TNL .56 - .50 .18 .18 .22 .13 .23 .29 .34 .25 .25 .13 .26 .24 .17 .16 .12ns .21
3. WJ-III PV .49 .49 - .33 .24 .23 .29 .31 .29 .40 .34 .35 .22 .35 .31 .34 .28 .10ns .20
4. Spelling .30 .32 .41 - .38 .39 .64 .69 .41 .40 .64 .67 .38 .45 .38 .60 .61 .24 .33
5. Alphabet writing
fluency
.20 .28 .19 .35 - .42 .16 .23 .32 .22 .32 .34 .27 .29 .20 .21 .26 .18 .14
6. Paragraph copying .18 .20 .11ns .33 .43 - .25 .42 .50 .41 .31 .45 .37 .39 .36 .26 .37 .33 .32
7. One Day %CWS .24 .20 .30 .58 .10ns .21 - .82 .25 .35 .64 .55 .19 .29 .32 .66 .58 .16 .35
8. One Day CIWS .25 .25 .30 .64 .20 .26 .86 - .54 .53 .62 .70 .43 .35 .44 .57 .70 .35 .43
9. One Day Ideas .36 .31 .41 .42 .31 .22 .21 .38 - .62 .32 .46 .45 .35 .42 .26 .44 .35 .29
10. One Day Org .41 .30 .42 .39 .24 .19 .23 .35 .69 - .36 .45 .35 .36 .35 .30 .41 .28 .40
11. WIAT %CWS .25 .29 .32 .65 .26 .35 .76 .70 .30 .32 - .84 .27 .36 .39 .65 .58 .20 .35
12. WIAT CIWS .23 .29 .29 .66 .29 .40 .62 .74 .33 .32 .86 - .55 .46 .54 .56 .69 .38 .38
13. WIAT Ideas .25 .40 .34 .43 .36 .29 .13ns .30 .47 .31 .26 .41 - .35 .49 .19 .41 .41 .24
14. WIAT Org .29 .36 .38 .48 .27 .27 .32 .41 .41 .47 .41 .41 .44 - .53 .38 .44 .28 .33
15. WIAT TDTO .33 .38 .36 .49 .40 .46 .36 .45 .47 .48 .44 .49 .41 .58 - .28 .42 .33 .29
16. Pet %CWS .29 .28 .36 .68 .25 .23 .62 .66 .41 .43 .70 .66 .30 .46 .39 - .77 .17 .32
17. Pet CIWS .25 .30 .33 .59 .27 .37 .49 .67 .35 .39 .61 .74 .40 .41 .45 .78 - .55 .41
18. Pet Ideas .21 .36 .30 .38 .28 .29 .23 .37 .31 .26 .29 .34 .46 .35 .40 .24 .48 - .37
19. Pet Org .36 .35 .31 .43 .28 .23 .31 .42 .46 .40 .43 .38 .38 .48 .43 .40 .43 .53 -

OWLS-II = Oral and Written Language Scales – 2nd Edition; TNL = Test of Narrative Language; WJ-III = Woodcock-Johnson Tests of Achievement – Third Edition; WIAT = Wechsler Individual Achievement Test; TDTO = Theme Development & Text Organization; Org = Organization

Unless otherwise noted, all coefficients are statistically significant at .05 level. ns = nonsignificant’

In order to examine whether %CWS and CIWS captured a dissociable construct, text writing fluency, from productivity (total words written) and writing quality indicators (ideas and organization), three alternative confirmatory factor models were fitted and compared. In the first model, all the indicators were hypothesized to capture a single latent variable. This model yielded a poor fit to the data: (χ2 [87] = 1096.21, p < .001; CFI = .84; TLI = .77; RMSEA = .15; SRMR = .10). In the second model, writing quality was hypothesized to be a dissociable latent variable from another latent variable composed of %CWS, CIWS, and total words written. This model was improved over the first model (Δχ2 [Δdf = 1] = 74.98, p < .001), but model fit was still below criterion: (χ2 [86] = 1021.23, p < .001; CFI = .85; TLI = .79; RMSEA = .15; SRMR = .10). In the final model, writing quality, writing fluency (%CWS and CIWS) and writing productivity (total words written) were hypothesized to be all related but dissociable latent variables. The model yielded an adequate model fit: (χ2 [85] = 523.15, p < .001; CFI = .93; TLI = .90; RMSEA = .10; SRMR = .07), and was superior to the first model (Δχ2 [Δdf = 2] = 573.06, p < .001) and the second model (Δχ2 [Δdf = 1] = 498.08, p < .001). These results suggest that writing quality (quality of ideas and organization), writing fluency (%CWS and CIWS), and writing productivity (total words written) are best described as related but dissociable variables. Writing quality was strongly related to text writing fluency (r = .80) and to writing productivity (r = .73). Text writing fluency was moderately related to writing productivity (r = .53).

Based on these results, we used writing quality and text writing fluency (%CWS and CIWS), but not writing productivity in the subsequent analysis because our focal question was structural relations among writing quality, text writing fluency, oral language, handwriting fluency, and spelling. Latent variables were created for oral language and handwriting fluency as well. Spelling was assessed by a single task, and therefore an observed variable was used. As shown in Figures 2 and 2b, loadings of each task (or scores) to latent variables were all moderate or strong.

Figure 2.

Figure 2

Figure 2

a. Standardized regression weights of oral language, handwriting fluency, spelling, and text writing fluency to writing quality for children in Grade 2. Solid lines represent statistically significant relations whereas dashed lines represent nonsignificant relations. Gray lines represent correlations.

b. Standardized regression weights of oral language, handwriting fluency, spelling, and text writing fluency to writing quality for children in Grade 3. Solid lines represent statistically significant relations. Gray lines represent correlations.

Relations of oral language, transcription skills, and writing fluency to writing quality

Given that there were two groups of children, multi-group structural equation modeling was employed and measurement invariance was examined following procedures described in Brown (2006) and Thompson and Green (2006). In multi-group analysis, factor loadings of observed measures to hypothesized latent variables are expected to be the same or similar for both groups to ensure unbiased effects of the measures across time points (Byrne & Watkins, 2003; Kline, 2011). First, a baseline model of non-invariance was specified in which the loadings were allowed to vary completely. This model demonstrated a good fit to the data: (χ2 [284] = 664.56, p < .001; CFI = .93; TLI = .92; RMSEA = .07; SRMR = .06). When a full invariance model was fitted, the model did not converge which is an indication of a poor model fit. Therefore, partial invariance models were fitted. After examining the raw loadings of each observed variable on its corresponding latent variable, equal loading constraints were relaxed for the following observed variables: One day prompt CIWS and letter writing fluency. Note that although full measurement invariance is desirable, partial measurement invariance is typically fitted because of subtle changes in measurement properties of indicators (e.g., reliability estimates).

In order to examine the hypothesized relations among oral language, transcription skills, text writing fluency, and writing quality, the mediation model (partial invariance model described above) shown in Figure 1 was fitted to the data. The model had a good fit to the data: χ2 (296) = 695.63, p < .001, CFI= .93, TLI=.92, RMSEA=.07 (.07–.08), SRMR=.07, and standardized path coefficients are shown in Figures 2a and 2b for children in Grade 2 and Grade 3, respectively. In Grade 2, handwriting fluency was weakly but statistically significantly related to text writing fluency in Grade 2 (γ = .22, p = .007), and spelling was moderately related to text writing fluency (γ = .58, p < .001). In contrast, oral language was not related to text writing fluency (γ = .10, p = .17). However, the writing quality outcome was only moderately related to oral language (γ = .42, p < .001) and handwriting fluency (γ = .33, p < .001). Spelling, in contrast, was not related to writing quality after accounting for text writing fluency, oral language, and handwriting fluency. Text writing fluency was also weakly but significantly related to writing quality (β = .25, p = .007) after accounting for oral language, handwriting fluency, and spelling. Approximately 60% of total variance in text writing fluency and 78% of variance in writing quality were explained.

In Grade 3, handwriting fluency (γ = .21, p = .003) and spelling (γ = .62, p < .001) were related to text writing fluency. Oral language (γ = .17, p = .005) was weakly but independently related to text writing fluency after accounting for handwriting fluency and spelling. When it comes to writing quality, oral language was weakly related (γ = .15, p = .03). Handwriting fluency (γ = .40, p < .001) was moderately related; whereas spelling had a suppressor effect (γ = −.21, p = .02) after accounting for handwriting fluency, oral language, and text writing fluency. Text writing fluency was strongly related to writing quality (β = .70, p < .001). Approximately 71% of total variance in text writing fluency and 86% of variance in writing quality were explained.

Discussion

The primary goal of the present study was to develop a conceptual model of text writing fluency and empirically test it, using data from children in Grades 2 and 3. To this end, we extended a recent proposal of writing fluency (Ritchey et al., 2015) by specifying the nature of relations from a component-based and developmental perspective. Our short-hand definition of writing fluency was efficiency and automaticity of writing connected texts. Based on this definition and previous studies on predictive validity, we hypothesized that two CBM writing scores, %CWS and CIWS, would be appropriate measures of writing fluency because these indicators capture accuracy as well as speed (or the amount of text written). Total number of words written, one of many indicators of CBM writing (see McMaster & Espin, 2007 for a review), has been widely investigated in previous studies as writing productivity (Kim, Al Otaiba, Sidler, Greulich, & Puranik, 2014; Kim, Al Otaiba, Wanzek, & Gatlin, 2015; Mackie & Dockrell, 2004; Puranik et al., 2008; Wagner et al., 2011), and at times has been labeled as writing fluency (Abbott & Berninger, 1993; Berninger et al., 2002; Graham et al., 1997). When we explicitly tested dimensionality of writing quality (ideas and organization), text writing fluency (%CWS and CIWS), and writing productivity (total words written), results revealed that all these three constructs are best described as related but dissociable. In fact, the correlation between text writing fluency and writing productivity was moderate (r = .53) compared to strong relations of writing quality to text writing fluency (r = .80) and writing productivity3 (r = .73).

Extending the developmental models of writing such as the simple view of writing (Berninger et al., 2002; Juel et al., 1986) and not-so-simple view of writing (Berninger & Winn, 2006), we hypothesized that the text writing fluency construct would draw on both transcription and oral language skills and act as a mediator between these skills and writing quality. In fact, the nature of relations of transcription and oral language skills to text writing fluency was hypothesized to differ across development. During the beginning phase of writing, which may be prolonged for students with writing difficulties or disabilities, transcription skills would severely constrain children’s available cognitive resources to a large extent such that oral language would make a limited contribution to text writing fluency, which in turn may preclude their ability to meet grade level CCSS standards. With further development in transcription skills, children’s cognitive resources may become available to a greater extent to allow access to their linguistic, meaning processing capacity, leading to a relation of oral language to text writing fluency. Our findings revealed that for children in Grade 2 who had lower skills in the assessed constructs, text writing fluency was predicted by transcription skills (spelling and handwriting fluency), but not by oral language. For children in Grade 3, in contrast, oral language made an independent contribution to text writing fluency over and above transcription skills. Transcription skills were consistently related to text writing fluency as expected. After all, efficient writing of connected texts (text writing fluency) requires and depends on transcription skills. What differentiates text writing fluency from transcription skills, however, is that text writing fluency involves context which is inherent in connected texts, and thus, text writing fluency draws on meaning processes (oral language) over and above transcription skills. Overall, a large amount of variance was explained in text writing fluency by the oral language and transcription skills (60% in Grade 2 and 71% in Grade 3).

At the center of theorizing the text writing fluency construct was its mediation role – that is, text writing fluency would mediate the relations of oral language and transcription skills to writing, at least partially. Our findings suggest a partial mediation for children in Grades 2 and 3. Text writing fluency was related to writing quality over and above oral language and transcription skills in both Grades 2 and 3. In addition, oral language and handwriting fluency remained related to writing quality over and above text writing fluency. Therefore, although oral language and transcription skills are captured in text writing fluency to some extent, aspects of oral language and transcription skills not captured in text writing fluency (operationalized by %CWS and CIWS) are important to writing quality. According to recent evidence, aspects that independently contribute to writing might include higher-order cognitive skills such as inference and perspective taking. Writing requires these higher-order reasoning skills (Hayes, 1996; Kim & Schatschneider, in press), but the two CBM writing scores primarily examine children’s ability to transcribe and use words in grammatically correct sequences (e.g., correct word sequences and incorrect word sequences). Therefore, higher-order reasoning processes that are important to discourse-level oral language such as inference (Kendeou, Bohn-Gettler, White, & van den Broek, 2008; Kim, 2015b, 2016; Tompkins, Guo, & Justice, 2013) and perspective taking and reasoning (Kim, 2015b, 2016; Kim & Phillips, 2014; Strasser & del Rio, 2014) are not captured by the CBM writing scores, and may explain the independent relation of oral language (i.e., discourse level oral language) to writing quality over and above %CWS and CIWS.

It is notable that the nature of the mediating role of text writing fluency differed for two transcription skills, handwriting fluency and spelling. For handwriting, text writing fluency partially mediated the relation of handwriting fluency to writing quality whereas spelling appears to be completely mediated by text writing fluency. In fact, spelling had a suppressor effect in Grade 3 – Spelling was positively related to writing quality in bivariate correlations (Table 2), but after accounting for its relation to text writing fluency, it had a negative relation. %CWS and CIWS, writing fluency indicators in the present study, are derived from correct word sequences and incorrect word sequences. In these scores, spelling accuracy is incorporated, and the present findings suggest that these CBM scores sufficiently capture children’s spelling ability and its role in writing.

The final hypothesis of the component-based and developmental model of text writing fluency was that the strengths of relations of text writing fluency to writing quality would differ as a function of developmental phase of writing (Grades 2 versus 3 in this study). We found differential magnitudes of relations with a stronger relation in Grade 3. As noted above, this might be because efficiency and automaticity in writing connected texts (i.e., writing fluency) release attention and working memory to be used for higher-order, meaning-related processes (translating ideas into oral language, chunking propositions and ideas into meaningful units, and organizing ideas in a logical flow), which engender higher quality writing. By contrast, inefficient and laborious writing of connected texts could interfere with composing processes by disrupting temporary representation of propositions and ideas in working memory.

Overall, the present findings support our conceptualization of text writing fluency and its relations with component skills and writing. Our theoretical model (Figure 1) and the present results extend the simple view and not-so-simple view of writing by showing the mediating role of writing fluency between oral language and transcription skills, and writing quality. Our model is component-based such that we hypothesized that text writing fluency draws on two component skills, transcription and oral language. Furthermore, text writing fluency acts as a mediator between these two component skills and the ultimate outcome of writing, writing quality. Our model is also developmental such that writing fluency is not a static construct but is functionally different for children at different developmental phases. Students with writing difficulties or disabilities may progress through these developmental phases at a slower rate than their peers. In the beginning phase, text writing fluency is largely constrained by transcription skills whereas with further development of transcription skills, text writing fluency refers to a state where cognitive resources such as attention and working memory can be allocated to meaning processes. Thus, students with writing difficulties or disabilities may need to develop these transcriptions skills to greater facility or receive assistive technology in transcription to allow for cognitive resources to be allocated toward meaning processes. Overall, a large amount of variance in writing quality was explained by this component-based and developmental model of text writing fluency– 78% in Grade 2 and 86% in Grade 3.

It should be noted that the two focal CBM writing scores, %CWS and CIWS, were measured using a mixture of CBM writing ‘tasks.’ As noted earlier, CBM tasks are typically timed (e.g., 5 min), but the tasks used in the present study included one task that was used in CBM framework in previous studies (i.e., One day prompt) whereas the other tasks were normed and standardized tasks that have not been previously used in a CBM framework. All these tasks were administered with a 10 min time limit. We argue that this did not present a problem in examining our conceptualization of text writing fluency because, as described above, the ‘task’ requirement for text writing fluency is assessing writing ability in connected text writing with a reasonable time limit while the evaluation requirement was capturing accuracy and speed of transcription and oral language.

Limitations and Directions for Future Research

Several limitations and related future directions are worth noting. As is the case with any studies, the present findings should be interpreted keeping in mind the study focus and design. First, because our focus in the present study was conceptualizing and testing text writing fluency, other potential component skills of writing such as discourse knowledge (see Bereiter & Scardamalia, 1987; Olinghouse & Graham, 2009) was not included. Similarly, in line with our conceptualization, writing outcome was writing quality and therefore, other outcomes (e.g., writing productivity) was not examined, but can be examined in future studies.

Second, generalizability of the findings is limited to student from similar backgrounds. The majority of our sample children were from low socio-economic backgrounds although their mean performances on normed language and literacy skills were in the average range. These results should be replicated with different populations, including children with identified LD, children with writing disability, and children learning to write in languages other than English.

Third, the present investigation was conducted with a cross-sectional sample. Although children in Grade 3 had higher mean performances than those in Grade 2 on all the tasks, given the developmental hypotheses, future replication with longitudinal samples is warranted. Longitudinal studies with older children or for a longer time span (e.g., capturing the elementary grades though middles school; or from Grades 2 to 6) would be also illuminating whether text writing fluency would completely mediate the relations of oral language and transcription skills at a later developmental point than what we observed in the present study. In this study we found that text writing fluency played a partial mediating role. Our speculation is that text writing fluency, as operationalized by %CWS and CIWS at least, would partially mediate the relation of oral language to writing quality because those two indicators capture only a certain aspects of oral language, and do not capture higher order skills as described above. Fourth, we used a single task for the spelling construct, and therefore, replication using a latent spelling variable would be informative.

The language measures in the present study included both receptive and expressive measures, and therefore, the oral language construct in the present study captured common variance among the receptive and expressive discourse level tasks. A recent study showed that receptive and expressive discourse level skills are best described as having a bi-factor structure with an underlying core, discourse-level oral language, along with task specific (receptive vs expressive) aspects, and it was the core discourse-level oral language construct that predicted reading rather than task-specific aspects (Kim, Park, & Park, 2015). A future replication of the present study could include only expressive measures of oral language (e.g., see Kim & Schatschneider, in press).

Implications for Practice

The present findings offer some important implications. First, inadequate efficiency in connected text writing as measured by %CWS and CIWS is primarily due to transcription skills for children in primary grades. Therefore, systematic and explicit instruction on transcription skills are expected to facilitate children’s text writing fluency as well as writing quality. Instruction and intervention must include explicit and systematic instruction to ensure mastery for these basic skills. Notably though, to develop writing skills including text writing fluency, children also need support to develop and use their oral language skills for writing. Therefore, instructional attention to oral language, particularly for low-achieving writers and students with LDs in writing is needed as part of writing instruction, including text writing fluency and writing quality. High scores in %CWS and CIWS indicate that students can transcribe their thoughts in a grammatically accurate manner. In contrast, low scores indicate an instructional need emphasizing transcription and language aspects for writing. For example, in CIWS, low or negative scores indicate that although students can produce connected texts drawing on transcription and certain aspects of oral language skills (e.g., vocabulary and grammar), their accuracy needs to be developed and students need opportunities to see these aspects, to apply them, and to receive feedback. Qualitative analysis of errors can reveal whether students need help with transcription, oral language, or both aspects.

In closing, we are mindful of the large number of students in fourth grade and beyond who cannot write proficiently enough for grade level standards, including the CCSS. To narrow the gap between their writing skills and the CCSS, we believe that the present study showed emerging evidence about text writing fluency, could provide to guide instruction and the need for intervention and adaptations. Developing a solid theoretical conceptualization about text writing fluency is critical to moving the field forward to expand our understanding about children’s writing development. The present study represents an important first step toward that direction, but it is clear that much work remains.

Footnotes

1

Note that self-regulatory processes by Berninger and Winn (2006) include many capacities and skills at lower and higher levels such as inhibitory control, attention, goal setting, and monitoring. Berninger and Winn used the term, executive function, to describe these processes. However, in the present study, we use the term, self-regulatory processes, because executive function is typically defined as specific set of processes such as inhibitory control, working memory, and shifting (Miyake et al., 2000).

2

Note that 45 written compositions (9%) is less than those previous studies in terms of percentage – reliability is typically established using 10–30% of written compositions. However, this lower percentage reflects the large number of written compositions (494 per prompt), and the researchers felt that the coders were adequately trained and reliable in their scoring.

3

Note again that the focal construct in the present study was text writing fluency and its relation to transcription, oral language, and writing quality. Productivity was examined to establish the fact that productivity is a differentiated construct from text writing fluency theoretically, and thus, was not further examined in the structural relations (i.e., Figures 2 and 2b).

Contributor Information

Young-Suk Grace Kim, University of California at Irvine.

Brandy Gatlin, Georgia State University.

Stephanie Al Otaiba, Southern Methodist University.

Jeanne Wanzek, Vanderbilt University.

References

  1. Abbott RD, Berninger VW. Structural equation modeling of relationships Among developmental skills and writing skills in primary- and intermediate-grade writers. Journal of Educational Psychology. 1993;85:478–508. [Google Scholar]
  2. Amato J, Watkins MW. The predictive validity of CBM writing indices of eighth-grade children. Journal of Special Education. 2011;44:195–204. [Google Scholar]
  3. Benjamini Y, Hochberg Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. 1995;57:289–300. [Google Scholar]
  4. Berman R, Verhoevan L. Cross-linguistic perspectives on the development of text-production abilities. Written Language and Literacy. 2002;5:1–43. [Google Scholar]
  5. Berninger VW, Abbott RD. Discourse-level oral language, oral expression, reading comprehension, and written expression: Related yet unique language systems in grades 1, 3, 5, and 7. Journal of Educational Psychology. 2010;102:635–651. doi: 10.1037/a0019319. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Berninger VW, Abbott RD, Abbott SP, Graham S, Richards T. Writing and reading: Connections between language by hand and language by eye. Journal of Learning Disabilities. 2002;35:39–56. doi: 10.1177/002221940203500104. [DOI] [PubMed] [Google Scholar]
  7. Berninger VW, Abbott RD, Swanson HL, Lovitt D, Trivedi P, Amtmann D. Relationship of word- and sentence-level working memory to reading and writing in second, fourth, and sixth grade. Language, Speech, and Hearing Services in Schools. 2010;41:179–193. doi: 10.1044/0161-1461(2009/08-0002). [DOI] [PubMed] [Google Scholar]
  8. Berninger V, Amtmann D. Preventing written expression disabilities through early and continuing assessment and intervention for handwriting and/or spelling problems: Research into practice. In: Swanson H, Harris K, Graham S, editors. Handbook of Learning Disabilities. New York: The Guilford Press; 2003. pp. 323–344. [Google Scholar]
  9. Berninger VW, Vaughn KB, Graham S, Abbott RD, Abbott SP, Rogan LW, Brooks A, Reed E. Treatment of handwriting problems in beginning writers: Transfer from handwriting to composition. Journal of Educational Psychology. 1997;89:652–666. [Google Scholar]
  10. Berninger VW, Vaughn K, Graham S, Abbott RD, Begay K, Coleman KB, Hawkins JM. Teaching spelling and composition alone and together: Implications for the simple view of writing. Journal of Educational Psychology. 2002;94:291–304. [Google Scholar]
  11. Berninger VW, Winn WD. Implications of advancements in brain research and technology for writing development, writing instruction, and educational evolution. In: MacArthur C, Graham S, Fitzgerald J, editors. Handbook of writing research. New York: Guilford; 2006. pp. 96–114. [Google Scholar]
  12. Brown TA. Confirmatory factor analysis for applied research. New York, NY: Guilford; 2006. [Google Scholar]
  13. Coker DL. Impact of first-grade factors on the growth and outcomes of urban schoolchildren’s primary-grade writing. Journal of Educational Psychology. 2006;98:471–488. [Google Scholar]
  14. Coker DL, Ritchey KD. Curriculum-based measurement of writing in kindergarten and first grade: An investigation of production and qualitative scores. Exceptional Children. 2010;76:175–193. [Google Scholar]
  15. Daneman M, Merikle PM. Working memory and language comprehension: A meta-analysis. Psychonomic Bulletin & Review. 1996;3:422–433. doi: 10.3758/BF03214546. [DOI] [PubMed] [Google Scholar]
  16. Deno SL, Marston D, Mirkin PK. Valid measurement procedures for continuous evaluation of written expression. Exceptional Children. 1982;48:368–371. [Google Scholar]
  17. Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and psychological measurement. 1973;33:613–619. [Google Scholar]
  18. Florit E, Roch M, Levorato MC. Listening text comprehension of explicit and implicit information in preschoolers: the role of verbal and inferential skills. Discourse Processes. 2011;48:119–138. [Google Scholar]
  19. Florit E, Roch M, Levorato MC. Listening text comprehension in preschoolers: A longitudinal study on the role of semantic components. Reading and Writing: An Interdisciplinary Journal. 2014;27:793–817. [Google Scholar]
  20. Florit E, Roch M, Altoè G, Levorato MC. Listening comprehension in preschoolers: The role of memory. British Journal of Developmental Psychology. 2009;27:935–951. doi: 10.1348/026151008x397189. [DOI] [PubMed] [Google Scholar]
  21. Gansle KA, Noell GH, VanDerHeyden AM, Naquin GM, Slider NJ. Moving beyond total words written: The reliability, criterion validity, and time cost of alternate measures for curriculum-based measurement in writing. School Psychology Review. 2002;31:477–497. [Google Scholar]
  22. Gansle KA, Noell GH, Vanderheyden AM, Slider NJ, Hoffpauir LD, Whitmarsh EL, Naquin GM. An examination of the criterion validity and sensitivity to brief intervention of alternate curriculum-based measures of writing skill. Psychology in the Schools. 2004;41:291–300. [Google Scholar]
  23. Gansle KA, VanDerHeyden AM, Noell GH, Resetar JL, Williams KL. The technical adequacy of curriculum-based and rating-based measures of written expression for elementary school students. School Psychology Review. 2006;35:435. [Google Scholar]
  24. Graham S, Berninger VW, Abbott RD, Abbott SP, Whitaker D. Role of mechanics in composing of elementary school children: A new methodological approach. Journal of Educational Psychology. 1997;89:170–182. [Google Scholar]
  25. Graham S, Berninger VW, Fan W. The structural relationship between writing attitude and writing achievement in first and third grade students. Contemporary Educational Psychology. 2007;32:516–536. http://dx.doi.org/10.1016/j.cedpsych.2007.01.002. [Google Scholar]
  26. Graham S, Harris KR, Chorzempa BF. Contribution of spelling instruction to the spelling, writing, and reading of poor spellers. Journal of Educational Psychology. 2002;94:669–686. http://dx.doi.org/10.1037/0022-0663.94.4.669. [Google Scholar]
  27. Graham S, Harris K, Santangelo T. Research-based writing practices and the common core meta-analysis and meta-synthesis. The Elementary School Journal. 2015;115:498–522. [Google Scholar]
  28. Graham S, McKeown D, Kiuhara S, Harris KR. A meta-analysis of writing instruction for students in the elementary grades. Journal of Educational Psychology. 2012;104:879–896. [Google Scholar]
  29. Graham S, Perin D. Writing next: Effective strategies to improve writing of adolescents in middle and high schools – A report to Carnegie Corporation of New York. Washington, DC: Alliance for Excellent Education; 2007. [Google Scholar]
  30. Hayes JR. A new framework for understanding cognition and affect in writing. In: Levy CM, Ransdell S, editors. The science of writing: Theories, methods, individual differences, and applications. Mahwah, NJ: Erlbaum; 1996. pp. 1–27. [Google Scholar]
  31. Hayes JR, Chenoweth NA. Working memory in an editing task. Written Communication. 2007;24:283–294. [Google Scholar]
  32. Hu L-T, Bentler PM. Cutoff criteria for fit indices in covariance structure analysis. Conventional criteria versus new alternatives. Structural Equation Modeling. 1999;6:1–55. [Google Scholar]
  33. Hooper SR, Swartz CW, Wakely MB, de Kruif REL, Montgomery JW. Executive functions in elementary school children with and without problems in written expression. Journal of Learning Disabilities. 2002;35:57–68. doi: 10.1177/002221940203500105. http://dx.doi.org/10.1177/002221940203500105. [DOI] [PubMed] [Google Scholar]
  34. Jewell J, Malecki CK. The utility of CBM written language indices: An investigation of product-dependent, product-independent, and accurate-production scores. School Psychology Review. 2005;34:27–44. [Google Scholar]
  35. Juel C, Griffith PL, Gough PB. Acquisition of literacy: A longitudinal study of children in first and second grade. Journal of Educational Psychology. 1986;78:243–255. [Google Scholar]
  36. Kame'enui EJ, Simmons DC, Good RH, Harn BA. The use of fluency-based measures in early identification and evaluation of intervention efficacy in schools. In: Wolf M, editor. Dyslexia, fluency, and the brain. York Press; 2001. pp. 307–331. [Google Scholar]
  37. Kellogg RT, Olive T, Piolat A. Verbal, visual, and spatial working memory in written language production. Acta Psychologica. 2007;124:382–397. doi: 10.1016/j.actpsy.2006.02.005. [DOI] [PubMed] [Google Scholar]
  38. Kendeou P, Bohn-Gettler CM, White MJ, van den Broek P. Children's inference generation across different media. Journal of Research in Reading. 2008;31:259–272. [Google Scholar]
  39. Kim Y-SG. Developmental, component-based model of reading fluency: An investigation of word reading fluency, text reading fluency, and reading comprehension. Reading Research Quarterly. 2015a;50:459–481. doi: 10.1002/rrq.107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Kim Y-S. Language and cognitive predictors of text comprehension: Evidence from multivariate analysis. Child Development. 2015b;86:128–144. doi: 10.1111/cdev.12293. [DOI] [PubMed] [Google Scholar]
  41. Kim Y-SG. Direct and mediated effects of language and cognitive skills on comprehension or oral narrative texts (listening comprehension) for children. Journal of Experimental Child Psychology. 2016;141:101–120. doi: 10.1016/j.jecp.2015.08.003. [DOI] [PubMed] [Google Scholar]
  42. Kim Y-S, Al Otaiba S, Puranik C, Sidler JF, Greulich L, Wagner RK. Componential skills of beginning writing: An exploratory study. Learning and Individual Differences. 2011;21:517–525. doi: 10.1016/j.lindif.2011.06.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Kim Y-S, Al Otaiba S, Sidler JF, Greulich L, Puranik C. Evaluating the dimensionality of first grade written composition. Journal of Speech, Language, and Hearing Research. 2014;57:199–211. doi: 10.1044/1092-4388(2013/12-0152). [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Kim Y-S, Al Otaiba S, Wanzek J, Gatlin B. Towards an understanding of dimension, predictors, and gender gaps in written composition. Journal of Educational Psychology. 2015;107:79–95. doi: 10.1037/a0037210. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Kim Y-SG, Park C, Park Y. Dimensions of discourse-level oral language skills and their relations to reading comprehension and written composition: An exploratory study. Reading and Writing: An Interdisciplinary Journal. 2015;28:633–654. [Google Scholar]
  46. Kim Y-S, Phillips B. Cognitive correlates of listening comprehension. Reading Research Quarterly. 2014;49:269–281. [Google Scholar]
  47. Kim Y-SG, Schatschneider C. Expanding the developmental models of writing: A direct and indirect effects model of developmental writing (DIEW) Journal of Educational Psychology. doi: 10.1037/edu0000129. (in press) http://dx.doi.org/10.1037/edu0000129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Kline RB. Principles and practice of structural equation modeling. 2nd. New York: Guilford; 2005. [Google Scholar]
  49. LaBerge D, Samuels SJ. Toward a theory of automatic information processing in reading. Cognitive Psychology. 1974;62:293–323. [Google Scholar]
  50. Lembke E, Deno SL, Hall K. Identifying an indicator of growth in early writing proficiency for elementary school students. Assessment for Effective Intervention. 2003;28:23–35. [Google Scholar]
  51. Lepola J, Lynch J, Laakkonen E, Silvén M, Niemi P. The role of inference making and other language skills in the development of narrative discourse-level oral language in 4- to 6-year old children. Reading Research Quarterly. 2012;47:259–282. [Google Scholar]
  52. Limpo T, Alves RA. Modeling writing development: Contribution of transcription and self-regulation to Portuguese students’ text generation quality. Journal of Educational Psychology. 2013;105:401–413. http://dx.doi.org/10.1037/a0031391. [Google Scholar]
  53. Logan GD. Automaticity and reading: Perspectives from the instance theory of automatization. Reading & Writing Quarterly. 1997;13:123–146. [Google Scholar]
  54. Mackie C, Dockrell JE. The nature of written language deficits in children with SLI. Journal of Speech, Language, and Hearing Research. 2004;47:1469–1483. doi: 10.1044/1092-4388(2004/109). [DOI] [PubMed] [Google Scholar]
  55. McCutchen D. Cognitive factors in the development of children’s writing. In: MacArthur C, Graham S, Fitzgerald J, editors. Handbook of Writing Research. New York: The Guilford Press; 2006. pp. 115–130. [Google Scholar]
  56. McMaster KL, Campbell H. Technical features of new and existing measures of written expression: An examination within and across grade levels. School Psychology Review. 2008;37(4):550–566. [Google Scholar]
  57. McMaster KL, Du X, Petursdotter A. Technical features of curriculum-based measures for beginning writers. Journal of Learning Disabilities. 2009;42:41–60. doi: 10.1177/0022219408326212. [DOI] [PubMed] [Google Scholar]
  58. McMaster KL, Du X, Yeo S, Deno SL, Parker D, Ellis T. Curriculum-based measures of beginning writing: Technical features of the slope. Exceptional Children. 2011;77(2):185–206. [Google Scholar]
  59. McMaster K, Espin C. Technical features of curriculum-based measurement in writing: A literature review. Journal of Special Education. 2007;41:68–84. [Google Scholar]
  60. McMaster KL, Ritchey KD, Lembke E. Curriculum-based measurement for beginning writers: Recent developments and future directions. In: Scruggs TE, Mastropieri MA, editors. Assessment and intervention: Advances in learning and behavioral disabilities. Vol. 24. Bingley, UK: Emerald; 2011. [Google Scholar]
  61. McGrew KS, Schrank FA, Woodcock RW. Woodcock-Johnson III Normative Update. Rolling Meadows, IL: Riverside; 2007. Technical Manual. [Google Scholar]
  62. Miyake A, Friedman NP, Emerson MJ, Witzki AH, Howerter A, Wager TD. The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: a latent variable approach. Cognitive Psychology. 2000;41:49–100. doi: 10.1006/cogp.1999.0734. [DOI] [PubMed] [Google Scholar]
  63. Muthén LK, Muthén BO. Mplus 7.1. Los Angeles: Muthén and Muthén; 2013. [Google Scholar]
  64. Persky HR, Dane MC, Jin Y. National Center for Education Statistics. The nation’s report card: Writing 2002 (Statistical Analysis Rep. No. 2003-529) Washington, DC: 2003. [Google Scholar]
  65. National Center for Education Statistics. The Nation’s Report Card: Writing 2011 (NCES 2012–470) Washington, DC: Institute of Education Sciences, U.S. Department of Education; 2012. [Google Scholar]
  66. Northwest Regional Educational Laboratory. 6 +1 trait writing. 2011 Available from http://educationnorthwest.org/traits.
  67. Olinghouse NG. Student-and instruction-level predictors of narrative writing in third grade children. Reading and Writing: An Interdisciplinary Journal. 2008;21(1–2):3–26. [Google Scholar]
  68. Parker DC, McMaster KL, Medhanie A, Silberglitt B. Modeling early writing growth with curriculum-based measures. School Psychology Quarterly. 2011;26:290–304. [Google Scholar]
  69. Perfetti CA. Reading ability. New York: Oxford University Press; 1985. [Google Scholar]
  70. Perfetti CA. The representation problem in reading acquisition. In: Gough P, Ehri L, Trieman R, editors. Reading acquisition. Mahwah, NJ: Erlbaum; 1992. pp. 145–174. [Google Scholar]
  71. Posner MI, Snyder CRR. Attention and cognitive control. In: Solso R, editor. Information processing and cognition: The Loyola Symposium. Hillsdale, NJ: Erlbaum; 1975. pp. 55–85. [Google Scholar]
  72. Puranik CS, Lombardino L, Altmann L. Assessing the microstructure of written language using a retelling paradigm. American Journal of Speech Language Pathology. 2008;17:107–120. doi: 10.1044/1058-0360(2008/012). [DOI] [PubMed] [Google Scholar]
  73. Ritchey KD, Coker DL., Jr An investigation of the validity and utility of two curriculum-based measurement writing tasks. Reading & Writing Quarterly. 2013;29(1):89–119. [Google Scholar]
  74. Ritchey KD, McMaster KL, Al Otaiba S, Puranik CS, Kim YSG, Parker DC, Ortiz M. Indicators of fluent writing in beginning writers. In: Cummings KD, Petscher Y, editors. The fluency construct: Curriculum-based measurement concepts and applications. New York: Springer; 2015. pp. 21–66. [Google Scholar]
  75. Salahu-Din D, Persky H, Miller J. The Nation’s Report Card: Writing 2007 (NCES 2008–468) Washington, D.C.: National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education; 2008. [Google Scholar]
  76. Sénéchal M, Ouellette G, Rodney D. The misunderstood giant: On the predictive role of vocabulary to reading. In: Neuman SB, Dickinson D, editors. Handbook of Early Literacy. Vol. 2. New York: Guilford Press; 2006. pp. 173–182. [Google Scholar]
  77. Shrout PE, Fleiss JL. Intraclass correlation: Uses in assessing rater reliability. Psychological Bulletin. 1979;86:420–428. doi: 10.1037//0033-2909.86.2.420. [DOI] [PubMed] [Google Scholar]
  78. Strasser K, del Rio F. The role of comprehension monitoring, theory of mind, and vocabulary depth in predicting story comprehension and recall of kindergarten children. Reading Research Quarterly. 2014;49:169–187. [Google Scholar]
  79. Thissen D, Steinberg L, Kuang D. Quick and easy implementation of the Benjamini-Hochberg procedure for controlling the false positive rate in multiple comparisons. Journal of Educational and Behavioral Statistics. 2002;27:77–83. [Google Scholar]
  80. Thompson MS, Green SB. Evaluating between-group differences in latent variable means. In: Hancock GR, Mueller O, editors. Structural equation modeling: A second course. Greenwich, CT: Information Age; 2006. pp. 119–170. [Google Scholar]
  81. Tompkins V, Guo Y, Justice LM. Inference generation, story comprehension, and language in the preschool years. Reading and Writing: An Interdisciplinary Journal. 2013;26:403–429. [Google Scholar]
  82. Tunmer WE. The role of language-related factors in reading disability. In: Shankweiler D, Liberman IY, editors. Phonology and reading disability: Solving the reading puzzle. Ann Arbor: University of Michigan Press; 1989. pp. 91–132. [Google Scholar]
  83. Wagner RK, Puranik CS, Foorman B, Foster E, Tschinkel E, Kantor PT. Modeling the development of written language. Reading and Writing. 2011;24:203–220. doi: 10.1007/s11145-010-9266-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  84. Weissenburger JW, Espin CA. Curriculum-based measures of writing across grade levels. Journal of School Psychology. 2005;43:153–169. [Google Scholar]
  85. Weschler D. Weschler individual achievement test – third edition. San Antonio, TX: Pearson; 2009. [Google Scholar]
  86. Williams VSL, Jones LV, Tukey JW. Controlling error in multiple comparisons, with examples from state-to-state differences in educational achievement. Journal of Educational and Behavioral Statistics. 1999;24:42–69. [Google Scholar]
  87. Woodcock RW, McGrew KS, Mather N. Woodcock-Johnson III tests of achievement. Itasca, IL: Riverside; 2001. [Google Scholar]

RESOURCES