Abstract
Purpose
The aim of this study was to develop the Language Exposure Assessment Tool (LEAT) and to examine its cross-linguistic validity, reliability, and utility. The LEAT is a computerized interview-style assessment that requests parents to estimate language exposure. The LEAT yields an automatic calculation of relative language exposure and captures qualitative aspects of early language experience.
Method
Relative language exposure as reported on the LEAT and vocabulary size at 17 months of age were measured in a group of bilingual language learners with varying levels of exposure to French and English or Spanish and English.
Results
The LEAT demonstrates high internal consistency and criterion validity. In addition, the LEAT's calculation of relative language exposure explains variability in vocabulary size above a single overall parent estimate.
Conclusions
The LEAT is a valid and efficient tool for characterizing early language experience across cultural settings and levels of language exposure. The LEAT could be a useful tool in clinical contexts to aid in determining whether assessment and intervention should be conducted in one or more languages.
Around the world, children growing up in bilingual homes are the norm rather than the exception (United Nations Educational, Scientific and Cultural Organization, 2003). Indeed, even in the United States, where the majority of the population speaks a single language, the proportion of residents who report speaking a language other than English has risen to one in five (U.S. Census Bureau, 2011). The rapid growth of this population in the United States as well as the growing awareness that multilingualism is a common phenomenon around the world have prompted an increase in bilingual research. One particular source of difficulty in conducting bilingual research, however, is assessing language exposure and obtaining reliable estimates of daily, weekly, and overall distribution of the input languages in heterogeneous groups of dual language-learners (for an overview, see Byers-Heinlein, 2015). The focus of the present study is to provide a reliable tool for assessing relative language exposure in infants and young children on the basis of a detailed parental interview. Relative language exposure generally refers to the proportion of input in each language (Grüter, Hurtado, Marchman, & Fernald, 2014). For example, bilingual children may receive relatively balanced (50%–50%) or unbalanced (75%–25%) exposure to each of their languages.
The extant literature provides robust evidence that relative language exposure is an important source of variability for bilingual language proficiency (Bedore et al., 2012; David & Wei, 2008; Eilers, Pearson, & Cobo-Lewis, 2006; Pearson, Fernandez, Lewedeg, & Oller, 1997; Place & Hoff, 2011; Poulin-Dubois, Bialystok, Blaye, Polonia & Yott, 2013). However, assessment of relative language exposure in bilingual infants and children who are unable to report on their language experience presents a unique problem for researchers and clinicians. Thus, the majority of extant measures of language exposure are based on parent report (Bosch & Sebastián-Gallés, 2001; Conboy & Mills, 2006; David & Wei, 2008; Gutierrez-Clellen & Kreiter, 2003; Pearson et al., 1997; Place & Hoff, 2011). Whereas a number of researchers have developed valid and reliable self-report assessments of language experience to be used in adult populations (e.g., Li, Sepanski, & Zhao, 2006; Marian, Blumenfeld, & Kaushanskaya, 2007), the research on early dual-language acquisition continues to suffer from inconsistency in the assessment of exposure. The present study seeks to provide an efficient and valid measure to reach an accurate estimate of relative language exposure for young children that can be used across research and clinical settings.
Prior Approaches to Measures of Language Exposure
Assessment of relative language exposure varies across studies in early child language research. For example, language exposure has been measured by recording direct-language input to a child in the home during the course of a day and calculating the amount of exposure in each language (Grüter et al., 2014). A more common and efficient approach is to measure language exposure on the basis of parent report. This can be in the form of a daily diary during the course of several days (e.g., De Houwer & Bornstein, 2003; Place & Hoff, 2011) or through a questionnaire assessing exposure across the lifespan (e.g., Bosch & Sebastián-Gallés, 2001; Gutierrez-Clellen & Kreiter, 2003). Other assessments include amount of language exposure reported from each conversational partner as rated on a scale (Conboy & Mills, 2006; De Houwer, 2007), and others simply ask parents to estimate the percentage of exposure to each language (David & Wei, 2008; Pearson et al., 1997). Thus, language exposure assessments vary in terms of the time period they assess (e.g., one day, several days, or the entire lifespan), the tools they use to assess it (e.g., direct language input or parent report), and the administration time.
Effects of Quantity and Quality of Language Exposure in Bilinguals
Parent reports of language exposure have been shown to relate to various aspects of early bilingual first language acquisition, thereby providing preliminary support for their reliability. These findings highlight the effects of several quantitative and qualitative aspects of exposure on language acquisition. In the monolingual literature, the seminal work by Hart and Risley (1995) demonstrated that the quantity of language input correlated with vocabulary size in English speakers. This finding is supported by more recent work documenting a relation between the amount of child-directed speech and speed of real-time language processing in Spanish speakers (Weisleder & Fernald, 2013). Similar results have been extended to bilingual language acquisition. For example, parent reports of relative language exposure across the lifespan correlate with size of vocabulary in young dual-language learners, such that greater exposure to a language relates to a larger vocabulary size (David & Wei, 2008; Eilers et al., 2006; Hoff et al., 2012; Pearson et al., 1997; Poulin-Dubois et al., 2013). In addition, the classification of participants into bilingual and monolingual groups derived from parent reports of relative language exposure also predicts performance on executive function and memory tasks (Brito & Barr, 2012; Poulin-Dubois, Blaye, Coutya, & Bialystok, 2011). In their study, Byers-Heinlein and Werker (2009) found differences in the application of disambiguation, a word-learning heuristic, in monolingual, bilingual, and trilingual infants as classified by parent-reported relative language exposure. Using a similar tool, Garcia-Sierra et al. (2011) showed differences in electrophysiological responses between groups of infants also classified by parent reports of language exposure. Other quantitative variables such as parent reports of age of initial exposure to a second language have implications for language mastery in the context of reading, lexical development, and fast mapping in young children (e.g., Jia, Kohnert, Collado, & Aquino-Garcia, 2006; Kan & Kohnert, 2008; Kovelman, Baker, & Petitto, 2008), whereas recent language exposure is a better predictor of semantic and morphosyntactic language measures (Bedore et al., 2012).
Qualitative aspects of language exposure that contribute to variability in early language acquisition have been documented in monolingual acquisition. Previous work demonstrated that word frequency, grammatical complexity, and gender differences in language input influence early vocabulary size and growth (Huttenlocher, Haight, Bryk, Seltzer, & Lyons, 1991; Snow, 1972). In a similar way, several dimensions of maternal responsiveness predict children's acquisition of language milestones as early as 9 months of age (Tamis-LeMonda, Bornstein, & Baumwell, 2001) and even into the fourth year of life (Hudson, Levickis, Down, Nicholls, & Wake, 2015). Qualitative aspects of language exposure have been much less studied in the bilingual literature. Hoff and others (for a review, see Hoff & Core, 2013; Hoff, Welsh, Place, & Ribot, 2014; Place & Hoff, 2011) investigated various qualitative aspects of language exposure and how they related to children's vocabulary size and grammatical complexity. These qualitative variables were measured using a language diary in which parents documented exposure during the course of several days. Their findings showed that the number of different conversational speakers who interact with the child was a significant predictor of bilingual language proficiency at age 2. That is, increased variability in the input provides support for early language development. In addition, the proportion of input coming from native-language speakers explained variability in vocabulary size. It is important to note that these qualitative measures of exposure demonstrated significant effects on vocabulary after controlling for the relative amount of exposure. That is, qualitative aspects of language exposure as reported by parents exert an additional influence over the quantity of exposure on acquisition. In terms of grammar, Place and Hoff (2011) found that the number of exclusively English conversational partners and the amount of different sources of English exposure correlated with children's English grammatical complexity.
The Current Study
Although prior work has demonstrated the value of parental reports of exposure, there remains a need to evaluate the reliability and validity of this approach. The present study aims to address current issues in measuring and quantifying relative language exposure by proposing an assessment protocol that can be used across languages and settings. The current study presents the Language Exposure Assessment Tool (LEAT), which captures aspects of language exposure by incorporating features from a number of existing instruments in an easy-to-use, systematic assessment format. Given that the literature demonstrates strong links between exposure and parent-reported vocabulary, the present study uses two measures of early vocabulary size (the MacArthur Communicative Development Inventory [MCDI], Fenson et al., 2006; and the Computerized Comprehension Task [CCT], Friend & Keplinger, 2008; Friend & Zesiger, 2011) to explore the criterion validity of the LEAT's measure of relative language exposure. The MCDI provides a parent-report measure of early vocabulary size. However, because method bias could lead to a significant relation between parent-reported vocabulary and parent-reported language exposure, we used a behavioral and laboratory-based measure of vocabulary comprehension (the CCT) as an additional test of the validity and reliability of parent-reported language exposure on the LEAT.
The LEAT provides a parent-report measure of relative language exposure through a systematic interview. For example, the LEAT acquires information on the number of communicative partners, the languages they speak, the amount of time the child interacts with each person in each language, and how this varies over time (Bedore et al., 2012; Bosch & Sebastián-Gallés, 2001; Conboy & Mills, 2006; Fennell, 2000; Marchman, Martínez-Sussmann, & Dale, 2004; Parra, Hoff, & Core, 2011; Peña, Gutierrez-Clellen, Iglesias, Goldstein, & Bedore, 2014; Place & Hoff, 2011; Thordardottir, Rothenberg, Rivard, & Naves, 2006). The ability to extract these variables aids in identifying those aspects of language exposure that influence acquisition in young dual-language learners. In addition, it can assist clinicians in clarifying the basis for dissociations in proficiency in the first and second language when assessing young dual-language learners. The central motivation for investigating the detailed nature and computational power of the LEAT is to provide a standard measure that can be efficiently administered across settings to facilitate research on early language acquisition in dual-language learners and assist in clinical assessment. Here, we describe three unique contributions of the LEAT to the measurement of early language exposure.
First, the LEAT is based in Excel software (Microsoft Corp., Redmond, WA) to facilitate data acquisition and language exposure calculation in the laboratory, clinic, or field. Because the LEAT consists of protected, fillable cells for calculation, data are easily captured across contexts and sites. In the past, researchers have characteristically completed the language assessments in a paper format. Calculating exposure to multiple languages manually can be tedious and may increase the possibility of error. In the LEAT, parents' responses to queries automatically generate relative language exposure calculations through built-in formulas. This fillable electronic format allows researchers and clinicians to quickly calculate relative language exposure in a systematic way and to conduct the assessment easily in person or over the phone. It also provides the benefit of facilitating export to analysis software through the use of built-in macros. Last, electronic documents facilitate data sharing and data backup.
Second, we present a user manual that documents a method of administration for the LEAT in the online supplemental materials (see Supplemental Materials S1, S2, and S3). For many years, researchers and clinicians have relied on orally transmitted instructions and informal, unpublished user guidelines (but for children 4;0 to 6;11 [years;months], see Peña et al., 2014). This article provides the documentation for assessing early language exposure in infants, toddlers, and young children prior to 4 years of age in an effort to standardize measurement of language exposure across laboratories.
Last, we present data from 98 bilingual toddlers to establish the internal consistency, utility, and criterion validity of the LEAT across languages, cultures, and laboratories. Whereas the LEAT has high face validity, and similar paper-and-pencil assessments have been used in many studies, to our knowledge, this is the first time that the validity of parent report of language exposure in infants and toddlers has been directly assessed and documented. In addition, a goal of the present study was to provide an efficient and reliable tool to assess language exposure. As such, it was important to ensure that the detailed questioning on the LEAT explained variance beyond that provided by an overall parent estimate of relative language exposure. In particular, the research questions were the following:
What is the internal consistency of the LEAT?
Does the LEAT's relative language exposure calculation demonstrate criterion validity such that it explains significant variance in language outcomes?
What is the utility of the LEAT? That is, does it explain variance in vocabulary measures beyond that provided from an overall parent estimate of relative language exposure?
Method
Participants
Participants in the current study formed part of a larger longitudinal study aimed at documenting relations between early language acquisition and subsequent development. For the purposes of the present study, we selected participants with no more than 80% exposure to one of the input languages, so that exposure to the other language was at least 20%. This 80%–20% distribution is often the limit for inclusion of bilingual participants in a sample (Byers-Heinlein, 2015; Pearson et al., 1997). This provided the opportunity to evaluate the LEAT's validity across a wide range of second-language exposure.
The present sample consisted of ninety-eight 17-month-old toddlers (M = 17;14, SD = 1.01, range = 14;22 to 19;24; 41 girls, 57 boys). Children were exposed to either Spanish and English or French and English. An additional three children were tested but not included in the sample as a result of experimenter error (n = 1) or failure to complete the behavioral task (n = 2). Children and their families were recruited through flyer postings, mailings, and child-oriented events. In addition, birth record information was acquired from local health agencies. Letters and response cards were sent to 17-month-old children within a 10-mile radius of the laboratory. Response cards were then reviewed to ensure children met inclusionary criteria, and parents were then contacted to participate in the study.
Participants resided in one of two geographical locations: Children exposed to French and English resided in Montréal, Canada (n = 54), and those exposed to Spanish and English resided in San Diego, California (n = 44). The language exposure contexts across these locations vary greatly and allow us to test the LEAT's psychometric properties cross-linguistically. In Montréal, although the official language is French, more than half of residents speak both French and English (Canadian Census, 2011). In San Diego, the majority language is English, but Spanish is a significant minority language, such that 27% of California residents report speaking Spanish (American Community Survey, 2010).
All participants were typically developing and had healthy hearing and vision. The average maternal and paternal education was at college level (maternal: M = 15.20 years of education, SD = 2.60; paternal: M = 14.71 years of education, SD = 2.75). Note that there was no difference in maternal and paternal education based on language of exposure, F(2, 89) = 0.66, p = .52. The majority of children (n = 87) received exposure to two languages (French and English or Spanish and English; average exposure to the dominant language = 61%, SD = 7.35, range = 50%–79%). The other 11 children received exposure to a third language in addition to French and English or Spanish and English (average exposure to the dominant language = 56%, SD = 8.52, range = 40%–70%), but exposure to a third language was minimal (≤ 20%). All but four of the children resided in two-parent homes. On average, the children lived with approximately four family members (M = 3.84, SD = 1.3, range = 2–8 people), which most often included a combination of parents, grandparents, and siblings. All of the children in the current study received early, simultaneous exposure to their dominant and nondominant language (i.e., simultaneous exposure to French and English or Spanish and English). For the purposes of the present study, we define the dominant language in terms of the LEAT's calculation of relative exposure (i.e., the dominant language is that with the highest level of exposure; Grosjean, 2010), which does not necessarily reflect proficiency. Indeed, a central question of the present study is whether exposure, as calculated by the LEAT, predicts proficiency to evaluate its utility and criterion validity.
Measures
LEAT
The LEAT is an Excel-based (Microsoft Corp.) interview assessment that relies on parent reports of exposure to measure both quantitative and qualitative aspects of language exposure (see online Supplemental Materials S1, S2, and S3). The LEAT was designed in a manner that would allow parents to easily and systematically report on features of their child's language exposure without compromising validity. For this reason, the LEAT is separated into two major sections that together allow for the calculation of relative language exposure. In the first section, parents are asked to list the people who interact with the child at least once a week, the language(s) they speak, and whether they are native speakers of the language(s) (e.g., “Who interacts with your child on a regular basis?” “What is their primary/secondary language?”). This list automatically populates the second section, which inventories the amount of time that the child spends hearing each conversational partner in each language. This information is broken down by day of the week and by age, thereby capturing exposure that happens on specific days of the week and at specific ages in the child's life (e.g., “At what age did the child start receiving language input from Person A?” “Has Person A's interaction with your child been consistent in the past or were there times when he/she spent more or less time with your child, such as maternity leave, moved, etc.?” “During the week, what days is Person A interacting with your child?”). Next, parents are asked to estimate the amount of input children receive on average for each conversational partner given the ages and days of the week during which they interacted (“On an average day, how many hours is your child exposed to Person A speaking in Language A?”). A detailed list of queries as well as information about exposure calculations can be found in the LEAT user manual (see online Supplemental Materials S1, S2, and S3). This conceptual organization allowed parents to report on the timing, frequency, and amount of language exposure in a stepwise fashion from who interacts with the child to the languages they speak with the child to more specific information regarding time of exposure (i.e., child's age, days per week, hours per day). In this way, parents are able to easily provide estimates for each aspect of language exposure rather than provide an overall estimate that may conflate important sources of variability.
The detailed responses provided on the LEAT yield several variables. Relative language exposure is calculated by weighting the hours of exposure according to the duration of exposure to each source of input relative to the child's age. That is, if a 12-month-old infant heard 4 hours of French per day from her grandmother in the first 6 months of her life, these hours of French would receive a weight of one half to reflect the fact that this exposure did not continue for the first full year. In contrast, if the same infant heard 6 hours of English per day from her mother for the entire first year, these hours would receive a weight of one. From these weighted estimates for each language, the LEAT calculates relative language exposure (total weighted hours of exposure to Language A divided by total weighted hours of exposure to Language A and Language B). As we reviewed in the introduction, various qualitative variables have been found to exert a significant effect on early vocabulary development (e.g., Place & Hoff, 2011), and these are also captured on the LEAT. Given that parents are asked to enumerate conversational partners, the languages they speak, and whether they are native speakers, the LEAT is able to document the following qualitative variables: the number of sources of input the child is exposed to, the number of speakers who speak more than one language to the child, the amount of native and nonnative language exposure, and the absolute hours of language input.
Trained interviewers were taught to use specific questions to probe parents about the child's language exposure outlined in a detailed manual (see online Supplemental Materials S1, S2, and S3). These questions use parent-friendly terminology to help respondents provide responses easily. To maintain consistency across administrations, each specific question is overlaid onto the electronic version of the LEAT. Interviewers are able to hover over each section and view the required dialogue to probe parents for responses. All of the parents in the present sample were able to respond to the interviewer's trained line of questioning with ease and completed the LEAT within about 15 minutes. In addition, parents demonstrated remarkable understanding of the constructs in question because their estimates of language exposure across speakers fell within the expected range of waking hours (M = 4.3 hours; range = 1.74–9.38).
MCDI
The MCDI is a widely used parent-report measure of early language. The Words and Gestures inventory, intended for children between 8 and 18 months of age, is a checklist for parents to mark the words their child understands and says. The inventory provides researchers with an indirect account of the child's vocabulary comprehension. The MCDI, originally developed in English, has good reliability and validity and has been adapted for use in more than 50 languages and dialects, including Spanish and Canadian French (Fenson et al., 2006; Jackson-Maldonado et al., 2003; Kern, 1999; Trudeau, Frank, & Poulin-Dubois, 1999). These adaptations were used in the present study for the Spanish- and French-learning children.
The MCDI yields a measure of vocabulary size based on the number of words identified by parents on the checklist. Because children were evaluated in both languages, two separate measures of vocabulary size were calculated for each participant. From these measures, relative vocabulary size in the child's dominant language of exposure was computed for each participant (vocabulary size in Language A divided by the sum of vocabulary size across Languages A and B). This allowed us to compare the LEAT's relative exposure calculations to a relative measure of vocabulary and assess criterion validity.
CCT
The CCT contains 41 pairs of images presented on a touch-sensitive screen, following the method of Friend and colleagues (Friend & Keplinger, 2003; Friend, Schmitt, & Simpson, 2012). Children are prompted to touch the target by an experimenter (“Where is the shoe? Touch shoe.”). The task begins with four training trials followed by a test phase consisting of nouns, verbs, and adjectives of varying difficulty. During the test phase, the experimenter presents the pairs of images immediately following the first mention of the target word in the prompt. After 7 s elapse, if no response has been made, the trial ends and the pair of images disappears. The CCT yields a total vocabulary score based on the number of correctly identified words (defined as a first touch to the target item).
The CCT has shown significant immediate test–retest reliability across English, Spanish, and French adaptations, thus demonstrating that performance is systematic in children as young as 16 months of age. The CCT also demonstrates convergent validity with MCDI reports of vocabulary comprehension and 4-month test–retest reliability (Friend & Keplinger, 2008; Friend & Zesiger, 2011) and accounts for significant variance in subsequent vocabulary production (Friend et al., 2012).
Once again, relative vocabulary size in the child's dominant language of exposure was computed for each participant based on the number of correctly identified words on the CCT in each language (vocabulary size in Language A divided by the sum of vocabulary size across Languages A and B).
Procedure
Approximately 1 week before the children's visit to the lab, the LEAT was administered over the phone with the primary caregiver. The interviewers administering the assessment were fluent bilingual speakers of English and Spanish or English and French and were trained to follow the LEAT manual outlining specific questions to be asked to elicit the caregiver's responses. The LEAT was administered in English, Spanish, or French depending on the parents' language preference. During the visits to the lab, vocabulary size was assessed using the MCDI and CCT in both of the bilingual children's languages (Pearson et al., 1997).
During the visit to the lab, the children were first given a few minutes to warm up to the lab environment and the experimenter. Children and their parents were then escorted to a dimly lit room to administer the CCT. Parents wore blacked-out sunglasses and noise-cancelling headphones while their children sat on their lap and completed the CCT. Following the CCT, parents filled out the MCDI. The MCDI was given to the expert reporter for each language (see Table 1).
Table 1.
Average | SD | |
---|---|---|
Dominant language | ||
CCT | 9.18 | 6.1 |
MCDI | 165.79 | 91.26 |
Nondominant language | ||
CCT | 9.35 | 5.79 |
MCDI | 146.64 | 94.65 |
Note. CCT = Computerized Comprehension Task; MCDI = MacArthur Communicative Development Inventory.
Planned Analyses
Internal consistency refers to the homogeneity of a test or the degree to which all items on a test measure the same construct. That is, the items on a test should correlate if they indeed represent the construct of interest. High internal consistency suggests that the construct of interest has been consistently measured and that the derived scores are reliable (Henson, 2001). Thus, to answer our first question regarding the internal consistency of the LEAT, we assessed its four quantitative measures of language exposure: the overall parent estimate, the LEAT's calculation of hours per week, hours per day, and relative language exposure. The overall parent-report estimate is obtained by asking parents to provide overall percentages of relative exposure for each language that the child has been exposed to since birth, whereas the other three measures are derived from the detailed day-to-day hourly exposure reported throughout the assessment. Although all of the measures are based on parent report, the LEAT calculations are based on careful questioning about the timeline of exposure on a day-by-day basis. This is in contrast to the overall parent estimate, for which parents provide a single estimate of relative language exposure for their child's lifespan. We conducted an analysis of the internal consistency of these estimates to assess their reliability in measuring language exposure (Tavakol & Dennick, 2011).
The second research question concerned the LEAT's criterion validity. Criterion validity refers to the relation between a test and performance on another theoretically related measure (DeVon et al., 2007; Waltz, 2005; Woehr & Arthur, 2003). Following the approach of similar adult assessments (Marian et al., 2007), we evaluated the criterion validity of the LEAT by asking whether the relative language exposure calculation predicts language outcomes. In the case of young toddlers, we expected that relative language exposure would predict scores on our vocabulary measures (David & Wei, 2008; Eilers et al., 2006; Hoff et al., 2012; Hurtado, Grüter, Marchman, & Fernald, 2014; Pearson et al., 1997; Poulin-Dubois et al., 2013). According to Grüter et al. (2014), analyses between exposure and language outcomes should be conducted in the same terms (either absolute or relative). For example, Hurtado et al. (2014) demonstrated a strengthened correlation between exposure and proficiency in Spanish- and English-speaking 30- and 36-month-olds when both measures were assessed in relative terms (e.g., relative exposure and first language [L1]: second language [L2] ratios). Thus, in the present analyses, relative language exposure served as our independent measure of interest, and relative vocabulary size in L1 and L2 (rather than a raw vocabulary score) served as our dependent measure. Recall that the LEAT's estimate of relative language exposure was calculated by weighting the hours of exposure per day according to the duration of exposure to each source of input relative to the child's age (see LEAT under Method and online Supplemental Materials S1, S2, and S3 for more detail). From these weighted hour estimates, the LEAT calculates relative language exposure (e.g., hours of exposure to Language A divided by sum of hours of exposure to Languages A and B).
The final question of the present study was aimed at investigating the utility of the LEAT. In particular, does it provide more explanatory power than simply asking parents to give an overall estimate of exposure? To this end, we investigated whether the detailed nature of the LEAT explained more variance than the single parent-report estimate of relative language exposure.
To answer our research questions concerning the utility and criterion validity of the LEAT, we ran two hierarchical linear regressions with relative vocabulary size as the dependent variable. The predictor variables for these two models were identical. In the first model, we assessed the utility and criterion validity of the LEAT using CCT scores as the dependent measure. Because there are established effects of age and socioeconomic status (SES) on raw vocabulary size, we included these in our models as control variables. However, it is important to note that there was no a priori reason to expect age or SES to influence children's relative vocabulary across their two languages. On the first step of the model, we included maternal education as a proxy for SES (e.g., Hoff, 2003; Hoff & Tian, 2005) and age to examine whether LEAT variables explained additional variance in language proficiency (vocabulary) above these two factors. On the second step, we included language (English, Spanish, or French) to evaluate language-specific effects on relative vocabulary size. On the third step, we included the overall parent estimate of relative language exposure to the dominant language. Recall that this was a separate parent estimate that was not derived from the LEAT's calculations, in which parents were asked to provide an overall estimate of percent language exposure from birth. On the final step, we entered the LEAT's calculation of relative exposure to the dominant language, derived from the detailed parent-report estimates provided throughout the assessment. The second model assessed the utility and criterion validity of the LEAT using MCDI scores as the dependent measure. All predictors were identical across the two models. Thus, these models evaluated the LEAT's utility by examining whether the LEAT's calculation of exposure, derived from a detailed parent report of day-by-day language input, explained significant variance in relative vocabulary size (as measured by the MCDI and CCT) above simply asking parents to provide an overall estimate. In addition, the analyses evaluated the LEAT's criterion validity by asking whether the LEAT's relative language exposure calculation was a significant predictor of a theoretically related measure (vocabulary).
We expected that, consistent with previous research, an increase in relative language exposure would be associated with a larger proportion of known words in that language. Furthermore, the regression analyses evaluated language-specific effects between participants by holding language of exposure and vocabulary size constant within participants and asking whether the relation between the LEAT and vocabulary varies with language. That is, English exposure was considered in relation to English vocabulary for a single participant, Spanish exposure to Spanish vocabulary, and French exposure to French vocabulary. We opted for this single-model approach rather than evaluating separate models for each language. In this way, we avoided reducing power by breaking up the sample and decreased the possibility of capitalizing on chance by running separate analyses for each language.
Results
Internal Consistency
Cronbach's alpha was calculated for the overall parent estimate, the LEAT's calculation of hours per week, hours per day, and relative language exposure. They indicated strong internal consistency (α = .96).
Utility and Criterion Validity
Relative Vocabulary Size as Measured on the CCT
To answer our research questions concerning the utility and criterion validity of the LEAT, we first ran a hierarchical linear regression with CCT relative vocabulary size in the child's two languages as the dependent variable. On the first step of the model, we included maternal education and age. On the second step, we included language (English, Spanish, or French). The third step included the overall parent estimate of relative language exposure to the dominant language. On the final step, we entered the LEAT's calculation of relative language exposure to the dominant language. Variance inflation factors were between 1.0 and 1.09, indicating that the predictor variables were not multicollinear and therefore appropriate for the regression analyses (Mansfield & Helms, 1982).
The first, second, and third models with age, maternal education, language, and the overall parent estimate were not significant in explaining relative vocabulary size. In a similar way, the fourth and overall model that included maternal education, age, overall parent estimate, and the LEAT calculation was not significant. However, the LEAT estimate explained significant additional variance in vocabulary (R 2Δ = .06, p = .02) above maternal education, age, language, and the overall parent estimate. Indeed, removing these nonsignificant predictors yielded a significant model, such that the LEAT calculation predicted significant variance in vocabulary size, evincing a moderate effect size, F(1, 96) = 4.85, p = .03, R = .22 (see Table 2 for model fit statistics). The absence of a relation between vocabulary, age, and SES may seem somewhat surprising; however, recall that the dependent measure used in these analyses is relative vocabulary size rather than overall vocabulary. There is no a priori reason to expect that age or SES would influence vocabulary size in the dominant, relative to the nondominant, language. Figure 1 presents a scatter plot of the LEAT calculation of relative exposure as a function of relative vocabulary size on the CCT across the three language groups. Note that the trend lines are relatively parallel across languages.
Table 2.
Change statistics |
Model fit |
|||||
---|---|---|---|---|---|---|
R 2Δ | p | β | F | R | p | |
DV: CCT relative vocabulary size | ||||||
1. Maternal education | .12 | |||||
Age | .01 | .52 | .01 | 0.66 | .12 | .52 |
2. Language | .002 | .63 | .05 | 0.51 | .13 | .67 |
3. Overall parent estimate of relative exposure | < .001 | .97 | .004 | 0.38 | .13 | .82 |
4. LEAT calculation of relative exposure | .06 | .02* | .24 | 1.42 | .27 | .22 |
DV: MCDI relative vocabulary size | ||||||
1. Maternal education | .14 | |||||
Age | .03 | .23 | .12 | 1.50 | .17 | .23 |
2. Language | .03 | .08 | .18 | 2.04 | .25 | .11 |
3. Overall parent estimate of relative exposure | .002 | .64 | .05 | 1.57 | .25 | .19 |
4. LEAT calculation of relative exposure | .07 | .008* | .27 | 2.81 | .36 | .02* |
Note. CCT = Computerized Comprehension Task; LEAT = Language Exposure Assessment Tool; MCDI = MacArthur Communicative Development Inventory.
Indicates significant value at p < .05.
Relative Vocabulary Size as Measured on the MCDI
A second hierarchical linear regression was performed but this time with MCDI relative vocabulary size as the dependent variable to parallel the analyses on the CCT. The predictor variables were identical to the ones in the previous regression analysis: The first step included maternal education and age, the second step included language (English, Spanish or French), the third step included the overall parent estimate of relative language exposure, and the fourth step included the LEAT's calculation of relative language exposure. Once again, the predictor variables were not multicollinear and therefore appropriate for the regression analyses (variance inflation factors range: 1.0 to 1.9; Mansfield & Helms, 1982).
Only the overall model that included maternal education, age, language, the overall parent estimate, and the LEAT's calculation was significant in predicting MCDI relative vocabulary size, F(4, 78) = 2.81, p = .02, R 2 = .13 (see Table 2). All of the other models were not significant. Furthermore, as before, only the LEAT calculation explained significant variance above the other predictor variables (R 2Δ = .07, p = .008). Figure 2 presents a scatter plot of the LEAT calculation of relative exposure and relative vocabulary size on the MCDI across the three language groups. Note that, as for the CCT, the trend lines are relatively parallel across languages. Table 3 provides the bivariate correlations among the outcome and predictor variables across the MCDI and CCT analyses.
Table 3.
Measure | 1 | 2 | 3 | 4 | 5 |
---|---|---|---|---|---|
1. CCT relative vocabulary size | |||||
2. MCDI relative vocabulary size | .12 | ||||
3. Age | −.02 | −.14 | |||
4. Maternal education | .13 | −.11 | −.04 | ||
5. Overall parent estimate of relative exposure | .01 | −.01 | .08 | .11 | |
6. LEAT estimate of relative exposure | .24* | .26* | .09 | −.04 | .23* |
Note. CCT = Computerized Comprehension Task; MCDI = MacArthur Communicative Development Inventory; LEAT = Language Exposure Assessment Tool.
Indicates significant value at p < .05.
Discussion
The validity and reliability of parent report as a measure of relative language exposure has not been previously established despite widespread use in early bilingual language acquisition research. Thus, the aim of the present study was to provide an efficient language exposure assessment that could be used across languages and contexts and to examine the validity, reliability, and utility of the LEAT. Our results indicate that the LEAT demonstrates high internal consistency, criterion validity, and additional explanatory power above simply asking parents for an overall estimate of relative language exposure. It is important to note that these latter effects hold across parent-report and behavioral estimates of vocabulary knowledge.
Prior findings demonstrate that parent reports of relative language exposure correlate with word knowledge such that greater language exposure leads to larger vocabulary (David & Wei, 2008; Eilers et al., 2006; Hoff et al., 2012; Pearson et al., 1997; Poulin-Dubois et al., 2013). In a similar way, Place and Hoff (2011) showed that the number of different conversational speakers and amount of native language exposure as reported by parents explained significant variance in lexical knowledge above relative language exposure in children at age 2. Furthermore, the number of language-exclusive sources of input predicted grammatical complexity in English. The link between exposure and language proficiency also held in the present study because language exposure estimated on the LEAT converged with measures of vocabulary size across French, English, and Spanish in young children, indicating strong criterion validity. Indeed, in the current sample of children, exposure to two languages was relatively balanced on average, and this balance was reflected in children's vocabulary sizes as a group (see Table 1).
We also assessed the utility of the LEAT by comparing its calculations to the overall parent-report measure of relative language exposure. That is, what is the utility of a detailed assessment, and what does it provide above the overall estimate a parent could provide? Across both measures of vocabulary, the calculation of relative language exposure based on detailed questioning explained significant additional variance above the overall parent estimate, age, and maternal education. Thus the comprehensive calculation generated by the LEAT based on detailed parent report provides a more robust and reliable measure of language exposure than the overall parent estimate. Together, these results support the idea that the LEAT indeed captures aspects of language exposure underlying early vocabulary growth, consistent with prior research. Given the widespread variability in parent reports of early language exposure, the LEAT introduces a valid, reliable, and systematic approach to assessing language exposure across studies.
The present findings also have implications for the assessment of exposure to better discern the sources of variability in early language acquisition research. Moreover, and from a clinical perspective, the LEAT provides speech and language pathologists with a relatively easy, quick, and reliable tool for evaluating relative language exposure and determining whether language assessments and subsequent intervention should be conducted in one or more of a child's languages. For example, if both languages are functionally relevant for the child, it is recommended that both languages be assessed (Hoff & Core, 2013; Kohnert, 2013). Qualitative information on a child's significant conversational partners also informs the clinician and the researcher about the relevant communication settings for the child. The LEAT can also be readministered longitudinally to document the changing nature of a child's language exposure, thereby informing the changing communicative needs of the child. In addition, the current study contributes to the systematic measurement of language exposure in young bilingual and multilingual infants, building on previous language assessments. The LEAT can be used with other measures to inform educational policy with regard to the design of pre-K programs aimed at school readiness and K–12 curriculum, especially in communities with large immigrant populations. Last, the LEAT may also be particularly useful for immigrant populations in conjunction with currently available assessments to aid in determining the proper educational setting for children with varying degrees of exposure to the majority language.
Limitations
We now turn to potential limitations of the LEAT in capturing language exposure. As with all forms of self-report, there is a risk of reporting bias in using the LEAT. Highlighting this point, preliminary research by Grüter et al. (2014) has shown that parental reports of exposure do not correlate with a home language sample during a single, typical day. It is important to note that this finding is based on a small sample of 10 children between the ages of 36 and 40 months. As children enter the period of early childhood, it is likely that they are exposed to multiple speakers. Thus a single, overall parent report on language input may be insufficient to capture the richness of the language environment.
In addition, one caution in using the LEAT (or any parent-reported measure of exposure) is that estimates are likely to be most veridical for infants and toddlers for whom parents have substantial opportunity to observe sources of language input. This limitation could be mitigated by obtaining assessments from multiple sources (e.g., parents, teachers, other caregivers). For example, findings from Bornstein, Putnick, and De Houwer (2006) using parent reports of vocabulary on the MCDI demonstrate the importance of obtaining information from all possible sources of information to provide a broader estimate of early vocabulary.
An additional caution is that memory limitations should be taken into account when asking parents to estimate past language exposure. In the present study, we asked parents to estimate exposure during the course of the child's 17 months of life. Such retroactive estimates can become increasingly difficult as children get older and may therefore diminish the reliability of the LEAT. In these cases, it is possible to record more recent exposure estimates on the LEAT to ensure more accurate estimates (Bedore et al., 2012).
It is also important to note that although the LEAT's calculation of relative language exposure is associated with language outcomes (size of the lexicon), it is not itself an estimate of language proficiency. The LEAT should therefore not replace assessments of language levels in both languages for children in dual-language contexts. Instead, it can be a useful tool in clinical contexts for determining whether to examine proficiency in one or two languages. In a similar way, the LEAT does not capture all aspects of language exposure, but measures a subset of important factors that together are associated with vocabulary. For example, it does not assess fine-grained measures of language input that also affect early acquisition, such as number of words, speech rate, and maternal responsiveness, as these are variables that cannot be obtained from parental reports but through direct observation, usually in home settings (e.g., Hart & Risley, 1995; Tamis-LeMonda et al., 2001).
Conclusion
The heterogeneity of bilingual populations requires a valid characterization of the linguistic environment. Introducing consistency in the way in which we measure early language exposure in young children is a step in the direction of providing consistent assessments. This article has introduced the LEAT, an electronic scoring tool, and a detailed user manual. Furthermore, we have provided evidence for the utility, validity, and reliability of the LEAT with data from toddlers across English–French and English–Spanish exposure contexts. Given that the majority of language exposure assessments in young children are parent reports, the present adaptation of the LEAT provides a unified assessment of relative language exposure variables in research and clinical contexts while contributing ease and consistency in administration through its electronic interface.
Materials
The LEAT will be made available at the Child Language Data Exchange System website in a downloadable Excel format (http://childes.psy.cmu.edu/) as well as in the supplemental information available online for this publication (see Supplemental Materials S2 and S3). The LEAT also has an accompanying manual that provides instructions as well as suggested dialogue for the researcher and clinician to elicit appropriate responses from parents (see online Supplemental Material S1). The manual also includes details on the calculations of exposure and instructions for creating spreadsheets with summary variables for each participant that can be exported into data analysis software using macros built into the LEAT. These materials can also be obtained directly from the first and senior authors.
Supplementary Material
Acknowledgments
This research was supported by National Institutes of Health awards 5R01HD068458 and HD068458-02S1 to the senior author and 1F31HD081933 to the first author and does not necessarily represent the views of the National Institutes of Health. Additional funding was provided by the Ministry of Economy and Competitiveness (PSI-2011-25376) to the second author and by the Natural Sciences and Engineering Research Council of Canada (2003–2013) to the third author. We gratefully acknowledge Zaira Flores, Kristi Hendrickson, Anya Mancillas, Tamara Patrucco, and Monyka Rodrigues for assistance in participant recruitment, data collection, and coding and all of the parents and infants who devoted their time to participate in this research. Parts of the research included in this manuscript were presented at the Society for Research and Child Development Special Topics meeting on Developmental Methods (September 2014).
Funding Statement
This research was supported by National Institutes of Health awards 5R01HD068458 and HD068458-02S1 to the senior author and 1F31HD081933 to the first author and does not necessarily represent the views of the National Institutes of Health. Additional funding was provided by the Ministry of Economy and Competitiveness (PSI-2011-25376) to the second author and by the Natural Sciences and Engineering Research Council of Canada (2003–2013) to the third author.
References
- American Community Survey. (2010). Most spoken languages in California. Retrieved from http://www.mla.org/cgi-shl/docstudio/docs.pl?map_data_results
- Bedore L. M., Peña E. D., Summers C. L., Boerger K. M., Resendiz M. D., Greene K., … Gillam R. B. (2012). The measure matters: Language dominance profiles across measures in Spanish–English bilingual children. Bilingualism: Language and Cognition, 15, 616–629. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bornstein M. H., Putnick D. L., & De Houwer A. (2006). Child vocabulary across the second year: Stability and continuity for reporter comparisons and a cumulative score. First Language, 26, 299–316. [Google Scholar]
- Bosch L., & Sebastián-Gallés N. (2001). Evidence of early language discrimination abilities in infants from bilingual environments. Infancy, 2, 29–49. [DOI] [PubMed] [Google Scholar]
- Brito N., & Barr R. (2012). Influence of bilingualism on memory generalization during infancy. Developmental Science, 15, 812–816. [DOI] [PubMed] [Google Scholar]
- Byers-Heinlein K. (2015). Methods for studying infant bilingualism. In Schwieter J. W. (Ed.), The Cambridge handbook of bilingual processing. Cambridge, UK: Cambridge University Press. [Google Scholar]
- Byers-Heinlein K., & Werker J. F. (2009). Monolingual, bilingual, trilingual: Infants' language experience influences the development of a word learning heuristic. Developmental Science, 12, 815–823. [DOI] [PubMed] [Google Scholar]
- Canadian Census. (2011). Linguistic characteristics of Canadians. Retrieved from http://www12.statcan.ca/census-recensement/2011/as-sa/98-314-x/98-314-x2011001-eng.cfm
- Conboy B. T., & Mills D. L. (2006). Two languages, one developing brain: Event‐related potentials to words in bilingual toddlers. Developmental Science, 9, F1–F12. [DOI] [PubMed] [Google Scholar]
- David A., & Wei L. (2008). Individual differences in the lexical development of French–English bilingual children. International Journal of Bilingual Education and Bilingualism, 11, 598–618. [Google Scholar]
- De Houwer A. (2007). Parental language input patterns and children's bilingual use. Applied Psycholinguistics, 28, 411–424. [Google Scholar]
- De Houwer A., & Bornstein M. (2003, April). Balancing on the tightrope: Language use patterns in bilingual families with young children. 4th International Symposium on Bilingualism, Tempe, AZ. [Google Scholar]
- DeVon H. A., Block M. E., Moyle‐Wright P., Ernst D. M., Hayden S. J., Lazzara D. J., … Kostas‐Polston E. (2007). A psychometric toolbox for testing validity and reliability. Journal of Nursing Scholarship, 39, 155–164. [DOI] [PubMed] [Google Scholar]
- Eilers R. E., Pearson B. Z., & Cobo-Lewis A. B. (2006). The social circumstances of childhood bilingualism: The Miami experience. In McCardle P. & Hoff E. (Eds.), Childhood bilingualism, pp. 68–90. Clevedon, UK: Multilingual Matters. [Google Scholar]
- Fennell C. T. (2000). Does bilingual exposure affect infants' use of phonetic detail in a word learning task? (Unpublished master's thesis). The University of British Columbia, Vancouver, British Columbia, Canada. [Google Scholar]
- Fenson L., Marchman V. A., Thal D., Dale P. S., Reznick J. S., & Bates E. (2006). MacArthur-Bates Communicative Development Inventories: User's guide and technical manual. 2. Baltimore, MD: Brookes. [Google Scholar]
- Friend M., & Keplinger M. (2003). An infant-based assessment of early lexicon acquisition. Behavior Research Methods, Instruments, & Computers, 35, 302–309. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friend M., & Keplinger M. (2008). Reliability and validity of the Computerized Comprehension Task (CCT): Data from American English and Mexican Spanish infants. Journal of Child Language, 35, 77–98. doi: 10.1017/S0305000907008264 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friend M., Schmitt S.A., & Simpson A. M. (2012). Evaluating the predictive validity of the Computerized Comprehension Task: Comprehension predicts production. Developmental Psychology, 48, 136. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friend M., & Zesiger P. (2011). A systematic replication of the psychometric properties of the CCT in three languages: English, Spanish, and French. Enfance, 3, 329–344. doi: 10.4074/S0013754511003041 [Google Scholar]
- Garcia-Sierra A., Rivera-Gaxiola M., Percaccio C. R., Conboy B. T., Romo H., Klarman L., … Kuhl P. K. (2011). Bilingual language learning: An ERP study relating early brain response to speech, language input, and later word production. Journal of Phonetics, 39, 546–557. [Google Scholar]
- Grosjean F. (2010). Bilingual: Life and reality. Cambridge, MA: Harvard University Press. [Google Scholar]
- Grüter T., Hurtado N., Marchman V. A., & Fernald A. (2014). Language exposure and online processing efficiency in bilingual development. Input and Experience in Bilingual Development, 13, 15–36. [Google Scholar]
- Gutierrez-Clellen V. F., & Kreiter J. (2003). Understanding child bilingual acquisition using parent and teacher reports. Applied Psycholinguistics, 24, 267–288. [Google Scholar]
- Hart B., & Risley T. R. (1995). Meaningful differences in the everyday experience of young American children. Baltimore, MD: Brookes. [Google Scholar]
- Henson R. K. (2001). Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177–189. [Google Scholar]
- Hoff E. (2003). The specificity of environmental influence: Socioeconomic status affects early vocabulary development via maternal speech. Child Development, 74, 1368–1378. [DOI] [PubMed] [Google Scholar]
- Hoff E., & Core C. (2013). Input and language development in bilingually developing children. Seminars in Speech and Language, 34, 215–226. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hoff E., Core C., Place S., Rumiche R., Senor M., & Parra M. (2012). Dual language exposure and early bilingual development. Journal of Child Language, 39, 1–27. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hoff E., & Tian C. (2005). Socioeconomic status and cultural influences on language. Journal of Communication Disorders, 38, 271–278. [DOI] [PubMed] [Google Scholar]
- Hoff E., Welsh S., Place S., & Ribot K. (2014). Properties of dual language input that shape bilingual development and properties of environments that shape dual language input. Input and Experience in Bilingual Development, 13, 119–140. [Google Scholar]
- Hudson S., Levickis P., Down K., Nicholls R., & Wake M. (2015). Maternal responsiveness predicts child language at ages 3 and 4 in a community‐based sample of slow‐to‐talk toddlers. International Journal of Language & Communication Disorders, 50, 136–142. [DOI] [PubMed] [Google Scholar]
- Hurtado N., Grüter T., Marchman V. A., & Fernald A. (2014). Relative language exposure, processing efficiency and vocabulary in Spanish–English bilingual toddlers. Bilingualism: Language and Cognition, 17, 189–202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huttenlocher J., Haight W., Bryk A., Seltzer M., & Lyons T. (1991). Early vocabulary growth: Relation to language input and gender. Developmental Psychology, 27, 236–248. [Google Scholar]
- Jackson-Maldonado D., Thal D. J., Fenson L., Marchman V. A., Newton T., & Conboy B. (2003). MacArthur Inventarios del Desarrollo de Habilidades Comunicativas: User's guide and technical manual. Baltimore, MD: Brookes. [Google Scholar]
- Jia G., Kohnert K., Collado J., & Aquino-Garcia F. (2006). Action naming in Spanish and English by sequential bilingual children and adolescents. Journal of Speech, Language, and Hearing Research, 49, 588–602. [DOI] [PubMed] [Google Scholar]
- Kan P. F., & Kohnert K. (2008). Fast mapping by bilingual preschool children. Journal of Child Language, 35, 495–514. [DOI] [PubMed] [Google Scholar]
- Kern S. (1999). Inventaire Français du Développement Communicatif communicatif chez le nourrisson: Mots et gestes [French Infant Communicative Development Inventory: Words and gestures] [Measurement instrument]. Lyon, France: Laboratoire Dynamique du Langage, Institut des Sciences de l'Homme. [Google Scholar]
- Kohnert K. (2013). Language disorders in bilingual children and adults. San Diego, CA: Plural. [Google Scholar]
- Kovelman I., Baker S. A., & Petitto L. A. (2008). Age of first bilingual language exposure as a new window into bilingual reading development. Bilingualism, 11, 203–223. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Li P., Sepanski S., & Zhao X. (2006). Language history questionnaire: A Web-based interface for bilingual research. Behavior Research Methods, 38, 202–210. [DOI] [PubMed] [Google Scholar]
- Mansfield E. R., & Helms B. P. (1982). Detecting multicollinearity. The American Statistician, 36, 158–160. [Google Scholar]
- Marchman V. A., Martínez-Sussmann C., & Dale P. S. (2004). The language-specific nature of grammatical development: Evidence from bilingual language learners. Developmental Science, 7, 212–224. doi: 10.1111/j.1467-7687.2004.00340.x [DOI] [PubMed] [Google Scholar]
- Marian V., Blumenfeld H. K., & Kaushanskaya M. (2007). The Language Experience and Proficiency Questionnaire (LEAP-Q): Assessing language profiles in bilinguals and multilinguals. Journal of Speech, Language, and Hearing Research, 50, 940–967. [DOI] [PubMed] [Google Scholar]
- Parra M., Hoff E., & Core C. (2011). Relations among language exposure, phonological memory, and language development in Spanish–English bilingually developing 2-year-olds. Journal of Experimental Child Psychology, 108, 113–125. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pearson B., Fernandez S., Lewedeg V., & Oller K. (1997). The relation of input factors to lexical learning by bilingual infants. Applied Psycholinguistics, 18, 41–58. [Google Scholar]
- Peña E. D., Gutierrez-Clellen V., Iglesias A., Goldstein B., & Bedore L. M. (2014). BESA: Bilingual English-Spanish Assessment Manual. San Rafael, CA: AR-Clinical. [Google Scholar]
- Place S., & Hoff E. (2011). Properties of dual language exposure that influence 2‐year‐olds' bilingual proficiency. Child Development, 82, 1834–1849. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Poulin-Dubois D., Bialystok E., Blaye A., Polonia A., & Yott J. (2013). Lexical access and vocabulary development in very young bilinguals. International Journal of Bilingualism, 17, 57–70. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Poulin-Dubois D., Blaye A., Coutya J., & Bialystok E. (2011). The effects of bilingualism on toddlers' executive functioning. Journal of Experimental Child Psychology, 108, 567–579. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Snow C. E. (1972). Mothers' speech to children learning language. Child Development, 43, 549–565. [Google Scholar]
- Tamis-LeMonda C. S., Bornstein M. H., & Baumwell L. (2001). Maternal responsiveness and children's achievement of language milestones. Child Development, 72, 748–767. [DOI] [PubMed] [Google Scholar]
- Tavakol M., & Dennick R. (2011). Making sense of Cronbach's alpha. International Journal of Medical Education, 2, 53–55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thordardottir E., Rothenberg A., Rivard M. E., & Naves R. (2006). Bilingual assessment: Can overall proficiency be estimated from separate assessment of two languages? Journal of Multilingual Communication Disorders, 4, 1–21. [Google Scholar]
- Trudeau N., Frank I., & Poulin-Dubois D. (1999). Une adaptation en francais quebecois du MacArthur Communicative Development Inventory [A Quebec-French adaptation of the MacArthur Communicative Development Inventory]. La Revue D'orthophonie et D'audiologie, 23, 61–73. [Google Scholar]
- United Nations Educational, Scientific and Cultural Organization. (2003). Education in a multilingual world. Retrieved from http://unesdoc.unesco.org/images/0012/001297/129728e.pdf
- U.S. Census Bureau. (2011). Language spoken at home, 2011 American Community Survey 1-year estimates. Retrieved from http://factfinder2.census.gov/faces/tableservices/jsf/pages/productview.xhtml?pid=ACS_11_1YR_S1601&prodType=table
- Waltz C. F. (2005). Measurement in nursing and health research. New York: Springer. [Google Scholar]
- Weisleder A., & Fernald A. (2013). Talking to children matters: Early language experience strengthens processing and builds vocabulary. Psychological Science, 24, 2143–2152. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Woehr D. J., & Arthur W. (2003). The construct-related validity of assessment center ratings: A review and meta-analysis of the role of methodological factors. Journal of Management, 29, 231–258. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.