Abstract
Research in the sociology of education has shown that noncognitive traits are important predictors of educational outcomes and a mechanism of the intergenerational transmission of status. However, previous research on this topic typically posits that there is a constant effect of these traits with variable prevalences of these traits by socioeconomic status. Using time spent on homework as an example, I analyze income-based heterogeneity in homework efficacy, defined as the individual effect of study time on academic achievement, using a national U.S. probability sample of secondary students. Higher income students gain more knowledge from their homework time than their counterparts in all grades and all subjects except history, with greater group differences for math than for science and reading. These results are confirmed by models accounting for time-invariant unobserved heterogeneity in the 8th–10th, but not 10th–12th, grade windows. These results imply that increases in the amount of homework assigned may increase the socioeconomic achievement gap in math, science, and reading in secondary school.
Keywords: Homework, Efficacy, Academic achievement, Secondary school, Parental income, Education
1. Introduction
Research in the sociology of education is frequently concerned with the importance of noncognitive traits such as behavioral habits and personality on academic achievement outcomes. For example, the groundbreaking research of Bowles and Gintis (1976), Farkas and colleagues (Farkas, Grobe, Shehan, & Shuan, 1990; Farkas, 1996), Lareau (Lareau & Horvat, 1999; Lareau, 2000, 2001, 2002) and others (DeLuca & Rosenbaum, 2001; Farkas et al., 1990; Farkas, 1996; Lleras, 2008; Roscigno & Ainsworth-Darnell, 1999; Rosenbaum, 2001) suggests that those who are more attentive, spend more time on work, and avoid disruptive behaviors experience greater learning in school, greater educational attainment, and labor force success than comparably skilled persons who do so to a lesser degree. This important line of research assumes that these inequalities are created when more advantaged students disproportionately engage in the behaviors in question and thereby attain greater academic achievement than do less advantaged students. However, this research largely does not investigate the possibility that the rewards accruing to these behaviors vary by social background. To the degree that students derive differential rewards from favored behaviors in the educational system, this line of research overlooks an important potential mechanism of educational inequality.
To address this possibility, in this research I investigate variability in the effect of time spent on homework in secondary school on academic achievement outcomes by parental income, grade, and subject. I hypothesize that more advantaged students will derive greater academic benefit from an additional hour of homework time than do less advantaged students who spend the same amount of time on their homework. Investigating this question for math, science, history, and reading, I show that, compared to less advantaged students, students with higher parental incomes derive additional knowledge from their studies in all subjects in 8th and 10th grade, and that this is true of all subjects except reading in 12th grade. However, this pattern is occasionally reversed at comparatively high amounts of time spent on homework. Because students with higher parental incomes also have higher initial test scores in 8th grade, these findings suggest that moderate increases in the homework load of secondary students will tend to increase inequality in academic achievement by parental income early in secondary school.
2. Background
2.1. Noncognitive traits and academic achievement
Sociological and other educational researchers have investigated the importance of a wide range of noncognitive traits for academic achievement and educational and occupational attainment, although many (Farkas, England, Vicknair, & Kilbourne, 1997; Farkas, 2003; Kerckhoff, Raudenbush, & Glennie, 2001; Lleras, 2008; Raudenbush & Kasim, 1998) argue that these processes have been understudied relative to cognitive skills. Among many others, parent–teacher and teacher–student relationships have been found to be important determinants of learning (e.g., Hamre & Pianta, 2001; Liew, Chen, & Hughes, 2010), as is parental social closure (e.g., Morgan & Sorensen, 1999), personality (e.g., Jackson, 2006), cultural capital and social skills (e.g., Lareau, 2003), and educational aspirations (Kao & Tienda, 1998).
However, school work habits and other goal-oriented behaviors occupy a prominent place in this literature. Bowles and Gintis (1976) emphasized the importance of perseverance, dependability, and consistency in school and labor force behavior, arguing that these traits were more important for stratification outcomes than was cognitive ability. Similarly, Farkas and colleagues (Farkas et al., 1990; Farkas, 1996) attribute similar importance to these traits in middle school net of cognitive skill influences. Similar findings are widely reported (e.g., DeLuca & Rosenbaum, 2001; Lleras, 2008; Roscigno & Ainsworth-Darnell, 1999; Rosenbaum, 2001).
Of these investigations, only DeLuca and Rosenbaum (2001) investigated variability in the effects of these traits. Their investigation found that harder-working low socioeconomic status students were less rewarded in their educational attainment outcomes than were their higher SES peers. The present investigation extends this important finding by examining socioeconomic variability in the academic achievement returns to time spent on homework in secondary school.
2.2. Time spent on homework
A key noncognitive behavior in this literature is work ethic, and time spent on homework is a potentially important means by which work ethic is expressed. Although the literature on noncognitive traits in education tends to emphasize their importance in grades, it may be that these are important for learning, as well. Time spent on homework is especially likely to do so because homework is assigned in the interests of promoting learning. As such the amount of time spent on homework is a potentially important linkage between socioeconomic status and academic achievement.
However, there is no strong linear relationship between parental SES and time spent on homework. Instead, it may be that the important socioeconomic difference in homework is how effectively this time is spent. However, there is no consensus on whether homework promotes learning at all. Some studies document positive effects (Di Napoli, 1937; Dickinson & O’Connell, 1990; Koch, 1965; Maertons & Johnson, 1972) and others report null effects (Dettmers, Trautwein, & Luedtke, 2009; Gray & Allison, 1971; Hill, 1991; Schuman, Walsh, Olson, & Etheridge, 1985; Teahan, 1935). Despite this lack of evidentiary basis, over the last fifty years secondary students have taken on steadily increasing homework loads (U.S. Department of Education, 2007).
One reason for these inconsistent and generally weak associations between homework time and achievement may be the insufficient attention which has been paid to the heterogeneous effects of homework time on learning. These previous studies have generally attempted to estimate the association or causal effect thereof for a population as a whole. This paper contends that there is no single effect of study time on learning – rather, students vary in the benefits of their homework time. In other words, they vary in their homework efficacy.
2.3. Perspectives on learning and homework efficacy
Theories of learning in the educational literature suggest a number of mechanisms which vary by parental socioeconomic status and which may influence homework efficacy. Although this analysis will not be able to determine which of these mechanisms, if any, link parental income to socioeconomic inequalities in homework efficacy, a brief review of these theoretical traditions should highlight potential avenues for future research on this important topic.
Learning is a process which takes place through time, and the time required to master material varies between students. As discussed at length by Trautwein and Köller (2003), there are two dominant perspectives on the learning process which shed light on how variable effects of time studying might occur. The classic approach is known as the Opportunity to Learn (OTL) paradigm (Carroll, 1963, 1984; Paschal, Weinstein, & Walberg, 1984; Walberg and Paschal, 1995), in which learning occurs at the conjunction of time spent on learning (influenced by time constraints and perseverance) and time needed to learn (influenced by academic aptitude, ability to follow instructions, and the quality of instruction). This perspective suggests that time spent on homework should yield positive learning rewards, but only up to the amount of time needed to learn the material, which is shorter for students with greater cognitive abilities and better teachers. The implication is that higher achieving students and those with more effective teachers will gain greater knowledge returns to their time studying than will their counterparts up to the point at which they have mastered the material.
Both of these factors – measured cognitive ability and teacher quality – vary by parental socioeconomic status. Cognitive skill may shorten time needed to learn as higher skill students are able to more quickly master the homework material (Sorensen & Hallinan, 1977). Cognitive skill is positively associated with parental socioeconomic status (Alexander, Entwisle, & Dauber, 1993; Bloom, 1964; Duncan, Brooks-Gunn, & Klebanov, 1994; Escalona, 1982; Fryer & Levitt, 2005; Grodsky, Warren, & Felts, 2008; Hess, Holloway, Price, & Dickson, 1982; Pianta, Egeland, & Sroufe, 1990). Additionally, better teachers and teacher–student relationships may promote how much one learns from homework (Liew et al., 2010), and higher quality teacher–student relationships are positively associated with parental SES (Birch & Ladd, 1997; Ladd, Birch, & Buhs, 1999; Pianta & Stuhlman, 2004a, 2004b).
A second perspective on self-guided learning is a combination of self-regulated learning theory (Boekaerts, 1999) and expectancy-value theory (Eccles, Adler, & Meece, 1984) exposited by Trautwein and Köller (2003). In this blending, there are three components of self-guided learning: cognitive (learning styles and strategies), metacognitive (goal specification), and motivational (motivation locus, control beliefs) components. Variability in these three components should yield variability in the rate of learning during study time – i.e., homework efficacy.
The cognitive component of this theory refers to learning styles and self-regulation of school effort. There are two primary styles of learning: reproductive (memorization and summarization) and constructive (meaning-seeking learning; Biggs, 1987; Entwisle, 1998; Marton & Säljö, 1984; Marton, Dall’Alba, & Beaty, 1993; Vermunt, 1992). Compared to reproductive styles, constructive learning strategies promote faster rates of learning during time spent on homework, even for assessments of factual knowledge (Beishuizen & Stoutjesdijk, 1999; Lindblom-Ylänne & Lonka, 1999; Vermunt & Vermetten, 2004). Self-regulation describes how students steer their learning activities. Examples include time management and diagnosing one’s work for errors (Zimmerman, 1998). This concept is closely related to learning style – students exhibiting constructive learning strategies are more likely to demonstrate self-regulated learning (Schunk, 1990; Vermunt, 1998). Self-regulatory behaviors are associated with parental socioeconomic status in ways which advantage higher SES students. Additionally, lower SES students exhibit lower rates of self-regulated learning (Brody & Flor, 1997; Brody, Stoneman & Flor, 1996; Evans & English, 2002; Evans & Rosenbaum, 2008; Evans, Gonella, Marcynyszyn, Gentile, & Salpekar, 2005), suggesting that high SES students will have higher homework efficacy.
The metacognitive component of this theory refers to differences in mistake recognition, self-monitoring of one’s current state of understanding, and expression of thoughts. The sparse evidence concerning socioeconomic patterns of metacognitive traits suggests that higher SES students will on average exhibit higher homework efficacy than lower SES students. An analysis of 5–6 year old children in day care showed that high SES children are better able to explain their ideas and thinking in a clinical setting (Pappas, Ginsburg, & Jiang, 2003). Middle class children typically show greater verbal skills than lower class children (Jordan, Huttenlocher, & Levine, 1992). Although I am unaware of any studies investigating socioeconomic patterns of metacognition in secondary school, these patterns are consistent with the hypothesis that higher SES students will have greater homework efficacy.
The motivational component refers to student differences in their locus of control and motivation to accomplish the task at hand. Locus of control (e.g., Battle & Rotter, 1963; Bialer, 1961; Findley & Cooper, 1983) describes the degree of control students believe they exert over the outcomes of a learning process. Those with external loci of control (‘externals’) on average show less persistence in the face of difficult tasks (Ducette & Wolk, 1972) and are on average associated with worse academic performance (Nelson & Mathia, 1995; Nowicki & Strickland, 1973). Additionally, motivation to achieve plays an important role, and more motivated students have better average academic performance (Schmitz & Skinner, 1993).
Research on the association of socioeconomic status with motivational factors suggests that students from higher SES homes could exhibit greater homework efficacy in both preschool (Day & Burns, 2011) and adulthood (Padawer, Jacobs-Lawson, Hershey, & Thomas, 2007). However, I found no study investigating the relationship between school work motivations and parental socioeconomic status in secondary school. Additionally, internal locus of control is positively related to parental SES (Battle & Rotter, 1963; Findley & Cooper, 1983; Gore & Rotter, 1963). Finally, although evidence on this subject is limited, academic self-efficacy (a concept closely related to academic motivation and locus of control) may be positively related to parental SES, as well (Usher & Pajares, 2006; Vekiri, 2010). Additionally, qualitative work in sociology (e.g., Lareau, 2002) suggests that middle class students disproportionately display behavioral profiles consistent with high self-efficacy. Although much is unknown about the socioeconomic patterns of academic motivation in this literature, taken together this evidence suggests that higher SES students will demonstrate greater homework efficacy.
In sum, the bulk of the predictors of homework efficacy in the education literature predict that higher socioeconomic status students will demonstrate higher homework efficacy in secondary school. To the degree that parental socioeconomic status is linked to variation in homework efficacy, it is likely that socioeconomic differentials in academic ability, teacher relationships, cognitive learning styles, metacognitive characteristics, and sense of control and academic motivation to some degree mediate this relationship.
2.4. Homework and achievement: obstacles to inference
Unfortunately, assessing the independent effects of homework on learning is not a straightforward process. In addition to the challenge of identifying the individually variable effects of homework on learning, well-known spurious processes between these two characteristics could lead to misleading conclusions concerning their association. For instance, classes involving large homework loads, and students who spend a great deal of time on them, likely vary in systematic ways from classes and individuals which do not, which could result in biased estimates. Honors courses could attract more highly achieving students and involve more homework, resulting in the appearance of a homework–learning association regardless of whether there is a true such effect. Similarly, higher achieving students could be more motivated to work in school regardless of whether doing so is efficacious for them. Also, over time students may adjust the amount of time they spend studying to their achievement level depending on whether they have achieved their academic goals – students who are doing either very well or very poorly may throttle down their study efforts in order to ‘cruise’ (in the case of high achieving students) or give up (in the case of lower achieving students).
2.4.1. Association studies
The majority of observational studies (Dickinson & O’Connell, 1990; Koch, 1965; Maertons & Johnson, 1972; Rau & Durand, 2000) addressing this topic do not adequately address these difficulties. Although most document positive effects of homework effort (Cooper, 1989; Cooper, Robinson, & Patall, 2006), cross-sectional studies by definition cannot address the direction or causal status of an effect without an exogenous source of variation (as in a natural or designed experiment or instrumental variable study). Furthermore, many such studies fail to address teacher effects or other sources of unobserved heterogeneity which could bias their estimates.
2.4.2. Causal studies
Even so, a number of studies have tried to address these methodological challenges in a more interpretable manner. For instance, Cooper and colleagues (Cooper et al., 2006) find four studies (Foyle, Lyman, Tompkins, Perne, & Foyle, 1990; Foyle, 1984; McGrath, 1992; Meloy, 1987) which randomly assign a homework/no homework policy to different classrooms in different grades and subjects. All four such studies found some evidence of positive influences. Unfortunately, the necessarily small scale of such studies and the difficulties of producing equivalent comparison groups in such settings limits their generalizability.
Other studies use observational, larger scale data to attempt to address some or all of these issues. Aksoy and Link (2000) use panel methods (fixed or random effects depending on the result of a Hausman specification test) using the NELS:88 dataset, and find positive influences of studying. Also using the NELS:88 dataset, Eren and Henderson (2008) find evidence of a positive, moderate, and declining marginal effect of study hours in 10th grade net of previous achievement, school fixed effects, and classroom achievement level. Stinebrickner and Stinebrickner (2008) use whether one’s randomly assigned roommate at a small college has a video game system as an instrumental variable for study efforts, and document a positive effect of studying on GPA. Finally, Trautwein, Schnyder, Niggli, Neumann, and Ludtke (2009) find strong positive homework effort and homework time causal effects at the individual level among a moderate sample of foreign language students in Switzerland.
Collectively, therefore, these studies address some of the interpretation challenges raised by the previously reviewed research efforts. Fixed effects studies (such as Aksoy & Link, 2000 and Trautwein et al., 2009) eliminate individually-stable components of variance, including any time-invariant individual confounders of the homework–achievement relationship. Instrumental variables – even weak ones such as a roommate’s gaming system – address the causal ordering question while also eliminating sources of spurious association (at the cost of efficiency). And the Eren and Ozkan (2008) study, by controlling for school fixed effects and classroom achievement level, address the multilevel nature of the homework completion process. Because all of these studies concur in their findings while differing in their methods and samples, they collectively provide some assurance that the average effect of homework on achievement is positive and causal.
2.4.3. Interactive studies
However, properly measuring variability in the effect of homework on achievement while accounting for these other challenges also poses inferential difficulties, and many of these more causally informative studies do not address this shortcoming. Variability in this effect may occur in one of two ways: due to variable mean effects of studying, and variable functional forms.
A few other studies attempt to investigate this subject. Possible moderators of homework efficacy include grade in school (Cooper et al., 2006), female gender (Mau & Lynn, 2000, but see Foyle, 1984), and class achievement levels (Eren & Henderson, 2008). Although not directly tested as such, the literature also suggests a number of other possible predictors of homework efficacy, among them test anxiety (Culler & Holahan, 1980), study skills (Credé & Kuncel, 2008), and parental involvement (Hoover-Dempsey et al., 2001). In the last decade, therefore, research on the homework–achievement relationship is beginning to recognize the potential for heterogeneity in its effects. To further this literature, the present research investigates socioeconomic and grade differentials in homework efficacy within a causally interpretable model.
3. Methods
3.1. Data: national educational longitudinal study of 1988
The NELS:88 public use dataset offers several advantages for studying the topic at hand. It provides a large (N = 27,394 cases), nationally representative data set of the cohort of U.S. adolescents in the 8th grade in 1988 with a school-based sampling design, and follows a subset (N = 15,437) of them longitudinally through five waves of data collection, including data from ages 14 to about 26. Importantly, the data includes repeated administrations of an identical set of subject-specific academic achievement tests in 8th, 10th, and 12th grades. I restrict my analysis to those who participated in the first three waves of data, whose school was marked with an identifier, and who remained in school through 12th grade and completed all three achievement test administrations, leaving 16.489 cases in the analytical sample, clustered in 1468 schools. Data were multiply imputed (Allison, 2002; Rubin, 1987) using the multivariate imputation by chained equations (MICE) method in Stata (Royston, 2004).
3.2. Measures
3.2.1. Time spent on homework
I measure study time using student categorical reports of the number of hours the respondent typically expends studying each subject outside of class in each week. The question reads, “In the following subjects, about how much time do you spend on homework each week?” Response categories for the first wave of data were “none,” “less than 1 hour,” “1 hour,” “2 hours,” “3 hours,” “4–6 hours,” “7–9 hours,” and “10 or more.” In subsequent waves the scales of the categories shifted upward, so to make measures comparable between waves each category was recoded with the number of hours if it is a specific value listed, the median if a range is listed, and the lowest value in the highest category (i.e., in the first wave, 10; in the second and third, 15). For each category the midpoint of the range is assigned as the numerical value; for the upper category, ten hours were assigned for the highest category in 8th grade and fifteen hours for the highest category in 10th and 12th grades.
3.2.2. Academic achievement
Academic achievement is measured using a subject-specific achievement test administered to students by NELS 88 in the 8th, 10th, and 12th grades, employing the item response theory (IRT) estimated number right metric. NELS 88 staff recommend this metric for longitudinal analysis (Rock & Pollock, 1991) as it is a reliable measure (thus somewhat reducing the problem of regression to the mean) and is directly comparable across administrations. Furthermore, this computer-administered test uses student performance on early questions to scale the difficulty level of subsequent questions, increasing precision of measurement.
3.2.3. Demographic characteristics
Information on respondents’ gender, race/ethnicity, and parental income are also employed in this analysis to provide information on the demographic characteristics of the sample and to test the hypothesis that homework efficacy varies by parental socioeconomic status. These are treated as time-invariant characteristics since parental income is measured only in 8th grade in NELS:88. Gender and race/ethnicity are measured by student report. Parental income is measured by parental report and grouped into fifteen categories, which in this analysis are recoded to the midpoint of the range and logged.
3.3. Models
Regression analyses proceeded in two primary steps. First, to test whether there is an average association between time spent on homework and academic achievement scores, OLS regression models were estimated predicting subject-specific academic achievement as a cubic function of time spent on homework, parental income, race, gender, and an interaction between all homework terms and parental income. The results of these models will establish whether there is an average association between homework and standardized test performance (stratified by subject and grade in school), and whether this association varies by parental income. As such these results will constitute the first test of the hypothesis that homework efficacy varies proportionally to parental income.
However, it is likely that these estimates will be biased due to unobserved heterogeneity in time-invariant factors such as academic potential. Accordingly, these results will be confirmed in a first differences regression analysis focused on change in homework time and academic achievement scores. First differences models are substantively very similar to fixed effects regression (Halaby, 2004) in that time-invariant, unobserved characteristics with constant effects are differenced out from the estimating equation. However, as with all panel methods, time-varying sources of unobserved heterogeneity and time-invariant characteristics with time-varying effects may still bias the estimates obtained.
A key refinement of the standard first differences model is required for present purposes. Although the main effects of time-invariant variables are not estimated in this model, the effects of changes in homework are interacted separately with a time-invariant characteristic – parental income in 8th grade. This adjustment produces the following model:
| (1) |
where ΔYit,(t − 1) is change in academic achievement, ΔXit,(t − 1) is change in study time, and I0 is logged parental income in 8th grade.1 The interactive effect of parental income and time spent on homework (captured in β4, β5, and β6) is of crucial concern for the present analysis and is taken as a measure of homework efficacy when potential time-invariant sources of spuriousness are accounted for.
As described, this model will be estimated for the NELS:88 sample by examining the association of changes in study time and academic achievement for four different subjects – mathematics, science, history/social studies, and reading. In each case the study time measure used will be matched by subject to the academic achievement measure being explained. In other words, hours spent studying for math will be used to explain variation in mathematics achievement. The lone exception to this practice will be the models of reading achievement, for which hours spent studying for English class will be the predictor variable.2
3.4. Margins of responses
In addition to properly estimating the association between study time and academic achievement, a further challenge of this analysis is to synthesize the large number of regression coefficients the analysis produced into an interpretable form. This is done by converting the regression coefficients into margins of the change in achievement scores associated with different values of study time. In this analysis, this consists of calculating the mean change in achievement expected if all respondents reported a 0–10 hour amount of homework time for a subject, while using the observed values on all control variables. In other words, this exercise calculates the predicted value of the change in academic achievement score when some covariates (homework time) are manipulated while others are used as observed. This approach is known as adjusted predictions or the method of recycled predictions. The key virtue of this approach is that it reduces the several regression coefficients associating changes in study time with changes in achievement in the proposed model into readily understood predicted change scores.
However, because the NELS:88 academic achievement tests vary by subject in their scale – for instance, the maximum math score is higher than the maximum science score – these marginal values are converted to an especially interpretable and comparable form with an eye on understanding changes in inequality associated with changes in study time. Each margin is displayed as the counterfactual rate of change (CRC) value
| (2) |
where j is the increase in study effort being evaluated and Mj is the margin value observed when all observations are assigned a k increase in homework time. Therefore Mj is the percentage increase in learning expected when one increases one’s homework time by k compared to the amount of learning expected with no increase in homework time. So for instance, if M3 is 10 and M0 is 8, R3−0 = 25%, indicating that one would learn 25% more in that time interval if one studied three hours per week than if one had not studied. The results on the left hand side of Figs. 2–4 (discussed below) are displayed in CRC form.
Fig. 2.
8th grade learning and achievement gap eliminated, by income percentile, study hours, and subject. Note: CRC values are model-predicted change in learning associated with increase in study time compared to no change in study time, separately by subject. MDR values are the percent change in achievement gaps predicted by interactive first differences model if all students increase their study time uniformly. Students with parental incomes in the 90th percentile are the reference group.
Fig. 4.
12th grade learning and achievement gap eliminated, by income percentile, study hours, and subject. Note: CRC values are model-predicted change in learning associated with increase in study time compared to no change in study time, separately by subject. MDR values are the percent change in achievement gaps predicted by interactive first differences model if all students increase their study time uniformly. Students with parental incomes in the 90th percentile are the reference group.
To assess the degree to which increases in homework hours would increase the socioeconomic achievement gap, these results are also shown in a different form, as
| (3) |
where MDRjklt is the margins difference ratio (hereafter MDR), M is the margin of response, j is the value of change in homework time being evaluated, k and l denote the designated reference and comparison groups, t designates the grade at the end of the interval being examined, and y are the mean achievement scores at the beginning of that interval. This ratio is interpretable as the percentage increase or decrease in the achievement gap between groups k and l associated with a uniform j hour increase in homework time over the interval t−1 to t. In other words, it is the percentage growth in the achievement gap between two groups predicted by the model if all students increased their homework time by j hours. The results on the right hand side of Figs. 2–4 (discussed below) are shown in MDR form.
4. Results
4.1. Homework and achievement – variability over time
There is sufficient variability in the key variables just described to estimate these models. This is important to investigate because, if students’ reported study time or academic achievement did not substantially vary over time, it would be impossible to estimate the desired effects. Comparing change in achievement scores between the 10th and 12th grades for math, science, history, and reading with cross-sectional variability in the same tests in 10th grade, as Table 1 shows, the standard deviation in the change in test scores is 69, 82, 76, and 84% the standard deviation of the cross-sectional distributions respectively. Therefore while the variability in the change scores are somewhat reduced, ample variability in test score changes still remain. Similarly for time spent on homework, the comparable figures are 80, 73, 69, and 81%. Thus there remains sufficient variability in both the first-differenced study time and academic achievement measures to efficiently estimate the proposed models in order to assess the contribution of differences in study time and homework efficacy to the achievement gap.
Table 1.
Cross-sectional and longitudinal test score and study effort, by grade and subject.
| Math | Science | History | Reading | |||||
|---|---|---|---|---|---|---|---|---|
| Mean | SD | Mean | SD | Mean | SD | Mean | SD | |
| Test scores | ||||||||
| 8th | 35.28 | (11.76) | 18.48 | (4.80) | 29.28 | (4.56) | 26.52 | (8.53) |
| 10th | 42.72 | (13.69) | 21.29 | (5.96) | 31.15 | (5.13) | 30.06 | (9.97) |
| 12th | 47.51 | (13.69) | 23.17 | (5.81) | 34.42 | (5.12) | 32.75 | (9.84) |
| Change, 8–10 | 7.39 | (8.13) | 2.79 | (4.44) | 1.85 | (3.58) | 3.50 | (6.64) |
| Change, 10–12 | 4.72 | (9.39) | 1.85 | (4.86) | 3.25 | (3.88) | 2.64 | (8.28) |
| Study hours | ||||||||
| 8th | 1.74 | (2.38) | 1.35 | (2.24) | 1.54 | (2.35) | 1.50 | (2.31) |
| 10th | 2.88 | (4.53) | 2.80 | (4.63) | 2.88 | (5.03) | 2.83 | (4.47) |
| 12th | 3.71 | (5.44) | 3.35 | (5.47) | 3.66 | (5.47) | 4.50 | (5.39) |
| Change, 8–10 | 0.36 | (3.09) | 0.59 | (2.89) | 0.21 | (3.03) | 0.63 | (2.97) |
| Change, 10–12 | 0.12 | (3.61) | −0.08 | (3.40) | 0.41 | (3.46) | 0.88 | (3.64) |
Another potential limitation of the analysis would be if the majority of changes in time spent on homework values were between adjacent categories across waves, potentially suggesting that apparent changes in studying time are the result of measurement error. This is not the case. For all subjects and grades, more than 40% of respondents shifted their self-reported time spent on homework between non-adjacent categories in the original survey measure (not shown). 3 Depending on the grade window and subject, only 22–31% of respondents report studying amounts in the same categories between windows of observation. These results suggest that changing the amount of time spent on homework students report is the norm, not the exception.
4.2. The achievement and homework gaps by parental income
Table 2 reports mean achievement scores by subject and parental income percentile in 8th and 10th grades, where achievement scores are calculated as the mean of students within two percentage points in either direction from the indicated parental income percentile. The data show large differences in academic achievement by parental income. For instance, the mean math achievement test score in 8th grade is 26% lower for those in the 10th income percentile compared with those in the 90th percentiles. Gradations in academic achievement in both grades and all subjects are well-ordered by income, such that each percentile listed in Table 2 shows a higher mean score on the achievement test than all lower percentiles. In general, the smallest proportional achievement gaps by income are observed for history, followed by science, reading, and math. All differences in academic achievement by grade and subject listed in Table 2 are statistically significant compared to the values for the 90th percentile income group.
Table 2.
Test scores and achievement gaps by grade, subject, and parental income percentile.
| Income percentile | 8th grade | 10th grade | ||||||
|---|---|---|---|---|---|---|---|---|
| Math | Science | History | Reading | Math | Science | History | Reading | |
| 10th | 29.4* | 16.7* | 27.4* | 23.3* | 35.0* | 18.2* | 29.0* | 25.6* |
| (10.0) | (3.1) | (3.2) | (5.7) | (12.4) | (4.7) | (3.6) | (7.2) | |
| 25th | 32.7* | 17.5* | 28.5* | 24.7* | 39.4* | 20.2* | 30.2* | 27.8* |
| (6.8) | (2.3) | (2.1) | (4.2) | (8.0) | (2.7) | (2.4) | (5.0) | |
| 50th | 35.1* | 18.6* | 29.3* | 26.7* | 42.9* | 21.3* | 31.3* | 30.4* |
| (4.4) | (1.3) | (1.3) | (2.2) | (4.5) | (1.6) | (1.4) | (2.4) | |
| 75th | 37.6* | 19.3* | 30.1* | 27.9* | 45.3* | 22.3* | 32.0* | 31.4* |
| (1.9) | (0.6) | (0.4) | (1.0) | (2.1) | (0.6) | (0.7) | (1.5) | |
| 90th (Ref.) | 39.5 | 19.9 | 30.6 | 28.9 | 47.4 | 22.9 | 32.7 | 32.8 |
Note: Mean achievement test scores by group and subject are listed first; achievement gap (defined as YRef — YCom where former is reference group and latter is comparison group) in that test score shown in parentheses second.
Indicate that, compared to the 90th percentile mean, the difference in means is statistically significant at the p ≤ .05 level.
Fig. 1 graphically depicts similar information for time spent on homework in all four subjects by parental income for 8th, 10th, and 12th grades. The data show a curvilinear relationship between parental income and time spent on homework. The relationship is relatively flat for all subjects in 8th grade. However, a strong curvilinear relationship between self-reported time spent on homework and parental income is observed in 10th and 12th grades. Those with the lowest parental incomes report the highest typical time spent on homework values, and the relationship with high levels of income is concave up.4
Fig. 1.
LOWESS curves of homework hours by subject and income percentile. Note: Lines are LOWESS curves plotted separately by subject and grade for the relationship between parental income percentile and hours spent on homework per week.
4.3. Other descriptive statistics
Additionally, Table 3 reports the demographic composition of the imputed, unweighted NELS:88 analytical sample,5 as well as descriptive statistics on all time-variant control variables employed in the regression models reported. The analytical sample was 51% female and 49% male. Sixty-eight percent of the respondents were non-Hispanic white, 10% were non-Hispanic black, 12% were Hispanics of any race, 6% were Asian Americans, and 4% were Native Americans. The average logged parental income in 8th grade (in thousands of dollars) was 10.3, with a standard deviation of 0.93.
Table 3.
Analytical sample demographic composition.
| Mean | SD | |
|---|---|---|
| Gender | ||
| Male | 0.49 | – |
| Female | 0.51 | – |
| Race | ||
| White | 0.68 | – |
| Black | 0.10 | – |
| Hispanic | 0.12 | – |
| Asian | 0.06 | – |
| Native American | 0.04 | – |
| Logged Income | 10.30 | (0.93) |
Note: Figures are unweighted.
4.4. Homework efficacy inequality by parental income
The first question to answer in this analysis is whether time spent on homework is statistically significantly associated with standardized test scores. Tables 4 and 5 show the results of all regression models employed in this analysis. All models control for income, gender, and race. As can be seen in models (1), (3), and (5) in Tables 4 and 5, time spent on homework is statistically significantly associated with performance on standardized tests in all subjects and grades.
Table 4.
Math and science regressions by grade.
| Cross-sectional | First difference | |||||||
|---|---|---|---|---|---|---|---|---|
| 8th | 10th | 12th | 8th–10th | 10th–12th | ||||
| (1) | (2) | (3) | (4) | (5) | (6) | (7) | (8) | |
| Math | ||||||||
| Homework | 3.017** | −8.958* | 2.857** | −1.889 | 3.521** | −3.069 | −0.160 | −0.379 |
| Homework2 | −0.162 | 1.313 | −0.324** | 0.031 | −0.380** | 0.997 | −0.227** | 0.217** |
| Homework3 | −0.014 | −0.046 | 0.008* | 0.011 | 0.009** | −0.047 | 0.012+ | 0.003 |
| Income | 3.319** | 2.363** | 4.005** | 3.668** | 2.905** | 3.086** | – | – |
| Homework × income | – | 1.168** | – | 0.455 | – | 0.624* | 0.036 | 0.066 |
| Homework2 × income | – | −0.147 | – | −0.033 | – | −0.130+ | 0.023** | −0.021** |
| Homework3 × income | – | 0.003 | – | 0.000 | – | 0.005 | −0.001* | 0.000 |
| Intercept | 0.230 | 10.041** | 1.648 | 5.130+ | 18.017** | 16.163** | 7.287** | 4.766** |
| R2 | 0.209 | 0.212 | 0.200 | 0.202 | 0.197 | 0.201 | 0.004 | 0.007 |
| Science | ||||||||
| Homework | 0.776** | −0.834 | 0.822** | −4.095** | 1.608** | 0.377 | −0.652 | 0.785+ |
| Homework2 | −0.112+ | −0.175 | −0.075** | 0.831* | −0.205** | −0.059 | −0.099 | 0.131** |
| Homework3 | 0.002 | 0.029 | 0.001 | −0.036* | 0.006** | 0.005 | 0.008 | −0.007+ |
| Income | 1.143** | 1.040** | 1.499** | 1.286** | 0.978** | 1.055** | – | – |
| Homework × income | – | 0.156 | – | 0.475** | – | 0.115 | 0.079* | −0.066+ |
| Homework2 × income | – | 0.006 | – | −0.087** | – | −0.013 | 0.011 | −0.012** |
| Homework3 × income | – | −0.003 | – | 0.004* | – | 0.000 | −0.001 | 0.001 |
| Intercept | 7.591** | 8.663** | 7.069** | 9.258** | 14.112** | 13.321** | 2.684** | 1.846** |
| R2 | 0.151 | 0.152 | 0.192 | 0.194 | 0.182 | 0.185 | 0.006 | 0.005 |
Note: All regressions include controls for race and gender. The sample size for all models is 15,825.
p < 0.10.
p < 0.05.
p < 0.01.
Table 5.
History and Reading Regressions by Grade.
| Cross-sectional | First difference | |||||||
|---|---|---|---|---|---|---|---|---|
| 8th | 10th | 12th | 8th–10th | 10th–12th | ||||
| (1) | (2) | (3) | (4) | (5) | (6) | (7) | (8) | |
| History | ||||||||
| Homework | 0.498** | 1.456 | 0.417** | − 1.140 | 0.771** | − 0.831 | − 0.205 | 0.349 |
| Homework2 | 0.002 | − 0.546 | − 0.027 | 0.022 | − 0.102** | 0.099 | − 0.030 | 0.028 |
| Homework3 | − 0.006 | 0.043 | − 0.001 | 0.004 | 0.003* | − 0.001 | 0.004 | − 0.001 |
| Income | 1.215** | 1.254** | 1.363** | 1.279** | 1.145** | 1.194** | – | – |
| Homework × income | – | − 0.094 | – | 0.151 | – | 0.153 | 0.030 | − 0.024 |
| Homework2 × income | – | 0.053 | – | − 0.005 | – | − 0.019 | 0.003 | − 0.003 |
| Homework3 × income | – | − 0.005 | – | 0.000 | – | 0.000 | − 0.001 | 0.000 |
| Intercept | 17.423** | 17.033** | 18.069** | 18.935** | 23.408** | 22.905** | 1.855** | 3.261** |
| R2 | 0.145 | 0.145 | 0.142 | 0.143 | 0.140 | 0.145 | 0.003 | 0.003 |
| Reading | ||||||||
| Homework | 1.442** | − 4.402 | 1.483** | − 1.201 | 1.459** | 1.352 | −0.461 | 0.728 |
| Homework2 | −0.152 | 1.264 | −0.165** | −0.192 | −0.138** | −0.141 | −0.202** | 0.194** |
| Homework3 | −0.001 | −0.075 | 0.004 | 0.02 | 0.002 | 0.006 | 0.016* | −0.013+ |
| Income | 2.295** | 2.039** | 2.561** | 2.290** | 1.692** | 1.881** | – | – |
| Homework × income | – | 0.565 | – | 0.260 | – | 0.006 | 0.058 | −0.080 |
| Homework2 × income | – | −0.136 | – | 0.003 | – | 0.001 | 0.020** | −0.019** |
| Homework3 × income | – | 0.007 | – | −0.002 | – | 0.000 | −0.002* | 0.001* |
| Intercept | 2.394* | 5.040+ | 3.060+ | 5.843** | 14.119** | 12.205** | 3.437** | 2.650** |
| R2 | 0.151 | 0.152 | 0.150 | 0.151 | 0.111 | 0.112 | 0.003 | 0.004 |
Note: All regressions include controls for race and gender. The sample size for all models is 15,825.
p < 0.10.
p < 0.05.
p < 0.01.
Models (2), (4), and (6) report the results of the same models, with interactions estimated between all time on homework terms and logged parental income in 8th grade. The results of this analysis are less consistent. There is a statistically significant interactive effect of time spent on homework and parental income for math in 8th and 12th grades, but not 10th grade. For science, the interactive effect is observed in the 10th grade only. In contrast, no evidence is found for an interactive effect of time spent on homework and standardized test performance in history and reading in any grade.
The functional form of these relationships is best depicted visually. The leftmost panels of Figs. 2–4 depict the results of this analysis in CRC form, separately by parental income percentile. For all subjects, grades, and parental income levels, evidence is seen in these results for a strong, curvilinear, concave down relationship between time spent on homework and academic achievement on a standardized test in the same subject. For all grades and subjects, this relationship peaks at around five hours spent studying, although depending on the grade, subject, and parental income group, the peak varies at between three and nine hours spent on homework per week.
These CRC plots also show that, at low to moderate homework totals, those with higher parental incomes benefit the most from time spent studying. In 8th grade, this generalization holds for math and science at nearly all homework tallies and through four hours spent studying per week for reading. (However, the reading interaction was not statistically significant.) In 10th grade, this pattern holds for all subjects, although the pattern is reversed above eight hours of homework per week for science. However, the degree to which income determines CRC values by income is generally smaller in 12th grade, and those patterns that are observed are sometimes not consistent with the hypothesis that parental income is positively associated with homework efficacy. Little substantively important difference in study efficacy is observed for science, history, and reading in 12th grade, and none of these differences are statistically significant. For math, there is a statistically significant interaction between time spent on homework and parental income, but the result is very little difference in homework efficacy through about four hours of studying per week, and higher levels of homework efficacy above that level.
Those grade and subject combinations which do show statistically significant interactions of time spent on homework and parental income suggest that higher homework loads will be associated with higher degrees of academic achievement inequality by income in these settings. There is a statistically significant interaction between time spent on homework and parental income for math in 8th and 12th grades. In 8th grade, this pattern results in a curvilinear relationship between time spent on studying and the predicted change in the achievement gap compared to 90th percentile parental earners, as seen in Fig. 2. No matter the homework level employed above 0, it is predicted that the size of the achievement gap will increase. A similar pattern is observed in 12th grade up through six hours spent on math homework per week, as shown in Fig. 4. Above this amount of time spent on homework, however, the pattern is reversed, and a decrease in the achievement gap is predicted.
The only other statistically significant interaction between time spent on homework and academic achievement is for science in the 10th grade. As seen in Fig. 3, those with the highest parental incomes have the highest homework efficacy up through approximately six hours of time spent on homework per week. Above that level, this pattern is reversed, as those with the lowest parental incomes are predicted to have the highest homework efficacies. As a result, this model predicts increases in the 10th grade science achievement gap up through eight hours of homework time per week, followed by a reduction therein at higher levels of time spent on homework. Although other income interactions with time spent on homework are not statistically significant, these results invariably predict increases in the achievement gap by parental income at low to moderate levels of homework.
Fig. 3.
10th grade learning and achievement gap eliminated, by income percentile, study hours, and subject. Note: CRC values are model-predicted change in learning associated with increase in study time compared to no change in study time, separately by subject. MDR values are the percent change in achievement gaps predicted by interactive first differences model if all students increase their study time uniformly. Students with parental incomes in the 90th percentile are the reference group.
Finally, the cross-sectional models achieve a reasonable degree of fit with the data, as measured by the model R2 values. Math models for all grades explain about 20% of the variance, depending on the exact specification. The fit for other subjects is somewhat lower but still reasonable, as science models explain between 15 and 19% of the variance in test scores across models, history about 14%, and reading 11–15%.
4.5. Robustness check – first differences models
As discussed above, however, the results of this model do not adequately address concerns that the results are biased due to unobserved heterogeneity in time-invariant factors such as individual ability and school characteristics. As such, the results discussed so far are supplemented with interactive first differences models in which the changes in test scores are predicted as a function of changes in time spent on homework, interactively with parental income. The results of this analysis are presented in the right hand sides of Tables 4 and 5. In both of these tables, models (7) and (8) present the results of a specification analogous to models (2), (4), and (6) – but without controls for race, gender, or the main effect of parental income. These variables are omitted from the specification because they are time-invariant. The purpose of these analyses is to confirm that the findings of the cross-sectional analyses are robust to adjustment for the effects of time-invariant sources of unobserved heterogeneity.
The results for both the 8th–10th and 10th–12th grade windows confirm that homework and parental income statistically significantly interact in predicting gains in academic achievement for all subjects except history. As with the cross-sectional analysis, the CRC plots (not shown) for the first difference models predict that, in 8th–10th grade, those with higher parental incomes will enjoy higher homework efficacy. CRC scores are uniformly positive for math and history; predicted change scores are slightly negative for the lowest income students at very high increases in studying for science and reading. Concomitantly, the MDR plots for the same time window (not shown) predict strong, roughly linear increases in the achievement gap compared to students with 90th percentile parental income for all subjects except history, for which the predicted change in the achievement gap is slightly positive and concave down with respect to increases in homework levels. In sum, with the exception of history, in the 8th–10th grade window the results of the first differences regression analysis support the conclusions of the cross-sectional analysis that students with higher parental income enjoy higher homework efficacy.
However, this pattern is contradicted by the results of the first differences models for the 10th–12th grade window, which finds that lower income students have higher homework efficacy, and that increases in homework loads will reduce, not increase, the socioeconomic achievement gap for all subjects. The MDR plots for the first difference models in the 10th–12th grade (not shown) show that the inequality-negating effect of these model results is roughly equal in magnitude to the positive MDR coefficients for the 8th–10th grade window. These effects are approximately negatively linear (except for math, where the effect is somewhat concave down) and strong (except for history). In short, although the results of the 10th–12th grade first differences models confirm the interactive importance of homework and parental income, the direction of this interaction contradicts the findings of the cross-sectional analysis.
However, although statistically significant interactive effects of time spent on homework and parental income are documented in these models, it should be noted that the fit of these models to the data is extremely poor, with no first differences regression model explaining even 1% of the variance in change in test scores. Thus, although the predicted CRC scores for the first differences models are typically larger in magnitude than for the cross-sectional model, the fit to the data is substantially poorer. Overall, the first differences models confirm the findings of the 8th–10th grade cross-sectional analysis that students with higher parental incomes have higher average homework efficacy, but cast doubt on the same finding for the 10th–12th grade window.
5. Discussion
Policymakers and educational researchers frequently recommend heavy homework loads as a mechanism of improved educational achievement in America (e.g., National Commission on Excellence in Education, 1983). However, the causal effect of study time on learning is a matter of debate. The consensus to date was that time spent on homework has a moderate, positive, causal effect on learning, a conclusion frequently stated in tandem with the caveat that “homework is a complicated thing” (Corno, 1996). Although this phrase is frequently quoted, rarely mentioned is Corno’s (1996) admonishment that “Students respond differently to the same assignments, depending on their interests, their home environments, and their study habits” (28). In other words, students vary in the amount they learn from their out-of-school studies – i.e., they have variable homework efficacy. Using NELS:88 data to model the effect of time spent on homework in secondary school, this analysis shows that homework efficacy varies substantially by parental income and grade and subject in school, and suggests that increased homework loads will, all else equal, increase educational inequality between these groups due to these homework efficacy differentials. These findings are robust over the 10th–12th grade time period; however, the conclusion for the 10th–12th grade window is uncertain and merits further study.
These findings demonstrate that self-reported time spent on homework has a curvilinear relationship with standardized test performance for all types of students in all grades and subjects. This is, to my knowledge, a novel finding, and presents an interpretive puzzle. On the one hand, it may be that, beyond a certain level of studying, spending additional time on homework is counterproductive to learning. Such an interpretation could be supported by research investigating the role of student stress (e.g., Daly, Chamberlain, & Spalding, 2011) and sleep deprivation (e.g., Taras & Potts-Datema, 2005) on test performance. From another perspective, though, it may be that students who study the most do so because they need to – i.e., because they are performing poorly in that subject in school. Comparing the first differences and cross-sectional analysis results suggest that the latter may be the stronger interpretation. If one assumes that large increases in study time are at least as stressful and contributory to sleep deprivation as a steadily high level of study activity, one would expect to find the same, strong curvilinear relationship between study time and test performance in the first differences results as in the cross-sectional results. This is not the case. Instead, the curvilinear, concave-down relationship between change in study time and change in test scores is either greatly ameliorated or not present at all in the first difference CRC plots compared to the cross-sectional plots. This result suggests that much of the curvilinear relationship is explained by the negative correlation between school performance and study time. However, the persistence of a weak concave down relationship between homework and CRC scores suggests that stress and sleep deprivation, or related processes, may yet play a role as well.
The interactive analysis results partially support the hypothesis that parental income is positively associated with homework efficacy. These differences are large in the 10th grade, and somewhat lessened in the 8th and 12th grades with the exception of math. Furthermore, these results are confirmed in the 8th–10th grade first differences models, which control for time-invariant sources of unobserved heterogeneity. However, the results of the 10th–12th grade first differences models are not consistent with this conclusion. Although the reason for this finding cannot be known with certainty, it is likely that selection into continuing to take courses plays something of a role. Many students complete their required course taking in core subjects by their senior year in high school. If patterns of course taking are differentially related to academic abilities by income such that the relationship is stronger among higher SES students, this could account for the divergent finding in the 10th–12th grade window. Future research should investigate this possibility.
On the whole, these results are consistent with the implications of the literature on learning, which identified a number of factors (such as motivation, homework efficacy, and locus of control) which are positively related to parental SES and which promote faster rates of learning. Unfortunately, the present analysis is incapable of determining which candidate mechanisms are the source of socioeconomic differences in homework efficacy. The patterns of association between homework time and test performance, however, are suggestive. Specifically, there is no interactive association between income and time spent on homework for the history test, and the interaction is generally strongest for math, with middle magnitude interactions observed for science and reading. Students with parents in the top NELS:88 income category are more likely to have paid or peer tutor help with their homework, while lower income students are more likely to rely on siblings (not shown), which suggests that access to formal tutelage may be a key mechanism of socioeconomic inequality.
Correspondingly, it may be that socioeconomic differences in parental and/or sibling knowledge play a role. Proportionally, socioeconomic inequalities in history knowledge are smaller for history than for the other subjects, and inequalities in math homework are the largest. If patterns of knowledge in focal students are reproduced in their family members, it could be that familial knowledge plays a key mechanism in socioeconomic inequalities in homework efficacy. Furthermore, noncognitive traits such as study skills, metacognitive traits, etc. have been found to play a large role in the intergenerational transmission of status (e.g., Bowles & Gintis, 1976).
Unfortunately, the present data are unable to ascertain which likely mechanisms ultimately account for these differences. In light of prominent theories of learning (Trautwein and Köller, 2003), group differences in home and family environments, availability of family or hired tutors, time constraints, academic aptitude, ability to follow instructions, teacher quality, cognitive skills, metacognitive skills, and motivational characteristics are likely candidates. Future research should collect detailed measures of these candidate mechanisms to identify which of these are responsible for this interactive effect.
The larger goal of this research is to advance the literature on the effects of noncognitive traits in the sociology of education. Frequently this literature functions by identifying noncognitive traits which predict academic achievement net of cognitive skills and exploring how social differences in these traits create academic achievement inequality. This research suggests that family background may modify the effects of noncognitive behaviors as well as influence their prevalence in different segments of the population. In other words, students may vary in both their behaviors and the effects thereof on academic achievement outcomes. Future research should investigate the degree to which this is true for other noncognitive traits identified in the sociology of education literature.
This study is subject to a number of potential limitations. As Trautwein (2007) observes, time spent on homework, the amount of homework assigned, and the effort the student puts into the homework are analytically separable constructs which are conflated in the measure used here. As more suitable nationally representative datasets become available which are capable of distinguishing between these characteristics, the robustness of these findings should be assessed in light of these differences. Additionally, the response categories of study time per week are relatively coarse, lumping together students whose homework time may be up to two hours different. Furthermore, because the response categories are measured on different scales in the 8th grade than in the other waves, some apparent movement in study time scores may in fact reflect no change, which can bias the results of the analysis in unpredictable ways. Moreover, it may be that for many purposes it is not socioeconomic inequality in academic achievement which is the important question, but the overall degree of inequality in academic achievement. Future research should investigate how increases in homework loads are likely to increase this important dependent variable. Finally, and most importantly, the lack of a full set of measures of theoretically important mediators of the parental income–homework efficacy relationship means the degree to which these play a role in this process cannot be directly tested in this dataset. Future research should seek to rectify this limitation of the present analysis.
6. Conclusion
Academic achievement gaps can arise both as a result of group differences in predictors of achievement as well as differential effects. This paper assesses group differences in the homework–achievement relationship, called homework efficacy. The results indicate that there is a positive, moderate, and curvilinear average homework–achievement relationship for all subjects except reading in all grades, and that the effects of study time are larger for math than science and reading, which are larger than those for history. Results further demonstrate that average homework efficacy is higher for high SES students than for lower SES students, with a sharp cleavage in effect observed between students in the 90th percentile of the income distribution compared to all others. The finding of higher homework efficacy for high SES students is confirmed with more stringent first differences models in the 8th–10th grade, but not 10th–12th grade, window.
These results suggest that educational policies encouraging increases in homework assignments in secondary school may have the effect of raising socioeconomic inequality in academic achievement as well as on individual predicted achievement. Unless group differences in homework efficacy are eliminated or are counteracting influences present, such policies will tend to result in increasing advantages for higher income individuals in secondary school. Policymakers and educators should remain mindful of this possibility, lest ongoing achievement gaps persist or increase. Policies which promote greater time spent on homework may be best paired with policies which teach all students study skills and promote other predictors of homework efficacy.
Acknowledgements
This research was supported by grants T32 HD007168, R01 HD061622, R24 HD066613, and T32 HD007289. The author wishes to thank Ted Mouw, Guang Guo, Ken Bollen, and Ashton Verdery for comments on previous versions of this manuscript. Any errors are the author’s alone.
Footnotes
At first it may appear to run against the spirit of the first differences model to include a non-differenced measure of parental income in the regression equation. However, because this term is only interacted with the change in homework time variables – it has no main effects terms – this term does not reintroduce unobserved heterogeneity against which the first differences model was intended to guard (Allison, 2005), and permits examination of another dimension of homework efficacy. In effect, the average regression parameters estimated for these interactive terms show how the marginal value of an additional hour of study time changes depending on one’s parental income.
This is a less satisfactory measure of the relevant homework time than for the other subjects because, although one likely learns relatively little math when completing homework assignments for other subjects, one is likely to learn something about reading comprehension when one is doing homework for nearly any subject. Unfortunately, no satisfactory alternative to this measure exists in the dataset, so the reading results must be examined with this caveat in mind.
To make figures comparable between the 8th and 10th grade periods of observation, for the purpose of this calculation only time spent on homework was recoded so that the top value for 10th and 12th grades for all subjects was 10 or more hours a week, as it was coded in the original survey in 8th grade.
This pattern may be partially skewed by a tendency among the lowest income respondents to report the maximum amount of study time at rates higher than any other group. It is unclear whether this is the result of a differential tendency toward measurement error or a real spike in studying patterns among those at the lowest parental incomes.
These figures are unweighted to reflect the characteristics of the sample rather than the target population. All other analyses are weighted.
References
- Aksoy T, Link CR. A panel analysis of student mathematics achievement in the US in the 1990s: Does increasing the amount of time in learning activities affect math achievement? Economics of Education Review. 2000;19:261–277. [Google Scholar]
- Alexander KL, Entwisle DR, Dauber SL. Firstgrade behavior: Its short- and long-term consequences for school performance. Child Development. 1993;64:801–814. [PubMed] [Google Scholar]
- Allison PD. Missing data. Thousand Oaks: Sage Publications; 2002. [Google Scholar]
- Allison PD. Fixed effects regression methods for longitudinal data using SAS. Cary, NC: SAS Institute; 2005. [Google Scholar]
- Battle ES, Rotter JB. Children’s feelings of personal control as related to social class and ethnic group. Journal of Personality. 1963;31(4):482–490. doi: 10.1111/j.1467-6494.1963.tb01314.x. [DOI] [PubMed] [Google Scholar]
- Beishuizen JJ, Stoutjesdijk ET. Study strategies in a computer assisted study environment. Learning and Instruction. 1999;9(3):281–301. [Google Scholar]
- Bialer I. Conceptualization of success and failure in mentally retarded and normal children. Journal of Personality. 1961;29:303–320. [Google Scholar]
- Biggs J. Student approaches to learning and studying. Hawthorn, Vic.: Australian Council for Educational Research; 1987. [Google Scholar]
- Birch SH, Ladd GW. The teacher–child relationship and children’s early school adjustment. Journal of School Psychology. 1997;34:934–946. doi: 10.1037//0012-1649.34.5.934. [DOI] [PubMed] [Google Scholar]
- Bloom BS. Stability and change in human characteristics. New York: Wiley; 1964. [Google Scholar]
- Boekaerts M. Self-regulated learning: Where we are today. International Journal of Educational Research. 1999;31(6):445–457. [Google Scholar]
- Bowles S, Gintis H. Schooling in capitalist America: Educational reform and the contradictions of economic life. New York: Basic Books; 1976. [Google Scholar]
- Brody GH, Stoneman Z, Flor D. Parental religiosity, family processes, and youth competence in rural, two-parent African American families. Developmental Psychology. 1996;32:696–706. [Google Scholar]
- Brody GH, Flor DL. Maternal psychological functioning, family processes, and child adjustment in rural, single-parent, African American Families. Developmental Psychology. 1997;33:1000–1011. doi: 10.1037//0012-1649.33.6.1000. [DOI] [PubMed] [Google Scholar]
- Carroll J. A model of school learning. Teachers College Record. 1963;64:723–733. [Google Scholar]
- Carroll J. The model of school learning: Progress of an idea. In: Anderson L, editor. Time and School Learning. London: Croom Helm; 1984. pp. 15–45. [Google Scholar]
- Cooper H. Homework. White Plains, NY: Longman; 1989. [Google Scholar]
- Cooper H, Robinson JCR, Patall EA. Does homework improve academic achievement? A synthesis of research, 1987–2003. Review of Educational Research. 2006;76(1):1–62. [Google Scholar]
- Corno L. Homework is a complicated thing. Educational Researcher. 1996;25(8):27–30. [Google Scholar]
- Credé M, Kuncel NR. Study habits, skills, and attitudes: The third pillar supporting collegiate academic performance. Perspectives on Psychological Science. 2008;3:425–453. doi: 10.1111/j.1745-6924.2008.00089.x. [DOI] [PubMed] [Google Scholar]
- Culler RE, Holahan CJ. Test anxiety and academic performance: The effects of study-related behaviors. Journal of Educational Psychology. 1980;72(1):16–20. [PubMed] [Google Scholar]
- Daly AL, Chamberlain S, Spalding V. Test Anxiety, heart rate, and performance in a-level French speaking mock exams: An exploratory study. Educational Research. 2011;53(3):321–330. [Google Scholar]
- Day CA, Burns BM. Characterizing the achievement motivation orientation of children from low- and middle-income families. Early Education and Development. 2011;22(1):105–127. [Google Scholar]
- DeLuca S, Rosenbaum JE. Individual agency and the life course: Do low-SES students get less long-term payoff for their school efforts? Sociological Focus. 2001;34(4):357–376. [Google Scholar]
- Dettmers W, Trautwein U, Luedtke O. The relationship between homework time and achievement is not universal: Evidence from multilevel analysis in 40 countries. School Effectiveness and School Improvement. 2009;20(4):375–405. [Google Scholar]
- Di Napoli PJ. Homework in the New York City elementary schools. New York: Bureau of Publications, Columbia University; 1937. [Google Scholar]
- Dickinson DJ, O’Connell DQ. Effect of quality and quantity of study on student grades. Journal of Educational Research. 1990;83(4):227–231. [Google Scholar]
- Ducette J, Wolk S. Locus of control and extreme behavior. Journal of Consulting and Clinical Psychology. 1972;39:253–258. doi: 10.1037/h0033386. [DOI] [PubMed] [Google Scholar]
- Duncan GJ, Brooks-Gunn J, Klebanov PK. Economic deprivation and early childhood development. Child Development. 1994;65(2):296–318. [PubMed] [Google Scholar]
- Eccles J, Adler T, Meece JL. Sex differences in achievement: A test of alternate theories. Journal of Perspectives on Social Psychology. 1984;46:26–43. [Google Scholar]
- Entwisle N. Approaches to learning and forms of understanding. In: Dart B, Boulton-Lewis G, editors. Teaching and learning in higher education. Melbourne: Australian Council for Educational Research; 1998. pp. 72–101. [Google Scholar]
- Eren O, Henderson DJ. The impact of homework on student achievement. Econometrics Journal. 2008;11:326–348. [Google Scholar]
- Escalona SK. Babies at double hazard: Early development of infants at biologic and social risk. Pediatrics. 1982;70:670–675. [PubMed] [Google Scholar]
- Evans GW, English K. The environment of poverty: Multiple stressor exposure, psychophysiological stress, and socioemotional adjustment. Child Development. 2002;73:1238–1248. doi: 10.1111/1467-8624.00469. [DOI] [PubMed] [Google Scholar]
- Evans GW, Gonella C, Marcynyszyn LA, Gentile L, Salpekar N. The role of chaos in poverty and children’s socioemotional adjustment. Psychological Science. 2005;16(7):560–565. doi: 10.1111/j.0956-7976.2005.01575.x. [DOI] [PubMed] [Google Scholar]
- Evans GW, Rosenbaum J. Self-regulation and the income–achievement gap. Early Childhood Research Quarterly. 2008;23:504–514. [Google Scholar]
- Farkas G, Grobe RP, Shehan D, Shuan Y. Cultural resources and school success: Gender, ethnicity, and poverty groups within an urban school district. American Sociological Review. 1990;5:127–142. [Google Scholar]
- Farkas G, England P, Vicknair K, Kilbourne BS. Cognitive skill, skill demands of jobs, and earnings among young European American, African American, and Mexican American workers. Social Forces. 1997;75(3):913–938. [Google Scholar]
- Farkas G. Human capital or cultural capital? New York: Aldine de Gruyter; 1996. [Google Scholar]
- Farkas G. Cognitive skills and noncognitive traits and behaviors in stratification processes. Annual Review of Sociology. 2003;29:541–562. [Google Scholar]
- Findley MJ, Cooper HM. Locus of control and academic achievement: A literature review. Journal of Personality and Social Psychology. 1983;44(2):419–427. [Google Scholar]
- Foyle H. The effects of preparation and practice homework on student achievement in tenth-grade American history. Dissertation at Kansas State University; 1984. [Google Scholar]
- Foyle H, Lyman L, Tompkins L, Perne S, Foyle D. Homework and cooperative learning: A classroom field experiment. ERIC ED350285. 1990. [Google Scholar]
- Fryer RG, Jr, Levitt SD. The black–white test score gap through third grade. NBER Working Paper 11049, National Bureau of Economic Research; 2005. [Google Scholar]
- Gore PM, Rotter JB. A personality correlate of social action. Journal of Personality. 1963;31:58–64. doi: 10.1111/j.1467-6494.1963.tb01840.x. [DOI] [PubMed] [Google Scholar]
- Gray RF, Allison DE. An experimental study of the relationship of homework to pupil success in computation with fractions. School Science and Mathematics. 1971;71:339–346. [Google Scholar]
- Grodsky E, Warren JR, Felts E. Testing and social stratification in American education. Annual Review of Sociology. 2008;34:385–404. [Google Scholar]
- Halaby CN. Panel models in sociological research: Theory into practice. Annual Review of Sociology. 2004;30:507–544. [Google Scholar]
- Hamre BK, Pianta RC. Early teacher–child relationships and the trajectory of children’s school outcomes through eighth grade. Child Development. 2001;65:253–263. doi: 10.1111/1467-8624.00301. [DOI] [PubMed] [Google Scholar]
- Hess RD, Holloway S, Price G, Dickson WP. Family environments and the acquisition of reading skills. In: Laosa LM, Sigel IE, editors. Families as learning environments of children. New York: Plenum; 1982. pp. 87–113. [Google Scholar]
- Hill L., Jr . Effort and reward in college: A replication of some puzzling findings. In: Neuliep, editor. Replication research in the social sciences. Newbury Park, CA: Sage; 1991. pp. 139–156. [Google Scholar]
- Hoover-Dempsey KV, Battiato AC, Walker JMT, Reed RP, DeJong JM, Jones KP. Parental involvement in homework. Educational Psychologist. 2001;36(3):195–209. [Google Scholar]
- Jackson M. Personality traits and occupational attainment. European Sociological Review. 2006;22(2):187–199. [Google Scholar]
- Jordan NC, Huttenlocher J, Levine SC. Differential calculation abilities in young children from middle- and low-income families. Developmental Psychology. 1992;28(4):644–653. [Google Scholar]
- Kao G, Tienda M. Educational aspirations of minority youth. American Journal of Education. 1998;106(3):349–384. [Google Scholar]
- Kerckhoff A, Raudenbush S, Glennie E. Education, cognitive skill, and labor force outcomes. Sociology of Education. 2001;74:1–24. [Google Scholar]
- Koch EA. Homework in arithmetic. Arithmetic Teacher. 1965;12:9–13. [Google Scholar]
- Ladd GW, Birch SH, Buhs ES. Children’s social and scholastic lives in kindergarten: Related spheres of influence? Child Development. 1999;70:1373–1400. doi: 10.1111/1467-8624.00101. [DOI] [PubMed] [Google Scholar]
- Lareau A. Home advantage: Social class and parental intervention in elementary education. 2nd ed. London: Routledge; 2000. [Google Scholar]
- Lareau A. Linking Bourdieu’s concept of capital to the broader field. In: Biddle BJ, editor. Social class, poverty, and education. New York: Routledge Falmer; 2001. pp. 77–100. [Google Scholar]
- Lareau A. Invisible inequality: Social class and childrearing in black families and white families. American Sociological Review. 2002;67:747–776. [Google Scholar]
- Lareau A. Unequal childhoods: Class, race, and family life. Ewing: University of California Press; 2003. [Google Scholar]
- Lareau A, Horvat EMcN. Moments of social inclusion and exclusion: Race, class, and cultural capital in family–school relationships. Sociology of Education. 1999;72(1):37–53. [Google Scholar]
- Liew J, Chen Q, Hughes JN. Child effortful control, teacher–student relationships, and achievement in academically atrisk children: Additive and interactive effects. Early Childhood Research Quarterly. 2010;25:51–64. doi: 10.1016/j.ecresq.2009.07.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lindblom-Ylänne S, Lonka K. Individual ways of interacting with the learning environment – Are they related to study success? Learning and Instruction. 1999;9:1–18. [Google Scholar]
- Lleras C. Do skills and behaviors in high school matter? The contribution of noncognitive factors in explaining differences in educational attainment and earnings. Social Science Research. 2008;37:888–902. [Google Scholar]
- Maertons N, Johnson J. Effects of arithmetic homework upon the attitude and achievement of fifth and sixth grade pupils. School Science and Mathematics. 1972;72:117–126. [Google Scholar]
- Marton F, Säljö R. Approaches to learning. In: Marton F, Hounsell D, Entwisle N, editors. The experience of learning. Edinburgh: Scottish Academic Press; 1984. pp. 36–55. [Google Scholar]
- Marton F, Dall’Alba G, Beaty E. Conceptions of learning. International Journal of Educational Research. 1993;19(3):277–300. [Google Scholar]
- Mau W-C, Lynn R. Gender differences in homework and test scores in mathematics, reading, and science at tenth and twelfth grade. Psychology, Evolution, and Gender. 2000;2:119–125. [Google Scholar]
- McGrath JB. Student and parental homework practices and the effect of English homework on student test scores. Dissertation at United States International University; 1992. [Google Scholar]
- Meloy LL. Effects of homework on language arts achievement in third and fourth-grades. Dissertation at The University of Iowa; 1987. [Google Scholar]
- Morgan SL, Sorensen AB. Parental networks, social closure, and mathematics learning: A test of Coleman’s social capital explanation of school effects. American Sociological Review. 1999;64(5):661–681. [Google Scholar]
- National Commission on Excellence in Education. A nation at risk: The imperative for educational reform. Washington, DC: U.S. Government Printing Office; 1983. [Google Scholar]
- Nelson ES, Mathia KE. The relationships among college students locus of control, learning styles, and self-prediction of grades. Education Research and Perspectives. 1995;22(2):110–117. [Google Scholar]
- Nowicki S, Strickland BR. A locus of control scale for children. Journal of Consulting and Clinical Psychology. 1973;40(1):148–154. doi: 10.1037/h0034499. [DOI] [PubMed] [Google Scholar]
- Padawer EA, Jacobs-Lawson JM, Hershey DA, Thomas DG. Demographic indicators as predictors of future time perspective. Current Psychology. 2007;26:102–108. [Google Scholar]
- Pappas S, Ginsburg HP, Jiang M. SES differences in young children’s metacognition in the context of mathematical problem solving. Cognitive Development. 2003;18:431–450. [Google Scholar]
- Paschal RA, Weinstein T, Walberg HJ. The effects of homework on learning: A quantitative synthesis. Journal of Educational Research. 1984;78:97–104. [Google Scholar]
- Pianta RC, Egeland B, Sroufe LA. Maternal stress and children’s development: Prediction of school outcomes and identification of protective factors. In: Rolf J, Masten AS, Cicchetti D, Nuechterlein KH, Weintraub S, editors. Risk and protective factors in the development of psychopathology. New York: Cambridge University Press; 1990. pp. 215–235. [Google Scholar]
- Pianta RC, Stuhlman MW. Teacher-Child Relationships and Children’s Success in the First Years of School. School Psychology Review. 2004a;33(3):444–458. [Google Scholar]
- Pianta RC, Stuhlman MW. Conceptualizing risk in relational terms: Associations among the quality of child–adult relationships prior to school entry and children’s developmental outcomes in first grade. Educational and School Psychology. 2004b;21:32–45. [Google Scholar]
- Rau W, Durand A. The academic ethic and college grades: Does hard work help students to ‘make the grade’? Sociology of Education. 2000;73(1):19–38. [Google Scholar]
- Raudenbush S, Kasim R. Cognitive skill and economic inequality: Findings from the national adult literacy survey. Harvard Educational Review. 1998;68:33–79. [Google Scholar]
- Rock DA, Pollock JM. Psychometric Report for NELS:88 Base Year Test Battery. Washington, D.C.: National Center for Education Statistics, U.S. Department of Education; 1991. [Google Scholar]
- Roscigno VJ, Ainsworth-Darnell JW. Race, cultural capital, and educational resources: Persistent inequalities and achievement returns. Sociology of Education. 1999;72:158–178. [Google Scholar]
- Rosenbaum JE. Rose monograph series. New York: Russell Sage Foundation Press; 2001. Beyond college-for-all: Career paths for the forgotten half. In. [Google Scholar]
- Royston Patrick. Multiple imputation of missing values. Stata Journal. 2004;4(3):227–241. [Google Scholar]
- Rubin Donald B. Multiple imputation for nonresponse in surveys. New York: Wiley; 1987. [Google Scholar]
- Schmitz B, Skinner E. Perceived control, effort, and academic performance: Interindividual, intraindividual, and multivariate time-series analyses. Journal of Personality and Social Psychology. 1993;64(6):1010–1028. [Google Scholar]
- Schuman H, Walsh E, Olson C, Etheridge B. Effort and reward: The assumption that college grades are affected by quantity of study. Social Forces. 1985;63(4):945–966. [Google Scholar]
- Schunk DH. Goal setting and self-efficacy during selfregulated learning. Educational Psychologist. 1990;25:71–86. [Google Scholar]
- Sorensen AB, Hallinan MT. A reconceptualization of school effects. Sociology of Education. 1977;50(4):273–289. [Google Scholar]
- Stinebrickner R, Stinebrickner TR. The causal effect of studying on academic performance. The B.E. Journal of Economic Analysis and Policy. 2008;8(1):1–53. [Google Scholar]
- Taras H, Potts-Datema W. Sleep and student performance at school. Journal of School Health. 2005;75(7):248–254. doi: 10.1111/j.1746-1561.2005.00033.x. [DOI] [PubMed] [Google Scholar]
- Teahan GE. Required home study is unwise. American School Board Journal. 1935;91:41. [Google Scholar]
- Trautwein U. The homework–achievement relation reconsidered: Differentiating homework time, homework frequency, and homework effort. Learning and Instruction. 2007;17:372–388. [Google Scholar]
- Trautwein U, Köller O. The relationship between homework and achievement – Still much of a mystery. Educational Psychology Review. 2003;15(2):115–145. [Google Scholar]
- Trautwein U, Schnyder I, Niggli A, Neumann M, Ludtke O. Chameleon effects in homework research: The homework–achievement association depends on the measures used and the level of analysis chosen. Contemporary Educational Psychology. 2009;34:77–88. [Google Scholar]
- U.S. Department of Education, National Center for Education Statistics. The condition of education 2007. Washington, DC: U.S. Government Printing Office; 2007. [Google Scholar]
- Usher EL, Pajares F. Sources of academic and selfregulatory efficacy beliefs of entering middle school students. Contemporary Educational Psychology. 2006;31:125–141. [Google Scholar]
- Vekiri I. Socioeconomic differences in elementary students’ ICT beliefs and out-of-school experiences. Computers & Education. 2010:941–950. [Google Scholar]
- Vermunt JD. Learning styles and regulation of learning in higher education – Toward process-oriented instruction in autonomous thinking. Amsterdam/Lisse: Swets & Zeitlinger; 1992. [Google Scholar]
- Vermunt JD. The regulation of constructive learning processes. British Journal of Educational Psychology. 1998;68:149–171. [Google Scholar]
- Vermunt JD, Vermetten YJ. Patterns in student learning: Relationships between learning strategies, conceptions of learning, and learning orientations. Educational Psychology Review. 2004;16(4):359–384. [Google Scholar]
- Walberg HJ, Paschal RA. Homework. In: Anderson L, editor. International Encyclopedia of Teaching and Teacher Education. Pergamon Press; 1995. pp. 268–282. [Google Scholar]
- Zimmerman BJ. Academic studying and the development of personal skill: A self-regulatory perspective. Educational Psychologist. 1998;33(2/3):73–86. [Google Scholar]




