Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2011 May 1.
Published in final edited form as: J Econom. 2010 May 1;156(1):27–37. doi: 10.1016/j.jeconom.2009.09.006

Comparing IV With Structural Models: What Simple IV Can and Cannot Identify

James J Heckman 1,*, Sergio Urzúa 2,
PMCID: PMC2861784  NIHMSID: NIHMS147336  PMID: 20440375

Abstract

This paper compares the economic questions addressed by instrumental variables estimators with those addressed by structural approaches. We discuss Marschak’s Maxim: estimators should be selected on the basis of their ability to answer well-posed economic problems with minimal assumptions. A key identifying assumption that allows structural methods to be more informative than IV can be tested with data and does not have to be imposed.

Keywords: Instrumental Variables, Structural Approaches, Marschak’s Maxim

1 Introduction

The primary question regarding the choice of an empirical approach to analyzing economic data should be What economic question does the analyst seek to answer? Explicit economic models make it easier to formulate and answer economic questions. Advocates of atheoretical approaches to analyzing economic data appeal to randomization as an ideal and invoke IV (or matching or regression discontinuity designs) as a surrogate for randomization. However, even perfectly executed randomizations do not answer all questions of economic interest. There are important examples where structural models produce more information about preferences than experiments.1

A valid instrument is not guaranteed to identify parameters of economic interest when responses to choices vary among individuals, and these variations influence choices taken.2 Different valid instruments answer different questions.3 The sign of the IV estimator can be different from that of the true causal effect.4

No one trained in economics can doubt the value of credible explicit economic models in interpreting economic data. They are designed to answer a variety of well-posed economic questions and to be invariant to classes of policy interventions.5 The problem with this approach is that after 60 years of experience with fitting structural models on a variety of data sources, empirical economists have come to appreciate the practical difficulty in identifying, and precisely estimating, the full array of structural parameters that answer the large variety of policy questions contemplated by the Cowles Commission economists — the fathers of structural estimation.6

Proponents of IV are less ambitious in the range of questions they seek to answer. The method often gains precision by asking narrower questions. The problem that plagues the IV approach is that the questions it answers are usually defined as probability limits of estimators and not by well-formulated economic problems. Unspecified “effects” replace clearly defined economic parameters as the objects of empirical interest.

As noted by Marschak (1953), there is a middle ground. Marschak’s Maxim emphasizes that one should solve well-posed economic problems with minimal assumptions. Marschak noted that for many problems of policy analysis, it is not necessary to identify fully specified structural models with parameters that are invariant to classes of policy modifications — the goal of structural analysis as conceived by the Cowles pioneers and successor generations of structural economists.7 All that is required to conduct many policy analyses or to answer many well-posed economic questions are combinations of the structural parameters that are often much easier to identify than the individual parameters themselves.8

Heckman and Vytlacil (1999, 2005) bridge the structural and IV literatures. They develop an economically interpretable parameter — the marginal treatment effect (MTE) — which is a marginal willingness to pay for the benefit of treatment for persons at well-defined margins of choice. It is invariant to a class of policy modifications. The MTE can be identified by local variation in instruments. They show how different instrumental variables weight the MTE differently. These weights need not be positive for all values of the argument of the MTE.9 For classes of well-posed economic questions, it is possible, under the conditions given in Heckman and Vytlacil (2005), to fashion functions of instruments that answer well-posed economic questions. Alternatively, it is possible to use an estimated MTE and construct weights to estimate economically interpretable parameters. This approach is unusual in the standard IV literature, which traditionally defines the parameter of interest to be an “effect” identified by an instrument.

Many economists follow Imbens and Angrist (1994) and interpret IV as identifying a weighted average of the gains to persons induced to change their choice (or state) by a change in the instrument. Imbens and Angrist work with a two choice model. Heckman, Urzua, and Vytlacil (2006, 2008) and Heckman and Vytlacil (2007b) extend this analysis to an ordered choice model and to general unordered choice models.10 This paper develops the unordered case further and gives a precise characterization of the generalization of the MTE that is appropriate for this case.

The original Imbens-Angrist intuition applies, but in general unordered choice models, agents attracted into a state by a change in an instrument come from many origin states, so there are many margins of choice. Structural models can identify the gains arising from these separate margins. This is a difficult task for IV without invoking structural assumptions. Structural models can also identify the fraction of persons induced into a state coming from each origin state. IV alone cannot.

For some economic questions, these are unimportant distinctions. For others, they are crucial. For specificity, consider an analysis of the GED program. The GED is a test by which high school dropouts can exam certify to be the equivalents of ordinary high school graduates. Heckman, LaFontaine, and Rodríguez (2008) show that the presence of a GED program induces some persons to drop out of high school. It also induces some persons who would remain dropouts to exam certify. Within this context we ask: What are the wage benefits for those induced to take the GED from the dropout state? For those induced to drop out of high school? What proportion of persons induced to take a GED come from each of the other states?

IV cannot answer these questions except under structural assumptions. It can identify the mean gross gain to the GED for those induced to take it, compared to the next best alternative. This is a weighted average of the effects from each possible origin state that the structural approach can separately identify. In the IV approach, when there are multiple origin states, the weights on the individual effects cannot be estimated without using structural methods. As shown in Heckman and Vytlacil (2007b), IV needs to be supplemented with explicit choice theory to answer many interesting questions, including questions of economic welfare regarding introduction of policies as well as distributional questions such as the percentage of persons harmed by a policy.

This paper demonstrates these points. We first establish a precise framework for discussing IV, and relate it to economic models.

2 The Choice Model and Assumptions

Following Heckman, Urzua, and Vytlacil (2006, 2008) and Heckman and Vytlacil (2007b), consider the following model with multiple choices and associated multiple outcome states. Let 𝒥 denote the agent’s choice set, where 𝒥 contains a finite number of elements. For example, 𝒥 enumerates possible schooling states (e.g., GED, high school dropout, high school graduate). The value to the agent of choosing j ∈ 𝒥 is

Rj(Zj)=ϑj(Zj)Vj, (1)

where Zj are the agent’s observed characteristics that affect the utility from choosing j, and Vj is the unobserved shock to the agent’s utility from choice j. We sometimes write Rj for Rj(Zj) to simplify notation. Let Z denote the random vector containing all unique elements of {Zj}j∈𝒥. We write Rj(Z) for Rj(Zj), leaving implicit the condition that Rj(·) only depends on the elements of Z that are contained in Zj. Let Dj be a variable indicating whether the agent would choose j if confronted with choice set 𝒥:11

Dj={1ifRjRkk𝒥0otherwise.

Array the Dj into a vector D. Let Y be the outcome that would be observed if the agent faced choice set 𝒥, defined as

Y=j𝒥DjYj,

where Yj is a potential outcome observed only if option j is chosen. Yj is determined by

Yj=μj(Xj,Uj),

where Xj is a vector of the agent’s observed characteristics and Uj is an unobserved random vector. Let X denote the random vector containing all unique elements of {Xj}j∈𝒥. (Z, X, D, Y) is assumed to be observed by the analyst.12

Define R𝒥 as the maximum obtainable value given choice set 𝒥:

R𝒥=maxj𝒥{Rj}=j𝒥DjRj. (2)

This is the traditional representation of the decision process that if choice j is optimal, choice j is better than the “next best” option:

Dj=1RjR𝒥\j.

Heckman, Urzua, and Vytlacil (2006, 2008) and Heckman and Vytlacil (2007b) show that this simple, well-known, representation is the key intuition for understanding how instrumental variables estimate the effect of a given choice versus the “next best” alternative. IV is a weighted average of the effects for people induced into a choice from different margins. Analogous to the definition of R𝒥, we define R𝒥(z) to be the maximum obtainable value given choice set 𝒥 when instruments are fixed at Z = z,

R𝒥(z)=maxj𝒥{Rj(z)}.

Following the analysis in Heckman, Urzua, and Vytlacil (2006, 2008) and Heckman and Vytlacil (2007b), we assume:

  • (A-1)

    The distribution of ({Vj}j∈𝒥) is continuous.13

  • (A-2)

    {(Vj, Uj)}j∈𝒥 is independent of Z conditional on X.

  • (A-3)

    E | Yj| < ∞ for all j ∈ 𝒥.

  • (A-4)

    Pr(Dj = 1 | X) > 0 for all j ∈ 𝒥.

In addition, we assume an exclusion restriction that requires some additional notation.14 Let Z[−l] denote all elements of Z except for the lth component. We assume (A-5) For each j ∈ 𝒥, their exists at least one element of Z, say Z[l], such that the distribution of ϑj(Zj) conditional on (X, Z[−l]) is continuous.

With these assumptions, one can generalize the analysis of Heckman and Vytlacil (1999, 2001, 2005) to the unordered case. Assumptions (A-1) and (A-2) imply that RjRk (with probability 1) for jk, so that argmaxj∈𝒥{Rj} is unique (with probability 1). Assumption (A-2) assures the existence of an instrument. Assumption (A-3) is required for mean treatment parameters to be well defined. It also allows one to integrate to the limit and to produce well-defined means. Assumption (A-4) requires that at least some individuals participate in each choice for all X. Assumption (A-5) imposes the requirement that one be able to independently vary the index for the given value function. It imposes a type of exclusion restriction, that for any j ∈ 𝒥, Z contains an element such that (i) it is contained in Zj; (ii) it is not contained in any Zk for kj, and (iii) ϑj(·) is a nontrivial function of that element conditional on all other regressors.15

In a series of papers, Heckman and Vytlacil (1999, 2001, 2005, 2007b), develop the method of local instrumental variables (LIV) to estimate the marginal treatment effect (MTE) for the case of binary choices. We now define and interpret the MTE and LIV in the case of general unordered choices.

3 Interpreting Local Instrumental Variables in the Unordered Case

We define local instrumental variables (LIV) using a variable that shifts people toward (or against) choice j by operating only on Rj(Zj). LIV identifies an average marginal return to j vs. the next best alternative across persons.16 However, without further assumptions, LIV will not decompose the average marginal return into its component parts corresponding to the effects for persons induced into j from each of the possible origin states.

To see this, consider a three outcome case, 𝒥 = {1, 2, 3}. For concreteness, we pursue the education example previously stated and let 1 be GED, 2 be high school dropout, and 3 be high school graduate. Our results are more general but the three outcome case is easy to exposit.

In this section, we assume that Z1, Z2, Z3 are disjoint sets of regressors so Z = (Z1, Z2, Z3) but they are not necessarily statistically independent. We can easily relax this assumption but making it simplifies the notation. We condition on X and keep it implicit throughout the analysis of this paper.17 In this notation,

E(Y|Z)=E  [j=13YjDj|Z]=E(Y1D1|Z)+E(Y2D2|Z)+E(Y3D3|Z). (3)

E(Y|Z) and its components can be estimated from data on (Y, Z). IV is based on (3). From (2), choices are generated by the following inequalities:

D1=1(R1R2,R1R3)D2=1(R2R1,R2R3)D3=1(R3R1,R3R2).

We define the marginal change in Y with respect to Z1. IV methods are based on such types of variation. The local instrumental variable estimator using Z1 as an instrument is the sample analogue of

E(Y|Z)Z1Pr(D1=1|Z)Z1|Z=z=LIV(z),

where LIV is a function of z. In the case of three choices, there are two margins from which persons can be attracted into or out of choice 1 by Z1.18

From local variations in Z1, one can recover the following combinations of parameters from the data on Y1D1:

E(Y1D1|Z=z)Z1=Z1ϑ1(Z1)ϑ2(Z2)ϑ1(Z1)ϑ3(Z3)y1fY1,V1V2,V1V3(y1,v1v2,v1v3)d(v1v3)d(v1v2)dy1|Z=z=ϑ1(Z1)Z1|Z1=z1[y1ϑ1(z1)ϑ3(z3)fY1,V1V2,V1V3(y1,ϑ1(z1)ϑ2(z2),v1v3)d(v1v3)dy1+y1ϑ1(z1)ϑ2(z2)fY1,V1V2,V1V3(y1,v1v2,ϑ1(z1)ϑ3(z3))d(v1v2)dy1]. (4)

By similar reasoning, we can recover the following combination of parameters from the data on Y2D2:

E(Y2D2|Z=z)Z1=Z1y2ϑ2(Z2)ϑ1(Z1)ϑ2(Z2)ϑ3(Z3)fY2,V2V1,V2V3(y2,v2v1,v2v3)d(v2v3)d(v2v1)dy2|Z=z=ϑ1(Z1)Z1|Z1=z1[y2ϑ2(z2)ϑ3(z3)fY2,V2V1,V2V3(y2,ϑ2(z2)ϑ3(z1),v2v3)d(v2v3)dy2]. (5)

From data on Y3D3, we obtain the following combination of parameters:

E(Y3D3|Z1=z)Z1=ϑ1(Z1)Z1|Z1=z1y3ϑ3(z3)ϑ2(z2)fY3,V3V1,V3V2(y3,ϑ3(z3)ϑ1(z1),v3v2)d(v3v2)dy3. (6)

Agents induced into 1 come from 2 and 3. There are two margins:

(R1=R2)  and  (R1R3)(marginofindifferencebetween1and2),

and

(R1=R3)  and  (R1R2)(marginofindifferencebetween1and3).

Unaided, IV does not enable analysts to identify the returns at each of the different margins. Instead, it identifies a weighted average of returns. It does not identify the density of persons at the various margins, i.e., the proportion of people induced into (or out of) 1 from each possible alternative state by a change in the instrument.

Collecting terms and rewriting in more easily interpretable components, which generalize the MTE developed for a two choice model to a multiple choice unordered model:19

(E(Y|Z)Z1)(ϑ1Z1)|Z=z=[[E(Y1Y2|R1(z1)=R2(z2),R1(z1)R3(z3))]GeneralizationofMTEforpersonsindifferentbetween1and2,wherechoice3isdominatedPr(R1(z1)=R2(z2),R1(z1)R3(z3))+[E(Y1Y3|R1(z1)=R3(z3),R1(z1)R2(z2))]GeneralizationofMTEforpersonsindifferentbetween1and3,wherechoice2isdominatedPr(R1(z1)=R3(z3),R1(z1)R2(z2))  ]  .

This is a weighted return to alternative 1 for persons coming from two separate margins: alternative 1 versus alternative 2, and alternative 1 versus alternative 3, i.e., the return to people induced into 1 from their next best choice. The weights are the proportion of people induced into 1 from each margin. This combination of parameters can be identified from IV. The components of the sum cannot be identified by IV without further assumptions. Note that it is possible that a group at one margin gains while a group at another margin loses. IV only estimates a net effect, which might be zero.

Notice that from representation (2.1) and the assumption that the Zj (j∈𝒥) are distinct, pairwise monotonicity, an extension of the monotonicity assumption invoked by Imbens and Angrist (1994) for the binary choice case, is satisfied.20 In the context of a model with multiple choices, pairwise monotonicity means the same pattern of flow between any two states is experienced by everyone. Thus, as Zj increases, there is a flow from i to j but not from j to i (or vice versa). From (1), changing Z1 induces all persons to move in the same direction (i.e. from 1 to 2 or 2 to 1 but not both, and from 1 to 3 or 3 to 1 but not both). Pairwise monotonicity does not rule out the possibility that a change in an instrument causes people to move in the direction from j to i but to move away from the direction from k to i for jk, and j, ki.

By the chain rule, the derivative of Pr (D1 = 1 | Z) is:

Pr(D1=1|Z=z)Z1=ϑ1Z1|Z1=z1[Pr(R1(z1)=R2(z2),R1(z1)R3(z3))+Pr(R1(z1)=R3(z3),R1(z1)R2(z2))  ].

We can define LIV in terms of the preceding ingredients as

LIV(z)=(E(Y|Z)Z1)(Pr(D1=1|Z)Z1)|Z=z=[E(Y1Y2|R1(z1)=R2(z2),R1(z1)R3(z3))ω12+E(Y1Y3|R1(z1)=R3(z3),R1(z1)R2(z2))ω13]. (7)

The combination of terms can be identified by LIV from the data on (Y, D, Z).

The IV weights are:

ω12=Pr(R1(z1)=R2(z2),R1(z1)R3(z3))[Pr(R1(z1)=R2(z2),R1(z1)R3(z3))+Pr(R1(z1)=R3(z3),R1(z1)R2(z2))] (8) (9)

and

ω13=Pr(R1(z1)=R3(z3),R1(z1)R2(z2))[Pr(R1(z1)=R2(z2),R1(z1)R3(z3))+Pr(R1(z1)=R3(z3),R1(z1)R2(z2))]. (10)

The weights can be identified from a structural discrete choice analysis.21 They cannot be identified by an unaided instrumental variable analysis. Thus it is not possible to identify the component parts of (5) by LIV alone, i.e., one cannot separately identify the generalized MTEs:

E(Y1Y2|R1(z1)=R2(z2),R1(z1)R3(z3))

and

E(Y1Y3|R1(z1)=R3(z3),R1(z1)R2(z2)),

unless one invokes “identification at infinity” arguments or alternative arguments using local variation in regressors developed by Fox and Gandhi (2008).22 Carneiro, Heckman, and Vytlacil (2009) and Heckman and Vytlacil (2007b) develop classes of economically interpretable parameters that do not require “identification at infinity” and that can be identified using estimated marginal treatment effects.

Using a structural model, one can estimate the components of (7) and determine the flow into (or out of) state 1 from all sources. We illustrate this point in Section 5. First we consider what standard IV estimates.

4 What does standard IV estimate?

To see what standard IV estimates, consider the following linear-in-schooling model of earnings that receives much attention in the literature in labor economics.23 Let Y denote log earnings and write S as years of schooling. The model writes

Y=α+βS+U (11)

where

S=j=13jDj, (12)

and Y is defined as in Section 2. It is interpreted in this section as an approximation to the general model presented in Section 2. S is assumed to be correlated with U, and β is a random variable that may be statistically dependent on S. The model of Section 2 does not, in general, imply (11). Indeed, there is much empirical evidence against model (11).24 An analysis of what IV estimates when linearity in S is imposed as an approximation, even though it may be inappropriate, is an interesting exercise because linearity is so often invoked.

Suppose Z1 is a valid instrument. We now interpret what

ΔZ1IV=Cov(Z1,Y)Cov(Z1,S) (13)

estimates. We do this by decomposing ΔZ1IV into components analogous to the decomposition produced by Heckman, Urzua, and Vytlacil (2006, 2008) and Heckman and Vytlacil (2007b). The Appendix presents the derivation of the following decomposition of IV into our pairwise generalization of MTE for the unordered case:

ΔZ1IV=Cov(Z1,Y)Cov(Z1,S)=  (E(Y1Y2|V2V1=v2v1,ϑ2(z2)ϑ3(z3)V2V3)GeneralizedMTE(21)notidentifiedfromLIV  ×ηϑ2(Z2)ϑ3(Z3),V2V1(ϑ2(z2)ϑ3(z3),v2v1)weightidentifiedfromdiscretechoiceanalysisd(v2v1)d(ϑ2(z2)ϑ3(z3)))+(E(Y1Y3|V3V1=v3v1,ϑ3(z3)ϑ2(z2)V3V2)GeneralizedMTE(31)notidentifiedfromLIV  ×ηϑ3(Z3)ϑ2(Z2),V3V1(ϑ3(z3)ϑ2(z2),v3v1)weightidentifiedfromdiscretechoiceanalysisd(v3v1)d(ϑ3(z3)ϑ2(z2)))[ηϑ2(Z2)ϑ3(Z3),V2V1(ϑ2(z2)ϑ3(z3),v2v1)]weightidentifiedfromdiscretechoiceanalysisd(ϑ2(z2)ϑ3(z3))d(v2v1)+2[ηϑ3(Z3)ϑ2(Z2),V3V1(ϑ3(z3)ϑ2(z2),v3v1)]weightidentifiedfromdiscretechoiceanalysisd(v3v1)d(ϑ3(z3)ϑ2(z2)). (14)

IV identifies a weighted average of gains to state 1 compared to the next best alternative which may be 2 or 3. The two terms of the decomposition are defined as generalized MTEs and are weighted averages of the gain of moving from state 2 to state 1 for persons on the margin of indifference between 1 and 2 and for whom 2 is a better choice than 3 (the first term) and the gain of moving from 3 to 1 for persons on the margin of indifference between 1 and 3 and for whom 3 is a better choice than 2 (the second term).25

In the Appendix, we derive the weights on the generalized MTEs and show that they do not sum to 1 even when normalized by the denominator. The mathematical reason for this result is simple. The weights in the numerator do not sum to the weights in the denominator. The second term in the denominator receives twice as much weight as the corresponding term in the numerator. This is a consequence of the definition of S (12), which plays no role in the numerator term. Thus, IV applied to the general model produces an arbitrarily weighted sum of generalized MTEs with weights that do not sum to 1, and which, in general, places more weight on the first generalized MTE term than on the second term, compared to the weights placed on the corresponding terms in the denominator.26 Using IV alone, we cannot decompose (14) into its component parts, even though the weights can be identified from discrete choice analysis.27,28

4.1 The Mincer Model

The Mincer (1974) model is a specialization of the general model discussed in Section 2 of this paper that justifies the precise functional form of equation (11).29 For this case, the weights in (14) in the numerator and denominator are the same. The Mincer model is formulated in terms of log earnings for Y1, Y2, and Y3:

Y2=ln(1+g)+Y1,Y3=ln(1+g)+Y2=2ln(1+g)+Y1,

where g is a growth factor for income that varies in the population. Earnings at each schooling level depend on two parameters: (g, Y1). In this case, letting α = ln(1 + g),

ΔZ1IV=Cov(Z1,Y)Cov(Z1,S)=[(E(α|V2V1=v2v1,ϑ2(z2)ϑ3(z3)V2V3)    ×ηϑ2(Z2)ϑ3(Z3),V2V1(ϑ2(z2)ϑ3(z3),v2v1)d(v2v1)d(ϑ2(z2)ϑ3(z3)))   +(E(α|V3V1=v3v1,ϑ3(z3)ϑ2(z2)V3V2)  ×2ηϑ3(Z3)ϑ2(Z2),V3V1(ϑ3(z3)ϑ2(z2),v3v1)d(v3v1)d(ϑ3(z3)ϑ2(z2)))]×[ηϑ2(Z2)ϑ3(z3),V2V1(ϑ2(z2)ϑ3(z3),v2v1)d(v2v1)d(ϑ2(z2)ϑ3(z3))   +2ηϑ3(Z3)ϑ2(Z2),V3V1(ϑ3(z3)ϑ2(z2),v3v1)d(v3v1)d(ϑ3(z3)ϑ2(z2))]1. (16)

In this case, the weights now sum to 1. The weights for the numerator term now are the same as the weights for the denominator term. But again, unaided IV does not identify the component parts of the term bundled in IV — the mean gains at each margin.30,31

5 An Example

It is instructive to summarize our analysis with an example. Consider a 3 choice model with associated outcomes. This corresponds to the GED, high school dropout and high school graduate example that we have used throughout the paper. Under conditions presented in Heckman and Vytlacil (2007a, Appendix B), the structural model is nonparametrically identified. A key assumption in their proof is the “identification at infinity” assumption previously discussed.32 This assumes the ability to vary (Z1, Z2, Z3) freely and the existence of limit sets such that fixing any two of (Z1, Z2, Z3), one makes the Rj associated with Zj arbitrarily small.33

Heckman and Vytlacil (2007b) show that if one augments the IV assumptions with the same identification at infinity assumptions used in structural models, one can use IV in the limit to identify the components of (3.5). In the limit sets, one can identify

E(Y1Y2|R1(z1)=R2(z2)) (17)

and

E(Y1Y3|R1(z1)=R3(z3)) (18)

by setting Z3 and Z2 respectively to limit set values. Essentially one can use the limit sets to make a three choice model into a two choice model, and the standard results for the two choice model apply.34 Under these assumptions, and additional mild regularity assumptions, using structural methods, one can identify the distributions of (Y1, Y2) and (Y1, Y3) so that one can identify distributions of treatment effects, Y2Y1 and Y3Y1, in addition to the mean parameters identified by IV.35 One can also identify the proportion of people induced into 1 from each alternative state using variation in the instrument.

Consider the model with the parameters presented in Table 1. This is a discrete choice model with associated outcome variables. The Zj, j = 1, …, 3, are assumed to be scalar and mutually independent. They are normally distributed so they satisfy large support (“identification at infinity”) conditions. Table 2 shows how a change in Z1, which increases it by .75 standard deviations, shifts people across categories. This corresponds to making GED attainment easier.36 The estimates reported in Table 2 can be obtained from a structural discrete choice model. The percentage initially in 1 (GED) increases from 33.17% to 38.8%. The percentage in 2 (dropout) decreases from 29.11% to 25.91%. The percentage in 3 (graduating high school) declines from 37.72% to 35.29%.

Table 1.

Potential Outcomes, Choice Model and Parameterizations

OutcomesChoice ModelYj=αj+Uj  with  j𝒥={1,2,3}Dj={1ifRjRkj𝒥0otherwiseY=j𝒥YjDjRj=γjZjVj  with  j𝒥Parameterization(U1,U2,U3,V1,V2,V3)N(0,ΣUV),(Z1,Z2,Z3)N(μZ,ΣZ)ΣUV=[0.640.160.160.0240.320.0160.1610.200.0200.300.0100.160.2010.0200.400.0400.0240.0200.02010.601000.320.300.400.610.20.0160.010.04001000.21],μZ=(1.0,0.5,1.5)andΣZ=[100010001]    [α1α2α3]=[0.30.10.7],[γ1γ2γ3]=[0.20.30.1]

Table 2.

Transition Matrix Obtained from the Change in the Instrument Z1

The Instrument Increases by 0.75 Standard Deviation

New Value of Instrument
( = Z1 + 0.75)
D1 = 1 D2 = 1 D3 = 1 Total
Original Value
of Instrument
(Z1)
D1 = 1 33.17% 0% 0% 33.17%
D2 = 1 3.20% 25.91% 0% 29.11%
D3 = 1 2.43% 0% 35.29% 37.72%
Total 38.80% 25.91% 35.29% 100%

The IV estimate is −.032. (See the base of Table 3) This is the only number produced by an IV analysis using Z1 as an instrument that changes within the specified range. The structural analysis in Table 3 shows that the net effect produced by the change in Z1 is composed of 2 terms. It arises from a gain of .199 for the switchers 2 → 1 (dropout to GED) and a loss of .336 (3 → 1) (graduate to GED).

Table 3.

Marginal Gains Identified from the Change in the Instrument Z1

The Instrument Increases by 0.75 Standard Deviation

Gains to Switchers Fraction of Population Switching
From 2 to 1 0.199 3.20%
From 3 to 1 −0.336 2.43%

Overall (IV estimate) −0.032 5.63%
IV Estimate:
E[Y|Z˜1]E[Y|Z1]=3.203.20+2.43×0.1992.433.20+2.43×0.336=0.032

Figure 1 shows what can be identified from the structural model. It plots the distributions of gains for persons going from 2 to 1 and from 3 to 1 as well as the overall distribution of gains to the switchers. Persons switching from 3 to 1 are harmed in gross terms by the policy that changes Z1, while those who switch from 2 to 1 gain in gross terms. In utility terms, (Rj), people are better off.37 In terms of gross gains, about 56.8% of the people who switch from 2 to 1 are better off while 39.3% of the people who switch from 3 to 1 are better off. Overall, 49.2% are better off in gross terms even though the IV estimate is slightly negative. If one seeks to understand the distributional effects of the policy associated with a change Z1, the structural analysis is clearly much more revealing. The IV estimate, which is a mean gross gain aggregating over origin states, does not capture the rich information about choices afforded by a structural analysis. However, it does identify the average gain to the program compared to the next-best alternatives. If that is the object of interest, linear IV is the right tool to use.

Figure 1.

Figure 1

Distribution of Gains in Outcomes Induced by the Change in the Instrument Z1

6 Summary and Discussion

The choice between using IV or a more structural approach for a particular problem should be made on the basis of Marschak’s Maxim: use minimal assumptions to answer well-posed economic questions. Most IV studies do not clearly formulate the economic question being answered by the IV analysis. The probability limit of the IV estimator is defined to be the object of interest. In the binary outcome case, even if Z is a valid instrument, if Z is a vector, and analysts use only one component of the vector as an instrument, and do not condition on the other components of Z, the weights on the MTE can be negative over certain ranges. The practice of not conditioning on the other instruments is common in the literature.38 In this case, IV can estimate the wrong sign for the true causal effect.39 Recent analyses show how to improve on this practice and to design functions of standard instrumental variables that answer classes of well-posed economic questions.40

We have discussed a model with three or more choices where there is no particular order among the choices. Such examples arise routinely in applied economics. In this case, under conditions specified in this paper, IV estimates a weighted average of the mean gross gain to persons induced into a choice state by a change in the instrument (policy) compared to their next best alternative.41 It averages the returns to a destination state over all origin states. It does not produce the distribution of gains overall or by each origin state. Again, as in the binary choice case, for vector Z, using one component of Z as an instrument, and not conditioning on the other components can produce negative weights so that the sign of an IV can be opposite to that of the true causal effect which can be identified by a structural analysis.

Structural methods provide a more complete description of the effect of the instrument or the policy associated with the instrument. They identify mean returns as well as distributions of returns for agents coming to a destination state from each margin. They also identify the proportion of people induced into a state from each origin state.

Structural methods come at a cost. Unless distributional assumptions for unobservables are invoked, structural methods often require some form of an “identification at infinity” assumption.42 However, in the general case in which responses to treatment are heterogeneous, IV requires the same assumption if one seeks to identify average treatment effects.43 An identification at infinity assumption can be checked in any sample so it does not require imposing a priori beliefs onto the data. Heckman, Stixrud, and Urzua (2006) present an example of how to test an identification at infinity assumption. See also the discussion in Abbring and Heckman (2007).44 Recent advances by Fox and Gandhi (2008) show that in structural models generated by finite mixtures, identification at infinity is not required to establish model identification, although continuity properties on functions and some of the regressors that constitute their arguments are required.45 Carneiro, Heckman, and Vytlacil (2009) develop a rich class of economically interesting parameters that do not require identification at infinity and can be identified from local variation in instruments. An “identification at infinity” assumption is not intrinsic to the structural approach.

Many proponents of IV point to the strong distributional and functional form assumptions required to implement structural methods. They ignore recent progress in econometrics that identifies and empirically implements robust semiparametric and nonparametric approaches to structural analysis.46 Recent developments respond to arguments against the use of explicit econometric models made by a generation of applied economists that emerged in the 1980s. Those arguments are more properly directed against 1980s versions of structural models that were based on linearity and normality. Structural econometricians in the 21st century have listened to the critics and have perfected their tools to response to the criticism.

The appeal to standard IV as a preferred estimator is sometimes made on the basis of “simplicity and robustness”. Standard IV is certainly simple to compute although problems with weak instruments can make it empirically unstable.47 Since, in the general case, different instruments identify different parameters, IV is not robust to the choice of instrument.48 Since the sign of an IV can be different from the true causal effect, IV may even produce a misleading guide to policy or inference, so it is not robust.

The meaning of “simplicity” is highly subjective. How simple is the economic interpretation of IV? Certainly decomposition (14) is not simple. The fact that simple IV can estimate wrong signs for true causal effects should give pause to those who claim that it is “robust”. The weak instrument literature cautions us against uncritical claims about the sturdiness of IV estimators.

The ability of different statistical estimators to answer questions of economic interest, or to show why they cannot be answered, should drive the choice of empirical techniques for analyzing data. Consider a worst case for structural estimation. Suppose that application of recently developed procedures for testing for structural identification reveal that a structural model is not identified or is only partially identified. Does this conclusion suggest that IV is a better choice for an estimator? That disguising identification problems by a statistical procedure is preferable to an honest discussion of the limits of the data? For underidentified structural models, it is possible to conduct sensitivity analyses guided by economic theory to explore the consequences of ignorance about features of the model. With IV, unaided by structural analysis, this type of exercise is not possible. Problems of identification and interpretation are swept under the rug and replaced by “an effect” identified by IV that is often very difficult to interpret as an answer to an interesting economic question.

Acknowledgements

We thank Donna Gilleskie, Daniel Schmierer, Greg Veramendi and an anonymous referee for helpful comments. This project was supported by NSF grant SES-0241858, NIH grant R01-HD043411, a grant from the Geary Institute, University College Dublin, and a grant from the American Bar Foundation.

A Derivation of the Standard IV Estimator

We first study the numerator of ΔZ1IV in the text. Recall that we keep the conditioning on X implicit. Using 1 = Z11,

Cov(Y,Z1)=E(Z˜1(Y1D1+Y2D2+Y3D3)).

Using D1 = 1 − D2D3, we obtain

Cov(Y,Z1)=E(Z˜1(Y1+(Y2Y1)D2+(Y3Y1)D3))=E(Z˜1Y1)+E(Z˜1(Y2Y1)D2)+E(Z˜1(Y3Y1)D3),

where E (1Y1) = 0. It is natural to decompose this expression using choice “1” as the base, because Z1 only shifts R1(Z1). The final two terms can be written as

Cov(Y,Z1)=E(Z˜1(Y2Y1)1(R2(Z2)R1(Z1),R2(Z2)R3(Z3)))+E(Z˜1(Y3Y1)1(R3(Z3)R1(Z1),R3(Z3)R2(Z2)))=E[Z˜1(Y2Y1)1((ϑ2(Z2)ϑ1(Z1)V2V1),(ϑ2(Z2)ϑ3(Z3)V2V3))]   +E[Z˜1(Y3Y1)1((ϑ3(Z3)ϑ1(Z1)V3V1),(ϑ3(Z3)ϑ2(Z2)V3V2))]=z˜1(y2y1)   ×(ϑ2(z2)ϑ1(z1)ϑ2(z2)ϑ3(z3)fY2Y1,V2V1,V2V3(y2y1,v2v1,v2v3)d(v2v3)d(v2v1)d(y2v1))   ×fZ˜1,ϑ2(Z2)ϑ1(Z1),ϑ2(Z2)ϑ3(Z3)(z˜1,ϑ2(z2)ϑ1(z1),ϑ2(z2)ϑ3(z3))d(ϑ2(z2)ϑ3(z3))d(ϑ2(z2)ϑ1(z1))dz˜1+z˜1(y3y1)   ×(ϑ3(z3)ϑ1(z1)ϑ3(z3)ϑ2(z2)fY3Y1,V3V1,V3V2(y3y1,v3v1,v3v2)d(v3v2)d(v3v1)d(y3y1))×fZ˜1,ϑ3(Z3)ϑ1(Z1),ϑ3(Z3)ϑ2(Z2)(z˜1,ϑ3(z3)ϑ1(z1),ϑ3(z3)ϑ2(z2))d(ϑ3(z3)ϑ2(z2))d(ϑ3,(z3)ϑ1(z1))dz˜1.

By Fubini’s Theorem, we can simplify the expressions and obtain for the first term:

E(Y2Y1|V2V1=v2v1,ϑ2(z2)ϑ3(z3)V2V3)×{z˜1[(ϑ2(z2)ϑ3(z3)hV2V1,V2V3(v2v1,v2v3)d(v2v3))×(v2v1fZ˜1,ϑ2(Z2)ϑ1(Z1),ϑ2(Z2)ϑ3(Z3)(z˜1,ϑ2(z2)ϑ1(z1),ϑ2(z2)ϑ3(z3))d(ϑ2(z2)ϑ1(z1)))]dz˜1}                 ×d(ϑ2(z2)ϑ3(z3))d(v2v1). (19)

hV2V1,V2V3(·) is the joint density of V2V1, V2V3. Define the weighting term in braces in (19) as ηϑ2(Z2) − ϑ3(Z3),V2V12 (z2) − ϑ3 (z3), v2v1). It is necessary to fix both ϑ2 (z2) − ϑ3 (z3) and v2v1 in forming the weight. This weight can be estimated from a structural discrete choice analysis and the joint distribution of (Z, D1, D2, D3). The terms multiplying the weight are marginal treatment effects generalized to the unordered case. (A.1) cannot be decomposed using IV. An alternative representation of the term in braces, ηϑ2(Z2) − ϑ3(Z3),V2V12 (z2) − ϑ3 (z3), v2v1) is

ηϑ2(Z2)ϑ3(Z3),V2V1(ϑ2(z2)ϑ3(z3),v2v1)=     E(Z1E(Z1)|ϑ2(Z2)ϑ3(Z3)=ϑ2(z2)ϑ3(z3),ϑ2(Z2)ϑ1(Z1)v2v1)          ×Pr(ϑ2(Z2)ϑ3(Z3)=ϑ2(z2)ϑ3(z3),ϑ2(Z2)ϑ1(Z1)v2v1).

An analysis parallel to the preceding one shows that the second term can be written as

E(Y3Y1|V3V1=v3v1,ϑ3(z3)ϑ2(z2)V3V2)×{z˜1[(ϑ3(z3)ϑ2(z2)hV3V1,V3V2(v3v1,v3v2)d(v3v2))×(v3v1fZ˜1,ϑ3(Z3)ϑ1(Z1),ϑ3(Z3)ϑ2(Z2)(z˜1,ϑ3(z3)ϑ1(z1),ϑ3(z3)ϑ2(z2))d(ϑ3(z3)ϑ1(z1)))]dz˜1}   ×d(ϑ3(z3)ϑ2(z2))d(v3v1). (20)

Define the term in braces in (20) as the weight ηϑ3(Z3) − ϑ2(Z2),V3V13 (z3) − ϑ2 (z2), v3v1).

To obtain the denominator for the IV, recall that S=j=13jDj. Substitute D1 = 1 − D2D3,

j=13jDj=(1D2D3)+2D2+3D3=1+D2+2D3.

Then

Cov(S,Z˜1)=E(Z˜1D2)+2E(Z˜1D3)=E(Z˜1(1(R2R1,R2R3)))+2E(Z˜1(1(R3R1,R3R2))). (21)

Using reasoning similar to that invoked for the analysis of the numerator terms, we obtain expressions for the terms corresponding to the two terms of (19) and (20). We obtain for the first term of (21)

z˜1[ϑ2(z2)ϑ1(z1)fZ˜1,ϑ2(Z2)ϑ1(Z1),ϑ2(Z2)ϑ3(Z3)(z˜1,ϑ2(z2)ϑ1(z1),ϑ2(z2)ϑ3(z3))     ×(ϑ2(z2)ϑ3(z3)hV2V1,V2V3(v2v1,v2v3)d(v2v3))d(v2v1)   ×d(ϑ2(z2)ϑ3(z3))d(ϑ2(z2)ϑ1(z1))]dz˜1. (22)

By Fubini’s Theorem, we obtain:

z˜1[(ϑ2(z2)ϑ3(z3)hV2V1,V2V3(v2v1,v2v3)d(v2v3))      ×(v2v1fZ˜1,ϑ2(Z2)ϑ1(Z1),ϑ2(Z2)ϑ3(Z3)(z˜1,ϑ2(z2)ϑ1(z1),ϑ2(z2)ϑ3(z3))×d(ϑ2(z2)ϑ1(z1)))d(ϑ2(z2)ϑ3(z3))]d(v2v1)dz˜1=ηϑ2(Z2)ϑ3(Z3),V2V1(ϑ2(z2)ϑ3(z3),v2v1)d(v2v1)d(ϑ2(z2)ϑ3(z3)). (23)

By parallel logic, we obtain for the second term in 21:

2z˜1[(ϑ3(z3)ϑ2(z2)hV3V1,V3V2(v3v1,v3v2)d(v3v2))     ×(v3v1fZ˜1,ϑ3(Z3)ϑ1(Z1),ϑ3(Z3)ϑ2(Z2)(z˜1,ϑ3(z3)ϑ1(z1),ϑ3(z3)ϑ2(z2))d(ϑ3(z3)ϑ1(z1)))     ×d(ϑ3(z3)ϑ2(z2))]d(v3v1)dz˜1=2ηϑ3(Z3)ϑ2(Z2),V3V1(ϑ3(z3)ϑ2(z2),v3v1)d(v3v1)d(ϑ3(z3)ϑ2(z2)).

These terms can be identified from a structural analysis using the joint distribution of (Z, D1, D2, D3). Collecting results, we obtain decomposition (14) in the text if we multiply both the numerator and denominator by −1.

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

2

See Heckman and Vytlacil (2007b) for a comparison of what different approaches identify. Matching rules out selection on unobservables. Regression discontinuity estimators identify, at best, local effects.

3

Building on this point, Heckman, Schmierer, and Urzua (2008) develop and apply nonparametric tests for the presence of heterogenous responses to treatment on which agents make choices.

4

Heckman, Urzua, and Vytlacil (2008). This is true even under the “monotonicity” conditions of Imbens and Angrist (1994), as generalized to the vector case by Heckman and Vytlacil (2005) and Heckman, Urzua, and Vytlacil (2006) unless one conditions on instruments correctly.

5

See the essays in Koopmans (1950). See also Heckman and Vytlacil (2007a).

6

Pencavel (1986) summarizes structural estimates of taxes on labor supply and reports absurd estimates, including one due to Jerry Hausman, which implied a negative marginal propensity to consume goods out of income. These and other estimates, reported in the literature some 20 years ago, fueled the flight of many empirical economists from structural models.

7

Heckman and Vytlacil (2007a) define structural models precisely following the seminal definition of Hurwicz (1962). These discussions formalize ideas in Marschak (1953).

8

See the discussion in Heckman (2008) and Heckman and Vytlacil (2007b).

9

MTE was introduced into the literature in the context of a selection model by Björklund and Moffitt (1987). The Local Average Treatment Effect (LATE) (Imbens and Angrist, 1994) is a discretized version of the MTE. The weights for special cases were derived by Yitzhaki (1989) and applied by Imbens and Angrist (1994). Those weights are always non-negative. Heckman and Vytlacil (1999, 2005, 2007b) and Heckman, Urzua, and Vytlacil (2006) generalize the Imbens-Angrist-Yitzhaki analysis to the case of multiple instruments without restrictions and show how IV weights can be non-positive over certain intervals, but that they must integrate to one.

10

Angrist and Imbens (1995) propose an ordered choice version of their 1994 paper. As shown by Heckman, Urzua, and Vytlacil (2006), their proposed extension has unsatisfactory features which can be removed by a careful reformulation of the IV method applied to the ordered choice model. See also Heckman and Vytlacil (2007b).

11

Below, we invoke conditions so that ties, Rj = Rk for jk, occur with probability zero.

12

Depending on the choice model, Z may or may not include the X. For example, in a Roy model of schooling under perfect certainty (e.g. Willis and Rosen, 1979), X would be among the Z. In models of schooling under uncertainty (e.g. Cunha, Heckman, and Navarro, 2005, Cunha and Heckman, 2007 and Urzua, 2008) innovations in X unknown at the time schooling decisions are made would not be in Z. The key condition on Z is given in Assumption (A-2) below.

13

Absolutely continuous with respect to Lebesgue measure on ∏j∈𝒥ℛ.

14

We work here with exclusion restrictions in part for ease of exposition. By adapting the analysis of Cameron and Heckman (1998) and Heckman and Navarro (2007), one can modify our analysis for the case of no exclusion restrictions if Z contains a sufficient number of continuous variables and there is sufficient variation in the ϑk function across k.

15

See Heckman and Vytlacil (2007b) for additional discussion.

17

See Heckman and Vytlacil (2007b) for a more general analysis.

18

Recall that Z1 only affects the utility associated with choice 1.

19

Heckman, Urzua, and Vytlacil (2006) generalize the MTE to an ordered choice model. See also Heckman and Vytlacil (2007b).

20

This is defined as “uniformity” in Heckman, Urzua, and Vytlacil (2006).

21

Conditions for nonparametric identification of the multinomial discrete choice model are presented in Matzkin (1993, 1994). Conditions for nonparametric identification of the full choice model with outcomes are given in Heckman and Vytlacil (2007a, Appendix B). Conditions for identification of general dynamic discrete choice models are presented in Abbring and Heckman (2007). Conditions for identification in multinomial models that do not require “identification at infinity” are given in Fox and Gandhi (2008).

22

See Heckman and Vytlacil (2007b) who show how to vary Z3 or Z2 to effectively shut down one margin of choice. Specifically, for any fixed Z1 = z1, if limZ22 R2(Z2) → −∞ and limZ33 R3(Z3) → −∞ where 2 and 3 represent limit sets, then we can identify, respectively, the gains at the 3 → 1 margin in the limit set, and the gains in the 2 → 1 margin in the limit set. These assumptions require that one can vary Z2 and Z3 to shut down one or the other margin of choice. Under these assumptions and some additional mild regularity assumptions, the structural approach can identify distributions of (Y1Y2) and (Y2Y3) as we demonstrate in the example in Section 5 of this paper. “Identification at infinity” is a model-specific misnomer. It is an assumption that there are different sets each with non-negligible probability such that the probabilities of attaining various outcome states are arbitrarily close to one. “Identification at infinity” assumptions are justified naturally in truncated regression models. See Heckman (1987).

23

We keep conditioning on X implicit.

24

See Heckman, Lochner, and Todd (2006) for discussions of this model and various justifications for it. Heckman, Layne-Farrar, and Todd (1996) present evidence against linearity of the earnings function in terms of years of schooling.

25

Since Z1 only affects R(Z1), it has no direct effect on the margin 2 → 3.

26

Thus “2” appears only in the denominator and not in the numerator.

27

The structural model is nonparametrically identified under the conditions in Appendix B of Heckman and Vytlacil (2007a).

28
Decomposition (14) is not unique. It arises from decomposing Y into
Y=D1Y1+D2Y2+D3Y3
where we solve out D1 = 1 − D2D3, to obtain
Y=Y1+D2(Y2Y1)+D3(Y3Y1).
We could also solve out D2 = 1 − D1D3 to obtain
Y=Y2+D1(Y1Y2)+D3(Y3Y2)
or D3 = 1 − D1D2 to obtain
Y=Y3+D1(Y1Y3)+D2(Y2Y3).
Each decomposition can be used to represent ΔZ1IV. For each decomposition, the leading terms on the right-hand side, (Y1, Y2, Y3), respectively, are uncorrelated with Z1 by virtue of (A-2). Corresponding generalized MTEs can be defined for each decomposition. Z1 affects the lower boundary of the opportunity set in
E(Y2Y3|R(z2)R(z1),R(z3)R(z1)).

We choose the decomposition reported in the text for its greater interpretability.

29

See Heckman, Lochner, and Todd (2006) for a discussion of the Mincer Model and the powerful body of evidence against it. Card (2001) provides one justification for functional form 11.

30

An anonymous referee has correctly expressed the concern that in the case of an income-maximizing Mincer model under perfect certainty, the general unordered model would not apply. Indeed, the decision problem is not well defined. If g > r, the opportunity cost of funds, agents would choose the maximum amount of schooling. If g < r, the agent chooses no schooling. If g = r, the agent is indifferent to all levels of schooling. Thus, for our analysis to apply to the Mincer earnings equation, we have to assume that choices involve some combination of psychic costs, tuition, uncertainty or the like. The model of Keane and Wolpin (1997) is one of many frameworks that would justify an unordered choice model but could be consistent with a Mincer earnings equation. See Heckman, Lochner, and Todd (2006). We thank the referee for emphasizing this point to us.

31

Decomposition (16) for an ordered choice model is presented in Heckman, Urzua, and Vytlacil (2006) and Heckman and Vytlacil (2007b).

32

Alternatively, one can make functional form assumptions about the distribution of the error terms.

33

See the conditions in footnote 22.

35

The literature on “quantile treatment effects” uses IV to identify the quantiles of Y1 and Y2 separately but not the quantiles of Y1Y2. See Abbring and Heckman (2007).

36

Heckman, LaFontaine, and Rodríguez (2008) show that easing GED requirements promotes dropping out of school and causes some dropouts to become GEDs.

37

This is imposed in a discrete choice model.

38

See e.g. Card (2001).

42

See Heckman and Vytlacil (2007a, Appendix B).

44

However, this assumption is not yet routinely checked in many structural analyses.

45

The analysis of Fox and Gandhi (2008) shows that under their conditions it is possible to identify structural models with heterogeneity in choice equations that are ruled out by LATE-like monotonicity conditions. Thus models with two way flows between states that result from exogenous changes in instruments can be constructed, identified and estimated, and meaningful economic parameters can be identified without invoking “identification at infinity” or arbitrary conditions like “monotonicity” that are central to LATE.

46

See e.g. Abbring and Heckman (2007), Carneiro, Hansen, and Heckman (2003), Cunha, Heckman, and Navarro (2007), Cunha, Heckman, and Schennach (2006, revised 2008), Fox and Gandhi (2008) and Matzkin (1992, 1993, 2007). These recent developments in robust structural modeling have not yet made their way into widespread use in empirical structural analysis.

47

See e.g. Stock and Staiger (1997) and the ensuing large literature on weak instruments.

Contributor Information

James J. Heckman, University of Chicago, University College Dublin, Cowles Foundation, Yale University, and the American Bar Foundation.

Sergio Urzúa, Northwestern University.

References

  1. Abbring JH, Heckman JJ. Econometric evaluation of social programs, part III: Distributional treatment effects, dynamic treatment effects, dynamic discrete choice, and general equilibrium policy evaluation. In: Heckman J, Leamer E, editors. Handbook of Econometrics. Volume 6B. Amsterdam: Elsevier; 2007. pp. 5145–5303. [Google Scholar]
  2. Angrist JD, Imbens GW. Two-stage least squares estimation of average causal effects in models with variable treatment intensity. Journal of the American Statistical Association. 1995 June;90(430):431–442. [Google Scholar]
  3. Björklund A, Moffitt R. The estimation of wage gains and welfare gains in self-selection. Review of Economics and Statistics. 1987 February;69(1):42–49. [Google Scholar]
  4. Cameron SV, Heckman JJ. Life cycle schooling and dynamic selection bias: Models and evidence for five cohorts of American males. Journal of Political Economy. 1998 April;106(2):262–333. [Google Scholar]
  5. Card D. Estimating the return to schooling: Progress on some persistent econometric problems. Econometrica. 2001 September;69(5):1127–1160. [Google Scholar]
  6. Carneiro P, Hansen K, Heckman JJ. Estimating distributions of treatment effects with an application to the returns to schooling and measurement of the effects of uncertainty on college choice. International Economic Review. 2003 May;44(2):361–422. [Google Scholar]
  7. Carneiro P, Heckman JJ, Vytlacil EJ. Evaluating marginal policy changes and the average effect of treatment for individuals at the margin. 2009 March; doi: 10.3982/ECTA7089. Unpublished manuscript, University of Chicago, under revision, Econometrica. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Cunha F, Heckman JJ. The evolution of inequality, heterogeneity and uncertainty in labor earnings in the U.S. economy. National Bureau of Economic Research Working Paper No. 13526. 2007 October [Google Scholar]
  9. Cunha F, Heckman JJ, Navarro S. Separating uncertainty from heterogeneity in life cycle earnings, The 2004 Hicks Lecture. Oxford Economic Papers. 2005 April;57(2):191–261. [Google Scholar]
  10. Cunha F, Heckman JJ, Navarro S. The identification and economic content of ordered choice models with stochastic cutoffs. International Economic Review. 2007 November;48(4):1273–1309. [Google Scholar]
  11. Cunha F, Heckman JJ, Schennach SM. Meaningful value added equations: Anchoring test scores in adult outcomes. University of Chicago, Department of Economics; 2006. Unpublished manuscript. [Google Scholar]
  12. Fox J, Gandhi A. Identifying heterogeneity in economic choice and selection models using mixtures. University of Chicago; 2008. Nov, Unpublished manuscript. [Google Scholar]
  13. Heckman JJ. Selection bias and self-selection. In: Eatwell J, Milgate M, Newman P, editors. The New Palgrave: A Dictionary of Economics. London: Palgrave Macmillan Press; 1987. pp. 287–297. [Google Scholar]
  14. Heckman JJ. Randomization and social policy evaluation. In: Manski C, Garfinkel I, editors. Evaluating Welfare and Training Programs. Cambridge, MA: Harvard University Press; 1992. pp. 201–230. [Google Scholar]
  15. Heckman JJ. Econometric causality. International Statistical Review. 2008 April;76(1):1–27. [Google Scholar]
  16. Heckman JJ, LaFontaine PA, Rodríguez PL. Taking the easy way out: How the GED testing program induces students to drop out. University of Chicago, Department of Economics; 2008. Unpublished manuscript. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Heckman JJ, Layne-Farrar A, Todd PE. Human capital pricing equations with an application to estimating the effect of schooling quality on earnings. Review of Economics and Statistics. 1996 November;78(4):562–610. [Google Scholar]
  18. Heckman JJ, Lochner LJ, Todd PE. Earnings equations and rates of return: The Mincer equation and beyond. Chapter 7. In: Hanushek EA, Welch F, editors. Handbook of the Economics of Education. Amsterdam: Elsevier; 2006. pp. 307–458. [Google Scholar]
  19. Heckman JJ, Navarro S. Dynamic discrete choice and dynamic treatment effects. Journal of Econometrics. 2007 February;136(2):341–396. [Google Scholar]
  20. Heckman JJ, Schmierer D, Urzua S. Journal of Econometrics. University of Chicago, Department of Economics under revision; 2008. Testing the correlated random coefficient model. Unpublished manuscript. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Heckman JJ, Stixrud J, Urzua S. The effects of cognitive and noncognitive abilities on labor market outcomes and social behavior. Journal of Labor Economics. 2006 July;24(3):411–482. [Google Scholar]
  22. Heckman JJ, Urzua S, Vytlacil EJ. Understanding instrumental variables in models with essential heterogeneity. Review of Economics and Statistics. 2006;88(3):389–432. [Google Scholar]
  23. Heckman JJ, Urzua S, Vytlacil EJ. Instrumental variables in models with multiple outcomes: The general unordered case. Les Annales d’Economie et de Statistique. 2008 Forthcoming. [Google Scholar]
  24. Heckman JJ, Vytlacil EJ. Local instrumental variables and latent variable models for identifying and bounding treatment effects. Proceedings of the National Academy of Sciences. 1999 April;96:4730–4734. doi: 10.1073/pnas.96.8.4730. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Heckman JJ, Vytlacil EJ. Local instrumental variables. In: Hsiao C, Morimune K, Powell JL, editors. Nonlinear Statistical Modeling: Proceedings of the Thirteenth International Symposium in Economic Theory and Econometrics: Essays in Honor of Takeshi Amemiya; Cambridge University Press; New York. 2001. pp. 1–46. [Google Scholar]
  26. Heckman JJ, Vytlacil EJ. Structural equations, treatment effects and econometric policy evaluation. Econometrica. 2005 May;73(3):669–738. [Google Scholar]
  27. Heckman JJ, Vytlacil EJ. Econometric evaluation of social programs, part I: Causal models, structural models and econometric policy evaluation. In: Heckman J, Leamer E, editors. Handbook of Econometrics. Volume 6B. Amsterdam: Elsevier; 2007a. pp. 4779–4874. [Google Scholar]
  28. Heckman JJ, Vytlacil EJ. Econometric evaluation of social programs, part II: Using the marginal treatment effect to organize alternative economic estimators to evaluate social programs and to forecast their effects in new environments. In: Heckman J, Leamer E, editors. Handbook of Econometrics. Volume 6B. Amsterdam: Elsevier; 2007b. pp. 4875–5144. [Google Scholar]
  29. Hurwicz L. On the structural form of interdependent systems. In: Nagel E, Suppes P, Tarski A, editors. Logic, Methodology and Philosophy of Science. Stanford University Press; 1962. pp. 232–239. [Google Scholar]
  30. Imbens GW, Angrist JD. Identification and estimation of local average treatment effects. Econometrica. 1994 March;62(2):467–475. [Google Scholar]
  31. Keane MP, Wolpin KI. The career decisions of young men. Journal of Political Economy. 1997 June;105(3):473–522. [Google Scholar]
  32. Koopmans TC. Statistical Inference in Dynamic Economic Models. New York: John Wiley & Sons; 1950. Number 10 in Cowles Commission Monograph. [Google Scholar]
  33. Marschak J. Economic measurements for policy and prediction. In: Hood W, Koopmans T, editors. Studies in Econometric Method. New York: Wiley; 1953. pp. 1–26. [Google Scholar]
  34. Matzkin RL. Nonparametric and distribution-free estimation of the binary threshold crossing and the binary choice models. Econometrica. 1992 March;60(2):239–270. [Google Scholar]
  35. Matzkin RL. Nonparametric identification and estimation of polychotomous choice models. Journal of Econometrics. 1993 July;58(1–2):137–168. [Google Scholar]
  36. Matzkin RL. Restrictions of economic theory in nonparametric methods. In: Engle R, McFadden D, editors. Handbook of Econometrics. Volume 4. New York: North-Holland; 1994. pp. 2523–2558. [Google Scholar]
  37. Matzkin RL. Nonparametric identification. In: Heckman J, Leamer E, editors. Handbook of Econometrics. Volume 6B. Amsterdam: Elsevier; 2007. [Google Scholar]
  38. Mincer J. Schooling, Experience and Earnings. New York: Columbia University Press for National Bureau of Economic Research; 1974. [Google Scholar]
  39. Pencavel J. Labor supply of men. In: Ashenfelter O, Layard R, editors. Handbook of Labor Economics. Volume 1. Amsterdam: North-Holland; 1986. pp. 3–102. [Google Scholar]
  40. Stock JH, Staiger D. Instrumental variables regression with weak instruments. Econometrica. 1997;65(3):557–586. [Google Scholar]
  41. Urzua S. Racial labor market gaps: The role of abilities and schooling choices. Journal of Human Resources. 2008 Forthcoming. [Google Scholar]
  42. Willis RJ, Rosen S. Education and self-selection. Journal of Political Economy. 1979 October;87(5, Part 2):S7–S36. [Google Scholar]
  43. Yitzhaki S. On using linear regression in welfare economics. Department of Economics, Hebrew University; 1989. Working Paper 217. [Google Scholar]

RESOURCES