Skip to main content
. Author manuscript; available in PMC: 2024 Jan 1.
Published in final edited form as: Hous Policy Debate. 2021 Apr 21;33(2):453–486. doi: 10.1080/10511482.2021.1881985

Table 3.

Comparing experimental and nonexperimental estimates of the effects of low poverty neighborhoods on an economic index

Census Tract Poverty Rates
Economic Index for High-Poverty Estimated Effect of Low-Poverty Nbhd on Economic Index
Low-Poverty Group Mean High-Poverty Group Mean Poverty Rate Diff. Coeff. (SE) P-Value N
I. Prior to trimming and reweighting
A. Experimental estimate
 (A1) MTO exp TOT (std wgts) 0.199 0.368 −0.169 −0.229 −0.012 0.863 2543
(0.067)
B. Nonexperimental estimates (unweighted)
 (B1) PSID nonexp estimate (< 25% poverty) 0.102 0.337 −0.235 −0.262 0.101 0.021 4299
(0.044)
 (B2) MTO nonexp est (< 25% poverty) 0.177 0.413 −0.236 −0.369 0.096 0.036 1770
(0.046)
C. Nonexp estimate matching gap (unweighted)
 (C1) PSID nonexp same poverty gap 0.148 0.319 −0.171 −0.250 0.107 0.018 2512
(0.045)
 (C2) Within study (MTO) nonexp same pov gap 0.199 0.370 −0.171 −0.368 0.053 0.295 1393
(0.050)
II. Trimming and reweighting to make samples more demographically similar
D. Reweighted quasi-experimental estimate
 (D1) MTO exp TOT (rewgtd) 0.200 0.369 −0.169 −0.111 −0.131 0.276 2532
(0.120)
E. Reweighted non-experimental estimate matching poverty gap/level
 (E1) PSID nonexp same poverty gap/level (rewgtd) 0.171 0.338 −0.167 −0.253 0.112 0.103 850
  (< 25% poverty) (0.068)
 (E2) MTO nonexp same poverty gap/level (rewgtd) 0.183 0.353 −0.170 −0.256 0.069 0.316 1738
  (< 25% poverty) (0.069)
F. Reweighted non-experimental matching poverty gap/level & disadv gap
 (F1) PSID nonexp same pov & disadv. gap/level 0.171 0.338 −0.166 −0.280 0.121 0.095 850
(0.073)
 (F2) MTO nonexp same pov & disadv. gap/level 0.183 0.353 −0.170 −0.249 0.091 0.188 1738
(0.068)
G. Reweighted non-experimental matching poverty gap/level & disadv/years gap
 (G1) PSID nonexp same poverty, disadv., and years 0.171 0.336 −0.165 −0.244 0.083 0.200 850
(0.065)
 (G2) MTO nonexp same poverty, disadv., and years 0.183 0.354 −0.171 −0.332 0.120 0.120 1738
(0.077)
H. Reweighted non-experimental matching poverty gap/level & disadv/# of moves
 (H1) PSID nonexp same poverty, disadv., and moves 0.171 0.337 −0.166 −0.247 0.079 0.222 850
(0.065)
 (H2) MTO nonexp same poverty, disadv., and moves 0.183 0.366 −0.183 −0.314 0.093 0.112 1738
(0.058)

Notes: This table presents the estimated effects of living in low-poverty neighborhoods on an index of economic outcomes for female adults. The economic index is an average z-score of employment and earnings measures (standardized against the PSID female sample). The MTO TOT (row A1) compares the experimental (low poverty voucher) and control groups using a regression (with the standard MTO weights) and scaling up the intent-to-treat estimate by the inverse of the compliance rate. This table’s measure of neighborhood poverty exposure is constructed for the MTO sample to be parallel to the PSID so it uses only biannual addresses during the present study’s follow-up time. In Row A1, the Low-Poverty Group Mean is the experimental complier mean, the Poverty Rate Diff is the TOT for the effect on the mean neighborhood poverty rate during follow-up, and the High-Poverty Group Mean is the implied experimental control complier mean (the experimental complier mean minus the TOT). The non-experimental treatment estimates are generated by first creating high- and low- neighborhood poverty subsamples. Rows B1 and B2 divide the sample into high and low groups at 25% poverty. In rows C1 and C2, the high and low poverty groups have been constructed such that the difference between them in average poverty rate is similar to the size of the MTO experimental TOT of about 17 percentage points. The nonexperimental analyses regress the outcome on an indicator for the low-poverty group as well as the best-available controls for each sample. The MTO non-experimental treatment estimates use only the Section 8 (traditional voucher) and control groups and the model includes an indicator for the Section 8 group. In Panel I, the nonexperimental estimates are unweighted. In Panel II, the samples have been made more similar to each other on basic demographics by trimming and reweighting the data.

Here is some additional detail about how we construct the high and low nonexperimental groups for rows C1 and C2 in Panel I. The sample is initially split at 25% average neighborhood poverty. The MTO average neighborhood poverty (for the combined controls and traditional voucher group) is about 17.7% among those with average neighborhood poverty rates below 25 percent. To produce a contrast comparable to the MTO TOT, we create a “high poverty” group starting with respondents near 25 percent neighborhood poverty and incrementally expanding (by 0.5 percentage points) to encompass higher neighborhood poverty rates until we achieve a contrast of about 17 percentage points between the high and low poverty groups.