Validating Teacher Effect Estimates Using Changes in Teacher Assignments in Los Angeles

Andrew Bacher-Hicks, Thomas J. Kane, Douglas O. Staiger

NBER Working Paper No. 20657
Issued in November 2014
NBER Program(s):Program on Children, Economics of Education Program, Labor Studies Program, Public Economics Program

In a widely cited study, Chetty, Friedman, and Rockoff (2014a; hereafter CFR) evaluate the degree of bias in teacher value-added estimates using a novel "teacher switching" research design with data from New York City. They conclude that there is little to no bias in their estimates. Using the same model with data from North Carolina, Rothstein (2014) argued that the CFR research design is invalid, given a relationship between student baseline test scores and teachers' value-added. In this paper, we replicated the CFR analysis using data from the Los Angeles Unified School District and similarly found that teacher value-added estimates were valid predictors of student achievement. We also demonstrate that Rothstein's test does not invalidate the CFR design and instead reflects a mechanical relationship, given that teacher value-added scores from prior years and baseline test scores can be based on the same data. In addition, we explore the (1) predictive validity of value-added estimates drawn from the same, similar, and different schools, (2) an alternative way of estimating differences in access to effective teaching by taking teacher experience into account, and (3) the implications of alternative ways of imputing value-added when it cannot be estimated directly.

download in pdf format
   (358 K)

email paper

Machine-readable bibliographic record - MARC, RIS, BibTeX

Document Object Identifier (DOI): 10.3386/w20657

Users who downloaded this paper also downloaded* these:
Kane and Staiger w14607 Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation
Bloom, Lemos, Sadun, and Van Reenen w20667 Does Management Matter in Schools
Chetty, Friedman, and Rockoff w19423 Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates
Chetty, Friedman, and Rockoff w21961 Using Lagged Outcomes to Evaluate Bias in Value-Added Models
Angrist, Hull, Pathak, and Walters w21748 Leveraging Lotteries for School Value-Added: Testing and Estimation
NBER Videos

National Bureau of Economic Research, 1050 Massachusetts Ave., Cambridge, MA 02138; 617-868-3900; email:

Contact Us