Can Online Off-The-Shelf Lessons Improve Student Outcomes? Evidence from A Field Experiment

C. Kirabo Jackson, Alexey Makarin

NBER Working Paper No. 22398
Issued in July 2016, Revised in January 2017
NBER Program(s):Children, Economics of Education, Labor Studies, Public Economics, Productivity, Innovation, and Entrepreneurship

There has been a proliferation of websites that warehouse instructional materials designed to be taught by teachers in a traditional classroom. While this new technology has revolutionized how most teachers plan their lessons, the potential benefits of this innovation are unknown. To present evidence on this, we analyze an experiment in which middle-school math teachers were randomly given access to high-quality “off-the-shelf” lessons. Only providing teachers with online access to the lessons increased students’ math achievement by 0.06 of a standard deviation, but providing teachers with online access to the lessons along with supports to promote their use increased students’ math achievement by 0.09 of a standard deviation. Benefits were much larger for weaker teachers, suggesting that weaker teachers compensated for skill deficiencies by substituting the lessons for their own efforts. Survey evidence suggests that these effects were mediated by both improvements in lesson quality and teachers having more time to engage in other tasks. We rationalize these results with a multitask model of teaching. The intervention is more scalable and cost effective than most policies aimed at improving teacher quality, suggesting a real benefit to making high-quality instructional materials available to teachers on the internet.

download in pdf format
   (1583 K)

email paper

Machine-readable bibliographic record - MARC, RIS, BibTeX

Document Object Identifier (DOI): 10.3386/w22398

Users who downloaded this paper also downloaded* these:
Chabrier, Cohodes, and Oreopoulos w22390 What Can We Learn from Charter School Lotteries?
Papay, Taylor, Tyler, and Laski w21986 Learning Job Skills from Colleagues at Work: Evidence from a Field Experiment Using Teacher Performance Data
Fryer w22399 An Empirical Analysis of Racial Differences in Police Use of Force
Card and Giuliano w22104 Can Tracking Raise the Test Scores of High-Ability Minority Students?
Michelmore and Dynarski w22474 The Gap within the Gap: Using Longitudinal Data to Understand Income Differences in Student Achievement
NBER Videos

National Bureau of Economic Research, 1050 Massachusetts Ave., Cambridge, MA 02138; 617-868-3900; email:

Contact Us