Can Online Off-The-Shelf Lessons Improve Student Outcomes? Evidence from A Field Experiment

C. Kirabo Jackson, Alexey Makarin

NBER Working Paper No. 22398
Issued in July 2016, Revised in January 2017
NBER Program(s):Children, Economics of Education, Labor Studies, Public Economics, Productivity, Innovation, and Entrepreneurship

There has been a proliferation of websites that warehouse instructional materials designed to be taught by teachers in a traditional classroom. While this new technology has revolutionized how most teachers plan their lessons, the potential benefits of this innovation are unknown. To present evidence on this, we analyze an experiment in which middle-school math teachers were randomly given access to high-quality “off-the-shelf” lessons. Only providing teachers with online access to the lessons increased students’ math achievement by 0.06 of a standard deviation, but providing teachers with online access to the lessons along with supports to promote their use increased students’ math achievement by 0.09 of a standard deviation. Benefits were much larger for weaker teachers, suggesting that weaker teachers compensated for skill deficiencies by substituting the lessons for their own efforts. Survey evidence suggests that these effects were mediated by both improvements in lesson quality and teachers having more time to engage in other tasks. We rationalize these results with a multitask model of teaching. The intervention is more scalable and cost effective than most policies aimed at improving teacher quality, suggesting a real benefit to making high-quality instructional materials available to teachers on the internet.

download in pdf format
   (1583 K)

email paper

Machine-readable bibliographic record - MARC, RIS, BibTeX

Document Object Identifier (DOI): 10.3386/w22398

Published: Kirabo Jackson & Alexey Makarin, 2018. "Can Online Off-the-Shelf Lessons Improve Student Outcomes? Evidence from a Field Experiment," American Economic Journal: Economic Policy, vol 10(3), pages 226-254. citation courtesy of

Users who downloaded this paper also downloaded* these:
Faber, Sanchis-Guarner, and Weinhardt w21306 ICT and Education: Evidence from Student Home Addresses
Escueta, Quan, Nickow, and Oreopoulos w23744 Education Technology: An Evidence-Based Review
Papay, Taylor, Tyler, and Laski w21986 Learning Job Skills from Colleagues at Work: Evidence from a Field Experiment Using Teacher Performance Data
Chabrier, Cohodes, and Oreopoulos w22390 What Can We Learn from Charter School Lotteries?
Kane and Staiger w14607 Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation
NBER Videos

National Bureau of Economic Research, 1050 Massachusetts Ave., Cambridge, MA 02138; 617-868-3900; email:

Contact Us