Do Students Know Best? Choice, Classroom Time, and Academic Performance

Theodore J. Joyce, Sean Crockett, David A. Jaeger, Onur Altindag, Stephen D. O'Connell, Dahlia K. Remler

NBER Working Paper No. 21656
Issued in October 2015
NBER Program(s):Economics of Education, Health Economics, Public Economics

We compare student academic performance in traditional twice-a-week and compressed once-a-week lecture formats in introductory microeconomics between one semester in which students were randomly assigned into the formats and another semester when students were allowed to choose their format. In each semester we offered the same course with the sections taught at the same times in the same classrooms by the same professors using the same book, software and lecture slides. Our study design is modeled after a doubly randomized preference trial (DRPT), which provides insights regarding external validity beyond what is possible from a single randomized study. Our goal is to assess whether having a choice modifies the treatment effect of format. Students in the compressed format of the randomized arm of the study scored -0.19 standard deviations less on the combined midterm and final (p<.01) and -0.14 standard deviation less in choice arm (p<.01). There was little evidence of selection bias in choice of format. Future analyses of online learning formats employing randomization should consider DRPT designs to enhance the generalizability of results.

download in pdf format
   (505 K)

email paper

Machine-readable bibliographic record - MARC, RIS, BibTeX

Document Object Identifier (DOI): 10.3386/w21656

Users who downloaded this paper also downloaded* these:
Joyce, Crockett, Jaeger, Altindag, and O'Connell w20006 Does Classroom Time Matter? A Randomized Field Experiment of Hybrid and Traditional Lecture Formats in Economics
Altonji, Arcidiacono, and Maurel w21655 The Analysis of Field Choice in College and Graduate School: Determinants and Wage Effects
Levitt and Lin w21628 Catching Cheating Students
Kline and Walters w21658 Evaluating Public Programs with Close Substitutes: The Case of Head Start
Cooper, McClelland, Pearce, Prisinzano, Sullivan, Yagan, Zidar, and Zwick w21651 Business in the United States: Who Owns it and How Much Tax Do They Pay?
NBER Videos

National Bureau of Economic Research, 1050 Massachusetts Ave., Cambridge, MA 02138; 617-868-3900; email:

Contact Us