NATIONAL BUREAU OF ECONOMIC RESEARCH
NATIONAL BUREAU OF ECONOMIC RESEARCH
loading...

The Online Laboratory: Conducting Experiments in a Real Labor Market

John J. Horton, David G. Rand, Richard J. Zeckhauser

NBER Working Paper No. 15961
Issued in May 2010
NBER Program(s):Law and Economics, Labor Studies

Online labor markets have great potential as platforms for conducting experiments, as they provide immediate access to a large and diverse subject pool and allow researchers to conduct randomized controlled trials. We argue that online experiments can be just as valid - both internally and externally - as laboratory and field experiments, while requiring far less money and time to design and to conduct. In this paper, we first describe the benefits of conducting experiments in online labor markets; we then use one such market to replicate three classic experiments and confirm their results. We confirm that subjects (1) reverse decisions in response to how a decision-problem is framed, (2) have pro-social preferences (value payoffs to others positively), and (3) respond to priming by altering their choices. We also conduct a labor supply field experiment in which we confirm that workers have upward sloping labor supply curves. In addition to reporting these results, we discuss the unique threats to validity in an online setting and propose methods for coping with these threats. We also discuss the external validity of results from online domains and explain why online results can have external validity equal to or even better than that of traditional methods, depending on the research question. We conclude with our views on the potential role that online experiments can play within the social sciences, and then recommend software development priorities and best practices.

download in pdf format
   (319 K)

email paper

Machine-readable bibliographic record - MARC, RIS, BibTeX

Document Object Identifier (DOI): 10.3386/w15961

Published: John Horton & David Rand & Richard Zeckhauser, 2011. "The online laboratory: conducting experiments in a real labor market," Experimental Economics, Springer, vol. 14(3), pages 399-425, September. citation courtesy of

Users who downloaded this paper also downloaded* these:
Blinder w3646 Why are Prices Sticky? Preliminary Results from an Interview Study
Froot, Scharfstein, and Stein w4084 Risk Management: Coordinating Corporate Investment and Financing Policies
Hsieh and Klenow w13290 Misallocation and Manufacturing TFP in China and India
Chevalier and Mayzlin w10148 The Effect of Word of Mouth on Sales: Online Book Reviews
Buiter, Corsetti, and Pesenti w5140 A Center-Periphery Model of Monetary Coordination and Exchange Rate Crises
 
Publications
Activities
Meetings
NBER Videos
Themes
Data
People
About

National Bureau of Economic Research, 1050 Massachusetts Ave., Cambridge, MA 02138; 617-868-3900; email: info@nber.org

Contact Us