NATIONAL BUREAU OF ECONOMIC RESEARCH
NATIONAL BUREAU OF ECONOMIC RESEARCH

Technical Problems in Social Experimentation: Cost versus Ease of Analysis

Jerry A. Hausman, David A. Wise

NBER Working Paper No. 1061 (Also Reprint No. r0644)
Issued in 1983

The goal of the paper is to set forth general guidelines that we believe would enhance the usefulness of future social experiments and to suggest ways of correcting for inherent limitations of them. Although the major motivation for an experiment is to overcome the inherent limitations of structural econometric models, in many instances the experimental designs have subverted this motivation. The primary advantages of randomized controlled experiments were often lost. The major complication for the analysis of the experiments was induced by an endogenous sample selection and treatment assignment procedure that selected the experimental participants and assigned them to controlversus treatment groups partly on the basis of the variable whose response the experiments were intended to measure. We propose that to overcome these difficulties, the goal of an experimental design should be as nearly as possible to allow analysis based on a simple analysis of variance model. Although complexities attendant to endogenous stratification can be avoided, there are inherent limitations of the experiments that cannot. Two major ones are self-determination of participation and self-selection out, through attrition.But these problems, we believe, can be corrected for with relative ease if endogenous stratification is eliminated. Finally, we propose that as a guiding principle, the experiments should have as a first priority the precise estimation of a single or a small number of treatment effects.

download in pdf format
   (568 K)

email paper

This paper is available as PDF (568 K) or via email.

Machine-readable bibliographic record - MARC, RIS, BibTeX

Document Object Identifier (DOI): 10.3386/w1061

Published:

Users who downloaded this paper also downloaded these:
Hausman and Wise Introduction to "Social Experimentation"
Hausman and Wise Technical Problems in Social Experimentation: Cost versus Ease of Analysis
List, Sadoff, and Wagner w15701 So you want to run an experiment, now what? Some Simple Rules of Thumb for Optimal Experimental Design
 
Publications
Activities
Meetings
NBER Videos
Data
People
About

Support
National Bureau of Economic Research, 1050 Massachusetts Ave., Cambridge, MA 02138; 617-868-3900; email: info@nber.org

Contact Us