The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con out of Econometrics

Joshua Angrist, Jörn-Steffen Pischke

NBER Working Paper No. 15794
Issued in March 2010
NBER Program(s):   CH   ED   HE   IO   LS   ME   PE

This essay reviews progress in empirical economics since Leamer's (1983) critique. Leamer highlighted the benefits of sensitivity analysis, a procedure in which researchers show how their results change with changes in specification or functional form. Sensitivity analysis has had a salutary but not a revolutionary effect on econometric practice. As we see it, the credibility revolution in empirical work can be traced to the rise of a design-based approach that emphasizes the identification of causal effects. Design-based studies typically feature either real or natural experiments and are distinguished by their prima facie credibility and by the attention investigators devote to making the case for a causal interpretation of the findings their designs generate. Design-based studies are most often found in the microeconomic fields of Development, Education, Environment, Labor, Health, and Public Finance, but are still rare in Industrial Organization and Macroeconomics. We explain why IO and Macro would do well to embrace a design-based approach. Finally, we respond to the charge that the design-based revolution has overreached.

download in pdf format
   (279 K)

email paper

The NBER Bulletin on Aging and Health provides summaries of publications like this.  You can sign up to receive the NBER Bulletin on Aging and Health by email.

This paper is available as PDF (279 K) or via email.

Machine-readable bibliographic record - MARC, RIS, BibTeX

Document Object Identifier (DOI): 10.3386/w15794

Published: Joshua D. Angrist & Jorn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring. citation courtesy of

Users who downloaded this paper also downloaded these:
Imbens and Wooldridge w14251 Recent Developments in the Econometrics of Program Evaluation
Deaton w14690 Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development
Angrist and Krueger w8456 Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments
Heckman w16110 Building Bridges Between Structural and Program Evaluation Approaches to Evaluating Policy
Banerjee and Duflo w14467 The Experimental Approach to Development Economics
NBER Videos

National Bureau of Economic Research, 1050 Massachusetts Ave., Cambridge, MA 02138; 617-868-3900; email:

Contact Us