Demand Estimation with Machine Learning and Model Combination

Patrick Bajari, Denis Nekipelov, Stephen P. Ryan, Miaoyu Yang

NBER Working Paper No. 20955
Issued in February 2015
NBER Program(s):   IO

We survey and apply several techniques from the statistical and computer science literature to the problem of demand estimation. We derive novel asymptotic properties for several of these models. To improve out-of-sample prediction accuracy and obtain parametric rates of convergence, we propose a method of combining the underlying models via linear regression. Our method has several appealing features: it is robust to a large number of potentially-collinear regressors; it scales easily to very large data sets; the machine learning methods combine model selection and estimation; and the method can flexibly approximate arbitrary non-linear functions, even when the set of regressors is high dimensional and we also allow for fixed effects. We illustrate our method using a standard scanner panel data set to estimate promotional lift and find that our estimates are considerably more accurate in out of sample predictions of demand than some commonly used alternatives. While demand estimation is our motivating application, these methods are likely to be useful in other microeconometric problems.

You may purchase this paper on-line in .pdf format from ($5) for electronic delivery.

Access to NBER Papers

You are eligible for a free download if you are a subscriber, a corporate associate of the NBER, a journalist, an employee of the U.S. federal government with a ".GOV" domain name, or a resident of nearly any developing country or transition economy.

If you usually get free papers at work/university but do not at home, you can either connect to your work VPN or proxy (if any) or elect to have a link to the paper emailed to your work email address below. The email address must be connected to a subscribing college, university, or other subscribing institution. Gmail and other free email addresses will not have access.


Machine-readable bibliographic record - MARC, RIS, BibTeX

Document Object Identifier (DOI): 10.3386/w20955

Users who downloaded this paper also downloaded* these:
Benzell, Kotlikoff, LaGarda, and Sachs w20941 Robots Are Us: Some Economics of Human Replacement
Kearney and Levine w21229 Early Childhood Education by MOOC: Lessons from Sesame Street
Einav and Levin w19035 The Data Revolution and Economic Analysis
Buera, Kaboski, and Shin w21107 Entrepreneurship and Financial Frictions: A Macro-Development Perspective
Becker A Theory of Marriage
NBER Videos

National Bureau of Economic Research, 1050 Massachusetts Ave., Cambridge, MA 02138; 617-868-3900; email:

Contact Us