NATIONAL BUREAU OF ECONOMIC RESEARCH
NATIONAL BUREAU OF ECONOMIC RESEARCH

Crowdsourcing City Government: Using Tournaments to Improve Inspection Accuracy

Edward L. Glaeser, Andrew Hillis, Scott Duke Kominers, Michael Luca

NBER Working Paper No. 22124
Issued in March 2016
NBER Program(s):PE, PR

Can open tournaments improve the quality of city services? The proliferation of big data makes it possible to use predictive analytics to better target services like hygiene inspections, but city governments rarely have the in-house talent needed for developing prediction algorithms. Cities could hire consultants, but a cheaper alternative is to crowdsource competence by making data public and offering a reward for the best algorithm. This paper provides a simple model suggesting that open tournaments dominate consulting contracts when cities have a reasonable tolerance for risk and when there is enough labor with low opportunity costs of time. We also illustrate how tournaments can be successful, by reporting on a Boston-based restaurant hygiene prediction tournament that we helped coordinate. The Boston tournament yielded algorithms—at low cost—that proved reasonably accurate when tested “out-of-sample” on hygiene inspections occurring after the algorithms were submitted. We draw upon our experience in working with Boston to provide practical suggestions for governments and other organizations seeking to run prediction tournaments in the future.

You may purchase this paper on-line in .pdf format from SSRN.com ($5) for electronic delivery.

Access to NBER Papers

You are eligible for a free download if you are a subscriber, a corporate associate of the NBER, a journalist, an employee of the U.S. federal government with a ".GOV" domain name, or a resident of nearly any developing country or transition economy.

If you usually get free papers at work/university but do not at home, you can either connect to your work VPN or proxy (if any) or elect to have a link to the paper emailed to your work email address below. The email address must be connected to a subscribing college, university, or other subscribing institution. Gmail and other free email addresses will not have access.

E-mail:

Supplementary materials for this paper:

Machine-readable bibliographic record - MARC, RIS, BibTeX

Document Object Identifier (DOI): 10.3386/w22124

Published: Edward L. Glaeser & Andrew Hillis & Scott Duke Kominers & Michael Luca, 2016. "Crowdsourcing City Government: Using Tournaments to Improve Inspection Accuracy," American Economic Review, vol 106(5), pages 114-118. citation courtesy of

Users who downloaded this paper also downloaded* these:
Kahn w23201 Is Local Public Sector Rent Extraction Higher in Progressive Cities or High Amenity Cities?
Naik, Kominers, Raskar, Glaeser, and Hidalgo w21620 Do People Shape Cities, or Do Cities Shape People? The Co-evolution of Physical, Social, and Economic Change in Five Major U.S. Cities
Ashraf, Glaeser, and Ponzetto w21910 Infrastructure, Incentives and Institutions
Chauvin, Glaeser, Ma, and Tobio w22002 What is Different About Urbanization in Rich and Poor Countries? Cities in Brazil, China, India and the United States
Glaeser, Kominers, Luca, and Naik w21778 Big Data and Big Cities: The Promises and Limitations of Improved Measures of Urban Life
 
Publications
Activities
Meetings
NBER Videos
Themes
Data
People
About

National Bureau of Economic Research, 1050 Massachusetts Ave., Cambridge, MA 02138; 617-868-3900; email: info@nber.org

Contact Us