Alternative approaches to evaluation in empirical microeconomics

Four alternative but related approaches to empirical evaluation of policy interventions are studied: social experiments, natural experiments, matching methods, and instrumental variables. In each case the necessary assumptions and the data requirements are considered for estimation of a number of key parameters of interest. These key parameters include the average treatment effect, the treatment of the treated and the local average treatment effect. Some issues of implementation and interpretation are discussed drawing on the labour market programme evaluation literature.

Suggested Citation

Download full text from publisher

Other versions of this item:

• Richard Blundell & Monica Costa Dias, 2009. " Alternative Approaches to Evaluation in Empirical Microeconomics ," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
• Richard Blundell & Monica Costa Dias, 2002. " Alternative approaches to evaluation in empirical microeconomics ," Portuguese Economic Journal, Springer;Instituto Superior de Economia e Gestao, vol. 1(2), pages 91-115, August.

• Richard Blundell & Monica Costa Dias, 2002. " Alternative approaches to evaluation in empirical microeconomics ," CeMMAP working papers 10/02, Institute for Fiscal Studies.
• Richard Blundell & Monica Costa Dias, 2008. " Alternative approaches to evaluation in empirical microeconomics ," CeMMAP working papers CWP26/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
• Richard Blundell & Mónica Costa Dias, 2008. " Alternative Approaches to Evaluation in Empirical Microeconomics ," CEF.UP Working Papers 0805, Universidade do Porto, Faculdade de Economia do Porto.
• Richard Blundell & Monica Costa Dias, 2008. " Alternative approaches to evaluation in empirical microeconomics ," CeMMAP working papers 26/08, Institute for Fiscal Studies.
• Blundell, Richard & Costa Dias, Monica, 2008. " Alternative Approaches to Evaluation in Empirical Microeconomics ," IZA Discussion Papers 3800, Institute of Labor Economics (IZA).

References listed on IDEAS

1. LaLonde, Robert J, 1986. " Evaluating the Econometric Evaluations of Training Programs with Experimental Data ," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.

• Robert J. LaLonde, 1984. " Evaluating the Econometric Evaluations of Training Programs with Experimental Data ," Working Papers 563, Princeton University, Department of Economics, Industrial Relations Section..

• Richard Blundell & Alan Duncan & Costas Meghir, 1995. " Estimating labour supply responses using tax reforms ," IFS Working Papers W95/07, Institute for Fiscal Studies.

• Jeffrey Smith & Petra Todd, 2003. " Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators? ," University of Western Ontario, Centre for Human Capital and Productivity (CHCP) Working Papers 20035, University of Western Ontario, Centre for Human Capital and Productivity (CHCP).

• Alberto Abadie & Joshua Angrist & Guido Imbens, 1999. " Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings ," Working papers 99-16, Massachusetts Institute of Technology (MIT), Department of Economics.

• Carneiro, Pedro & Hansen, Karsten T & Heckman, James J, 2002. " Removing the veil of ignorance in assessing the distributional impacts of social policies ," Working Paper Series 2002:2, IFAU - Institute for Evaluation of Labour Market and Education Policy.
• Carneiro, Pedro & Hansen, Karsten T. & Heckman, James J., 2002. " Removing the Veil of Ignorance in Assessing the Distributional Impacts of Social Policies ," IZA Discussion Papers 453, Institute of Labor Economics (IZA).

• Richard Blundell & Thomas MaCurdy, 1998. " Labour supply: a review of alternative approaches ," IFS Working Papers W98/18, Institute for Fiscal Studies.

• Richard Blundell & James L. Powell, 2001. " Endogeneity in semiparametric binary response models ," CeMMAP working papers CWP05/01, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
• Richard Blundell & James L. Powell, 2001. " Endogeneity in semiparametric binary response models ," CeMMAP working papers 05/01, Institute for Fiscal Studies.

• Austan Goolsbee, 1997. " What Happens When You Tax the Rich? Evidence from Executive Compensation ," NBER Working Papers 6333, National Bureau of Economic Research, Inc.

• Blundell, Richard & Dearden, Lorraine & Sianesi, Barbara, 2004. " Evaluating the impact of education on earnings in the UK: models, methods and results from the NCDS ," LSE Research Online Documents on Economics 19451, London School of Economics and Political Science, LSE Library.
• Richard Blundell & Lorraine Dearden & Barbara Sianesi, 2004. " Evaluating the Impact of Education on Earnings in the UK: Models, Methods and Results from the NCDS ," CEE Discussion Papers 0047, Centre for the Economics of Education, LSE.

• Nada Eissa & Jeffrey B. Liebman, 1995. " Labor Supply Response to the Earned Income Tax Credit ," NBER Working Papers 5158, National Bureau of Economic Research, Inc.

• Feenberg, D.R. & Poterba, J.M., 1992. " Income Inequality and the Incomes of Very High Income Taxpayers: Evidence from Tax Returns ," Working papers 92-16, Massachusetts Institute of Technology (MIT), Department of Economics.
• Daniel Feenberg & James Poterba, 1992. " Income Inequality and the Incomes of Very High Income Taxpayers: Evidence from Tax Returns ," NBER Working Papers 4229, National Bureau of Economic Research, Inc.

• Feldstein, Martin, 1995. " Effect of Marginal Tax Rates on Taxable Income: A Panel Study of the 1986 Tax Reform Act ," Scholarly Articles 2766676, Harvard University Department of Economics.

• Susan Athey & Guido W. Imbens, 2002. " Identification and Inference in Nonlinear Difference-In-Differences Models ," NBER Technical Working Papers 0280, National Bureau of Economic Research, Inc.
• Susan Athey & Guido Imbens, 2003. " Identification and Inference in Nonlinear Difference-in-Differences Models ," Levine's Working Paper Archive 506439000000000079, David K. Levine.

• Joshua D. Angrist & Guido W. Imbens, 1995. " Identification and Estimation of Local Average Treatment Effects ," NBER Technical Working Papers 0118, National Bureau of Economic Research, Inc.

• Blundell, Richard & Meghir, Costas & Van Reenen, John & Costa Dias, Monica, 2003. " Evaluating the Employment Impact of a Mandatory Job Search Programme ," CEPR Discussion Papers 3786, C.E.P.R. Discussion Papers.

• Martin Feldstein, 1993. " The Effect of Marginal Tax Rates on Taxable Income: A Panel Study of the1986 Tax Reform Act ," NBER Working Papers 4496, National Bureau of Economic Research, Inc.

• David Card & Lara D. Shore-Sheppard, 2002. " Using Discontinuous Eligibility Rules to Identify the Effects of the Federal Medicaid Expansions on Low Income Children ," NBER Working Papers 9058, National Bureau of Economic Research, Inc.
• David Card & Lara D. Shore-Sheppard, 2003. " Using Discontinuous Eligibility Rules to Identify the Effects of the Federal Medicaid Expansions on Low Income Children ," Department of Economics Working Papers 2003-09, Department of Economics, Williams College.

• Orley Ashenfelter & David Card, 1984. " Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs ," NBER Working Papers 1489, National Bureau of Economic Research, Inc.
• Orley Ashenfelter & David E. Card, 1984. " Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs ," Working Papers 554, Princeton University, Department of Economics, Industrial Relations Section..

• Frölich, Markus, 2006. " A Note on Parametric and Nonparametric Regression in the Presence of Endogenous Control Variables ," IZA Discussion Papers 2126, Institute of Labor Economics (IZA).

• Guido Imbens & Thomas Lemieux, 2007. " Regression Discontinuity Designs: A Guide to Practice ," NBER Working Papers 13039, National Bureau of Economic Research, Inc.
• Guido Imbens & Thomas Lemieux, 2007. " Regression Discontinuity Designs: A Guide to Practice ," NBER Technical Working Papers 0337, National Bureau of Economic Research, Inc.

• James J. Heckman, 1989. " Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: The Case of Manpower Training ," NBER Working Papers 2861, National Bureau of Economic Research, Inc.

• Whitney Newey & James Powell & Francis Vella, 1998. " Nonparametric Estimation of Triangular Simultaneous Equations Models ," Working papers 98-16, Massachusetts Institute of Technology (MIT), Department of Economics.
• Whitney K. Newey & James L. Powell & Francis Vella, 1998. " Nonparametric Estimation of Triangular Simultaneous Equations Models ," Working papers 98-6, Massachusetts Institute of Technology (MIT), Department of Economics.

• Heckman, James & Navarro-Lozano, Salvador, 2003. " Using matching, instrumental variables and control functions to estimate economic choice models ," Working Paper Series 2003:4, IFAU - Institute for Evaluation of Labour Market and Education Policy.
• James J. Heckman & Salvador Navarro-Lozano, 2003. " Using Matching, Instrumental Variables and Control Functions to Estimate Economic Choice Models ," NBER Working Papers 9497, National Bureau of Economic Research, Inc.
• Heckman, James J. & Navarro, Salvador, 2003. " Using Matching, Instrumental Variables and Control Functions to Estimate Economic Choice Models ," IZA Discussion Papers 768, Institute of Labor Economics (IZA).

• Richard Blundell & James L. Powell, 2001. " Endogeneity in nonparametric and semiparametric regression models ," CeMMAP working papers CWP09/01, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.

• Ahn, H. & Powell, J.L., 1990. " Semiparametric Estimation Of Censored Selection Models With A Nonparametric Selection Mechanism ," Working papers 90-33, Wisconsin Madison - Social Systems.

• Heckman, James J, 1979. " Sample Selection Bias as a Specification Error ," Econometrica, Econometric Society, vol. 47(1), pages 153-161, January.

• James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. " Characterizing Selection Bias Using Experimental Data ," NBER Working Papers 6699, National Bureau of Economic Research, Inc.

Most related items

1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. " Recent Developments in the Econometrics of Program Evaluation ," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.

• Guido M. Imbens & Jeffrey M. Wooldridge, 2008. " Recent Developments in the Econometrics of Program Evaluation ," NBER Working Papers 14251, National Bureau of Economic Research, Inc.
• Wooldridge, Jeffrey M. & Imbens, Guido, 2009. " Recent Developments in the Econometrics of Program Evaluation ," Scholarly Articles 3043416, Harvard University Department of Economics.
• Guido Imbens & Jeffrey M. Wooldridge, 2008. " Recent developments in the econometrics of program evaluation ," CeMMAP working papers CWP24/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
• Imbens, Guido W. & Wooldridge, Jeffrey M., 2008. " Recent Developments in the Econometrics of Program Evaluation ," IZA Discussion Papers 3640, Institute of Labor Economics (IZA).

• Heckman, James J. & Navarro, Salvador, 2003. " Using Matching, Instrumental Variables and Control Functions to Estimate Economic Choice Models ," IZA Discussion Papers 768, Institute of Labor Economics (IZA).
• Heckman, James & Navarro-Lozano, Salvador, 2003. " Using matching, instrumental variables and control functions to estimate economic choice models ," Working Paper Series 2003:4, IFAU - Institute for Evaluation of Labour Market and Education Policy.
• James J. Heckman & Salvador Navarro-Lozano, 2003. " Using Matching, Instrumental Variables and Control Functions to Estimate Economic Choice Models ," NBER Working Papers 9497, National Bureau of Economic Research, Inc.

• Blundell, Richard & Dearden, Lorraine & Sianesi, Barbara, 2004. " Evaluating the impact of education on earnings in the UK: models, methods and results from the NCDS ," LSE Research Online Documents on Economics 19451, London School of Economics and Political Science, LSE Library.
• Richard Blundell & Lorraine Dearden & Barbara Sianesi, 2004. " Evaluating the Impact of Education on Earnings in the UK: Models, Methods and Results from the NCDS ," CEE Discussion Papers 0047, Centre for the Economics of Education, LSE.

• van der Klaauw, Bas, 2014. " From Micro Data to Causality: Forty Years of Empirical Labor Economics ," IZA Discussion Papers 8047, Institute of Labor Economics (IZA).

• Jeffrey Smith & Petra Todd, 2003. " Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators? ," University of Western Ontario, Centre for Human Capital and Productivity (CHCP) Working Papers 20035, University of Western Ontario, Centre for Human Capital and Productivity (CHCP).

• Heckman, James J. & Pinto, Rodrigo, 2022. " Causality and Econometrics ," IZA Discussion Papers 15081, Institute of Labor Economics (IZA).

• Peter Hull & Michal Koles'ar & Christopher Walters, 2022. " Labour by Design: Contributions of David Card, Joshua Angrist, and Guido Imbens ," Papers 2203.16405, arXiv.org.

• Peter R. Mueser & Kenneth Troske & Alexey Gorislavsky, 2003. " Using State Administrative Data to Measure Program Performance ," Working Papers 0309, Department of Economics, University of Missouri.
• Mueser, Peter R. & Troske, Kenneth & Gorislavsky, Alexey, 2003. " Using State Administrative Data to Measure Program Performance ," IZA Discussion Papers 786, Institute of Labor Economics (IZA).
• Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. " Using State Administrative Data to Measure Program Performance ," Working Papers 0702, Department of Economics, University of Missouri.

• Darwin Ugarte Ontiveros & Gustavo Canavire-Bacarreza & Luis Castro Peñarrieta, 2017. " Outliers in semi-parametric Estimation of Treatment Effects ," Development Research Working Paper Series 06/2017, Institute for Advanced Development Studies.
• Darwin Ugarte Ontiveros & Gustavo Canavire-Bacarreza & Luis Castro Peñarrieta, 2017. " Outliers in semi-parametric Estimation of Treatment Effects ," Documentos de Trabajo de Valor Público 15810, Universidad EAFIT.

• Dan A. Black & Joonhwi Joo & Robert LaLonde & Jeffrey Andrew Smith & Evan J. Taylor, 2017. " Simple Tests for Selection: Learning More from Instrumental Variables ," CESifo Working Paper Series 6392, CESifo.
• Dan Black & Joonhwi Joo & Robert LaLonde & Jeffrey Smith & Evan Taylor, 2020. " Simple Tests for Selection: Learning More from Instrumental Variables ," Working Papers 2020-048, Human Capital and Economic Opportunity Working Group.
• Dan A. Black & Joonhwi Joo & Robert LaLonde & Jeffrey A. Smith & Evan J. Taylor, 2022. " Simple Tests for Selection: Learning More from Instrumental Variables ," NBER Working Papers 30291, National Bureau of Economic Research, Inc.

More about this item

JEL classification:

• J21 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Labor Force and Employment, Size, and Structure
• J64 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment: Models, Duration, Incidence, and Job Search
• C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models

NEP fields

• NEP-LTV-2002-06-13 (Unemployment, Inequality and Poverty)

Statistics

Corrections

All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:10/02 . See general information about how to correct material in RePEc.

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

Please note that corrections may take a couple of weeks to filter through the various RePEc services.