Advanced

Avoiding the counterfactuals: Research design in assesing the impact of agricultural research

Djurfeldt, Göran LU ; Fagerström, Torbjörn LU and Fredholm, Axel LU (2009)
Abstract
Two things strike the eye in the literature and debate on the impact of agricultural research. Firstly, it is not unsurprisingly dominated by economists using cost-benefit analysis. Secondly and more surprisingly, much space is devoted to the discussion of counterfactuals, i.e. by an argument of the type: “If this research had not been made, yield development (or whatever indicator) would have been less than it currently is.” Counterfactuals are shunned by historians but crop up in the literature on impact assessment for a simple reason, viz. that assessment is made ex post and without careful benchmarking having been done ex ante. This paper argues that historians are right, that counterfactual arguments in principle are dubious, at least... (More)
Two things strike the eye in the literature and debate on the impact of agricultural research. Firstly, it is not unsurprisingly dominated by economists using cost-benefit analysis. Secondly and more surprisingly, much space is devoted to the discussion of counterfactuals, i.e. by an argument of the type: “If this research had not been made, yield development (or whatever indicator) would have been less than it currently is.” Counterfactuals are shunned by historians but crop up in the literature on impact assessment for a simple reason, viz. that assessment is made ex post and without careful benchmarking having been done ex ante. This paper argues that historians are right, that counterfactual arguments in principle are dubious, at least in social impact assessment and that alternative research designs, more useful for causal attribution should be aimed for.

In the first section follows a review of previous CGIAR work in impact assessment and a general methodological discussion. This is followed by a review of the methodologies, first for social impact assessment followed by an examination of environmental indicators. In the concluding section we propose a selection of case studies in which it would be possible to apply the methods and indicators suggested. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Book/Report
publication status
published
subject
pages
28 pages
publisher
Independent Science & Partnership Council of the CGIAR, Standing Panel on Impact Assessment (SPIA)
language
English
LU publication?
yes
id
5da3fdd5-ead5-436f-83fa-3b63b293314a (old id 7861374)
alternative location
http://impact.cgiar.org/sites/default/files/docs/Djurfeldt-et-al-2009.pdf
date added to LUP
2015-09-10 09:28:20
date last changed
2016-04-16 08:28:53
@misc{5da3fdd5-ead5-436f-83fa-3b63b293314a,
  abstract     = {Two things strike the eye in the literature and debate on the impact of agricultural research. Firstly, it is not unsurprisingly dominated by economists using cost-benefit analysis. Secondly and more surprisingly, much space is devoted to the discussion of counterfactuals, i.e. by an argument of the type: “If this research had not been made, yield development (or whatever indicator) would have been less than it currently is.” Counterfactuals are shunned by historians but crop up in the literature on impact assessment for a simple reason, viz. that assessment is made ex post and without careful benchmarking having been done ex ante. This paper argues that historians are right, that counterfactual arguments in principle are dubious, at least in social impact assessment and that alternative research designs, more useful for causal attribution should be aimed for.<br/><br>
In the first section follows a review of previous CGIAR work in impact assessment and a general methodological discussion. This is followed by a review of the methodologies, first for social impact assessment followed by an examination of environmental indicators. In the concluding section we propose a selection of case studies in which it would be possible to apply the methods and indicators suggested.},
  author       = {Djurfeldt, Göran and Fagerström, Torbjörn and Fredholm, Axel},
  language     = {eng},
  pages        = {28},
  publisher    = {ARRAY(0x9328358)},
  title        = {Avoiding the counterfactuals: Research design in assesing the impact of agricultural research},
  year         = {2009},
}