Avoiding the counterfactuals: Research design in assesing the impact of agricultural research
Djurfeldt, Göran LU
; Fagerström, Torbjörn
LU
and Fredholm, Axel
LU
(2009)
- Abstract
- Two things strike the eye in the literature and debate on the impact of agricultural research. Firstly, it is not unsurprisingly dominated by economists using cost-benefit analysis. Secondly and more surprisingly, much space is devoted to the discussion of counterfactuals, i.e. by an argument of the type: “If this research had not been made, yield development (or whatever indicator) would have been less than it currently is.” Counterfactuals are shunned by historians but crop up in the literature on impact assessment for a simple reason, viz. that assessment is made ex post and without careful benchmarking having been done ex ante. This paper argues that historians are right, that counterfactual arguments in principle are dubious, at least... (More)
- Two things strike the eye in the literature and debate on the impact of agricultural research. Firstly, it is not unsurprisingly dominated by economists using cost-benefit analysis. Secondly and more surprisingly, much space is devoted to the discussion of counterfactuals, i.e. by an argument of the type: “If this research had not been made, yield development (or whatever indicator) would have been less than it currently is.” Counterfactuals are shunned by historians but crop up in the literature on impact assessment for a simple reason, viz. that assessment is made ex post and without careful benchmarking having been done ex ante. This paper argues that historians are right, that counterfactual arguments in principle are dubious, at least in social impact assessment and that alternative research designs, more useful for causal attribution should be aimed for.
In the first section follows a review of previous CGIAR work in impact assessment and a general methodological discussion. This is followed by a review of the methodologies, first for social impact assessment followed by an examination of environmental indicators. In the concluding section we propose a selection of case studies in which it would be possible to apply the methods and indicators suggested. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/7861374
- author
- Djurfeldt, Göran
LU
; Fagerström, Torbjörn
LU
and Fredholm, Axel
LU
- organization
- publishing date
- 2009
- type
- Book/Report
- publication status
- published
- subject
- pages
- 28 pages
- publisher
- Independent Science & Partnership Council of the CGIAR, Standing Panel on Impact Assessment (SPIA)
- language
- English
- LU publication?
- yes
- id
- 5da3fdd5-ead5-436f-83fa-3b63b293314a (old id 7861374)
- alternative location
- http://impact.cgiar.org/sites/default/files/docs/Djurfeldt-et-al-2009.pdf
- date added to LUP
- 2016-04-04 10:52:33
- date last changed
- 2018-11-21 21:01:17
@techreport{5da3fdd5-ead5-436f-83fa-3b63b293314a,
abstract = {{Two things strike the eye in the literature and debate on the impact of agricultural research. Firstly, it is not unsurprisingly dominated by economists using cost-benefit analysis. Secondly and more surprisingly, much space is devoted to the discussion of counterfactuals, i.e. by an argument of the type: “If this research had not been made, yield development (or whatever indicator) would have been less than it currently is.” Counterfactuals are shunned by historians but crop up in the literature on impact assessment for a simple reason, viz. that assessment is made ex post and without careful benchmarking having been done ex ante. This paper argues that historians are right, that counterfactual arguments in principle are dubious, at least in social impact assessment and that alternative research designs, more useful for causal attribution should be aimed for.<br/><br>
In the first section follows a review of previous CGIAR work in impact assessment and a general methodological discussion. This is followed by a review of the methodologies, first for social impact assessment followed by an examination of environmental indicators. In the concluding section we propose a selection of case studies in which it would be possible to apply the methods and indicators suggested.}},
author = {{Djurfeldt, Göran and Fagerström, Torbjörn and Fredholm, Axel}},
institution = {{Independent Science & Partnership Council of the CGIAR, Standing Panel on Impact Assessment (SPIA)}},
language = {{eng}},
title = {{Avoiding the counterfactuals: Research design in assesing the impact of agricultural research}},
url = {{http://impact.cgiar.org/sites/default/files/docs/Djurfeldt-et-al-2009.pdf}},
year = {{2009}},
}