Scoping the field of disaster exercise evaluation - A literature overview and analysis
Beerens, Ralf LU
and Tehler, Henrik
LU
(2016)
In International Journal of Disaster Risk Reduction
19.
p.413-446
- Abstract
The evaluation of emergency, disaster and crisis management exercises supports both individual and organisational learning, facilitates the development of response capabilities, and helps to determine whether the current level of preparedness is good enough. Nevertheless, despite its importance in the field of disaster risk management, there is a lack of a comprehensive overview of research in the area. The aim of the paper is to provide such an overview. A scoping study identified the key contributions on the topic of disaster exercise evaluation, provides an overview of research in the area, and analyses opportunities for future work. The purpose, function and form of the evaluation provided the framework for the analysis, which was... (More)
The evaluation of emergency, disaster and crisis management exercises supports both individual and organisational learning, facilitates the development of response capabilities, and helps to determine whether the current level of preparedness is good enough. Nevertheless, despite its importance in the field of disaster risk management, there is a lack of a comprehensive overview of research in the area. The aim of the paper is to provide such an overview. A scoping study identified the key contributions on the topic of disaster exercise evaluation, provides an overview of research in the area, and analyses opportunities for future work. The purpose, function and form of the evaluation provided the framework for the analysis, which was applied to the scoping study results. The results indicate a lack of academic interest. Although exercises take place on a regular basis and are often used for research purposes, their evaluations are seldom the focus of attention per se. Moreover, contributions that do focus on evaluations are spread over several disciplines. Nevertheless, the results indicate that recent contributions are becoming more coherent as they build on each other (or at least refer to each other), even if they are produced within different disciplines. Despite encouraging signs of a more cohesive scientific corpus on the evaluation of disaster exercises, there is still room for improvement. The scientific discourse would benefit from greater clarity regarding: (1) the purpose and context in which a specific evaluation method is designed to be used; (2) what the method needs to do (or produce) in order for it to fulfil the purpose; and (3) how the method achieves its goal and thereby fulfils its purpose. Moreover, in order to help researchers to build on each other's work and suggest improvements to evaluation methods, it is urgent that the supporting evidence (for example, empirical data or logical reasoning) for claims regarding the usefulness of a specific method is clearly presented. This is likely to lead to a more vigorous scientific discourse, which will result in increasingly relevant and robust arguments related to how to approach the problem of evaluating disaster exercises in practice.
(Less)
- author
- Beerens, Ralf
LU
and Tehler, Henrik
LU
- organization
- publishing date
- 2016-10-01
- type
- Contribution to journal
- publication status
- published
- subject
- keywords
- Analysis, Assessment, Crisis, Disaster, Drill, Emergency, Evaluation, Exercise, Literature overview, Review, Scoping study, Valuation
- in
- International Journal of Disaster Risk Reduction
- volume
- 19
- pages
- 34 pages
- publisher
- Elsevier
- external identifiers
-
- scopus:84992045296
- scopus:84992045296
- wos:000390555100040
- ISSN
- 2212-4209
- DOI
- 10.1016/j.ijdrr.2016.09.001
- language
- English
- LU publication?
- yes
- id
- f16093c6-799f-4b21-b420-0a75ad9e88b4
- date added to LUP
- 2016-10-31 13:53:20
- date last changed
- 2024-06-15 19:17:34
@article{f16093c6-799f-4b21-b420-0a75ad9e88b4,
abstract = {{<p>The evaluation of emergency, disaster and crisis management exercises supports both individual and organisational learning, facilitates the development of response capabilities, and helps to determine whether the current level of preparedness is good enough. Nevertheless, despite its importance in the field of disaster risk management, there is a lack of a comprehensive overview of research in the area. The aim of the paper is to provide such an overview. A scoping study identified the key contributions on the topic of disaster exercise evaluation, provides an overview of research in the area, and analyses opportunities for future work. The purpose, function and form of the evaluation provided the framework for the analysis, which was applied to the scoping study results. The results indicate a lack of academic interest. Although exercises take place on a regular basis and are often used for research purposes, their evaluations are seldom the focus of attention per se. Moreover, contributions that do focus on evaluations are spread over several disciplines. Nevertheless, the results indicate that recent contributions are becoming more coherent as they build on each other (or at least refer to each other), even if they are produced within different disciplines. Despite encouraging signs of a more cohesive scientific corpus on the evaluation of disaster exercises, there is still room for improvement. The scientific discourse would benefit from greater clarity regarding: (1) the purpose and context in which a specific evaluation method is designed to be used; (2) what the method needs to do (or produce) in order for it to fulfil the purpose; and (3) how the method achieves its goal and thereby fulfils its purpose. Moreover, in order to help researchers to build on each other's work and suggest improvements to evaluation methods, it is urgent that the supporting evidence (for example, empirical data or logical reasoning) for claims regarding the usefulness of a specific method is clearly presented. This is likely to lead to a more vigorous scientific discourse, which will result in increasingly relevant and robust arguments related to how to approach the problem of evaluating disaster exercises in practice.</p>}},
author = {{Beerens, Ralf and Tehler, Henrik}},
issn = {{2212-4209}},
keywords = {{Analysis; Assessment; Crisis; Disaster; Drill; Emergency; Evaluation; Exercise; Literature overview; Review; Scoping study; Valuation}},
language = {{eng}},
month = {{10}},
pages = {{413--446}},
publisher = {{Elsevier}},
series = {{International Journal of Disaster Risk Reduction}},
title = {{Scoping the field of disaster exercise evaluation - A literature overview and analysis}},
url = {{http://dx.doi.org/10.1016/j.ijdrr.2016.09.001}},
doi = {{10.1016/j.ijdrr.2016.09.001}},
volume = {{19}},
year = {{2016}},
}