Advanced

Scoping the field of disaster exercise evaluation - A literature overview and analysis

Beerens, Ralf LU and Tehler, Henrik LU (2016) In International Journal of Disaster Risk Reduction 19. p.413-446
Abstract

The evaluation of emergency, disaster and crisis management exercises supports both individual and organisational learning, facilitates the development of response capabilities, and helps to determine whether the current level of preparedness is good enough. Nevertheless, despite its importance in the field of disaster risk management, there is a lack of a comprehensive overview of research in the area. The aim of the paper is to provide such an overview. A scoping study identified the key contributions on the topic of disaster exercise evaluation, provides an overview of research in the area, and analyses opportunities for future work. The purpose, function and form of the evaluation provided the framework for the analysis, which was... (More)

The evaluation of emergency, disaster and crisis management exercises supports both individual and organisational learning, facilitates the development of response capabilities, and helps to determine whether the current level of preparedness is good enough. Nevertheless, despite its importance in the field of disaster risk management, there is a lack of a comprehensive overview of research in the area. The aim of the paper is to provide such an overview. A scoping study identified the key contributions on the topic of disaster exercise evaluation, provides an overview of research in the area, and analyses opportunities for future work. The purpose, function and form of the evaluation provided the framework for the analysis, which was applied to the scoping study results. The results indicate a lack of academic interest. Although exercises take place on a regular basis and are often used for research purposes, their evaluations are seldom the focus of attention per se. Moreover, contributions that do focus on evaluations are spread over several disciplines. Nevertheless, the results indicate that recent contributions are becoming more coherent as they build on each other (or at least refer to each other), even if they are produced within different disciplines. Despite encouraging signs of a more cohesive scientific corpus on the evaluation of disaster exercises, there is still room for improvement. The scientific discourse would benefit from greater clarity regarding: (1) the purpose and context in which a specific evaluation method is designed to be used; (2) what the method needs to do (or produce) in order for it to fulfil the purpose; and (3) how the method achieves its goal and thereby fulfils its purpose. Moreover, in order to help researchers to build on each other's work and suggest improvements to evaluation methods, it is urgent that the supporting evidence (for example, empirical data or logical reasoning) for claims regarding the usefulness of a specific method is clearly presented. This is likely to lead to a more vigorous scientific discourse, which will result in increasingly relevant and robust arguments related to how to approach the problem of evaluating disaster exercises in practice.

(Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
Analysis, Assessment, Crisis, Disaster, Drill, Emergency, Evaluation, Exercise, Literature overview, Review, Scoping study, Valuation
in
International Journal of Disaster Risk Reduction
volume
19
pages
34 pages
publisher
Elsevier
external identifiers
  • scopus:84992045296
  • scopus:84992045296
  • wos:000390555100040
ISSN
2212-4209
DOI
10.1016/j.ijdrr.2016.09.001
language
English
LU publication?
yes
id
f16093c6-799f-4b21-b420-0a75ad9e88b4
date added to LUP
2016-10-31 13:53:20
date last changed
2017-09-18 11:28:50
@article{f16093c6-799f-4b21-b420-0a75ad9e88b4,
  abstract     = {<p>The evaluation of emergency, disaster and crisis management exercises supports both individual and organisational learning, facilitates the development of response capabilities, and helps to determine whether the current level of preparedness is good enough. Nevertheless, despite its importance in the field of disaster risk management, there is a lack of a comprehensive overview of research in the area. The aim of the paper is to provide such an overview. A scoping study identified the key contributions on the topic of disaster exercise evaluation, provides an overview of research in the area, and analyses opportunities for future work. The purpose, function and form of the evaluation provided the framework for the analysis, which was applied to the scoping study results. The results indicate a lack of academic interest. Although exercises take place on a regular basis and are often used for research purposes, their evaluations are seldom the focus of attention per se. Moreover, contributions that do focus on evaluations are spread over several disciplines. Nevertheless, the results indicate that recent contributions are becoming more coherent as they build on each other (or at least refer to each other), even if they are produced within different disciplines. Despite encouraging signs of a more cohesive scientific corpus on the evaluation of disaster exercises, there is still room for improvement. The scientific discourse would benefit from greater clarity regarding: (1) the purpose and context in which a specific evaluation method is designed to be used; (2) what the method needs to do (or produce) in order for it to fulfil the purpose; and (3) how the method achieves its goal and thereby fulfils its purpose. Moreover, in order to help researchers to build on each other's work and suggest improvements to evaluation methods, it is urgent that the supporting evidence (for example, empirical data or logical reasoning) for claims regarding the usefulness of a specific method is clearly presented. This is likely to lead to a more vigorous scientific discourse, which will result in increasingly relevant and robust arguments related to how to approach the problem of evaluating disaster exercises in practice.</p>},
  author       = {Beerens, Ralf and Tehler, Henrik},
  issn         = {2212-4209},
  keyword      = {Analysis,Assessment,Crisis,Disaster,Drill,Emergency,Evaluation,Exercise,Literature overview,Review,Scoping study,Valuation},
  language     = {eng},
  month        = {10},
  pages        = {413--446},
  publisher    = {Elsevier},
  series       = {International Journal of Disaster Risk Reduction},
  title        = {Scoping the field of disaster exercise evaluation - A literature overview and analysis},
  url          = {http://dx.doi.org/10.1016/j.ijdrr.2016.09.001},
  volume       = {19},
  year         = {2016},
}