Advanced

Does the means achieve an end? : A document analysis providing an overview of emergency and crisis management evaluation practice in the Netherlands

Beerens, Ralf Josef Johanna LU (2019) In International Journal of Emergency Management 15(3). p.221-254
Abstract

Evaluations provide insights into the effectiveness of emergency exercises or the response to a disaster. A well-constructed process is key to capture evidence-based feedback that can support future learning and development. However, little is known about how they are performed in practice and whether they actually meet their intended purpose. Therefore, this paper provides an overview of how ‘operational emergency response evaluations’ are currently performed in the Netherlands. The study was based on an analysis of evaluation reports and supporting documents from all 25 Dutch safety regions. Outcomes were cross-checked by regional representatives. The findings show that a variety of approaches and designs are currently being used,... (More)

Evaluations provide insights into the effectiveness of emergency exercises or the response to a disaster. A well-constructed process is key to capture evidence-based feedback that can support future learning and development. However, little is known about how they are performed in practice and whether they actually meet their intended purpose. Therefore, this paper provides an overview of how ‘operational emergency response evaluations’ are currently performed in the Netherlands. The study was based on an analysis of evaluation reports and supporting documents from all 25 Dutch safety regions. Outcomes were cross-checked by regional representatives. The findings show that a variety of approaches and designs are currently being used, which are not explicitly or logically linked. Most evaluations are isolated activities that do not build on each other. It is unclear how, and if, lessons identified become lessons learned, while the link between data collection and analysis and conclusions often remains vague. These issues undermine the validity of the evaluation and can have implications for its impact.

(Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
Crisis, Disaster, Document analysis, Emergency, Evaluation, Evaluation design, Evaluation process, Evaluation report, Exercise, Practice, Test, The Netherlands
in
International Journal of Emergency Management
volume
15
issue
3
pages
34 pages
publisher
Inderscience
external identifiers
  • scopus:85072386306
ISSN
1471-4825
DOI
10.1504/IJEM.2019.102310
language
English
LU publication?
yes
id
1849ea3c-3ef8-47a6-a6b8-fd8c61b7dd13
date added to LUP
2019-09-30 09:38:30
date last changed
2020-09-23 07:56:20
@article{1849ea3c-3ef8-47a6-a6b8-fd8c61b7dd13,
  abstract     = {<p>Evaluations provide insights into the effectiveness of emergency exercises or the response to a disaster. A well-constructed process is key to capture evidence-based feedback that can support future learning and development. However, little is known about how they are performed in practice and whether they actually meet their intended purpose. Therefore, this paper provides an overview of how ‘operational emergency response evaluations’ are currently performed in the Netherlands. The study was based on an analysis of evaluation reports and supporting documents from all 25 Dutch safety regions. Outcomes were cross-checked by regional representatives. The findings show that a variety of approaches and designs are currently being used, which are not explicitly or logically linked. Most evaluations are isolated activities that do not build on each other. It is unclear how, and if, lessons identified become lessons learned, while the link between data collection and analysis and conclusions often remains vague. These issues undermine the validity of the evaluation and can have implications for its impact.</p>},
  author       = {Beerens, Ralf Josef Johanna},
  issn         = {1471-4825},
  language     = {eng},
  month        = {01},
  number       = {3},
  pages        = {221--254},
  publisher    = {Inderscience},
  series       = {International Journal of Emergency Management},
  title        = {Does the means achieve an end? : A document analysis providing an overview of emergency and crisis management evaluation practice in the Netherlands},
  url          = {http://dx.doi.org/10.1504/IJEM.2019.102310},
  doi          = {10.1504/IJEM.2019.102310},
  volume       = {15},
  year         = {2019},
}