Does the means achieve an end? : A document analysis providing an overview of emergency and crisis management evaluation practice in the Netherlands
Beerens, Ralf Josef Johanna LU
(2019)
In International Journal of Emergency Management
15(3).
p.221-254
- Abstract
Evaluations provide insights into the effectiveness of emergency exercises or the response to a disaster. A well-constructed process is key to capture evidence-based feedback that can support future learning and development. However, little is known about how they are performed in practice and whether they actually meet their intended purpose. Therefore, this paper provides an overview of how ‘operational emergency response evaluations’ are currently performed in the Netherlands. The study was based on an analysis of evaluation reports and supporting documents from all 25 Dutch safety regions. Outcomes were cross-checked by regional representatives. The findings show that a variety of approaches and designs are currently being used,... (More)
Evaluations provide insights into the effectiveness of emergency exercises or the response to a disaster. A well-constructed process is key to capture evidence-based feedback that can support future learning and development. However, little is known about how they are performed in practice and whether they actually meet their intended purpose. Therefore, this paper provides an overview of how ‘operational emergency response evaluations’ are currently performed in the Netherlands. The study was based on an analysis of evaluation reports and supporting documents from all 25 Dutch safety regions. Outcomes were cross-checked by regional representatives. The findings show that a variety of approaches and designs are currently being used, which are not explicitly or logically linked. Most evaluations are isolated activities that do not build on each other. It is unclear how, and if, lessons identified become lessons learned, while the link between data collection and analysis and conclusions often remains vague. These issues undermine the validity of the evaluation and can have implications for its impact.
(Less)
- author
- Beerens, Ralf Josef Johanna
LU
- organization
- publishing date
- 2019-01-01
- type
- Contribution to journal
- publication status
- published
- subject
- keywords
- Crisis, Disaster, Document analysis, Emergency, Evaluation, Evaluation design, Evaluation process, Evaluation report, Exercise, Practice, Test, The Netherlands
- in
- International Journal of Emergency Management
- volume
- 15
- issue
- 3
- pages
- 34 pages
- publisher
- Inderscience Publishers
- external identifiers
-
- scopus:85072386306
- ISSN
- 1471-4825
- DOI
- 10.1504/IJEM.2019.102310
- language
- English
- LU publication?
- yes
- id
- 1849ea3c-3ef8-47a6-a6b8-fd8c61b7dd13
- date added to LUP
- 2019-09-30 09:38:30
- date last changed
- 2022-04-18 17:58:25
@article{1849ea3c-3ef8-47a6-a6b8-fd8c61b7dd13,
abstract = {{<p>Evaluations provide insights into the effectiveness of emergency exercises or the response to a disaster. A well-constructed process is key to capture evidence-based feedback that can support future learning and development. However, little is known about how they are performed in practice and whether they actually meet their intended purpose. Therefore, this paper provides an overview of how ‘operational emergency response evaluations’ are currently performed in the Netherlands. The study was based on an analysis of evaluation reports and supporting documents from all 25 Dutch safety regions. Outcomes were cross-checked by regional representatives. The findings show that a variety of approaches and designs are currently being used, which are not explicitly or logically linked. Most evaluations are isolated activities that do not build on each other. It is unclear how, and if, lessons identified become lessons learned, while the link between data collection and analysis and conclusions often remains vague. These issues undermine the validity of the evaluation and can have implications for its impact.</p>}},
author = {{Beerens, Ralf Josef Johanna}},
issn = {{1471-4825}},
keywords = {{Crisis; Disaster; Document analysis; Emergency; Evaluation; Evaluation design; Evaluation process; Evaluation report; Exercise; Practice; Test; The Netherlands}},
language = {{eng}},
month = {{01}},
number = {{3}},
pages = {{221--254}},
publisher = {{Inderscience Publishers}},
series = {{International Journal of Emergency Management}},
title = {{Does the means achieve an end? : A document analysis providing an overview of emergency and crisis management evaluation practice in the Netherlands}},
url = {{http://dx.doi.org/10.1504/IJEM.2019.102310}},
doi = {{10.1504/IJEM.2019.102310}},
volume = {{15}},
year = {{2019}},
}