External evaluation of the scientific basis of the assessment system for ecological condition in Norway
Eckerberg, Katarina ; Gustafsson, Lena ; Moen, Jon ; Nightingale, Andrea Joslyn ; Roose, Patrick ; Sahlin, Ullrika LU
and Węsławski, Jan Martin
(2024)
- Abstract
- This reportis an external evaluation of the scientific basis of the Norwegian assessment system for ecological condition, commissioned by the Ministry of Climate and Environment. Two assessment methods are currently used for various terrestsrial and marine ecosystem: the Panel-Based Assessment of Ecological Condition (PAEC) and the Index-Based Ecological Condition Assessment (IBECA). The purpose of the evaluation is to scrutinise and compare the respective scientific strengths and weaknesses of the two assessment methods, as well as the assessments carried out since 2017, and to evaluate the suitability of the two assessment methods for evidence-based policy-making. The evaluation should cover possible improvements and adjustments to the... (More)
- This reportis an external evaluation of the scientific basis of the Norwegian assessment system for ecological condition, commissioned by the Ministry of Climate and Environment. Two assessment methods are currently used for various terrestsrial and marine ecosystem: the Panel-Based Assessment of Ecological Condition (PAEC) and the Index-Based Ecological Condition Assessment (IBECA). The purpose of the evaluation is to scrutinise and compare the respective scientific strengths and weaknesses of the two assessment methods, as well as the assessments carried out since 2017, and to evaluate the suitability of the two assessment methods for evidence-based policy-making. The evaluation should cover possible improvements and adjustments to the assessment system regarding methods and scientific design, including opportunities and dilemmas, and "as far as the available information permits" discuss the role of the two assessment methods as basis for decisions in policy and management including any limitations of the knowledge base. All these aims are well covered in the report.
The evaluation panel has consisted of seven international experts, coordinated by the Norwegian Research Council. The panel has evaluated twelve PAEC and IBECA reports including an advisory report setting the framework conditions for the assessment system. Three peer-reviewed articles describining the respective methods have been considiered. Further, the panel has interviewed five experts involved in the assessments and 14 stakeholders to better understand the methods for assessment and the potential use of the assessment results for policy and management.
The evaluation ends with proposing specific recommendations both to the PAEC and IBECA methods and to the Ministry. (Less) - Abstract (Swedish)
- This report is an external evaluation of the scientific basis of the Norwegian assessment system for ecological condition (Fagsystem for økologisk tilstand), commissioned by the Ministry of Climate and Environment (KLD). Two assessment methods are currently used for various terrestrial and marine ecosystems: the Panel-Based Assessment of Ecological Condition (PAEC) and the Index-Based Ecological Condition Assessment (IBECA). The purpose of the evaluation is to scrutinise and compare the respective scientific strengths and weaknesses of the two assessment methods, as well as the assessments carried out since 2017, and to evaluate the suitability of the two assessment methods for evidence-based policymaking. The evaluation should cover... (More)
- This report is an external evaluation of the scientific basis of the Norwegian assessment system for ecological condition (Fagsystem for økologisk tilstand), commissioned by the Ministry of Climate and Environment (KLD). Two assessment methods are currently used for various terrestrial and marine ecosystems: the Panel-Based Assessment of Ecological Condition (PAEC) and the Index-Based Ecological Condition Assessment (IBECA). The purpose of the evaluation is to scrutinise and compare the respective scientific strengths and weaknesses of the two assessment methods, as well as the assessments carried out since 2017, and to evaluate the suitability of the two assessment methods for evidence-based policymaking. The evaluation should cover possible improvements and adjustments to the assessment system regarding methods and scientific design, including opportunities and dilemmas, and “as far as the available information permits” discuss the role of the two assessment methods as basis for decisions in policy and public administration including any limitations of this knowledge base.
The evaluation panel has consisted of seven international experts, coordinated by the Norwegian Research Council. The panel has evaluated twelve PAEC and IBECA reports including an advisory report setting the framework conditions for the assessment system. Three peer-reviewed articles describing the respective methods have been considered. Further, the panel has interviewed five experts involved in the assessments and 14 stakeholders to better understand the methods for assessment and the potential use of the assessment results for policy and management. The evaluation panel’s overarching conclusion is that the PAEC and IBECA methods have been developed for the same purpose but in partly different institutional and policy contexts. We find that neither of the two methods follow all our proposed scientific and management criteria for an efficient assessment system for ecological condition, but that the PAEC method is better designed overall to this aim compared with the IBECA method. Since our knowledge of the processes influencing the functioning of the different ecosystems are incomplete, and indicators must be selected based on data availability and best available knowledge, we fully acknowledge the need for structured and well-documented expert judgements. In this respect, we find that the PAEC method outweighs IBECA. IBECA relies heavily on quantitative indices and aggregation of data with comparatively low transparency and high uncertainty in relation to the setting of a normative threshold of ‘good ecological condition’. Inevitably, to evaluate changes over time and critical thresholds not to be exceeded will require insightful expert judgement from different perspectives and needs to be presented in a transparent manner.
We end our evaluation by proposing specific recommendations both to the PAEC and IBECA methods and to the Ministry for Climate and Environment for the future direction of the assessment system for ecological condition. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/f696cdfe-9bd0-48f0-b727-69cb143bae34
- author
- Eckerberg, Katarina
; Gustafsson, Lena
; Moen, Jon
; Nightingale, Andrea Joslyn
; Roose, Patrick
; Sahlin, Ullrika
LU
and Węsławski, Jan Martin
- organization
- publishing date
- 2024
- type
- Book/Report
- publication status
- published
- subject
- keywords
- evaluation, ecological assessment, assessment system, ecological condition
- pages
- 71 pages
- publisher
- The Research Council of Norway
- ISBN
- 978-82-12-04189-9
- language
- Swedish
- LU publication?
- yes
- id
- f696cdfe-9bd0-48f0-b727-69cb143bae34
- alternative location
- https://umu.diva-portal.org/smash/get/diva2:1930872/FULLTEXT01.pdf
- date added to LUP
- 2025-02-06 10:16:38
- date last changed
- 2025-04-04 14:57:26
@techreport{f696cdfe-9bd0-48f0-b727-69cb143bae34,
abstract = {{This reportis an external evaluation of the scientific basis of the Norwegian assessment system for ecological condition, commissioned by the Ministry of Climate and Environment. Two assessment methods are currently used for various terrestsrial and marine ecosystem: the Panel-Based Assessment of Ecological Condition (PAEC) and the Index-Based Ecological Condition Assessment (IBECA). The purpose of the evaluation is to scrutinise and compare the respective scientific strengths and weaknesses of the two assessment methods, as well as the assessments carried out since 2017, and to evaluate the suitability of the two assessment methods for evidence-based policy-making. The evaluation should cover possible improvements and adjustments to the assessment system regarding methods and scientific design, including opportunities and dilemmas, and "as far as the available information permits" discuss the role of the two assessment methods as basis for decisions in policy and management including any limitations of the knowledge base. All these aims are well covered in the report.<br/><br/>The evaluation panel has consisted of seven international experts, coordinated by the Norwegian Research Council. The panel has evaluated twelve PAEC and IBECA reports including an advisory report setting the framework conditions for the assessment system. Three peer-reviewed articles describining the respective methods have been considiered. Further, the panel has interviewed five experts involved in the assessments and 14 stakeholders to better understand the methods for assessment and the potential use of the assessment results for policy and management.<br/><br/>The evaluation ends with proposing specific recommendations both to the PAEC and IBECA methods and to the Ministry.}},
author = {{Eckerberg, Katarina and Gustafsson, Lena and Moen, Jon and Nightingale, Andrea Joslyn and Roose, Patrick and Sahlin, Ullrika and Węsławski, Jan Martin}},
institution = {{The Research Council of Norway}},
isbn = {{978-82-12-04189-9}},
keywords = {{evaluation; ecological assessment; assessment system; ecological condition}},
language = {{swe}},
title = {{External evaluation of the scientific basis of the assessment system for ecological condition in Norway}},
url = {{https://umu.diva-portal.org/smash/get/diva2:1930872/FULLTEXT01.pdf}},
year = {{2024}},
}