Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Evaluating Transformation - what can we learn from the literature?

Wise, Emily LU and Arnold, Erik (2022) 2022.
Abstract
The last decade’s rise of the so-called “third frame” (or third generation) of Transformative Innovation Policies (TIP) has shifted focus of research and innovation investments from economic growth and competitiveness to also tackling societal challenges and generating broader environmental and societal impact. The evolution in rationale and aims for policy action also implies a need to adapt and evolve evaluative strategies and practices. As policymakers begin to develop new transformative innovation programmes, a key question arises as to how monitoring, evaluation and learning practices (currently framed around 1st and 2nd generation innovation policies) can be adapted in order to meet 3rd generation innovation policy needs? In shaping... (More)
The last decade’s rise of the so-called “third frame” (or third generation) of Transformative Innovation Policies (TIP) has shifted focus of research and innovation investments from economic growth and competitiveness to also tackling societal challenges and generating broader environmental and societal impact. The evolution in rationale and aims for policy action also implies a need to adapt and evolve evaluative strategies and practices. As policymakers begin to develop new transformative innovation programmes, a key question arises as to how monitoring, evaluation and learning practices (currently framed around 1st and 2nd generation innovation policies) can be adapted in order to meet 3rd generation innovation policy needs? In shaping a response, one can learn from both theory and practice. This brief (produced within the GReaTr initiative ) aims to provide a synthesis of what recent academic research tells us about evaluating transformation, leveraging a set of 11 seminal articles (and other complementary literature) to answer four questions: For whom and why? What to evaluate? How to evaluate? What unit of analysis? The synthesis points to a relative consensus in the academic literature on the main purposes and uses, the recommended principles and approaches, as well as possibilities for delineating and dealing with multiple scopes and units of analysis in evaluating transformation – yet highlights different conceptual framings of system change. The summary provides inputs to planning an evaluative strategy for TIP and highlights the need to consider new questions related to approaches to reporting across funding agencies, and more active roles for funding and policymaking agencies in dialogues about strategic direction and prioritisation of investments. (Less)
Abstract (Swedish)
The last decade’s rise of the so-called “third frame” (or third generation) of Transformative Innovation Policies (TIP) has shifted focus of research and innovation investments from economic growth and competitiveness to also tackling societal challenges and generating broader environmental and societal impact. The evolution in rationale and aims for policy action also implies a need to adapt and evolve evaluative strategies and practices. As policymakers begin to develop new transformative innovation programmes, a key question arises as to how monitoring, evaluation and learning practices (currently framed around 1st and 2nd generation innovation policies) can be adapted in order to meet 3rd generation innovation policy needs? In shaping... (More)
The last decade’s rise of the so-called “third frame” (or third generation) of Transformative Innovation Policies (TIP) has shifted focus of research and innovation investments from economic growth and competitiveness to also tackling societal challenges and generating broader environmental and societal impact. The evolution in rationale and aims for policy action also implies a need to adapt and evolve evaluative strategies and practices. As policymakers begin to develop new transformative innovation programmes, a key question arises as to how monitoring, evaluation and learning practices (currently framed around 1st and 2nd generation innovation policies) can be adapted in order to meet 3rd generation innovation policy needs? In shaping a response, one can learn from both theory and practice. This brief (produced within the GReaTr initiative ) aims to provide a synthesis of what recent academic research tells us about evaluating transformation, leveraging a set of 11 seminal articles (and other complementary literature) to answer four questions: For whom and why? What to evaluate? How to evaluate? What unit of analysis? The synthesis points to a relative consensus in the academic literature on the main purposes and uses, the recommended principles and approaches, as well as possibilities for delineating and dealing with multiple scopes and units of analysis in evaluating transformation – yet highlights different conceptual framings of system change. The summary provides inputs to planning an evaluative strategy for TIP and highlights the need to consider new questions related to approaches to reporting across funding agencies, and more active roles for funding and policymaking agencies in dialogues about strategic direction and prioritisation of investments. (Less)
Please use this url to cite or link to this publication:
author
and
organization
publishing date
type
Working paper/Preprint
publication status
published
subject
volume
2022
edition
10
pages
26 pages
publisher
Papers in Innovation Studies, Lund University, CIRCLE - Centre for Innovation Research
language
English
LU publication?
yes
id
2be241d5-1072-4847-816f-129a88b3fc18
alternative location
https://swopec.hhs.se/lucirc/abs/lucirc2022_010.htm
date added to LUP
2022-10-05 12:42:41
date last changed
2023-04-27 14:46:12
@misc{2be241d5-1072-4847-816f-129a88b3fc18,
  abstract     = {{The last decade’s rise of the so-called “third frame” (or third generation) of Transformative Innovation Policies (TIP) has shifted focus of research and innovation investments from economic growth and competitiveness to also tackling societal challenges and generating broader environmental and societal impact. The evolution in rationale and aims for policy action also implies a need to adapt and evolve evaluative strategies and practices. As policymakers begin to develop new transformative innovation programmes, a key question arises as to how monitoring, evaluation and learning practices (currently framed around 1st and 2nd generation innovation policies) can be adapted in order to meet 3rd generation innovation policy needs? In shaping a response, one can learn from both theory and practice. This brief (produced within the GReaTr initiative ) aims to provide a synthesis of what recent academic research tells us about evaluating transformation, leveraging a set of 11 seminal articles (and other complementary literature) to answer four questions: For whom and why? What to evaluate? How to evaluate? What unit of analysis? The synthesis points to a relative consensus in the academic literature on the main purposes and uses, the recommended principles and approaches, as well as possibilities for delineating and dealing with multiple scopes and units of analysis in evaluating transformation – yet highlights different conceptual framings of system change. The summary provides inputs to planning an evaluative strategy for TIP and highlights the need to consider new questions related to approaches to reporting across funding agencies, and more active roles for funding and policymaking agencies in dialogues about strategic direction and prioritisation of investments.}},
  author       = {{Wise, Emily and Arnold, Erik}},
  language     = {{eng}},
  note         = {{Working Paper}},
  publisher    = {{Papers in Innovation Studies, Lund University, CIRCLE - Centre for Innovation Research}},
  title        = {{Evaluating Transformation - what can we learn from the literature?}},
  url          = {{https://swopec.hhs.se/lucirc/abs/lucirc2022_010.htm}},
  volume       = {{2022}},
  year         = {{2022}},
}