Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Shared Visions: Evaluating Potential in Unsettled Fields

Olofsson, Tobias LU orcid and Gerber, Alison LU orcid (2025) In Minerva
Abstract
Issues of quality, value, and merit are perpetually lively and contentious in scientific and academic work, and research on evaluation panels have shown that organizational constraints and the methods of evaluation used, whether well-motivated or adopted ad hoc, have enormous influence on outcomes. But while previous studies have highlighted the influence exerted by particular methods of evaluation or by social psychological factors, this study shows how in conditions of high uncertainty assessors’ speculative work allows them to project and establish consensus on indicators of quality. Drawing on ethnographic fieldwork with a national science council, we focus especially on the challenges of evaluating speculative genres of academic... (More)
Issues of quality, value, and merit are perpetually lively and contentious in scientific and academic work, and research on evaluation panels have shown that organizational constraints and the methods of evaluation used, whether well-motivated or adopted ad hoc, have enormous influence on outcomes. But while previous studies have highlighted the influence exerted by particular methods of evaluation or by social psychological factors, this study shows how in conditions of high uncertainty assessors’ speculative work allows them to project and establish consensus on indicators of quality. Drawing on ethnographic fieldwork with a national science council, we focus especially on the challenges of evaluating speculative genres of academic writing. We look to evaluations of research proposals in the field of artistic research in order to highlight the ways that evaluators project and establish consensus on indicators of quality in relation to the uncertainties inherent in speculative scientific writing. We show how successful applications outline particular visions of the future, visions that can be accommodated within evaluators’ understanding of the discipline itself well enough that evaluators can suspend disbelief regarding the future outcomes of the proposed research. In doing so, we exploit the emergent and unsettled nature of artistic research as a discipline to highlight the impact of the future in evaluation processes: the function of panelists’ visions of their discipline at its best in the present, and their imaginaries of the discipline of the future. (Less)
Please use this url to cite or link to this publication:
author
and
organization
publishing date
type
Contribution to journal
publication status
published
subject
in
Minerva
publisher
Springer
ISSN
0026-4695
DOI
10.1007/s11024-025-09628-5
language
English
LU publication?
yes
id
46c1f826-7df5-4cdc-9a14-12c991216da6
alternative location
https://link.springer.com/article/10.1007/s11024-025-09628-5
date added to LUP
2026-01-19 17:47:39
date last changed
2026-01-20 10:11:35
@article{46c1f826-7df5-4cdc-9a14-12c991216da6,
  abstract     = {{Issues of quality, value, and merit are perpetually lively and contentious in scientific and academic work, and research on evaluation panels have shown that organizational constraints and the methods of evaluation used, whether well-motivated or adopted ad hoc, have enormous influence on outcomes. But while previous studies have highlighted the influence exerted by particular methods of evaluation or by social psychological factors, this study shows how in conditions of high uncertainty assessors’ speculative work allows them to project and establish consensus on indicators of quality. Drawing on ethnographic fieldwork with a national science council, we focus especially on the challenges of evaluating speculative genres of academic writing. We look to evaluations of research proposals in the field of artistic research in order to highlight the ways that evaluators project and establish consensus on indicators of quality in relation to the uncertainties inherent in speculative scientific writing. We show how successful applications outline particular visions of the future, visions that can be accommodated within evaluators’ understanding of the discipline itself well enough that evaluators can suspend disbelief regarding the future outcomes of the proposed research. In doing so, we exploit the emergent and unsettled nature of artistic research as a discipline to highlight the impact of the future in evaluation processes: the function of panelists’ visions of their discipline at its best in the present, and their imaginaries of the discipline of the future.}},
  author       = {{Olofsson, Tobias and Gerber, Alison}},
  issn         = {{0026-4695}},
  language     = {{eng}},
  month        = {{12}},
  publisher    = {{Springer}},
  series       = {{Minerva}},
  title        = {{Shared Visions: Evaluating Potential in Unsettled Fields}},
  url          = {{http://dx.doi.org/10.1007/s11024-025-09628-5}},
  doi          = {{10.1007/s11024-025-09628-5}},
  year         = {{2025}},
}