Advanced

How expensive is Big Science? Consequences of using simple publication counts in performance assessment of large scientific facilities

Hallonsten, Olof LU (2014) In Scientometrics 100(2). p.483-496
Abstract
Although the nuclear era and the Cold War superpower competition have long since passed, governments are still investing in Big Science, although these large facilities are nowadays mostly geared towards areas of use closer to utility. Investments in Big Science are also motivated not only by promises of scientific breakthroughs but also by expectations (and demands) of measurable impact, and with an emerging global market of competing user-oriented Big Science facilities, quantitative measures of productivity and quality have become mainstream. Among these are rather simple and one-sided publication counts. This article uses publication counts and figures of expenditure for three cases that are disparate but all represent the... (More)
Although the nuclear era and the Cold War superpower competition have long since passed, governments are still investing in Big Science, although these large facilities are nowadays mostly geared towards areas of use closer to utility. Investments in Big Science are also motivated not only by promises of scientific breakthroughs but also by expectations (and demands) of measurable impact, and with an emerging global market of competing user-oriented Big Science facilities, quantitative measures of productivity and quality have become mainstream. Among these are rather simple and one-sided publication counts. This article uses publication counts and figures of expenditure for three cases that are disparate but all represent the state-of-the-art of Big Science of their times, discussing at depth the problems of using simple publication counts as a measure of performance in science. Showing, quite trivially, that Big Science is very expensive, the article also shows the absurd consequences of consistently using simple publication counts to display productivity and quality of Big Science, and concludes that such measures should be deemed irrelevant for analyses on the level of organizations in science and replaced by qualitative assessment of the content of the science produced. (Less)
Please use this url to cite or link to this publication:
author
publishing date
type
Contribution to journal
publication status
published
subject
in
Scientometrics
volume
100
issue
2
pages
483 - 496
publisher
Akademiai Kiado
external identifiers
  • scopus:84904153051
ISSN
1588-2861
DOI
10.1007/s11192-014-1249-z
language
English
LU publication?
no
id
ce8a3e01-6b15-484b-be8e-02d6d568f0f5 (old id 4610429)
date added to LUP
2014-08-26 11:55:00
date last changed
2017-05-28 03:16:46
@article{ce8a3e01-6b15-484b-be8e-02d6d568f0f5,
  abstract     = {Although the nuclear era and the Cold War superpower competition have long since passed, governments are still investing in Big Science, although these large facilities are nowadays mostly geared towards areas of use closer to utility. Investments in Big Science are also motivated not only by promises of scientific breakthroughs but also by expectations (and demands) of measurable impact, and with an emerging global market of competing user-oriented Big Science facilities, quantitative measures of productivity and quality have become mainstream. Among these are rather simple and one-sided publication counts. This article uses publication counts and figures of expenditure for three cases that are disparate but all represent the state-of-the-art of Big Science of their times, discussing at depth the problems of using simple publication counts as a measure of performance in science. Showing, quite trivially, that Big Science is very expensive, the article also shows the absurd consequences of consistently using simple publication counts to display productivity and quality of Big Science, and concludes that such measures should be deemed irrelevant for analyses on the level of organizations in science and replaced by qualitative assessment of the content of the science produced.},
  author       = {Hallonsten, Olof},
  issn         = {1588-2861},
  language     = {eng},
  number       = {2},
  pages        = {483--496},
  publisher    = {Akademiai Kiado},
  series       = {Scientometrics},
  title        = {How expensive is Big Science? Consequences of using simple publication counts in performance assessment of large scientific facilities},
  url          = {http://dx.doi.org/10.1007/s11192-014-1249-z},
  volume       = {100},
  year         = {2014},
}