Advanced

Evaluating the practical use of different measurement scales in requirements prioritisation

Karlsson, Lena LU ; Höst, Martin LU and Regnell, Björn LU (2006) International Symposium on Empirical Software Engineering In Proceedings of the 2006 ACM/IEEE international symposium on International symposium on empirical software engineering 2006. p.326-335
Abstract
The importance of prioritising requirements is widely recognised. A number of different techniques for prioritising requirements have been proposed, some based on an ordinal scale, others on a ratio scale. Some measurement scales provide more information than others, i.e. the ratio scale is richer than the ordinal scale. This paper aims to investigate the differences between the scales used in prioritisation. This is important since techniques using a richer scale tend to be more time-consuming and complex to use. Thus, there is a trade-off between simple techniques only providing ranks and complex techniques providing information about the relative distance between requirements priorities. The paper suggests an approach to measure the... (More)
The importance of prioritising requirements is widely recognised. A number of different techniques for prioritising requirements have been proposed, some based on an ordinal scale, others on a ratio scale. Some measurement scales provide more information than others, i.e. the ratio scale is richer than the ordinal scale. This paper aims to investigate the differences between the scales used in prioritisation. This is important since techniques using a richer scale tend to be more time-consuming and complex to use. Thus, there is a trade-off between simple techniques only providing ranks and complex techniques providing information about the relative distance between requirements priorities. The paper suggests an approach to measure the skewness of the ratio distribution and a way to use the cost-value approach on ordinal scale data. Four different empirical data sets were used to verify the suggested approaches. The skewness measure seems feasible to determine in which cases the ratio scale is valuable. It indicates that some of our subjects tend to use the extreme values of the scale while others are more modest. The cost-value approach based on ordinal scale data also seems feasible. The requirements selection decisions based on ordinal scale data agree substantially with the decisions based on ratio scale data. Copyright 2006 ACM. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
keywords
Ratio scale data, Cost value approaches, Measurement scales, Ordinal scale data
in
Proceedings of the 2006 ACM/IEEE international symposium on International symposium on empirical software engineering
volume
2006
pages
326 - 335
publisher
ACM
conference name
International Symposium on Empirical Software Engineering
external identifiers
  • Scopus:34247326975
DOI
10.1145/1159733.1159782
language
English
LU publication?
yes
id
1cf0117c-3d67-4c4a-88e9-3c4664f6c17a (old id 616913)
date added to LUP
2007-11-24 11:22:08
date last changed
2016-10-13 04:44:59
@misc{1cf0117c-3d67-4c4a-88e9-3c4664f6c17a,
  abstract     = {The importance of prioritising requirements is widely recognised. A number of different techniques for prioritising requirements have been proposed, some based on an ordinal scale, others on a ratio scale. Some measurement scales provide more information than others, i.e. the ratio scale is richer than the ordinal scale. This paper aims to investigate the differences between the scales used in prioritisation. This is important since techniques using a richer scale tend to be more time-consuming and complex to use. Thus, there is a trade-off between simple techniques only providing ranks and complex techniques providing information about the relative distance between requirements priorities. The paper suggests an approach to measure the skewness of the ratio distribution and a way to use the cost-value approach on ordinal scale data. Four different empirical data sets were used to verify the suggested approaches. The skewness measure seems feasible to determine in which cases the ratio scale is valuable. It indicates that some of our subjects tend to use the extreme values of the scale while others are more modest. The cost-value approach based on ordinal scale data also seems feasible. The requirements selection decisions based on ordinal scale data agree substantially with the decisions based on ratio scale data. Copyright 2006 ACM.},
  author       = {Karlsson, Lena and Höst, Martin and Regnell, Björn},
  keyword      = {Ratio scale data,Cost value approaches,Measurement scales,Ordinal scale data},
  language     = {eng},
  pages        = {326--335},
  publisher    = {ARRAY(0x7e16be8)},
  series       = {Proceedings of the 2006 ACM/IEEE international symposium on International symposium on empirical software engineering},
  title        = {Evaluating the practical use of different measurement scales in requirements prioritisation},
  url          = {http://dx.doi.org/10.1145/1159733.1159782},
  volume       = {2006},
  year         = {2006},
}