Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Experimental context classification: incentives and experience of subjects

Höst, Martin LU ; Wohlin, Claes LU and Thelin, Thomas LU (2005) 27th International Conference on Software Engineering p.470-478
Abstract
There is a need to identify factors that affect the result of empirical studies in software engineering research. It is still the case that seemingly identical replications of controlled experiments result in different conclusions due to the fact that all factors describing the experiment context are not clearly defined and hence controlled. In this article, a scheme for describing the participants of controlled experiments is proposed and evaluated. It consists of two main factors, the incentives for participants in the experiment and the experience of the participants. The scheme has been evaluated by classifying a set of previously conducted experiments from literature. It can be concluded that the scheme was easy to use and understand.... (More)
There is a need to identify factors that affect the result of empirical studies in software engineering research. It is still the case that seemingly identical replications of controlled experiments result in different conclusions due to the fact that all factors describing the experiment context are not clearly defined and hence controlled. In this article, a scheme for describing the participants of controlled experiments is proposed and evaluated. It consists of two main factors, the incentives for participants in the experiment and the experience of the participants. The scheme has been evaluated by classifying a set of previously conducted experiments from literature. It can be concluded that the scheme was easy to use and understand. It is also found that experiments that are classified in the same way to a large extent point at the same results, which indicates that the scheme addresses relevant factors (Less)
Please use this url to cite or link to this publication:
author
; and
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
keywords
software engineering research, controlled experiment participant description, experimental context classification
host publication
27th International Conference on Software Engineering
pages
470 - 478
publisher
IEEE - Institute of Electrical and Electronics Engineers Inc.
conference name
27th International Conference on Software Engineering
conference location
St. Louis, MO, United States
conference dates
2005-05-15 - 2005-05-21
external identifiers
  • wos:000235638200061
  • scopus:27644550871
ISBN
1-59593-963-2
DOI
10.1109/ICSE.2005.1553590
language
English
LU publication?
yes
id
a45dec36-d722-43aa-8ff1-9519af2a262a (old id 616456)
date added to LUP
2016-04-04 10:51:37
date last changed
2022-04-23 23:36:35
@inproceedings{a45dec36-d722-43aa-8ff1-9519af2a262a,
  abstract     = {{There is a need to identify factors that affect the result of empirical studies in software engineering research. It is still the case that seemingly identical replications of controlled experiments result in different conclusions due to the fact that all factors describing the experiment context are not clearly defined and hence controlled. In this article, a scheme for describing the participants of controlled experiments is proposed and evaluated. It consists of two main factors, the incentives for participants in the experiment and the experience of the participants. The scheme has been evaluated by classifying a set of previously conducted experiments from literature. It can be concluded that the scheme was easy to use and understand. It is also found that experiments that are classified in the same way to a large extent point at the same results, which indicates that the scheme addresses relevant factors}},
  author       = {{Höst, Martin and Wohlin, Claes and Thelin, Thomas}},
  booktitle    = {{27th International Conference on Software Engineering}},
  isbn         = {{1-59593-963-2}},
  keywords     = {{software engineering research; controlled experiment participant description; experimental context classification}},
  language     = {{eng}},
  pages        = {{470--478}},
  publisher    = {{IEEE - Institute of Electrical and Electronics Engineers Inc.}},
  title        = {{Experimental context classification: incentives and experience of subjects}},
  url          = {{http://dx.doi.org/10.1109/ICSE.2005.1553590}},
  doi          = {{10.1109/ICSE.2005.1553590}},
  year         = {{2005}},
}