Experimental context classification: incentives and experience of subjects
(2005) 27th International Conference on Software Engineering p.470-478- Abstract
- There is a need to identify factors that affect the result of empirical studies in software engineering research. It is still the case that seemingly identical replications of controlled experiments result in different conclusions due to the fact that all factors describing the experiment context are not clearly defined and hence controlled. In this article, a scheme for describing the participants of controlled experiments is proposed and evaluated. It consists of two main factors, the incentives for participants in the experiment and the experience of the participants. The scheme has been evaluated by classifying a set of previously conducted experiments from literature. It can be concluded that the scheme was easy to use and understand.... (More)
- There is a need to identify factors that affect the result of empirical studies in software engineering research. It is still the case that seemingly identical replications of controlled experiments result in different conclusions due to the fact that all factors describing the experiment context are not clearly defined and hence controlled. In this article, a scheme for describing the participants of controlled experiments is proposed and evaluated. It consists of two main factors, the incentives for participants in the experiment and the experience of the participants. The scheme has been evaluated by classifying a set of previously conducted experiments from literature. It can be concluded that the scheme was easy to use and understand. It is also found that experiments that are classified in the same way to a large extent point at the same results, which indicates that the scheme addresses relevant factors (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/616456
- author
- Höst, Martin LU ; Wohlin, Claes LU and Thelin, Thomas LU
- organization
- publishing date
- 2005
- type
- Chapter in Book/Report/Conference proceeding
- publication status
- published
- subject
- keywords
- software engineering research, controlled experiment participant description, experimental context classification
- host publication
- 27th International Conference on Software Engineering
- pages
- 470 - 478
- publisher
- IEEE - Institute of Electrical and Electronics Engineers Inc.
- conference name
- 27th International Conference on Software Engineering
- conference location
- St. Louis, MO, United States
- conference dates
- 2005-05-15 - 2005-05-21
- external identifiers
-
- wos:000235638200061
- scopus:27644550871
- ISBN
- 1-59593-963-2
- DOI
- 10.1109/ICSE.2005.1553590
- language
- English
- LU publication?
- yes
- id
- a45dec36-d722-43aa-8ff1-9519af2a262a (old id 616456)
- date added to LUP
- 2016-04-04 10:51:37
- date last changed
- 2022-04-23 23:36:35
@inproceedings{a45dec36-d722-43aa-8ff1-9519af2a262a, abstract = {{There is a need to identify factors that affect the result of empirical studies in software engineering research. It is still the case that seemingly identical replications of controlled experiments result in different conclusions due to the fact that all factors describing the experiment context are not clearly defined and hence controlled. In this article, a scheme for describing the participants of controlled experiments is proposed and evaluated. It consists of two main factors, the incentives for participants in the experiment and the experience of the participants. The scheme has been evaluated by classifying a set of previously conducted experiments from literature. It can be concluded that the scheme was easy to use and understand. It is also found that experiments that are classified in the same way to a large extent point at the same results, which indicates that the scheme addresses relevant factors}}, author = {{Höst, Martin and Wohlin, Claes and Thelin, Thomas}}, booktitle = {{27th International Conference on Software Engineering}}, isbn = {{1-59593-963-2}}, keywords = {{software engineering research; controlled experiment participant description; experimental context classification}}, language = {{eng}}, pages = {{470--478}}, publisher = {{IEEE - Institute of Electrical and Electronics Engineers Inc.}}, title = {{Experimental context classification: incentives and experience of subjects}}, url = {{http://dx.doi.org/10.1109/ICSE.2005.1553590}}, doi = {{10.1109/ICSE.2005.1553590}}, year = {{2005}}, }