Towards a framework to support large scale sampling in software engineering surveys
De Mello, Rafael Maiani ; Da Silva, Pedro Correa ; Runeson, Per LU
and Travassos, Guilherme Horta
(2014)
8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2014
- Abstract
Context: The low quality and small size of samples in empirical studies in software engineering hamper the interpretation and generalization of their results. Therefore, enlarging sample sizes and improving their quality represent an important research challenge. Goal: We aim to define a conceptual framework, including requirements for establishing adequate sources for sampling subjects in software engineering surveys. Method: We use previous experience on applying systematic sampling strategies combined with contemporary web technologies in previously executed surveys, to organize the conceptual framework. We analyze its application to different sources of sampling. Results: The framework was observed to be feasible after its... (More)
Context: The low quality and small size of samples in empirical studies in software engineering hamper the interpretation and generalization of their results. Therefore, enlarging sample sizes and improving their quality represent an important research challenge. Goal: We aim to define a conceptual framework, including requirements for establishing adequate sources for sampling subjects in software engineering surveys. Method: We use previous experience on applying systematic sampling strategies combined with contemporary web technologies in previously executed surveys, to organize the conceptual framework. We analyze its application to different sources of sampling. Results: The framework was observed to be feasible after its application to nine different large-scale sources of sampling. Conclusions: The analyzed crowdsourcing tools do not support essential requirements to be considered sources of sampling, while free-lancing tools and professional social network do.
(Less)
- author
- De Mello, Rafael Maiani
; Da Silva, Pedro Correa
; Runeson, Per
LU
and Travassos, Guilherme Horta
- organization
- publishing date
- 2014-09-18
- type
- Chapter in Book/Report/Conference proceeding
- publication status
- published
- subject
- keywords
- experimental software engineering, population, quantitative studies, sampling, sampling frame, survey
- host publication
- 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement
- article number
- a48
- publisher
- Association for Computing Machinery (ACM)
- conference name
- 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2014
- conference location
- Torino, Italy
- conference dates
- 2014-09-18 - 2014-09-19
- external identifiers
-
- scopus:84907819168
- ISBN
- 9781450327749
- DOI
- 10.1145/2652524.2652567
- language
- English
- LU publication?
- yes
- additional info
- Publisher Copyright: © 2014 ACM.
- id
- c9bac308-304a-4b43-8848-88e9115eb104
- date added to LUP
- 2022-10-17 07:56:55
- date last changed
- 2022-10-19 11:55:58
@inproceedings{c9bac308-304a-4b43-8848-88e9115eb104,
abstract = {{<p>Context: The low quality and small size of samples in empirical studies in software engineering hamper the interpretation and generalization of their results. Therefore, enlarging sample sizes and improving their quality represent an important research challenge. Goal: We aim to define a conceptual framework, including requirements for establishing adequate sources for sampling subjects in software engineering surveys. Method: We use previous experience on applying systematic sampling strategies combined with contemporary web technologies in previously executed surveys, to organize the conceptual framework. We analyze its application to different sources of sampling. Results: The framework was observed to be feasible after its application to nine different large-scale sources of sampling. Conclusions: The analyzed crowdsourcing tools do not support essential requirements to be considered sources of sampling, while free-lancing tools and professional social network do.</p>}},
author = {{De Mello, Rafael Maiani and Da Silva, Pedro Correa and Runeson, Per and Travassos, Guilherme Horta}},
booktitle = {{8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement}},
isbn = {{9781450327749}},
keywords = {{experimental software engineering; population; quantitative studies; sampling; sampling frame; survey}},
language = {{eng}},
month = {{09}},
publisher = {{Association for Computing Machinery (ACM)}},
title = {{Towards a framework to support large scale sampling in software engineering surveys}},
url = {{http://dx.doi.org/10.1145/2652524.2652567}},
doi = {{10.1145/2652524.2652567}},
year = {{2014}},
}