Advanced

Reporting guidelines for controlled experiments in software engineering

Jedlitschka, Andreas and Pfahl, Dietmar LU (2005) 4th International Symposium on Empirical Software Engineering, ISESE 2005, November 17-18 In [Host publication title missing] p.95-104
Abstract
One major problem for integrating study results into a common body of knowledge is the heterogeneity of reporting styles: (1) It is difficult to locate relevant information and (2) important information is often missing. Reporting guidelines are expected to support a systematic, standardized presentation of empirical research, thus improving reporting in order to support readers in (1) finding the information they are looking for, (2) understanding how an experiment is conducted, and (3) assessing the validity of its results. The objective of this paper is to survey the most prominent published proposals for reporting guidelines, and to derive a unified standard that which can serve as a starting point for further discussion. We provide... (More)
One major problem for integrating study results into a common body of knowledge is the heterogeneity of reporting styles: (1) It is difficult to locate relevant information and (2) important information is often missing. Reporting guidelines are expected to support a systematic, standardized presentation of empirical research, thus improving reporting in order to support readers in (1) finding the information they are looking for, (2) understanding how an experiment is conducted, and (3) assessing the validity of its results. The objective of this paper is to survey the most prominent published proposals for reporting guidelines, and to derive a unified standard that which can serve as a starting point for further discussion. We provide detailed guidance on the expected content of the sections and subsections for reporting a specific type of empirical studies, i.e., controlled experiments. Before the guidelines can be evaluated, feedback from the research community is required. For this purpose, we propose to adapt guideline development processes from other disciplines. © 2005 IEEE. (Less)
Please use this url to cite or link to this publication:
author
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
keywords
Guidelines, Guideline development, Standardization, Information analysis, Feedback, Engineering research, Research community, Software engineering
in
[Host publication title missing]
pages
95 - 104
publisher
IEEE--Institute of Electrical and Electronics Engineers Inc.
conference name
4th International Symposium on Empirical Software Engineering, ISESE 2005, November 17-18
external identifiers
  • scopus:33749066130
ISBN
978-0-7803-9508-4
DOI
10.1109/ISESE.2005.1541818
language
English
LU publication?
no
id
28a6508d-ae9a-4047-927e-afea1a299c88 (old id 1669740)
date added to LUP
2010-09-10 10:13:24
date last changed
2017-08-27 05:59:54
@inproceedings{28a6508d-ae9a-4047-927e-afea1a299c88,
  abstract     = {One major problem for integrating study results into a common body of knowledge is the heterogeneity of reporting styles: (1) It is difficult to locate relevant information and (2) important information is often missing. Reporting guidelines are expected to support a systematic, standardized presentation of empirical research, thus improving reporting in order to support readers in (1) finding the information they are looking for, (2) understanding how an experiment is conducted, and (3) assessing the validity of its results. The objective of this paper is to survey the most prominent published proposals for reporting guidelines, and to derive a unified standard that which can serve as a starting point for further discussion. We provide detailed guidance on the expected content of the sections and subsections for reporting a specific type of empirical studies, i.e., controlled experiments. Before the guidelines can be evaluated, feedback from the research community is required. For this purpose, we propose to adapt guideline development processes from other disciplines. © 2005 IEEE.},
  author       = {Jedlitschka, Andreas and Pfahl, Dietmar},
  booktitle    = {[Host publication title missing]},
  isbn         = {978-0-7803-9508-4},
  keyword      = {Guidelines,Guideline development,Standardization,Information analysis,Feedback,Engineering research,Research community,Software engineering},
  language     = {eng},
  pages        = {95--104},
  publisher    = {IEEE--Institute of Electrical and Electronics Engineers Inc.},
  title        = {Reporting guidelines for controlled experiments in software engineering},
  url          = {http://dx.doi.org/10.1109/ISESE.2005.1541818},
  year         = {2005},
}