Advanced

Survey reproduction of defect reporting in industrial software development

Eero, Laukkanen and Mäntylä, Mika LU (2011) Empirical Software Engineering and Measurement (ESEM), 2011 International Symposium on In International Symposium on Empirical Software Engineering and Measurement p.197-206
Abstract (Swedish)
Abstract in Undetermined

Context: Defect reporting is an important part of software development in-vivo, but previous work from open source context suggests that defect reports often have insufficient information for defect fixing. Objective: Our goal was to reproduce and partially replicate one of those open source studies in industrial context to see how well the results could be generalized. Method: We surveyed developers from six industrial software development organizations about the defect report information, from three viewpoints: concerning quality, usefulness and automation possibilities of the information. Seventy-four developers out of 142 completed our survey. Results: Our reproduction confirms the results of... (More)
Abstract in Undetermined

Context: Defect reporting is an important part of software development in-vivo, but previous work from open source context suggests that defect reports often have insufficient information for defect fixing. Objective: Our goal was to reproduce and partially replicate one of those open source studies in industrial context to see how well the results could be generalized. Method: We surveyed developers from six industrial software development organizations about the defect report information, from three viewpoints: concerning quality, usefulness and automation possibilities of the information. Seventy-four developers out of 142 completed our survey. Results: Our reproduction confirms the results of the prior study in that "steps to reproduce" and "observed behaviour" are highly important defect information. Our results extend the results of the prior study as we found that "part of the application", "configuration of the application", and "operating data" are also highly important, but they were not surveyed in the prior study. Finally, we classified defect information as "critical problems", "solutions", "boosters", and "essentials" based on the survey answers. Conclusion: The quality of defect reports is a problem in the software industry as well as in the open source community. Thus, we suggest that a part of the defect reporting should be automated since many of the defect reporters lack technical knowledge or interest to produce high-quality defect reports. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
keywords
Companies, Context, Hardware, Programming, Software, Software engineering, Testing, software debugging, software maintenance, software quality
in
International Symposium on Empirical Software Engineering and Measurement
pages
10 pages
publisher
IEEE--Institute of Electrical and Electronics Engineers Inc.
conference name
Empirical Software Engineering and Measurement (ESEM), 2011 International Symposium on
external identifiers
  • scopus:84858725905
ISSN
1938-6451
1949-3789
ISBN
978-1-4577-2203-5
DOI
10.1109/ESEM.2011.28
language
English
LU publication?
no
id
3310ddc9-c58f-4341-875a-aa5b8d83301e (old id 2225547)
date added to LUP
2011-12-15 14:15:46
date last changed
2017-10-22 03:14:51
@inproceedings{3310ddc9-c58f-4341-875a-aa5b8d83301e,
  abstract     = {<b>Abstract in Undetermined</b><br/><br>
Context: Defect reporting is an important part of software development in-vivo, but previous work from open source context suggests that defect reports often have insufficient information for defect fixing. Objective: Our goal was to reproduce and partially replicate one of those open source studies in industrial context to see how well the results could be generalized. Method: We surveyed developers from six industrial software development organizations about the defect report information, from three viewpoints: concerning quality, usefulness and automation possibilities of the information. Seventy-four developers out of 142 completed our survey. Results: Our reproduction confirms the results of the prior study in that "steps to reproduce" and "observed behaviour" are highly important defect information. Our results extend the results of the prior study as we found that "part of the application", "configuration of the application", and "operating data" are also highly important, but they were not surveyed in the prior study. Finally, we classified defect information as "critical problems", "solutions", "boosters", and "essentials" based on the survey answers. Conclusion: The quality of defect reports is a problem in the software industry as well as in the open source community. Thus, we suggest that a part of the defect reporting should be automated since many of the defect reporters lack technical knowledge or interest to produce high-quality defect reports.},
  author       = {Eero, Laukkanen and Mäntylä, Mika},
  booktitle    = {International Symposium on Empirical Software Engineering and Measurement},
  isbn         = {978-1-4577-2203-5},
  issn         = {1938-6451},
  keyword      = {Companies,Context,Hardware,Programming,Software,Software engineering,Testing,software debugging,software maintenance,software quality},
  language     = {eng},
  pages        = {197--206},
  publisher    = {IEEE--Institute of Electrical and Electronics Engineers Inc.},
  title        = {Survey reproduction of defect reporting in industrial software development},
  url          = {http://dx.doi.org/10.1109/ESEM.2011.28},
  year         = {2011},
}