Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Who tested my software? Testing as an organizationally cross-cutting Activity

Mäntylä, Mika LU ; Itkonen, Juha and Iivonen, Joonas (2012) In Software Quality Journal 20(1). p.145-172
Abstract
Abstract in Undetermined
There is a recognized disconnect between testing research and industry practice, and more studies are needed on understanding how testing is conducted in real-world circumstances instead of demonstrating the superiority of specific methods. Recent literature indicates that testing is a cross-cutting activity that involves various organizational roles rather than the sole involvement of specialized testers. This research empirically investigates how testing involves employees in varying organizational roles in software product companies. We studied the organization and values of testing using an exploratory case study methodology through interviews, defect database analysis, workshops, analyses of documentation,... (More)
Abstract in Undetermined
There is a recognized disconnect between testing research and industry practice, and more studies are needed on understanding how testing is conducted in real-world circumstances instead of demonstrating the superiority of specific methods. Recent literature indicates that testing is a cross-cutting activity that involves various organizational roles rather than the sole involvement of specialized testers. This research empirically investigates how testing involves employees in varying organizational roles in software product companies. We studied the organization and values of testing using an exploratory case study methodology through interviews, defect database analysis, workshops, analyses of documentation, and informal communications at three software product companies. We analyzed which employee groups test software in the case companies, and how many defects they find. Two companies organized testing as a team effort, and one company had a specialized testing group because of its different development model. We found evidence that testing was not an action conducted only by testing specialists. Testing by individuals with customer contact and domain expertise was an important validation method. We discovered that defects found by developers had the highest fix rates while those revealed by specialized testers had the lowest. The defect importance was susceptible to organizational competition of resources (i.e., overvaluing defects of reporter’s own products or projects). We conclude that it is important to understand the diversity of individuals participating in software testing and the relevance of validation from the end users’ viewpoint. Future research is required to evaluate testing approaches for diverse organizational roles. Finally, to improve defect information, we suggest increasing automation in defect data collection. (Less)
Please use this url to cite or link to this publication:
author
; and
organization
publishing date
type
Contribution to journal
publication status
published
subject
in
Software Quality Journal
volume
20
issue
1
pages
145 - 172
publisher
Springer
external identifiers
  • scopus:84855358438
ISSN
0963-9314
DOI
10.1007/s11219-011-9157-4
language
English
LU publication?
no
id
95c5e42f-09b6-4baf-9e1a-daf96e316c32 (old id 2225616)
date added to LUP
2016-04-04 09:43:59
date last changed
2022-02-28 17:22:02
@article{95c5e42f-09b6-4baf-9e1a-daf96e316c32,
  abstract     = {{Abstract in Undetermined<br/>There is a recognized disconnect between testing research and industry practice, and more studies are needed on understanding how testing is conducted in real-world circumstances instead of demonstrating the superiority of specific methods. Recent literature indicates that testing is a cross-cutting activity that involves various organizational roles rather than the sole involvement of specialized testers. This research empirically investigates how testing involves employees in varying organizational roles in software product companies. We studied the organization and values of testing using an exploratory case study methodology through interviews, defect database analysis, workshops, analyses of documentation, and informal communications at three software product companies. We analyzed which employee groups test software in the case companies, and how many defects they find. Two companies organized testing as a team effort, and one company had a specialized testing group because of its different development model. We found evidence that testing was not an action conducted only by testing specialists. Testing by individuals with customer contact and domain expertise was an important validation method. We discovered that defects found by developers had the highest fix rates while those revealed by specialized testers had the lowest. The defect importance was susceptible to organizational competition of resources (i.e., overvaluing defects of reporter’s own products or projects). We conclude that it is important to understand the diversity of individuals participating in software testing and the relevance of validation from the end users’ viewpoint. Future research is required to evaluate testing approaches for diverse organizational roles. Finally, to improve defect information, we suggest increasing automation in defect data collection.}},
  author       = {{Mäntylä, Mika and Itkonen, Juha and Iivonen, Joonas}},
  issn         = {{0963-9314}},
  language     = {{eng}},
  number       = {{1}},
  pages        = {{145--172}},
  publisher    = {{Springer}},
  series       = {{Software Quality Journal}},
  title        = {{Who tested my software? Testing as an organizationally cross-cutting Activity}},
  url          = {{http://dx.doi.org/10.1007/s11219-011-9157-4}},
  doi          = {{10.1007/s11219-011-9157-4}},
  volume       = {{20}},
  year         = {{2012}},
}