Advanced

An experimental evaluation of inspection and testing for detection of design faults

Andersson, Carina LU ; Thelin, Thomas LU ; Runeson, Per LU and Dzamashvili, N (2003) Proceedings 2003 International Symposium on Empirical Software Engineering. ISESE 2003 In Proceedings 2003 International Symposium on Empirical Software Engineering. ISESE 2003 p.174-184
Abstract
The two most common strategies for verification and validation, inspection and testing, are in a controlled experiment evaluated in terms of their fault detection capabilities. These two techniques are in the previous work compared applied to code. In order to compare the efficiency and effectiveness of these techniques on a higher abstraction level than code, this experiment investigates inspection of design documents and testing of the corresponding program, to detect faults originating from the design document. Usage-based reading (UBR) and usage-based testing (UBT) were chosen for inspections and testing, respectively. These techniques provide similar aid to the reviewers as to the testers. The purpose of both fault detection... (More)
The two most common strategies for verification and validation, inspection and testing, are in a controlled experiment evaluated in terms of their fault detection capabilities. These two techniques are in the previous work compared applied to code. In order to compare the efficiency and effectiveness of these techniques on a higher abstraction level than code, this experiment investigates inspection of design documents and testing of the corresponding program, to detect faults originating from the design document. Usage-based reading (UBR) and usage-based testing (UBT) were chosen for inspections and testing, respectively. These techniques provide similar aid to the reviewers as to the testers. The purpose of both fault detection techniques is to focus the inspection and testing from a user's viewpoint. The experiment was conducted with 51 Master's students in a two-factor blocked design; each student applied each technique once, each application on different versions of the same program. The two versions contained different sets of faults, including 13 and 14 faults, respectively. The general results from this study show that when the two groups of subjects are combined, the efficiency and effectiveness are significantly higher for usage-based reading and that testing tends to require more learning. Rework is not taken into account, thus the experiment indicates strong support for design inspection over testing (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
keywords
user viewpoint, abstraction level, fault detection, controlled experiment, validation, verification, inspection, experimental evaluation, usage-based testing, code, usage-based reading, design document
in
Proceedings 2003 International Symposium on Empirical Software Engineering. ISESE 2003
pages
174 - 184
publisher
IEEE--Institute of Electrical and Electronics Engineers Inc.
conference name
Proceedings 2003 International Symposium on Empirical Software Engineering. ISESE 2003
external identifiers
  • WOS:000186331600018
  • Scopus:84944323902
ISBN
0-7695-2002-2
DOI
10.1109/ISESE.2003.1237976
language
English
LU publication?
yes
id
9f751155-96d2-4bab-a61f-8bc1d196b4a9 (old id 612441)
date added to LUP
2007-11-28 09:08:56
date last changed
2016-10-13 04:46:31
@misc{9f751155-96d2-4bab-a61f-8bc1d196b4a9,
  abstract     = {The two most common strategies for verification and validation, inspection and testing, are in a controlled experiment evaluated in terms of their fault detection capabilities. These two techniques are in the previous work compared applied to code. In order to compare the efficiency and effectiveness of these techniques on a higher abstraction level than code, this experiment investigates inspection of design documents and testing of the corresponding program, to detect faults originating from the design document. Usage-based reading (UBR) and usage-based testing (UBT) were chosen for inspections and testing, respectively. These techniques provide similar aid to the reviewers as to the testers. The purpose of both fault detection techniques is to focus the inspection and testing from a user's viewpoint. The experiment was conducted with 51 Master's students in a two-factor blocked design; each student applied each technique once, each application on different versions of the same program. The two versions contained different sets of faults, including 13 and 14 faults, respectively. The general results from this study show that when the two groups of subjects are combined, the efficiency and effectiveness are significantly higher for usage-based reading and that testing tends to require more learning. Rework is not taken into account, thus the experiment indicates strong support for design inspection over testing},
  author       = {Andersson, Carina and Thelin, Thomas and Runeson, Per and Dzamashvili, N},
  isbn         = {0-7695-2002-2},
  keyword      = {user viewpoint,abstraction level,fault detection,controlled experiment,validation,verification,inspection,experimental evaluation,usage-based testing,code,usage-based reading,design document},
  language     = {eng},
  pages        = {174--184},
  publisher    = {ARRAY(0xb0bbdd8)},
  series       = {Proceedings 2003 International Symposium on Empirical Software Engineering. ISESE 2003},
  title        = {An experimental evaluation of inspection and testing for detection of design faults},
  url          = {http://dx.doi.org/10.1109/ISESE.2003.1237976},
  year         = {2003},
}