Advanced

Evaluation of a Perspective Based Review Method Applied in an Industrial Setting

Berling, Tomas LU and Runeson, Per LU (2003) In IEE proceedings Software 150(3). p.177-184
Abstract
Inspections are an important means for developing high quality software. The effects of using a perspective based review method with a testing perspective (PBRM(T)) on requirements specifications have been evaluated in an industrial project. PBRM(T) was employed and compared to the normal checklist-based review method (CBRM) which was used earlier in the project. The effects studied were 1) the effectiveness 2) the efficiency and 3) the number of system faults related to requirements specifications knowledge. Inspection data from CBRM and PBRM(T) were analyzed and compared. Problem report data were also analyzed and a small survey was used for evaluation of the two methods. PBRM(T) showed an effectiveness of 0.3 faults found per... (More)
Inspections are an important means for developing high quality software. The effects of using a perspective based review method with a testing perspective (PBRM(T)) on requirements specifications have been evaluated in an industrial project. PBRM(T) was employed and compared to the normal checklist-based review method (CBRM) which was used earlier in the project. The effects studied were 1) the effectiveness 2) the efficiency and 3) the number of system faults related to requirements specifications knowledge. Inspection data from CBRM and PBRM(T) were analyzed and compared. Problem report data were also analyzed and a small survey was used for evaluation of the two methods. PBRM(T) showed an effectiveness of 0.3 faults found per requirement compared with 0.05 with CBRM or 2.4 faults found per page compared with 0.5 with CBRM in this study. The efficiency with PBRM(T) was 1.9 faults found per hour compared with 1.2 with CBRM. The engineers expressed that they had gained a greater increase in system knowledge when having used PBRM(T) compared with CBRM. However, it is not possible in this case study to judge the causality of the effect.

This case study indicates that the use of an active review method, such as PBRM(T), yields both a higher effectiveness and efficiency compared with a passive method, such as CBRM, when reviewing requirements specifications. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Contribution to journal
publication status
published
subject
in
IEE proceedings Software
volume
150
issue
3
pages
177 - 184
publisher
IEE
external identifiers
  • scopus:0038721370
language
English
LU publication?
yes
id
1cd11bb8-6d16-4421-998a-8b5568a29993 (old id 708296)
date added to LUP
2007-12-10 10:23:54
date last changed
2017-01-01 08:10:25
@article{1cd11bb8-6d16-4421-998a-8b5568a29993,
  abstract     = {Inspections are an important means for developing high quality software. The effects of using a perspective based review method with a testing perspective (PBRM(T)) on requirements specifications have been evaluated in an industrial project. PBRM(T) was employed and compared to the normal checklist-based review method (CBRM) which was used earlier in the project. The effects studied were 1) the effectiveness 2) the efficiency and 3) the number of system faults related to requirements specifications knowledge. Inspection data from CBRM and PBRM(T) were analyzed and compared. Problem report data were also analyzed and a small survey was used for evaluation of the two methods. PBRM(T) showed an effectiveness of 0.3 faults found per requirement compared with 0.05 with CBRM or 2.4 faults found per page compared with 0.5 with CBRM in this study. The efficiency with PBRM(T) was 1.9 faults found per hour compared with 1.2 with CBRM. The engineers expressed that they had gained a greater increase in system knowledge when having used PBRM(T) compared with CBRM. However, it is not possible in this case study to judge the causality of the effect. <br/><br>
This case study indicates that the use of an active review method, such as PBRM(T), yields both a higher effectiveness and efficiency compared with a passive method, such as CBRM, when reviewing requirements specifications.},
  author       = {Berling, Tomas and Runeson, Per},
  language     = {eng},
  number       = {3},
  pages        = {177--184},
  publisher    = {IEE},
  series       = {IEE proceedings Software},
  title        = {Evaluation of a Perspective Based Review Method Applied in an Industrial Setting},
  volume       = {150},
  year         = {2003},
}