Advanced

Models for Estimation of Software Faults and Failures in Inspection and Test

Runeson, Per LU (1998)
Abstract (Swedish)
Popular Abstract in Swedish

Programvara spelar en allt viktigare roll i industriella produkter. Bilar, flygplan, telefoner, hemelektronik, kärnkraftverk m.m. innehåller alla programvara. När man utvecklar programvara blir det ofta fel i produkterna, fel som kan vara mycket allvarliga för funktion och säkerhet. Ett första steg i att minska dessa fel är att uppskatta hur många fel som finns i produkterna och hur de uppträder i produktens driftsfas.



Under programvaruutvecklingen vidtas olika åtgärder för att hitta de fel som finns i produkterna. Två åtgärder är granskningar och tester. Granskningar innebär att olika personer läser dokument för att hitta fel i dem. Test innebär att programvaran används på... (More)
Popular Abstract in Swedish

Programvara spelar en allt viktigare roll i industriella produkter. Bilar, flygplan, telefoner, hemelektronik, kärnkraftverk m.m. innehåller alla programvara. När man utvecklar programvara blir det ofta fel i produkterna, fel som kan vara mycket allvarliga för funktion och säkerhet. Ett första steg i att minska dessa fel är att uppskatta hur många fel som finns i produkterna och hur de uppträder i produktens driftsfas.



Under programvaruutvecklingen vidtas olika åtgärder för att hitta de fel som finns i produkterna. Två åtgärder är granskningar och tester. Granskningar innebär att olika personer läser dokument för att hitta fel i dem. Test innebär att programvaran används på olika sätt innan den sätts i drift.



I denna avhandling presenteras modeller för att uppskatta hur många fel som finns kvar i en programvaruprodukt efter en granskning. Skattningen baseras på vilka fel som hittats av olika granskare. Modellerna är baserade på en teknik som används inom biologin för att räkna djurpopulationer.



Vidare presenteras en modell som används som underlag för tester av programvaran. Modellen beskriver hur användarna använder programvaran. Genom att välja testfall från denna modell blir testningen som en slags “opinionsundersökning” om hur den verkliga driften kommer att te sig. Genom statistiska modeller kan man uppskatta hur ofta fel kommer att uppträda i den verkliga driften. (Less)
Abstract
In software engineering, the quality of software and in particular the software reliability has to be controlled and improved. Hence there is a need for measuring and controlling the number and appearance of software faults and failures. This thesis presents models for estimation of residual faults after inspections and a model for usage specifications which enables estimation of operational failure behaviour and software reliability already in test.



The fault estimation models are based on the capture-recapture technique. A filter approach and an experience-based approach are developed and evaluated in two experiments. The experimental results show that the new estimation models give less absolute error and more stable... (More)
In software engineering, the quality of software and in particular the software reliability has to be controlled and improved. Hence there is a need for measuring and controlling the number and appearance of software faults and failures. This thesis presents models for estimation of residual faults after inspections and a model for usage specifications which enables estimation of operational failure behaviour and software reliability already in test.



The fault estimation models are based on the capture-recapture technique. A filter approach and an experience-based approach are developed and evaluated in two experiments. The experimental results show that the new estimation models give less absolute error and more stable estimates than established models. However, replication of the experiments is needed to get sufficient confidence in the results.



The failure estimation, or software reliability estimation models require test cases to be representative of the future usage of the system in order to make estimates in test. The future usage is specified in a usage specification. The state hierarchy usage specification model is developed to be suitable for modelling of the usage of real-time multi-user systems. The model is applied in early phases in the life cycle to dynamic analysis, as well as to test of components. Furthermore the implementation of the usage specification in an executable language for automatic generation of test cases is studied. The model is evaluated in minor case studies in different application domains, which have provided promising results.



The models contribute to estimation of software faults and failures, hence providing means for control of software quality attributes. (Less)
Please use this url to cite or link to this publication:
author
opponent
  • Professor von Mayrhauser, Anneliese, Colorado State University
organization
publishing date
type
Thesis
publication status
published
subject
keywords
failures, usage based testing, usage model, statistical testing, faults, capture-recapture, inspections, software quality, software reliability, experiments, Computer science, numerical analysis, systems, control, Datalogi, numerisk analys, system, kontroll
pages
222 pages
publisher
Department of Communication Systems, Lund University
defense location
E:1406
defense date
1998-01-30 10:15
external identifiers
  • other:ISRN: LUTEDX/TETS--1034--SE+222P
ISSN
1101-3931
language
English
LU publication?
yes
id
d672565d-70c9-4004-817f-463468efb032 (old id 38373)
date added to LUP
2007-08-01 11:10:35
date last changed
2016-09-19 08:44:55
@phdthesis{d672565d-70c9-4004-817f-463468efb032,
  abstract     = {In software engineering, the quality of software and in particular the software reliability has to be controlled and improved. Hence there is a need for measuring and controlling the number and appearance of software faults and failures. This thesis presents models for estimation of residual faults after inspections and a model for usage specifications which enables estimation of operational failure behaviour and software reliability already in test.<br/><br>
<br/><br>
The fault estimation models are based on the capture-recapture technique. A filter approach and an experience-based approach are developed and evaluated in two experiments. The experimental results show that the new estimation models give less absolute error and more stable estimates than established models. However, replication of the experiments is needed to get sufficient confidence in the results.<br/><br>
<br/><br>
The failure estimation, or software reliability estimation models require test cases to be representative of the future usage of the system in order to make estimates in test. The future usage is specified in a usage specification. The state hierarchy usage specification model is developed to be suitable for modelling of the usage of real-time multi-user systems. The model is applied in early phases in the life cycle to dynamic analysis, as well as to test of components. Furthermore the implementation of the usage specification in an executable language for automatic generation of test cases is studied. The model is evaluated in minor case studies in different application domains, which have provided promising results.<br/><br>
<br/><br>
The models contribute to estimation of software faults and failures, hence providing means for control of software quality attributes.},
  author       = {Runeson, Per},
  issn         = {1101-3931},
  keyword      = {failures,usage based testing,usage model,statistical testing,faults,capture-recapture,inspections,software quality,software reliability,experiments,Computer science,numerical analysis,systems,control,Datalogi,numerisk analys,system,kontroll},
  language     = {eng},
  pages        = {222},
  publisher    = {Department of Communication Systems, Lund University},
  school       = {Lund University},
  title        = {Models for Estimation of Software Faults and Failures in Inspection and Test},
  year         = {1998},
}