Assessing the sensitivity to usage profile changes in test planning
Wesslén, Anders LU ; Runeson, Per LU
and Regnell, Bjorn
LU
(2000)
11th International Symposium on Software Reliability Engineering (ISSRE 2000)
In Proceedings of the International Symposium on Software Reliability Engineering, ISSRE
p.317-326
- Abstract
Software reliability is an important characteristic for most systems, but due to its dynamic properties it is hard to assess until very late in the development. Nevertheless, the testing must be planned to meet the reliability requirements. In test planning, the notion of usage coverage may be used as an indicator of reliability as they are correlated with each other. When the testing is planned, the test cases to be run and the usage profile are derived. The usage profile is estimated using the available information of the expected usage. There are therefore some uncertainties in the estimated usage profile. This paper presents and evaluates a method for analyzing the impact of uncertainties in the usage profile on the usage coverage.... (More)
Software reliability is an important characteristic for most systems, but due to its dynamic properties it is hard to assess until very late in the development. Nevertheless, the testing must be planned to meet the reliability requirements. In test planning, the notion of usage coverage may be used as an indicator of reliability as they are correlated with each other. When the testing is planned, the test cases to be run and the usage profile are derived. The usage profile is estimated using the available information of the expected usage. There are therefore some uncertainties in the estimated usage profile. This paper presents and evaluates a method for analyzing the impact of uncertainties in the usage profile on the usage coverage. The method is applied during test planning to evaluate how sensitive the usage coverage is to usage profile uncertainties. Different usage profiles are simulated using the expected usage profile and an uncertainty expressed as a percentage value or a range within which the changed usage profile may vary. Test cases are derived from the expected usage profile and the resulting usage coverage is estimated for each simulated usage profile. Thus the impact in the usage coverage can be analyzed. The presented analysis method is illustrated with an example system. One of the conclusions from this first study of the method is that the sparseness of the usage profile, which is defined by limitations in the usage pattern, reduces the impact of the usage profile uncertainties. Further, the number of test cases is an important factor in the sensitivity to uncertainties in the usage profile.
(Less)
- author
- Wesslén, Anders
LU
; Runeson, Per
LU
and Regnell, Bjorn
LU
- organization
- publishing date
- 2000
- type
- Chapter in Book/Report/Conference proceeding
- publication status
- published
- subject
- host publication
- Proceedings 11th International Symposium on Software Reliability Engineering
- series title
- Proceedings of the International Symposium on Software Reliability Engineering, ISSRE
- pages
- 10 pages
- publisher
- IEEE - Institute of Electrical and Electronics Engineers Inc.
- conference name
- 11th International Symposium on Software Reliability Engineering (ISSRE 2000)
- conference location
- San Jose, CA, USA
- conference dates
- 2000-10-08 - 2000-10-11
- external identifiers
-
- scopus:0034538844
- ISSN
- 1071-9458
- ISBN
- 0-7695-0807-3
- DOI
- 10.1109/ISSRE.2000.885882
- language
- English
- LU publication?
- yes
- id
- 82a8f359-8c0e-40d1-becc-f57956b770f8
- date added to LUP
- 2022-10-19 11:44:31
- date last changed
- 2022-10-21 12:07:19
@inproceedings{82a8f359-8c0e-40d1-becc-f57956b770f8,
abstract = {{<p>Software reliability is an important characteristic for most systems, but due to its dynamic properties it is hard to assess until very late in the development. Nevertheless, the testing must be planned to meet the reliability requirements. In test planning, the notion of usage coverage may be used as an indicator of reliability as they are correlated with each other. When the testing is planned, the test cases to be run and the usage profile are derived. The usage profile is estimated using the available information of the expected usage. There are therefore some uncertainties in the estimated usage profile. This paper presents and evaluates a method for analyzing the impact of uncertainties in the usage profile on the usage coverage. The method is applied during test planning to evaluate how sensitive the usage coverage is to usage profile uncertainties. Different usage profiles are simulated using the expected usage profile and an uncertainty expressed as a percentage value or a range within which the changed usage profile may vary. Test cases are derived from the expected usage profile and the resulting usage coverage is estimated for each simulated usage profile. Thus the impact in the usage coverage can be analyzed. The presented analysis method is illustrated with an example system. One of the conclusions from this first study of the method is that the sparseness of the usage profile, which is defined by limitations in the usage pattern, reduces the impact of the usage profile uncertainties. Further, the number of test cases is an important factor in the sensitivity to uncertainties in the usage profile.</p>}},
author = {{Wesslén, Anders and Runeson, Per and Regnell, Bjorn}},
booktitle = {{Proceedings 11th International Symposium on Software Reliability Engineering}},
isbn = {{0-7695-0807-3}},
issn = {{1071-9458}},
language = {{eng}},
pages = {{317--326}},
publisher = {{IEEE - Institute of Electrical and Electronics Engineers Inc.}},
series = {{Proceedings of the International Symposium on Software Reliability Engineering, ISSRE}},
title = {{Assessing the sensitivity to usage profile changes in test planning}},
url = {{http://dx.doi.org/10.1109/ISSRE.2000.885882}},
doi = {{10.1109/ISSRE.2000.885882}},
year = {{2000}},
}