Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Test processes in software product evolution - a qualitative survey on the state of practice

Runeson, Per LU orcid ; Andersson, Carina LU and Höst, Martin LU (2003) In Journal of Software Maintenance and Evolution: Research and Practice 15(1). p.41-59
Abstract
In order to understand the state of test process practices in the software industry, we have conducted a qualitative survey, covering software development departments at 11 companies in Sweden of different sizes and application domains. The companies develop products in an evolutionary manner, which means either new versions are released regularly, or new product variants under new names are released. The survey was conducted through workshop and interview sessions, loosely guided by a questionnaire scheme. The main conclusions of the survey are that the documented development process is emphasized by larger organizations as a key asset, while smaller organizations tend to lean more on experienced people. Further, product evolution is... (More)
In order to understand the state of test process practices in the software industry, we have conducted a qualitative survey, covering software development departments at 11 companies in Sweden of different sizes and application domains. The companies develop products in an evolutionary manner, which means either new versions are released regularly, or new product variants under new names are released. The survey was conducted through workshop and interview sessions, loosely guided by a questionnaire scheme. The main conclusions of the survey are that the documented development process is emphasized by larger organizations as a key asset, while smaller organizations tend to lean more on experienced people. Further, product evolution is performed primarily as new product variants for embedded systems, and as new versions for packaged software. The development is structured using incremental development or a daily build approach; increments are used among more process-focused organizations, and daily build is more frequently utilized in less process-focused organizations. Test automation is performed using scripts for products with focus on functionality, and recorded data for products with focus on non-functional properties. Test automation is an issue which most organizations want to improve; handling the legacy parts of the product and related documentation presents a common problem in improvement efforts for product evolution. Copyright (C) 2003 John Wiley Sons, Ltd. (Less)
Please use this url to cite or link to this publication:
author
; and
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
industry practice, evolution, interviews, verification and validation, qualitative survey
in
Journal of Software Maintenance and Evolution: Research and Practice
volume
15
issue
1
pages
41 - 59
publisher
John Wiley & Sons Inc.
external identifiers
  • wos:000181162600004
  • scopus:0037285416
ISSN
1532-060X
DOI
10.1002/smr.265
language
English
LU publication?
yes
id
edcfa7d7-1115-4b2a-85b1-2078509409ce (old id 317491)
date added to LUP
2016-04-01 11:56:09
date last changed
2022-01-26 20:27:11
@article{edcfa7d7-1115-4b2a-85b1-2078509409ce,
  abstract     = {{In order to understand the state of test process practices in the software industry, we have conducted a qualitative survey, covering software development departments at 11 companies in Sweden of different sizes and application domains. The companies develop products in an evolutionary manner, which means either new versions are released regularly, or new product variants under new names are released. The survey was conducted through workshop and interview sessions, loosely guided by a questionnaire scheme. The main conclusions of the survey are that the documented development process is emphasized by larger organizations as a key asset, while smaller organizations tend to lean more on experienced people. Further, product evolution is performed primarily as new product variants for embedded systems, and as new versions for packaged software. The development is structured using incremental development or a daily build approach; increments are used among more process-focused organizations, and daily build is more frequently utilized in less process-focused organizations. Test automation is performed using scripts for products with focus on functionality, and recorded data for products with focus on non-functional properties. Test automation is an issue which most organizations want to improve; handling the legacy parts of the product and related documentation presents a common problem in improvement efforts for product evolution. Copyright (C) 2003 John Wiley Sons, Ltd.}},
  author       = {{Runeson, Per and Andersson, Carina and Höst, Martin}},
  issn         = {{1532-060X}},
  keywords     = {{industry practice; evolution; interviews; verification and validation; qualitative survey}},
  language     = {{eng}},
  number       = {{1}},
  pages        = {{41--59}},
  publisher    = {{John Wiley & Sons Inc.}},
  series       = {{Journal of Software Maintenance and Evolution: Research and Practice}},
  title        = {{Test processes in software product evolution - a qualitative survey on the state of practice}},
  url          = {{http://dx.doi.org/10.1002/smr.265}},
  doi          = {{10.1002/smr.265}},
  volume       = {{15}},
  year         = {{2003}},
}