Advanced

On the search for industry-relevant regression testing research

Ali, Nauman Bin; Engström, Emelie LU ; Taromirad, Masoumeh; Mousavi, Mohammad; Minhas, Nasir Mehmood; Helgesson, Daniel LU ; Kunze, Sebastian and Varshoaz, Mahsa (2019) In Empirical Software Engineering
Abstract
Regression testing is a means to assure that a change in the software, or its execution environment, does not introduce new defects. It involves the expensive undertaking of rerunning test cases. Several techniques have been proposed to reduce the number of test cases to execute in regression testing, however, there is no research on how to assess industrial relevance and applicability of such techniques. We conducted a systematic literature review with the following two goals: firstly, to enable researchers to design and present regression testing research with a focus on industrial relevance and applicability and secondly, to facilitate the industrial adoption of such research by addressing the attributes of concern from the... (More)
Regression testing is a means to assure that a change in the software, or its execution environment, does not introduce new defects. It involves the expensive undertaking of rerunning test cases. Several techniques have been proposed to reduce the number of test cases to execute in regression testing, however, there is no research on how to assess industrial relevance and applicability of such techniques. We conducted a systematic literature review with the following two goals: firstly, to enable researchers to design and present regression testing research with a focus on industrial relevance and applicability and secondly, to facilitate the industrial adoption of such research by addressing the attributes of concern from the practitioners’ perspective. Using a reference-based search approach, we identified 1068 papers on regression testing. We then reduced the scope to only include papers with explicit discussions about relevance and applicability (i.e. mainly studies involving industrial stakeholders). Uniquely in this literature review, practitioners were consulted at several steps to increase the likelihood of achieving our aim of identifying factors important for relevance and applicability. We have summarised the results of these consultations and an analysis of the literature in three taxonomies, which capture aspects of industrial-relevance regarding the regression testing techniques. Based on these taxonomies, we mapped 38 papers reporting the evaluation of 26 regression testing techniques in industrial settings. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Contribution to journal
publication status
epub
subject
keywords
Regression testing, Industrial relevance, Systematic literature review, Taxonomy, Recommendations
in
Empirical Software Engineering
publisher
Springer
external identifiers
  • scopus:85061506841
ISSN
1573-7616
DOI
10.1007/s10664-018-9670-1
language
English
LU publication?
yes
id
18d9fd5e-f5cf-4349-be27-bdf8b7b02414
alternative location
https://rdcu.be/bmtMG
date added to LUP
2019-02-15 15:53:34
date last changed
2019-03-19 04:05:30
@article{18d9fd5e-f5cf-4349-be27-bdf8b7b02414,
  abstract     = {Regression testing is a means to assure that a change in the software, or its execution environment, does not introduce new defects. It involves the expensive undertaking of rerunning test cases. Several techniques have been proposed to reduce the number of test cases to execute in regression testing, however, there is no research on how to assess industrial relevance and applicability of such techniques. We conducted a systematic literature review with the following two goals: firstly, to enable researchers to design and present regression testing research with a focus on industrial relevance and applicability and secondly, to facilitate the industrial adoption of such research by addressing the attributes of concern from the practitioners’ perspective. Using a reference-based search approach, we identified 1068 papers on regression testing. We then reduced the scope to only include papers with explicit discussions about relevance and applicability (i.e. mainly studies involving industrial stakeholders). Uniquely in this literature review, practitioners were consulted at several steps to increase the likelihood of achieving our aim of identifying factors important for relevance and applicability. We have summarised the results of these consultations and an analysis of the literature in three taxonomies, which capture aspects of industrial-relevance regarding the regression testing techniques. Based on these taxonomies, we mapped 38 papers reporting the evaluation of 26 regression testing techniques in industrial settings.},
  author       = {Ali, Nauman Bin and Engström, Emelie and Taromirad, Masoumeh and Mousavi, Mohammad and Minhas, Nasir Mehmood and Helgesson, Daniel and Kunze, Sebastian and Varshoaz, Mahsa},
  issn         = {1573-7616},
  keyword      = {Regression testing,Industrial relevance,Systematic literature review,Taxonomy,Recommendations},
  language     = {eng},
  month        = {02},
  publisher    = {Springer},
  series       = {Empirical Software Engineering},
  title        = {On the search for industry-relevant regression testing research},
  url          = {http://dx.doi.org/10.1007/s10664-018-9670-1},
  year         = {2019},
}