On the search for industry-relevant regression testing research
Ali, Nauman Bin ; Engström, Emelie LU
; Taromirad, Masoumeh
; Mousavi, Mohammad
; Minhas, Nasir Mehmood
; Helgesson, Daniel
LU
; Kunze, Sebastian
and Varshoaz, Mahsa
(2019)
In Empirical Software Engineering
24(4).
p.2020-2055
- Abstract
- Regression testing is a means to assure that a change in the software, or its execution environment, does not introduce new defects. It involves the expensive undertaking of rerunning test cases. Several techniques have been proposed to reduce the number of test cases to execute in regression testing, however, there is no research on how to assess industrial relevance and applicability of such techniques. We conducted a systematic literature review with the following two goals: firstly, to enable researchers to design and present regression testing research with a focus on industrial relevance and applicability and secondly, to facilitate the industrial adoption of such research by addressing the attributes of concern from the... (More)
- Regression testing is a means to assure that a change in the software, or its execution environment, does not introduce new defects. It involves the expensive undertaking of rerunning test cases. Several techniques have been proposed to reduce the number of test cases to execute in regression testing, however, there is no research on how to assess industrial relevance and applicability of such techniques. We conducted a systematic literature review with the following two goals: firstly, to enable researchers to design and present regression testing research with a focus on industrial relevance and applicability and secondly, to facilitate the industrial adoption of such research by addressing the attributes of concern from the practitioners’ perspective. Using a reference-based search approach, we identified 1068 papers on regression testing. We then reduced the scope to only include papers with explicit discussions about relevance and applicability (i.e. mainly studies involving industrial stakeholders). Uniquely in this literature review, practitioners were consulted at several steps to increase the likelihood of achieving our aim of identifying factors important for relevance and applicability. We have summarised the results of these consultations and an analysis of the literature in three taxonomies, which capture aspects of industrial-relevance regarding the regression testing techniques. Based on these taxonomies, we mapped 38 papers reporting the evaluation of 26 regression testing techniques in industrial settings. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/18d9fd5e-f5cf-4349-be27-bdf8b7b02414
- author
- Ali, Nauman Bin
; Engström, Emelie
LU
; Taromirad, Masoumeh
; Mousavi, Mohammad
; Minhas, Nasir Mehmood
; Helgesson, Daniel
LU
; Kunze, Sebastian
and Varshoaz, Mahsa
- organization
- publishing date
- 2019-02-12
- type
- Contribution to journal
- publication status
- published
- subject
- keywords
- Regression testing, Industrial relevance, Systematic literature review, Taxonomy, Recommendations
- in
- Empirical Software Engineering
- volume
- 24
- issue
- 4
- pages
- 2020 - 2055
- publisher
- Springer
- external identifiers
-
- scopus:85061506841
- ISSN
- 1573-7616
- DOI
- 10.1007/s10664-018-9670-1
- language
- English
- LU publication?
- yes
- id
- 18d9fd5e-f5cf-4349-be27-bdf8b7b02414
- alternative location
- https://rdcu.be/bmtMG
- date added to LUP
- 2019-02-15 15:53:34
- date last changed
- 2022-05-11 06:14:49
@article{18d9fd5e-f5cf-4349-be27-bdf8b7b02414,
abstract = {{Regression testing is a means to assure that a change in the software, or its execution environment, does not introduce new defects. It involves the expensive undertaking of rerunning test cases. Several techniques have been proposed to reduce the number of test cases to execute in regression testing, however, there is no research on how to assess industrial relevance and applicability of such techniques. We conducted a systematic literature review with the following two goals: firstly, to enable researchers to design and present regression testing research with a focus on industrial relevance and applicability and secondly, to facilitate the industrial adoption of such research by addressing the attributes of concern from the practitioners’ perspective. Using a reference-based search approach, we identified 1068 papers on regression testing. We then reduced the scope to only include papers with explicit discussions about relevance and applicability (i.e. mainly studies involving industrial stakeholders). Uniquely in this literature review, practitioners were consulted at several steps to increase the likelihood of achieving our aim of identifying factors important for relevance and applicability. We have summarised the results of these consultations and an analysis of the literature in three taxonomies, which capture aspects of industrial-relevance regarding the regression testing techniques. Based on these taxonomies, we mapped 38 papers reporting the evaluation of 26 regression testing techniques in industrial settings.}},
author = {{Ali, Nauman Bin and Engström, Emelie and Taromirad, Masoumeh and Mousavi, Mohammad and Minhas, Nasir Mehmood and Helgesson, Daniel and Kunze, Sebastian and Varshoaz, Mahsa}},
issn = {{1573-7616}},
keywords = {{Regression testing; Industrial relevance; Systematic literature review; Taxonomy; Recommendations}},
language = {{eng}},
month = {{02}},
number = {{4}},
pages = {{2020--2055}},
publisher = {{Springer}},
series = {{Empirical Software Engineering}},
title = {{On the search for industry-relevant regression testing research}},
url = {{http://dx.doi.org/10.1007/s10664-018-9670-1}},
doi = {{10.1007/s10664-018-9670-1}},
volume = {{24}},
year = {{2019}},
}