Regression testing goals-view of practitioners and researchers
(2018) 24th Asia-Pacific Software Engineering Conference Workshops, APSECW 2017 p.25-31- Abstract
Context: Regression testing is a well-researched area. However,the majority regression testing techniques proposed by theresearchers are not getting the attention of the practitioners. Communicationgaps between industry and academia and disparity in theregression testing goals are the main reasons. Close collaboration canhelp in bridging the communication gaps and resolving the disparities.Objective: The study aims at exploring the views of academicsand practitioners about the goals of regression testing. The purpose isto investigate the commonalities and differences in their viewpointsand defining some common goals for the success of regression testing.Method: We conducted a focus group study, with 7 testingexperts from industry and... (More)
Context: Regression testing is a well-researched area. However,the majority regression testing techniques proposed by theresearchers are not getting the attention of the practitioners. Communicationgaps between industry and academia and disparity in theregression testing goals are the main reasons. Close collaboration canhelp in bridging the communication gaps and resolving the disparities.Objective: The study aims at exploring the views of academicsand practitioners about the goals of regression testing. The purpose isto investigate the commonalities and differences in their viewpointsand defining some common goals for the success of regression testing.Method: We conducted a focus group study, with 7 testingexperts from industry and academia. 4 testing practitioners from 2companies and 3 researchers from 2 universities participated in thestudy. We followed GQM approach, to elicit the regression testinggoals, information needs, and measures.Results: 43 regression testing goals were identified by theparticipants, which were reduced to 10 on the basis of similarityamong the identified goals. Later during the priority assignmentprocess, 5 goals were discarded, because the priority assigned tothese goals was very low. Participants identified 47 informationneeds/questions required to evaluate the success of regression testingwith reference to goal G5 (confidence). Which were then reduced to10 on the basis of similarity. Finally, we identified measures to gaugethose information needs/questions, which were corresponding to thegoal (G5).Conclusions: We observed that participation level ofpractitioners and researchers during the elicitation of goals andquestions was same. We found a certain level of agreement betweenthe participants regarding the regression testing definitions and goals.But there was some level of disagreement regarding the prioritiesof the goals. We also identified the need to implement a regressiontesting evaluation framework in the participating companies.
(Less)
- author
- Minhas, Nasir Mehmood ; Petersen, Kai ; Ali, Nauman Bin and Wnuk, Krzysztof LU
- publishing date
- 2018-03-09
- type
- Chapter in Book/Report/Conference proceeding
- publication status
- published
- subject
- keywords
- Focus group, GQM, Regression testing, Regression testing goals
- host publication
- Proceedings - 2017 24th Asia-Pacific Software Engineering Conference Workshops, APSECW 2017
- pages
- 7 pages
- publisher
- IEEE - Institute of Electrical and Electronics Engineers Inc.
- conference name
- 24th Asia-Pacific Software Engineering Conference Workshops, APSECW 2017
- conference location
- Nanjing, China
- conference dates
- 2017-12-04 - 2017-12-08
- external identifiers
-
- scopus:85050614037
- ISBN
- 978-1-5386-2650-4
- 978-1-5386-2649-8
- DOI
- 10.1109/APSECW.2017.23
- project
- Embedded Applications Software Engineering
- language
- English
- LU publication?
- no
- id
- 87efc36b-cdda-4183-bf7a-a02380077b85
- date added to LUP
- 2018-09-27 13:32:31
- date last changed
- 2024-06-10 18:01:49
@inproceedings{87efc36b-cdda-4183-bf7a-a02380077b85,
abstract = {{<p>Context: Regression testing is a well-researched area. However,the majority regression testing techniques proposed by theresearchers are not getting the attention of the practitioners. Communicationgaps between industry and academia and disparity in theregression testing goals are the main reasons. Close collaboration canhelp in bridging the communication gaps and resolving the disparities.Objective: The study aims at exploring the views of academicsand practitioners about the goals of regression testing. The purpose isto investigate the commonalities and differences in their viewpointsand defining some common goals for the success of regression testing.Method: We conducted a focus group study, with 7 testingexperts from industry and academia. 4 testing practitioners from 2companies and 3 researchers from 2 universities participated in thestudy. We followed GQM approach, to elicit the regression testinggoals, information needs, and measures.Results: 43 regression testing goals were identified by theparticipants, which were reduced to 10 on the basis of similarityamong the identified goals. Later during the priority assignmentprocess, 5 goals were discarded, because the priority assigned tothese goals was very low. Participants identified 47 informationneeds/questions required to evaluate the success of regression testingwith reference to goal G5 (confidence). Which were then reduced to10 on the basis of similarity. Finally, we identified measures to gaugethose information needs/questions, which were corresponding to thegoal (G5).Conclusions: We observed that participation level ofpractitioners and researchers during the elicitation of goals andquestions was same. We found a certain level of agreement betweenthe participants regarding the regression testing definitions and goals.But there was some level of disagreement regarding the prioritiesof the goals. We also identified the need to implement a regressiontesting evaluation framework in the participating companies.</p>}},
author = {{Minhas, Nasir Mehmood and Petersen, Kai and Ali, Nauman Bin and Wnuk, Krzysztof}},
booktitle = {{Proceedings - 2017 24th Asia-Pacific Software Engineering Conference Workshops, APSECW 2017}},
isbn = {{978-1-5386-2650-4}},
keywords = {{Focus group; GQM; Regression testing; Regression testing goals}},
language = {{eng}},
month = {{03}},
pages = {{25--31}},
publisher = {{IEEE - Institute of Electrical and Electronics Engineers Inc.}},
title = {{Regression testing goals-view of practitioners and researchers}},
url = {{http://dx.doi.org/10.1109/APSECW.2017.23}},
doi = {{10.1109/APSECW.2017.23}},
year = {{2018}},
}