Advanced

Regression testing goals-view of practitioners and researchers

Minhas, Nasir Mehmood; Petersen, Kai; Ali, Nauman Bin and Wnuk, Krzysztof LU (2018) 24th Asia-Pacific Software Engineering Conference Workshops, APSECW 2017 p.25-31
Abstract

Context: Regression testing is a well-researched area. However,the majority regression testing techniques proposed by theresearchers are not getting the attention of the practitioners. Communicationgaps between industry and academia and disparity in theregression testing goals are the main reasons. Close collaboration canhelp in bridging the communication gaps and resolving the disparities.Objective: The study aims at exploring the views of academicsand practitioners about the goals of regression testing. The purpose isto investigate the commonalities and differences in their viewpointsand defining some common goals for the success of regression testing.Method: We conducted a focus group study, with 7 testingexperts from industry and... (More)

Context: Regression testing is a well-researched area. However,the majority regression testing techniques proposed by theresearchers are not getting the attention of the practitioners. Communicationgaps between industry and academia and disparity in theregression testing goals are the main reasons. Close collaboration canhelp in bridging the communication gaps and resolving the disparities.Objective: The study aims at exploring the views of academicsand practitioners about the goals of regression testing. The purpose isto investigate the commonalities and differences in their viewpointsand defining some common goals for the success of regression testing.Method: We conducted a focus group study, with 7 testingexperts from industry and academia. 4 testing practitioners from 2companies and 3 researchers from 2 universities participated in thestudy. We followed GQM approach, to elicit the regression testinggoals, information needs, and measures.Results: 43 regression testing goals were identified by theparticipants, which were reduced to 10 on the basis of similarityamong the identified goals. Later during the priority assignmentprocess, 5 goals were discarded, because the priority assigned tothese goals was very low. Participants identified 47 informationneeds/questions required to evaluate the success of regression testingwith reference to goal G5 (confidence). Which were then reduced to10 on the basis of similarity. Finally, we identified measures to gaugethose information needs/questions, which were corresponding to thegoal (G5).Conclusions: We observed that participation level ofpractitioners and researchers during the elicitation of goals andquestions was same. We found a certain level of agreement betweenthe participants regarding the regression testing definitions and goals.But there was some level of disagreement regarding the prioritiesof the goals. We also identified the need to implement a regressiontesting evaluation framework in the participating companies.

(Less)
Please use this url to cite or link to this publication:
author
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
keywords
Focus group, GQM, Regression testing, Regression testing goals
host publication
Proceedings - 2017 24th Asia-Pacific Software Engineering Conference Workshops, APSECW 2017
pages
7 pages
publisher
IEEE--Institute of Electrical and Electronics Engineers Inc.
conference name
24th Asia-Pacific Software Engineering Conference Workshops, APSECW 2017
conference location
Nanjing, China
conference dates
2017-12-04 - 2017-12-08
external identifiers
  • scopus:85050614037
ISBN
978-1-5386-2650-4
978-1-5386-2649-8
DOI
10.1109/APSECW.2017.23
language
English
LU publication?
no
id
87efc36b-cdda-4183-bf7a-a02380077b85
date added to LUP
2018-09-27 13:32:31
date last changed
2019-02-20 11:28:03
@inproceedings{87efc36b-cdda-4183-bf7a-a02380077b85,
  abstract     = {<p>Context: Regression testing is a well-researched area. However,the majority regression testing techniques proposed by theresearchers are not getting the attention of the practitioners. Communicationgaps between industry and academia and disparity in theregression testing goals are the main reasons. Close collaboration canhelp in bridging the communication gaps and resolving the disparities.Objective: The study aims at exploring the views of academicsand practitioners about the goals of regression testing. The purpose isto investigate the commonalities and differences in their viewpointsand defining some common goals for the success of regression testing.Method: We conducted a focus group study, with 7 testingexperts from industry and academia. 4 testing practitioners from 2companies and 3 researchers from 2 universities participated in thestudy. We followed GQM approach, to elicit the regression testinggoals, information needs, and measures.Results: 43 regression testing goals were identified by theparticipants, which were reduced to 10 on the basis of similarityamong the identified goals. Later during the priority assignmentprocess, 5 goals were discarded, because the priority assigned tothese goals was very low. Participants identified 47 informationneeds/questions required to evaluate the success of regression testingwith reference to goal G5 (confidence). Which were then reduced to10 on the basis of similarity. Finally, we identified measures to gaugethose information needs/questions, which were corresponding to thegoal (G5).Conclusions: We observed that participation level ofpractitioners and researchers during the elicitation of goals andquestions was same. We found a certain level of agreement betweenthe participants regarding the regression testing definitions and goals.But there was some level of disagreement regarding the prioritiesof the goals. We also identified the need to implement a regressiontesting evaluation framework in the participating companies.</p>},
  author       = {Minhas, Nasir Mehmood and Petersen, Kai and Ali, Nauman Bin and Wnuk, Krzysztof},
  isbn         = {978-1-5386-2650-4 },
  keyword      = {Focus group,GQM,Regression testing,Regression testing goals},
  language     = {eng},
  location     = {Nanjing, China},
  month        = {03},
  pages        = {25--31},
  publisher    = {IEEE--Institute of Electrical and Electronics Engineers Inc.},
  title        = {Regression testing goals-view of practitioners and researchers},
  url          = {http://dx.doi.org/10.1109/APSECW.2017.23},
  year         = {2018},
}