Advanced

Supporting Regression Test Scoping with Visual Analytics

Engström, Emelie LU ; Mäntylä, Mika; Runeson, Per LU and Borg, Markus LU (2014) IEEE International Conference on Software Testing, Verification, and Validation, 2014 In [Host publication title missing] p.283-292
Abstract
Test managers have to repeatedly select test cases for test activities during evolution of large software systems. Researchers have widely studied automated test scoping, but have not fully investigated decision support with

human interaction. We previously proposed the introduction of visual analytics for this purpose. Aim: In this empirical study we investigate how to design such decision support. Method: We explored the use of visual analytics using heat maps of historical test data for test scoping support by letting test managers evaluate prototype visualizations in three focus groups with in total nine industrial test experts. Results: All test managers in the study found the visual analytics useful for supporting test... (More)
Test managers have to repeatedly select test cases for test activities during evolution of large software systems. Researchers have widely studied automated test scoping, but have not fully investigated decision support with

human interaction. We previously proposed the introduction of visual analytics for this purpose. Aim: In this empirical study we investigate how to design such decision support. Method: We explored the use of visual analytics using heat maps of historical test data for test scoping support by letting test managers evaluate prototype visualizations in three focus groups with in total nine industrial test experts. Results: All test managers in the study found the visual analytics useful for supporting test planning. However, our results show that different tasks and contexts require different types of visualizations. Conclusion: Important properties for test planning support are: ability to overview testing from different perspectives, ability to filter and zoom to compare subsets of the testing with respect to various attributes and the ability to manipulate the subset under analysis by selecting and deselecting test cases. Our results may be used to support the introduction of visual test analytics in practice. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
in
[Host publication title missing]
editor
O'Conner, Lisa and
pages
10 pages
publisher
IEEE--Institute of Electrical and Electronics Engineers Inc.
conference name
IEEE International Conference on Software Testing, Verification, and Validation, 2014
external identifiers
  • wos:000355985000031
  • scopus:84903212709
DOI
10.1109/ICST.2014.41
language
English
LU publication?
yes
id
d4605252-acd3-425f-91ba-3a77e8eeee7d (old id 4407393)
date added to LUP
2014-04-28 12:17:17
date last changed
2017-01-01 08:06:33
@inproceedings{d4605252-acd3-425f-91ba-3a77e8eeee7d,
  abstract     = {Test managers have to repeatedly select test cases for test activities during evolution of large software systems. Researchers have widely studied automated test scoping, but have not fully investigated decision support with<br/><br>
human interaction. We previously proposed the introduction of visual analytics for this purpose. Aim: In this empirical study we investigate how to design such decision support. Method: We explored the use of visual analytics using heat maps of historical test data for test scoping support by letting test managers evaluate prototype visualizations in three focus groups with in total nine industrial test experts. Results: All test managers in the study found the visual analytics useful for supporting test planning. However, our results show that different tasks and contexts require different types of visualizations. Conclusion: Important properties for test planning support are: ability to overview testing from different perspectives, ability to filter and zoom to compare subsets of the testing with respect to various attributes and the ability to manipulate the subset under analysis by selecting and deselecting test cases. Our results may be used to support the introduction of visual test analytics in practice.},
  author       = {Engström, Emelie and Mäntylä, Mika and Runeson, Per and Borg, Markus},
  booktitle    = {[Host publication title missing]},
  editor       = {O'Conner, Lisa},
  language     = {eng},
  pages        = {283--292},
  publisher    = {IEEE--Institute of Electrical and Electronics Engineers Inc.},
  title        = {Supporting Regression Test Scoping with Visual Analytics},
  url          = {http://dx.doi.org/10.1109/ICST.2014.41},
  year         = {2014},
}