Supporting Regression Test Scoping with Visual Analytics
(2014) IEEE International Conference on Software Testing, Verification, and Validation, 2014 p.283-292- Abstract
- Test managers have to repeatedly select test cases for test activities during evolution of large software systems. Researchers have widely studied automated test scoping, but have not fully investigated decision support with
human interaction. We previously proposed the introduction of visual analytics for this purpose. Aim: In this empirical study we investigate how to design such decision support. Method: We explored the use of visual analytics using heat maps of historical test data for test scoping support by letting test managers evaluate prototype visualizations in three focus groups with in total nine industrial test experts. Results: All test managers in the study found the visual analytics useful for supporting test... (More) - Test managers have to repeatedly select test cases for test activities during evolution of large software systems. Researchers have widely studied automated test scoping, but have not fully investigated decision support with
human interaction. We previously proposed the introduction of visual analytics for this purpose. Aim: In this empirical study we investigate how to design such decision support. Method: We explored the use of visual analytics using heat maps of historical test data for test scoping support by letting test managers evaluate prototype visualizations in three focus groups with in total nine industrial test experts. Results: All test managers in the study found the visual analytics useful for supporting test planning. However, our results show that different tasks and contexts require different types of visualizations. Conclusion: Important properties for test planning support are: ability to overview testing from different perspectives, ability to filter and zoom to compare subsets of the testing with respect to various attributes and the ability to manipulate the subset under analysis by selecting and deselecting test cases. Our results may be used to support the introduction of visual test analytics in practice. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/4407393
- author
- Engström, Emelie LU ; Mäntylä, Mika ; Runeson, Per LU and Borg, Markus LU
- organization
- publishing date
- 2014
- type
- Chapter in Book/Report/Conference proceeding
- publication status
- published
- subject
- host publication
- [Host publication title missing]
- editor
- O'Conner, Lisa
- pages
- 10 pages
- publisher
- IEEE - Institute of Electrical and Electronics Engineers Inc.
- conference name
- IEEE International Conference on Software Testing, Verification, and Validation, 2014
- conference location
- Cleveland, Ohio, United States
- conference dates
- 2014-03-31 - 2014-04-04
- external identifiers
-
- wos:000355985000031
- scopus:84903212709
- DOI
- 10.1109/ICST.2014.41
- project
- Embedded Applications Software Engineering
- language
- English
- LU publication?
- yes
- id
- d4605252-acd3-425f-91ba-3a77e8eeee7d (old id 4407393)
- date added to LUP
- 2016-04-04 12:01:35
- date last changed
- 2022-03-23 18:31:33
@inproceedings{d4605252-acd3-425f-91ba-3a77e8eeee7d, abstract = {{Test managers have to repeatedly select test cases for test activities during evolution of large software systems. Researchers have widely studied automated test scoping, but have not fully investigated decision support with<br/><br> human interaction. We previously proposed the introduction of visual analytics for this purpose. Aim: In this empirical study we investigate how to design such decision support. Method: We explored the use of visual analytics using heat maps of historical test data for test scoping support by letting test managers evaluate prototype visualizations in three focus groups with in total nine industrial test experts. Results: All test managers in the study found the visual analytics useful for supporting test planning. However, our results show that different tasks and contexts require different types of visualizations. Conclusion: Important properties for test planning support are: ability to overview testing from different perspectives, ability to filter and zoom to compare subsets of the testing with respect to various attributes and the ability to manipulate the subset under analysis by selecting and deselecting test cases. Our results may be used to support the introduction of visual test analytics in practice.}}, author = {{Engström, Emelie and Mäntylä, Mika and Runeson, Per and Borg, Markus}}, booktitle = {{[Host publication title missing]}}, editor = {{O'Conner, Lisa}}, language = {{eng}}, pages = {{283--292}}, publisher = {{IEEE - Institute of Electrical and Electronics Engineers Inc.}}, title = {{Supporting Regression Test Scoping with Visual Analytics}}, url = {{https://lup.lub.lu.se/search/files/5910058/4407403.pdf}}, doi = {{10.1109/ICST.2014.41}}, year = {{2014}}, }