Efficient Regression Testing Based on Test History: An Industrial Evaluation
Ekelund, Edward Dunn and Engström, Emelie LU
(2015)
International Conference on Software Maintenance and Evolution
- Abstract
- Due to changes in the development practices at Axis Communications, towards continuous integration, faster regression testing feedback is needed. The current automated regression test suite takes approximately seven hours to run which prevents developers from integrating code changes several times a day as preferred. Therefore we want to implement a highly selective yet accurate regression testing strategy. Traditional code coverage based techniques are not applicable due to the size and complexity of the software under test. Instead we decided to select tests based on regression test history. We developed a tool, the Difference Engine, which parses and analyzes results from previous test runs and outputs regression test recommendations.... (More)
- Due to changes in the development practices at Axis Communications, towards continuous integration, faster regression testing feedback is needed. The current automated regression test suite takes approximately seven hours to run which prevents developers from integrating code changes several times a day as preferred. Therefore we want to implement a highly selective yet accurate regression testing strategy. Traditional code coverage based techniques are not applicable due to the size and complexity of the software under test. Instead we decided to select tests based on regression test history. We developed a tool, the Difference Engine, which parses and analyzes results from previous test runs and outputs regression test recommendations. The Difference Engine correlates code and test cases at package level and recommends test cases that are strongly correlated to recently changed packages. We evaluated the technique with respect to correctness, precision, recall and efficiency. Our results are promising. On average the tool manages to identify 80% of the relevant tests while recommending only 4% of the test cases in the full regression test suite. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/7989669
- author
- Ekelund, Edward Dunn
and Engström, Emelie
LU
- organization
- publishing date
- 2015
- type
- Chapter in Book/Report/Conference proceeding
- publication status
- published
- subject
- host publication
- 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME)
- pages
- 9 pages
- publisher
- IEEE - Institute of Electrical and Electronics Engineers Inc.
- conference name
- International Conference on Software Maintenance and Evolution
- conference location
- Bremen, Germany
- conference dates
- 2015-09-29
- external identifiers
-
- scopus:84961644861
- ISBN
- 978-1-4673-7532-0
- DOI
- 10.1109/ICSM.2015.7332496
- language
- English
- LU publication?
- yes
- id
- ce239e5f-6811-4e9b-93ac-3d7a32b0eef6 (old id 7989669)
- date added to LUP
- 2016-04-04 10:04:12
- date last changed
- 2022-02-13 19:13:35
@inproceedings{ce239e5f-6811-4e9b-93ac-3d7a32b0eef6,
abstract = {{Due to changes in the development practices at Axis Communications, towards continuous integration, faster regression testing feedback is needed. The current automated regression test suite takes approximately seven hours to run which prevents developers from integrating code changes several times a day as preferred. Therefore we want to implement a highly selective yet accurate regression testing strategy. Traditional code coverage based techniques are not applicable due to the size and complexity of the software under test. Instead we decided to select tests based on regression test history. We developed a tool, the Difference Engine, which parses and analyzes results from previous test runs and outputs regression test recommendations. The Difference Engine correlates code and test cases at package level and recommends test cases that are strongly correlated to recently changed packages. We evaluated the technique with respect to correctness, precision, recall and efficiency. Our results are promising. On average the tool manages to identify 80% of the relevant tests while recommending only 4% of the test cases in the full regression test suite.}},
author = {{Ekelund, Edward Dunn and Engström, Emelie}},
booktitle = {{2015 IEEE International Conference on Software Maintenance and Evolution (ICSME)}},
isbn = {{978-1-4673-7532-0}},
language = {{eng}},
publisher = {{IEEE - Institute of Electrical and Electronics Engineers Inc.}},
title = {{Efficient Regression Testing Based on Test History: An Industrial Evaluation}},
url = {{https://lup.lub.lu.se/search/files/5453229/7989670.pdf}},
doi = {{10.1109/ICSM.2015.7332496}},
year = {{2015}},
}