Practical regression test selection with dynamic file dependencies

Milos Gligoric, Lamyaa Eloussi, Darko Marinov

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Regression testing is important but can be time-intensive. One approach to speed it up is regression test selection (RTS), which runs only a subset of tests. RTS was proposed over three decades ago but has not been widely adopted in practice. Meanwhile, testing frameworks, such as JUnit, are widely adopted and well integrated with many popular build systems. Hence, integrating RTS in a testing framework already used by many projects would increase the likelihood that RTS is adopted. We propose a new, lightweight RTS technique, called Ekstazi, that can integrate well with testing frameworks. Ekstazi tracks dynamic dependencies of tests on files, and unlike most prior RTS techniques, Ekstazi requires no integration with version-control systems. We implemented Ekstazi for Java and JUnit, and evaluated it on 615 revisions of 32 open-source projects (totaling almost 5M LOC) with shorter-and longer-running test suites. The results show that Ekstazi reduced the end-to-end testing time 32% on average, and 54% for longer-running test suites, compared to executing all tests. Ekstazi also has lower end-to-end time than the existing techniques, despite the fact that it selects more tests. Ekstazi has been adopted by several popular open source projects, including Apache Camel, Apache Commons Math, and Apache CXF.

Original languageEnglish (US)
Title of host publication2015 International Symposium on Software Testing and Analysis, ISSTA 2015 - Proceedings
PublisherAssociation for Computing Machinery, Inc
Pages211-222
Number of pages12
ISBN (Electronic)9781450336208
DOIs
StatePublished - Jul 13 2015
Event24th International Symposium on Software Testing and Analysis, ISSTA 2015 - Baltimore, United States
Duration: Jul 13 2015Jul 17 2015

Publication series

Name2015 International Symposium on Software Testing and Analysis, ISSTA 2015 - Proceedings

Other

Other24th International Symposium on Software Testing and Analysis, ISSTA 2015
CountryUnited States
CityBaltimore
Period7/13/157/17/15

Keywords

  • File dependencies
  • Regression test selection

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Practical regression test selection with dynamic file dependencies'. Together they form a unique fingerprint.

Cite this