Hybrid Regression Test Selection

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Regression testing is crucial but can be extremely costly. Regression Test Selection (RTS) aims to reduce regression testing cost by only selecting and running the tests that may be affected by code changes. To date, various RTS techniques analyzing at different granularities (e.g., at the basic-block, method, and file levels) have been proposed. RTS techniques working on finer granularities may be more precise in selecting tests, while techniques working on coarser granularities may have lower overhead. According to a recent study, RTS at the file level (FRTS) can have less overall testing time compared with a finer grained technique at the method level, and represents state-of-the-art RTS. In this paper, we present the first hybrid RTS approach, HyRTS, that analyzes at multiple granularities to combine the strengths of traditional RTS techniques at different granularities. We implemented the basic HyRTS technique by combining the method and file granularity RTS. The experimental results on 2707 revisions of 32 projects, totalling over 124 Million LoC, demonstrate that HyRTS outperforms state-of-the-art FRTS significantly in terms of selected test ratio and the offline testing time. We also studied the impacts of each type of method-level changes, and further designed two new HyRTS variants based on the study results. Our additional experiments show that transforming instance method additions/deletions into file-level changes produces an even more effective HyRTS variant that can significantly outperform FRTS in both offline and online testing time.
Original languageEnglish (US)
Title of host publication2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE)
Number of pages11
ISBN (Print)978-1-5386-5293-0
StatePublished - Jun 3 2018
Externally publishedYes
Event2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE) - Gothenburg, Sweden
Duration: May 27 2018Jun 3 2018


Conference2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE)


  • Testing
  • Tools
  • Java
  • Runtime
  • Open source software


Dive into the research topics of 'Hybrid Regression Test Selection'. Together they form a unique fingerprint.

Cite this