Test input reduction for result inspection to facilitate fault localization

Dan Hao, Tao Xie, Lu Zhang, Xiaoyin Wang, Jiasu Sun, Hong Mei

Research output: Contribution to journalArticle

Abstract

Testing-based fault-localization (TBFL) approaches often require the availability of high-statement-coverage test suites that sufficiently exercise the areas around the faults. However, in practice, fault localization often starts with a test suite whose quality may not be sufficient to apply TBFL approaches. Recent capture/replay or traditional test-generation tools can be used to acquire a high-statement-coverage test collection (i.e., test inputs only) without expected outputs. But it is expensive or even infeasible for developers to manually inspect the results of so many test inputs. To enable practical application of TBFL approaches, we propose three strategies to reduce the test inputs in an existing test collection for result inspection. These three strategies are based on the execution traces of test runs using the test inputs. With the three strategies, developers can select only a representative subset of the test inputs for result inspection and fault localization. We implemented and applied the three test-input-reduction strategies to a series of benchmarks: the Siemens programs, DC, and TCC. The experimental results show that our approach can help developers inspect the results of a smaller subset (less than 10%) of test inputs, whose fault-localization effectiveness is close to that of the whole test collection.

Original languageEnglish (US)
Pages (from-to)5-31
Number of pages27
JournalAutomated Software Engineering
Volume17
Issue number1
DOIs
StatePublished - Mar 1 2010
Externally publishedYes

Keywords

  • Debugging
  • Fault localization
  • Test suite reduction
  • Testing

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Test input reduction for result inspection to facilitate fault localization'. Together they form a unique fingerprint.

  • Cite this