JaConTeBe: A benchmark suite of real-world Java concurrency bugs

Ziyi Lin, Darko Marinov, Hao Zhong, Yuting Chen, Jianjun Zhao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Researchers have proposed various approaches to detect concurrency bugs and improve multi-threaded programs, but performing evaluations of the effectiveness of these approaches still remains a substantial challenge. We survey the existing evaluations and find out that they often use code or bugs not representative of real world. To improve representativeness, we have prepared JaConTeBe, a benchmark suite of 47 confirmed concurrency bugs from 8 popular open-source projects, supplemented with test cases for reproducing buggy behaviors. Running three approaches on JaConTeBe shows that our benchmark suite confirms some limitations of the three approaches. We submitted JaConTeBe to the SIR repository (a software-artifact repository for rigorous controlled experiments), and it was included as a part of SIR.

Original languageEnglish (US)
Title of host publicationProceedings - 2015 30th IEEE/ACM International Conference on Automated Software Engineering, ASE 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages178-189
Number of pages12
ISBN (Electronic)9781509000241
DOIs
StatePublished - Jan 4 2016
Event30th IEEE/ACM International Conference on Automated Software Engineering, ASE 2015 - Lincoln, United States
Duration: Nov 9 2015Nov 13 2015

Publication series

NameProceedings - 2015 30th IEEE/ACM International Conference on Automated Software Engineering, ASE 2015

Other

Other30th IEEE/ACM International Conference on Automated Software Engineering, ASE 2015
CountryUnited States
CityLincoln
Period11/9/1511/13/15

Keywords

  • Benchmark suite
  • Evaluations
  • JaConTeBe
  • Java concurrency bugs
  • SIR

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'JaConTeBe: A benchmark suite of real-world Java concurrency bugs'. Together they form a unique fingerprint.

  • Cite this

    Lin, Z., Marinov, D., Zhong, H., Chen, Y., & Zhao, J. (2016). JaConTeBe: A benchmark suite of real-world Java concurrency bugs. In Proceedings - 2015 30th IEEE/ACM International Conference on Automated Software Engineering, ASE 2015 (pp. 178-189). [7372007] (Proceedings - 2015 30th IEEE/ACM International Conference on Automated Software Engineering, ASE 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ASE.2015.87