First international Competition on Runtime Verification: rules, benchmarks, tools, and final results of CRV 2014

Ezio Bartocci, Yliès Falcone, Borzoo Bonakdarpour, Christian Colombo, Normann Decker, Klaus Havelund, Yogi Joshi, Felix Klaedtke, Reed Milewicz, Giles Reger, Grigore Rosu, Julien Signoles, Daniel Thoma, Eugen Zalinescu, Yi Zhang

Research output: Contribution to journalArticle

Abstract

The first international Competition on Runtime Verification (CRV) was held in September 2014, in Toronto, Canada, as a satellite event of the 14th international conference on Runtime Verification (RV’14). The event was organized in three tracks: (1) offline monitoring, (2) online monitoring of C programs, and (3) online monitoring of Java programs. In this paper, we report on the phases and rules, a description of the participating teams and their submitted benchmark, the (full) results, as well as the lessons learned from the competition.

Original languageEnglish (US)
Pages (from-to)31-70
Number of pages40
JournalInternational Journal on Software Tools for Technology Transfer
Volume21
Issue number1
DOIs
StatePublished - Feb 6 2019

Fingerprint

Monitoring
Satellites

Keywords

  • Benchmarks
  • Monitoring
  • Runtime Verification
  • Software competition

ASJC Scopus subject areas

  • Software
  • Information Systems

Cite this

First international Competition on Runtime Verification : rules, benchmarks, tools, and final results of CRV 2014. / Bartocci, Ezio; Falcone, Yliès; Bonakdarpour, Borzoo; Colombo, Christian; Decker, Normann; Havelund, Klaus; Joshi, Yogi; Klaedtke, Felix; Milewicz, Reed; Reger, Giles; Rosu, Grigore; Signoles, Julien; Thoma, Daniel; Zalinescu, Eugen; Zhang, Yi.

In: International Journal on Software Tools for Technology Transfer, Vol. 21, No. 1, 06.02.2019, p. 31-70.

Research output: Contribution to journalArticle

Bartocci, E, Falcone, Y, Bonakdarpour, B, Colombo, C, Decker, N, Havelund, K, Joshi, Y, Klaedtke, F, Milewicz, R, Reger, G, Rosu, G, Signoles, J, Thoma, D, Zalinescu, E & Zhang, Y 2019, 'First international Competition on Runtime Verification: rules, benchmarks, tools, and final results of CRV 2014', International Journal on Software Tools for Technology Transfer, vol. 21, no. 1, pp. 31-70. https://doi.org/10.1007/s10009-017-0454-5
Bartocci, Ezio ; Falcone, Yliès ; Bonakdarpour, Borzoo ; Colombo, Christian ; Decker, Normann ; Havelund, Klaus ; Joshi, Yogi ; Klaedtke, Felix ; Milewicz, Reed ; Reger, Giles ; Rosu, Grigore ; Signoles, Julien ; Thoma, Daniel ; Zalinescu, Eugen ; Zhang, Yi. / First international Competition on Runtime Verification : rules, benchmarks, tools, and final results of CRV 2014. In: International Journal on Software Tools for Technology Transfer. 2019 ; Vol. 21, No. 1. pp. 31-70.
@article{e835d8d16e57436296682c653de58c15,
title = "First international Competition on Runtime Verification: rules, benchmarks, tools, and final results of CRV 2014",
abstract = "The first international Competition on Runtime Verification (CRV) was held in September 2014, in Toronto, Canada, as a satellite event of the 14th international conference on Runtime Verification (RV’14). The event was organized in three tracks: (1) offline monitoring, (2) online monitoring of C programs, and (3) online monitoring of Java programs. In this paper, we report on the phases and rules, a description of the participating teams and their submitted benchmark, the (full) results, as well as the lessons learned from the competition.",
keywords = "Benchmarks, Monitoring, Runtime Verification, Software competition",
author = "Ezio Bartocci and Yli{\`e}s Falcone and Borzoo Bonakdarpour and Christian Colombo and Normann Decker and Klaus Havelund and Yogi Joshi and Felix Klaedtke and Reed Milewicz and Giles Reger and Grigore Rosu and Julien Signoles and Daniel Thoma and Eugen Zalinescu and Yi Zhang",
year = "2019",
month = "2",
day = "6",
doi = "10.1007/s10009-017-0454-5",
language = "English (US)",
volume = "21",
pages = "31--70",
journal = "International Journal on Software Tools for Technology Transfer",
issn = "1433-2779",
publisher = "Springer Verlag",
number = "1",

}

TY - JOUR

T1 - First international Competition on Runtime Verification

T2 - rules, benchmarks, tools, and final results of CRV 2014

AU - Bartocci, Ezio

AU - Falcone, Yliès

AU - Bonakdarpour, Borzoo

AU - Colombo, Christian

AU - Decker, Normann

AU - Havelund, Klaus

AU - Joshi, Yogi

AU - Klaedtke, Felix

AU - Milewicz, Reed

AU - Reger, Giles

AU - Rosu, Grigore

AU - Signoles, Julien

AU - Thoma, Daniel

AU - Zalinescu, Eugen

AU - Zhang, Yi

PY - 2019/2/6

Y1 - 2019/2/6

N2 - The first international Competition on Runtime Verification (CRV) was held in September 2014, in Toronto, Canada, as a satellite event of the 14th international conference on Runtime Verification (RV’14). The event was organized in three tracks: (1) offline monitoring, (2) online monitoring of C programs, and (3) online monitoring of Java programs. In this paper, we report on the phases and rules, a description of the participating teams and their submitted benchmark, the (full) results, as well as the lessons learned from the competition.

AB - The first international Competition on Runtime Verification (CRV) was held in September 2014, in Toronto, Canada, as a satellite event of the 14th international conference on Runtime Verification (RV’14). The event was organized in three tracks: (1) offline monitoring, (2) online monitoring of C programs, and (3) online monitoring of Java programs. In this paper, we report on the phases and rules, a description of the participating teams and their submitted benchmark, the (full) results, as well as the lessons learned from the competition.

KW - Benchmarks

KW - Monitoring

KW - Runtime Verification

KW - Software competition

UR - http://www.scopus.com/inward/record.url?scp=85017167481&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85017167481&partnerID=8YFLogxK

U2 - 10.1007/s10009-017-0454-5

DO - 10.1007/s10009-017-0454-5

M3 - Article

AN - SCOPUS:85017167481

VL - 21

SP - 31

EP - 70

JO - International Journal on Software Tools for Technology Transfer

JF - International Journal on Software Tools for Technology Transfer

SN - 1433-2779

IS - 1

ER -