Presentation of the 9th Edition of the Model Checking Contest

Elvio Amparore, Bernard Berthomieu, Gianfranco Ciardo, Silvano Dal Zilio, Francesco Gallà, Lom Messan Hillah, Francis Hulin-Hubard, Peter Gjøl Jensen, Loïg Jezequel, Fabrice Kordon, Didier Le Botlan, Torsten Liebke, Jeroen Meijer, Andrew Miner, Emmanuel Paviot-Adet, Jiří Srba, Yann Thierry-Mieg, Tom van Dijk, Karsten Wolf
In TACAS 2019 — Tools and Algorithms for the Construction and Analysis of Systems, apr 2019.

 PDF  DOI〈10.1007/978-3-030-17502-3_4〉  HAL-02094047

Abstract

#

The Model Checking Contest (MCC) is an annual competition of software tools for model checking. Tools must process an increasing benchmark gathered from the whole community and may participate in various examinations: state space generation, computation of global properties, computation of some upper bounds in the model, evaluation of reachability formulas, evaluation of CTL formulas, and evaluation of LTL formulas. For each examination and each model instance, participating tools are provided with up to 3600s and 16 gigabyte of memory. Then, tool answers are analyzed and confronted to the results produced by other competing tools to detect diverging answers (which are quite rare at this stage of the competition, and lead to penalties). For each examination, golden, silver, and bronze medals are attributed to the three best tools. CPU usage and memory consumption are reported, which is also valuable information for tool developers.

Citation

#

@InProceedings{DalzilioS:TOOLympics2019,
   author    = {Amparore, Elvio and Berthomieu, Bernard and Ciardo, Gianfranco and {Dal Zilio}, Silvano and Gallà, Francesco and Hillah, Lom Messan and Hulin-Hubard, Francis and Jensen, Peter Gjøl and Jezequel, Loïg and Kordon, Fabrice and {Le Botlan}, Didier and Liebke, Torsten and Meijer, Jeroen and Miner, Andrew and Paviot-Adet, Emmanuel and Srba, Jiří and Thierry-Mieg, Yann and {van Dijk}, Tom and Wolf, Karsten},
   title     = {{Presentation of the 9th Edition of the Model Checking Contest}},
   booktitle = {TACAS 2019 -- Tools and Algorithms for the Construction and Analysis of Systems},
   series    = {Lecture Notes in Computer Science},
   volume    = {11429},
   publisher = {Springer-Verlag},
   doi = {10.1007/978-3-030-17502-3_4},
   month     = apr, 
   year      = 2019
}