Global Benchmark Database

Global Benchmark Database
Iser, Markus, and Jabs, Christoph
2024
In 27th International Conference on Theory and Applications of Satisfiability Testing (SAT 2024), vol. 305, pp. 18:1–18:10, 2024

Links

    1. PDF
    2. Code
    3. URL
    4. DOI
    5. arXiv

  1. Abstract

    This paper presents Global Benchmark Database (GBD), a comprehensive suite of tools for provisioning and sustainably maintaining benchmark instances and their metadata. The availability of benchmark metadata is essential for many tasks in empirical research, e.g., for the data-driven compilation of benchmarks, the domain-specific analysis of runtime experiments, or the instance-specific selection of solvers. In this paper, we introduce the data model of GBD as well as its interfaces and provide examples of how to interact with them. We also demonstrate the integration of custom data sources and explain how to extend GBD with additional problem domains, instance formats and feature extractors.

    Bibtex

    @inproceedings{IserJabs2024GlobalBenchmarkDatabase,
  author = {Iser, Markus and Jabs, Christoph},
  title = {Global Benchmark Database},
  booktitle = {27th International Conference on Theory and Applications of Satisfiability Testing ({SAT} 2024)},
  year = {2024},
  pages = {18:1--18:10},
  editor = {Chakraborty, Supratik and Jiang, Jie-Hong Roland},
  publisher = {Schloss Dagstuhl---Leibniz-Zentrum f{\"{u}}r Informatik},
  address = {Dagstuhl, Germany},
  series = {Leibniz International Proceedings in Informatics ({LIPIcs})},
  isbn = {978-3-95977-334-8},
  issn = {1868-8969},
  volume = {305},
  eprinttype = {arXiv},
  url = {https://drops.dagstuhl.de/entities/document/10.4230/LIPIcs.SAT.2024.18},
  doi = {10.4230/LIPIcs.SAT.2024.18},
}