Know your enemy: benchmarking and experimenting with insight as a goal
Files
Accepted manuscript
Date
2022-12-05
DOI
Authors
Nicolella, Mattia
Hoornaert, Denis
Roozkhosh, Shahin
Bastoni, Andrea
Mancuso, Renato
Version
Accepted manuscript
OA Version
Citation
M. Nicolella, D. Hoornaert, S. Roozkhosh, A. Bastoni, R. Mancuso. 2022. "Know your Enemy: Benchmarking and Experimenting with Insight as a Goal" In Proceedings of the Open Demo Session of the 43rd Real-Time Systems Symposium (RTSS@Work).
Abstract
Available benchmark suites are used to provide realistic workloads and to understand their run-time characteristics. However, they do not necessarily target the same platforms and often offer a diverse set of metrics, leading to the lack of a knowledge base that could be used for both systems and theoretical research. RT-Bench, a new benchmark framework environment, tries to address these issues by providing a uniform interface and metrics while maintaining portability. This demo illustrates how to leverage this framework and its recently added features to improve the understanding of the benchmarks’ interaction with its system.