On the Road to Benchmarking BPMN 2.0 Workflow Engines

TitleOn the Road to Benchmarking BPMN 2.0 Workflow Engines
Publication TypeConference Paper
Year of Publication2015
AuthorsSkouradaki, M., V. Ferme, F. Leymann, C. Pautasso, and D. Roller
Conference Name6th ACM/SPEC International Conference on Performance Engineering
MonthJanuary
PublisherIEEE
Conference LocationAustin, TX, USA
KeywordsBenchFlow, benchmarking
Abstract

Workflow Management Systems (WfMSs) provide platforms for delivering complex service-oriented applications that need to satisfy enterprise-grade quality of service requirements such as dependability and scalability.
In this paper we focus on the case of benchmarking the performance of the core of WfMSs, Workflow Engines, that are compliant with the Business Process Model and Notation 2.0 (BPMN 2.0) standard.
We first explore the main challenges that need to be met when designing such a benchmark and describe the approaches we designed for tackling them in the BenchFlow project.
We discuss our approach to distill the essence of real-world processes to create from it processes for the benchmark, and to ensure that the benchmark finds wide applicability.

DOI10.1145/2668930.2695527
Citation Keybenchflow:2015:icpe