A Pattern Language for Workflow Engine Conformance and Performance Benchmarking

TitleA Pattern Language for Workflow Engine Conformance and Performance Benchmarking
Publication TypeConference Paper
Year of Publication2017
AuthorsSimon Harrer, Jörg Lenhard, Oliver Kopp, Vincenzo Ferme, and Cesare Pautasso
Conference Name22nd European Conference on Pattern Languages of Programs (EuroPLoP)
MonthJuly
PublisherACM
Conference LocationKloster Irsee, Germany
KeywordsBenchFlow, pattern language
Abstract

Workflow engines are frequently used in the domains of business process management, service orchestration, and cloud computing, where they serve as middleware platforms for integrated business applications. Engines have a significant impact on the quality of service provided by hosted applications. Therefore, it is desirable to compare them and to select the most appropriate engine for a given task. To enable such a comparison, approaches for benchmarking workflow engines have emerged. Although these approaches deal with different quality attributes, i.e., performance or standard conformance, they face many reoccurring design and implementation problems, which have been solved in similar ways. In this paper, we present a pattern language that captures such common solutions to reoccurring problems (e.g., from test identification, benchmarking procedure validation, automatic engine interaction, and workflow execution observation) in the area of workflow engine conformance and performance benchmarking. Our aim is to help future benchmark authors with the pattern language presented in this paper to benefit from our experience with the design and implementation of workflow engine benchmarks and benchmarking tools

DOI10.1145/3147704.3147705
Citation Key2017:europlop
Refereed DesignationRefereed