Interactive Dashboard for Workflow Engine Benchmarks

Today, more and more companies model their business processes using languages such as Business Process Model and Notation (BPMN) or Business Process Execution Language (BPEL), and automate their processes by executing these models on appropriate workflow engines. To help choose the best fitting engine among different alternatives, several benchmarking initiatives have emerged, e.g., the BPEL/BPMN Engine Test System (betsy) that benchmarks conformance and expressiveness, and BenchFlow that benchmarks performance. However, their results are hard to analyze and compare for the typical end-user, developer or researcher. This paper tries to solve this issue by introducing (a) a common data model which can hold data of both betsy and BenchFlow tests and their results, (b) a transformer that can automatically transform the results of betsy and BenchFlow runs into the common data model, and (c) an interactive dashboard that visualizes the results according to the most important use cases. Hence, it enables the end-users, developers and researchers to analyze and compare the engines in a straight-forward manner.