Resource-Aware Optimal Scheduling of In Situ Analysis

This chapter describes methodologies to perform in situ computations at desired intervals along with the simulations for different execution modes. This needs to be done in a way such that the simulation throughput is minimally impacted and the analysis output is available immediately within desired intervals. We describe the formulation of optimal resource allocation for simulation and in situ analysis computations as constrained integer linear programs so that the end-to-end simulation-analysis time is minimized. In particular, we describe the scheduling of in situ analyses as a numerical optimization problem to maximize the number of online analyses and minimize overall runtime, subject to resource constraints such as I/O bandwidth, network bandwidth, rate of computation and available memory. We also demonstrate the effectiveness of our approach through real application case studies on supercomputers.