Performance modeling and analysis of heterogeneous lattice Boltzmann simulations on CPU–GPU clusters

•Introduction of software design concepts for multi-GPU simulations.•A study on how to efficiently exploit heterogeneous compute nodes.•A detailed analysis of the performance of parallel multi-GPU.•Heterogeneous lattice Boltzmann simulations on Tsubame 2.0.•A performance model for the communication overhead.