ClimateBench: A benchmark for data-driven climate projections

<p>Exploration of future emissions scenarios mostly relies on one-dimensional impulse response models, or simple pattern scaling approaches to approximate the physical climate response to a given scenario. Such approaches are unable to reliably predict climate variables which respond non-linearly to emissions or forcing (such as precipitation) and must rely on heavily simplified representations of e.g., aerosol, neglecting important spatial dependencies.</p><p>Here we present ClimateBench - a benchmark dataset based on a suite of CMIP, AerChemMIP and DAMIP simulations performed by NorESM2, and a set of baseline machine learning models that emulate its response to a variety of forcers. These surrogate models can skilfully predict annual mean global distributions of temperature, diurnal temperature range and precipitation (including extreme precipitation) given a wide range of emissions and concentrations of carbon dioxide, methane and spatially resolved aerosol. We discuss the accuracy and interpretability of these emulators and consider their robustness to physical constraints such as total energy conservation. Future opportunities incorporating such physical constraints directly in the machine learning models and using the emulators for detection and attribution studies are also discussed. This opens a wide range of opportunities to improve prediction, consistency and mathematical tractability.</p><p>We hope that by defining a clear baseline with appropriate metrics and providing a variety of baseline models we can bring the power of modern machine learning techniques to bear on the important problem of efficiently and robustly sampling future climates.</p>