Deep and interpretable regression models for ordinal outcomes

•We present interpretable ordinal DL models incorporating image and tabular data.•ONTRAMs are interpretable and achieve on-par performance with common DL models.•Model components possess a direct statistical interpretation on the odds scale.•ONTRAMs show a higher training efficiency for ordinal outcomes than softmax DL models.