End-to-End diagnosis of breast biopsy images with transformers

•An end-to-end computer-aided diagnostic system that classifies the full spectrum of breast cancer diagnoses (benign, atypia, ductal carcinoma in situ, and invasive cancer).•Learns to find important biomarkers (stromal tissue and ducts) in the diagnosis and classification of breast tissue without any supervision.•Comparable performance to 87 U.S. pathologists who independently interpreted the same cases.