Fully-automated alignment of 3D fetal brain ultrasound to a canonical reference space using multi-task learning

•We propose a FCN to automatically co-align 3D fetal neurosonography images.•The multi-task FCN predicts skull boundaries, eye location, and 3D brain orientation.•Our proposed brain alignment method is invariant to fetal size and gestational age.•Structural and anatomical correspondence was achieved in 88% of 140 tested volumes.