M3Net: A multi-scale multi-view framework for multi-phase pancreas segmentation based on cross-phase non-local attention

•A multi-scale multi-view segmentation framework for accurate multi-phase pancreas segmentation.•A novel cross-phase segmentation network based on dual path segmentation models.•M3Net well segment both the normal and abnormal pancreases, and accurately delineate the external contours of the pancreas with lesion occupancy.•Cross-phase non-local attention is promoted to explore location and channel noneuclidean relationships between phases.