AGUnet: Annotation-guided U-net for fast one-shot video object segmentation

•An annotation guided U-net is proposed to achieved fast video object segmentation.•The annotation information obtained by Siamese networks is incorporated into a U-net.•AGUnet can be trained in an end-to-end manner on datasets with only static images.•AGUnet is target-focusing and can quickly adapt the trained model to segment targets.•Experiments demonstrate the effectiveness and fast speed of the proposed AGUnet.