Temporal feature enhancement network with external memory for live-stream video object detection

•Aggregating features from only the past few frames can improve detection accuracy.•Aggregation by the attention mechanism performs better than similarity- based methods.•Aggregating coarse features can improve accuracy while keeping real-time performance.