Structural displacement estimation by a hybrid computer vision approach

•A novel structural displacement estimation approach integrating dense optical flow and template matching was proposed.•The proposed approach was evaluated in two large-scale shaking table tests.•The hybrid approach eliminated displacement drift caused by cumulative errors.•Stable and reliable estimation of structural displacement across various environments was achieved.