Cooperative Learning of Audio and Video Models from Self-Supervised Synchronization

Bruno Korbar
Bruno Korbar

ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018.

Cited by: 0|Bibtex|Views7|Links

Abstract:

There is a natural correlation between the visual and auditive elements of a video. In this work we leverage this connection to learn general and effective models for both audio and video analysis from self-supervised temporal synchronization. We demonstrate that a calibrated curriculum learning scheme, a careful choice of negative exampl...More

Code:

Data:

Your rating :
0

 

Tags
Comments