Ensemble Adaptation Networks with low-cost unsupervised hyper-parameter search
PATTERN ANALYSIS AND APPLICATIONS(2019)
摘要
The development of deep learning makes the learning model have more parameters to be learned, and it means that sufficient samples are needed. On the other hand, it is extremely difficult to find tons of labels to support model training process. The existing methods can extend the model to a new domain by looking for domain-invariant features from different domains. In this paper, we propose a novel deep domain adaptation model. Firstly, we try to make a variety of statistics working on high-level feature layers at the same time to obtain better performance. What is more, inspired by the active learning, we propose ‘uncertainty’ metric to search for hyper-parameters under unsupervised setting. The ‘uncertainty’ uses entropy to describe the learning status of the current discriminator. The smaller the ‘uncertainty’, the more stable the discriminator predicts the data. Finally, the network parameters are obtained by fine-tuning a generic pre-trained deep network. As a conclusion, the performance of our algorithm has been further improved over other compared algorithms on standard benchmarks.
更多查看译文
关键词
Unsupervised domain adaptation,Unsupervised hyper-parameter search,Domain-invariant feature learning
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络