The Foundation and Advances of Deep Learning

The past decade has witnessed the rapid development of feature representation learning, especially deep learning. Deep learning methods have achieved great success in many applications, including computer vision, and natural language processing. In this chapter, we present a short review of the foundation of deep learning, ie, artificial neural network, and introduce some new techniques in deep learning.