This research project aims to study the landscape of neural network. Even though neural network has been widely used in many fields such as computer vision and natural language processing, the nature of neural network and training process are still not well understood. Researchers have been able to train neural networks to reach very good accuracy, but the lack of deep understanding of the neural network makes the training process not robust.