This thesis aimed to utilize prior learning on the early period of training and OOD generalization to improve the efficiency of training and create efficient architecture. The student should have a strong math/ML background.