Deep Learning Neural Networks Shallow Neural Networks Deep Neural Networks Activation Functions Loss Functions Gradient Descent Stochastic Gradient Descent Backpropagation Weight Initialization Regularization Dropout Batch Normalization Optimization Algorithms Model Evaluation Training Dynamics