三、Perceiving and Understanding the Visual World——Lecture 7: Training Neural Networks

目录

• 框架
• Activation Functions
• Data Preprocessing
• Weight Initialization
• Model Ensembles
• Regularization
• Choosing Hyperparameters

框架

1. 一次性设置:激活函数，预处理，权值初始化，正则化，梯度检验
2. 动态训练:训练过程监控，参数更新，超参数优化
3. 评价:模型集成、测试时间增强、迁移学习

Activation Functions

Data Preprocessing

Weight Initialization

Model Ensembles

Regularization

Choosing Hyperparameters