2019年3月29日
Freeze partial parameters while training
摘要： 1. requires_grad = False Set all parameters in the current model frozen: Filter some specific layers by name to be frozen: 2. Filter out unfrozen para 阅读全文
posted @ 2019-03-29 22:04 leizhao 阅读(270) 评论(0) 推荐(0)
Activation Functions
摘要： Sigmoid Sigmoids saturate and kill gradients. Sigmoid outputs are not zero-centered. Exponential function is a little computational expensive. Tanh Ki 阅读全文
posted @ 2019-03-29 19:35 leizhao 阅读(152) 评论(0) 推荐(0)
Basic Classifiers and Loss Functions
摘要： Linear Classifier and Hing Loss (or Multiclass SVM Loss) Linear Mapping (Score function) Linear Classifier Hinge Loss Regularization Softmax Classifie 阅读全文
posted @ 2019-03-29 16:26 leizhao 阅读(244) 评论(0) 推荐(0)