Comparison among several SGD derivation

http://www.denizyuret.com/2015/03/alec-radfords-animations-for.html

 

https://zhuanlan.zhihu.com/p/22252270