2019-09-20 ML (draft)梯度下降算法 dummy RAWCODE Keys Newton Method Defination Draft Gradient descent BGD (batch gradient descent) SGD (stochastic gradient descent) MGD (mini-batch gradient descent) Algorithms Momentum NAG (Nesterov's accelerated gradient) Adagrad Adadelta Accumulate Over Window Correct Units with Hessian Approximation RMSprop Adam AdaMax Nadam AMSGrad Compare References 阅读全文…