Solution to Mathematics for Machine Learning Exercise 7.2
Consider the update equation for stochastic gradient descent (Equation (7.15)). Write down the update when we use a mini-batch size of one. Solution: Let $a$ be any function from $\mathbb…
Consider the update equation for stochastic gradient descent (Equation (7.15)). Write down the update when we use a mini-batch size of one. Solution: Let $a$ be any function from $\mathbb…