## Solution to Mathematics for Machine Learning Exercise 7.2

Consider the update equation for stochastic gradient descent (Equation (7.15)). Write down the update when we use a mini-batch size of one. Solution: Let $a$ be any function from $\mathbb…

Consider the update equation for stochastic gradient descent (Equation (7.15)). Write down the update when we use a mini-batch size of one. Solution: Let $a$ be any function from $\mathbb…