If you find any mistakes, please make a comment! Thank you.

## Solution to Mathematics for Machine Learning Exercise 7.2

Consider the update equation for stochastic gradient descent (Equation (7.15)). Write down the update when we use a mini-batch size of one. Solution: Let $a$ be any function from \$\mathbb…