If you find any mistakes, please make a comment! Thank you.

Solution to Mathematics for Machine Learning Exercise 7.2


Consider the update equation for stochastic gradient descent (Equation (7.15)). Write down the update when we use a mini-batch size of one.


Solution: Let a be any function from Z+ to {1,,n}. Then θi+1=θiγi(La(i)(θi)).The point is using single Lj instead of all L1,,Ln.

Linearity

This website is supposed to help you study Linear Algebras. Please only read these solutions after thinking about the problems carefully. Do not just copy these solutions.
Close Menu
Close Menu