Optimization Nuggets: Stochastic Polyak Step-size, Part 2

less than 1 minute read


Fabian Pedregosa invited me to write a joint blog post on a convergence proof for the stochastic Polyak step size (SPS).

The post is part of his (quite awesome) blog post series Optimization Nuggets and can be found here.