苏剑林
@Jianlin_S
Revisiting Convergence Results in Convex Optimization (IX)
https://kexue.fm/archives/11882revisits
AdaGrad, the seminal work on adaptive gradient algorithms, reproducing its full derivation via "convergence analysis → minimizing the upper bound → optimal preconditioning matrix."