This little result came up when proving the convergence of a stochastic gradient algorithm and I want to write it down to remember it after discussions with Matt Johnson and Alex Tank.

Let \(a_1, a_2, \ldots\) be a positive sequence of numbers. If \(\sum_{n=1}^\infty \frac{1}{n ...