Faster SGD Using Sketched Conditioning
CoRR, Volume abs/1506.02649, 2015.
We propose a novel method for speeding up stochastic optimization algorithms via sketching methods, which recently became a powerful tool for accelerating algorithms for numerical linear algebra. We revisit the method of conditioning for accelerating first-order methods and suggest the use of sketching methods for constructing a cheap c...More
PPT (Upload PPT)