by ,
We propose a parallel stochastic Newton method (PSN) for minimizing unconstrained smooth convex functions. We analyze the method in the strongly convex case, and give conditions under which acceleration can be expected when compared to its serial counter- part. We show how PSN can be applied to the large quadratic function minimization in general, and empirical risk minimization problems. We demonstrate the practical efficiency of the method through numerical experiments and models of simple matrix classes.
Parallel Stochastic Newton Method M. Mutný, P. RichtárikIn Journal of Computational Mathematics, volume 36, 2018
Bibtex Entry:
  author    = {Mutn{\'y}, Mojmir and Richt{\'a}rik, Peter},
  title     = {Parallel Stochastic Newton Method},
  journal   = {Journal of Computational Mathematics},
  year      = {2018},
  volume    = {36},
  number    = {3},
  pages     = {405-426},