Optimization problems arise naturally in statistical machine learning and other fields concerned with data analysis. The rapid growth in the scale and complexity of modern data sets has led to a focus on gradient-based methods such as gradient descent and mirror descent...