Scheduled Restart Momentum for Accelerated Stochastic Gradient Descent

Mathematics

• Restart 100%
• Stochastic Gradient 98%
• Gradient Descent 92%
• Momentum 71%
• Training 56%
• Neural Networks 30%
• Error Rate 24%
• Benchmark 20%
• Image Classification 17%
• Accumulate 13%
• Descent Algorithm 13%
• Gradient Algorithm 13%
• Baseline 11%
• Optimization Methods 11%
• Schedule 11%
• Convex Optimization 11%
• Style 10%
• Time-varying 10%
• Rate of Convergence 8%
• Gradient 8%
• Iteration 6%
• Demonstrate 6%
• Zero 5%
• Generalization 5%
• Model 3%

Engineering & Materials Science

• Momentum 68%
• Deep neural networks 36%
• Image classification 13%
• Convex optimization 13%