Archive: Hogwild for Machine Learning on Multicore

3,426 views · Published 12 June 2014 · 51:23 · Indexed 12 November 2026

Channel: UW Video · 2014 · Education

Watch on YouTube

This program provides both theoretical and experimental evidence demonstrating the achievement of linear speedups on multicore workstations on several benchmark optimization problems. Stochastic Gradient Descent (SGD) is a popular optimization algorithm for solving data-driven machine learning problems such as classification, model selection, sequence labeling, and recommendation. SGD is well suited to processing large amounts of data due to its robustness against noise, rapid convergence rates, and predictable memory footprint. Learn how SGD can be implemented in parallel with minimal communication, with no locking or synchronization, and with strong spatial locality. Finally, hear a discussion of a challenging problem raised by our implementations relating arithmetic and geometric means of positive definite matrices.

Produced 5/3/2012

More from this channel