Archive: Naiad: A System for Incremental, Iterative and Interactive Parallel Computation

1,141 views · Published 13 November 2013 · 56:21 · Indexed 16 October 2026

Channel: UW Video · 2013 · Education

Watch on YouTube

In this talk, you'll hear about the development of a new system for large-scale data analysis -- called "Naiad" -- which has the goal of supporting complex iterative queries over dynamic inputs at interactive timescales. Like many existing systems, Naiad supports high-level declarative queries, data-parallel execution, and transparent distribution. Unlike these systems, Naiad can efficiently execute queries with multiple (possibly nested) iterative loops, while simultaneously supporting low-latency incremental changes to the query inputs.  

Hear the computational model underlying Naiad, a generalization of traditional incremental dataflow to partially ordered logical times, and work through some of the (very friendly, picture oriented) mathematical details.

More from this channel