Customizable Scalable Compute Intensive Stream Queries

745 views · Published 9 October 2007 · 46:04 · Indexed 20 September 2026

Channel: Google TechTalks · 2007 · Howto & Style

Watch on YouTube

Google TechTalks
July 11, 2006

Tore Risch

ABSTRACT
GSDM is a data stream management system running on cluster computers. The system is extensible through user-defined data representations and computations. The computations are specified as stream queries continuously computed over windows of data sliding over the streams.

Our applications include a virtual radio telescope requiring advanced computations over huge streams of data. The system needs to be highly scalable w.r.t. both data and computations. Rather than providing only built-in distribution strategies, the system allows the user to define distribution templates to specify customized distribution strategies for user functions in...

More from this channel