Building a Big Data Collection and Processing System
236 views · Published 4 April 2017 · 34:48 · Indexed 30 October 2026
Channel: The Linux Foundation · 2017 · Science & Technology
In today's connected world, we see the need to build systems to collect, store, and process a large amount of data. For example, a municipal video surveillance system in a Chinese city collects live video feed from tens of thousands of cameras and generates peta-bytes of data every day. In this talk, we will discuss how to build a system that leverages Apache Mesos and Apache Hadoop to collect, store, and process live video data. Apache Mesos provides a common runtime platform for both Apache Hadoop and the computing cluster used to process the videos. We use containers to automate the deployment and management of all the moving parts in the system.
More from this channel
-
0:37
The Linux Foundation Video Site:: Chicks dig it
-
1:01
The Origin (Japanese Subtitles)
-
5:19
The Linux Foundation Video Site:: Flock
-
0:35
The Linux Foundation Video Site:: Gnu/Linux-Desktop
-
5:51
The Linux Foundation Video Site:: Debian & Cooliris
-
6:09
The Linux Foundation Video Site:: Slackware Linux
-
1:57
The Linux Foundation Video Site:: Bdale Garbee (Hewlett-Pack
-
1:12
The Linux Foundation Video Site:: James Morris (Red Hat) at