Hadoop on OpenStack: Scaling Hadoop-SwiftFS for Big Data

1,371 views · Published 29 October 2015 · 39:04 · Indexed 6 November 2026

Channel: OpenInfra Foundation · 2015 · Science & Technology

Watch on YouTube

Elastically scalable big data clusters that can respond to varying workload demands, while efficiently utilizing and sharing cloud resources, is a reality that is attainable with Hadoop on OpenStack.  To achieve that reality requires seperating cluster compute from cluster storage in order to enable scaling compute independently of data.  In this session we discuss how OpenStack Swift can serve as the basis for an elastically scalable Hadoop cluster on OpenStack and detail the challenges faced w

More from this channel