Pallavi Rao – Let your Big Data Processing take flight with Apache Falcon

864 views · Published 31 July 2016 · 28:59 · Indexed 27 October 2026

Channel: Hasgeek TV · 2016 · Science & Technology

Watch on YouTube

Slides: https://www.slideshare.net/secret/FxSYwsWYxLOzXb

At InMobi, a mobile advertising company, we see events arriving in excess of 10 billion per day. Analysis, reporting and inferencing from these requests (and responses served) is key to serving the right ad, to the right person, at the right time. We have nearly 200 complex big data pipelines that run against various data sources. Managing so many pipelines and the associated data was becoming a challenge and that is when we created an orchestration and data lifecycle management framework called Falcon. After benefiting immensely from this, we open sourced the product and it is now a Top Level Apache Project. The product was initially developed at InMobi Labs in India and now has many contributors and users from across the world. In this presentation we walk you through Apache Falcon and show how it has simplified our lives at InMobi.

More from this channel