RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Environment

379 views · Published 12 June 2017 · 35:11 · Indexed 10 November 2026

Channel: Databricks · 2017 · Science & Technology

Watch on YouTube

"The retail industry has a long history of fierce competition leading to innovations in marketing and operational efficiencies; however, this rapid advancement has not always kept pace with the latest advances in technology. This is evident by the abundance of business analysts at large enterprise retailers who are often constrained more by their own IT departments than by a lack of expertise or problems to solve.

RubiOne was designed as a vertically-integrated big data analytics development environment for retail business analysts and data scientists, with Apache Spark as the cornerstone of the product.  It allows retailers to make data-driven decisions going beyond traditional analytics tools such as SQL and Excel. Using Apache Spark as one of the primary tools to query data and perform analytics, issues such as package installation, computational resources, and scalability are seamlessly handled by RubiOne.

In this session, you will learn how Apache Spark can serve as a shared backbone for an entire suite of enterprise services such as credential management, continuous integration, ad-hoc interactive data exploration, and task automation, while still maintaining hard enterprise requirements around security, availability, and cost. Learn from our war stories and best practices around transparently scaling Apache Spark clusters with Kubernetes, managing service and user isolation, and monitoring accurate enough for both debugging and billing.  Beyond the technical aspects, we’ll also share our experiences of working with a global enterprise retailer to drive adoption of a modern big data technology stack centered around Apache Spark.

Session hashtag: #SFeco20"

About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unified-data-analytics-platform

Connect with us:
Website: https://databricks.com
Facebook: https://www.facebook.com/databricksinc
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks
Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner

More from this channel