Hiding Apache Spark Complexity for Fast Prototyping of Applications

174 views · Published 30 October 2017 · 22:00 · Indexed 25 October 2026

Channel: Databricks · 2017 · Science & Technology

Watch on YouTube

"In many cases, Big Data becomes just another buzzword because of the lack of tools that can  support both the technological requirements for developing and deploying of the projects and/or the fluency of communication between the different profiles of people involved in the projects. 

In this talk, we will present Moriarty,  a set of tools for fast prototyping of Big Data applications that can be deployed in an Apache Spark environment. These tools support the creation of Big Data workflows using the already existing functional blocks or supporting the creation of new functional blocks. The created workflow can then be deployed in a Spark infrastructure and used through a REST API.  

For better understanding of Moriarty, the prototyping process and the way it hides the Spark environment to the Big Data users and developers, we will present it together with a couple of examples based on a Industry 4.0 success cases and other on a logistic success case.

Talk by Rosa Montañés & Francisco Lacueva

Session hashtag: #EUent6"

About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unified-data-analytics-platform

Connect with us:
Website: https://databricks.com
Facebook: https://www.facebook.com/databricksinc
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks
Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner

More from this channel