Powering NLU Engine with Apache Spark to Communicate with World with Rahul Kumar (I am+)

183 views · Published 11 October 2018 · 28:23 · Indexed 28 September 2026

Channel: Databricks · 2018 · Science & Technology

Watch on YouTube

Building natural language processing engines is really a complex work. It requires an architecture where we glue many algorithms, data processing, and data storage techniques together to solve a single most important problem—how effectively we can understand users query in the form of text, voice, or visual gestures fast and effectively and respond them with zero error. Identifying the best tools available in the market and how we can fit these tools and libraries in our pipelines makes a great edge to build these systems.

In this talk, I will give a deep knowledge of how we’re using Apache Spark in our NLU engine to solve a complex problem with ease. At the end of the talk, attendees will get a high-level architecture overview of our NLU engine, some TensorFlow introduction, and how they can use Apache Spark in ML and deep learning system.

About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unified-data-analytics-platform

Connect with us:
Website: https://databricks.com
Facebook: https://www.facebook.com/databricksinc
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks
Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner

More from this channel