Powering NLU Engine with Apache Spark to Communicate with World with Rahul Kumar (I am+)
183 views · Published 11 October 2018 · 28:23 · Indexed 28 September 2026
Channel: Databricks · 2018 · Science & Technology
Building natural language processing engines is really a complex work. It requires an architecture where we glue many algorithms, data processing, and data storage techniques together to solve a single most important problem—how effectively we can understand users query in the form of text, voice, or visual gestures fast and effectively and respond them with zero error. Identifying the best tools available in the market and how we can fit these tools and libraries in our pipelines makes a great edge to build these systems. In this talk, I will give a deep knowledge of how we’re using Apache Spark in our NLU engine to solve a complex problem with ease. At the end of the talk, attendees will get a high-level architecture overview of our NLU engine, some TensorFlow introduction, and how they can use Apache Spark in ML and deep learning system. About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business. Read more here: https://databricks.com/product/unified-data-analytics-platform Connect with us: Website: https://databricks.com Facebook: https://www.facebook.com/databricksinc Twitter: https://twitter.com/databricks LinkedIn: https://www.linkedin.com/company/databricks Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner
More from this channel
-
10:06
Big Data Meets Learning Science
-
30:18
Yelp Ad Targeting at Scale with Apache Spark - Inaz Alaei-Novin and Joe Malicki
-
28:55
Scaling Up Data Science Applications with Kexin Xie and Yacov Salomon
-
31:03
Extending Spark Machine Learning: Adding Your Own Algorithms and Tools
-
23:09
The Key to Machine Learning is Prepping the Right Data - Jean Georges Perrin
-
30:16
Best Practices for Using Alluxio with Apache Spark - Cheng Chang & Haoyuan Li
-
27:41
Social Media, Spark, Machine Learning, and Data Visualization to Find Patterns and Insight
-
16:23
SparkOscope: Enabling Apache Spark Optimization through Cross Stack Monitoring - Yiannis Gkoufas