PayPal Notebooks: Data science and machine learning at scale, powered by Jupyter

2,107 views · Published 10 October 2018 · 46:22 · Indexed 20 October 2026

Channel: O'Reilly · 2018 · Science & Technology

Watch on YouTube

PayPal Notebooks: Data science and machine learning at scale, powered by Jupyter
Romit Mehta (PayPal), Praveen Kanamarlapudi (PayPal)

PayPal Notebooks powered by Jupyter is new major ecosystem for data analytics and exploration at PayPal, with kernels, magics, and utilities for analytics and engineering. Hundreds of PayPal’s data scientists, analysts, and developers use Jupyter to access data spread across filesystem, relational, document, and key-value stores, enabling complex analytics and an easy way to build, train, and deploy machine learning models. Romit Mehta and Praveen Kanamarlapudi explain how PayPal built its Jupyter infrastructure and powerful extensions.

Topics include:

High availability: A grid of highly available servers ensures customers get a notebook instance immediately
PPMagics (PayPal Magics): An extension containing all PayPal magics to connect to any storage using any compute
Parameterized notebooks: An extension to make notebooks more interactive
Notebooks scheduling: An integration with Airflow to schedule notebooks
GitHub integration: An integration with PayPal’s enterprise GitHub repository to share and collaborate with notebooks
One-touch kernels: A simplified way to access any compute or storage
Unified Data API: An integration with PayPal’s unified data API to access almost any storage engine directly within notebooks

Subscribe to O'Reilly on YouTube: http://goo.gl/n3QSYi

Follow O'Reilly on: 
Twitter: http://twitter.com/oreillymedia
Facebook: http://facebook.com/OReilly
Instagram: https://www.instagram.com/oreillymedia
LinkedIn: https://www.linkedin.com/company-beta/8459/

More from this channel