PyData Tel Aviv Meetup: Analyzing Machine Generated Mail - Irena Grabovitch-Zuyev

734 views · Published 8 December 2017 · 27:33 · Indexed 6 November 2026

Channel: PyData · 2017 · Science & Technology

Watch on YouTube

PyData Tel Aviv Meetup #10
29 November 2017
Sponsored and Hosted by Kenshoo
https://www.meetup.com/PyData-Tel-Aviv/

Web Mail has grown significantly in the last decade, with 95% of its traffic being generated by automated scripts or “machines”. In this reality of an ever growing mailbox, you, the email user, rightfully expect your email provider to do a good job in organizing your electronic life.

In this talk we will discuss this challenge, and will present a classification algorithm for message clusters, developed by my team and myself at Yahoo research. The clusters of the messages are generated by a new clustering method, leveraging the HTML structure.

The classification algorithm was evaluated on a large scale experiment carried over real Yahoo mail traffic and achieved precision and recall rates between 85%-90%. It has been deployed in production in Yahoo mail backend and, as we speak, is sorting the messages in your Yahoo inbox.

Irena Grabovitch-Zuyev is a Senior Research Engineer in Yahoo Research (Oath). She received her bachelor's degree and a master's degree from the Technion. She is a past Google Anita Borg scholar, who strongly believes that increasing women’s representation in the tech is essential. After having several papers accepted to top conferences and filling a few patents, she is confidant that her 3 most successful projects are her kids. 

Irena's graduate studies focused on Information Retrieval in Social Networks. In her work in Yahoo, she is mainly working on Automatic Extraction and Classification using machine learning algorithms.

www.pydata.org

PyData is an educational program of NumFOCUS, a 501(c)3 non-profit organization in the United States. PyData provides a forum for the international community of users and developers of data analysis tools to share ideas and learn from each other. The global PyData network promotes discussion of best practices, new approaches, and emerging technologies for data management, processing, analytics, and visualization. PyData communities approach data science using many languages, including (but not limited to) Python, Julia, and R. 

Find a PyData chapter near you: meetup.com/pro/pydata 00:00 Welcome!
00:10 Help us add time stamps or captions to this video! See the description for details.

Want to help add timestamps to our YouTube videos to help with discoverability? Find out more here: https://github.com/numfocus/YouTubeVideoTimestamps

More from this channel