PyData Ann Arbor: Bryan Witherspoon | Big(ish) Data: Scaling Up Customer-facing Logs

1,197 views · Published 22 September 2017 · 57:41 · Indexed 10 November 2026

Channel: PyData · 2017 · Science & Technology

Watch on YouTube

PyData Ann Arbor Meetup - September 14, 2017
Sponsored by NumFOCUS, TD Ameritrade, and MIDAS
https://www.meetup.com/PyData-Ann-Arbor/

PyData Ann Arbor: Bryan Witherspoon | Big(ish) Data: Scaling Up Customer-facing Logs

As an engineer on Duo Security's Data Engineering team, Bryan Witherspoon designs and develops solutions to improve the usability and scale of data within Duo's products and services. He occasionally tweets @uoodsq.

In a security product used to secure access to mission-critical applications, logging and auditing is incredibly important. Recently, Duo Security transitioned its authentication log storage from MySQL to Elasticsearch. In this talk, Bryan will talk about life before the transition, some of the reasons why they chose to make the transition, what went into the design process, the challenges they faced along the way, and the benefits they gained from the transition. 00:00 Welcome!
00:10 Help us add time stamps or captions to this video! See the description for details.

Want to help add timestamps to our YouTube videos to help with discoverability? Find out more here: https://github.com/numfocus/YouTubeVideoTimestamps

More from this channel