Look Who it Was Random video

Demystifying Kafka by Nakul Mishra

3,566 views · Published 15 November 2018 · 41:54 · Indexed 3 October 2026

Channel: Devoxx · 2018 · Science & Technology

Watch on YouTube

Subscribe to Devoxx on YouTube @ https://bit.ly/devoxx-youtube 
Like Devoxx on Facebook @ https://www.facebook.com/devoxxcom 
Follow Devoxx on Twitter @ https://twitter.com/devoxx

Kafka is an open-source distributed commit log addressing low latency, high throughput, scalability, fault-tolerance, and disk-based retention. It can be used to build tracking systems, messaging systems, high performance streaming platforms, real-time analysis, audit log….you name it. In our case, it’s been used to build a scalable event-store and messaging platform that stores billions of messages.

In this talk, we’re taking a closer look at essential Kafka concepts such as partition rebalancing, offset management, replication, producer/broker request fetching, file segments, etc. to understand what makes Kafka so scalable, resilient, performant and fault tolerant. We will also touch upon Kafka transactions to know what they are and how to leverage them. Last but not the least we will highlight some potential pitfalls that one should watch out when going to production with Kafka.

 
Nakul Mishra From Casumo
Senior Software engineer and consultant around JVM and related technologies. Prefer automation over manual configurations. Keen on continuous delivery, unit testing and code simplicity. Interested in developing applications that requires creativity, imagination, fast-learning and zest for putting theory into code.

More from this channel