Kafka Workshop: How to Efficiently Use Kafka in a High-Volume Production Environment

This is code for a workshop hosted at the DraftKings Engineering Blog co-created by Martin Ivanov, Dimitar Nanov, Vadym Kutsenko and David Musicant.

This code, and the exercises, will help you learn:

1. When to use Kafka vs a message queue such as RabbitMQ
2. The key components of Kafka and how to properly tune them
3. Creating highly efficient Consumers to handle the data streams
4. Creating well configured Producers that are optimized for high throughput
5. How to use advanced configurations for cleanup policies, compression and more to fine tune your stream handling