Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow using consumer group prefix when not using consumer group #17

Open
peter-quix opened this issue Dec 8, 2023 · 0 comments
Open

Comments

@peter-quix
Copy link
Contributor

Is your feature request related to a problem? Please describe.
While the title sounds counter intuitive, the problem is real. When there is no consumer group in use, librdkafka still requires a consumer group to connect to Kafka with, but it will not commit anything. Because of this quirk of the underlying library we need to be able to specify a prefix to use when a random consumer group is generated for this purpose.

Describe the solution you'd like
Add consumer_prefix="" in python and relevant in C# when opening a topic for consumption.

Describe alternatives you've considered
Not an alternative solution, but a bad workaround: specify consumer group with your prefix and a random id. Won't behave exactly the same, as by default commit is enabled, but future runs won't use it if you always use a new one.

Moved from quixio/quix-streams#116

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant