Skip to content
This repository has been archived by the owner on Mar 24, 2021. It is now read-only.

Consuming messages from a simple consumer #968

Open
reutshal opened this issue Sep 18, 2019 · 0 comments
Open

Consuming messages from a simple consumer #968

reutshal opened this issue Sep 18, 2019 · 0 comments

Comments

@reutshal
Copy link

Hey,
I'm trying to consume messages from a topic using pykafka with no duplicates.
I'm interested in consuming messages every few minutes, so every time I will get only new messages.

I tried this (as a part of a function that will be called every few minutes):
image

but I'm getting the same messages every time.

I also tried to set the consumer like this:
image

with offset start from -2 and then update the offset according to the op.last_offset_consumed,
but it still didn't work.

Basically I tried to perform a very trivial Kafka pattern- consume new messages.

Any ideas for this?
I will appreciate your quick response.

Thank you!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant