Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can we do dynamic rewind in setting offset to earlier point on the fly? #844

Closed
hothero opened this issue Dec 6, 2024 · 1 comment
Closed

Comments

@hothero
Copy link

hothero commented Dec 6, 2024

We used to do something like

doRewind(topicAndTime); // reset offset based on the topic and partition
kafkaConsumer.poll(getPollTimeMillis());

however, based on the parallel-consumer's architecture diagram, there is a work state management. We're not sure if we can directly manage that. Could you please advice? Is there any way that we can update the offset on the fly while the consumers are still consuming messages?

Note: our consumer has self-protection mechanism to process "new" data only, so no concern to us to do so in real time.

@hothero
Copy link
Author

hothero commented Dec 9, 2024

#782 covered

@hothero hothero closed this as completed Dec 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant