Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kafka producers experience frequent connection timeouts and message sending failures under high loads #754

Open
CCTV-six opened this issue Nov 21, 2024 · 0 comments

Comments

@CCTV-six
Copy link

CurrentBehavior

Kafka producers have experienced frequent connection timeouts and message sending failures under high loads. Producers occasionally throw org.apache.kafka.common.errors when calling the send() method TimeoutException
And I saw the following error message in the log:
[ERROR] KafkaProducer: Exception while sending a message:
org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node to become available.
at org.apache.kafka.clients.producer.internals.Sender.sendProducerData(Sender.java:435)
at org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:804)
at org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:748)

ExpectedBehavior

Producers should be able to maintain stable connections with Kafka clusters, and messages should be successfully sent even under high loads and network fluctuations.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant