You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We've been testing a few Camel Kafka Connectors (more specifically PubSub source connector and Kafka source connector). And it looks like PubSub source connector is able to support at least once by ack the message via calling the oncompletion synchronization in the override commitRecord method.
However, for Kafka source connector, even if we disable auto commit, enable manual commit, create a new connector and task that extends the auto generated CamelKafkasourceSourceConnector and CamelKafkasourceSourceTask, and override the commitRecord in the extended task to get the KafkaManualCommit from the exchange's header and try to call it to commit, because the actual Kafka consumer and connector task are two different threads, the commit is never going to work as Kafka consumer can only be operated on the same thread. So, I am just wondering is there any approach that we can make the Camel Kafka source connector support at least once?
The text was updated successfully, but these errors were encountered:
We've been testing a few Camel Kafka Connectors (more specifically PubSub source connector and Kafka source connector). And it looks like PubSub source connector is able to support at least once by ack the message via calling the oncompletion synchronization in the override commitRecord method.
However, for Kafka source connector, even if we disable auto commit, enable manual commit, create a new connector and task that extends the auto generated CamelKafkasourceSourceConnector and CamelKafkasourceSourceTask, and override the commitRecord in the extended task to get the KafkaManualCommit from the exchange's header and try to call it to commit, because the actual Kafka consumer and connector task are two different threads, the commit is never going to work as Kafka consumer can only be operated on the same thread. So, I am just wondering is there any approach that we can make the Camel Kafka source connector support at least once?
The text was updated successfully, but these errors were encountered: