[
https://issues.apache.org/jira/browse/CAMEL-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268484#comment-17268484
]
Claus Ibsen commented on CAMEL-16064:
-------------------------------------
Also it may be worth to look at if we can add some support code in
camel-support for BatchingConsumer with code for handling the aggregation and
completion check based on size/timeout, and then the on completion logic to do
the commit.
As the sjms / jms component could potentially also have such feature.
And some other components as well.
> camel-vertx-kafka - Add batching consumer
> -----------------------------------------
>
> Key: CAMEL-16064
> URL: https://issues.apache.org/jira/browse/CAMEL-16064
> Project: Camel
> Issue Type: New Feature
> Components: camel-kafka
> Reporter: Claus Ibsen
> Priority: Major
> Fix For: 3.x
>
>
> It would be good to make camel-vertx-kafka consumer able to batch together N
> messages via aggregation strategy as a single outgoing exchange. The batch
> should support group size, and timeout.
> Something that was in the sjms-batch component.
> The batching should use the same KafkaConsumer instance and defer the commit
> till the batching has been done. This requires manual offset commit by the
> consumer.
> The use-case has been discussed on the chat at
> https://camel.zulipchat.com/#narrow/stream/257298-camel/topic/kafka.20and.20batching
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
