Otavio Rodolfo Piske created CAMEL-20368:
--------------------------------------------

             Summary: Add batching consumers
                 Key: CAMEL-20368
                 URL: https://issues.apache.org/jira/browse/CAMEL-20368
             Project: Camel
          Issue Type: New Feature
          Components: camel-kafka
            Reporter: Claus Ibsen
            Assignee: Otavio Rodolfo Piske
             Fix For: 4.4.0


It would be good to make camel-kafka and camel-vertx-kafka consumer able to 
batch together N messages via aggregation strategy as a single outgoing 
exchange. The batch should support group size, and timeout.

Something that was in the sjms-batch component.

The batching should use the same KafkaConsumer instance and defer the commit 
till the batching has been done. This requires manual offset commit by the 
consumer.

The use-case has been discussed on the chat at
https://camel.zulipchat.com/#narrow/stream/257298-camel/topic/kafka.20and.20batching



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to