Daniel Kulp created CAMEL-10065:
-----------------------------------

             Summary: Support Iterator<...> for kafka component
                 Key: CAMEL-10065
                 URL: https://issues.apache.org/jira/browse/CAMEL-10065
             Project: Camel
          Issue Type: Improvement
          Components: camel-kafka
            Reporter: Daniel Kulp
            Assignee: Daniel Kulp


The kafka component currently takes the body of the message and sends that 
directly into the kafka producer then sets the callback for when that 
particular message is delivered to the kafka server.   This works, but is slow, 
particularly for thousands of little messages.  (cannot really take advantage 
of the batching that is done in the kafka producer)

It would be good to allow the camel-kafka producer to accept various 
collections (Iterable and Iterator) and have it iterator through those creating 
kafka messages that can be uploaded and processed in a batch.  dataformats (and 
aggregator) that can produce those could benefit tremendously. 






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to