Omri Tavor created CAMEL-12492:
----------------------------------
Summary: Camel kafka producer is blocking
Key: CAMEL-12492
URL: https://issues.apache.org/jira/browse/CAMEL-12492
Project: Camel
Issue Type: Bug
Components: camel-kafka
Affects Versions: 2.21.0
Environment: Windows/Centos
Reporter: Omri Tavor
Camel Kafka producer (org.apache.camel.component.kafka.KafkaProducer) is
blocking on the Kafka producer
(org.apache.kafka.clients.producer.KafkaProducer) callback. This highly affects
performance when there is a big latency between the client and the Kafka
server. For example, if there is a latency of 100ms between the servers, then
the Kafka producer will run at a throughput of 10 events per second (per Camel
worker thread). This means that each worker thread will only handle one kafka
event at a time resulting in very bad performance.
Changing the 'Process()' method in
org.apache.camel.component.kafka.KafkaProducer to always return true (work
synchronously) will boost performance on a machine with a latency of 150mb-
from 6 events per second to 5000 events per second.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
