Maciej Bryński created KAFKA-6626:
-------------------------------------
Summary: Performance bottleneck in Kafka Connect sendRecords
Key: KAFKA-6626
URL: https://issues.apache.org/jira/browse/KAFKA-6626
Project: Kafka
Issue Type: Bug
Affects Versions: 1.0.0
Reporter: Maciej Bryński
Attachments: MapPerf.java, image-2018-03-08-08-35-19-247.png
Kafka Connect is using IdentityHashMap for storing records.
[https://github.com/apache/kafka/blob/trunk/connect/runtime/src/main/java/org/apache/kafka/connect/runtime/WorkerSourceTask.java#L239]
Unfortunately this solution is very slow (2 times slower than normal HashMap /
HashSet).
Benchmark result (code in attachment).
{code:java}
Identity 3977
Set 2442
Map 2207
Fast Set 2067
{code}
This problem is greatly slowing Kafka Connect.
!image-2018-03-08-08-35-19-247.png!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
