Gopinath Sundaram created KAFKA-1587:
----------------------------------------
Summary: Possible Memory Leak when we use Kafka 8.0 Producer for
sending messages
Key: KAFKA-1587
URL: https://issues.apache.org/jira/browse/KAFKA-1587
Project: Kafka
Issue Type: Bug
Affects Versions: 0.8.0
Reporter: Gopinath Sundaram
Priority: Critical
Hi Kafka team,
We use Kafka to send messages in an high volume/memory crazy application which
uses Parallel GC. We send messages at the rate of 12500/min in the first few
hours and then the number of messages drop down to 6000/min. Our application
usually runs for a maximum of 24 hours
What we have:
1) When we do not send messages through Kafka Producer 0.8, then our
application never slows down much and our entire process completes within 24
hours
2) When we use Kafka, our machines slow down in sending messages to around
2500/min and as time progresses, the number of messages being sent is even
lesser
3) We suspect that our application spends more time in GC and hence the
problem. The Heap Dump does not contain an leak suspect with Kafka, but this
slowness happens only when Kafka messaging system is used.
Any pointers that could help us resolve this issue will be highly appreciated.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
