Re: Apache Kafka Memory Leakage???

2019-03-07 Thread Syed Mudassir Ahmed
>> >> >>>>>> Hi Syed, > >> >> >>>>>> > >> >> >>>>>> let's keep it on the list for now so that everybody can > >> >> participate :) > >> >> >>>>>> > >> >> &g

Re: Apache Kafka Memory Leakage???

2019-03-06 Thread Sönke Liebau
re. Have you >> tried >> >> >>>>>> that? >> >> >>>>>> >> >> >>>>>> Best regards, >> >> >>>>>> Sönke >> >> >>>>>> >> >> >>>>>> On Mon, Mar

Re: Apache Kafka Memory Leakage???

2019-03-06 Thread Syed Mudassir Ahmed
gt;>>> pls? Let me know your availability. I can share zoom meeting > >> link. > >> >>>>>> > > >> >>>>>> > Thanks, > >> >>>>>> > > >> >>>>>> > > >> >&

Re: Apache Kafka Memory Leakage???

2019-03-05 Thread Sönke Liebau
gt;>> >> Hi Syed, >> >>>>>> >> >> >>>>>> >> from your screenshot I assume that you are using SnapLogic to >> run >> >>>>>> your >> >>>>>> >> code (full disclosure: I do

Re: Apache Kafka Memory Leakage???

2019-03-05 Thread Syed Mudassir Ahmed
Allocated reflects > >>>>>> the > >>>>>> >> number of bytes that were allocated by the Snap. Note that this > >>>>>> >> number does not reflect the amount of memory that was freed and > it > >>>>>>

Re: Apache Kafka Memory Leakage???

2019-03-05 Thread Sönke Liebau
s freed and it >>>>>> is >>>>>> >> not the peak memory usage of the Snap. So, it is not necessarily a >>>>>> >> metric that can be used to estimate the required size of a Snaplex >>>>>> >> node. Rather, the number provides an insight into how much memory

Re: Apache Kafka Memory Leakage???

2019-03-05 Thread Syed Mudassir Ahmed
> >> other statistics, this number can help to identify the potential >>>>> >> causes of performance issues." >>>>> >> The part about not reflecting memory that was freed makes me >>>>> somewhat >>>>> >> d

Re: Apache Kafka Memory Leakage???

2019-03-05 Thread Sönke Liebau
t; >> work without dependencies for 2 hours and saw no unusual memory >>>> >> consumption, just a regular garbage collection sawtooth pattern. That >>>> >> being said, I had to replace your actual processing with a simple >>>> >> println, so

Re: Apache Kafka Memory Leakage???

2019-03-05 Thread Syed Mudassir Ahmed
ction sawtooth pattern. That >>> >> being said, I had to replace your actual processing with a simple >>> >> println, so if there is a memory leak in there I would of course not >>> >> have noticed. >>> >> I've uploaded the code I ran [1] for reference. Fo

Re: Apache Kafka Memory Leakage???

2019-03-04 Thread Sönke Liebau
. >> >> >> >> Also, two random observations on your code: >> >> >> >> KafkaConsumer.poll(Long timeout) is deprecated, you should consider >> >> using the overloaded version with a Duration parameter instead. >> >> >> >> The comment at [2] seems to contradic

Re: Apache Kafka Memory Leakage???

2019-03-04 Thread Syed Mudassir Ahmed
gest mode. But as I have no idea > >> what suggest mode even is or all this means this observation may be > >> miles of point :) > >> > >> I hope that helps a little. > >> > >> Best regards, > >> Sönke > >> > >> [1] >

Re: Apache Kafka Memory Leakage???

2019-03-04 Thread Sönke Liebau
gt; [2] >> https://gist.github.com/soenkeliebau/e77e8665a1e7e49ade9ec27a6696e983#file-memoryleak-java-L86 >> >> >> On Fri, Mar 1, 2019 at 7:35 AM Syed Mudassir Ahmed >> wrote: >> > >> > >> > Thanks, >> > >> > >

Re: Apache Kafka Memory Leakage???

2019-03-03 Thread Syed Mudassir Ahmed
ir Ahmed > wrote: > > > > > > Thanks, > > > > > > > > -- Forwarded message - > > From: Syed Mudassir Ahmed > > Date: Tue, Feb 26, 2019 at 12:40 PM > > Subject: Apache Kafka Memory Leakage??? > > To:

Re: Apache Kafka Memory Leakage???

2019-03-01 Thread Sönke Liebau
Mar 1, 2019 at 7:35 AM Syed Mudassir Ahmed wrote: > > > Thanks, > > > > -- Forwarded message - > From: Syed Mudassir Ahmed > Date: Tue, Feb 26, 2019 at 12:40 PM > Subject: Apache Kafka Memory Leakage??? > To: > Cc: Syed Mudassir Ahmed > >

Fwd: Apache Kafka Memory Leakage???

2019-02-28 Thread Syed Mudassir Ahmed
Thanks, -- Forwarded message - From: Syed Mudassir Ahmed Date: Tue, Feb 26, 2019 at 12:40 PM Subject: Apache Kafka Memory Leakage??? To: Cc: Syed Mudassir Ahmed Hi Team, I have a java application based out of latest Apache Kafka version 2.1.1. I have a consumer