I am updating & adding few fields in csv. Hence used UpdateRecord..
Thanks & Regards,
Prashanth
From: Mark Payne [mailto:marka...@hotmail.com]
Sent: Wednesday, June 13, 2018 10:49 PM
To: users@nifi.apache.org
Subject: Re: NiFi Performance Analysis Clarification
Prashanth,
Also of note,
al Message-
From: Joe Witt [mailto:joe.w...@gmail.com]
Sent: Wednesday, June 13, 2018 6:04 PM
To: users@nifi.apache.org<mailto:users@nifi.apache.org>
Subject: Re: NiFi Performance Analysis Clarification
Prasanth
I strongly recommend you reduce your JVM heap size for NiFi to 2 or 4 and no
mor
anks for the reply. Please find the comments inline.
Thanks & Regards,
Prashanth
From: Mark Payne [mailto:marka...@hotmail.com]
Sent: Wednesday, June 13, 2018 6:07 PM
To: users@nifi.apache.org<mailto:users@nifi.apache.org>
Subject: Re: NiFi Performance Analysis Clarification
Prashant
Mark,
Thanks for the reply. Please find the comments inline.
Thanks & Regards,
Prashanth
From: Mark Payne [mailto:marka...@hotmail.com]
Sent: Wednesday, June 13, 2018 6:07 PM
To: users@nifi.apache.org
Subject: Re: NiFi Performance Analysis Clarification
Prashanth,
Whenever the Flow
Joe,
Thanks for the reply. Please find the answers inline.
Thanks & Regards,
Prashanth
-Original Message-
From: Joe Witt [mailto:joe.w...@gmail.com]
Sent: Wednesday, June 13, 2018 6:04 PM
To: users@nifi.apache.org
Subject: Re: NiFi Performance Analysis Clarification
Pras
o: users@nifi.apache.org; Mike Thomsen
Cc: users@nifi.apache.org; pierre.villard...@gmail.com
Subject: Re: NiFi Performance Analysis Clarification
Prashanth - just out of curiosity could you share the average size of those
Avro files you are pushing to Kafka? It would be nice to know for so
okia.com>>
Cc: users@nifi.apache.org<mailto:users@nifi.apache.org>;
pierre.villard...@gmail.com<mailto:pierre.villard...@gmail.com>
Subject: Re: NiFi Performance Analysis Clarification
Relevant: http://www.idata.co.il/2016/09/moving-binary-data-with-kafka/
If you're throwing 1MB and b
M
> To: Mike Thomsen
> Cc: users@nifi.apache.org; pierre.villard...@gmail.com
> Subject: RE: NiFi Performance Analysis Clarification
>
>
> Hi Mike,
>
>
>
> Thanks for the reply. Actually , we did all those optimisations with kafka.
> I am converting to avro, also I config
)
Sent: Wednesday, June 13, 2018 8:10:27 AM
To: Mike Thomsen
Cc: users@nifi.apache.org; pierre.villard...@gmail.com
Subject: RE: NiFi Performance Analysis Clarification
Hi Mike,
Thanks for the reply. Actually , we did all those optimisations with kafka. I
am converting to avro, also I configured
lard...@gmail.com
Subject: Re: NiFi Performance Analysis Clarification
Relevant: http://www.idata.co.il/2016/09/moving-binary-data-with-kafka/
If you're throwing 1MB and bigger files at Kafka, that's probably where your
slowdown is occurring. Particularly if you're running a single node
op the world* time right?
>
>
>
> Can you please tell me about flowfile checkpointing related tunings?
>
>
>
> Thanks & Regards,
>
> Prashanth
>
>
>
> *From:* Mike Thomsen [mailto:mikerthom...@gmail.com]
> *Sent:* Wednesday, June 13, 2018 2:33 PM
&
Please find answers inline
Thanks & Regards,
Prashanth
From: Pierre Villard [mailto:pierre.villard...@gmail.com]
Sent: Wednesday, June 13, 2018 3:56 PM
To: users@nifi.apache.org
Subject: Re: NiFi Performance Analysis Clarification
Hi,
What's the version of NiFi you're using?
; *From:* Mike Thomsen [mailto:mikerthom...@gmail.com]
> *Sent:* Wednesday, June 13, 2018 2:33 PM
> *To:* users@nifi.apache.org
> *Subject:* Re: NiFi Performance Analysis Clarification
>
>
>
> What are you retrieving (particularly size) and what happens in the
> "
tunings?
Thanks & Regards,
Prashanth
From: Mike Thomsen [mailto:mikerthom...@gmail.com]
Sent: Wednesday, June 13, 2018 2:33 PM
To: users@nifi.apache.org
Subject: Re: NiFi Performance Analysis Clarification
What are you retrieving (particularly size) and what happens in the "update"
What are you retrieving (particularly size) and what happens in the
"update" step?
Thanks,
Mike
On Wed, Jun 13, 2018 at 4:10 AM V, Prashanth (Nokia - IN/Bangalore) <
prashant...@nokia.com> wrote:
> Hi Team,
>
>
>
> I am doing some performance testing in NiFi. WorkFlow is *GetSFTP ->
> update ->
Hi Team,
I am doing some performance testing in NiFi. WorkFlow is GetSFTP -> update ->
PutKafka. I want to tune my setup to achieve high throughput without much
queuing.
But my throughput average drops during flowfile checkpointing duration. I
believe stop-the-world is happening during that ti
16 matches
Mail list logo
