Hi Mark,
Thanks for clarifying things for me. Do we have any workaround ?
Because load balancer between listSftp and fetchSftp is also not working
seamlessly in 1.9.2. Out of 60 files it processes only 30 and remaining
stuck in the queue. Is there any way where I can debug things. I have taken
Nayan,
Yes, version 1.10.0 does have a dependency on 3.5.5.
Thanks
-Mark
> On Dec 10, 2019, at 11:13 AM, nayan sharma wrote:
>
> Hi Mark,
>
> I was trying to update NIFI cluster to 1.10.0 but I am getting error
> Connection State changed to SUSPENDED,RECONNECTED and
>
Hi Mark,
I was trying to update NIFI cluster to 1.10.0 but I am getting error
*Connection
State changed to SUSPENDED,RECONNECTED and
zookeeper.KeeperException$ConnectionLossException :
KeeperErrorCode=ConnectionLoss*
I am not using embedded zookeeper. Zookeeper version 3.4.6.
Do NIFI 1.10.0
Hi Mark,
One more thing I have noticed about the putHDFS that only two files has been
written and rest of them are in complete. Please refer image.
https://i.imgur.com/hu26hQG.png
Thank you,
Mark
On 2019/12/04 07:30:03, nayan sharma wrote:
> Hi Mark,
> Thanks for your valuable suggestion.
Hi Mark,
Thanks for your valuable suggestion. It worked a lot. Now I can understand,
there is no point in load balancing between FetchSFTP and CompressContent.
After making all the changes it worked but some of the flow files are stuck
between CompressContent and putHDFS
Nayan,
Looking at the screenshot, I can see two different connections there that are
load balanced. One of them holds the nearly 100 GB of data.
There are a handful of bugs related to load-balanced connections in 1.9.2 that
were addressed in 1.10.0. If you're relying on load-balanced
Hello,
It would be helpful if you could upload a screenshot of your flow
somewhere and send a link.
Thanks,
Bryan
On Tue, Dec 3, 2019 at 6:06 AM nayan sharma wrote:
>
> Hi,
> I am using 2 nodes cluster.
> nodes config Heap(max) 48gb & 64 core machine
> Processor flow
>
Hi,
I am using 2 nodes cluster.
nodes config Heap(max) 48gb & 64 core machine
Processor flow
ListSFTP--->FetchSFTP(all nodes with 10 threads)--->CompressContent(all
nodes,10 threads)-->PutHDFS
Queues shows it has 96gb in queue but when I do listing it shows no flow files.
Everything seems
