NiFi 1.6.0 cluster stability with Site-to-Site

I am running a 7-node NiFi 1.6.0 cluster that performs fairly well when it's simply processing its own data (putting records in Elasticsearch, MongoDB, running transforms, etc.). However, when we add receiving Site-to-Site traffic to the mix, the CPU spikes to the point that the nodes can't talk t

Re: NiFi 1.6.0 cluster stability with Site-to-Site

Any nifi developers on this list that have any suggestions? On Wed, Aug 8, 2018 at 7:38 AM Joe Gresock wrote: > I am running a 7-node NiFi 1.6.0 cluster that performs fairly well when > it's simply processing its own data (putting records in Elasticsearch, > MongoDB, running t

Re: NiFi 1.6.0 cluster stability with Site-to-Site

ng the latest release if you're able. > > Thanks > On Fri, Aug 10, 2018 at 4:13 PM Martijn Dekkers > wrote: > > > Whats the OS you are running on? What kind of systems? Memory stats, > network stats, JVM stats etc. How much data coming through? > > On 10 August 2

Load balancer queues stuck on 1.9.2?

I have round robin load balanced connections working on one cluster, but on another, this type of connection seems to be stuck. What would be the best way to debug this problem? The connection is from one processor group to another, so it's from an Output Port to an Input Port. My configuration

Re: Load balancer queues stuck on 1.9.2?

apache.org/jira/browse/NIFI-6285 > > Seems like you wouldn't hit the first one since you are on 1.9.2, but > does seem odd that is the same scenario. > > Mark P probably knows best about debugging, but I'm guessing possibly > a thread dump while in this state would be help

Re: Load balancer queues stuck on 1.9.2?

> on one of those 3 nodes. It's also not > related to swapping if it's in this state with only 500 FlowFiles queued. > > Are you able to confirm that you are indeed receiving data from the load > balanced queue on both prod-5 and prod-6? > > > On Jun 4, 2019, at 11:47

Re: Load balancer queues stuck on 1.9.2?

Thanks for the suggestions! On Tue, Jun 4, 2019 at 4:14 PM Joe Gresock wrote: > prod-5 and -6 don't appear to be receiving any data in that queue, based > on the status history. Is there anything I should see in the logs to > confirm this? > > On Tue, Jun 4, 2019 at 4:05

Re: Load balancer queues stuck on 1.9.2?

Ok, it happened almost immediately again. Apparently the node disconnect/reconnect thing only works to process the flow files currently in that queue. But as soon as more come in, they get stuck again. Can you provide a little more info on what I should be looking for in the diagnostics that mig

Re: Load balancer queues stuck on 1.9.2?

ging can certainly be quite > verbose. > > Thanks > -Mark > > > > On Jun 4, 2019, at 12:29 PM, Mark Payne wrote: > > Well, that is certainly interesting. Thanks for the updated. Please do let > us know if it occurs again. > > On Jun 4, 2019, at 12:23 PM, Joe

Re: Load balancer queues stuck on 1.9.2?

if any one load balanced connection is back-pressured, it could consume all of the available load balancer threads such that no other load balanced connection can function? Joe On Tue, Jun 4, 2019 at 6:00 PM Joe Gresock wrote: > Thanks! I'm taking notes for next time. For now, a full

Re: Load balancer queues stuck on 1.9.2?

a fix. Hopefully > will have a PR up very shortly. If you're in a position to do so, it would > be great if you have > a chance to test it out. I just created a JIRA to track the issue, > NIFI-6353 [1]. > > Thanks > -Mark > > [1] https://issues.apache.org/jira/b

Keeping NiFi 1.9.2 console available

I posted about this a while back on 1.6.0, but as far as I can tell it has only gotten worse in 1.9.2. I have a cluster of 7 nifi nodes running on CentOS 6 VMs. When no data is being processed, the UI console is very responsive. However, once I start processing lots of data, the CPU gets maxed b

Re: Keeping NiFi 1.9.2 console available

n Mon, Jun 10, 2019 at 12:54 PM Joe Witt wrote: > ...also how does the heap and garbage collection look during this? > > On Sun, Jun 9, 2019, 5:58 PM Joe Witt wrote: > >> Joe >> >> When you view top or other tools what is dominating the cpu? >> >> thank

Re: Load balancer queues stuck on 1.9.2?

y and am starting to > work on a fix. Hopefully > will have a PR up very shortly. If you're in a position to do so, it would > be great if you have > a chance to test it out. I just created a JIRA to track the issue, > NIFI-6353 [1]. > > Thanks > -Mark > > [1] htt

Re: Load balancer queues stuck on 1.9.2?

Mark, looks great! No problems since yesterday. I'd say you're good to commit. On Tue, Jun 11, 2019 at 7:15 PM Mark Payne wrote: > Thanks Joe! If all looks good then we can hopefully get this merged in > quickly. > > On Jun 11, 2019, at 2:30 PM, Joe Gresock wrote: &g

Run duration warning?

Hi, I'm curious about the Run Duration warning: "Source Processors with a run duration greater than 0ms and no incoming connections could lose data when NiFi is shutdown." I notice not all processors have this warning when you set their run duration larger than 0ms. Is there a specific annotatio

NiFi Kubernetes question

Apologies if this has been answered on the list already.. Does anyone have knowledge of the latest in the realm of nifi kubernetes support? I see some pages like https://hub.helm.sh/charts/cetic/nifi, and https://github.com/AlexsJones/nifi but am unsure which example to pick to start with. I'm c

Re: NiFi Kubernetes question

tion of the master during transitions. >> - manage your certs as K8S secrets. >> - you also need to also have a stateful set of zookeeper pods for >> managing the nifi servers. >> - use persistent volume mounts to hold the flowfile, database, content, >> and provenanc

Re: NiFi Kubernetes question

nning a 3-node cluster in kubernetes using modified >>> configuration scripts from the AlexJones github repo - >>> https://github.com/AlexsJones/nifi >>> >>> Ours is on an internal bare-metal k8s lab configuration, not in a public >>> cloud at this time, but

Re: NiFi Kubernetes question

if there is any way I can get the SAN to work. On Mon, Dec 30, 2019 at 4:51 PM Joe Gresock wrote: > Thanks for the suggestion, apparently there was a typo on my nifi-ca-cs > service that caused the pod not to be matched. Unfortunately, even once I > corrected this, I'm still g

Re: NiFi Kubernetes question

plex in your environment. > > Le lun. 30 déc. 2019 à 21:29, Joe Gresock a écrit : > >> Looks like it works when I exclude the --subjectAlternativeNames >> parameter, whereas it fails with the null error when I specify this >> parameter. >> For example, this works: &g

No enable button for SSL context service in 1.10.0

I'm testing a new 1.10.0 deployment and found that both StandardSSLContextService and StandardRestrictedSSLContextService do not have an "enable" button available in the controller services panel. I've added every single policy from the main menu and the root level to both myself and all the nodes

Re: No enable button for SSL context service in 1.10.0

Interestingly, when I deleted one node from my 2-node cluster, I can suddenly enable the service. On Fri, Jan 10, 2020 at 2:12 PM Joe Gresock wrote: > I'm testing a new 1.10.0 deployment and found that both > StandardSSLContextService and StandardRestrictedSSLContextService do no

Re: No enable button for SSL context service in 1.10.0

Ok, disregard, I'm 99% positive this is because the keystore on both of my nodes have *different* passwords. :) On Fri, Jan 10, 2020 at 2:31 PM Joe Gresock wrote: > Interestingly, when I deleted one node from my 2-node cluster, I can > suddenly enable the service. > > On

Re: Round Robin not working NiFi 1.13.2

Hi Jens, Out of curiosity, when you run the FetchFTP processor, what does the Status History of that processor show? Is the processor processing files on all of your nodes or just the primary? On Thu, Jun 10, 2021 at 9:07 AM Jens M. Kofoed wrote: > Dear community > > I have created a 3 node cl

Re: Round Robin not working NiFi 1.13.2

gt; > Any advice for future investigation? > > kind regards > Jens > > Den tor. 10. jun. 2021 kl. 15.36 skrev Joe Gresock : > >> Hi Jens, >> >> Out of curiosity, when you run the FetchFTP processor, what does the >> Status History of that processor show

Re: Round Robin not working NiFi 1.13.2

nifi.cluster.load.balance.max.thread.count=8 > nifi.cluster.load.balance.comms.timeout=30 sec > > kind regards > Jens > > > Den tor. 10. jun. 2021 kl. 16.18 skrev Joe Gresock : > >> That would seem to be the culprit :) It sounds like your other nodes >> can&

Re: Round Robin not working NiFi 1.13.2

regards > Jens > > > Den tor. 10. jun. 2021 kl. 16.32 skrev Joe Gresock : > >> Ok, and just to confirm, you've verified that each node can talk to the >> others over port 6342? >> >> On Thu, Jun 10, 2021 at 10:29 AM Jens M. Kofoed >> wrote: >>

Re: BUG??? NiFi 1.13.2 Cluster Load Balance binds to localhost and is not accessible

Jens, Can you try removing the space from the nifi.cluster.load.balance.host property and see what happens? On Thu, Jun 10, 2021 at 1:23 PM Jens M. Kofoed wrote: > Dear Community > > I have installed and configured a 3 node secured NiFi cluster with NiFi > 1.13.2, Java 8 on Ubuntu 20.04. > I wa

Re: Re: No Load Balancing since 1.13.2

Also, make sure to use nifi.cluster.load.balance.host instead of .address if you're still running 1.14.0. Virus-free. www.avast.com

Re: Execute Script Processor is not working some random times

Hi Vibhath, Yes, though not recommended you can still disable the default security features in 1.14.0. The administration guide [1] has examples of enabling https, so you could do the opposite. However, can you describe the use case that requires you to use http? Since 1.1.40 comes secured by de

Re: Hashicorp vault transit engine for sensitive properties of processors

Hi Cannon, Both the HashiCorp Vault Transit and Key/Value Sensitive Property Providers are able to protect NiFi's configuration files (e.g., nifi.properties, login-identity-providers.xml, and authorizers.xml). In the case of the Transit implementation, you would use the encrypt-config.sh tool fro

Re: Hashicorp vault transit engine for sensitive properties of processors

d be happy to >> create one if not. >> >> Cannon >> >> On Tue, Feb 1, 2022 at 3:46 PM Joe Gresock wrote: >> >>> Hi Cannon, >>> >>> Both the HashiCorp Vault Transit and Key/Value Sensitive Property >>> Providers are able to

Re: Parameters and Process Groups

Hi James, I'd like to add that while there is a concept of parameter context inheritance in NiFi 1.15.x, as Pierre linked in the above article, this only applies to a single Process Group. There is not currently a concept of inheritance of parameters through the nesting of Process Groups. Therefo

Re: NiFi to draw samples from very large raw data sets

James, This sounds like an interesting project. I would recommend RouteOnAttribute with a "sample" property with value "${random():mod(1032):equals(100)}" (the second number could be anything between 0 and 1031), and then routing the "sample" relationship to your sampling path. I'm not sure I un

Re: NiFi to draw samples from very large raw data sets

; and a Stateful Variables Initial Value of 0. Then add a RouteOnAttribute with a property called "samples" with value "${counter:toNumber():le(1032)}}, and only the first 1032 flowfiles will be routed to that relationship. On Thu, May 19, 2022 at 6:49 AM Joe Gresock wrote: &

Re: Proper use of parameter contexts?

[1] also has a discussion on using parameter context inheritance to overcome some of the problems you're describing. [1] https://bryanbende.com/development/2021/11/08/apache-nifi-1-15-0-parameter-context-inheritance On Fri, Jun 3, 2022 at 11:25 AM James McMahon wrote: > I see. Sounds like I sho