Re: Clustered nifi issues

2020-10-14 Thread Wyll Ingersoll
@nifi.apache.org Subject: Re: Clustered nifi issues The CLI does not use nifi.properties, there are several ways of passing in config... https://nifi.apache.org/docs/nifi-docs/html/toolkit-guide.html#property-argument-handling On Wed, Oct 14, 2020 at 10:01 AM Wyll Ingersoll mailto:wyllys.ingers

Re: Clustered nifi issues

2020-10-14 Thread Bryan Bende
It must be reading the keystore/truststore specified in > the nifi.properties file then? > -- > *From:* Bryan Bende > *Sent:* Wednesday, October 14, 2020 9:59 AM > *To:* users@nifi.apache.org > *Subject:* Re: Clustered nifi issues > > The

Re: Clustered nifi issues

2020-10-14 Thread Wyll Ingersoll
That makes sense. It must be reading the keystore/truststore specified in the nifi.properties file then? From: Bryan Bende Sent: Wednesday, October 14, 2020 9:59 AM To: users@nifi.apache.org Subject: Re: Clustered nifi issues The get-nodes command calls

Re: Clustered nifi issues

2020-10-14 Thread Bryan Bende
ers@nifi.apache.org > *Subject:* Re: Clustered nifi issues > > Did you say that the same line of code works fine for secured clusters > too. > I asked because nifi-toolkit has a separate set of parameters asking for > certificates and everything else related to secure clusters.

Re: Clustered nifi issues

2020-10-14 Thread Wyll Ingersoll
@nifi.apache.org Subject: Re: Clustered nifi issues Did you say that the same line of code works fine for secured clusters too. I asked because nifi-toolkit has a separate set of parameters asking for certificates and everything else related to secure clusters. On Tue, Oct 13, 2020 at 12:14 PM

Re: Clustered nifi issues

2020-10-13 Thread Sushil Kumar
jq . /tmp/cluster.state > > exit 1 > > fi > > > -- > *From:* Chris Sampson > *Sent:* Thursday, October 1, 2020 9:03 AM > *To:* users@nifi.apache.org > *Subject:* Re: Clustered nifi issues > > For info, the probes we cu

Re: Clustered nifi issues

2020-10-13 Thread Wyll Ingersoll
, 2020 9:03 AM To: users@nifi.apache.org Subject: Re: Clustered nifi issues For info, the probes we currently use for our StatefulSet Pods are: * livenessProbe - tcpSocket to ping the NiFi instance port (e.g. 8080) * readinessProbe - exec command to curl the nifi-api/controller/cluster endpoi

Re: Clustered nifi issues

2020-10-01 Thread Wyll Ingersoll
Thanks, I'll try it out. I had the liveness probe already, but wasn't quite sure what to check for in the readinessProbe. From: Chris Sampson Sent: Thursday, October 1, 2020 9:03 AM To: users@nifi.apache.org Subject: Re: Clustered nifi issues For info

Re: Clustered nifi issues

2020-10-01 Thread Chris Sampson
s.samp...@naimuri.com <https://www.naimuri.com/> On Wed, 30 Sep 2020 at 16:43, Wyll Ingersoll < wyllys.ingers...@keepertech.com> wrote: > Thanks for following up and filing the issue. Unfortunately, I dont have > any of the logs from the original issue since I have since restarted and > re

Re: Clustered nifi issues

2020-09-30 Thread Wyll Ingersoll
@nifi.apache.org Subject: Re: Clustered nifi issues Thanks Wyll, I created a Jira [1] to address this. The NullPointer that you show in the stack trace will prevent the node from reconnecting to the cluster. Unfortunately, it’s a bug that needs to be addressed. It’s possible that you may find a way

Re: Clustered nifi issues

2020-09-30 Thread Wyll Ingersoll
1.11.4 From: Mark Payne Sent: Wednesday, September 30, 2020 11:02 AM To: users@nifi.apache.org Subject: Re: Clustered nifi issues Wyll, What version of nifi are you running? Thanks -Mark On Sep 30, 2020, at 10:33 AM, Wyll Ingersoll mailto:wyllys.ingers

Re: Clustered nifi issues

2020-09-30 Thread Mark Payne
Wyllys From: Chris Sampson mailto:chris.samp...@naimuri.com>> Sent: Tuesday, September 29, 2020 3:21 PM To: users@nifi.apache.org<mailto:users@nifi.apache.org> mailto:users@nifi.apache.org>> Subject: Re: Clustered nifi issues We started to hav

Re: Clustered nifi issues

2020-09-30 Thread Wyll Ingersoll
s.connection.model.score.name>=rSquared nifi.analytics.connection.model.score.threshold=.90 From: Chris Sampson mailto:chris.samp...@naimuri.com>> Sent: Tuesday, September 29, 2020 12:41 PM To: users@nifi.apache.org<mailto:users@nifi.apache.org> mailto:users@nifi

Re: Clustered nifi issues

2020-09-29 Thread Chris Sampson
cluster.local:2181,zk-1.zk-hs.ki.svc.cluster.local:2181,zk-2.zk-hs.ki.svc.cluster.local:2181 > > nifi.zookeeper.connect.timeout=30 secs > > nifi.zookeeper.session.timeout=30 secs > > nifi.zookeeper.root.node=/nifi > > nifi.zookeeper.auth.type= > > nifi.zookeeper.kerberos.removeHostFromPrincipal

Re: Clustered nifi issues

2020-09-29 Thread Wyll Ingersoll
nifi issues Also, which version of zookeeper and what image (I've found different versions and images provided better stability)? Cheers, Chris Sampson On Tue, 29 Sep 2020, 17:34 Sushil Kumar, mailto:skm@gmail.com>> wrote: Hello Wyll It may be helpful if you can send nifi.prop

Re: Clustered nifi issues

2020-09-29 Thread Chris Sampson
Also, which version of zookeeper and what image (I've found different versions and images provided better stability)? Cheers, Chris Sampson On Tue, 29 Sep 2020, 17:34 Sushil Kumar, wrote: > Hello Wyll > > It may be helpful if you can send nifi.properties. > > Thanks > Sushil Kumar > > On

Re: Clustered nifi issues

2020-09-29 Thread Sushil Kumar
Hello Wyll It may be helpful if you can send nifi.properties. Thanks Sushil Kumar On Tue, Sep 29, 2020 at 7:58 AM Wyll Ingersoll < wyllys.ingers...@keepertech.com> wrote: > > I have a 3-node Nifi (1.11.4) cluster in kubernetes environment (as a > StatefulSet) using external zookeeper (3 nodes

Clustered nifi issues

2020-09-29 Thread Wyll Ingersoll
I have a 3-node Nifi (1.11.4) cluster in kubernetes environment (as a StatefulSet) using external zookeeper (3 nodes also) to manage state. Whenever even 1 node (pod/container) goes down or is restarted, it can throw the whole cluster into a bad state that forces me to restart ALL of the pods