Re: NiFi fails on cluster nodes

2018-10-24 Thread Bryan Bende
g' > run.as: 'nifi' > zookeeper.properties: > server.1: 'host1.test.com:2888:3888' > server.2: 'host2.test.com:2889:3889' > > /Viking > ____________ > From: Saip, Alexander (NIH/CC/BTRIS) [C] > Sent: Wednesday,

Re: NiFi fails on cluster nodes

2018-10-24 Thread Bryan Bende
nshots > taken on those. Please note that host’s FQDNs have been removed. > > > > -Original Message- > From: Bryan Bende > Sent: Wednesday, October 24, 2018 9:25 AM > To: users@nifi.apache.org > Subject: Re: NiFi fails on cluster nodes > > > > Many servic

Re: NiFi fails on cluster nodes

2018-10-24 Thread Bryan Bende
ou anything. > > > > BTW, what does “a different location in the same ZK” mean? > > > > -Original Message- > From: Bryan Bende > Sent: Tuesday, October 23, 2018 3:02 PM > To: users@nifi.apache.org > Subject: Re: NiFi fails on cluster nodes > &g

Re: NiFi fails on cluster nodes

2018-10-23 Thread Bryan Bende
xactly the case. > > -Original Message- > From: Bryan Bende > Sent: Tuesday, October 23, 2018 2:44 PM > To: users@nifi.apache.org > Subject: Re: NiFi fails on cluster nodes > > So you can get into each node's UI and they each show 1/1 for cluster nodes? > > It does

RE: NiFi fails on cluster nodes

2018-10-23 Thread Saip, Alexander (NIH/CC/BTRIS) [C]
That's exactly the case. -Original Message- From: Bryan Bende Sent: Tuesday, October 23, 2018 2:44 PM To: users@nifi.apache.org Subject: Re: NiFi fails on cluster nodes So you can get into each node's UI and they each show 1/1 for cluster nodes? It doesn't really make sense how

Re: NiFi fails on cluster nodes

2018-10-23 Thread Bryan Bende
standalone NiFi > > instances into cluster nodes turned out to be much more challenging than we > > had anticipated… > > > > > > > > -Original Message- > > From: Bryan Bende > > Sent: Tuesday, October 23, 2018 1:17 PM > > To: u

Re: NiFi fails on cluster nodes

2018-10-23 Thread Bryan Bende
opy users.xml and > > authorizations.xml from the connected node to it, or remove them there > > instead? > > > > > > > > > > > > -Original Message- > > > From: Bryan Bende > > > Sent: Tuesday, October 23, 2018 12:36

Re: NiFi fails on cluster nodes

2018-10-23 Thread Bryan Bende
> Sent: Tuesday, October 23, 2018 12:36 PM > To: users@nifi.apache.org > Subject: Re: NiFi fails on cluster nodes > > > > That means the user representing host-1 does not have permissions to proxy. > > > > You can look in authorizations.xml o

Re: NiFi fails on cluster nodes

2018-10-23 Thread Bryan Bende
the most likely causes for this exception? > > > > Thank you, > > > > Alexander > > > > -Original Message- > From: Bryan Bende > Sent: Monday, October 22, 2018 1:25 PM > To: users@nifi.apache.org > Subject: Re: NiFi fails on cluster nodes

Re: NiFi fails on cluster nodes

2018-10-22 Thread Bryan Bende
we will need to re-create all users and > groups that we had in the original standalone NiFi instance? > > -Original Message- > From: Bryan Bende > Sent: Monday, October 22, 2018 12:48 PM > To: users@nifi.apache.org > Subject: Re: NiFi fails on cluster nodes > >

RE: NiFi fails on cluster nodes

2018-10-22 Thread Saip, Alexander (NIH/CC/BTRIS) [C]
PM To: users@nifi.apache.org Subject: Re: NiFi fails on cluster nodes Sorry I was confused when you said two 1 node clusters and I assumed they each had their own ZooKeeper. You don't need to run ZK on both nodes, you can create a 2 node cluster using the embedded ZK on the first node

Re: NiFi fails on cluster nodes

2018-10-22 Thread Bryan Bende
w authorizers.xml? I’m asking > since we have the same LDAP authentication/authorization settings in the > latter. > > > > Thank you, > > > > Alexander > > > > -Original Message- > From: Bryan Bende > Sent: Monday, October 22, 2018 11:55 AM > To

Re: NiFi fails on cluster nodes

2018-10-22 Thread Bryan Bende
pparently, the NiFi instances don’t talk to each other, but > at least, they come alive… > > > > From: Saip, Alexander (NIH/CC/BTRIS) [C] > Sent: Friday, October 19, 2018 11:18 AM > To: users@nifi.apache.org > Subject: RE: NiFi fails on cluster nodes > > > > We ha

RE: NiFi fails on cluster nodes

2018-10-22 Thread Saip, Alexander (NIH/CC/BTRIS) [C]
with two one-node clusters, since apparently, the NiFi instances don’t talk to each other, but at least, they come alive… From: Saip, Alexander (NIH/CC/BTRIS) [C] Sent: Friday, October 19, 2018 11:18 AM To: users@nifi.apache.org Subject: RE: NiFi fails on cluster nodes We have managed to get past

RE: NiFi fails on cluster nodes

2018-10-19 Thread Saip, Alexander (NIH/CC/BTRIS) [C]
Google for possible clues, but so far, there hasn’t been any luck… -Original Message- From: Bryan Bende Sent: Monday, October 15, 2018 10:27 AM To: users@nifi.apache.org Subject: Re: NiFi fails on cluster nodes I'm not really sure, the error message is indicating that either a certi

Re: NiFi fails on cluster nodes

2018-10-15 Thread Bryan Bende
y, October 15, 2018 9:43 AM > To: users@nifi.apache.org > Subject: Re: NiFi fails on cluster nodes > > This is not related to ZooKeeper... I think you are missing something related > to TLS/SSL configuration, maybe you set cluster protocol to be secure, but > then you did

RE: NiFi fails on cluster nodes

2018-10-15 Thread Saip, Alexander (NIH/CC/BTRIS) [C]
Sent: Monday, October 15, 2018 9:43 AM To: users@nifi.apache.org Subject: Re: NiFi fails on cluster nodes This is not related to ZooKeeper... I think you are missing something related to TLS/SSL configuration, maybe you set cluster protocol to be secure, but then you didn't configure NiFi

Re: NiFi fails on cluster nodes

2018-10-15 Thread Bryan Bende
SLHandshakeException: Received fatal alert: bad_certificate >> >> >> >> It is likely extraneous to NiFi, but does this mean that we need install a >> cert into ZooKeeper? Right now, both apps are running on the same box. >> >> >> >> Thank yo

Re: NiFi fails on cluster nodes

2018-10-15 Thread Mike Thomsen
, but does this mean that we need install a > cert into ZooKeeper? Right now, both apps are running on the same box. > > > > Thank you. > > > > *From:* Mike Thomsen > *Sent:* Monday, October 15, 2018 9:02 AM > *To:* users@nifi.apache.org > *Subject:* Re: NiFi fa

RE: NiFi fails on cluster nodes

2018-10-15 Thread Saip, Alexander (NIH/CC/BTRIS) [C]
install a cert into ZooKeeper? Right now, both apps are running on the same box. Thank you. From: Mike Thomsen Sent: Monday, October 15, 2018 9:02 AM To: users@nifi.apache.org Subject: Re: NiFi fails on cluster nodes http://nifi.apache.org/docs/nifi-docs/html/administration-guide.html See

Re: NiFi fails on cluster nodes

2018-10-15 Thread Bryan Bende
an external instance of ZooKeeper? The NiFi Admin Guide talks > exclusively about the embedded one. > > > > Thanks again. > > > > From: Mike Thomsen > Sent: Friday, October 12, 2018 10:17 AM > To: users@nifi.apache.org > Subject: Re: NiFi fails on clust

Re: NiFi fails on cluster nodes

2018-10-15 Thread Mike Thomsen
ld point me to instructions how to configure a cluster > with an external instance of ZooKeeper? The NiFi Admin Guide talks > exclusively about the embedded one. > > > > Thanks again. > > > > *From:* Mike Thomsen > *Sent:* Friday, October 12, 2018 10:17 AM > *To:*

RE: NiFi fails on cluster nodes

2018-10-15 Thread Saip, Alexander (NIH/CC/BTRIS) [C]
: Re: NiFi fails on cluster nodes It very well could become a problem down the road. The reason ZooKeeper is usually on a dedicated machine is that you want it to be able to have enough resources to always communicate within a quorum to reconcile configuration changes and feed configuration details

Re: NiFi fails on cluster nodes

2018-10-12 Thread Mike Thomsen
e changed to SUSPENDED > > > > *From:* Mike Thomsen > *Sent:* Friday, October 12, 2018 8:33 AM > *To:* users@nifi.apache.org > *Subject:* Re: NiFi fails on cluster nodes > > > > Also, in a production environment NiFi should have its own dedicated > ZooKeeper clu

RE: NiFi fails on cluster nodes

2018-10-12 Thread Saip, Alexander (NIH/CC/BTRIS) [C]
: Mike Thomsen Sent: Friday, October 12, 2018 8:33 AM To: users@nifi.apache.org Subject: Re: NiFi fails on cluster nodes Also, in a production environment NiFi should have its own dedicated ZooKeeper cluster to be on the safe side. You should not reuse ZooKeeper quora (ex. have HBase and NiFi point

Re: NiFi fails on cluster nodes

2018-10-12 Thread Mike Thomsen
or.java:293) >> >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) >> >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) >> >> at java.lang.Thread.run(T

Re: NiFi fails on cluster nodes

2018-10-12 Thread Mike Thomsen
> at java.lang.Thread.run(Thread.java:748) > > > > Is there anything else we should check? > > > > *From:* Nathan Gough > *Sent:* Thursday, October 11, 2018 9:12 AM > *To:* users@nifi.apache.org > *Subject:* Re: NiFi fails on cluster nodes > > &g

RE: NiFi fails on cluster nodes

2018-10-12 Thread Saip, Alexander (NIH/CC/BTRIS) [C]
) Is there anything else we should check? From: Nathan Gough Sent: Thursday, October 11, 2018 9:12 AM To: users@nifi.apache.org Subject: Re: NiFi fails on cluster nodes You may also need to explicitly open ‘nifi.cluster.node.protocol.port’ on all nodes to allow cluster communication for cluster

Re: NiFi fails on cluster nodes

2018-10-11 Thread Nathan Gough
You may also need to explicitly open ‘nifi.cluster.node.protocol.port’ on all nodes to allow cluster communication for cluster heartbeats etc. From: ashmeet kandhari Reply-To: Date: Thursday, October 11, 2018 at 9:09 AM To: Subject: Re: NiFi fails on cluster nodes Hi Alexander, Can

Re: NiFi fails on cluster nodes

2018-10-11 Thread ashmeet kandhari
s@nifi.apache.org > *Subject:* Re: NiFi fails on cluster nodes > > > > Can you see if zookeeper node is up and running and can connect to the > nifi nodes > > > > On Wed, Oct 10, 2018 at 7:34 PM Saip, Alexander (NIH/CC/BTRIS) [C] < > alexander.s...@nih.gov

RE: NiFi fails on cluster nodes

2018-10-11 Thread Saip, Alexander (NIH/CC/BTRIS) [C]
, October 11, 2018 6:50 AM To: users@nifi.apache.org Subject: RE: NiFi fails on cluster nodes How do I do that? The nifi.properties file on each node includes ‘nifi.state.management.embedded.zookeeper.start=true’, so I assume Zookeeper does start. From: ashmeet kandhari mailto:ashmeetkandhar

RE: NiFi fails on cluster nodes

2018-10-11 Thread Saip, Alexander (NIH/CC/BTRIS) [C]
How do I do that? The nifi.properties file on each node includes ‘nifi.state.management.embedded.zookeeper.start=true’, so I assume Zookeeper does start. From: ashmeet kandhari Sent: Thursday, October 11, 2018 4:36 AM To: users@nifi.apache.org Subject: Re: NiFi fails on cluster nodes Can you

Re: NiFi fails on cluster nodes

2018-10-11 Thread ashmeet kandhari
Can you see if zookeeper node is up and running and can connect to the nifi nodes On Wed, Oct 10, 2018 at 7:34 PM Saip, Alexander (NIH/CC/BTRIS) [C] < alexander.s...@nih.gov> wrote: > Hello, > > > > We have three NiFi 1.7.1 nodes originally configured as independent > instances, each on its own