Re: Nifi Clustering not working

[Peter Wilcsinszky]

Jonathan,

I think the issue is with how you apply the overrides in the properties
file. I've removed the trailing comments from the overriden lines and it
seems to be working.

Peter

On Fri, Apr 20, 2018 at 11:01 AM, Peter Wilcsinszky <
peterwilcsins...@gmail.com> wrote:

> Hi,
>
> I've tested your statefulset and it seems it doesn't even try to connect
> to zookeeper to form a cluster, although the config looks good. I'm still
> new to this, but will dig deeper later.
>
> Peter
>
> On Tue, Apr 17, 2018 at 6:55 PM, Jonathan Kosgei <
> jonat...@saharacluster.com> wrote:
>
>> Thank you for the tips.
>>
>>
>>
>> I've tried setting the fqdn as the hosts and made sure each was pingeable
>> from all the other nodes with no luck.
>>
>>
>>
>> In particular I see this error a lot;
>>
>>
>>
>>
>>
>> Unable to locate group with id 'd4779129-0162-1000-982f-9436d01eb801'.
>>
>>
>>
>> I'm wondering if I might have a port closed that should be open, is there
>> any list of all official ports? Looking in my logs the bootstrap port seems
>> to be different each time and I wonder if maybe they need to be accessible
>> for each pod?
>>
>>
>>
>> Here's a trimmed down version of my logs (not in DEBUG mode);
>>
>>
>>
>> nifi-app.log
>>
>> https://gist.github.com/jonathan-kosgei/81936b7e59a563f55111bfe5be06e8bc
>>
>>
>>
>> nifi-user.log
>>
>> https://gist.github.com/jonathan-kosgei/19ce9929a764a40ac74a84fdcac2b3e2
>>
>>
>>
>> nifi-bootrap.log
>>
>> https://gist.github.com/jonathan-kosgei/e7396f558cbcd9a20cf6c0dca72c2728
>>
>>
>>
>> My Statefulset and Services
>>
>> https://gist.github.com/jonathan-kosgei/49a628edab109ba39da8598caf0e4f1e
>>
>>
>>
>> Thanks!
>>
>>
>

Re: Nifi Clustering not working

[Peter Wilcsinszky]

Hi,

I've tested your statefulset and it seems it doesn't even try to connect to
zookeeper to form a cluster, although the config looks good. I'm still new
to this, but will dig deeper later.

Peter

On Tue, Apr 17, 2018 at 6:55 PM, Jonathan Kosgei  wrote:

> Thank you for the tips.
>
>
>
> I've tried setting the fqdn as the hosts and made sure each was pingeable
> from all the other nodes with no luck.
>
>
>
> In particular I see this error a lot;
>
>
>
>
>
> Unable to locate group with id 'd4779129-0162-1000-982f-9436d01eb801'.
>
>
>
> I'm wondering if I might have a port closed that should be open, is there
> any list of all official ports? Looking in my logs the bootstrap port seems
> to be different each time and I wonder if maybe they need to be accessible
> for each pod?
>
>
>
> Here's a trimmed down version of my logs (not in DEBUG mode);
>
>
>
> nifi-app.log
>
> https://gist.github.com/jonathan-kosgei/81936b7e59a563f55111bfe5be06e8bc
>
>
>
> nifi-user.log
>
> https://gist.github.com/jonathan-kosgei/19ce9929a764a40ac74a84fdcac2b3e2
>
>
>
> nifi-bootrap.log
>
> https://gist.github.com/jonathan-kosgei/e7396f558cbcd9a20cf6c0dca72c2728
>
>
>
> My Statefulset and Services
>
> https://gist.github.com/jonathan-kosgei/49a628edab109ba39da8598caf0e4f1e
>
>
>
> Thanks!
>
>

Nifi Clustering not working

[Jonathan Kosgei]

Thank you for the tips.



I've tried setting the fqdn as the hosts and made sure each was pingeable from 
all the other nodes with no luck.



In particular I see this error a lot;





Unable to locate group with id 'd4779129-0162-1000-982f-9436d01eb801'.



I'm wondering if I might have a port closed that should be open, is there any 
list of all official ports? Looking in my logs the bootstrap port seems to be 
different each time and I wonder if maybe they need to be accessible for each 
pod?



Here's a trimmed down version of my logs (not in DEBUG mode);



nifi-app.log

https://gist.github.com/jonathan-kosgei/81936b7e59a563f55111bfe5be06e8bc



nifi-user.log

https://gist.github.com/jonathan-kosgei/19ce9929a764a40ac74a84fdcac2b3e2



nifi-bootrap.log

https://gist.github.com/jonathan-kosgei/e7396f558cbcd9a20cf6c0dca72c2728



My Statefulset and Services

https://gist.github.com/jonathan-kosgei/49a628edab109ba39da8598caf0e4f1e



Thanks!