RE: java.lang.NullPointerException on some commands (stats, conf)

2019-12-09 Thread Mike Smotritsky
Hey Mate, thank you very much!
It got into junk mail.

Thanks again,

Mike

-Original Message-
From: Szalay-Bekő Máté [mailto:szalay.beko.m...@gmail.com] 
Sent: Monday, December 09, 2019 3:19 AM
To: user@zookeeper.apache.org
Subject: Re: java.lang.NullPointerException on some commands (stats, conf)

I sent you on Friday a link in private to mikesmotrit...@ongov.net
Let me know if an other address should I use.

Mate

On Sun, Dec 8, 2019 at 12:23 PM Mike Smotritsky 
wrote:

> Hey Mate - thank you very much!
> How do I download the fixed build?
>
> Thanks again,
>
> Mike
>
> -Original Message-
> From: Mate Szalay-Beko [mailto:msza...@cloudera.com.INVALID]
> Sent: Friday, December 06, 2019 5:06 AM
> To: user@zookeeper.apache.org
> Subject: Re: java.lang.NullPointerException on some commands (stats, conf)
>
> yep, in general I think it makes sense to try / get used to build ZooKeeper
> (or any other OpenSource product you use), one can never know when he
> needs a security patch or bugfix. :)
>
> Anyway, as I already have my environment ready, I did a quick build and
> shared it with Mike.
>
> Cheers,
> Mate
>
> On Thu, Dec 5, 2019 at 4:35 PM Enrico Olivelli 
> wrote:
>
> > Just run these commands:
> >
> > git clone https://github.com/apache/zookeeper
> > git checkout branch-3.5
> > mvn clean install -DskipTests
> >
> > you will find binaries for 3.5.7-SNAPSHOT inside
> > "zookeeper-assembly/target"
> >
> > if you want to run unit tests run the command without '-DskipTests':
> > mvn clean install
> >
> > you need "git", "Apache Maven" and a Java JDK 8.x (or greater), like the
> > one from AdoptOpenJDK or which one you prefer
> >
> > Hope that helps
> >
> > Enrico
> >
> > Il giorno gio 5 dic 2019 alle ore 16:19 Mike Smotritsky <
> > mikesmotrit...@ongov.net> ha scritto:
> >
> > > Hey Enrico,
> > > If Mate can help to cut it - it would be great, if not - I'll need more
> > > detailed instructions on how to cut it please.
> > >
> > > Thanks and Regards,
> > > Mike
> > >
> > > -Original Message-
> > > From: Enrico Olivelli [mailto:eolive...@gmail.com]
> > > Sent: Thursday, December 05, 2019 10:08 AM
> > > To: UserZooKeeper
> > > Subject: Re: java.lang.NullPointerException on some commands (stats,
> > conf)
> > >
> > > Mike
> > >
> > > Il giorno gio 5 dic 2019 alle ore 15:55 Mike Smotritsky <
> > > mikesmotrit...@ongov.net> ha scritto:
> > >
> > > > Hey Mate, thank you very much for a very quick action on this issue.
> > > > If it's not very difficult can you please cut me a patched 3.5.6?
> > > >
> > >
> > > I think the best procedure is that you build your own patched version
> by
> > > yourself.
> > > Just "mvn clean install -DskipTests" on branch-3.5
> > >
> > > Please be aware that the binaries you are going to use are not an
> > official
> > > Apache release.
> > > I think it is fine, many companies run their own patched version of
> Open
> > > Source software
> > >
> > > Just my 2 cents
> > >
> > > Enrico
> > >
> > >
> > >
> > >
> > > > Again I very much appreciate your help!
> > > >
> > > > You guys have a very dedicated team on this project!
> > > >
> > > > Thanks and Regards,
> > > > Mike
> > > >
> > > > -Original Message-
> > > > From: Mate Szalay-Beko [mailto:msza...@cloudera.com.INVALID]
> > > > Sent: Thursday, December 05, 2019 3:48 AM
> > > > To: user@zookeeper.apache.org
> > > > Subject: Re: java.lang.NullPointerException on some commands (stats,
> > > conf)
> > > >
> > > > Hi Mike,
> > > >
> > > > 3.5.6 was already released a couple of weeks ago. Norbert
> cherry-picked
> > > the
> > > > NPE fix to branch 3.5, so the question is if we will have a 3.5.7 or
> > not.
> > > > BTW if it is a blocker for you, I can create you a personal /
> > unofficial
> > > > patched version of 3.5.6 which contains this fix and then you can use
> > it
> > > > until you would have 3.6 or 3.5.7 later.
> > > >
> > > > You can do this for yourself as well, by cloning the 3.5 branch (
> > > > https://github.com/apache/zookeeper/tree/branch-3.5) and executing
> > 'mvn
> > > > clean install -DskipTests'. If you also need the C-client, then 'mvn
> > > clean
> > > > install -DskipTests -Pfull-build'. It will not be an official
> release,
> > > but
> > > > in this case it is actually safe to use it, as the branch 3.5 now
> only
> > > > contains two small bugfixes on top of the stable 3.5.6.
> > > >
> > > > Cheers,
> > > > Mate
> > > >
> > > > On Tue, Dec 3, 2019 at 5:09 PM Mike Smotritsky <
> > mikesmotrit...@ongov.net
> > > >
> > > > wrote:
> > > >
> > > > > Hi Enrico, I'd really love to have 3.5.6 released with this fix in.
> > > > > (Thanks to Mate for the very quick fix!)
> > > > > Cause my my Solr cluster keeps complaining about the Zookeeper
> state.
> > > > >
> > > > > Thanks and Regards,
> > > > > Mike
> > > > >
> > > > >
> > > > >
> > > > > -Original Message-
> > > > > From: Enrico Olivelli [mailto:eolive...@gmail.com]
> > > > > Sent: Tuesday, December 03, 2019 10:07 AM
> > > > > 

Snapshot creation after 3.4.14 -> 3.5.6 upgrade

2019-12-09 Thread Thomas Cooper
Hi,

I am working on upgrading a Kubernetes based 3.4.14 cluster to 3.5.6.

I are hitting the issue where the new snapshot checks prevent the newly
upgraded 3.5.6 cluster from starting. This usually happens in our test
set-up as the 3.4.14 cluster is not very old and has not hit the snapCount
limit yet. Typically only one node (presumable the leader) has a snapshot
file but the other do not.

I can disable the snapshot checks via the config value for the upgrade to
3.5.6, however we obviously need to re-enable the checks ASAP. The issue is
making sure all of the ZK nodes have snapshots so that the checks can be
re-enabled.

My question is: Is there a way to force the snapshot creation / sync from
the leader?

As part of our upgrade process we need to restart the servers soon after
the initial upgrade of the ZK container images to enable config changes. If
the snapshot creation / sync hasn't happened by this point then obviously
the checks will fail. If we can force a snapshot creation, after the
initial upgrade, we can re-enable the checks as part of the upgrade
process. If not, we will need to create some method to check if the
snapshots have been created and periodically inspect the ZK server file
system, re-enabling the checks once they all have snapshots.

Any pointers would be appreciated.

Thanks in advance,

Tom Cooper


Re: Anyone running Zookeeper on ARM?

2019-12-09 Thread Flavio Junqueira
I'm not aware of anything either.

-Flavio

> On 9 Dec 2019, at 08:50, Enrico Olivelli  wrote:
> 
> Brian
> 
> Il giorno sab 7 dic 2019 alle ore 00:07 Brian Lininger <
> brian.linin...@veeva.com> ha scritto:
> 
>> Hi ZooKeeper's,
>> I was poking around the Release Notes for 3.4/3.5 releases and the
>> Zookeeper docs for tested platforms and I could find any details so I
>> thought I'd ask is Zookeeper tested/validated on ARM-based platforms,
>> specifically EC2 ARM-based instances?
> 
> 
> I am sorry
> We don't have any automatic tests against this platform, at least not in
> Apache Community.
> 
> Maybe someone can share his own experience
> 
> Cheers
> Enrico
> 
> 
> 
>> Anyone with any experience running
>> them in AWS?
>> Thanks,
>> Brian
>> 
>> --
>> 
>> 
>> *Brian Lininger*
>> Technical Architect, Infrastructure & Search
>> *Veeva Systems *
>> brian.linin...@veeva.com
>> www.veeva.com
>> 
>> *This email and the information it contains are intended for the intended
>> recipient only, are confidential and may be privileged information exempt
>> from disclosure by law.*
>> *If you have received this email in error, please notify us immediately by
>> reply email and delete this message from your computer.*
>> *Please do not retain, copy or distribute this email.*
>> 



Re: java.lang.NullPointerException on some commands (stats, conf)

2019-12-09 Thread Szalay-Bekő Máté
I sent you on Friday a link in private to mikesmotrit...@ongov.net
Let me know if an other address should I use.

Mate

On Sun, Dec 8, 2019 at 12:23 PM Mike Smotritsky 
wrote:

> Hey Mate - thank you very much!
> How do I download the fixed build?
>
> Thanks again,
>
> Mike
>
> -Original Message-
> From: Mate Szalay-Beko [mailto:msza...@cloudera.com.INVALID]
> Sent: Friday, December 06, 2019 5:06 AM
> To: user@zookeeper.apache.org
> Subject: Re: java.lang.NullPointerException on some commands (stats, conf)
>
> yep, in general I think it makes sense to try / get used to build ZooKeeper
> (or any other OpenSource product you use), one can never know when he
> needs a security patch or bugfix. :)
>
> Anyway, as I already have my environment ready, I did a quick build and
> shared it with Mike.
>
> Cheers,
> Mate
>
> On Thu, Dec 5, 2019 at 4:35 PM Enrico Olivelli 
> wrote:
>
> > Just run these commands:
> >
> > git clone https://github.com/apache/zookeeper
> > git checkout branch-3.5
> > mvn clean install -DskipTests
> >
> > you will find binaries for 3.5.7-SNAPSHOT inside
> > "zookeeper-assembly/target"
> >
> > if you want to run unit tests run the command without '-DskipTests':
> > mvn clean install
> >
> > you need "git", "Apache Maven" and a Java JDK 8.x (or greater), like the
> > one from AdoptOpenJDK or which one you prefer
> >
> > Hope that helps
> >
> > Enrico
> >
> > Il giorno gio 5 dic 2019 alle ore 16:19 Mike Smotritsky <
> > mikesmotrit...@ongov.net> ha scritto:
> >
> > > Hey Enrico,
> > > If Mate can help to cut it - it would be great, if not - I'll need more
> > > detailed instructions on how to cut it please.
> > >
> > > Thanks and Regards,
> > > Mike
> > >
> > > -Original Message-
> > > From: Enrico Olivelli [mailto:eolive...@gmail.com]
> > > Sent: Thursday, December 05, 2019 10:08 AM
> > > To: UserZooKeeper
> > > Subject: Re: java.lang.NullPointerException on some commands (stats,
> > conf)
> > >
> > > Mike
> > >
> > > Il giorno gio 5 dic 2019 alle ore 15:55 Mike Smotritsky <
> > > mikesmotrit...@ongov.net> ha scritto:
> > >
> > > > Hey Mate, thank you very much for a very quick action on this issue.
> > > > If it's not very difficult can you please cut me a patched 3.5.6?
> > > >
> > >
> > > I think the best procedure is that you build your own patched version
> by
> > > yourself.
> > > Just "mvn clean install -DskipTests" on branch-3.5
> > >
> > > Please be aware that the binaries you are going to use are not an
> > official
> > > Apache release.
> > > I think it is fine, many companies run their own patched version of
> Open
> > > Source software
> > >
> > > Just my 2 cents
> > >
> > > Enrico
> > >
> > >
> > >
> > >
> > > > Again I very much appreciate your help!
> > > >
> > > > You guys have a very dedicated team on this project!
> > > >
> > > > Thanks and Regards,
> > > > Mike
> > > >
> > > > -Original Message-
> > > > From: Mate Szalay-Beko [mailto:msza...@cloudera.com.INVALID]
> > > > Sent: Thursday, December 05, 2019 3:48 AM
> > > > To: user@zookeeper.apache.org
> > > > Subject: Re: java.lang.NullPointerException on some commands (stats,
> > > conf)
> > > >
> > > > Hi Mike,
> > > >
> > > > 3.5.6 was already released a couple of weeks ago. Norbert
> cherry-picked
> > > the
> > > > NPE fix to branch 3.5, so the question is if we will have a 3.5.7 or
> > not.
> > > > BTW if it is a blocker for you, I can create you a personal /
> > unofficial
> > > > patched version of 3.5.6 which contains this fix and then you can use
> > it
> > > > until you would have 3.6 or 3.5.7 later.
> > > >
> > > > You can do this for yourself as well, by cloning the 3.5 branch (
> > > > https://github.com/apache/zookeeper/tree/branch-3.5) and executing
> > 'mvn
> > > > clean install -DskipTests'. If you also need the C-client, then 'mvn
> > > clean
> > > > install -DskipTests -Pfull-build'. It will not be an official
> release,
> > > but
> > > > in this case it is actually safe to use it, as the branch 3.5 now
> only
> > > > contains two small bugfixes on top of the stable 3.5.6.
> > > >
> > > > Cheers,
> > > > Mate
> > > >
> > > > On Tue, Dec 3, 2019 at 5:09 PM Mike Smotritsky <
> > mikesmotrit...@ongov.net
> > > >
> > > > wrote:
> > > >
> > > > > Hi Enrico, I'd really love to have 3.5.6 released with this fix in.
> > > > > (Thanks to Mate for the very quick fix!)
> > > > > Cause my my Solr cluster keeps complaining about the Zookeeper
> state.
> > > > >
> > > > > Thanks and Regards,
> > > > > Mike
> > > > >
> > > > >
> > > > >
> > > > > -Original Message-
> > > > > From: Enrico Olivelli [mailto:eolive...@gmail.com]
> > > > > Sent: Tuesday, December 03, 2019 10:07 AM
> > > > > To: UserZooKeeper
> > > > > Subject: Re: java.lang.NullPointerException on some commands
> (stats,
> > > > conf)
> > > > >
> > > > > Mike,
> > > > > just to be clear:  'we can cut new releases from 3.5 branch' means
> > that
> > > > we
> > > > > are able to do it.
> > > > >
> > > > > But there are no plans