[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324237#comment-17324237 ] Enrico Olivelli commented on HADOOP-17612: -- I am going to switch to 3.7.0 on Curator but we will keep compatibility with 3.5.x and 3.6.x > Bump default Zookeeper version to 3.7.0 > --- > > Key: HADOOP-17612 > URL: https://issues.apache.org/jira/browse/HADOOP-17612 > Project: Hadoop Common > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Time Spent: 1h > Remaining Estimate: 0h > > We can bump Zookeeper version to 3.7.0 for trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[
https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324226#comment-17324226
]
Viraj Jasani commented on HADOOP-17612:
---
{quote}Do you mind to drop an email on dev@curator?
{quote}
Sounds good. Will do it, and in the meanwhile, perhaps we can repurpose
CURATOR-588 to bump ZK to 3.6.3?
> Bump default Zookeeper version to 3.7.0
> ---
>
> Key: HADOOP-17612
> URL: https://issues.apache.org/jira/browse/HADOOP-17612
> Project: Hadoop Common
> Issue Type: Task
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Labels: pull-request-available
> Time Spent: 1h
> Remaining Estimate: 0h
>
> We can bump Zookeeper version to 3.7.0 for trunk.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324220#comment-17324220 ] Enrico Olivelli commented on HADOOP-17612: -- There is no official plan. I was waiting before cutting a release in order to add support for zk 3.7.0 that has been released as well. Do you mind to drop an email on dev@curator? >From my side I will try to finish my work ASAP and then propose to cut a >release > Bump default Zookeeper version to 3.7.0 > --- > > Key: HADOOP-17612 > URL: https://issues.apache.org/jira/browse/HADOOP-17612 > Project: Hadoop Common > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Time Spent: 1h > Remaining Estimate: 0h > > We can bump Zookeeper version to 3.7.0 for trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324197#comment-17324197 ] Viraj Jasani commented on HADOOP-17612: --- Zookeeper 3.6.3 is out. Announcement [here|https://mail-archives.apache.org/mod_mbox/zookeeper-dev/202104.mbox/%3CCA%2BhtFBmbxPb8dRd6xnW3dG2nwRk006%3D6JcrUVV%3D8BVcz9u-Y9g%40mail.gmail.com%3E] I could not find Curator 5.1.1 planning in curator-dev mailing list. [~eolivelli] are you aware of the planning? Thanks > Bump default Zookeeper version to 3.7.0 > --- > > Key: HADOOP-17612 > URL: https://issues.apache.org/jira/browse/HADOOP-17612 > Project: Hadoop Common > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Time Spent: 1h > Remaining Estimate: 0h > > We can bump Zookeeper version to 3.7.0 for trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314414#comment-17314414 ] Viraj Jasani commented on HADOOP-17612: --- Thanks for inputs [~ayushtkn] [~eolivelli]. Keeping an eye on Zookeeper 3.6.3 and Curator 5.1.1 releases, we can start using them once they are out. Zookeeper 3.6.3 RC is [in-progress|https://github.com/apache/zookeeper/releases/tag/release-3.6.3-0]. > Bump default Zookeeper version to 3.7.0 > --- > > Key: HADOOP-17612 > URL: https://issues.apache.org/jira/browse/HADOOP-17612 > Project: Hadoop Common > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Time Spent: 1h > Remaining Estimate: 0h > > We can bump Zookeeper version to 3.7.0 for trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314362#comment-17314362 ] Ayush Saxena commented on HADOOP-17612: --- bq. The best we can do as of this point is bump up Zookeeper to 3.6 and curator to the appropriate version that uses 3.6. That sound like a plan, we can go ahead this way, and if we face some issues, from zk or curator side, we can bug the respective teams and see if they can help us in the upcoming release > Bump default Zookeeper version to 3.7.0 > --- > > Key: HADOOP-17612 > URL: https://issues.apache.org/jira/browse/HADOOP-17612 > Project: Hadoop Common > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Time Spent: 1h > Remaining Estimate: 0h > > We can bump Zookeeper version to 3.7.0 for trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312449#comment-17312449 ] Enrico Olivelli commented on HADOOP-17612: -- My suggestion is to move to ZooKeeper 3.6 and to Curator 5.1. We are going to cut a release of ZooKeeper 3.6.3 and of Curator 5.1.1, probably you can wait until those releases. I guess it will happen in a couple of weeks > Bump default Zookeeper version to 3.7.0 > --- > > Key: HADOOP-17612 > URL: https://issues.apache.org/jira/browse/HADOOP-17612 > Project: Hadoop Common > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Time Spent: 40m > Remaining Estimate: 0h > > We can bump Zookeeper version to 3.7.0 for trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312297#comment-17312297 ] Viraj Jasani commented on HADOOP-17612: --- Ah I see, bumping Zookeeper to 3.7 might not be doable sooner than what I expected because we use curator and so far, curator supports 3.6 as max version of Zookeeper. There are some ZookeeperServer level refactoring done in 3.7 release due to which curator too needs some minor code changes in order to support 3.7 version. We might have to hold on to this until we have new curator release that supports 3.7. > Bump default Zookeeper version to 3.7.0 > --- > > Key: HADOOP-17612 > URL: https://issues.apache.org/jira/browse/HADOOP-17612 > Project: Hadoop Common > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Time Spent: 40m > Remaining Estimate: 0h > > We can bump Zookeeper version to 3.7.0 for trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312134#comment-17312134 ] Viraj Jasani commented on HADOOP-17612: --- Thanks everyone for all your valuable inputs. I agree that 3.7.0 is in early phase and not many products might start using it anytime soon, we are also just beginning the testing phase, and that's why my proposal is to bump Zookeeper in Hadoop trunk (3.4.0) only and not to any active release branches. > Bump default Zookeeper version to 3.7.0 > --- > > Key: HADOOP-17612 > URL: https://issues.apache.org/jira/browse/HADOOP-17612 > Project: Hadoop Common > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > We can bump Zookeeper version to 3.7.0 for trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[
https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311817#comment-17311817
]
Andrew Kyle Purtell commented on HADOOP-17612:
--
My observation is all the "Facebook" version changes are in both 3.6 and 3.7
and 3.7 hasn't made any significant implementation deviation for core things,
with the exception of some improvements to LE (ZOOKEEPER-3690, ZOOKEEPER-4000).
If this set is larger it would be good to know! ZOOKEEPER-3874 ("official
API"), ZOOKEEPER-3301 (quotas), ZOOKEEPER-3264 (benchmark tool), ZOOKEEPER-3979
(audit cleanup), ZOOKEEPER-3948 (deterministic FI framework), and the several
security related JIRAs are all quite nice to haves.
> Bump default Zookeeper version to 3.7.0
> ---
>
> Key: HADOOP-17612
> URL: https://issues.apache.org/jira/browse/HADOOP-17612
> Project: Hadoop Common
> Issue Type: Task
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> We can bump Zookeeper version to 3.7.0 for trunk.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311792#comment-17311792 ] Andor Molnar commented on HADOOP-17612: --- >From ZooKeeper's perspective I tend say: Sure, go ahead! The more people get on board with 3.7, the better testing coverage we get. On the flipside the current (3.5.6) version is completely stable and will be long supported. There's no talk about the EOL of any of these versions. 3.4.x is already EoL btw. Featurewise 3.6.x and 3.7.x versions have obviously more features: 3.6.x is the "Facebook" version: it contains all the patches that Facebook ZK team made upstream so far. It should be generally more robust for large deployments and under heavy load. I'm not sure about 3.7.x to be honest, because I'm not following that branch closely. Maybe it introduces the new generic monitoring API which should give you much better insight on what's going on under the hood. Be aware that 3.7.0 is the first stable version of that branch, so I would be careful with that. > Bump default Zookeeper version to 3.7.0 > --- > > Key: HADOOP-17612 > URL: https://issues.apache.org/jira/browse/HADOOP-17612 > Project: Hadoop Common > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > We can bump Zookeeper version to 3.7.0 for trunk. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311763#comment-17311763 ] Viraj Jasani commented on HADOOP-17612: --- Thanks for providing info [~symat]. This requirement actually comes from Zookeeper + Hadoop + HBase setup. Since we are targeting some HBase 2 clusters, we were looking into leveraging all latest dependencies so far and thought of using latest Zookeeper release 3.7.0, and at the same time realized that Hadoop is also not using 3.7.0 (yes, it's latest release and hence not surprising), hence I thought of giving it a shot and see how tests would go for Hadoop trunk. The entire setup of Zookeeper 3.7 + Hadoop 2.10 (for now before upgrading to Hadoop 3.3/3.4) + HBase 2.4 seem to be working well. While we test this setup in depth, I just wanted to ensure that at least Hadoop trunk starts using Zookeeper 3.7.0. Is that fine? FYI [~apurtell] [~liuml07] > Bump default Zookeeper version to 3.7.0 > --- > > Key: HADOOP-17612 > URL: https://issues.apache.org/jira/browse/HADOOP-17612 > Project: Hadoop Common > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > We can bump Zookeeper version to 3.7.0. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311740#comment-17311740 ] Mate Szalay-Beko commented on HADOOP-17612: --- Thanks [~weichiu] for the ping and also thanks [~vjasani] for the PR! I'm not an active member in the Hadoop community, but I can provide some insight from ZooKeeper... 3.7.0 was just released very recently. I think I would recommend the latest 3.5 or 3.6 version instead, as those can be considered more stable. I know about many large companies and open-source projects and distributions using 3.5 now (migrated from 3.4 in the last 1-2 years), and also I know some that are using 3.6 in production. But I maybe wouldn't go with 3.7.0 as a requirement just yet... as 3.5 and 3.6 are still supported by the ZooKeeper community and seem to me more safe versions for Hadoop. Unless you want to use a specific feature in 3.7 that you miss from earlier ZooKeepers. cc. [~eolivelli] and [~andor] who are active PMC members in ZooKeeper, they might have more input about versions / end-of-life decisions. > Bump default Zookeeper version to 3.7.0 > --- > > Key: HADOOP-17612 > URL: https://issues.apache.org/jira/browse/HADOOP-17612 > Project: Hadoop Common > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > We can bump Zookeeper version to 3.7.0. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311573#comment-17311573 ] Wei-Chiu Chuang commented on HADOOP-17612: -- [~symat] could you help review this PR? Historically ZK version update tend to be bumpy. > Bump default Zookeeper version to 3.7.0 > --- > > Key: HADOOP-17612 > URL: https://issues.apache.org/jira/browse/HADOOP-17612 > Project: Hadoop Common > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > We can bump Zookeeper version to 3.7.0. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
