Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-25 Thread Sangjin Lee
File MAPREDUCE-6836 . On Wed, Jan 25, 2017 at 2:35 PM, Sangjin Lee wrote: > Sorry for missing the cutoff. > > I'm also +1 (binding) if that counts. > > I did find a small issue with MR, and I'll file a separate JIRA, but it > shouldn't stop t

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-25 Thread Sangjin Lee
Sorry for missing the cutoff. I'm also +1 (binding) if that counts. I did find a small issue with MR, and I'll file a separate JIRA, but it shouldn't stop the release. On Wed, Jan 25, 2017 at 12:06 PM, Andrew Wang wrote: > Thanks guys. With that, I'm going to close the VOTE for 3.0.0-alpha2 wi

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-25 Thread Andrew Wang
Thanks guys. With that, I'm going to close the VOTE for 3.0.0-alpha2 with the following vote totals: 5 binding +1s (Arun got his vote in just in time ;) 7 non-binding +1s 0 -1's Thanks to everyone who tried out the RC! I'll get started on publishing the release. Best, Andrew On Wed, Jan 25, 201

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-25 Thread Arun Suresh
Thanks for all the work on this Andrew. I agree with Chris and Karthik. +1 (binding) from me as well - Ran a 9 node cluster HDFS and YARN cluster - Played with some hdfs commands - Ran some sleep jobs using YARN ReservationSytstem + Opportunistic Containers - Compiled REEF and Spark agains

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-25 Thread Karthik Kambatla
I feel the same way as Chris. +1 on the current RC. And, open to changes to RN and License. On Wed, Jan 25, 2017 at 11:59 AM, Chris Douglas wrote: > On Wed, Jan 25, 2017 at 11:42 AM, Andrew Wang > wrote: > > Chris and Karthik, could you clarify the contingency of your votes? Is > > fixing just

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-25 Thread Chris Douglas
On Wed, Jan 25, 2017 at 11:42 AM, Andrew Wang wrote: > Chris and Karthik, could you clarify the contingency of your votes? Is > fixing just the release notes sufficient? My +1 was not contingent on any changes. The release is fine as-is. Fixing any subset of the release notes, minicluster jar, a

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-25 Thread Andrew Wang
Thanks folks. To be clear, I'm willing to fix the release notes without a new RC, but adding the missing LICENSE requires adding HADOOP-14018 which changes the checksum of that jar and also the tarballs. Chris and Karthik, could you clarify the contingency of your votes? Is fixing just the release

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-25 Thread Karthik Kambatla
Thanks for driving the alphas, Andrew. I don't see the need to restart the vote and I feel it is okay to fix the minor issues before releasing. +1 (binding). Downloaded source, stood up a pseudo-distributed cluster with FairScheduler, ran example jobs, and played around with the UI. Thanks Karthi

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-25 Thread Xiao Chen
Thanks Andrew and the community to work out the alpha2 RC! +1 (non-binding) - Built the source tarball - Tested on a pseudo-distributed cluster, basic HDFS operations/sample pi job over HDFS encryption zone work. - Sanity checked NN and KMS webui - Sanity checked NN/DN/KMS logs.

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-25 Thread Zhihai Xu
Thanks Andrew for creating release Hadoop 3.0.0-alpha2 RC0 +1 ( non-binding) --Downloaded source and built from it. --Deployed on a pseudo-distributed cluster. --Ran sample MR jobs and tested with basics HDFS operations. --Did a sanity check for RM and NM UI. Best, zhihai On Wed, Jan 25, 2017 at

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-25 Thread Kuhu Shukla
+1 (non-binding)* Built from source* Deployed on a pseudo-distributed cluster (MAC)* Ran wordcount and sleep jobs. On Wednesday, January 25, 2017 3:21 AM, Marton Elek wrote: Hi, I also did a quick smoketest with the provided 3.0.0-alpha2 binaries: TLDR; It works well Environment:

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-25 Thread Marton Elek
Hi, I also did a quick smoketest with the provided 3.0.0-alpha2 binaries: TLDR; It works well Environment: * 5 hosts, docker based hadoop cluster, every component in separated container (5 datanode/5 nodemanager/...) * Components are: * Hdfs/Yarn cluster (upgraded 2.7.3 to 3.0.0-alpha2 usi

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-24 Thread Yongjun Zhang
Thanks Andrew much for the work here! +1 (binding). - Downloaded both binary and src tarballs - Verified md5 checksum and signature for both - Built from source tarball - Deployed 2 pseudo clusters, one with the released tarball and the other with what I built from source, and did the following

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-24 Thread Eric Badger
+1 (non-binding) - Verified signatures and md5- Built from source- Started single-node cluster on my mac- Ran some sleep jobs Eric On Tuesday, January 24, 2017 4:32 PM, Yufei Gu wrote: Hi Andrew, Thanks for working on this. +1 (Non-Binding) 1. Downloaded the binary and verified the m

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-24 Thread Chris Douglas
On Mon, Jan 23, 2017 at 9:32 PM, Allen Wittenauer wrote: > The problem here is that there is a 'license' directory and a file called > 'LICENSE'. If this gets extracted by jar via jar xf, it will fail. unzip > can be made to extract it via an option like -o. To make matters worse, none > of

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-24 Thread Marton Elek
]> > minicluster is kind of weird on filesystems that don't support mixed case, > like OS X's default HFS+. > > $ jar tf hadoop-client-minicluster-3.0.0-alpha3-SNAPSHOT.jar | grep -i > license > LICENSE.txt > license/ > license/LICENSE > license/LICENSE.dom-documentation.txt > license/LICENSE.

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-23 Thread Allen Wittenauer
> On Jan 23, 2017, at 8:50 PM, Chris Douglas wrote: > > Thanks for all your work on this, Andrew. It's great to see the 3.x > series moving forward. > > If you were willing to modify the release notes and add the LICENSE to > the jar, we don't need to reset the clock on the VOTE, IMO. FWIW, I

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-23 Thread Chris Douglas
Thanks for all your work on this, Andrew. It's great to see the 3.x series moving forward. If you were willing to modify the release notes and add the LICENSE to the jar, we don't need to reset the clock on the VOTE, IMO. What's the issue with the minicluster jar [1]? I tried to reproduce, but ha

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-23 Thread Andrew Wang
There are 5 JIRAs by my count that are missing release notes, which isn't that bad but could of course be improved. Four of those I had already checked earlier and forgot to follow up, and they were very minorly incompatible (affecting private APIs) or mistakenly marked incompatible. I'm not too c

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-22 Thread Allen Wittenauer
> On Jan 22, 2017, at 9:05 PM, Allen Wittenauer > wrote: > > > > > >> On Jan 20, 2017, at 2:36 PM, Andrew Wang wrote: >> >> http://home.apache.org/~wang/3.0.0-alpha2-RC0/ > > There are quite a few JIRA issues that need release notes. > One other thing, before I forget...

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-22 Thread Allen Wittenauer
> On Jan 20, 2017, at 2:36 PM, Andrew Wang wrote: > > http://home.apache.org/~wang/3.0.0-alpha2-RC0/ There are quite a few JIRA issues that need release notes. - To unsubscribe, e-mail: common-dev-unsubscr...@hadoo

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-22 Thread Andrew Wang
Thanks for the validation John. Do we feel the L&N issue is enough to sink the RC? On Fri, Jan 20, 2017 at 6:47 PM, John Zhuge wrote: > Discovered 1 missing license using the script verify-license-notice.sh. > > Missing LICENSE! ./../hadoop-dist/target/hadoop-3.0.0-alpha2/share/ > hadoop/client/

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-21 Thread Akira Ajisaka
Hi Marton, This is intentional. source htmls were removed. https://issues.apache.org/jira/browse/HADOOP-13688 Regards, Akira On 2017/01/22 0:50, Marton Elek wrote: hadoop-3.0.0-alpha2.tar.gz is much more smaller than hadoop-3.0.0-alpha1.tar.gz. (246M vs 316M) The big difference is the genera

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-21 Thread Marton Elek
hadoop-3.0.0-alpha2.tar.gz is much more smaller than hadoop-3.0.0-alpha1.tar.gz. (246M vs 316M) The big difference is the generated source documentation: find -name src-html ./hadoop-2.7.3/share/doc/hadoop/api/src-html ./hadoop-2.7.3/share/doc/hadoop/hadoop-hdfs-httpfs/apidocs/src-html ./hadoop-

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-20 Thread Anu Engineer
Hi Andrew, Thank you for all the hard work. I am really excited to see us making progress towards a 3.0 release. +1 (Non-Binding) 1. Deployed the downloaded bits on 4 node cluster with 1 Namenode and 3 datanodes. 2. Verified all normal HDFS operations like create directory, create file , del

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-20 Thread John Zhuge
Discovered 1 missing license using the script verify-license-notice.sh. Missing LICENSE! ./../hadoop-dist/target/hadoop-3.0.0-alpha2/share/hadoop/client/hadoop-client-api-3.0.0-alpha2.jar - Verified checksums and signatures of the tarballs - Built source with Java 1.8.0_66 on Mac - Deployed a pseu

[VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-20 Thread Andrew Wang
Hi all, With heartfelt thanks to many contributors, the RC0 for 3.0.0-alpha2 is ready. 3.0.0-alpha2 is the second alpha in the planned 3.0.0 release line leading up to a 3.0.0 GA. It comprises 857 fixes, improvements, and new features since alpha1 was released on September 3rd, 2016. More inform