Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-07 Thread Steve Loughran
> On 6 Sep 2016, at 17:30, Andrew Wang wrote: > > Thanks everyone for voting and helping to validate alpha1. The VOTE closes > with 16 +1s, 6 of them binding PMC votes, and no -1s. > > I'll go ahead and wrap up the release, will send an announcement out likely >

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-06 Thread Andrew Wang
Thanks everyone for voting and helping to validate alpha1. The VOTE closes with 16 +1s, 6 of them binding PMC votes, and no -1s. I'll go ahead and wrap up the release, will send an announcement out likely tomorrow once the mirrors have caught up. Best, Andrew On Sat, Sep 3, 2016 at 6:55 PM,

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-03 Thread Akira Ajisaka
Thanks Andrew for the great work. +1 (binding) - Downloaded source and verified checksum and signature - Compiled with -Pnative @ CentOS 7.2 and OpenJDK 8u101 - Ran some MapReduce jobs successfully - Checked Web UIs and logs - hdfs/yarn/mapred "--daemon" option works as expected Regards, Akira

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-03 Thread Eric Payne
Thank you very much, Andrew. +1 (non-binding) - Downloaded source and built native - Installed on 3-node, non-secure cluster - Ran sleep jobs - Ensured preemption works as expected -Eric Payne - Original Message - From: Andrew Wang To:

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-03 Thread Tsuyoshi Ozawa
+1(binding) * Compiling source code. * Verified checksums. * Running RM-HA cluster with ZooKeeper 3.4.8 and ran MR job with native libraries. It worked well. Again, I'm very happy to move 3.0.0 release forward :-) Thanks, Andrew! FYI: > In fact, I hit an error similar to Eric's one regardless

RE: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-02 Thread Zheng, Kai
gt; Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org; Chen, Sammi <sammi.c...@intel.com> Subject: RE: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0 +1 (non-binding). Thanks for driving this Andrew! * Download and built f

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-02 Thread Tsuyoshi Ozawa
I'm sorry, very big typo I did... s/hardly/very hard/ Best - Tsuyoshi On Sat, Sep 3, 2016 at 1:53 AM, Tsuyoshi Ozawa wrote: > Thanks for making this forward hardly, Andrew! > > In fact, I hit an error similar to Eric's one regardless of > configuring yarn.app.mapreduce.am.env

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-02 Thread Tsuyoshi Ozawa
Thanks for making this forward hardly, Andrew! In fact, I hit an error similar to Eric's one regardless of configuring yarn.app.mapreduce.am.env and mapreduce.admin.user.env... does anyone hit same error? 2016-09-02 16:49:35,223 INFO mapreduce.Job: The url to track the job:

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-02 Thread Kuhu Shukla
+1( non-binding) * Successfully downloaded and built from source. * Deployed to single node cluster. *  Ran Sleep and Wordcount jobs. Thanks Andrew for the effort! Regards,Kuhu On Thursday, September 1, 2016 10:32 PM, Arun Suresh wrote: +1 (binding). Thanks for

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-01 Thread Arun Suresh
+1 (binding). Thanks for driving this Andrew.. * Download and built from source. * Setup a 5 mode cluster. * Verified that MR works with opportunistic containers * Verified that the AMRMClient supports 'allocationRequestId' Cheers -Arun On Thu, Sep 1, 2016 at 4:31 PM, Aaron Fabbri

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-01 Thread Aaron Fabbri
+1, non-binding. I built everything on OS X and ran the s3a contract tests successfully: mvn test -Dtest=org.apache.hadoop.fs.contract.s3a.\* ... Results : Tests run: 78, Failures: 0, Errors: 0, Skipped: 1 [INFO]

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-01 Thread Andrew Wang
Good point Allen, I forgot about `hadoop version`. Since it's populated by a version-info.properties file, people can always cat that file. On Thu, Sep 1, 2016 at 3:21 PM, Allen Wittenauer wrote: > > > On Sep 1, 2016, at 3:18 PM, Allen Wittenauer

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-01 Thread Allen Wittenauer
> On Sep 1, 2016, at 2:57 PM, Andrew Wang wrote: > > Steve requested a git hash for this release. This led us into a brief > discussion of our use of git tags, wherein we realized that although > release tags are immutable (start with "rel/"), RC tags are not. This is

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-01 Thread Chen He
+1 non-binding download source and build successfully; deploy to single node cluster; run wordcount and loadgen passed; Verified that MR-6336 is there and FileOutputCommitter is using algorithm 2 by default. Best Regards! Chen On Wed, Aug 31, 2016 at 9:25 PM, Rakesh Radhakrishnan

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-01 Thread Andrew Wang
Steve requested a git hash for this release. This led us into a brief discussion of our use of git tags, wherein we realized that although release tags are immutable (start with "rel/"), RC tags are not. This is based on the HowToRelease instructions. I asked in infra.chat about this, and filed a

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-01 Thread Xiao Chen
+1 (non-binding) Thanks Andrew for putting this up! Super excited to see a Hadoop 3 RC. Verifications done on OS X: - Verified md5 on all files - Spot checked release notes and changes - Built from source - Verified LICENSE and NOTICE are correctly contained in the jars built - Started

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-31 Thread Rakesh Radhakrishnan
Thanks for getting this out. +1 (non-binding) - downloaded and built tarball from source - deployed HDFS-HA cluster and tested few EC file operations - executed few hdfs commands including EC commands - viewed basic UI - ran some of the sample jobs Best Regards, Rakesh Intel On Thu, Sep 1,

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-31 Thread Gangumalla, Uma
+1 (binding). Overall it¹s a great effort, Andrew. Thank you for putting all the energy. Downloaded and built. Ran some sample jobs. I would love to see all this efforts will lead to get the GA from Hadoop 3.X soon. Regards, Uma On 8/30/16, 8:51 AM, "Andrew Wang"

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-31 Thread Aaron T. Myers
+1 (binding) from me. Downloaded the source, built from source, set up a pseudo cluster, and ran a few of the sample jobs. Thanks a lot for doing all this release work, Andrew. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Aug 30, 2016 at 8:51 AM, Andrew Wang

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-31 Thread Sean Busbey
It's also the key Andrew has in the project's KEYS file: http://www.apache.org/dist/hadoop/common/KEYS On Tue, Aug 30, 2016 at 4:12 PM, Andrew Wang wrote: > Hi Eric, thanks for trying this out, > > I tried this gpg command to get my key, seemed to work: > > # gpg

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Zhe Zhang
+1 (non-binding) Did the following on 7 RHEL 6.6 servers - Downloaded and built from source - Downloaded and verified checksum of the binary tar.gz file - Setup a cluster with 1 NN and 6 DNs - Tried regular HDFS commands - Tried EC commands (listPolicies, getPolicy, setPolicy), they work fine -

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Allen Wittenauer
> On Aug 30, 2016, at 2:20 PM, Eric Badger wrote: > > Well that's embarrassing. I had accidentally slightly renamed my > log4j.properties file in my conf directory, so it was there, just not being > read. Nah. You were just testing out the shell rewrite's

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Eric Badger
Well that's embarrassing. I had accidentally slightly renamed my log4j.properties file in my conf directory, so it was there, just not being read. Apologies for the unnecessary spam. With this and the public key from Andrew, I give my non-binding +1. Eric On Tuesday, August 30, 2016 4:11

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Andrew Wang
Hi Eric, thanks for trying this out, I tried this gpg command to get my key, seemed to work: # gpg --keyserver pgp.mit.edu --recv-keys 7501105C gpg: requesting key 7501105C from hkp server pgp.mit.edu gpg: /root/.gnupg/trustdb.gpg: trustdb created gpg: key 7501105C: public key "Andrew Wang (CODE

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Allen Wittenauer
> On Aug 30, 2016, at 2:06 PM, Eric Badger > wrote: > > > WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete. ^^ > > After running the above command, the RM UI showed a successful job, but as > you can

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Eric Badger
I don't know why my email client keeps getting rid of all of my spacing. Resending the same email so that it is actually legible... All on OSX 10.11.6: - Verified the hashes. However, Andrew, I don't know where to find your public key, so I wasn't able to verify that they were signed by you. -

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Eric Badger
All on OSX 10.11.6: Verified the hashes. However, Andrew, I don't know where to find your public key, so I wasn't able to verify that they were signed by you.Built from sourceDeployed a pseudo-distributed clusterRan a few sample jobsPoked around the RM UIPoked around the attached website

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Allen Wittenauer
> On Aug 30, 2016, at 10:17 AM, Zhe Zhang wrote: > > Thanks Andrew for the great work! It's really exciting to finally see a > Hadoop 3 RC. > > I noticed CHANGES and RELEASENOTES markdown files which were not in > previous RCs like 2.7.3. What are good tools to verify them? I

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Andrew Wang
I'll put my own +1 on it: * Built from source * Started pseudo cluster and ran Pi job successfully On Tue, Aug 30, 2016 at 10:17 AM, Zhe Zhang wrote: > > Thanks Andrew for the great work! It's really exciting to finally see a > Hadoop 3 RC. > > I noticed CHANGES and

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-30 Thread Zhe Zhang
Thanks Andrew for the great work! It's really exciting to finally see a Hadoop 3 RC. I noticed CHANGES and RELEASENOTES markdown files which were not in previous RCs like 2.7.3. What are good tools to verify them? I tried reading them on IntelliJ but format looks odd. I'm still testing the RC: -