Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-25 Thread Arun C Murthy
With 9 +1s including mine (6 binding) and no -1s, the vote passes. Thanks to all who voted. Arun On Aug 15, 2013, at 2:15 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get released - this fixes the

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-22 Thread Colin McCabe
On Wed, Aug 21, 2013 at 3:49 PM, Stack st...@duboce.net wrote: On Wed, Aug 21, 2013 at 1:25 PM, Colin McCabe cmcc...@alumni.cmu.eduwrote: St.Ack wrote: + Once I figured where the logs were, found that JAVA_HOME was not being exported (don't need this in hadoop-2.0.5 for instance). Adding

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-22 Thread Rob Parker
+1 non-binding Verified signatures and checksums one binary and source tar files Built the source Ran some tests on psuedo-distributed cluster. Rob On 08/15/2013 09:15 PM, Arun C Murthy wrote: Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get

RE: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-22 Thread Bikas Saha
] Release Apache Hadoop 2.1.0-beta +1 (binding) Verified checksums, built from source and ran basic MR jobs on a single-node cluster. -- Hitesh On Aug 15, 2013, at 2:15 PM, Arun C Murthy wrote: Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get released

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-22 Thread Steve Loughran
+1, binding Review process # symlink /usr/local/bin/protoc to the homebrew installed 2.5.0 version # delete all 2.1.0-beta artifacts in the mvn repo: find ~/.m2 -name 2.1.0-beta -print | xargs rm -rf # checkout hbase apache/branch-0.95 (commit # b58d596 ) # switch to ASF repo (arun's

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-21 Thread Sandy Ryza
+1 (non-binding) Built from source, ran jobs on a pseudo-distributed cluster with the Fair Scheduler. -Sandy On Tue, Aug 20, 2013 at 7:27 PM, Arun C Murthy a...@hortonworks.com wrote: Thanks for the heads up Aaron, I've changed fix-version of HDFS-4763 to 2.1.1-beta for now. Committers -

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-21 Thread Siddharth Seth
+1 (binding). Verified signature and checksums. Built from source and upgraded a 2.0.4 cluster. Ran a couple of simple MR and Tez jobs. - Sid On Thu, Aug 15, 2013 at 2:15 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-21 Thread Colin McCabe
St.Ack wrote: + Once I figured where the logs were, found that JAVA_HOME was not being exported (don't need this in hadoop-2.0.5 for instance). Adding an exported JAVA_HOME to my running shell which don't seem right but it took care of it (I gave up pretty quick on messing w/

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-21 Thread Stack
On Wed, Aug 21, 2013 at 1:25 PM, Colin McCabe cmcc...@alumni.cmu.eduwrote: St.Ack wrote: + Once I figured where the logs were, found that JAVA_HOME was not being exported (don't need this in hadoop-2.0.5 for instance). Adding an exported JAVA_HOME to my running shell which don't seem

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-21 Thread Jason Lowe
+1 (binding) - verified signatures and checksums - built from source - ran some simple jobs on a single-node cluster On 08/15/2013 04:15 PM, Arun C Murthy wrote: Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get released - this fixes the bugs we saw

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-21 Thread Hitesh Shah
+1 (binding) Verified checksums, built from source and ran basic MR jobs on a single-node cluster. -- Hitesh On Aug 15, 2013, at 2:15 PM, Arun C Murthy wrote: Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get released - this fixes the bugs we

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-20 Thread Stack
On Thu, Aug 15, 2013 at 2:15 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get released - this fixes the bugs we saw since the last go-around (rc1). The RC is available at:

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-20 Thread Aaron T. Myers
I was evaluating the release bits when I noticed that the change done in HDFS-4763 to add support for starting the HDFS NFSv3 gateway, which is marked with a fix version of 2.1.0-beta and included in the release notes of RC2, is not in fact included in the RC2 release bits. It looks to me like the

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-20 Thread Arun C Murthy
Thanks for the heads up Aaron, I've changed fix-version of HDFS-4763 to 2.1.1-beta for now. Committers - please be careful setting fix-versions, this is a good anti-pattern to avoid… though, I'm willing to bet a lot of dough that this isn't the first Hadoop release with this issue… *smile*

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-19 Thread Daryn Sharp
-...@hadoop.apache.org mapreduce-...@hadoop.apache.org; hdfs-...@hadoop.apache.org hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org Sent: Friday, August 16, 2013 4:55 PM Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta It's your call, Arun. I.e. as long you believe

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-19 Thread Vinod Kumar Vavilapalli
-...@hadoop.apache.org mapreduce-...@hadoop.apache.org; hdfs-...@hadoop.apache.org hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org Sent: Friday, August 16, 2013 4:55 PM Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta It's your call, Arun. I.e. as long you believe

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-19 Thread Sandy Ryza
mapreduce-...@hadoop.apache.org; hdfs-...@hadoop.apache.org hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org Sent: Friday, August 16, 2013 4:55 PM Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta It's your call, Arun. I.e. as long you believe rc2

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-19 Thread Roman Shaposhnik
On Mon, Aug 19, 2013 at 2:49 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Thanks for the clarification Daryn. That is what I was asking before when I said From my limited understanding, this doesn't seem like a API or a compatibility issue. Can we not fix it in subsequent bug-fix

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
-...@hadoop.apache.org mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org Sent: Thursday, August 15, 2013 4:15 PM Subject: [VOTE] Release Apache Hadoop 2.1.0-beta Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
; mapreduce-...@hadoop.apache.org mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org Sent: Thursday, August 15, 2013 4:15 PM Subject: [VOTE] Release Apache Hadoop 2.1.0-beta Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Arun C Murthy
: Thursday, August 15, 2013 4:15 PM Subject: [VOTE] Release Apache Hadoop 2.1.0-beta Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get released - this fixes the bugs we saw since the last go-around (rc1). The RC is available at: http

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Vinod Kumar Vavilapalli
: [VOTE] Release Apache Hadoop 2.1.0-beta Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get released - this fixes the bugs we saw since the last go-around (rc1). The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.1.0-beta

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Arun Murthy
-...@hadoop.apache.org; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org Sent: Thursday, August 15, 2013 4:15 PM Subject: [VOTE] Release Apache Hadoop 2.1.0-beta Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get released - this fixes the bugs we saw since

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
-...@hadoop.apache.org mapreduce-...@hadoop.apache.org; hdfs-...@hadoop.apache.org hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org Sent: Friday, August 16, 2013 3:44 PM Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta That makes sense too. On Aug 16

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
@hadoop.apache.org Cc: mapreduce-...@hadoop.apache.org mapreduce-...@hadoop.apache.org; hdfs-...@hadoop.apache.org hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org Sent: Friday, August 16, 2013 4:55 PM Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta It's your

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Roman Shaposhnik
-...@hadoop.apache.org; hdfs-...@hadoop.apache.org hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org Sent: Friday, August 16, 2013 4:55 PM Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta It's your call, Arun. I.e. as long you believe rc2 meets the expectations

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Vinod Kumar Vavilapalli
-...@hadoop.apache.org; hdfs-...@hadoop.apache.org hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org Sent: Friday, August 16, 2013 4:55 PM Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta It's your call, Arun. I.e. as long you believe rc2 meets the expectations

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Arun C Murthy
@hadoop.apache.org Cc: mapreduce-...@hadoop.apache.org mapreduce-...@hadoop.apache.org; hdfs-...@hadoop.apache.org hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org Sent: Friday, August 16, 2013 4:55 PM Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta It's your

[VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-15 Thread Arun C Murthy
Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get released - this fixes the bugs we saw since the last go-around (rc1). The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.1.0-beta-rc2/ The RC tag in svn is here:

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-08 Thread Kihwal Lee
; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org; common-dev@hadoop.apache.org common-dev@hadoop.apache.org Sent: Thursday, August 1, 2013 1:30 PM Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta Ok, thanks for heads up Daryn. I'll spin an RC2 once HADOOP-9816 gets in - I'd

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-06 Thread Arpit Agarwal
Hi Arun, Would it make sense to generate Windows binaries since this is the first 2.0 release with Windows support? I am happy to help out with that. FWIW I generated a Windows tarball from the source, brought up a pseudo-distributed cluster, ran some smoke tests and it is looking good! Thanks,

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-05 Thread Tsuyoshi OZAWA
+1 (non-binding) * verified md5 of the source code. * build the package from source code. * run basic hdfs commands. * run MapReduce example jobs(random text writer, wordcount, and pi) over YARN in single node. - Tsuyoshi On Tue, Jul 30, 2013 at 10:29 PM, Arun C Murthy a...@hortonworks.com

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-02 Thread Steve Loughran
On 30 July 2013 14:29, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created another release candidate (rc1) for hadoop-2.1.0-beta that I would like to get released. This RC fixes a number of issues reported on the previous candidate. This release represents a *huge* amount of work

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-01 Thread Daryn Sharp
I broke RPC QOP for integrity and privacy options. :( See blocker HADOOP-9816. I think I understand the problem and it shouldn't be hard to fix. The bug went unnoticed because sadly there are no unit tests for the QOP options, even though it just involves a conf setting. Daryn On Jul 29,

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-01 Thread Roman Shaposhnik
On Wed, Jun 26, 2013 at 1:17 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.1.0-beta that I would like to get released. This release represents a *huge* amount of work done by the community (639 fixes) which includes several major

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-01 Thread Arun C Murthy
Ok, thanks for heads up Daryn. I'll spin an RC2 once HADOOP-9816 gets in - I'd appreciate if you could help push the fix in ASAP. Thanks again! Arun On Aug 1, 2013, at 9:38 AM, Daryn Sharp da...@yahoo-inc.com wrote: I broke RPC QOP for integrity and privacy options. :( See blocker

RE: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-31 Thread Bikas Saha
Apache Hadoop 2.1.0-beta Folks, I've created another release candidate (rc1) for hadoop-2.1.0-beta that I would like to get released. This RC fixes a number of issues reported on the previous candidate. This release represents a *huge* amount of work done by the community (~650 fixes) which

[VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-30 Thread Arun C Murthy
Folks, I've created another release candidate (rc1) for hadoop-2.1.0-beta that I would like to get released. This RC fixes a number of issues reported on the previous candidate. This release represents a *huge* amount of work done by the community (~650 fixes) which includes several major

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-30 Thread Alejandro Abdelnur
Thanks Arun, +1 * verified MD5 signature of source tarball. * built from source tarball * run apache-rat:check on source * installed pseudo cluster (unsecure) * test httpfs * run pi example * run unmanaged AM application Minor NITs (in case we do a new RC): * remove 2.1.1.-beta section from

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-30 Thread Roman Shaposhnik
On Mon, Jul 29, 2013 at 3:00 PM, Arun C Murthy a...@hortonworks.com wrote: Ok, I think we are close to rc1 now - the last of blockers should be committed later today… I'll try and spin RC1 tonight. Great news! I'm back from my vacation (man, those were good 3 weeks! ;-)) and I'll try to pull

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-21 Thread Devaraj Das
I have just raised https://issues.apache.org/jira/browse/HDFS-5016 .. This bug can easily be reproduced by some HBase tests. I'd like this to be considered before we make a beta release. Have spoken about this with some hdfs folks offline and I am told that it is being worked on. Thanks Devaraj

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-17 Thread Vinod Kumar Vavilapalli
Looks like this RC has gone stale and lots of bug fixes went into 2.1 and 2.1.0 branches and there are 4-5 outstanding blockers. And from what I see in CHANGES.txt files there seems to be a confusion about which branch to get in what. I'm blowing off the current 2.1.0 release branch so that

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-17 Thread Vinod Kumar Vavilapalli
On Jul 17, 2013, at 1:04 PM, Alejandro Abdelnur wrote: * YARN-701 It should be addressed before a GA release. Still, as it is this breaks unmanaged AMs and to me that would be a blocker for the beta. YARN-701 and the unmanaged AMs fix should be committed in tandem. * YARN-918

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-03 Thread Tsuyoshi OZAWA
Hi Arun, Some bug fixes about MapReduce should be included in next release. MAPREDUCE-5221 should be merged because it's a lost feature of MRv2 compared to MRv1. MAPREDUCE-5358 and MAPREDUCE-5335 are very trivial fixes, so it can be merged immediately. # I sent the previous email only to

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-03 Thread Vinod Kumar Vavilapalli
We should get these in, looking at them now. Thanks, +Vinod On Jun 28, 2013, at 12:03 PM, Hitesh Shah wrote: Hi Arun, From a YARN perspective, YARN-791 and YARN-727 are 2 jiras that may potentially change the apis. They can implemented in a backward compat fashion if committed after

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-03 Thread Jason Lowe
I committed MAPREDUCE-5358 to branch-2 but did not commit it to branch-2.1-beta since it wasn't a blocker and Arun was in the middle of cutting the release. Arun, if you feel it's appropriate to put this in branch-2.1-beta feel free to pull it in or let me know. Thanks! Jason On

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-02 Thread Ramya Sunil
-1. Some of the cli and distcp system tests which use hftp:// and webhdfs:// are failing on secure cluster (HDFS-4841 and HDFS-4952/HDFS-4896). This is a regression and we need to make sure they work before we call a release. On Wed, Jun 26, 2013 at 1:17 AM, Arun C Murthy a...@hortonworks.com

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-01 Thread Roman Shaposhnik
Hi Arun! On Fri, Jun 28, 2013 at 2:05 PM, Arun C Murthy a...@hortonworks.com wrote: Thanks Hitesh Roman, I'll roll RC1 once these are fixed. Here's the latest update. I've incorporated Collin's patch for HADOOP-9676 and re-ran the tests. A few subtests of TestCLI still fail, but quite a few

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-28 Thread Hitesh Shah
Hi Arun, From a YARN perspective, YARN-791 and YARN-727 are 2 jiras that may potentially change the apis. They can implemented in a backward compat fashion if committed after 2.1.0. However, this will require adding of differently-named apis ( different urls in case of the webservices ) and

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-28 Thread Sandy Ryza
For YARN-791, if we can come to consensus on the correct approach, I can try to have a patch ASAP. -Sandy On Fri, Jun 28, 2013 at 12:03 PM, Hitesh Shah hit...@apache.org wrote: Hi Arun, From a YARN perspective, YARN-791 and YARN-727 are 2 jiras that may potentially change the apis. They

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-28 Thread Arun C Murthy
Thanks Hitesh Roman, I'll roll RC1 once these are fixed. Arun On Jun 28, 2013, at 12:25 PM, Roman Shaposhnik r...@apache.org wrote: I think it would very useful if somebody more familiar with HDFS (Suresh?) could take a look at: https://issues.apache.org/jira/browse/HDFS-4940 Suresh

[VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-26 Thread Arun C Murthy
Folks, I've created a release candidate (rc0) for hadoop-2.1.0-beta that I would like to get released. This release represents a *huge* amount of work done by the community (639 fixes) which includes several major advances including: # HDFS Snapshots # Windows support # YARN API stabilization

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-26 Thread Steve Loughran
On 26 June 2013 09:17, Arun C Murthy a...@hortonworks.com wrote: Folks, The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.1.0-beta-rc0 The maven artifacts are available via repository.apache.org. did all the poms go up? [INFO]