Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-19 Thread Arun C Murthy
With 24 +1s (10 binding) and no -1s the vote passes. Thanks for everyone who tried the release and provided feedback. I'll push the bits and send out a note. thanks, Arun On Nov 13, 2014, at 3:08 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created another release candidate

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-18 Thread Tsuyoshi OZAWA
Hi, I also found that a following command fails with hadoop-2.6.0-rc1-src.tar.gz: $ mvn package -Pdocs -DskipTests -Dtar I filed it as HADOOP-11316. We should fix it if possible. Or, should we fix it for 2.6.1? Thanks, - Tsuyoshi On Tue, Nov 18, 2014 at 3:04 PM, Tsuyoshi OZAWA

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-18 Thread Arun C Murthy
Tsuyoshi, I think you have to pass along -Pdist too… afaik that is how the Jenkins we use for building release artifacts operates. For now, I've marked HADOOP-11316 for inclusion into 2.6.1 if required. thanks, Arun On Nov 18, 2014, at 7:26 AM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.com

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-18 Thread Eric Payne
-...@hadoop.apache.org Sent: Thursday, November 13, 2014 5:08 PM Subject: [VOTE] Release Apache Hadoop 2.6.0 Folks, I've created another release candidate (rc1) for hadoop-2.6.0 based on the feedback. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1 The RC tag in git

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-18 Thread Karthik Kambatla
-...@hadoop.apache.org yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org mapreduce-...@hadoop.apache.org Sent: Thursday, November 13, 2014 5:08 PM Subject: [VOTE] Release Apache Hadoop 2.6.0 Folks, I've created another release candidate (rc1) for hadoop-2.6.0 based on the feedback

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-18 Thread Tsuyoshi OZAWA
-...@hadoop.apache.org mapreduce-...@hadoop.apache.org Sent: Thursday, November 13, 2014 5:08 PM Subject: [VOTE] Release Apache Hadoop 2.6.0 Folks, I've created another release candidate (rc1) for hadoop-2.6.0 based on the feedback. The RC is available at: http://people.apache.org

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-18 Thread Masatake Iwasaki
-...@hadoop.apache.org mapreduce-...@hadoop.apache.org Sent: Thursday, November 13, 2014 5:08 PM Subject: [VOTE] Release Apache Hadoop 2.6.0 Folks, I've created another release candidate (rc1) for hadoop-2.6.0 based on the feedback. The RC is available at: http://people.apache.org/~acmurthy/hadoop

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Tsuyoshi OZAWA
+0(non-binding) HDFS-6833 is critical issue for us - could you help us to merge it into 2.6? Thanks, - Tsuyoshi On Sat, Nov 15, 2014 at 1:03 PM, Hitesh Shah hit...@apache.org wrote: +1 (binding) Built Hadoop from source, compiled Tez against the hadoop jars pushed to staging repo and ran a

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Mit Desai
+1 (non-binding) + download and compile source code + deployed on a pseudo cluster + successfully run sample MR jobs + verified checksum Thanks,Mit Desai On Monday, November 17, 2014 6:19 AM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.com wrote: +0(non-binding) HDFS-6833 is critical

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Jason Lowe
@hadoop.apache.org common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org mapreduce-...@hadoop.apache.org Sent: Thursday, November 13, 2014 5:08 PM Subject: [VOTE] Release Apache Hadoop 2.6.0

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Charles Lamb
I built from the src package, started a cluster, created an encryption zone and read/wrote data from/to it. +1 (non-binding) Charles

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Suresh Srinivas
Tsuyoshi, thanks for bringing up HDFS-6833. However, given it is a boundary condition (and should not cause issues when for files with replication factor 3), we should perhaps target this into 2.6.1 and not block this release. Thoughts? On Mon, Nov 17, 2014 at 4:17 AM, Tsuyoshi OZAWA

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Yongjun Zhang
Hi Suresh, I did review HDFS-6833 and the patch Shinichi provided a while back. It's not really directly related to replication factor. The problem reported there is, DirectoryScanner tries to register with NN blocks already scheduled to be deleted as regular blocks, due to the delay in block

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Subramaniam V K
+1 (non-binding) - Deployed single node cluster - Verified reservation system works (YARN-1051) by making reservations and submitting sample MR jobs against the reservations - Verified move apps between capacity scheduler queues (YARN-2378) Thanks, Subru On Mon, Nov 17, 2014 at 9:55 AM, Charles

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Suresh Srinivas
+1 (binding) Verified the signatures and hashes for both src and binary tars. Built from the source, the binary distribution and the documentation. Started a single node cluster and tested the following: - Started HDFS cluster, verified the hdfs CLI commands such ls, copying data back and forth,

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Tsz Wo Sze
I agree that HDFS-6833 is not a blocker.  It is not a problem for the blocks with replication = 3 and it is not a regression (please correct me if I am wrong.)Tsz-Wo On Monday, November 17, 2014 10:06 AM, Suresh Srinivas sur...@hortonworks.com wrote: Tsuyoshi, thanks for bringing

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Tsz Wo Sze
Hi Arun, Only md5 is provided but not mds?  Is it intentional? Tsz-Wo On Monday, November 17, 2014 2:14 PM, Tsz Wo Sze szets...@yahoo.com wrote: I agree that HDFS-6833 is not a blocker.  It is not a problem for the blocks with replication = 3 and it is not a regression (please

RE: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Liu, Yi A
...@hortonworks.com] Sent: Friday, November 14, 2014 7:08 AM To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: [VOTE] Release Apache Hadoop 2.6.0 Folks, I've created another release candidate (rc1) for hadoop-2.6.0 based

RE: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Liu, Yi A
Subject: RE: [VOTE] Release Apache Hadoop 2.6.0 +1 (non-binding) - Built from source - Setup a security cluster with 4 nodes, and verified various fs operations. - Verified MapReduce examples in security mode. - Verify HDFS encryption at rest in security mode. Regards, Yi Liu -Original Message

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Tsz Wo Sze
+1 (suppose using md5 is intentional.) Verified md5 and ran a single node HA HDFS cluster for some time.  Everything worked great. Regards,Tsz-Wo On Monday, November 17, 2014 4:48 PM, Tsz Wo Sze szets...@yahoo.com wrote: Hi Arun, Only md5 is provided but not mds?  Is it

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Tsuyoshi OZAWA
Suresh, Tsz-Wo, Thanks for your comments. Could you check a comment by Masatake on HDFS-6833? thanks, - Tsuyoshi On Tue, Nov 18, 2014 at 7:14 AM, Tsz Wo Sze szets...@yahoo.com.invalid wrote: I agree that HDFS-6833 is not a blocker. It is not a problem for the blocks with replication = 3 and

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Akira AJISAKA
Thanks Arun for creating another rc! +1 (non-binding) - patched Tez 0.5.2 pom to compile against 2.6.0-rc1 - patched Hive 0.14 pom to compile against 2.6.0-rc1 - run several Hive queries on Tez Thanks, Akira (11/14/14, 10:16), Wangda Tan wrote: Thanks Arun! Have tried compile, deploy and

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Chen He
+1 non-binding download and compile source code; setup single node cluster; successfully run sleep job; Regards! Chen On Fri, Nov 14, 2014 at 1:44 AM, Akira AJISAKA ajisa...@oss.nttdata.co.jp wrote: Thanks Arun for creating another rc! +1 (non-binding) - patched Tez 0.5.2 pom to compile

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Steve Loughran
+1 binding purged local m2 repos of org/apache/hadoop/* rebuilt and reran slider unit and functional tests on OSX and windows, triggered jenkins builds on Centos debian. All passed. On 13 November 2014 23:08, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created another release

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Zhijie Shen
+1 (non-binding) Replayed the verifications for rc0, and everything keeps working fine. On Fri, Nov 14, 2014 at 9:21 AM, Chen He airb...@gmail.com wrote: +1 non-binding download and compile source code; setup single node cluster; successfully run sleep job; Regards! Chen On Fri, Nov

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Yongjun Zhang
Thanks Arun for leading the 2.6 release effort. +1 (non-binding) - Downloaded rc1 source and did build - Created two single-node clusters running 2.6 - Ran sample mapreduce job - Ran distcp between two clusters --Yongjun On Thu, Nov 13, 2014 at 3:08 PM, Arun C Murthy a...@hortonworks.com

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Eric Payne
@hadoop.apache.org common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org mapreduce-...@hadoop.apache.org Sent: Monday, November 10, 2014 8:52 PM Subject: [VOTE] Release Apache Hadoop

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Chris Nauroth
+1 (binding) - Verified checksums and signatures for source and binary tarballs. - Started a pseudo-distributed HDFS cluster in secure mode with SSL. - Tested various file system operations. - Verified HDFS-2856, the new feature to run a secure DataNode without requiring root. - Verified

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Chris Nauroth
10, 2014 8:52 PM Subject: [VOTE] Release Apache Hadoop 2.6.0 Folks, I've created a release candidate (rc0) for hadoop-2.6.0 that I would like to see released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0 The RC tag in git is: release-2.6.0-rc0 The maven

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Jing Zhao
+1 (binding) Verified checksums and signatures. Successfully deploy a cluster with NameNode HA setup and run some hdfs commands. Thanks, -Jing On Fri, Nov 14, 2014 at 3:58 PM, Chris Nauroth cnaur...@hortonworks.com wrote: +1 (binding) - Verified checksums and signatures for source and

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Xiaoyu Yao
+1 (non-binding) Successfully download the hadoop-2.6.0-rc1 source code, build and deploy a single node clusters with the following new HDFS features configured. * HDFS-6581 (Memory Storage), * HDFS-6584 (Archival Storage Storage Policy), * HDFS-6134 (KMS HDFS at rest data encryption) I

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Hitesh Shah
+1 (binding) Built Hadoop from source, compiled Tez against the hadoop jars pushed to staging repo and ran a few example Tez jobs on a single node cluster. — HItesh On Nov 13, 2014, at 3:08 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created another release candidate

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Jason Lowe
-...@hadoop.apache.org; common-dev@hadoop.apache.org common-dev@hadoop.apache.org Sent: Wednesday, November 12, 2014 10:58 AM Subject: Re: [VOTE] Release Apache Hadoop 2.6.0 Sounds good. I'll create an rc1. Thanks. Arun On Nov 11, 2014, at 2:06 PM, Robert Kanter rkan...@cloudera.com wrote: Hi

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Chris Nauroth
] Sent: Thursday, November 13, 2014 12:58 AM To: yarn-...@hadoop.apache.org Cc: mapreduce-...@hadoop.apache.org; Ravi Prakash; hdfs-...@hadoop.apache.org; common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.6.0 Sounds good. I'll create an rc1. Thanks. Arun On Nov 11

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Chris Nauroth
-...@hadoop.apache.org; Ravi Prakash; hdfs-...@hadoop.apache.org; common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.6.0 Sounds good. I'll create an rc1. Thanks. Arun On Nov 11, 2014, at 2:06 PM, Robert Kanter rkan...@cloudera.com wrote: Hi Arun, We were testing

[VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Arun C Murthy
Folks, I've created another release candidate (rc1) for hadoop-2.6.0 based on the feedback. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1 The RC tag in git is: release-2.6.0-rc1 The maven artifacts are available via repository.apache.org at

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Ravi Prakash
Thanks for the respin Arun! I've verified all checksums, and tested that the DockerContainerExecutor was able to launch jobs. I'm a +1 on the release On Thursday, November 13, 2014 3:09 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created another release candidate

RE: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Liu, Yi A
-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.6.0 I have committed HDFS-7385 down through branch-2.6.0. Thank you! Chris Nauroth Hortonworks http://hortonworks.com/ On Thu, Nov 13, 2014 at 9:14 AM, Chris Nauroth cnaur...@hortonworks.com wrote: I'm helping to expedite a complete

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Wangda Tan
Thanks Arun! Have tried compile, deploy and configured a local cluster and can successfully execute a job with node labels. +1 (non-binding) Thanks, Wangda On Thu, Nov 13, 2014 at 3:39 PM, Ravi Prakash ravi...@ymail.com wrote: Thanks for the respin Arun! I've verified all checksums, and

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-12 Thread Arun C Murthy
Sounds good. I'll create an rc1. Thanks. Arun On Nov 11, 2014, at 2:06 PM, Robert Kanter rkan...@cloudera.com wrote: Hi Arun, We were testing the RC and ran into a problem with the recent fixes that were done for POODLE for Tomcat (HADOOP-11217 for KMS and HDFS-7274 for HttpFS).

RE: [VOTE] Release Apache Hadoop 2.6.0

2014-11-12 Thread Liu, Yi A
...@hortonworks.com] Sent: Thursday, November 13, 2014 12:58 AM To: yarn-...@hadoop.apache.org Cc: mapreduce-...@hadoop.apache.org; Ravi Prakash; hdfs-...@hadoop.apache.org; common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.6.0 Sounds good. I'll create an rc1. Thanks. Arun On Nov 11

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Steve Loughran
+1 binding -patched slider pom to build against 2.6.0 -verified build did download, which it did at up to ~8Mbps. Faster than a local build. -full clean test runs on OS/X Linux Windows 2012: Same thing. I did have to first build my own set of the windows native binaries, by checking out

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Ravi Prakash
Hi Arun! We are very close to completion on YARN-1964 (DockerContainerExecutor). I'd also like HDFS-4882 to be checked in. Do you think these issues merit another RC? ThanksRavi On Tuesday, November 11, 2014 11:57 AM, Steve Loughran ste...@hortonworks.com wrote: +1 binding

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Robert Kanter
Hi Arun, We were testing the RC and ran into a problem with the recent fixes that were done for POODLE for Tomcat (HADOOP-11217 for KMS and HDFS-7274 for HttpFS). Basically, in disabling SSLv3, we also disabled SSLv2Hello, which is required for older clients (e.g. Java 6 with openssl 0.9.8x) so

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Wangda Tan
Thanks Arun for creating the RC. Tried to build and deploy it on a local distributed cluster, can successfully run distributed shell job with node labels. +1 (non-binding), Thanks, Wangda On Tue, Nov 11, 2014 at 2:06 PM, Robert Kanter rkan...@cloudera.com wrote: Hi Arun, We were testing

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Zhijie Shen
+1 (non-binding) * Downloaded the source tar ball, and built binaries from it successfully. * Ran DS apps and MR jobs with emitting timeline data enabled successfully. * Verified the generic history information, DS-specific and MR-specific metrics were available. * Ran the timeline server in

[VOTE] Release Apache Hadoop 2.6.0

2014-11-10 Thread Arun C Murthy
Folks, I've created a release candidate (rc0) for hadoop-2.6.0 that I would like to see released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0 The RC tag in git is: release-2.6.0-rc0 The maven artifacts are available via repository.apache.org at

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-10 Thread Tsuyoshi OZAWA
Hi Arun, Could you confirm the link and permission to the files is correct? I got a following error: Forbidden You don't have permission to access /~acmurthy/hadoop-2.6.0-rc0/hadoop-2.6.0-src.tar.gz on this server. On Tue, Nov 11, 2014 at 11:52 AM, Arun C Murthy a...@hortonworks.com wrote:

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-10 Thread Arun Murthy
Duh! $ chmod a+r * Please try now. Thanks! Arun On Mon, Nov 10, 2014 at 7:06 PM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.com wrote: Hi Arun, Could you confirm the link and permission to the files is correct? I got a following error: Forbidden You don't have permission to access