Re: [DISCUSS] Release numbering semantics with concurrent (>2) releases [Was Setting JIRA fix versions for 3.0.0 releases]

2016-07-26 Thread Andrew Wang
Thanks for replies Akira and Tsuyoshi, inline: Akira: Assuming 3.0.0-alpha1 will be released between 2.7.0 and 2.8.0, we > need to add 3.0.0-alphaX if 2.8.0 is in the fix versions of a jira and we > don't need to add 3.0.0-alphaX if 2.7.0 is in the fix versions of a jira. > Is it right? Yes,

[DISCUSS] Release numbering semantics with concurrent (>2) releases [Was Setting JIRA fix versions for 3.0.0 releases]

2016-07-26 Thread Tsuyoshi Ozawa
Hi Vinod, Thanks all guys for starting discussion! My suggestion is adding the date when branch cut is done: like 3.0.0-alpha1-20160724, 2.8.0-20160730 or something. Pros:-) It's totally ordered. If we have a policy such as backporting to maintainance branches after the date, users can find

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Akira Ajisaka
+1 for the source tarball. - Downloaded source tarball and binary tarball - Verified signatures and checksums - Compiled and built a single node cluster - Compiled Hive 2.1.0/1.2.1 and Tez 0.8.4/0.7.1 using Hadoop 2.7.3 pom successfully - Ran some Hive on Tez queries successfully Thanks,

[jira] [Created] (YARN-5437) [Umbrella] Add more debug/diagnostic messages to scheduler

2016-07-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5437: Summary: [Umbrella] Add more debug/diagnostic messages to scheduler Key: YARN-5437 URL: https://issues.apache.org/jira/browse/YARN-5437 Project: Hadoop YARN Issue

[jira] [Created] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-26 Thread Zhiyuan Yang (JIRA)
Zhiyuan Yang created YARN-5436: -- Summary: Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also ) Key: YARN-5436 URL: https://issues.apache.org/jira/browse/YARN-5436 Project:

[jira] [Created] (YARN-5435) User AM resource limit for does not get updated for ReservationQueue after execution of plan-follower.

2016-07-26 Thread Sean Po (JIRA)
Sean Po created YARN-5435: - Summary: User AM resource limit for does not get updated for ReservationQueue after execution of plan-follower. Key: YARN-5435 URL: https://issues.apache.org/jira/browse/YARN-5435

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Eric Payne
+1 (non-binding) Thanks, Vinod, for all of your hard work and congratulations in completing this release. After downloading and building the source, I installed Hadoop 2.7.3 RC0 on a 3-node, multi-tenant, insecure cluster. I ran manual tests to ensure the following: - Ensure that user limit

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Kuhu Shukla
+1 (non-binding). - Built Tar ball from source. - Deployed pseudo-distributed cluster. - Ran sleep job. Thank you Vinod! Regards,Kuhu Shukla On Tuesday, July 26, 2016 4:17 PM, Andrew Wang wrote: On Tue, Jul 26, 2016 at 1:23 PM, Karthik Kambatla

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Andrew Wang
On Tue, Jul 26, 2016 at 1:23 PM, Karthik Kambatla wrote: > IIRR, the vote is on source artifacts and binaries are for convenience. > > Let me refine this statement a bit. Both the binary tarball and the JARs we publish to Maven are still official release artifacts. This is

Re: [DISCUSS] Release numbering semantics with concurrent (>2) releases [Was Setting JIRA fix versions for 3.0.0 releases]

2016-07-26 Thread Andrew Wang
Thanks Vinod for forking the thread. Let me try and summarize what Allen and I talked about in the previous thread. Currently, we've been marking JIRAs with fix versions of both 2.6.x and 2.7.x. IIUC, the chronological ordering between these two lines is actually not important. If you're on

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Eric Badger
* Verified mds and pgp signatures of both source and binary* Built tarball from source on OS X 10.11.6 (El Capitan)* Deployed in pseudo-distributed mode* Ran sleep jobs and other randomly selected tests on both MapReduce and Tez* Visually verified the RM and history server UIs  Thanks, Eric

[jira] [Created] (YARN-5434) Add -client|server argument for graceful decom

2016-07-26 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-5434: --- Summary: Add -client|server argument for graceful decom Key: YARN-5434 URL: https://issues.apache.org/jira/browse/YARN-5434 Project: Hadoop YARN Issue Type:

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Karthik Kambatla
IIRR, the vote is on source artifacts and binaries are for convenience. If that is right, I am open to either options - do another RC or continue this vote and fix the binary artifacts. On Tue, Jul 26, 2016 at 12:11 PM, Vinod Kumar Vavilapalli < vino...@apache.org> wrote: > Thanks Daniel and

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Naganarasimha Garla
Tested as follows - deployed a pseudo cluster from RC0 tar - Verified signature and checksum - Run MR sleep on YARN - With/Without node labels enabled. - Verified ATS V1 (One small issue though not regression, tracking URL for running app is shown as Unassigned, will check and raise if required )

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Vinod Kumar Vavilapalli
But, everyone please do continue your sanity checking on RC0 in case there are more issues to be fixed. Thanks +Vinod > On Jul 26, 2016, at 12:11 PM, Vinod Kumar Vavilapalli > wrote: > > Thanks Daniel and Wei. > > I think these are worth fixing, I’m withdrawing this RC.

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Vinod Kumar Vavilapalli
Thanks Daniel and Wei. I think these are worth fixing, I’m withdrawing this RC. Will look at fixing these issues and roll a new candidate with the fixes as soon as possible. Thanks +Vinod > On Jul 26, 2016, at 11:05 AM, Wei-Chiu Chuang wrote: > > I noticed two issues: >

[DISCUSS] Release numbering semantics with concurrent (>2) releases [Was Setting JIRA fix versions for 3.0.0 releases]

2016-07-26 Thread Vinod Kumar Vavilapalli
Forking the thread to make sure it attracts enough eye-balls. The earlier one was about 3.0.0 specifically and I don’t think enough people were watching that. I’ll try to summarize a bit. # Today’s state of release numbering and ordering: So far, all the releases we have done, we have

Re: Setting JIRA fix versions for 3.0.0 releases

2016-07-26 Thread Wangda Tan
Hi all, I'm trying to generate JDiff for sub projects of Hadoop, some updates: *- Common*: JDiff cannot be generated , filed https://issues.apache.org/jira/browse/HADOOP-13428 and debugging that. - *HDFS*: It pointed to a older version (2.6.0), we need to upgrade it to the latest stable release

Re: Setting JIRA fix versions for 3.0.0 releases

2016-07-26 Thread Vinod Kumar Vavilapalli
+1 Thanks +Vinod > On Jul 26, 2016, at 7:39 AM, Wangda Tan wrote: > > lets try to use both jdiff and the new tool and compare results because this > is the first time with the new tool. > > Appreciate your time to help us about this effort!

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Wei-Chiu Chuang
I noticed two issues: (1) I ran hadoop checknative, but it seems the binary tarball was not compiled with native library for Linux. On the contrary, the Hadoop built from source tarball with maven -Pnative can find the native libraries on the same host. (2) I noticed that the release dates in

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Daniel Templeton
I just downloaded the build tarball and deployed it on a 2-node cluster. It looks to me like it's compiled for the wrong platform: # file /usr/lib/hadoop/bin/container-executor /usr/lib/hadoop/bin/container-executor: setuid setgid Mach-O 64-bit executable I'm also seeing the

[jira] [Created] (YARN-5433) Audit dependencies for Category-X

2016-07-26 Thread Sean Busbey (JIRA)
Sean Busbey created YARN-5433: - Summary: Audit dependencies for Category-X Key: YARN-5433 URL: https://issues.apache.org/jira/browse/YARN-5433 Project: Hadoop YARN Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Masatake Iwasaki
Thanks for putting this up, Vinod. +1 (non-binding) * verified signature and mds of source and binary tarball * built from source tarball on CentOS 6 * built site documentation * deployed 3-node cluster with NN-HA and RM-HA, ran example jobs * built rpms by using Bigtop, deployed 3-node cluster

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-26 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/114/ [Jul 25, 2016 1:45:03 PM] (stevel) HADOOP-13406 S3AFileSystem: Consider reusing filestatus in delete() and [Jul 25, 2016 2:50:23 PM] (stevel) HADOOP-13188 S3A file-create should throw error rather than

Re: Setting JIRA fix versions for 3.0.0 releases

2016-07-26 Thread Wangda Tan
Hi Sean, Sorry I didn't make it clear, lets try to use both jdiff and the new tool and compare results because this is the first time with the new tool. Appreciate your time to help us about this effort! Thanks, Wangda Sent from my iPhone > On Jul 26, 2016, at 6:01 AM, Sean Busbey

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Rohith Sharma K S
+1(non-binding) Downloaded and built from source Cluster installed in 3 nodes and verified running simple MR jobs. Verified for RM HA , RM work preserving restart with CapacityScheduler Thanks & Regards Rohith Sharma K S > On Jul 26, 2016, at 6:50 PM, Vinayakumar B

RE: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Vinayakumar B
+1 (binding) 1. Downloaded and Built from branch-2.7.3 2. Started up HDFS and YARN in Single Node cluster. 3. Ran WordCount job multiple times and Success. 4. Verified the "Release Notes" available at the URL mentioned by Vinod. Apart from that, Faced same issues as Andrew wang, while running

Re: Setting JIRA fix versions for 3.0.0 releases

2016-07-26 Thread Sean Busbey
Just so I don't waste time chasing my tail, should I interpret this email and the associated JIRA as the PMC preferring I not spend volunteer time providing a compatibility breakdown as previously discussed? On Mon, Jul 25, 2016 at 7:54 PM, Wangda Tan wrote: > I just filed

Re: Setting JIRA fix versions for 3.0.0 releases

2016-07-26 Thread Sean Busbey
Yes, the Java API Compliance Checker allows specifying Annotations to pare down where incompatible changes happen. It was added some time ago based on feedback from the Apache HBase project. The limitations I've found are: 1) at least earlier versions only supported annotations at the class level

[jira] [Resolved] (YARN-5427) Labeled apps cant use resources in 2.8

2016-07-26 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan resolved YARN-5427. - Resolution: Not A Bug Close this issue since it`s normal behavior in 2.8. Thanks for your replys. >

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Rakesh Radhakrishnan
Thank you Vinod. +1 (non-binding) - downloaded and built from source - deployed HDFS-HA cluster and tested few switching behaviors - executed few hdfs commands from command line - viewed basic UI - ran HDFS/Common unit tests - checked LICENSE and NOTICE files Regards, Rakesh Intel On Tue, Jul

[jira] [Created] (YARN-5431) TimeLineReader daemon start should allow to pass its own reader opts

2016-07-26 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-5431: --- Summary: TimeLineReader daemon start should allow to pass its own reader opts Key: YARN-5431 URL: https://issues.apache.org/jira/browse/YARN-5431 Project:

[jira] [Created] (YARN-5430) Get docker container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
Jian He created YARN-5430: - Summary: Get docker container's ip and host from NM Key: YARN-5430 URL: https://issues.apache.org/jira/browse/YARN-5430 Project: Hadoop YARN Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Zhihai Xu
Thanks Vinod. +1 (non-binding) * Downloaded and built from source * Checked LICENSE and NOTICE * Deployed a pseudo cluster * Ran through MR and HDFS tests * verified basic HDFS operations and Pi job. Zhihai On Fri, Jul 22, 2016 at 7:15 PM, Vinod Kumar Vavilapalli wrote: