Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

2017-12-13 Thread Rohith Sharma K S
+1 (Binding) Built from source and deployed non-secure 3 node cluster Verified for - RM HA/RM Restart/RM work preserving restart - NM work preserving restart - Ran sample MR and Distributed shell jobs. Thanks & Regards Rohith Sharma K S On 5 December 2017 at 15:28, Junping Du

[jira] [Created] (YARN-7648) Application page UI is broken in app error state

2017-12-13 Thread Vasudevan Skm (JIRA)
Vasudevan Skm created YARN-7648: --- Summary: Application page UI is broken in app error state Key: YARN-7648 URL: https://issues.apache.org/jira/browse/YARN-7648 Project: Hadoop YARN Issue Type:

Re: [VOTE] Release Apache Hadoop 2.7.5 (RC1)

2017-12-13 Thread Rohith Sharma K S
+1 (binding) Built from source and deployed non-secure 3 node cluster Verified for - RM HA/RM Restart/RM work preserving restart - Ran sample MR and Distributed shell jobs. Thanks & Regards Rohith Sharma K S On 8 December 2017 at 08:52, Konstantin Shvachko wrote: > Hi

[jira] [Created] (YARN-7649) RMContainer state transition exception after container update

2017-12-13 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7649: - Summary: RMContainer state transition exception after container update Key: YARN-7649 URL: https://issues.apache.org/jira/browse/YARN-7649 Project: Hadoop YARN

RE: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread Brahma Reddy Battula
+1 (non-binding),Thanks Andrew wang for driving this. ---Built from the source --Installed 3 Node HA cluster --Verified Basic shell commands --Ran Sample jobs like pi,wordcount --Verified the UI's --Brahma Reddy Battula -Original Message- From: Andrew Wang

[jira] [Created] (YARN-7650) Queue link in old RM UI is not working correctly when node labels are enabled

2017-12-13 Thread Sunil G (JIRA)
Sunil G created YARN-7650: - Summary: Queue link in old RM UI is not working correctly when node labels are enabled Key: YARN-7650 URL: https://issues.apache.org/jira/browse/YARN-7650 Project: Hadoop YARN

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread Sunil G
+1 (binding) Thanks Andrew Wang for driving this effort and also thanks to all others who helped in this release. Kudos!!! I tested this RC by building it from source. I met with couple of issues (not blocker) HADOOP-15116 and YARN-7650. This could be tracked separately. - Ran many MR apps

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

2017-12-13 Thread Sunil G
+1 (binding) Thanks Junping for the effort. I have deployed a cluster built from source tar ball. - Ran few MR apps and verified UI. CLI commands are also fine related to app. - Tested below feature sanity - Application priority - Application timeout - Tested basic

[jira] [Created] (YARN-7651) branch-2 application master (MR) cannot run in 3.1 cluster

2017-12-13 Thread Sunil G (JIRA)
Sunil G created YARN-7651: - Summary: branch-2 application master (MR) cannot run in 3.1 cluster Key: YARN-7651 URL: https://issues.apache.org/jira/browse/YARN-7651 Project: Hadoop YARN Issue Type:

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread Rohith Sharma K S
+1 (binding) - built from source and deployed 3 node cluster - installed RM HA cluster along with ATSv2 enabled and new YARN UI. - verified for -- RM HA switch / RM Restart / RM Work preserving restart -- NM work preserving restart -- Ran sample MR jobs and Distributed shell along with multiple

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread Vinod Kumar Vavilapalli
Yes, JIRAs will be filed, the wiki-page idea from YARN meetup is to record all combinations of testing that need to be done and correspondingly capture all the testing that someone in the community has already done and record it for future perusal. From what you are saying, I guess we haven't

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread Vinod Kumar Vavilapalli
Good stuff Andrew, and thanks everyone! +Vinod > On Dec 13, 2017, at 1:05 PM, Andrew Wang wrote: > > To close this out, the vote passes successfully with 13 binding +1s, 5 > non-binding +1s, and no -1s. Thanks everyone for voting! I'll work on staging. >

回复:[VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread 郑锴(铁杰)
Thanks Andrew for the hard driving!! I downloaded the source tar bao and built it successfully on a MacOS. I haven't got the chance to try it yet, so mynon-binding +1.  Regards,Kai --发件人:John Zhuge

[jira] [Created] (YARN-7656) Can not destroy yarn service application in stopped state

2017-12-13 Thread Eric Yang (JIRA)
Eric Yang created YARN-7656: --- Summary: Can not destroy yarn service application in stopped state Key: YARN-7656 URL: https://issues.apache.org/jira/browse/YARN-7656 Project: Hadoop YARN Issue

[RESULT] [VOTE] Release Apache Hadoop 2.8.3 (RC0)

2017-12-13 Thread Junping Du
Thanks to all who verified and voted! I give my binding +1 to conclude the vote for 2.8.3 RC0, based on: - Build from source and verify signatures - Deploy pseudo-distributed cluster and run some simple job, like: pi, sleep, etc. - Verify UI of daemons, like: NameNode, DataNode, ResourceManager,

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread John Zhuge
Thanks Andrew for the great effort! Here is my late vote. +1 (binding) - Verified checksums and signatures of tarballs - Built source with native, Oracle Java 1.8.0_152 on Mac OS X 10.13.2 - Verified cloud connectors: - S3A integration tests (perf tests skipped) - Deployed

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread Sean Mackrory
+1 (non-binding) * Verified md5 of all artifacts * Built with -Pdist * Ran several s3a shell commands * Started a pseudo-distributed HDFS and YARN cluster * Ran grep and pi MR examples * Sanity-checked contents of release notes, rat report, and changes On Fri, Dec 8, 2017 at 1:31 PM, Andrew Wang

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-12-13 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/621/ [Dec 12, 2017 6:56:26 PM] (jlowe) YARN-7625. Expose NM node/containers resource utilization in JVM [Dec 12, 2017 9:35:56 PM] (jianhe) YARN-7565. Yarn service pre-maturely releases the container after AM

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread Wangda Tan
Thanks Andrew for driving this. +1 (Binding) Ran SLS + CS's Perf unit test and saw similar performance compared to trunk. Compiled from source, deployed single node cluster and ran several jobs. Best, Wangda On Wed, Dec 13, 2017 at 7:29 AM, Sunil G wrote: > +1

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

2017-12-13 Thread Naganarasimha Garla
Thanks Junping for the release. +1 (binding) Tested on a single node pseudo cluster, I performed the following tests: - Downloaded the tars and verified the signatures, installed using the tar - Successfully ran few MR jobs - Verified few hdfs operations - Verified RM,NM and HDFS webui's -

Re: [VOTE] Release Apache Hadoop 2.7.5 (RC1)

2017-12-13 Thread Eric Payne
Thanks for the hard work on this release, Konstantin. +1 (binding) - Built from source - Verified that refreshing of queues works as expected. - Verified can run multiple users in a single queue - Ran terasort test - Verified that cross-queue preemption works as expected Thanks. Eric Payne

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread Wei-Chiu Chuang
Thanks Andrew again, +1 (binding) * Downloaded source tarball, and compiled with native libs successfully: -Pdist,native -Drequire.isal -Drequire.snappy -Drequire.openssl -Drequire.zstd. * hadoop checknative ran successfully. * Upgraded a fsimage that was previously used in a Hadoop 2.6-based

Re: [VOTE] Release Apache Hadoop 2.7.5 (RC1)

2017-12-13 Thread Jonathan Hung
Thanks Konstantin for working on this. +1 (non-binding) - Downloaded binary and verified md5 - Deployed RM HA and tested failover Jonathan Hung On Wed, Dec 13, 2017 at 11:02 AM, Eric Payne wrote: > Thanks for the hard work on this release, Konstantin. > +1

[jira] [Created] (YARN-7652) Handle AM register requests asynchronously in FederationInterceptor

2017-12-13 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-7652: Summary: Handle AM register requests asynchronously in FederationInterceptor Key: YARN-7652 URL: https://issues.apache.org/jira/browse/YARN-7652 Project: Hadoop YARN

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread Vinod Kumar Vavilapalli
I was waiting for Daniel to post the minutes from YARN meetup to talk about this. Anyways, in that discussion, we identified a bunch of key upgrade related scenarios that no-one seems to have validated - atleast from the representation in the YARN meetup. I'm going to create a wiki-page listing

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread Andrew Wang
Hi folks, To close this out, the vote passes successfully with 13 binding +1s, 5 non-binding +1s, and no -1s. Thanks everyone for voting! I'll work on staging. I'm hoping we can address YARN-7588 and any remaining rolling upgrade issues in 3.0.x maintenance releases. Beyond a wiki page, it would

[jira] [Created] (YARN-7653) Node group support for AllocationTagsManager

2017-12-13 Thread Panagiotis Garefalakis (JIRA)
Panagiotis Garefalakis created YARN-7653: Summary: Node group support for AllocationTagsManager Key: YARN-7653 URL: https://issues.apache.org/jira/browse/YARN-7653 Project: Hadoop YARN

[jira] [Created] (YARN-7654) Support ENTRY_POINT for docker container

2017-12-13 Thread Eric Yang (JIRA)
Eric Yang created YARN-7654: --- Summary: Support ENTRY_POINT for docker container Key: YARN-7654 URL: https://issues.apache.org/jira/browse/YARN-7654 Project: Hadoop YARN Issue Type: Sub-task

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread Subramaniam V K
Thanks to everyone who pushed on this release, really great to see a release coming off trunk. +1 (binding). Deployed the RC on a federated YARN cluster consisting of 8 sub-clusters on CentOs 7.4 running Java 1.8.0_144. Hit YARN-7652[1] which is not a blocker as I was able to run multiple jobs

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread Vinod Kumar Vavilapalli
Looked at RC1. Went through my usual check-list. Here's my summary. +1 (binding) overall Verification - [Check] Successful recompilation from source tar-ball - [Check] Signature verification - [Check] Generating dist tarballs from source tar-ball - [Check] Validating the layout of the binary

[jira] [Created] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2017-12-13 Thread Steven Rand (JIRA)
Steven Rand created YARN-7655: - Summary: avoid AM preemption caused by RRs for specific nodes or racks Key: YARN-7655 URL: https://issues.apache.org/jira/browse/YARN-7655 Project: Hadoop YARN