Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-24 Thread Yongjun Zhang
Thanks Andrew much for the work here! +1 (binding). - Downloaded both binary and src tarballs - Verified md5 checksum and signature for both - Built from source tarball - Deployed 2 pseudo clusters, one with the released tarball and the other with what I built from source, and did the following

Re: YARN Client and Unmanaged AM running in the same process?

2017-01-24 Thread Sergiy Matusevych
Cool! I'll try it on Hadoop 2.7.3. Thanks a lot for your help Jason! -- Sergiy. On Tue, Jan 24, 2017 at 2:59 PM, Jason Lowe wrote: > Version 2.7.1.2.3.0.0-2557 is not a standard Apache Hadoop version, nor is > the specified git hash present in the Apache Hadoop repo. I cannot match > the code

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-24 Thread Eric Badger
+1 (non-binding) - Verified signatures and md5- Built from source- Started single-node cluster on my mac- Ran some sleep jobs Eric On Tuesday, January 24, 2017 4:32 PM, Yufei Gu wrote: Hi Andrew, Thanks for working on this. +1 (Non-Binding) 1. Downloaded the binary and verified the m

Re: YARN Client and Unmanaged AM running in the same process?

2017-01-24 Thread Jason Lowe
Version 2.7.1.2.3.0.0-2557 is not a standard Apache Hadoop version, nor is the specified git hash present in the Apache Hadoop repo.  I cannot match the code exactly with what you are running. What is happening according to the RM log is this sequence:- The RM is trying to publish system metrics

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-24 Thread Yufei Gu
Hi Andrew, Thanks for working on this. +1 (Non-Binding) 1. Downloaded the binary and verified the md5. 2. Deployed it on 3 node cluster with 1 ResourceManager and 2 NodeManager. 3. Set YARN to use Fair Scheduler. 4. Ran MapReduce jobs Pi 5. Verified Hadoop version command output is correct. Bes

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-24 Thread Chris Douglas
On Mon, Jan 23, 2017 at 9:32 PM, Allen Wittenauer wrote: > The problem here is that there is a 'license' directory and a file called > 'LICENSE'. If this gets extracted by jar via jar xf, it will fail. unzip > can be made to extract it via an option like -o. To make matters worse, none > of

[jira] [Created] (YARN-6121) Launch app collectors for unmanaged AMs'

2017-01-24 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-6121: -- Summary: Launch app collectors for unmanaged AMs' Key: YARN-6121 URL: https://issues.apache.org/jira/browse/YARN-6121 Project: Hadoop YARN Issue Type: Bug

Re: YARN Client and Unmanaged AM running in the same process?

2017-01-24 Thread Sergiy Matusevych
Hi Jason, Here's what I see in our YARN logs (below). Could it be that I forget to populate some field in the registration or, say, application/container launch context? P.S. YARN version that we are running is: 2.7.1.2.3.0.0-2557 from 9f17d40a0f2046d217b2bff90ad6e2fc7e41f5e1 by jenkins source ch

Re: Not be able to receive notification mail for watch JIRA (YARN)

2017-01-24 Thread Chris Trezzo
Thanks Ted! I am receiving new notifications now. On Tue, Jan 24, 2017 at 11:12 AM, Ted Yu wrote: > The ticket has been resolved. > > You should be able to receive notifications now. > > On Tue, Jan 24, 2017 at 11:05 AM, Chris Trezzo wrote: > >> There seems to be an issue with JIRA notification

Re: YARN Client and Unmanaged AM running in the same process?

2017-01-24 Thread Sergiy Matusevych
Hi Jason, Thanks a lot for your help! It is great to hear that Unmanaged AM mode works at least on some version of YARN :) I will check our YARN logs and give you more details soon. Thank you! Sergiy. On Tue, Jan 24, 2017 at 8:48 AM, Jason Lowe wrote: > Have you looked at the ResourceManager l

Re: Not be able to receive notification mail for watch JIRA (YARN)

2017-01-24 Thread Ted Yu
The ticket has been resolved. You should be able to receive notifications now. On Tue, Jan 24, 2017 at 11:05 AM, Chris Trezzo wrote: > There seems to be an issue with JIRA notifications again. I see this INFRA > ticket filed for HBase: https://issues.apache.org/jira/browse/INFRA-13374 > > I hav

Re: Not be able to receive notification mail for watch JIRA (YARN)

2017-01-24 Thread Chris Trezzo
There seems to be an issue with JIRA notifications again. I see this INFRA ticket filed for HBase: https://issues.apache.org/jira/browse/INFRA-13374 I have left a comment for what I am seeing with my current watched jiras on the YARN project. On Fri, Jan 13, 2017 at 6:20 PM, Brahma Reddy Battula

Re: YARN Client and Unmanaged AM running in the same process?

2017-01-24 Thread Jason Lowe
Have you looked at the ResourceManager logs to see what it is doing when it receives the unregister request?  I'm wondering if there's an exception or error that could explain why it is not working as expected.  The sample code works against trunk for me.  The unmanaged AM registered, unregister

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-01-24 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/296/ [Jan 23, 2017 6:49:35 AM] (sunilg) YARN-6031. Application recovery has failed when node label feature is [Jan 23, 2017 5:12:51 PM] (jlowe) YARN-5910. Support for multi-cluster delegation tokens. Contribute

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-24 Thread Marton Elek
]> > minicluster is kind of weird on filesystems that don't support mixed case, > like OS X's default HFS+. > > $ jar tf hadoop-client-minicluster-3.0.0-alpha3-SNAPSHOT.jar | grep -i > license > LICENSE.txt > license/ > license/LICENSE > license/LICENSE.dom-documentation.txt > license/LICENSE.