[jira] [Resolved] (YARN-5128) Investigate potential race condition in the scheduler nodeUpdate() method

2018-03-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YARN-5128. - Resolution: Duplicate The comment was added into the CapacityScheduler only as

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

2018-03-29 Thread Wangda Tan
Thanks Junping for reporting this, I did append my keys to https://svn.apache.org/repos/asf/hadoop/common/dist/KEYS, I'm not sure how to propagate it to https://dist.apache.org/repos/dist/release/hadoop/common/ KEYS, I couldn't find any guide about this. Could you share how you did this? -

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

2018-03-29 Thread 俊平堵
Hi Wanda, Thanks for the release effort on 3.1.0. Another reminder is I tried to verify the signature of RC0 bits but found there is no known key get uploaded to https://dist.apache.org/repos/dist/release/hadoop/common/KEYS. Would you please upload it there then we can go ahead to verify the

[jira] [Created] (YARN-8088) [atsv2 read acls] REST API to get domain info by id

2018-03-29 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8088: Summary: [atsv2 read acls] REST API to get domain info by id Key: YARN-8088 URL: https://issues.apache.org/jira/browse/YARN-8088 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-8087) Allow YARN ATSv2 ACLs to be disabled

2018-03-29 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8087: Summary: Allow YARN ATSv2 ACLs to be disabled Key: YARN-8087 URL: https://issues.apache.org/jira/browse/YARN-8087 Project: Hadoop YARN Issue Type: Task

[jira] [Created] (YARN-8086) ManagedParentQueue with no leaf queues cause JS error in new UI

2018-03-29 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-8086: -- Summary: ManagedParentQueue with no leaf queues cause JS error in new UI Key: YARN-8086 URL: https://issues.apache.org/jira/browse/YARN-8086 Project: Hadoop YARN

[jira] [Created] (YARN-8089) Recover domain from backend for TimelineCollector.

2018-03-29 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8089: Summary: Recover domain from backend for TimelineCollector. Key: YARN-8089 URL: https://issues.apache.org/jira/browse/YARN-8089 Project: Hadoop YARN Issue Type:

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2018-03-29 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/179/ [Mar 30, 2018 1:03:32 AM] (shv) HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. -1 overall The following subsystems voted -1: docker Powered by Apache Yetus

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

2018-03-29 Thread Wangda Tan
Arun helped me to figure this out. It was pushed to a wrong location. The correct one is: https://dist.apache.org/repos/dist/release/hadoop/common/

[jira] [Created] (YARN-8091) Revisit checkUserAccessToQueue RM REST API

2018-03-29 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-8091: Summary: Revisit checkUserAccessToQueue RM REST API Key: YARN-8091 URL: https://issues.apache.org/jira/browse/YARN-8091 Project: Hadoop YARN Issue Type: Task

[jira] [Created] (YARN-8092) Expose node-attributes info via RM nodes REST API

2018-03-29 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8092: - Summary: Expose node-attributes info via RM nodes REST API Key: YARN-8092 URL: https://issues.apache.org/jira/browse/YARN-8092 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-8093) Support HBase 2.0.0-beta1 as ATSv2 backend

2018-03-29 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8093: Summary: Support HBase 2.0.0-beta1 as ATSv2 backend Key: YARN-8093 URL: https://issues.apache.org/jira/browse/YARN-8093 Project: Hadoop YARN Issue Type: Task

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-03-29 Thread Yufei Gu
Thanks Wangda for working on this! +1 (non-binding) - Downloaded the binary tarball and verified the checksum. - Started a pseudo cluster inside one docker container - Run Resource Manager with Fair Scheduler - Verified distributed shell - Verified mapreduce pi job - Sanity

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-03-29 Thread Rohith Sharma K S
+1 (binding) * Downloaded source, built from source with -Dhbase.profile=2.0. * Installed RM HA cluster integrated with ATSv2. Installed HBase-2.0-beta1 for ATSv2 back end. Scheduler is configured with 2 level queue hierarchy. * Ran sample jobs such as MR/Distributed shell and verified for **

[jira] [Created] (YARN-8094) Support configuration based node attribute provider

2018-03-29 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8094: - Summary: Support configuration based node attribute provider Key: YARN-8094 URL: https://issues.apache.org/jira/browse/YARN-8094 Project: Hadoop YARN Issue Type:

[VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-03-29 Thread Wangda Tan
Hi folks, Thanks to the many who helped with this release since Dec 2017 [1]. We've created RC1 for Apache Hadoop 3.1.0. The artifacts are available here: http://people.apache.org/~wangda/hadoop-3.1.0-RC1 The RC tag in git is release-3.1.0-RC1. Last git commit SHA is

[jira] [Resolved] (YARN-8093) Support HBase 2.0.0-beta1 as ATSv2 backend

2018-03-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-8093. -- Resolution: Duplicate > Support HBase 2.0.0-beta1 as ATSv2 backend >

[jira] [Created] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-03-29 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-8090: Summary: Race conditions in FadvisedChunkedFile Key: YARN-8090 URL: https://issues.apache.org/jira/browse/YARN-8090 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-7278) LinuxContainer in docker mode will be failed when nodemanager restart, because timeout for docker is too slow.

2018-03-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-7278. --- Resolution: Duplicate Fix Version/s: (was: 2.9.1) > LinuxContainer in docker mode will be

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-03-29 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/735/ [Mar 28, 2018 2:33:18 AM] (sunilg) YARN-8075. DShell does not fail when we ask more GPUs than available [Mar 28, 2018 3:00:08 AM] (yqlin) HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

2018-03-29 Thread Weiwei Yang
Hi Wangda While testing the build, we found a bug https://issues.apache.org/jira/browse/YARN-8085, it might cause NPE during RM fail-over. I think that needs to be included in 3.1.0. We have run some other tests, and they look good so far. This includes - Some basic teragen/terasort/DS jobs -

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

2018-03-29 Thread Wangda Tan
Thanks all for doing testing and reporting issues. YARN-8085 discovered by Weiwei/Tao is a blocker, we will roll an RC1 today. - Wangda On Thu, Mar 29, 2018 at 7:26 AM, Weiwei Yang wrote: > Hi Wangda > > While testing the build, we found a bug