[jira] [Created] (YARN-10045) Host Resolve should take DNS server

2019-12-18 Thread chaoli (Jira)
chaoli created YARN-10045: - Summary: Host Resolve should take DNS server Key: YARN-10045 URL: https://issues.apache.org/jira/browse/YARN-10045 Project: Hadoop YARN Issue Type: Improvement

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-12-18 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/540/ No changes -1 overall The following subsystems voted -1: docker Powered by Apache Yetus 0.8.0 http://yetus.apache.org -

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-12-18 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1355/ [Dec 18, 2019 4:34:12 AM] (github) YARN-10020. Fix build instruction of hadoop-yarn-ui. (#1750) [Dec 18, 2019 5:20:46 PM] (shashikant) HDFS-15012. NN fails to parse Edit logs after applying HDFS-13101.

[jira] [Created] (YARN-10044) ResourceManager NPE - Error in handling event type NODE_UPDATE to the Event Dispatcher

2019-12-18 Thread Jon Bringhurst (Jira)
Jon Bringhurst created YARN-10044: - Summary: ResourceManager NPE - Error in handling event type NODE_UPDATE to the Event Dispatcher Key: YARN-10044 URL: https://issues.apache.org/jira/browse/YARN-10044

[jira] [Created] (YARN-10043) FairOrderingPolicy Improvements

2019-12-18 Thread Manikandan R (Jira)
Manikandan R created YARN-10043: --- Summary: FairOrderingPolicy Improvements Key: YARN-10043 URL: https://issues.apache.org/jira/browse/YARN-10043 Project: Hadoop YARN Issue Type: Bug

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-12-18 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1354/ [Dec 17, 2019 2:41:45 AM] (inigoiri) HDFS-14908. LeaseManager should check parent-child relationship when [Dec 17, 2019 5:11:23 PM] (ebadger) YARN-10033. TestProportionalCapacityPreemptionPolicy not

Bi-weekly YARN Call (U.S.)

2019-12-18 Thread epa...@apache.org
Hello everyone, This is just a friendly reminder that the bi-weekly U.S. YARN call is today at 10 PT / 1 ET. Zoom & Notes: https://docs.google.com/document/d/1GY55sXrekVd-aDyRY7uzaX0hMDPyh3T-AL1kUY2TI5M/edit Thanks,-Eric Payne

Re: Qus: Yarn container in RM

2019-12-18 Thread Hariharan Iyer
It should be possible to do this using placement constraints , though you may need changes in mapreduce to add allocationTags "map" and "reduce" to the containers. Thanks, Hariharan On Wed, Dec 18, 2019

[jira] [Created] (YARN-10042) Uupgrade grpc-xxx depdencies to 1.26.0

2019-12-18 Thread liusheng (Jira)
liusheng created YARN-10042: --- Summary: Uupgrade grpc-xxx depdencies to 1.26.0 Key: YARN-10042 URL: https://issues.apache.org/jira/browse/YARN-10042 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-10041) Should not use AbstractPath to create unix domain socket

2019-12-18 Thread zhao bo (Jira)
zhao bo created YARN-10041: -- Summary: Should not use AbstractPath to create unix domain socket Key: YARN-10041 URL: https://issues.apache.org/jira/browse/YARN-10041 Project: Hadoop YARN Issue Type:

Re: Qus: Yarn container in RM

2019-12-18 Thread zhankun tang
Hi Aakash, This is an interesting topic. Now the scheduler is not aware of the underlying hardware differences. In my understanding, the placement constraints or label or node attributes together with application-level(MR/Spark/Hive to be cloud instance aware) changes could potentially achieve

Qus: Yarn container in RM

2019-12-18 Thread Aakash Sharma
Hello Yarn Gurus, I am working on a YARN enhancement for optimizing utilization in AWS. Is it possible to classify a container in resource manager as a Map or Reduce task? I have looked at the source code of capacity scheduler, and I dont think it is possible. If I were to make some placement