[jira] [Created] (YARN-8980) Mapreduce application container start fail after AM restart.

2018-11-06 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-8980: -- Summary: Mapreduce application container start fail after AM restart. Key: YARN-8980 URL: https://issues.apache.org/jira/browse/YARN-8980 Project: Hadoop YARN

[jira] [Created] (YARN-8981) Virtual IP address support

2018-11-06 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created YARN-8981: --- Summary: Virtual IP address support Key: YARN-8981 URL: https://issues.apache.org/jira/browse/YARN-8981 Project: Hadoop YARN Issue Type: New Feature

[jira] [Created] (YARN-8982) [Router] Add locality policy

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-8982: -- Summary: [Router] Add locality policy Key: YARN-8982 URL: https://issues.apache.org/jira/browse/YARN-8982 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8983) YARN container with docker: hostname entry not in /etc/hosts

2018-11-06 Thread Keqiu Hu (JIRA)
Keqiu Hu created YARN-8983: -- Summary: YARN container with docker: hostname entry not in /etc/hosts Key: YARN-8983 URL: https://issues.apache.org/jira/browse/YARN-8983 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Yang Wang (JIRA)
Yang Wang created YARN-8984: --- Summary: OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty Key: YARN-8984 URL: https://issues.apache.org/jira/browse/YARN-8984

Run Distributed TensorFlow on YARN

2018-11-06 Thread Robert Grandl
Hi all, I am wondering if there is any stable support to run distributed TensorFlow atop YARN at the moment.  I found this blog post from Hortonworks. It seems this it is possible starting YARN 3.1.0.https://hortonworks.com/blog/distributed-tensorflow-assembly-hadoop-yarn/ Also I found some

Re: Run Distributed TensorFlow on YARN

2018-11-06 Thread Jonathan Hung
Hi Robert, I also encourage you to check out https://github.com/linkedin/TonY (TensorFlow on YARN) which is a platform built for this purpose. Jonathan From: Sunil G Sent: Tuesday, November 6, 2018 10:05:14 PM To: Robert Grandl Cc: yarn-dev@hadoop.apache.org;

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-11-06 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/950/ [Nov 6, 2018 5:14:57 AM] (wwei) YARN-8969. AbstractYarnScheduler#getNodeTracker should return generic [Nov 6, 2018 5:38:39 AM] (xiao) HDFS-14053. Provide ability for NN to re-replicate based on topology

[jira] [Resolved] (YARN-8237) mxnet yarn spec file to add to native service examples

2018-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8237. -- Resolution: Duplicate > mxnet yarn spec file to add to native service examples >

[jira] [Resolved] (YARN-8238) [Umbrella] YARN deep learning framework examples to run on native service

2018-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8238. -- Resolution: Fixed Closing as dup of YARN-8135.  > [Umbrella] YARN deep learning framework examples to

Re: Run Distributed TensorFlow on YARN

2018-11-06 Thread Sunil G
Hi Robert {Submarine} project helps to run Distributed Tensorflow on top of YARN with ease. YARN-8220 was an early attempt to do the same with some scripts etc, but Submarine will help to avoid all such custom scripts etc, and rather can simply

[jira] [Resolved] (YARN-8700) Application cannot un-registered

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan resolved YARN-8700. -- Resolution: Not A Problem Closed with correct status > Application cannot un-registered >

[jira] [Created] (YARN-8976) Remove redundant modifiers in interface "ApplicationConstants"

2018-11-06 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8976: -- Summary: Remove redundant modifiers in interface "ApplicationConstants" Key: YARN-8976 URL: https://issues.apache.org/jira/browse/YARN-8976 Project: Hadoop YARN

[jira] [Created] (YARN-8977) Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting

2018-11-06 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-8977: - Summary: Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting Key: YARN-8977 URL: https://issues.apache.org/jira/browse/YARN-8977

[jira] [Resolved] (YARN-8756) [Submarine] Properly handle relative path for staging area

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan resolved YARN-8756. -- Resolution: Duplicate > [Submarine] Properly handle relative path for staging area >

[jira] [Resolved] (YARN-8718) Merge related work for YARN-3409

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan resolved YARN-8718. -- Resolution: Information Provided > Merge related work for YARN-3409 >

[jira] [Created] (YARN-8975) Use predefined Charset object StandardCharsets.UTF_8 instead of String "UTF-8"

2018-11-06 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8975: -- Summary: Use predefined Charset object StandardCharsets.UTF_8 instead of String "UTF-8" Key: YARN-8975 URL: https://issues.apache.org/jira/browse/YARN-8975 Project:

[jira] [Created] (YARN-8979) Spark on yarn job failed with yarn federation enabled

2018-11-06 Thread Shen Yinjie (JIRA)
Shen Yinjie created YARN-8979: - Summary: Spark on yarn job failed with yarn federation enabled Key: YARN-8979 URL: https://issues.apache.org/jira/browse/YARN-8979 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8978) For fair scheduler, application with higher priority should also get priority resources for running AM

2018-11-06 Thread qiuliang (JIRA)
qiuliang created YARN-8978: -- Summary: For fair scheduler, application with higher priority should also get priority resources for running AM Key: YARN-8978 URL: https://issues.apache.org/jira/browse/YARN-8978