[jira] [Resolved] (YARN-8237) mxnet yarn spec file to add to native service examples

2018-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8237. -- Resolution: Duplicate > mxnet yarn spec file to add to native service examples >

[jira] [Resolved] (YARN-8238) [Umbrella] YARN deep learning framework examples to run on native service

2018-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8238. -- Resolution: Fixed Closing as dup of YARN-8135.  > [Umbrella] YARN deep learning framework examples to

Re: Run Distributed TensorFlow on YARN

2018-11-06 Thread Jonathan Hung
Hi Robert, I also encourage you to check out https://github.com/linkedin/TonY (TensorFlow on YARN) which is a platform built for this purpose. Jonathan From: Sunil G Sent: Tuesday, November 6, 2018 10:05:14 PM To: Robert Grandl Cc: yarn-dev@hadoop.apache.org;

Re: Run Distributed TensorFlow on YARN

2018-11-06 Thread Sunil G
Hi Robert {Submarine} project helps to run Distributed Tensorflow on top of YARN with ease. YARN-8220 was an early attempt to do the same with some scripts etc, but Submarine will help to avoid all such custom scripts etc, and rather can simply

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-11-06 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/950/ [Nov 6, 2018 5:14:57 AM] (wwei) YARN-8969. AbstractYarnScheduler#getNodeTracker should return generic [Nov 6, 2018 5:38:39 AM] (xiao) HDFS-14053. Provide ability for NN to re-replicate based on topology

Run Distributed TensorFlow on YARN

2018-11-06 Thread Robert Grandl
Hi all, I am wondering if there is any stable support to run distributed TensorFlow atop YARN at the moment.  I found this blog post from Hortonworks. It seems this it is possible starting YARN 3.1.0.https://hortonworks.com/blog/distributed-tensorflow-assembly-hadoop-yarn/ Also I found some

[jira] [Created] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Yang Wang (JIRA)
Yang Wang created YARN-8984: --- Summary: OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty Key: YARN-8984 URL: https://issues.apache.org/jira/browse/YARN-8984

[jira] [Created] (YARN-8983) YARN container with docker: hostname entry not in /etc/hosts

2018-11-06 Thread Keqiu Hu (JIRA)
Keqiu Hu created YARN-8983: -- Summary: YARN container with docker: hostname entry not in /etc/hosts Key: YARN-8983 URL: https://issues.apache.org/jira/browse/YARN-8983 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8982) [Router] Add locality policy

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-8982: -- Summary: [Router] Add locality policy Key: YARN-8982 URL: https://issues.apache.org/jira/browse/YARN-8982 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8981) Virtual IP address support

2018-11-06 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created YARN-8981: --- Summary: Virtual IP address support Key: YARN-8981 URL: https://issues.apache.org/jira/browse/YARN-8981 Project: Hadoop YARN Issue Type: New Feature

[jira] [Created] (YARN-8980) Mapreduce application container start fail after AM restart.

2018-11-06 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-8980: -- Summary: Mapreduce application container start fail after AM restart. Key: YARN-8980 URL: https://issues.apache.org/jira/browse/YARN-8980 Project: Hadoop YARN

[jira] [Created] (YARN-8979) Spark on yarn job failed with yarn federation enabled

2018-11-06 Thread Shen Yinjie (JIRA)
Shen Yinjie created YARN-8979: - Summary: Spark on yarn job failed with yarn federation enabled Key: YARN-8979 URL: https://issues.apache.org/jira/browse/YARN-8979 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8978) For fair scheduler, application with higher priority should also get priority resources for running AM

2018-11-06 Thread qiuliang (JIRA)
qiuliang created YARN-8978: -- Summary: For fair scheduler, application with higher priority should also get priority resources for running AM Key: YARN-8978 URL: https://issues.apache.org/jira/browse/YARN-8978

[jira] [Created] (YARN-8977) Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting

2018-11-06 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-8977: - Summary: Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting Key: YARN-8977 URL: https://issues.apache.org/jira/browse/YARN-8977

[jira] [Resolved] (YARN-8700) Application cannot un-registered

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan resolved YARN-8700. -- Resolution: Not A Problem Closed with correct status > Application cannot un-registered >

[jira] [Resolved] (YARN-8756) [Submarine] Properly handle relative path for staging area

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan resolved YARN-8756. -- Resolution: Duplicate > [Submarine] Properly handle relative path for staging area >

[jira] [Resolved] (YARN-8718) Merge related work for YARN-3409

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan resolved YARN-8718. -- Resolution: Information Provided > Merge related work for YARN-3409 >

[jira] [Created] (YARN-8976) Remove redundant modifiers in interface "ApplicationConstants"

2018-11-06 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8976: -- Summary: Remove redundant modifiers in interface "ApplicationConstants" Key: YARN-8976 URL: https://issues.apache.org/jira/browse/YARN-8976 Project: Hadoop YARN

[jira] [Created] (YARN-8975) Use predefined Charset object StandardCharsets.UTF_8 instead of String "UTF-8"

2018-11-06 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8975: -- Summary: Use predefined Charset object StandardCharsets.UTF_8 instead of String "UTF-8" Key: YARN-8975 URL: https://issues.apache.org/jira/browse/YARN-8975 Project: