Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/951/ [Nov 7, 2018 2:17:35 AM] (aajisaka) YARN-8233. NPE in CapacityScheduler#tryCommit when handling [Nov 7, 2018 2:48:07 AM] (wwei) YARN-8976. Remove redundant modifiers in interface ApplicationConstants.

Re: Zeppelin add hadoop submarine(machine learning) interpreter

hi, community I updated the design documentation, https://docs.google.com/document/d/16YN8Kjmxt1Ym3clx5pDnGNXGajUT36hzQxjaik1cP4A/edit# added the interactive development of machine learning algorithms and

Re: Run Distributed TensorFlow on YARN

Forgot to add Xun in my last email. On Thu, Nov 8, 2018 at 11:55 AM Wangda Tan wrote: > Hi Robert, > > Submarine in 3.2.0 only support Docker container runtime, and in future > releases (maybe 3.2.1), we plan to add support for non-docker containers. > > In order to try Submarine, you need to

[jira] [Created] (YARN-8991) nodemanager not cleaning blockmgr directories inside appcache

Hidayat Teonadi created YARN-8991: - Summary: nodemanager not cleaning blockmgr directories inside appcache Key: YARN-8991 URL: https://issues.apache.org/jira/browse/YARN-8991 Project: Hadoop YARN

[jira] [Created] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

Weiwei Yang created YARN-8988: - Summary: Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled Key: YARN-8988 URL: https://issues.apache.org/jira/browse/YARN-8988

[jira] [Created] (YARN-8986) publish all exposed ports to random ports when using bridge network

Charo Zhang created YARN-8986: - Summary: publish all exposed ports to random ports when using bridge network Key: YARN-8986 URL: https://issues.apache.org/jira/browse/YARN-8986 Project: Hadoop YARN

[jira] [Created] (YARN-8989) Move DockerCommandPlugin volume related APIs' invocation from DockerLinuxContainerRuntime#prepareContainer to #launchContainer

Zhankun Tang created YARN-8989: -- Summary: Move DockerCommandPlugin volume related APIs' invocation from DockerLinuxContainerRuntime#prepareContainer to #launchContainer Key: YARN-8989 URL:

[jira] [Created] (YARN-8985) FSParentQueue: debug log missing when assigning container

Wilfred Spiegelenburg created YARN-8985: --- Summary: FSParentQueue: debug log missing when assigning container Key: YARN-8985 URL: https://issues.apache.org/jira/browse/YARN-8985 Project: Hadoop

Re: Run Distributed TensorFlow on YARN

Thanks a lot for your reply.  Sunil, I was trying to follow the steps from:  https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-submarine/src/site/markdown/RunningDistributedCifar10TFJobs.md to run the tensorflow standalone using

[jira] [Created] (YARN-8990) FS" race condition in app submit and queue cleanup

Wilfred Spiegelenburg created YARN-8990: --- Summary: FS" race condition in app submit and queue cleanup Key: YARN-8990 URL: https://issues.apache.org/jira/browse/YARN-8990 Project: Hadoop YARN

Re: Run Distributed TensorFlow on YARN

Hi Robert, Submarine in 3.2.0 only support Docker container runtime, and in future releases (maybe 3.2.1), we plan to add support for non-docker containers. In order to try Submarine, you need to properly configure docker-on-yarn first. You can check

[jira] [Created] (YARN-8987) Usability improvements for adding centralised node-attributes from CLI

Weiwei Yang created YARN-8987: - Summary: Usability improvements for adding centralised node-attributes from CLI Key: YARN-8987 URL: https://issues.apache.org/jira/browse/YARN-8987 Project: Hadoop YARN

[jira] [Created] (YARN-8994) Fix for race condition in move app and queue cleanup in FS

Wilfred Spiegelenburg created YARN-8994: --- Summary: Fix for race condition in move app and queue cleanup in FS Key: YARN-8994 URL: https://issues.apache.org/jira/browse/YARN-8994 Project: Hadoop

[jira] [Created] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

Haibo Chen created YARN-8992: Summary: Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue Key: YARN-8992 URL: https://issues.apache.org/jira/browse/YARN-8992

[jira] [Created] (YARN-8993) [Submarine] Add support to run deep learning workload in non-Docker containers

Wangda Tan created YARN-8993: Summary: [Submarine] Add support to run deep learning workload in non-Docker containers Key: YARN-8993 URL: https://issues.apache.org/jira/browse/YARN-8993 Project: Hadoop

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/952/ [Nov 8, 2018 4:23:00 AM] (wwei) YARN-8880. Add configurations for pluggable plugin framework. [Nov 8, 2018 9:47:18 AM] (wwei) YARN-8988. Reduce the verbose log on RM heartbeat path when distributed [Nov

[jira] [Created] (YARN-8995) Log the event type of the too big event queue size, and add the information to the metrics.

zhuqi created YARN-8995: --- Summary: Log the event type of the too big event queue size, and add the information to the metrics. Key: YARN-8995 URL: https://issues.apache.org/jira/browse/YARN-8995 Project:

[jira] [Created] (YARN-8999) [Submarine] Remove redundant local variables

Zhankun Tang created YARN-8999: -- Summary: [Submarine] Remove redundant local variables Key: YARN-8999 URL: https://issues.apache.org/jira/browse/YARN-8999 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-8996) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

Zhankun Tang created YARN-8996: -- Summary: [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs Key: YARN-8996 URL: https://issues.apache.org/jira/browse/YARN-8996 Project: Hadoop YARN

[jira] [Created] (YARN-8997) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

Zhankun Tang created YARN-8997: -- Summary: [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs Key: YARN-8997 URL: https://issues.apache.org/jira/browse/YARN-8997 Project: Hadoop YARN

[jira] [Created] (YARN-8998) Simplify the condition check in CliUtils#argsForHelp

Zhankun Tang created YARN-8998: -- Summary: Simplify the condition check in CliUtils#argsForHelp Key: YARN-8998 URL: https://issues.apache.org/jira/browse/YARN-8998 Project: Hadoop YARN Issue