ResourceManager & Resource Types topic to discuss: SafeMode

2019-03-27 Thread Szilard Nemeth
Hi, This could be interesting for anyone interested in RM / Resource Types: I filed a jira recently: https://issues.apache.org/jira/browse/YARN-9421 (Implement SafeMode for ResourceManager by defining a resource threshold). The issue in one sentence: If an app is submitted while RM still haven't

[jira] [Created] (YARN-9421) Implement SafeMode for ResourceManager by defining a resource threshold

2019-03-27 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9421: Summary: Implement SafeMode for ResourceManager by defining a resource threshold Key: YARN-9421 URL: https://issues.apache.org/jira/browse/YARN-9421 Project: Hadoop

Re: MapReduce Job fails due to corrupted mapreduce.tar.gz

2019-03-27 Thread Prabhu Josephraj
Hi Kunal, This issue will happen if the mapreduce.tar.gz present in hdfs path (mapreduce.application.framework.path) is corrupted due to some Hdfs issue. Below steps will help to fix the issue 1. Remove all cached and corrupted mapreduce.tar.gz under the NM local directories. 2.

[jira] [Created] (YARN-9420) Avoid potentially dangerous filename concatenation in native code (cgroups-operations.c)

2019-03-27 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9420: Summary: Avoid potentially dangerous filename concatenation in native code (cgroups-operations.c) Key: YARN-9420 URL: https://issues.apache.org/jira/browse/YARN-9420

[jira] [Created] (YARN-9419) Log a warning if GPU isolation is enabled but LinuxContainerExecutor is disabled

2019-03-27 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9419: Summary: Log a warning if GPU isolation is enabled but LinuxContainerExecutor is disabled Key: YARN-9419 URL: https://issues.apache.org/jira/browse/YARN-9419

[jira] [Resolved] (YARN-9412) Backport YARN-6909 to branch-2

2019-03-27 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung resolved YARN-9412. - Resolution: Fixed This ended up being a clean port. Closing. > Backport YARN-6909 to branch-2 >

[jira] [Created] (YARN-9418) ATSV2 /apps/${appId}/entities/YARN_CONTAINER rest api does not show metrics

2019-03-27 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-9418: --- Summary: ATSV2 /apps/${appId}/entities/YARN_CONTAINER rest api does not show metrics Key: YARN-9418 URL: https://issues.apache.org/jira/browse/YARN-9418 Project:

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-03-27 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1088/ [Mar 26, 2019 3:51:04 AM] (yqlin) HDDS-1334. Fix asf license errors in newly added files by HDDS-1234. [Mar 26, 2019 5:47:24 AM] (yufei) YARN-8967. Change FairScheduler to use PlacementRule interface.

[jira] [Created] (YARN-9417) Implement FS equivalent of AppNameMappingPlacementRule

2019-03-27 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-9417: --- Summary: Implement FS equivalent of AppNameMappingPlacementRule Key: YARN-9417 URL: https://issues.apache.org/jira/browse/YARN-9417 Project: Hadoop YARN

[jira] [Created] (YARN-9416) Add filter options to FS placement rules

2019-03-27 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-9416: --- Summary: Add filter options to FS placement rules Key: YARN-9416 URL: https://issues.apache.org/jira/browse/YARN-9416 Project: Hadoop YARN

[jira] [Resolved] (YARN-5387) FairScheduler: add the ability to specify a parent queue to all placement rules

2019-03-27 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YARN-5387. - Resolution: Implemented This has been included as part of the YARN-8967 changes.

[jira] [Resolved] (YARN-2257) Add user to queue mappings to automatically place users' apps into specific queues

2019-03-27 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YARN-2257. - Resolution: Duplicate This has been fixed as part of YARN-8948, YARN-9298 and

[jira] [Created] (YARN-9415) Document FS placement rule changes from YARN-8967

2019-03-27 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-9415: --- Summary: Document FS placement rule changes from YARN-8967 Key: YARN-9415 URL: https://issues.apache.org/jira/browse/YARN-9415 Project: Hadoop YARN