[1/3] hadoop git commit: Disable mounting cgroups by default (miklos.szeg...@cloudera.com via rkanter)

2018-08-07 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-2.8 9ed62cbf3 -> 2a6b62655 Disable mounting cgroups by default (miklos.szeg...@cloudera.com via rkanter) (cherry picked from commit 351cf87c92872d90f62c476f85ae4d02e485769c) (cherry picked from commit d61d84279f7f22867c23dd95e8bfeb70ea7e06

[2/3] hadoop git commit: Only mount non-empty directories for cgroups (miklos.szeg...@cloudera.com via rkanter)

2018-08-07 Thread szegedim
Only mount non-empty directories for cgroups (miklos.szeg...@cloudera.com via rkanter) (cherry picked from commit 0838fe833738e04f5e6f6408e97866d77bebbf30) (cherry picked from commit c1dc4ca2c6080377159157ce97bf5d72fa3285a1) (cherry picked from commit 92f02f97fd8e8306fda7374b5180a633622f9636) (ch

[3/3] hadoop git commit: YARN-8518. test-container-executor test_is_empty() is broken (Jim_Brennan via rkanter)

2018-08-07 Thread szegedim
YARN-8518. test-container-executor test_is_empty() is broken (Jim_Brennan via rkanter) (cherry picked from commit 1bc106a738a6ce4f7ed025d556bb44c1ede022e3) (cherry picked from commit 6e0db6fe1a8ce50977175567f2ba1f957e7b9c91) (cherry picked from commit edb9d8b55419dabf5b8ace678e5ddb5cd559972b) (ch

[3/3] hadoop git commit: YARN-8518. test-container-executor test_is_empty() is broken (Jim_Brennan via rkanter)

2018-07-21 Thread szegedim
YARN-8518. test-container-executor test_is_empty() is broken (Jim_Brennan via rkanter) (cherry picked from commit 1bc106a738a6ce4f7ed025d556bb44c1ede022e3) (cherry picked from commit 6e0db6fe1a8ce50977175567f2ba1f957e7b9c91) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: ht

[1/3] hadoop git commit: Only mount non-empty directories for cgroups (miklos.szeg...@cloudera.com via rkanter)

2018-07-21 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-2 8a68a1590 -> edb9d8b55 Only mount non-empty directories for cgroups (miklos.szeg...@cloudera.com via rkanter) (cherry picked from commit 0838fe833738e04f5e6f6408e97866d77bebbf30) (cherry picked from commit c1dc4ca2c6080377159157ce97bf5d

[2/3] hadoop git commit: Disable mounting cgroups by default (miklos.szeg...@cloudera.com via rkanter)

2018-07-21 Thread szegedim
Disable mounting cgroups by default (miklos.szeg...@cloudera.com via rkanter) (cherry picked from commit 351cf87c92872d90f62c476f85ae4d02e485769c) (cherry picked from commit d61d84279f7f22867c23dd95e8bfeb70ea7e0690) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-w

hadoop git commit: YARN-8461. Support strict memory control on individual container with elastic control memory mechanism. Contributed by Haibo Chen.

2018-06-26 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk b69ba0f33 -> 62d83ca53 YARN-8461. Support strict memory control on individual container with elastic control memory mechanism. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-u

hadoop git commit: YARN-8438. TestContainer.testKillOnNew flaky on trunk. Contributed by Szilard Nemeth.

2018-06-25 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 7a3c6e9c3 -> 35ec9401e YARN-8438. TestContainer.testKillOnNew flaky on trunk. Contributed by Szilard Nemeth. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/35ec9401

hadoop git commit: YARN-8427. Don't start opportunistic containers at container scheduler/finish event with over-allocation. Contributed by Haibo Chen.

2018-06-22 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 1411874be -> e0e646074 YARN-8427. Don't start opportunistic containers at container scheduler/finish event with over-allocation. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git

hadoop git commit: MAPREDUCE-7114. Make FrameworkUploader symlink ignore improvement. Contributed by Gergo Repas.

2018-06-22 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 55fad6a3d -> ae055622e MAPREDUCE-7114. Make FrameworkUploader symlink ignore improvement. Contributed by Gergo Repas. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit

hadoop git commit: MAPREDUCE-7113. Typos in test names in TestTaskAttempt: "testAppDiognostic". Contributed by Szilard Nemeth.

2018-06-20 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 46f905816 -> d6ee4290d MAPREDUCE-7113. Typos in test names in TestTaskAttempt: "testAppDiognostic". Contributed by Szilard Nemeth. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/

hadoop git commit: YARN-8441. Typo in CSQueueUtils local variable names: queueGuranteedResource. Contributed by Szilard Nemeth.

2018-06-20 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 388fafa00 -> 46f905816 YARN-8441. Typo in CSQueueUtils local variable names: queueGuranteedResource. Contributed by Szilard Nemeth. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf

hadoop git commit: YARN-8442. Strange characters and missing spaces in FairScheduler documentation. Contributed by Szilard Nemeth.

2018-06-20 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk bbbc7cc42 -> 388fafa00 YARN-8442. Strange characters and missing spaces in FairScheduler documentation. Contributed by Szilard Nemeth. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/

hadoop git commit: YARN-7449. Split up class TestYarnClient to TestYarnClient and TestYarnClientImpl. Contributed by Szilard Nemeth.

2018-06-20 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 55432b098 -> bbbc7cc42 YARN-7449. Split up class TestYarnClient to TestYarnClient and TestYarnClientImpl. Contributed by Szilard Nemeth. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repo

hadoop git commit: YARN-8440. Typo in YarnConfiguration javadoc: "Miniumum request grant-able..". Contributed by Szilard Nemeth.

2018-06-20 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 9a9e96957 -> 55432b098 YARN-8440. Typo in YarnConfiguration javadoc: "Miniumum request grant-able..". Contributed by Szilard Nemeth. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/as

hadoop git commit: YARN-6794. Fair Scheduler to explicitly promote OPPORTUNISITIC containers locally at the node where they're running. Contributed by Haibo Chen.

2018-06-20 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 c6acfc44d -> 1411874be YARN-6794. Fair Scheduler to explicitly promote OPPORTUNISITIC containers locally at the node where they're running. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: YARN-8391. Investigate AllocationFileLoaderService.reloadListener locking issue. Contributed by Szilard Nemeth.

2018-06-20 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 4939ffedb -> 9a9e96957 YARN-8391. Investigate AllocationFileLoaderService.reloadListener locking issue. Contributed by Szilard Nemeth. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/

hadoop git commit: YARN-6677. Preempt opportunistic containers when root container cgroup goes over memory limit. Contributed by Haibo Chen.

2018-06-07 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 67fc70e09 -> d5eca1a6a YARN-6677. Preempt opportunistic containers when root container cgroup goes over memory limit. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.

hadoop git commit: YARN-6677. Preempt opportunistic containers when root container cgroup goes over memory limit. Contributed by Haibo Chen.

2018-06-07 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 5c5e34a93 -> ed33756db YARN-6677. Preempt opportunistic containers when root container cgroup goes over memory limit. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apa

hadoop git commit: YARN-8240. Add queue-level control to allow all applications in a queue to opt-out. Contributed by Haibo Chen.

2018-06-04 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 f9a7055b9 -> 7826759b3 YARN-8240. Add queue-level control to allow all applications in a queue to opt-out. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/rep

hadoop git commit: YARN-8382. cgroup file leak in NM. Contributed by Hu Ziqian.

2018-06-04 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-3.0 4ecb7aaf7 -> a3afd6905 YARN-8382. cgroup file leak in NM. Contributed by Hu Ziqian. (cherry picked from commit 925fdf761a513130e23c10575c7328c8681cff1d) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-w

hadoop git commit: YARN-8382. cgroup file leak in NM. Contributed by Hu Ziqian.

2018-06-04 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-3.1 83d0964d8 -> 21948b048 YARN-8382. cgroup file leak in NM. Contributed by Hu Ziqian. (cherry picked from commit 925fdf761a513130e23c10575c7328c8681cff1d) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-w

hadoop git commit: YARN-8382. cgroup file leak in NM. Contributed by Hu Ziqian.

2018-06-04 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk ea7b53fb4 -> e2c172dc9 YARN-8382. cgroup file leak in NM. Contributed by Hu Ziqian. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e2c172dc Tree: http://git-wip-us.a

hadoop git commit: YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter.

2018-05-24 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-2 911852e93 -> 81ee9938c YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip

hadoop git commit: YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter.

2018-05-24 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-3.0 731abae55 -> b0f7b0dfd YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-w

hadoop git commit: YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter.

2018-05-24 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-3.1 f49e697cc -> 1483c9037 YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter. (cherry picked from commit 3e5f7ea986600e084fcac723b0423e7de1b3bb8a) Project: h

hadoop git commit: YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter.

2018-05-24 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-8310.branch-3.1 [created] 1483c9037 YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter. (cherry picked from commit 3e5f7ea986600e084fcac723b0423e7de1b3bb8a) Pro

hadoop git commit: YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter.

2018-05-22 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 68c7fd8e6 -> 3e5f7ea98 YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us

hadoop git commit: MAPREDUCE-7094. LocalDistributedCacheManager leaves classloaders open, which leaks FDs. Contributed by Adam Szita.

2018-05-17 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk cc3600aab -> a2cdffb95 MAPREDUCE-7094. LocalDistributedCacheManager leaves classloaders open, which leaks FDs. Contributed by Adam Szita. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/rep

[2/2] hadoop git commit: YARN-6675. Add NM support to launch opportunistic containers based on overallocation. Contributed by Haibo Chen.

2018-04-20 Thread szegedim
YARN-6675. Add NM support to launch opportunistic containers based on overallocation. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c1362b68 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/t

[1/2] hadoop git commit: YARN-6675. Add NM support to launch opportunistic containers based on overallocation. Contributed by Haibo Chen.

2018-04-20 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 72534c37a -> c1362b68a http://git-wip-us.apache.org/repos/asf/hadoop/blob/c1362b68/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager

hadoop git commit: HADOOP-14855. Hadoop scripts may errantly believe a daemon is still running, preventing it from starting. Contributed by Robert Kanter.

2018-04-04 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 345e7624d -> e52539b46 HADOOP-14855. Hadoop scripts may errantly believe a daemon is still running, preventing it from starting. Contributed by Robert Kanter. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-

hadoop git commit: YARN-8035. Uncaught exception in ContainersMonitorImpl during relaunch due to the process ID changing. Contributed by Shane Kumpf.

2018-04-03 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 5a174f8ac -> 2d06d885c YARN-8035. Uncaught exception in ContainersMonitorImpl during relaunch due to the process ID changing. Contributed by Shane Kumpf. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-u

[06/10] hadoop git commit: MAPREDUCE-6926. Allow MR jobs to opt out of oversubscription. Contributed by Haibo Chen.

2018-04-02 Thread szegedim
MAPREDUCE-6926. Allow MR jobs to opt out of oversubscription. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/83f03dc5 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/83f03dc5 Diff: http:

[04/10] hadoop git commit: YARN-6750. Add a configuration to cap how much a NM can be overallocated. Contributed by Haibo Chen.

2018-04-02 Thread szegedim
YARN-6750. Add a configuration to cap how much a NM can be overallocated. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2109c367 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2109c367

[03/10] hadoop git commit: YARN-6921. Allow resource request to opt out of oversubscription in Fair Scheduler. Contributed by Haibo Chen.

2018-04-02 Thread szegedim
YARN-6921. Allow resource request to opt out of oversubscription in Fair Scheduler. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e48809ca Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tre

[05/10] hadoop git commit: YARN-7491. Make sure AM is not scheduled on an opportunistic container. Contributed by Haibo Chen.

2018-04-02 Thread szegedim
YARN-7491. Make sure AM is not scheduled on an opportunistic container. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c483d491 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c483d491 D

[09/10] hadoop git commit: YARN-5473. Expose per-application over-allocation info in the Resource Manager. Contributed by Haibo Chen.

2018-04-02 Thread szegedim
YARN-5473. Expose per-application over-allocation info in the Resource Manager. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/29de8de8 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/29

[10/10] hadoop git commit: YARN-6739. Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off. Contributed by Haibo Chen.

2018-04-02 Thread szegedim
YARN-6739. Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/dece162b Tree: http://git-wip-us.apache.org/

[08/10] hadoop git commit: YARN-5473. Expose per-application over-allocation info in the Resource Manager. Contributed by Haibo Chen.

2018-04-02 Thread szegedim
http://git-wip-us.apache.org/repos/asf/hadoop/blob/29de8de8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/recovery/records/impl/pb/ApplicationAttemptStateDataPBImpl.java -

[07/10] hadoop git commit: YARN-5473. Expose per-application over-allocation info in the Resource Manager. Contributed by Haibo Chen.

2018-04-02 Thread szegedim
http://git-wip-us.apache.org/repos/asf/hadoop/blob/29de8de8/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestContainerResourceUsage.java -

[02/10] hadoop git commit: YARN-7337. Expose per-node over-allocation info in Node Report Contributed by Haibo Chen.

2018-04-02 Thread szegedim
YARN-7337. Expose per-node over-allocation info in Node Report Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a8c2becd Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a8c2becd Diff: http

[01/10] hadoop git commit: YARN-7460. Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers. Contributed by Haibo Chen. [Forced Update!]

2018-04-02 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 8ea3f763d -> dece162b0 (forced update) YARN-7460. Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/rep

hadoop git commit: YARN-6739. Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off. Contributed by Haibo Chen.

2018-04-02 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 13d61cc42 -> 8ea3f763d YARN-6739. Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-w

hadoop git commit: YARN-8077. The vmemLimit parameter in ContainersMonitorImpl#isProcessTreeOverLimit is confusing. Contributed by Sen Zhao.

2018-03-28 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 411993f6e -> cdee0a4f8 YARN-8077. The vmemLimit parameter in ContainersMonitorImpl#isProcessTreeOverLimit is confusing. Contributed by Sen Zhao. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache

hadoop git commit: YARN-5764. NUMA awareness support for launching containers. Contributed by Devaraj K.

2018-03-13 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 45cccadd2 -> a82d4a2e3 YARN-5764. NUMA awareness support for launching containers. Contributed by Devaraj K. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a82d4a2e

hadoop git commit: YARN-7879. NM user is unable to access the application filecache due to permissions. Contributed by Jason Lowe.

2018-02-02 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 0ef639235 -> c7101fe21 YARN-7879. NM user is unable to access the application filecache due to permissions. Contributed by Jason Lowe. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/

hadoop git commit: YARN-7814. Remove automatic mounting of the cgroups root directory into Docker containers. Contributed by Shane Kumpf.

2018-01-25 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk cc1085225 -> 2e5865606 YARN-7814. Remove automatic mounting of the cgroups root directory into Docker containers. Contributed by Shane Kumpf. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org

[2/3] hadoop git commit: YARN-5473. Expose per-application over-allocation info in the Resource Manager. Contributed by Haibo Chen.

2018-01-23 Thread szegedim
http://git-wip-us.apache.org/repos/asf/hadoop/blob/c95d31fd/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/recovery/records/impl/pb/ApplicationAttemptStateDataPBImpl.java -

[1/3] hadoop git commit: YARN-5473. Expose per-application over-allocation info in the Resource Manager. Contributed by Haibo Chen.

2018-01-23 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 43f51bcdb -> c95d31fd7 http://git-wip-us.apache.org/repos/asf/hadoop/blob/c95d31fd/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestCont

[3/3] hadoop git commit: YARN-5473. Expose per-application over-allocation info in the Resource Manager. Contributed by Haibo Chen.

2018-01-23 Thread szegedim
YARN-5473. Expose per-application over-allocation info in the Resource Manager. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c95d31fd Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c9

hadoop git commit: YARN-7796. Container-executor fails with segfault on certain OS configurations. Contributed by Gergo Repas.

2018-01-23 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-3.0 e4ad5f7f3 -> bf795560f YARN-7796. Container-executor fails with segfault on certain OS configurations. Contributed by Gergo Repas. (cherry picked from commit e7642a3e6f540b4b56367babfbaf35ee6b3c7675) Project: http://git-wip-us.apach

hadoop git commit: YARN-7796. Container-executor fails with segfault on certain OS configurations. Contributed by Gergo Repas.

2018-01-23 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 95743c672 -> e7642a3e6 YARN-7796. Container-executor fails with segfault on certain OS configurations. Contributed by Gergo Repas. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/

hadoop git commit: YARN-7139. FairScheduler: finished applications are always restored to default queue. Contributed by Wilfred Spiegelenburg.

2018-01-18 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 37f4696a9 -> bc93ac229 YARN-7139. FairScheduler: finished applications are always restored to default queue. Contributed by Wilfred Spiegelenburg. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apach

[2/2] hadoop git commit: HADOOP-14842. Hadoop 2.8.2 release build process get stuck due to java issue. Contributed by Junping Du.

2018-01-18 Thread szegedim
HADOOP-14842. Hadoop 2.8.2 release build process get stuck due to java issue. Contributed by Junping Du. (cherry picked from commit d0a0f24abc42957c885d5076f8c8e7945e074ba8) (cherry picked from commit eaf5c66f7ec8c34e34541b7398fe59228f5ef2d8) Conflicts: dev-support/bin/create-release

[1/2] hadoop git commit: YARN-7590. Improve container-executor validation check. Contributed by Eric Yang.

2018-01-18 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-2.6 f638ff904 -> 0a8a79988 YARN-7590. Improve container-executor validation check. Contributed by Eric Yang. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/27c2ade

hadoop git commit: YARN-7590. Improve container-executor validation check. Contributed by Eric Yang.

2018-01-18 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-2.7 ea57d107b -> 83177a257 YARN-7590. Improve container-executor validation check. Contributed by Eric Yang. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/83177a2

hadoop git commit: HADOOP-14842. Hadoop 2.8.2 release build process get stuck due to java issue. Contributed by Junping Du.

2018-01-18 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-2.7 17a673e74 -> ea57d107b HADOOP-14842. Hadoop 2.8.2 release build process get stuck due to java issue. Contributed by Junping Du. (cherry picked from commit d0a0f24abc42957c885d5076f8c8e7945e074ba8) (cherry picked from commit eaf5c66f7e

hadoop git commit: YARN-7590. Improve container-executor validation check. Contributed by Eric Yang.

2018-01-18 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-2.8 759b1e14f -> b98568fbd YARN-7590. Improve container-executor validation check. Contributed by Eric Yang. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b98568f

hadoop git commit: YARN-7590. Improve container-executor validation check. Contributed by Eric Yang.

2018-01-18 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-2.9 3cdc39215 -> 6e11ef7c4 YARN-7590. Improve container-executor validation check. Contributed by Eric Yang. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6e11ef7

hadoop git commit: YARN-7717. Add configuration consistency for module.enabled and docker.privileged-containers.enabled. Contributed by Eric Badger.

2018-01-17 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 6e42d0582 -> a68e445dc YARN-7717. Add configuration consistency for module.enabled and docker.privileged-containers.enabled. Contributed by Eric Badger. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us

hadoop git commit: YARN-7758. Add an additional check to the validity of container and application ids passed to container-executor. Contributed by Yufei Gu.

2018-01-17 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-3.0 244369243 -> 762935315 YARN-7758. Add an additional check to the validity of container and application ids passed to container-executor. Contributed by Yufei Gu. (cherry picked from commit 41049ba5d129f0fd0953ed8fdeb12635f7546bb2) P

hadoop git commit: YARN-7758. Add an additional check to the validity of container and application ids passed to container-executor. Contributed by Yufei Gu.

2018-01-17 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-2 c228a7c70 -> 86a2ac94b YARN-7758. Add an additional check to the validity of container and application ids passed to container-executor. Contributed by Yufei Gu. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http:

hadoop git commit: YARN-7758. Add an additional check to the validity of container and application ids passed to container-executor. Contributed by Yufei Gu.

2018-01-16 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 3bd9ea63d -> 41049ba5d YARN-7758. Add an additional check to the validity of container and application ids passed to container-executor. Contributed by Yufei Gu. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://g

hadoop git commit: YARN-7705. Create the container log directory with correct sticky bit in C code. Contributed by Yufei Gu.

2018-01-12 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-3.0 b83004076 -> 75c0b19be YARN-7705. Create the container log directory with correct sticky bit in C code. Contributed by Yufei Gu. (cherry picked from commit 2dcfc18) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: YARN-7705. Create the container log directory with correct sticky bit in C code. Contributed by Yufei Gu.

2018-01-12 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-2 2273499ae -> 09428b137 YARN-7705. Create the container log directory with correct sticky bit in C code. Contributed by Yufei Gu. (cherry picked from commit 2dcfc18) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: h

hadoop git commit: YARN-7705. Create the container log directory with correct sticky bit in C code. Contributed by Yufei Gu.

2018-01-12 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk d5d6a0353 -> 2dcfc1876 YARN-7705. Create the container log directory with correct sticky bit in C code. Contributed by Yufei Gu. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/ha

hadoop git commit: YARN-7590. Improve container-executor validation check. Contributed by Eric Yang.

2018-01-11 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-2 68b7908aa -> 35527db15 YARN-7590. Improve container-executor validation check. Contributed by Eric Yang. (cherry picked from commit bc285da) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.

hadoop git commit: YARN-7590. Improve container-executor validation check. Contributed by Eric Yang.

2018-01-11 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-3.0 a13a773ed -> ed9c516bc YARN-7590. Improve container-executor validation check. Contributed by Eric Yang. (cherry picked from commit bc285da) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apach

hadoop git commit: YARN-7590. Improve container-executor validation check. Contributed by Eric Yang.

2018-01-11 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 2e0a451a8 -> bc285da10 YARN-7590. Improve container-executor validation check. Contributed by Eric Yang. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/bc285da1 Tre

hadoop git commit: MAPREDUCE-6926. Allow MR jobs to opt out of oversubscription. Contributed by Haibo Chen.

2018-01-10 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 b646d79d9 -> 43f51bcdb MAPREDUCE-6926. Allow MR jobs to opt out of oversubscription. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4

hadoop git commit: HADOOP-15060. TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky. Contributed by Miklos Szegedi.

2018-01-10 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-2 66d58d2b9 -> 679ad2ced HADOOP-15060. TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky. Contributed by Miklos Szegedi. (cherry picked from commit 12d0645) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo C

hadoop git commit: HADOOP-15060. TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky. Contributed by Miklos Szegedi.

2018-01-10 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-3.0 5ed1eff48 -> 542cb8480 HADOOP-15060. TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky. Contributed by Miklos Szegedi. (cherry picked from commit 12d0645) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo

hadoop git commit: HADOOP-15060. TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky. Contributed by Miklos Szegedi.

2018-01-10 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 1a09da740 -> 12d064599 HADOOP-15060. TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky. Contributed by Miklos Szegedi. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repo

hadoop git commit: YARN-7689. TestRMContainerAllocator fails after YARN-6124. Contributed by Wilfred Spiegelenburg.

2018-01-09 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 8ee7080e5 -> 55066cc53 YARN-7689. TestRMContainerAllocator fails after YARN-6124. Contributed by Wilfred Spiegelenburg. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/comm

[1/2] hadoop git commit: YARN-6894. RM Apps API returns only active apps when query parameter queue used. Contributed by Gergely Novák.

2018-01-02 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 626b5103d -> 7f515f57e YARN-6894. RM Apps API returns only active apps when query parameter queue used. Contributed by Gergely Novák. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/

[2/2] hadoop git commit: YARN-7585. NodeManager should go unhealthy when state store throws DBException. Contributed by Wilfred Spiegelenburg.

2018-01-02 Thread szegedim
YARN-7585. NodeManager should go unhealthy when state store throws DBException. Contributed by Wilfred Spiegelenburg. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/7f515f57 Tree: http://git-wip-us.apache.org/repos/asf/had

hadoop git commit: YARN-7688. Miscellaneous Improvements To ProcfsBasedProcessTree. Contributed by BELUGA BEHR.

2018-01-02 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 4ad39ec30 -> 626b5103d YARN-7688. Miscellaneous Improvements To ProcfsBasedProcessTree. Contributed by BELUGA BEHR. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6

hadoop git commit: YARN-7687. ContainerLogAppender Improvements. Contributed by BELUGA BEHR.

2018-01-02 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 5c28804b9 -> 33ae2a4ae YARN-7687. ContainerLogAppender Improvements. Contributed by BELUGA BEHR. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/33ae2a4a Tree: http:/

hadoop git commit: HADOOP-15122. Lock down version of doxia-module-markdown plugin. Contributed by Marton Elek.

2017-12-29 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/branch-3.0 8c275c63f -> c3cff8eac HADOOP-15122. Lock down version of doxia-module-markdown plugin. Contributed by Marton Elek. (cherry picked from commit 4bb765ee2e9fa16bb18c70d8f62ab885d883f414) Project: http://git-wip-us.apache.org/repos/asf

hadoop git commit: HADOOP-15122. Lock down version of doxia-module-markdown plugin. Contributed by Marton Elek.

2017-12-29 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 7467e8fe5 -> 4bb765ee2 HADOOP-15122. Lock down version of doxia-module-markdown plugin. Contributed by Marton Elek. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4

svn commit: r1819549 - in /hadoop/common/site/main: author/src/documentation/content/xdocs/who.xml publish/who.html publish/who.pdf

2017-12-29 Thread szegedim
Author: szegedim Date: Fri Dec 29 23:26:17 2017 New Revision: 1819549 URL: http://svn.apache.org/viewvc?rev=1819549&view=rev Log: Adding new committer to who.xml Modified: hadoop/common/site/main/author/src/documentation/content/xdocs/who.xml hadoop/common/site/main/publish/who.

hadoop git commit: YARN-7580. ContainersMonitorImpl logged message lacks detail when exceeding memory limits. Contributed by Wilfred Spiegelenburg.

2017-12-29 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/trunk 6e3e1b8cd -> b82049b4f YARN-7580. ContainersMonitorImpl logged message lacks detail when exceeding memory limits. Contributed by Wilfred Spiegelenburg. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.

hadoop git commit: YARN-7491. Make sure AM is not scheduled on an opportunistic container. Contributed by Haibo Chen.

2017-11-28 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 10aad13b5 -> 45fee61f2 YARN-7491. Make sure AM is not scheduled on an opportunistic container. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoo

hadoop git commit: YARN-6750. Add a configuration to cap how much a NM can be overallocated. Contributed by Haibo Chen.

2017-11-22 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 82f12ece6 -> 4defd7d28 YARN-6750. Add a configuration to cap how much a NM can be overallocated. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/had

hadoop git commit: YARN-6921. Allow resource request to opt out of oversubscription in Fair Scheduler. Contributed by Haibo Chen.

2017-11-22 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 c108ba0cb -> 82f12ece6 YARN-6921. Allow resource request to opt out of oversubscription in Fair Scheduler. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/rep

hadoop git commit: YARN-7337. Expose per-node over-allocation info in Node Report Contributed by Haibo Chen.

2017-11-22 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 f2b85d6c1 -> c108ba0cb YARN-7337. Expose per-node over-allocation info in Node Report Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/

hadoop git commit: YARN-7460. Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers. Contributed by Haibo Chen.

2017-11-20 Thread szegedim
Repository: hadoop Updated Branches: refs/heads/YARN-1011 561410c78 -> f2b85d6c1 YARN-7460. Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http:/