[06/24] hadoop git commit: YARN-7491. Make sure AM is not scheduled on an opportunistic container. Contributed by Haibo Chen.

YARN-7491. Make sure AM is not scheduled on an opportunistic container. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6f6cac1c Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/6f6cac1c

[19/24] hadoop git commit: Revert "Revert "YARN-6675. Add NM support to launch opportunistic containers based on overallocation. Contributed by Haibo Chen.""

Revert "Revert "YARN-6675. Add NM support to launch opportunistic containers based on overallocation. Contributed by Haibo Chen."" This reverts commit 1235cf5deb9f309e975c4f59ee27caf1282f19f9. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

[01/24] hadoop git commit: YARN-1015. FS should watch node resource utilization and allocate opportunistic containers if appropriate. [Forced Update!]

Repository: hadoop Updated Branches: refs/heads/YARN-1011 954986dd5 -> 8d217ee3c (forced update)

[07/24] hadoop git commit: YARN-6750. Add a configuration to cap how much a NM can be overallocated. Contributed by Haibo Chen.

YARN-6750. Add a configuration to cap how much a NM can be overallocated. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6d028d77 Tree:

[03/24] hadoop git commit: YARN-7460. Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers. Contributed by Haibo Chen.

YARN-7460. Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c7c178c1 Tree:

[23/24] hadoop git commit: YARN-6672. Add NM preemption of opportunistic containers when utilization goes high.

YARN-6672. Add NM preemption of opportunistic containers when utilization goes high. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0a54014d Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0a54014d Diff:

[10/24] hadoop git commit: YARN-5473. Expose per-application over-allocation info in the Resource Manager. Contributed by Haibo Chen.

http://git-wip-us.apache.org/repos/asf/hadoop/blob/c045be51/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/recovery/records/impl/pb/ApplicationAttemptStateDataPBImpl.java

[20/24] hadoop git commit: YARN-6794. Fair Scheduler to explicitly promote OPPORTUNISITIC containers locally at the node where they're running. Contributed by Haibo Chen.

YARN-6794. Fair Scheduler to explicitly promote OPPORTUNISITIC containers locally at the node where they're running. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c1dae721 Tree:

[09/24] hadoop git commit: YARN-5473. Expose per-application over-allocation info in the Resource Manager. Contributed by Haibo Chen.

http://git-wip-us.apache.org/repos/asf/hadoop/blob/c045be51/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestContainerResourceUsage.java

[17/24] hadoop git commit: YARN-8240. Add queue-level control to allow all applications in a queue to opt-out. Contributed by Haibo Chen.

YARN-8240. Add queue-level control to allow all applications in a queue to opt-out. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ddae86c9 Tree:

[16/24] hadoop git commit: YARN-6675. Add NM support to launch opportunistic containers based on overallocation. Contributed by Haibo Chen.

YARN-6675. Add NM support to launch opportunistic containers based on overallocation. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/879a5e7b Tree:

[02/24] hadoop git commit: YARN-1015. FS should watch node resource utilization and allocate opportunistic containers if appropriate.

YARN-1015. FS should watch node resource utilization and allocate opportunistic containers if appropriate. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/86555164 Tree:

[22/24] hadoop git commit: YARN-6672. Add NM preemption of opportunistic containers when utilization goes high.

http://git-wip-us.apache.org/repos/asf/hadoop/blob/0a54014d/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/scheduler/TestContainerSchedulerWithOverAllocation.java

[24/24] hadoop git commit: YARN-8809. Refactor AbstractYarnScheduler and CapacityScheduler OPPORTUNISTIC container completion codepaths. (Haibo Chen via asuresh)

YARN-8809. Refactor AbstractYarnScheduler and CapacityScheduler OPPORTUNISTIC container completion codepaths. (Haibo Chen via asuresh) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8d217ee3 Tree:

[21/24] hadoop git commit: YARN-8427. Don't start opportunistic containers at container scheduler/finish event with over-allocation. Contributed by Haibo Chen.

YARN-8427. Don't start opportunistic containers at container scheduler/finish event with over-allocation. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/98218c20 Tree:

[18/24] hadoop git commit: Revert "Revert "YARN-6675. Add NM support to launch opportunistic containers based on overallocation. Contributed by Haibo Chen.""

http://git-wip-us.apache.org/repos/asf/hadoop/blob/f9db0368/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/scheduler/TestContainerSchedulerRecovery.java

[13/24] hadoop git commit: Revert "YARN-6675. Add NM support to launch opportunistic containers based on overallocation. Contributed by Haibo Chen."

http://git-wip-us.apache.org/repos/asf/hadoop/blob/f8851333/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/scheduler/TestContainerSchedulerRecovery.java

[15/24] hadoop git commit: YARN-6675. Add NM support to launch opportunistic containers based on overallocation. Contributed by Haibo Chen.

http://git-wip-us.apache.org/repos/asf/hadoop/blob/879a5e7b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/scheduler/TestContainerSchedulerRecovery.java

[14/24] hadoop git commit: Revert "YARN-6675. Add NM support to launch opportunistic containers based on overallocation. Contributed by Haibo Chen."

Revert "YARN-6675. Add NM support to launch opportunistic containers based on overallocation. Contributed by Haibo Chen." This reverts commit c1362b68af03c546f4c0802758e9729d2372ab6c. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

[11/24] hadoop git commit: YARN-5473. Expose per-application over-allocation info in the Resource Manager. Contributed by Haibo Chen.

YARN-5473. Expose per-application over-allocation info in the Resource Manager. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c045be51 Tree:

[04/24] hadoop git commit: YARN-7337. Expose per-node over-allocation info in Node Report Contributed by Haibo Chen.

YARN-7337. Expose per-node over-allocation info in Node Report Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ff73fb94 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ff73fb94 Diff:

[05/24] hadoop git commit: YARN-6921. Allow resource request to opt out of oversubscription in Fair Scheduler. Contributed by Haibo Chen.

YARN-6921. Allow resource request to opt out of oversubscription in Fair Scheduler. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d106fdbe Tree:

[12/24] hadoop git commit: YARN-6739. Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off. Contributed by Haibo Chen.

YARN-6739. Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0456591f Tree:

[08/24] hadoop git commit: MAPREDUCE-6926. Allow MR jobs to opt out of oversubscription. Contributed by Haibo Chen.

MAPREDUCE-6926. Allow MR jobs to opt out of oversubscription. Contributed by Haibo Chen. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8757aa90 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8757aa90 Diff:

hadoop git commit: HDDS-391. Simplify Audit Framework to make audit logging easier to use. Contributed by Dinesh Chitlangia.

Repository: hadoop Updated Branches: refs/heads/trunk 35c7351f4 -> 0da03f8b1 HDDS-391. Simplify Audit Framework to make audit logging easier to use. Contributed by Dinesh Chitlangia. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDDS-455. Ozone genconf tool must use picocli. Contributed by Dinesh Chitlangia.

Repository: hadoop Updated Branches: refs/heads/trunk 19ad5be65 -> 35c7351f4 HDDS-455. Ozone genconf tool must use picocli. Contributed by Dinesh Chitlangia. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/35c7351f

[1/2] hadoop git commit: YARN-8800. Updated documentation of Submarine with latest examples. Contributed by Wangda Tan.

Repository: hadoop Updated Branches: refs/heads/trunk 72891fc9b -> 19ad5be65

[2/2] hadoop git commit: YARN-8800. Updated documentation of Submarine with latest examples. Contributed by Wangda Tan.

YARN-8800. Updated documentation of Submarine with latest examples. Contributed by Wangda Tan. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/19ad5be6 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/19ad5be6

hadoop git commit: HDDS-289. Volume and Bucket name should not contain a delimiter ('/'). Contributed by chencan.

Repository: hadoop Updated Branches: refs/heads/trunk 3c798c1e3 -> 72891fc9b HDDS-289. Volume and Bucket name should not contain a delimiter ('/'). Contributed by chencan. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDDS-448. Move NodeStat to NodeStatemanager from SCMNodeManager. Contributed by LiXin Ge.

Repository: hadoop Updated Branches: refs/heads/trunk d1c1dde30 -> 3c798c1e3 HDDS-448. Move NodeStat to NodeStatemanager from SCMNodeManager. Contributed by LiXin Ge. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: YARN-8734. Readiness check for remote service belonging to the same user. Contributed by Eric Yang

Repository: hadoop Updated Branches: refs/heads/trunk e2113500d -> d1c1dde30 YARN-8734. Readiness check for remote service belonging to the same user. Contributed by Eric Yang Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang.

Repository: hadoop Updated Branches: refs/heads/branch-2.8 2a9d8da6d -> d84958405 YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang.

Repository: hadoop Updated Branches: refs/heads/branch-2.9 463d1c312 -> 54ef6e25b YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang. (cherry picked from commit d7d0e55e0a2cbd64de38435fe18a6e65e3144486) Project:

hadoop git commit: YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang.

Repository: hadoop Updated Branches: refs/heads/branch-2 1b0a11050 -> d7d0e55e0 YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang.

Repository: hadoop Updated Branches: refs/heads/branch-3.0 17583e690 -> b412bb224 YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang. (cherry picked from commit 8598b498bcaf4deffa822f871a26635bdf3d9d5c) Project:

hadoop git commit: HDFS-8196. Post enabled Erasure Coding Policies on NameNode UI. Contributed by Kitti Nanasi and Kai Sasaki.

Repository: hadoop Updated Branches: refs/heads/trunk 8598b498b -> e2113500d HDFS-8196. Post enabled Erasure Coding Policies on NameNode UI. Contributed by Kitti Nanasi and Kai Sasaki. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang.

Repository: hadoop Updated Branches: refs/heads/branch-3.1 5b72aa04e -> c306da08e YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang. (cherry picked from commit 8598b498bcaf4deffa822f871a26635bdf3d9d5c) Project:

hadoop git commit: YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang.

Repository: hadoop Updated Branches: refs/heads/trunk 7093afd87 -> 8598b498b YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

[2/2] hadoop git commit: HDDS-548. Create a Self-Signed Certificate. Contributed by Anu Engineer.

HDDS-548. Create a Self-Signed Certificate. Contributed by Anu Engineer. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6f5bc5a4 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/6f5bc5a4 Diff:

[1/2] hadoop git commit: HDDS-548. Create a Self-Signed Certificate. Contributed by Anu Engineer.

Repository: hadoop Updated Branches: refs/heads/HDDS-4 fe85d5157 -> 6f5bc5a4c http://git-wip-us.apache.org/repos/asf/hadoop/blob/6f5bc5a4/hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/security/x509/keys/TestHDDSKeyPEMWriter.java

[hadoop] Git Push Summary

Repository: hadoop Updated Branches: refs/remotes/origin/HDDS-4 [created] fe85d5157 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org

hadoop git commit: YARN-8829. Cluster metrics can fail with IndexOutOfBoundsException. Contributed by Akshay Agarwal.

Repository: hadoop Updated Branches: refs/heads/trunk 284aca8b6 -> 7093afd87 YARN-8829. Cluster metrics can fail with IndexOutOfBoundsException. Contributed by Akshay Agarwal. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-13938. Add a missing break in BaseTestHttpFSWith. Contributed by Siyao Meng.

Repository: hadoop Updated Branches: refs/heads/trunk 5c8d90763 -> 284aca8b6 HDFS-13938. Add a missing break in BaseTestHttpFSWith. Contributed by Siyao Meng. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/284aca8b