svn commit: r1603348 - /hadoop/common/branches/YARN-1051/

Author: curino Date: Wed Jun 18 02:13:26 2014 New Revision: 1603348 URL: http://svn.apache.org/r1603348 Log: Creating a branch for YARN-1051 development activities. Added: hadoop/common/branches/YARN-1051/ (props changed) - copied from r1603347, hadoop/common/trunk/ Propchange

svn commit: r1619019 - in /hadoop/common/branches/YARN-1051: ./ hadoop-assemblies/src/main/resources/assemblies/ hadoop-project-dist/ hadoop-project/ hadoop-project/src/site/ hadoop-tools/hadoop-archi

Author: curino Date: Wed Aug 20 01:34:29 2014 New Revision: 1619019 URL: http://svn.apache.org/r1619019 Log: Merge trunk Added: hadoop/common/branches/YARN-1051/hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/appmaster/ - copied from r1619017, hadoop/common/trunk

svn commit: r1619019 [2/6] - in /hadoop/common/branches/YARN-1051/hadoop-common-project: hadoop-auth/ hadoop-auth/dev-support/ hadoop-auth/src/main/java/org/apache/hadoop/security/authentication/clien

Modified: hadoop/common/branches/YARN-1051/hadoop-common-project/hadoop-common/src/main/bin/hadoop URL: http://svn.apache.org/viewvc/hadoop/common/branches/YARN-1051/hadoop-common-project/hadoop-common/src/main/bin/hadoop?rev=1619019r1=1619018r2=1619019view=diff

svn commit: r1619019 [6/6] - in /hadoop/common/branches/YARN-1051/hadoop-common-project: hadoop-auth/ hadoop-auth/dev-support/ hadoop-auth/src/main/java/org/apache/hadoop/security/authentication/clien

Modified: hadoop/common/branches/YARN-1051/hadoop-common-project/hadoop-kms/src/main/java/org/apache/hadoop/crypto/key/kms/server/KMSAudit.java URL:

svn commit: r1619019 [1/6] - in /hadoop/common/branches/YARN-1051/hadoop-common-project: hadoop-auth/ hadoop-auth/dev-support/ hadoop-auth/src/main/java/org/apache/hadoop/security/authentication/clien

Author: curino Date: Wed Aug 20 01:34:29 2014 New Revision: 1619019 URL: http://svn.apache.org/r1619019 Log: Merge trunk Added: hadoop/common/branches/YARN-1051/hadoop-common-project/hadoop-auth/dev-support/ - copied from r1619017, hadoop/common/trunk/hadoop-common-project/hadoop

svn commit: r1619019 [3/6] - in /hadoop/common/branches/YARN-1051/hadoop-common-project: hadoop-auth/ hadoop-auth/dev-support/ hadoop-auth/src/main/java/org/apache/hadoop/security/authentication/clien

Modified: hadoop/common/branches/YARN-1051/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/KeyShell.java URL:

svn commit: r1619019 [4/6] - in /hadoop/common/branches/YARN-1051/hadoop-common-project: hadoop-auth/ hadoop-auth/dev-support/ hadoop-auth/src/main/java/org/apache/hadoop/security/authentication/clien

Modified: hadoop/common/branches/YARN-1051/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/NetgroupCache.java URL:

svn commit: r1619019 [5/6] - in /hadoop/common/branches/YARN-1051/hadoop-common-project: hadoop-auth/ hadoop-auth/dev-support/ hadoop-auth/src/main/java/org/apache/hadoop/security/authentication/clien

Modified: hadoop/common/branches/YARN-1051/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/crypto/key/TestKeyProviderFactory.java URL:

svn commit: r1619608 - in /hadoop/common/branches/YARN-1051: ./ hadoop-project-dist/ hadoop-project/ hadoop-project/src/site/ hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/ hadoop-t

Author: curino Date: Thu Aug 21 21:55:57 2014 New Revision: 1619608 URL: http://svn.apache.org/r1619608 Log: Merge with trunk to pick up YARN-2436 Added: hadoop/common/branches/YARN-1051/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestDistCpWithRawXAttrs.java

svn commit: r1619608 - in /hadoop/common/branches/YARN-1051/hadoop-common-project/hadoop-common: ./ dev-support/ src/ src/main/bin/ src/main/conf/ src/main/docs/ src/main/java/ src/main/java/org/apach

Author: curino Date: Thu Aug 21 21:55:57 2014 New Revision: 1619608 URL: http://svn.apache.org/r1619608 Log: Merge with trunk to pick up YARN-2436 Added: hadoop/common/branches/YARN-1051/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/AesCtrCryptoCodec.java

git commit: YARN-1707. Introduce APIs to add/remove/resize queues in the CapacityScheduler. Contributed by Carlo Curino and Subru Krishnan

Repository: hadoop Updated Branches: refs/heads/YARN-1051 c656d7d6e - 3777838ca YARN-1707. Introduce APIs to add/remove/resize queues in the CapacityScheduler. Contributed by Carlo Curino and Subru Krishnan Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip

git commit: YARN-2475. Logic for responding to capacity drops for the ReservationSystem. Contributed by Carlo Curino and Subru Krishnan.

Repository: hadoop Updated Branches: refs/heads/YARN-1051 3777838ca - 5d17b5343 YARN-2475. Logic for responding to capacity drops for the ReservationSystem. Contributed by Carlo Curino and Subru Krishnan. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip

git commit: YARN-1710. Logic to find allocations within a Plan that satisfy user ReservationRequest(s). Contributed by Carlo Curino and Subru Krishnan.

Repository: hadoop Updated Branches: refs/heads/YARN-1051 ca9be6fda - 7800b53c4 YARN-1710. Logic to find allocations within a Plan that satisfy user ReservationRequest(s). Contributed by Carlo Curino and Subru Krishnan. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit

git commit: YARN-1711. Policy to enforce instantaneous and over-time quotas on user reservation. Contributed by Carlo Curino and Subru Krishnan.

Repository: hadoop Updated Branches: refs/heads/YARN-1051 7800b53c4 - a72071b3d YARN-1711. Policy to enforce instantaneous and over-time quotas on user reservation. Contributed by Carlo Curino and Subru Krishnan. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git

[01/50] [abbrv] git commit: KMS: Support for multiple Kerberos principals. (tucu)

Repository: hadoop Updated Branches: refs/heads/YARN-1051 f00e7af8a - e82461be5 KMS: Support for multiple Kerberos principals. (tucu) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/fad4cd85 Tree:

[08/50] [abbrv] git commit: HADOOP-11109. Site build is broken. Contributed by Jian He.

HADOOP-11109. Site build is broken. Contributed by Jian He. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/64345722 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/64345722 Diff:

[02/50] [abbrv] git commit: Merge branch 'HDFS-6584' into trunk

Merge branch 'HDFS-6584' into trunk Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/98f7bfe9 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/98f7bfe9 Diff:

[09/50] [abbrv] git commit: YARN-2568. Fixed the potential test failures due to race conditions when RM work-preserving recovery is enabled. Contributed by Jian He.

YARN-2568. Fixed the potential test failures due to race conditions when RM work-preserving recovery is enabled. Contributed by Jian He. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6fe5c6b7 Tree:

[17/50] [abbrv] git commit: HADOOP-10970. Cleanup KMS configuration keys. (wang)

HADOOP-10970. Cleanup KMS configuration keys. (wang) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/adf0b67a Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/adf0b67a Diff:

[30/50] [abbrv] git commit: YARN-2453. TestProportionalCapacityPreemptionPolicy fails with FairScheduler. (Zhihai Xu via kasha)

YARN-2453. TestProportionalCapacityPreemptionPolicy fails with FairScheduler. (Zhihai Xu via kasha) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9721e2c1 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/9721e2c1

[23/50] [abbrv] git commit: HDFS-7095. Archival Storage: TestStorageMover often fails in Jenkins. Contributed by Jing Zhao.

HDFS-7095. Archival Storage: TestStorageMover often fails in Jenkins. Contributed by Jing Zhao. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/84a0a629 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/84a0a629

[26/50] [abbrv] git commit: HDFS-7110. Skip tests related to short-circuit read on platforms that do not currently implement short-circuit read. Contributed by Chris Nauroth.

HDFS-7110. Skip tests related to short-circuit read on platforms that do not currently implement short-circuit read. Contributed by Chris Nauroth. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b6fd5ccb Tree:

[25/50] [abbrv] git commit: HDFS-7109. TestDataStorage does not release file locks between tests. Contributed by Chris Nauroth.

HDFS-7109. TestDataStorage does not release file locks between tests. Contributed by Chris Nauroth. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0795fe37 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0795fe37

[14/50] [abbrv] git commit: HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw)

HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9f03a7c0 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/9f03a7c0 Diff:

[13/50] [abbrv] git commit: YARN-2565. Fixed RM to not use FileSystemApplicationHistoryStore unless explicitly set. Contributed by Zhijie Shen

YARN-2565. Fixed RM to not use FileSystemApplicationHistoryStore unless explicitly set. Contributed by Zhijie Shen Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/444acf8e Tree:

[21/50] [abbrv] git commit: HDFS-7073. Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases. Contributed by Chris Nauroth.

HDFS-7073. Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases. Contributed by Chris Nauroth. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f85cc14e Tree:

[07/50] [abbrv] git commit: HDFS-6840. Clients are always sent to the same datanode when read is off rack. (wang)

HDFS-6840. Clients are always sent to the same datanode when read is off rack. (wang) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8e730844 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8e730844 Diff:

[32/50] [abbrv] git commit: HDFS-7115. TestEncryptionZones assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao.

HDFS-7115. TestEncryptionZones assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/26cba7f3 Tree:

[29/50] [abbrv] git commit: HADOOP-10131. NetWorkTopology#countNumOfAvailableNodes() is returning wrong value if excluded nodes passed are not part of the cluster tree (Contributed by Vinayakumar B)

HADOOP-10131. NetWorkTopology#countNumOfAvailableNodes() is returning wrong value if excluded nodes passed are not part of the cluster tree (Contributed by Vinayakumar B) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

[27/50] [abbrv] git commit: YARN-2452. TestRMApplicationHistoryWriter fails with FairScheduler. (Zhihai Xu via kasha)

YARN-2452. TestRMApplicationHistoryWriter fails with FairScheduler. (Zhihai Xu via kasha) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c50fc925 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c50fc925 Diff:

[15/50] [abbrv] git commit: MAPREDUCE-6091. YARNRunner.getJobStatus() fails with ApplicationNotFoundException if the job rolled off the RM view. Contributed by Sangjin Lee

MAPREDUCE-6091. YARNRunner.getJobStatus() fails with ApplicationNotFoundException if the job rolled off the RM view. Contributed by Sangjin Lee Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/951847ba Tree:

[05/50] [abbrv] git commit: HDFS-6727. Refresh data volumes on DataNode based on configuration changes (Lei Xu via Colin Patrick McCabe)

HDFS-6727. Refresh data volumes on DataNode based on configuration changes (Lei Xu via Colin Patrick McCabe) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/fe38d2e9 Tree:

[50/50] [abbrv] git commit: Rebase against trunk

/heads/YARN-1051 Commit: e82461be56fab0c3b5188219c8fc09946b0826ba Parents: e53fdea f00e7af Author: carlo curino Carlo Curino Authored: Mon Sep 22 16:46:56 2014 -0700 Committer: carlo curino Carlo Curino Committed: Mon Sep 22 16:46:56 2014 -0700

[38/50] [abbrv] git commit: YARN-2539. FairScheduler: Set the default value for maxAMShare to 0.5. (Wei Yan via kasha)

YARN-2539. FairScheduler: Set the default value for maxAMShare to 0.5. (Wei Yan via kasha) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/43efdd30 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/43efdd30 Diff:

[36/50] [abbrv] git commit: HDFS-7106. Reconfiguring DataNode volumes does not release the lock files in removed volumes. (cnauroth via cmccabe)

HDFS-7106. Reconfiguring DataNode volumes does not release the lock files in removed volumes. (cnauroth via cmccabe) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/912ad32b Tree:

[12/50] [abbrv] git commit: HDFS-7096. Fix TestRpcProgramNfs3 to use DFS_ENCRYPTION_KEY_PROVIDER_URI (clamb via cmccabe)

HDFS-7096. Fix TestRpcProgramNfs3 to use DFS_ENCRYPTION_KEY_PROVIDER_URI (clamb via cmccabe) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/25fd69a8 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/25fd69a8 Diff:

[24/50] [abbrv] git commit: HDFS-7107. Avoid Findbugs warning for synchronization on AbstractNNFailoverProxyProvider#fallbackToSimpleAuth. Contributed by Chris Nauroth.

HDFS-7107. Avoid Findbugs warning for synchronization on AbstractNNFailoverProxyProvider#fallbackToSimpleAuth. Contributed by Chris Nauroth. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/47491f9a Tree:

[37/50] [abbrv] git commit: YARN-2540. FairScheduler: Queue filters not working on scheduler page in RM UI. (Ashwin Shankar via kasha)

YARN-2540. FairScheduler: Queue filters not working on scheduler page in RM UI. (Ashwin Shankar via kasha) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/23e17ce0 Tree:

[20/50] [abbrv] git commit: HDFS-7105. Fix TestJournalNode#testFailToStartWithBadConfig to match log output change. Contributed by Ray Chiang.

HDFS-7105. Fix TestJournalNode#testFailToStartWithBadConfig to match log output change. Contributed by Ray Chiang. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/332e2e23 Tree:

[42/50] [abbrv] git commit: YARN-1708. Public YARN APIs for creating/updating/deleting reservations.

-us.apache.org/repos/asf/hadoop/diff/3f1d205a Branch: refs/heads/YARN-1051 Commit: 3f1d205a73bffac56e295cad989a38aa260af80b Parents: 15478ca Author: subru su...@outlook.com Authored: Fri Sep 12 17:16:07 2014 -0700 Committer: carlo curino Carlo Curino Committed: Mon Sep 22 16:32:11 2014 -0700

[48/50] [abbrv] YARN-2080. Integrating reservation system with ResourceManager and client-RM protocol. Contributed by Subru Krishnan and Carlo Curino.

http://git-wip-us.apache.org/repos/asf/hadoop/blob/e53fdea3/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/AppAddedSchedulerEvent.java

[44/50] [abbrv] git commit: YARN-1709. In-memory data structures used to track resources over time to enable reservations.

: http://git-wip-us.apache.org/repos/asf/hadoop/diff/36a83267 Branch: refs/heads/YARN-1051 Commit: 36a832674fc8a9027d9f50ded17b95240d65a1d1 Parents: 3f1d205 Author: subru su...@outlook.com Authored: Fri Sep 12 17:22:08 2014 -0700 Committer: carlo curino Carlo Curino Committed: Mon Sep 22 16:32:11

[28/50] [abbrv] git commit: HDFS-6987. Move CipherSuite xattr information up to the encryption zone root. Contributed by Zhe Zhang.

HDFS-6987. Move CipherSuite xattr information up to the encryption zone root. Contributed by Zhe Zhang. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1737950d Tree:

[31/50] [abbrv] git commit: MAPREDUCE-6095. Enable DistributedCache for uber-mode Jobs. Contributed by Gera Shegalov

MAPREDUCE-6095. Enable DistributedCache for uber-mode Jobs. Contributed by Gera Shegalov Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/7039b98e Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/7039b98e Diff:

[40/50] [abbrv] git commit: YARN-2475. Logic for responding to capacity drops for the ReservationSystem. Contributed by Carlo Curino and Subru Krishnan.

YARN-2475. Logic for responding to capacity drops for the ReservationSystem. Contributed by Carlo Curino and Subru Krishnan. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/15478ca5 Tree: http://git-wip-us.apache.org/repos

[18/50] [abbrv] git commit: HDFS-7046. HA NN can NPE upon transition to active. Contributed by Kihwal Lee.

HDFS-7046. HA NN can NPE upon transition to active. Contributed by Kihwal Lee. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9e355719 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/9e355719 Diff:

[35/50] [abbrv] git commit: YARN-1372. Ensure all completed containers are reported to the AMs across RM restart. Contributed by Anubhav Dhoot

YARN-1372. Ensure all completed containers are reported to the AMs across RM restart. Contributed by Anubhav Dhoot Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0a641496 Tree:

[49/50] [abbrv] git commit: YARN-2080. Integrating reservation system with ResourceManager and client-RM protocol. Contributed by Subru Krishnan and Carlo Curino.

YARN-2080. Integrating reservation system with ResourceManager and client-RM protocol. Contributed by Subru Krishnan and Carlo Curino. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e53fdea3 Tree: http://git-wip

[47/50] [abbrv] git commit: YARN-1712. Plan follower that synchronizes the current state of reservation subsystem with the scheduler. Contributed by Subru Krishnan and Carlo Curino.

YARN-1712. Plan follower that synchronizes the current state of reservation subsystem with the scheduler. Contributed by Subru Krishnan and Carlo Curino. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4a795348 Tree: http

[34/50] [abbrv] YARN-1372. Ensure all completed containers are reported to the AMs across RM restart. Contributed by Anubhav Dhoot

http://git-wip-us.apache.org/repos/asf/hadoop/blob/0a641496/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/TestRMAppAttemptTransitions.java

[33/50] [abbrv] git commit: MAPREDUCE-5279. Made MR headroom calculation honor cpu dimension when YARN scheduler resource type is memory plus cpu. Contributed by Peng Zhang and Varun Vasudev.

MAPREDUCE-5279. Made MR headroom calculation honor cpu dimension when YARN scheduler resource type is memory plus cpu. Contributed by Peng Zhang and Varun Vasudev. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/376233cd

[43/50] [abbrv] YARN-1709. In-memory data structures used to track resources over time to enable reservations.

http://git-wip-us.apache.org/repos/asf/hadoop/blob/36a83267/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/reservation/TestInMemoryPlan.java

[39/50] [abbrv] git commit: YARN-1707. Introduce APIs to add/remove/resize queues in the CapacityScheduler. Contributed by Carlo Curino and Subru Krishnan

YARN-1707. Introduce APIs to add/remove/resize queues in the CapacityScheduler. Contributed by Carlo Curino and Subru Krishnan Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/60d4f29d Tree: http://git-wip-us.apache.org

[41/50] [abbrv] YARN-1708. Public YARN APIs for creating/updating/deleting reservations.

http://git-wip-us.apache.org/repos/asf/hadoop/blob/3f1d205a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/ReservationSubmissionRequestPBImpl.java -- diff --git

[45/50] [abbrv] git commit: YARN-1710. Logic to find allocations within a Plan that satisfy user ReservationRequest(s). Contributed by Carlo Curino and Subru Krishnan.

YARN-1710. Logic to find allocations within a Plan that satisfy user ReservationRequest(s). Contributed by Carlo Curino and Subru Krishnan. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d297491d Tree: http://git-wip

[46/50] [abbrv] git commit: YARN-1711. Policy to enforce instantaneous and over-time quotas on user reservation. Contributed by Carlo Curino and Subru Krishnan.

YARN-1711. Policy to enforce instantaneous and over-time quotas on user reservation. Contributed by Carlo Curino and Subru Krishnan. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a5800b72 Tree: http://git-wip

git commit: Fix spurious modificaiton in previous commit

/repos/asf/hadoop/tree/d0dc7eaf Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/d0dc7eaf Branch: refs/heads/YARN-1051 Commit: d0dc7eafe72f7cb11b660cd51b013091bde84b90 Parents: e82461b Author: carlo curino Carlo Curino Authored: Mon Sep 22 17:10:17 2014 -0700 Committer: carlo curino Carlo

hadoop git commit: YARN-3974. Refactor the reservation system test cases to use parameterized base test. (subru via curino)

Repository: hadoop Updated Branches: refs/heads/trunk f4c523b69 - 8572a5a14 YARN-3974. Refactor the reservation system test cases to use parameterized base test. (subru via curino) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf

hadoop git commit: YARN-3974. Refactor the reservation system test cases to use parameterized base test. (subru via curino)

Repository: hadoop Updated Branches: refs/heads/branch-2 d7d804623 - 8e23a7997 YARN-3974. Refactor the reservation system test cases to use parameterized base test. (subru via curino) (cherry picked from commit 8572a5a14b999a866fa64ce32ee20078ffefdb1e) Project: http://git-wip-us.apache.org

hadoop git commit: Revert YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino) moving this to branch-2.7 per Akira's request.

Repository: hadoop Updated Branches: refs/heads/branch-2.7.1 5a1d236ba - a4c88298d Revert YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino) moving this to branch-2.7 per Akira's request. This reverts commit

hadoop git commit: YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino)

Repository: hadoop Updated Branches: refs/heads/branch-2.7 b919c1c04 - 76339bfb9 YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino) (cherry picked from commit 0fcb4a8cf2add3f112907ff4e833e2f04947b53e) (cherry picked from

hadoop git commit: YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino)

Repository: hadoop Updated Branches: refs/heads/branch-2.7.1 ac0538aac - 5a1d236ba YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino) (cherry picked from commit 0fcb4a8cf2add3f112907ff4e833e2f04947b53e) (cherry picked

hadoop git commit: YARN-3969. Updating CHANGES.txt to reflect the correct set of branches where this is committed

/heads/branch-2.7 Commit: b465c5b907f359d925a218618cfd87f0bdb330ae Parents: c65b6b7 Author: carlo curino Carlo Curino Authored: Fri Jul 24 13:38:44 2015 -0700 Committer: carlo curino Carlo Curino Committed: Fri Jul 24 13:42:13 2015 -0700

hadoop git commit: YARN-3969. Updating CHANGES.txt to reflect the correct set of branches where this is committed

: 2419711 Author: carlo curino Carlo Curino Authored: Fri Jul 24 13:38:44 2015 -0700 Committer: carlo curino Carlo Curino Committed: Fri Jul 24 13:40:14 2015 -0700 -- hadoop-yarn-project/CHANGES.txt | 6 -- 1 file changed, 4

hadoop git commit: YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino)

Repository: hadoop Updated Branches: refs/heads/trunk 206d4933a - 0fcb4a8cf YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip

hadoop git commit: YARN-3969. Updating CHANGES.txt to reflect the correct set of branches where this is committed

/fc42fa8a Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/fc42fa8a Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/fc42fa8a Branch: refs/heads/trunk Commit: fc42fa8ae3bc9d6d055090a7bb5e6f0c5972fcff Parents: e4b0c74 Author: carlo curino Carlo Curino Authored: Fri Jul 24 13:38:44

[3/4] hadoop git commit: YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino)

http://git-wip-us.apache.org/repos/asf/hadoop/blob/156f24ea/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/reservation/planning/PlanningAlgorithm.java

[2/4] hadoop git commit: YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino)

http://git-wip-us.apache.org/repos/asf/hadoop/blob/156f24ea/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/reservation/TestGreedyReservationAgent.java

[4/4] hadoop git commit: YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino)

YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/156f24ea Tree: http://git-wip-us.apache.org/repos/asf

[2/4] hadoop git commit: YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino) (cherry picked from commit 156f24ead00436faad5d4aeef327a5

http://git-wip-us.apache.org/repos/asf/hadoop/blob/26ea0458/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/reservation/TestGreedyReservationAgent.java

[4/4] hadoop git commit: YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino) (cherry picked from commit 156f24ead00436faad5d4aeef327a5

YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino) (cherry picked from commit 156f24ead00436faad5d4aeef327a546392cd265) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf

[3/4] hadoop git commit: YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino) (cherry picked from commit 156f24ead00436faad5d4aeef327a5

http://git-wip-us.apache.org/repos/asf/hadoop/blob/26ea0458/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/reservation/planning/PlanningAlgorithm.java

Git Push Summary

Repository: hadoop Updated Branches: refs/heads/YARN-2915 [created] c9dd2cada

[2/2] hadoop git commit: YARN-3800. Reduce storage footprint for ReservationAllocation. Contributed by Anubhav Dhoot.

Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/753d8706 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/753d8706 Branch: refs/heads/branch-2 Commit: 753d87066f4d5c793d5ef0bdc9018d320d45ad20 Parents: ae0d5d6 Author: carlo curino Carlo Curino Authored: Thu Jul 9 16:47:35 2015 -0700

[1/2] hadoop git commit: YARN-3800. Reduce storage footprint for ReservationAllocation. Contributed by Anubhav Dhoot.

-wip-us.apache.org/repos/asf/hadoop/commit/0e602fa3 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0e602fa3 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/0e602fa3 Branch: refs/heads/trunk Commit: 0e602fa3a1529134214452fba10a90307d9c2072 Parents: f4ca530 Author: carlo curino

hadoop git commit: YARN-4248. REST API for submit/update/delete Reservations. (curino)

Repository: hadoop Updated Branches: refs/heads/trunk 4ff973f96 -> c25a63545 YARN-4248. REST API for submit/update/delete Reservations. (curino) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c25a6354 Tree: http://

hadoop git commit: YARN-4248. REST API for submit/update/delete Reservations. (curino)

Repository: hadoop Updated Branches: refs/heads/branch-2 7c604c3d0 -> 4ac156441 YARN-4248. REST API for submit/update/delete Reservations. (curino) (cherry picked from commit c25a6354598ec855bec7f695a7c3eed8794cd381) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: h

hadoop git commit: YARN-4248. REST API for submit/update/delete Reservations. (curino)

Repository: hadoop Updated Branches: refs/heads/branch-2.8 03e615ba5 -> 3205fe3da YARN-4248. REST API for submit/update/delete Reservations. (curino) (cherry picked from commit c25a6354598ec855bec7f695a7c3eed8794cd381) (cherry picked from commit 4ac1564418597e2ebbaa80600eb5f002b1431

[2/3] hadoop git commit: YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)

http://git-wip-us.apache.org/repos/asf/hadoop/blob/013532a9/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMWebServices.java

[3/3] hadoop git commit: YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)

YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/013532a9 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/013532a9 Diff: http://git

[1/3] hadoop git commit: YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)

Repository: hadoop Updated Branches: refs/heads/trunk 3c83cee11 -> 013532a95 http://git-wip-us.apache.org/repos/asf/hadoop/blob/013532a9/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/ResourceManagerRest.md

[2/3] hadoop git commit: YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)

http://git-wip-us.apache.org/repos/asf/hadoop/blob/c6569779/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMWebServices.java

[3/3] hadoop git commit: YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)

YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino) (cherry picked from commit 013532a95e63d7c53e601be530021d6d5a15ab7f) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c6569779 Tree: http

[1/3] hadoop git commit: YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)

Repository: hadoop Updated Branches: refs/heads/branch-2 da7704079 -> c65697796 http://git-wip-us.apache.org/repos/asf/hadoop/blob/c6569779/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/ResourceManagerRest.md

[2/3] hadoop git commit: YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)

http://git-wip-us.apache.org/repos/asf/hadoop/blob/7982933c/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMWebServices.java

[1/3] hadoop git commit: YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)

Repository: hadoop Updated Branches: refs/heads/branch-2.8 fe10caee8 -> 7982933c0 http://git-wip-us.apache.org/repos/asf/hadoop/blob/7982933c/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/ResourceManagerRest.md

[3/3] hadoop git commit: YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)

YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino) (cherry picked from commit 013532a95e63d7c53e601be530021d6d5a15ab7f) (cherry picked from commit c656977961e2ba0f9dfd349ed59bf1d0d41c57f5) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http

[2/2] hadoop git commit: Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk

Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c3641ed3 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c3641ed3 Diff:

[1/2] hadoop git commit: YARN-4420. Add REST API for List Reservations (Sean Po via curino)

Repository: hadoop Updated Branches: refs/heads/trunk bc425a623 -> c3641ed3b YARN-4420. Add REST API for List Reservations (Sean Po via curino) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b706cbc1 Tree: http://

hadoop git commit: YARN-4420. Amend adding modification to CHANGES.txt

op-yarn-project/CHANGES.txt @@ -802,6 +802,8 @@ Release 2.8.0 - UNRELEASED YARN-4360. Improve GreedyReservationAgent to support "early" allocations, and performance improvements (curino via asuresh) +YARN-4420. Add REST API for List Reservations. (Sean Po via curino) + OPTIM

hadoop git commit: YARN-4420. Add REST API for List Reservations. (Sean Po via curino)

Repository: hadoop Updated Branches: refs/heads/branch-2.8 cad143657 -> 9220bb649 YARN-4420. Add REST API for List Reservations. (Sean Po via curino) (cherry picked from commit fc9eb4577cdfd44cb99b933eae15f4794494836b) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: h

hadoop git commit: YARN-6190. Validation and synchronization fixes in LocalityMulticastAMRMProxyPolicy. (Botong Huang via curino)

Repository: hadoop Updated Branches: refs/heads/YARN-2915 611a7fec4 -> f743fe342 YARN-6190. Validation and synchronization fixes in LocalityMulticastAMRMProxyPolicy. (Botong Huang via curino) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.

hadoop git commit: YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino)

Repository: hadoop Updated Branches: refs/heads/branch-2 4274600b9 -> 58ac40b55 YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino) (cherry picked from commit 892a8348fceb42069ea9877251c413fe33415e16) Project: h

hadoop git commit: YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino)

Repository: hadoop Updated Branches: refs/heads/branch-2.8 55ba22072 -> b32f14d80 YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino) (cherry picked from commit 892a8348fceb42069ea9877251c413fe33415e16) (cherry pic

hadoop git commit: YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino)

Repository: hadoop Updated Branches: refs/heads/trunk 79ae78dcb -> 892a8348f YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-

hadoop git commit: YARN-6370. Properly handle rack requests for non-active subclusters in LocalityMulticastAMRMProxyPolicy. (Contributed by Botong Huang via curino).

Repository: hadoop Updated Branches: refs/heads/YARN-2915 3778d87b4 -> 39d352caf YARN-6370. Properly handle rack requests for non-active subclusters in LocalityMulticastAMRMProxyPolicy. (Contributed by Botong Huang via curino). Project: http://git-wip-us.apache.org/repos/asf/hadoop/r

hadoop git commit: YARN-6203: Occasional test failure in TestWeightedRandomRouterPolicy (curino)

Repository: hadoop Updated Branches: refs/heads/YARN-2915 5eacf0cdb -> 47451e0e3 YARN-6203: Occasional test failure in TestWeightedRandomRouterPolicy (curino) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/47451

[02/50] [abbrv] hadoop git commit: YARN-3673. Create a FailoverProxy for Federation services. Contributed by Subru Krishnan

+0800 Committer: Carlo Curino <cur...@apache.org> Committed: Tue Aug 1 17:28:20 2017 -0700 -- .../org/apache/hadoop/yarn/conf/HAUtil.java | 30 ++- .../hadoop/yarn/conf/YarnConfiguration.java | 10 + .

[35/50] [abbrv] hadoop git commit: YARN-6691. Update YARN daemon startup/shutdown scripts to include Router service. (Giovanni Matteo Fumarola via asuresh).

thored: Mon Jun 19 10:52:23 2017 -0700 Committer: Carlo Curino <cur...@apache.org> Committed: Tue Aug 1 17:28:26 2017 -0700 -- hadoop-yarn-project/hadoop-yarn/bin/yarn | 5 + hadoop-yarn-project/hadoop-yarn/

[05/50] [abbrv] hadoop git commit: YARN-5676. Add a HashBasedRouterPolicy, and small policies and test refactoring. (Carlo Curino via Subru).

http://git-wip-us.apache.org/repos/asf/hadoop/blob/4128c952/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/server/federation/policies/TestRouterPolicyFacade.java

  1   2   3   >