This is an automated email from the ASF dual-hosted git repository.
mthakur pushed a change to branch feature-vectored-io
in repository https://gitbox.apache.org/repos/asf/hadoop.git.
omit ac08a25 HADOOP-11867. Add a high-performance vectored read API.
(#3904)
add fcb1076 HDFS-16426. Fix nextBlockReportTime when trigger full block
report force (#3887)
add e355646 HDFS-16399. Reconfig cache report parameters for datanode
(#3841)
add db2c320 HDFS-16423. Balancer should not get blocks on stale storages
(#3883)
add 7c97c0f HADOOP-18084. ABFS: Add testfilePath while verifying test
contents are read correctly (#3903)
add dae33cf YARN-11065. Bump follow-redirects from 1.13.3 to 1.14.7 in
hadoop-yarn-ui (#3890)
add 15b820c HDFS-16402. Improve HeartbeatManager logic to avoid incorrect
stats. (#3839). Contributed by tomscut.
add 5ef335d HDFS-16430. Add validation to maximum blocks in EC group when
adding an EC policy (#3899). Contributed by daimin.
add 795a5ef HADOOP-17593. hadoop-huaweicloud and hadoop-cloud-storage to
remove log4j as transitive dependency
add b795f6f HADOOP-18094. Disable S3A auditing by default.
add 3ed3c74 YARN-11015. Decouple queue capacity with ability to run
OPPORTUNISTIC container (#3779)
add d699389 HDFS-16403. Improve FUSE IO performance by supporting FUSE
parameter max_background (#3842)
add 43153e8 HDFS-16428. Source path with storagePolicy cause wrong
typeConsumed while rename (#3898). Contributed by lei w.
add 94b884a HDFS-16262. Async refresh of cached locations in
DFSInputStream (#3527)
add 8c7c49d HDFS-16401.Remove the worthless
DatasetVolumeChecker#numAsyncDatasetChecks. (#3838)
add 0d17b62 HADOOP-18093. Better exception handling for
testFileStatusOnMountLink() in ViewFsBaseTest.java (#3918). Contributed by Xing
Lin.
add 4b26635 YARN-11034. Add enhanced headroom in AllocateResponse (#3766)
add 4faac58 HADOOP-18089. Test coverage for Async profiler servlets
(#3913)
add c2ff390 HDFS-16398. Reconfig block report parameters for datanode
(#3831)
add 6136d63 HDFS-16427. Add debug log for
BlockManager#chooseExcessRedundancyStriped (#3888)
add e17c96a HDFS-16429. Add DataSetLockManager to manage fine-grain locks
for FsDataSetImpl. (#3900). Contributed by limingxiang.
add 1c01944 YARN-11068. Exclude transitive log4j2 dependency coming from
solr 8. (#3936)
add 02f6bad Revert "YARN-11068. Exclude transitive log4j2 dependency
coming from solr 8. (#3936)"
add 9cb535c YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
YARN application catalog webapp (#2591)
add 39cad5f HDFS-16169. Fix TestBlockTokenWithDFSStriped#testEnd2End
failure (#3850)
add bd50b91 HDFS-16444. Show start time of JournalNode on Web (#3943)
add 089e06d HDFS-16443. Fix edge case where DatanodeAdminDefaultMonitor
doubly enqueues a DatanodeDescriptor on exception (#3942)
add e8f767f YARN-11026. Make default AppPlacementAllocator configurable
in AppSch… (#3741)
add aeae571 Revert "HADOOP-18024. SocketChannel is not closed when
IOException happens in Server$Listener.doAccept (#3719)"
add 87abc43 YARN-10822. Containers going from New to Scheduled transition
for kil… (#3632)
add ec2fd01 YARN-10459. containerLaunchedOnNode method not need to hold
scheduler… (#3195)
add ed44662 HDFS-16445. Make HDFS count, mkdir, rm cross platform (#3945)
add b5b07af HDFS-16435. Remove no need TODO comment for
ObserverReadProxyProvider (#3912). Contributed by tomscut.
add 41c86b6 HADOOP-18101. Bump aliyun-sdk-oss to 3.13.2 and jdom2 to
2.0.6.1 (#3951)
add 3684c7f HADOOP-18100: Change scope of inner classes in InodeTree to
make them accessible outside package
add 5e7ce26e HADOOP-18085. S3 SDK Upgrade causes AccessPoint ARN endpoint
mistranslation (#3902)
add 125e3b6 HDFS-16437 ReverseXML processor doesn't accept XML files
without the … (#3926)
add b39b334 HADOOP-18098. Basic verification for the release candidate
vote (#3944)
add 3e7a7c3 HDFS-16411 RBF: RouterId is NULL when disable
RourterRpcServer (#3878)
add bf0cefb HDFS-16406. ReadsFromLocalClient counts short-circuit reads
(#3847)
add a08e69d HADOOP-18114. Documentation correction in assumed_roles.md
(#3949)
add 390967f RBF: Add search box in Router's tab-mounttable web page
(#3968)
add efdec92 HADOOP-18091. S3A auditing leaks memory through ThreadLocal
references (#3930)
add c777142 RBF: Registry HDFS Router's rpcserver & rpcclient metrics for
PrometheusSink. (#3965)
add fe583c4 HADOOP-18096. Distcp: Sync moves filtered file to home
directory rather than deleting. (#3940). Contributed by Ayush Saxena.
add ca8ba24 HADOOP-18110. ViewFileSystem: Add Support for Localized Trash
Root
add 0e74f1e Fix thread safety of EC decoding during concurrent preads
(#3881)
add b689643 HDFS-16449. Fix hadoop web site release notes and changelog
not available (#3967)
add 7fd90cd YARN-10788. TestCsiClient fails (#3989)
add 0c194f2 HDFS-16396. Reconfig slow peer parameters for datanode (#3827)
add 48bef28 HDFS-16440. RBF: Support router get HAServiceStatus with
Lifeline RPC address (#3971)
add 19d90e6 HADOOP-18109. Ensure that default permissions of directories
under internal ViewFS directories are the same as directories on target
filesystems. Contributed by Chentao Yu. (3953)
add 2025243 HADOOP-18082.Add debug log when RPC#Reader gets a Call.
(#3891). Contributed by JiangHua Zhu.
add 5f6a294 HADOOP-18126. update junit 5 version due to build issues
(#3993)
add d58c10c YARN-11071. AutoCreatedQueueTemplate incorrect wildcard
level. Contributed by Tamas Domok
add bb1135c YARN-10894. Follow up YARN-10237: fix the new test case in
TestRMWebServicesCapacitySched. Contributed by Tamas Domok
add 48e02f7 YARN-10580. Fix some issues in
TestRMWebServicesCapacitySchedDynamicConfig. Contributed by Tamas Domok
add 51001fc YARN-11022. Fix the documentation for max-parallel-apps in
CS. Contributed by Tamas Domok
add 4c05d25 YARN-10995. Move PendingApplicationComparator from
GuaranteedOrZeroCapacityOverTimePolicy. Contributed by Benjamin Teke
add ad0a1dc YARN-11075. Explicitly declare serialVersionUID in
LogMutation class. Contributed by Benjamin Teke
add 7dd288c YARN-11070. Minimum resource ratio is overridden by
subsequent labels. Contributed by Andras Gyori
add de526e1 YARN-10947. Simplify AbstractCSQueue#initializeQueueState.
Contributed by Andras Gyori
add a4f4590 HADOOP-18117. Add an option to preserve root directory
permissions (#3970)
add 007c201 YARN-11068. Update transitive log4j2 dependency to 2.17.1
(#3963)
add cae749b HADOOP-18136. Verify FileUtils.unTar() handling of missing
.tar files.
add 2f448ac HDFS-16459. RBF: register RBFMetrics in MetricsSystem for
promethuessink (#3999)
add 589695c HDFS-16316.Improve DirectoryScanner: add regular file check
related block. (#3861)
add 697e5d4 HADOOP-18125. Utility to identify git commit / Jira
fixVersion discrepancies for RC preparation (#3991)
add e363f51 HDFS-16461. Expose JournalNode storage info in the jmx
metrics (#4002)
add 1f157f8 HADOOP-17386. Change default fs.s3a.buffer.dir to be under
Yarn container path on yarn applications (#3908)
new 87682c9 HADOOP-11867. Add a high-performance vectored read API.
(#3904)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (ac08a25)
\
N -- N -- N refs/heads/feature-vectored-io (87682c9)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
LICENSE-binary | 5 +-
dev-support/git-jira-validation/README.md | 134 ++++++
.../git_jira_fix_version_check.py | 118 +++++
dev-support/git-jira-validation/requirements.txt | 18 +
dev-support/hadoop-vote.sh | 201 +++++++++
.../hadoop-huaweicloud/pom.xml | 10 +-
.../main/java/org/apache/hadoop/fs/FileUtil.java | 36 +-
.../apache/hadoop/fs/audit/CommonAuditContext.java | 27 +-
.../hadoop/fs/impl/WeakReferenceThreadMap.java | 54 +++
.../org/apache/hadoop/fs/viewfs/Constants.java | 6 +
.../java/org/apache/hadoop/fs/viewfs/FsGetter.java | 8 +-
.../org/apache/hadoop/fs/viewfs/InodeTree.java | 24 +-
.../apache/hadoop/fs/viewfs/ViewFileSystem.java | 100 ++++-
.../org/apache/hadoop/http/ProfileServlet.java | 11 +-
.../io/erasurecode/rawcoder/RawErasureDecoder.java | 6 +-
.../main/java/org/apache/hadoop/ipc/Server.java | 28 +-
.../hadoop/util/LightWeightResizableGSet.java | 28 +-
.../org/apache/hadoop/util/WeakReferenceMap.java | 261 +++++++++++
.../src/main/resources/core-default.xml | 18 +-
.../3.2.2/{CHANGELOG.md => CHANGELOG.3.2.2.md} | 0
.../{RELEASENOTES.md => RELEASENOTES.3.2.2.md} | 0
.../java/org/apache/hadoop/fs/TestFileUtil.java | 50 +++
.../hadoop/fs/audit/TestCommonAuditContext.java | 18 +
.../hadoop/fs/viewfs/ViewFileSystemBaseTest.java | 156 +++++++
.../apache/hadoop/fs/viewfs/ViewFsBaseTest.java | 9 +-
.../org/apache/hadoop/http/TestProfileServlet.java | 85 ++++
.../test/java/org/apache/hadoop/ipc/TestIPC.java | 47 --
.../apache/hadoop/util/TestWeakReferenceMap.java | 199 +++++++++
.../java/org/apache/hadoop/hdfs/ClientContext.java | 42 ++
.../java/org/apache/hadoop/hdfs/DFSClient.java | 34 +-
.../org/apache/hadoop/hdfs/DFSInputStream.java | 324 +++++++++-----
.../apache/hadoop/hdfs/DFSStripedInputStream.java | 10 +-
.../apache/hadoop/hdfs/LocatedBlocksRefresher.java | 210 +++++++++
.../hadoop/hdfs/client/HdfsClientConfigKeys.java | 13 +
.../hadoop/hdfs/client/impl/DfsClientConf.java | 18 +-
.../namenode/ha/ObserverReadProxyProvider.java | 1 -
.../src/main/native/fuse-dfs/doc/README | 1 +
.../src/main/native/fuse-dfs/fuse_dfs.c | 6 +
.../src/main/native/fuse-dfs/fuse_init.c | 4 +-
.../src/main/native/fuse-dfs/fuse_options.c | 11 +-
.../src/main/native/fuse-dfs/fuse_options.h | 1 +
.../src/main/native/fuse-dfs/test/TestFuseDFS.java | 1 +
.../native/libhdfspp/tests/tools/CMakeLists.txt | 9 +
.../libhdfspp/tests/tools/hdfs-count-mock.cc | 63 +++
.../native/libhdfspp/tests/tools/hdfs-count-mock.h | 68 +++
.../libhdfspp/tests/tools/hdfs-mkdir-mock.cc | 83 ++++
.../native/libhdfspp/tests/tools/hdfs-mkdir-mock.h | 70 +++
.../native/libhdfspp/tests/tools/hdfs-rm-mock.cc | 60 +++
.../native/libhdfspp/tests/tools/hdfs-rm-mock.h | 68 +++
.../libhdfspp/tests/tools/hdfs-tool-tests.cc | 59 +++
.../native/libhdfspp/tests/tools/hdfs-tool-tests.h | 94 ++++
.../src/main/native/libhdfspp/tools/CMakeLists.txt | 9 +-
.../libhdfspp/tools/hdfs-count/CMakeLists.txt | 27 ++
.../libhdfspp/tools/hdfs-count/hdfs-count.cc | 125 ++++++
.../native/libhdfspp/tools/hdfs-count/hdfs-count.h | 94 ++++
.../main/native/libhdfspp/tools/hdfs-count/main.cc | 51 ++-
.../libhdfspp/tools/hdfs-mkdir/CMakeLists.txt | 27 ++
.../libhdfspp/tools/hdfs-mkdir/hdfs-mkdir.cc | 140 ++++++
.../native/libhdfspp/tools/hdfs-mkdir/hdfs-mkdir.h | 105 +++++
.../main/native/libhdfspp/tools/hdfs-mkdir/main.cc | 51 ++-
.../native/libhdfspp/tools/hdfs-rm/CMakeLists.txt | 27 ++
.../main/native/libhdfspp/tools/hdfs-rm/hdfs-rm.cc | 114 +++++
.../main/native/libhdfspp/tools/hdfs-rm/hdfs-rm.h | 92 ++++
.../main/native/libhdfspp/tools/hdfs-rm/main.cc | 51 ++-
.../src/main/native/libhdfspp/tools/hdfs_count.cc | 93 ----
.../src/main/native/libhdfspp/tools/hdfs_mkdir.cc | 98 ----
.../src/main/native/libhdfspp/tools/hdfs_rm.cc | 90 ----
.../federation/metrics/FederationRPCMetrics.java | 8 +
.../hdfs/server/federation/metrics/RBFMetrics.java | 35 ++
.../router/NamenodeHeartbeatService.java | 10 +-
.../hdfs/server/federation/router/Router.java | 17 +
.../src/main/webapps/router/federationhealth.html | 8 +-
.../src/main/webapps/router/federationhealth.js | 16 +
.../hdfs/server/federation/router/TestRouter.java | 20 +-
.../router/TestRouterNamenodeHeartbeat.java | 56 ++-
.../java/org/apache/hadoop/hdfs/DFSConfigKeys.java | 7 +
.../hadoop/hdfs/qjournal/server/JournalNode.java | 16 +
.../hdfs/qjournal/server/JournalNodeMXBean.java | 16 +
.../hdfs/server/blockmanagement/BlockManager.java | 24 +-
.../blockmanagement/BlockManagerFaultInjector.java | 4 +
.../DatanodeAdminDefaultMonitor.java | 1 +
.../server/blockmanagement/DatanodeDescriptor.java | 11 +
.../blockmanagement/DatanodeStorageInfo.java | 5 +
.../server/blockmanagement/HeartbeatManager.java | 26 +-
.../hdfs/server/common/AutoCloseDataSetLock.java | 79 ++++
.../hdfs/server/common/DataNodeLockManager.java | 59 +++
.../hadoop/hdfs/server/common/NoLockManager.java | 68 +++
.../hadoop/hdfs/server/common/StorageInfo.java | 15 +
.../hdfs/server/datanode/BPServiceActor.java | 3 +-
.../hadoop/hdfs/server/datanode/BlockReceiver.java | 4 +-
.../apache/hadoop/hdfs/server/datanode/DNConf.java | 63 ++-
.../hadoop/hdfs/server/datanode/DataNode.java | 178 ++++++--
.../hdfs/server/datanode/DataSetLockManager.java | 297 +++++++++++++
.../hadoop/hdfs/server/datanode/DataXceiver.java | 5 +-
.../hdfs/server/datanode/DirectoryScanner.java | 36 +-
.../datanode/checker/DatasetVolumeChecker.java | 1 -
.../datanode/fsdataset/impl/FsDatasetImpl.java | 7 +
.../datanode/metrics/DataNodePeerMetrics.java | 57 ++-
.../server/datanode/metrics/OutlierDetector.java | 20 +-
.../namenode/ErasureCodingPolicyManager.java | 7 +
.../hadoop/hdfs/server/namenode/FSDirRenameOp.java | 6 +-
.../hadoop/hdfs/server/namenode/FSDirectory.java | 6 +-
.../apache/hadoop/hdfs/server/namenode/INode.java | 10 +
.../OfflineImageReconstructor.java | 4 +
.../src/main/resources/hdfs-default.xml | 29 ++
.../src/main/webapps/journal/journalnode.html | 1 +
.../hadoop/fs/viewfs/TestViewFileSystemHdfs.java | 19 +
.../hdfs/TestDFSInputStreamBlockLocations.java | 244 +++++-----
.../hadoop/hdfs/TestErasureCodingPolicies.java | 9 +
.../java/org/apache/hadoop/hdfs/TestGetBlocks.java | 65 +++
.../hadoop/hdfs/TestLocatedBlocksRefresher.java | 266 +++++++++++
.../java/org/apache/hadoop/hdfs/TestQuota.java | 39 ++
.../qjournal/server/TestJournalNodeMXBean.java | 14 +-
.../hadoop/hdfs/server/balancer/TestBalancer.java | 5 +
.../hdfs/server/balancer/TestBalancerService.java | 2 +
.../balancer/TestBalancerWithHANameNodes.java | 37 +-
.../datanode/TestBpServiceActorScheduler.java | 17 +
.../hdfs/server/datanode/TestDataNodeLifeline.java | 54 +++
.../hdfs/server/datanode/TestDataNodeMetrics.java | 38 ++
.../datanode/TestDataNodeReconfiguration.java | 204 +++++++--
.../server/datanode/TestDataSetLockManager.java | 92 ++++
.../hdfs/server/datanode/TestDirectoryScanner.java | 50 +++
.../org/apache/hadoop/hdfs/tools/TestDFSAdmin.java | 2 +-
.../offlineImageViewer/TestOfflineImageViewer.java | 42 +-
hadoop-project/pom.xml | 42 +-
.../java/org/apache/hadoop/fs/s3a/ArnResource.java | 5 +-
.../hadoop/fs/s3a/audit/AWSRequestAnalyzer.java | 2 +-
.../hadoop/fs/s3a/audit/AuditIntegration.java | 12 +-
.../hadoop/fs/s3a/audit/OperationAuditor.java | 11 +
.../hadoop/fs/s3a/audit/S3AAuditConstants.java | 13 +
.../fs/s3a/audit/impl/ActiveAuditManagerS3A.java | 130 +++++-
.../fs/s3a/audit/impl/NoopAuditManagerS3A.java | 15 +-
.../hadoop/fs/s3a/commit/AbstractS3ACommitter.java | 3 +
.../fs/s3a/commit/magic/MagicS3GuardCommitter.java | 2 +
.../fs/s3a/commit/staging/StagingCommitter.java | 2 +
.../markdown/tools/hadoop-aws/assumed_roles.md | 2 +-
.../src/site/markdown/tools/hadoop-aws/auditing.md | 48 +-
.../tools/hadoop-aws/auditing_architecture.md | 123 +++++-
.../site/markdown/tools/hadoop-aws/committers.md | 2 +-
.../src/site/markdown/tools/hadoop-aws/index.md | 14 +-
.../org/apache/hadoop/fs/s3a/TestArnResource.java | 53 ++-
.../hadoop/fs/s3a/audit/AuditTestSupport.java | 6 +-
.../fs/s3a/audit/ITestAuditAccessChecks.java | 4 +-
.../fs/s3a/audit/ITestAuditManagerDisabled.java | 77 ++++
.../hadoop/fs/s3a/audit/MemoryHungryAuditor.java | 130 ++++++
.../impl/TestActiveAuditManagerThreadLeakage.java | 406 +++++++++++++++++
.../s3a/performance/ITestS3AMiscOperationCost.java | 44 +-
.../hadoop-aws/src/test/resources/log4j.properties | 3 +
.../fs/azurebfs/services/ITestAbfsInputStream.java | 22 +-
.../services/ITestAbfsInputStreamReadFooter.java | 6 +-
.../ITestAbfsInputStreamSmallFileReads.java | 10 +-
.../org/apache/hadoop/tools/DistCpConstants.java | 2 +
.../org/apache/hadoop/tools/DistCpContext.java | 4 +
.../apache/hadoop/tools/DistCpOptionSwitch.java | 6 +-
.../org/apache/hadoop/tools/DistCpOptions.java | 19 +
.../java/org/apache/hadoop/tools/DistCpSync.java | 2 +-
.../org/apache/hadoop/tools/OptionsParser.java | 4 +-
.../org/apache/hadoop/tools/SimpleCopyListing.java | 6 +-
.../apache/hadoop/tools/mapred/CopyCommitter.java | 10 +-
.../hadoop-distcp/src/site/markdown/DistCp.md.vm | 1 +
.../org/apache/hadoop/tools/TestDistCpOptions.java | 13 +-
.../org/apache/hadoop/tools/TestDistCpSync.java | 79 ++++
.../org/apache/hadoop/tools/TestDistCpSystem.java | 43 ++
.../org/apache/hadoop/tools/TestOptionsParser.java | 14 +
.../yarn/api/protocolrecords/AllocateResponse.java | 38 ++
.../hadoop/yarn/api/records/EnhancedHeadroom.java | 72 +++
.../apache/hadoop/yarn/conf/YarnConfiguration.java | 20 +-
.../src/main/proto/yarn_service_protos.proto | 6 +
.../pom.xml | 4 +-
.../yarn/client/api/impl/AHSv2ClientImpl.java | 4 +-
.../yarn/client/api/impl/TestAHSv2ClientImpl.java | 70 +++
.../impl/pb/AllocateResponsePBImpl.java | 38 ++
.../records/impl/pb/EnhancedHeadroomPBImpl.java | 123 ++++++
.../src/main/resources/yarn-default.xml | 23 +-
.../apache/hadoop/yarn/api/TestPBImplRecords.java | 9 +
.../hadoop/yarn/csi/client/TestCsiClient.java | 11 +-
.../LocalityMulticastAMRMProxyPolicy.java | 12 +-
.../containermanager/container/ContainerImpl.java | 17 +-
.../AllocationBasedResourceUtilizationTracker.java | 58 ++-
.../scheduler/ContainerScheduler.java | 106 ++++-
.../OpportunisticContainersQueuePolicy.java | 46 ++
.../scheduler/ResourceUtilizationTracker.java | 7 +
.../BaseContainerSchedulerTest.java | 208 +++++++++
.../TestContainerManagerRecovery.java | 50 ++-
...ContainerSchedulerOppContainersByResources.java | 263 +++++++++++
.../scheduler/TestContainerSchedulerQueuing.java | 177 +-------
.../recovery/NMMemoryStateStoreService.java | 1 +
.../resourcemanager/DefaultAMSProcessor.java | 13 +
.../scheduler/AppSchedulingInfo.java | 31 +-
.../scheduler/SchedulerApplicationAttempt.java | 4 +-
.../scheduler/capacity/AbstractCSQueue.java | 2 +-
.../capacity/AutoCreatedQueueTemplate.java | 3 +-
.../scheduler/capacity/CapacityScheduler.java | 31 ++
.../capacity/CapacitySchedulerContext.java | 3 +-
.../capacity/CapacitySchedulerQueueContext.java | 7 +-
.../scheduler/capacity/ParentQueue.java | 22 +-
.../capacity/conf/YarnConfigurationStore.java | 1 +
.../GuaranteedOrZeroCapacityOverTimePolicy.java | 32 +-
.../scheduler/TestAppSchedulingInfo.java | 51 +++
.../TestAbsoluteResourceConfiguration.java | 61 +++
.../capacity/TestAutoCreatedQueueTemplate.java | 11 +
.../webapp/TestRMWebServicesCapacitySched.java | 2 +-
...estRMWebServicesCapacitySchedDynamicConfig.java | 16 +-
.../TestRMWebServicesSchedulerActivities.java | 4 +-
.../scheduler-response-NodeLabelDefaultAPI.xml | 491 ++++++++++++++++++++-
.../scheduler-response-PerUserResources.json | 487 +++++++++++++++++++-
.../webapp/scheduler-response-PerUserResources.xml | 490 +++++++++++++++++++-
.../test/resources/webapp/scheduler-response.json | 487 +++++++++++++++++++-
.../test/resources/webapp/scheduler-response.xml | 490 +++++++++++++++++++-
.../src/site/markdown/CapacityScheduler.md | 2 +-
.../hadoop-yarn/hadoop-yarn-ui/pom.xml | 4 +-
.../hadoop-yarn-ui/src/main/webapp/yarn.lock | 6 +-
212 files changed, 10748 insertions(+), 1291 deletions(-)
create mode 100644 dev-support/git-jira-validation/README.md
create mode 100644
dev-support/git-jira-validation/git_jira_fix_version_check.py
create mode 100644 dev-support/git-jira-validation/requirements.txt
create mode 100755 dev-support/hadoop-vote.sh
create mode 100644
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/impl/WeakReferenceThreadMap.java
create mode 100644
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/WeakReferenceMap.java
rename
hadoop-common-project/hadoop-common/src/site/markdown/release/3.2.2/{CHANGELOG.md
=> CHANGELOG.3.2.2.md} (100%)
rename
hadoop-common-project/hadoop-common/src/site/markdown/release/3.2.2/{RELEASENOTES.md
=> RELEASENOTES.3.2.2.md} (100%)
create mode 100644
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/http/TestProfileServlet.java
create mode 100644
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestWeakReferenceMap.java
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/LocatedBlocksRefresher.java
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/tools/hdfs-count-mock.cc
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/tools/hdfs-count-mock.h
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/tools/hdfs-mkdir-mock.cc
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/tools/hdfs-mkdir-mock.h
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/tools/hdfs-rm-mock.cc
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tests/tools/hdfs-rm-mock.h
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs-count/CMakeLists.txt
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs-count/hdfs-count.cc
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs-count/hdfs-count.h
copy
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/FsGetter.java
=>
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs-count/main.cc
(51%)
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs-mkdir/CMakeLists.txt
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs-mkdir/hdfs-mkdir.cc
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs-mkdir/hdfs-mkdir.h
copy
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/FsGetter.java
=>
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs-mkdir/main.cc
(51%)
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs-rm/CMakeLists.txt
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs-rm/hdfs-rm.cc
create mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs-rm/hdfs-rm.h
copy
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/FsGetter.java
=>
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs-rm/main.cc
(51%)
delete mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs_count.cc
delete mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs_mkdir.cc
delete mode 100644
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools/hdfs_rm.cc
create mode 100644
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/common/AutoCloseDataSetLock.java
create mode 100644
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/common/DataNodeLockManager.java
create mode 100644
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/common/NoLockManager.java
create mode 100644
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataSetLockManager.java
create mode 100644
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestLocatedBlocksRefresher.java
create mode 100644
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDataSetLockManager.java
create mode 100644
hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/audit/ITestAuditManagerDisabled.java
create mode 100644
hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/audit/MemoryHungryAuditor.java
create mode 100644
hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/audit/impl/TestActiveAuditManagerThreadLeakage.java
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/EnhancedHeadroom.java
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/EnhancedHeadroomPBImpl.java
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/scheduler/OpportunisticContainersQueuePolicy.java
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/BaseContainerSchedulerTest.java
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/scheduler/TestContainerSchedulerOppContainersByResources.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]