This is an automated email from the ASF dual-hosted git repository. jinglun pushed a change to branch HADOOP-19236 in repository https://gitbox.apache.org/repos/asf/hadoop.git
omit b68e862e71c HADOOP-19236. Incorporate VolcanoEngine Cloud TOS File System Implementation. add 464d7d97f9f HDFS-17668 Treat null SASL negotiated QOP as auth in DataTransferSasl… (#7171) add b55c9c7495a HADOOP-19349: S3A : Improve Client Side Encryption Documentation (#7191) add 2c2beb715d0 HADOOP-19358. Update command usage of appendToFile. (#7209) add 86d8fa6d518 HDFS-17679 Use saslClient#hasInitialResponse() instead of heuristics in SaslParticipant#createFirstMessage() (#7201) add 2b2acb028c7 HDFS-17682. Fix incorrect command of fs2img tool. (#7206). Contributed by fuchaohong. add 93a4dd02cf2 HDFS-17648. Fix BalancerMetrics duplicate registration issue. (#7133). Contributed by Zhaobo Huang. add de8b5061d89 HADOOP-19337. Fix ZKFailoverController NPE issue due to integer overflow in parseInt when initHM. (#7165). Contributed by ConfX. add 58896f0e135 HADOOP-19339. OutofBounds Exception due to assumption about buffer size in BlockCompressorStream. Contributed by ConfX. add aa5fe6f550c YARN-10058. Handle uncaught exception for async-scheduling threads to prevent scheduler hangs (#7129). Contributed by Tao Yang. add efb83ecbc34 HADOOP-19360. Disable releases for apache.snapshots repo (#7218) add fc42da70cea HADOOP-19357: [ABFS] Optimizations for Retry Handling and Client Side Throttling (#7216) add 626455653f5 YARN-11744. Tackle flaky test testGetRunningContainersToKill (#7227) Contributed by Cheng Pan. add 5fe4f134afe HADOOP-19366. Install OpenJDK 17 in default ubuntu build container (#7226) Contributed by Cheng Pan. add 7f491908020 YARN-7327: Enable asynchronous scheduling by default for capacity scheduler (#7138) add 6cb2e866a6c HADOOP-19367. Fix setting final field value on Java 17 (#7228) add f32a937511e HADOOP-19362. RPC metrics should be updated correctly when call is defered. (#7224). Contributed by hfutatzhanghb. add 3bf43b41441 HADOOP-19370. Fix error links of huaweicloud in site index. (#7229). Contributed by fuchaohong. add ecc4e00145f HADOOP-19371. JVM GC Metrics supports ZGC pause time and count (#7230) Contributed by cxzl25. add 71b3a6477b5 HADOOP-19335. Bump netty to 4.1.116 due to CVE-2024-47535 (#7158). Contributed by PJ Fanning add d5b836bc34e HDFS-17655. Cannot run HDFS balancer with BlockPlacementPolicyWithNodeGroup (#7141). Contributed by YUBI LEE. add 7e673584a12 HADOOP-19207: [ABFS][FNSOverBlob] Response Handling of Blob Endpoint APIs and Metadata APIs (#7210) add 305e3e73a91 HADOOP-19380. Update the year to 2025 (#7262). Contributed by Ayush Saxena. add 94d6a77c394 HDFS-17496. DataNode supports more fine-grained dataset lock based on blockid. (#6764). Contributed by farmmamba. add fd653fa9885 HADOOP-19376. Add fs.hdfs.impl.disable.cache to core-default.xml. (#7249) add fd4aa2a0d41 HDFS-17683. Add metrics for acquiring dataset read/write lock. (#7211). Contributed by farmmamba. add f65747d4596 YARN-11751. Remove TestAppLevelTimelineCollector. (#7271) Contributed by Shilun Fan. add 815ca41c69b HDFS-17080. fix ec connection leak. (#5807) add 22a9287e4a6 HDFS-17696. Optimize isBlockReplicatedOk method when scheduleReconStruction parameter is false (#7243) add fb1bb6429df HDFS-17695. Fix javadoc for FSDirectory#resolvePath method. (#7238) add a4872099908 HDFS-17602. RBF: Fix mount point with SPACE order can not find the available namespace. (#6991). Contributed by Zhongkun Wu. add d44ac28e326 HADOOP-19278. S3A: Remove option to delete directory markers (#7052) add f0ab1e69723 Revert "HDFS-17496. DataNode supports more fine-grained dataset lock based on…" (#7279) add 37bdf945d1a YARN-11743. Cgroup v2 support should fall back to v1 when there are no v2 controllers (#7222) add 1bd4835a3d1 HADOOP-19305: Fix ProcessEnvironment ClassCastException in Shell.java (#7106) Contributed by Butao Zhang. add d2095fae38e HADOOP-19382. [ABFS][FnsOverBlob] Test Fix for ITestAzureBlobFileSystemInitAndCreate failure (#7269) add c24d569a6e6 YARN-11752: Global Scheduler: Improve the container allocation time (#7277) Contributed by Syed Shameerur Rahman. add 266dad1617d HDFS-17706. TestBlockTokenWithDFSStriped fails due to closed streams. (#7275). Contribtued by Felix N. add c3e322860f7 HADOOP-19229. S3A/ABFS: Vector IO on cloud storage: increase threshold for range merging (#7281) add f38d7072566 HADOOP-19351. S3A: Add config option to skip test with performance mode (#7223) add 06d36f5a6a1 HADOOP-15984. Update jersey from 1.19 to 2.x. (#7019) add 9bf5e38c483 YARN-11745: Fix TimSort contract violation in PriorityQueueComparator Class (#7278) add 0d72896db16 YARN-11753. Ensure NM is marked unhealthy if the ProcessBuilder reports an issue with the container-executor (#7290) add 0432761ac84 HDFS-17657. The balancer service supports httpserver. (#7242) Contribtued by Zhaobo Huang. add e41f2ba1552 HADOOP-19392: Upgrade ftpserver to resolve maven/pom issue (#7311) Contributed by YanivKunda. add 8afbfbc2f57 HDFS-17394. [FGL] Remove unused WriteHoldCount of FSNamesystemLock (#6571) add 9b45c66e34f HDFS-17387. [FGL] Abstract the configuration locking mode (#6572) add 16c25b277da HDFS-17398. [FGL] Implement the FGL lock for FSNLockManager (#6599) add f0368bb2372 HDFS-17405. [FGL] Using different metric name to trace performance for FGL and Global lock (#6600) add a1ab911896f HDFS-17390. [FGL] FSDirectory supports this fine-grained locking (#6573) add 7158b9ee194 HDFS-17395. [FGL] Use FSLock to protect ErasureCodingPolicy related operations (#6579) add d39f034f982 HDFS-17413. [FGL] CacheReplicationMonitor supports fine-grained lock (#6641) add 7764b39e4ab HDFS-17414. [FGL] RPCs in DatanodeProtocol support fine-grained lock (#6649) add ac0605db419 HDFS-17416. [FGL] Monitor threads in BlockManager.class support fine-grained lock (#6647) add 3b5e28a87ec HDFS-17423. [FGL] BlockManagerSafeMode supports fine-grained lock (#6645) add 778e819b41a HDFS-17410. [FGL] Client RPCs that changes file attributes supports fine-grained lock (#6634) add 7d37995f46e HDFS-17415. [FGL] RPCs in NamenodeProtocol support fine-grained lock (#6654) add 40d54ebb66a HDFS-17417. [FGL] HeartbeatManager and DatanodeAdminMonitor support fine-grained locking (#6656) add 03603efd74b HDFS-17412. [FGL] Client RPCs involving maintenance supports fine-grained lock (#6667) add ed302ae3aad HDFS-17420. [FGL] EditLogTailer and FSEditLogLoader support FGL (#6679) add 7577f3ad619 HDFS-17388. [FGL] Client RPCs involving write process supports fine-grained lock (#6589) add 4c86601cba5 HDFS-17389. [FGL] Client RPCs involving read process supports fine-grained lock (#6590) add 6d888d599f4 HDFS-17411. [FGL] Client RPCs involving snapshot support fine-grained lock (#6714) add 02b149da67e HDFS-17445. [FGL] some operations support fine-grained locking (#6715) add e4885b02efc HDFS-17424. [FGL] DelegationTokenSecretManager supports fine-grained lock (#6696) add 0d626f516f4 HDFS-17472. [FGL] gcDeletedSnapshot and getDelegationToken support FGL (#6743) add e5b1c09b8a0 HDFS-17459. [FGL] Add documentation (#6737) add be0267313bd HDFS-17457. [FGL] UTs support fine-grained locking (#6741) add e8807726b8d HDFS-17506. [FGL] Performance for phase 1 add b289f9abd33 HDFS-17691. [FGL] Move FSNamesystemLockMode to org.apache.hadoop.hdfs.util package (#7232) add 16552b6fbdc HDFS-17692. [FGL] fix bug in getContentSummary method (#7233) add 8ab53982a56 HDFS-17697. [FGL] hasWriteLock and hasReadLock in FineGrainedFSNamesystemLock shouldn't throw assert error (#7250) add 2343bd71a93 HDFS-17701. [FGL] Fix some javadocs (#7256) add 7ce4ea57807 HDFS-17711: Change fsimage loading progress percentage discontinuous to continuous add 053afb7063f HDFS-17704. Fix TestDecommission and TestDecommissionWithBackoffMonitor often run timeout. (#7266). Contributed by hfutatzhanghb. add 4ad3f1f579a HADOOP-19389: Optimize shell -text command I/O with multi-byte read. (#7291) add 6cc743eac6f HADOOP-19397. Update LICENSE-binary with jersey 2 details (#7315). Contributed by PJ Fanning add 0698e8a2c40 HADOOP-19236. Incorporate VolcanoEngine Cloud TOS File System Implementation. (#7294) add 91867ed7554 HADOOP-19236. Incorporate VolcanoEngine Cloud TOS File System Implementation. This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (b68e862e71c) \ N -- N -- N refs/heads/HADOOP-19236 (91867ed7554) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: LICENSE-binary | 112 +- dev-support/docker/pkg-resolver/packages.json | 6 +- .../hadoop-client-check-invariants/pom.xml | 2 + .../resources/ensure-jars-have-correct-contents.sh | 6 +- .../hadoop-client-check-test-invariants/pom.xml | 1 + .../hadoop-client-integration-tests/pom.xml | 10 +- .../hadoop-client-minicluster/pom.xml | 106 +- .../hadoop-client-runtime/pom.xml | 26 +- hadoop-client-modules/hadoop-client/pom.xml | 76 - .../hadoop-cloud-storage/pom.xml | 12 - .../hadoop-huaweicloud/pom.xml | 6 + .../apache/hadoop/fs/obs/OBSBlockOutputStream.java | 2 +- .../org/apache/hadoop/fs/obs/OBSInputStream.java | 2 +- .../hadoop-tos/dev-support/findbugs-exclude.xml | 89 + .../hadoop-tos/hadoop-tos-core/pom.xml | 167 -- .../exceptions/ChecksumMismatchException.java | 16 - .../apache/hadoop/fs/tosfs/util/ParseUtils.java | 181 -- .../hadoop-tos/hadoop-tos-shade/pom.xml | 132 -- hadoop-cloud-storage-project/hadoop-tos/pom.xml | 134 +- .../hadoop-tos/src/main/assembly/hadoop-tos.xml | 43 + .../java/org/apache/hadoop/fs/tosfs/RawFS.java | 0 .../org/apache/hadoop/fs/tosfs/RawFSUtils.java | 10 +- .../org/apache/hadoop/fs/tosfs/RawFileStatus.java | 44 +- .../org/apache/hadoop/fs/tosfs/RawFileSystem.java | 104 +- .../hadoop/fs/tosfs/RawLocatedFileStatus.java | 0 .../org/apache/hadoop/fs/tosfs/TosChecksum.java | 0 .../java/org/apache/hadoop/fs/tosfs/TosFS.java | 0 .../org/apache/hadoop/fs/tosfs/TosFileSystem.java | 0 .../hadoop/fs/tosfs/commit/CommitContext.java | 0 .../apache/hadoop/fs/tosfs/commit/CommitUtils.java | 33 +- .../apache/hadoop/fs/tosfs/commit/Committer.java | 45 +- .../hadoop/fs/tosfs/commit/CommitterFactory.java | 0 .../hadoop/fs/tosfs/commit/MagicOutputStream.java | 19 +- .../org/apache/hadoop/fs/tosfs/commit/Pending.java | 32 +- .../apache/hadoop/fs/tosfs/commit/PendingSet.java | 0 .../apache/hadoop/fs/tosfs/commit/SuccessData.java | 41 +- .../hadoop/fs/tosfs/commit/mapred/Committer.java | 31 +- .../hadoop/fs/tosfs/commit/ops/PendingOps.java | 4 +- .../fs/tosfs/commit/ops/PendingOpsFactory.java | 2 +- .../hadoop/fs/tosfs/commit/ops/RawPendingOps.java | 3 + .../hadoop/fs/tosfs/commit/ops/package-info.java | 20 +- .../hadoop/fs/tosfs/commit/package-info.java | 20 +- .../org/apache/hadoop/fs/tosfs/common/Bytes.java | 85 +- .../org/apache/hadoop/fs/tosfs/common/Chain.java | 9 +- .../org/apache/hadoop/fs/tosfs/common/Tasks.java | 20 +- .../apache/hadoop/fs/tosfs/common/ThreadPools.java | 12 +- .../hadoop/fs/tosfs/common/package-info.java | 20 +- .../apache/hadoop/fs/tosfs/conf/ArgumentKey.java | 0 .../org/apache/hadoop/fs/tosfs/conf/ConfKeys.java | 4 +- .../apache/hadoop/fs/tosfs/conf/FileStoreKeys.java | 4 +- .../org/apache/hadoop/fs/tosfs/conf/TosKeys.java | 12 +- .../apache/hadoop/fs/tosfs/object/BucketInfo.java | 0 .../hadoop/fs/tosfs/object/ChecksumInfo.java | 0 .../hadoop/fs/tosfs/object/ChecksumType.java | 20 - .../apache/hadoop/fs/tosfs/object/Constants.java | 4 +- .../hadoop/fs/tosfs/object/DirectoryStorage.java | 0 .../apache/hadoop/fs/tosfs/object/FileStore.java | 55 +- .../fs/tosfs/object/InputStreamProvider.java | 0 .../hadoop/fs/tosfs/object/MultipartUpload.java | 0 .../hadoop/fs/tosfs/object/ObjectConstants.java | 2 +- .../hadoop/fs/tosfs/object/ObjectContent.java | 0 .../apache/hadoop/fs/tosfs/object/ObjectInfo.java | 2 +- .../tosfs/object/ObjectMultiRangeInputStream.java | 0 .../hadoop/fs/tosfs/object/ObjectOutputStream.java | 31 +- .../fs/tosfs/object/ObjectRangeInputStream.java | 3 +- .../hadoop/fs/tosfs/object/ObjectStorage.java | 15 +- .../fs/tosfs/object/ObjectStorageFactory.java | 8 +- .../apache/hadoop/fs/tosfs/object/ObjectUtils.java | 8 +- .../org/apache/hadoop/fs/tosfs/object/Part.java | 0 .../hadoop/fs/tosfs/object/PrefixStorage.java | 15 +- .../exceptions/ChecksumMismatchException.java} | 15 +- .../exceptions/InvalidObjectKeyException.java | 8 +- .../object/exceptions/NotAppendableException.java | 0 .../fs/tosfs/object/exceptions/package-info.java} | 13 +- .../hadoop/fs/tosfs/object/package-info.java} | 15 +- .../tosfs/object/request/ListObjectsRequest.java | 18 +- .../fs/tosfs/object/request/package-info.java | 20 +- .../tosfs/object/response/ListObjectsResponse.java | 0 .../fs/tosfs/object/response/package-info.java | 20 +- .../fs/tosfs/object/staging/FileStagingPart.java | 5 +- .../fs/tosfs/object/staging/StagingPart.java | 10 +- .../hadoop/fs/tosfs/object/staging/State.java | 0 .../fs/tosfs/object/staging/package-info.java | 20 +- .../fs/tosfs/object/tos/ChainTOSInputStream.java | 9 +- .../fs/tosfs/object/tos/DelegationClient.java | 536 ++--- .../tosfs/object/tos/DelegationClientBuilder.java | 20 +- .../fs/tosfs/object/tos/GetObjectOutput.java | 2 +- .../org/apache/hadoop/fs/tosfs/object/tos/TOS.java | 133 +- .../hadoop/fs/tosfs/object/tos/TOSErrorCodes.java | 7 +- .../hadoop/fs/tosfs/object/tos/TOSInputStream.java | 19 +- .../hadoop/fs/tosfs/object/tos/TOSUtils.java | 15 +- .../hadoop/fs/tosfs/object/tos/TosObjectInfo.java | 0 .../tos/auth/AbstractCredentialsProvider.java | 9 +- .../tosfs/object/tos/auth/CredentialsProvider.java | 2 +- .../tos/auth/DefaultCredentialsProviderChain.java | 9 +- .../tos/auth/EnvironmentCredentialsProvider.java | 0 .../object/tos/auth/ExpireableCredential.java | 6 +- .../object/tos/auth/SimpleCredentialsProvider.java | 4 +- .../fs/tosfs/object/tos/auth/package-info.java | 20 +- .../hadoop/fs/tosfs/object/tos/package-info.java | 20 +- .../apache/hadoop/fs/tosfs/ops/DefaultFsOps.java | 6 +- .../apache/hadoop/fs/tosfs/ops/DirectoryFsOps.java | 3 +- .../java/org/apache/hadoop/fs/tosfs/ops/FsOps.java | 3 + .../org/apache/hadoop/fs/tosfs/ops/RenameOp.java | 46 +- .../apache/hadoop/fs/tosfs/ops/package-info.java | 20 +- .../org/apache/hadoop/fs/tosfs/package-info.java | 20 +- .../apache/hadoop/fs/tosfs/util/CommonUtils.java | 2 + .../org/apache/hadoop/fs/tosfs/util/FSUtils.java | 12 +- .../org/apache/hadoop/fs/tosfs/util/FuseUtils.java | 2 +- .../org/apache/hadoop/fs/tosfs/util/Iterables.java | 2 + .../org/apache/hadoop/fs/tosfs/util/JsonCodec.java | 0 .../apache/hadoop/fs/tosfs/util/LazyReload.java | 0 .../hadoop/fs/tosfs/util/LazyReloadIter.java | 8 +- .../apache/hadoop/fs/tosfs/util/ParseUtils.java | 65 + .../org/apache/hadoop/fs/tosfs/util/Range.java | 19 +- .../org/apache/hadoop/fs/tosfs/util/Reload.java | 0 .../hadoop/fs/tosfs/util/RemoteIterators.java | 5 +- .../hadoop/fs/tosfs/util/RetryableUtils.java | 2 +- .../apache/hadoop/fs/tosfs/util/Serializer.java | 0 .../fs/tosfs/util/TOSClientContextUtils.java | 2 +- .../org/apache/hadoop/fs/tosfs/util/UUIDUtils.java | 2 +- .../apache/hadoop/fs/tosfs/util/package-info.java} | 13 +- .../src/site/markdown/cloud-storage/index.md | 28 +- .../java/org/apache/hadoop/fs/tosfs/TestEnv.java | 0 .../org/apache/hadoop/fs/tosfs/TestRawFSUtils.java | 0 .../apache/hadoop/fs/tosfs/TestRawFileSystem.java | 0 .../apache/hadoop/fs/tosfs/TestTosChecksum.java | 0 .../apache/hadoop/fs/tosfs/TestTosFileSystem.java | 0 .../hadoop/fs/tosfs/commit/BaseJobSuite.java | 0 .../hadoop/fs/tosfs/commit/CommitterTestBase.java | 0 .../apache/hadoop/fs/tosfs/commit/JobSuite.java | 0 .../hadoop/fs/tosfs/commit/MRJobTestBase.java | 9 +- .../hadoop/fs/tosfs/commit/TestCommitter.java | 0 .../apache/hadoop/fs/tosfs/commit/TestMRJob.java | 0 .../fs/tosfs/commit/TestMagicOutputStream.java | 0 .../fs/tosfs/commit/mapred/CommitterTestBase.java | 0 .../hadoop/fs/tosfs/commit/mapred/JobSuite.java | 0 .../fs/tosfs/commit/mapred/TestCommitter.java | 0 .../hadoop/fs/tosfs/contract/TestChecksum.java | 0 .../hadoop/fs/tosfs/contract/TestCreate.java | 0 .../hadoop/fs/tosfs/contract/TestDelete.java | 0 .../hadoop/fs/tosfs/contract/TestDistCp.java | 0 .../fs/tosfs/contract/TestGetFileStatus.java | 0 .../apache/hadoop/fs/tosfs/contract/TestMkdir.java | 0 .../apache/hadoop/fs/tosfs/contract/TestOpen.java | 0 .../hadoop/fs/tosfs/contract/TestRename.java | 0 .../hadoop/fs/tosfs/contract/TestRootDir.java | 0 .../apache/hadoop/fs/tosfs/contract/TestSeek.java | 0 .../hadoop/fs/tosfs/contract/TestUnbuffer.java | 0 .../apache/hadoop/fs/tosfs/contract/TestXAttr.java | 0 .../hadoop/fs/tosfs/contract/TosContract.java | 0 .../fs/tosfs/object/ObjectStorageTestBase.java | 0 .../hadoop/fs/tosfs/object/ObjectTestUtils.java | 0 .../fs/tosfs/object/TestDirectoryStorage.java | 0 .../object/TestObjectMultiRangeInputStream.java | 0 .../fs/tosfs/object/TestObjectOutputStream.java | 0 .../tosfs/object/TestObjectRangeInputStream.java | 0 .../hadoop/fs/tosfs/object/TestObjectStorage.java | 2 +- .../tosfs/object/tos/TestChainTOSInputStream.java | 4 +- .../object/tos/TestDelegationClientBuilder.java | 28 +- .../fs/tosfs/object/tos/TestTOSInputStream.java | 6 +- .../fs/tosfs/object/tos/TestTOSObjectStorage.java | 2 +- .../fs/tosfs/object/tos/TestTOSRetryPolicy.java | 14 +- .../tos/auth/TestAbstractCredentialsProvider.java | 0 .../auth/TestDefaultCredentialsProviderChain.java | 2 +- .../auth/TestEnvironmentCredentialsProvider.java | 0 .../tos/auth/TestSimpleCredentialsProvider.java | 2 +- .../apache/hadoop/fs/tosfs/ops/TestBaseFsOps.java | 0 .../apache/hadoop/fs/tosfs/ops/TestBaseOps.java | 0 .../hadoop/fs/tosfs/ops/TestDefaultFsOps.java | 0 .../hadoop/fs/tosfs/ops/TestDirectoryFsOps.java | 0 .../apache/hadoop/fs/tosfs/ops/TestRenameOp.java | 0 .../org/apache/hadoop/fs/tosfs/util/TempFiles.java | 0 .../apache/hadoop/fs/tosfs/util/TestFSUtils.java | 0 .../apache/hadoop/fs/tosfs/util/TestIterables.java | 0 .../hadoop/fs/tosfs/util/TestLazyReload.java | 0 .../org/apache/hadoop/fs/tosfs/util/TestRange.java | 0 .../apache/hadoop/fs/tosfs/util/TestUtility.java | 0 .../src/test/resources/contract/tos.xml | 2 +- .../src/test/resources/core-site.xml | 4 +- .../src/test/resources/log4j.properties | 0 hadoop-common-project/hadoop-auth-examples/pom.xml | 4 +- hadoop-common-project/hadoop-auth/pom.xml | 4 +- hadoop-common-project/hadoop-common/pom.xml | 97 +- .../org/apache/hadoop/fs/PositionedReadable.java | 7 +- .../java/org/apache/hadoop/fs/shell/Display.java | 167 +- .../org/apache/hadoop/ha/ZKFailoverController.java | 7 +- .../java/org/apache/hadoop/http/HttpServer2.java | 34 +- .../src/main/java/org/apache/hadoop/io/Sizes.java | 94 + .../hadoop/io/compress/BlockCompressorStream.java | 6 +- .../org/apache/hadoop/ipc/ProtobufRpcEngine.java | 26 +- .../org/apache/hadoop/ipc/ProtobufRpcEngine2.java | 24 +- .../main/java/org/apache/hadoop/ipc/Server.java | 55 +- .../apache/hadoop/metrics2/source/JvmMetrics.java | 7 + .../main/java/org/apache/hadoop/util/Shell.java | 4 +- .../src/main/resources/core-default.xml | 11 + .../src/site/markdown/FileSystemShell.md | 8 +- .../hadoop-common/src/site/markdown/Metrics.md | 4 + .../hadoop/conf/TestCommonConfigurationFields.java | 1 + .../apache/hadoop/fs/ftp/TestFTPFileSystem.java | 8 +- .../apache/hadoop/fs/shell/TestTextCommand.java | 565 ++++-- .../org/apache/hadoop/http/TestHttpServer.java | 18 +- .../org/apache/hadoop/http/TestHttpServerLogs.java | 9 +- .../hadoop/ipc/TestProtoBufRpcServerHandoff.java | 58 +- .../org/apache/hadoop/test/ReflectionUtils.java | 25 + hadoop-common-project/hadoop-kms/pom.xml | 15 +- .../hadoop-kms/src/main/conf/kms-log4j.properties | 1 - .../apache/hadoop/crypto/key/kms/server/KMS.java | 14 +- .../key/kms/server/KMSExceptionsProvider.java | 2 +- .../src/main/resources/webapps/kms/WEB-INF/web.xml | 16 +- .../hadoop/crypto/key/kms/server/TestKMS.java | 4 +- .../hadoop-kms/src/test/resources/log4j.properties | 2 - hadoop-common-project/hadoop-nfs/pom.xml | 4 +- hadoop-hdfs-project/hadoop-hdfs-client/pom.xml | 5 + .../java/org/apache/hadoop/hdfs/StripeReader.java | 40 +- .../datatransfer/sasl/DataTransferSaslUtil.java | 9 +- .../datatransfer/sasl/SaslParticipant.java | 9 +- hadoop-hdfs-project/hadoop-hdfs-httpfs/pom.xml | 11 +- .../fs/http/server/HttpFSExceptionProvider.java | 2 +- .../fs/http/server/HttpFSParametersProvider.java | 2 - .../apache/hadoop/fs/http/server/HttpFSServer.java | 45 +- .../apache/hadoop/lib/wsrs/JSONMapProvider.java | 14 +- .../apache/hadoop/lib/wsrs/ParametersProvider.java | 67 +- .../main/resources/webapps/webhdfs/WEB-INF/web.xml | 18 +- .../src/main/webapp/WEB-INF/web.xml | 18 +- .../hadoop/fs/http/server/TestHttpFSServer.java | 3 +- .../src/test/resources/default-log4j.properties | 1 - hadoop-hdfs-project/hadoop-hdfs-nfs/pom.xml | 10 +- .../hadoop/hdfs/nfs/nfs3/Nfs3HttpServer.java | 2 +- hadoop-hdfs-project/hadoop-hdfs-rbf/pom.xml | 5 + .../resolver/order/AvailableSpaceResolver.java | 7 +- .../server/federation/router/RouterHttpServer.java | 2 +- .../federation/router/RouterWebHdfsMethods.java | 3 - .../resolver/order/TestAvailableSpaceResolver.java | 8 + .../server/federation/router/TestRouterRpc.java | 5 +- hadoop-hdfs-project/hadoop-hdfs/pom.xml | 28 +- .../java/org/apache/hadoop/hdfs/DFSConfigKeys.java | 21 + .../main/java/org/apache/hadoop/hdfs/DFSUtil.java | 4 +- .../qjournal/server/JournalNodeHttpServer.java | 2 +- .../delegation/DelegationTokenSecretManager.java | 9 +- .../hadoop/hdfs/server/balancer/Balancer.java | 61 +- .../hdfs/server/balancer/BalancerHttpServer.java | 114 ++ .../hdfs/server/balancer/BalancerMXBean.java | 30 +- .../hadoop/hdfs/server/balancer/package-info.java | 14 +- .../hdfs/server/blockmanagement/BlockManager.java | 122 +- .../blockmanagement/BlockManagerSafeMode.java | 33 +- .../blockmanagement/CacheReplicationMonitor.java | 13 +- .../DatanodeAdminBackoffMonitor.java | 55 +- .../DatanodeAdminDefaultMonitor.java | 26 +- .../blockmanagement/DatanodeAdminMonitorBase.java | 18 + .../server/blockmanagement/DatanodeManager.java | 12 +- .../server/blockmanagement/HeartbeatManager.java | 9 +- .../server/blockmanagement/ProvidedStorageMap.java | 5 +- .../hadoop/hdfs/server/datanode/DataNode.java | 4 +- .../hdfs/server/datanode/DataSetLockManager.java | 21 +- .../server/datanode/metrics/DataNodeMetrics.java | 12 + .../datanode/web/webhdfs/ExceptionHandler.java | 4 +- .../hadoop/hdfs/server/namenode/BackupImage.java | 5 +- .../hadoop/hdfs/server/namenode/CacheManager.java | 33 +- .../hadoop/hdfs/server/namenode/Checkpointer.java | 10 +- .../namenode/ContentSummaryComputationContext.java | 12 +- .../server/namenode/EncryptionZoneManager.java | 14 +- .../hadoop/hdfs/server/namenode/FSDirAppendOp.java | 5 +- .../hadoop/hdfs/server/namenode/FSDirDeleteOp.java | 4 +- .../server/namenode/FSDirEncryptionZoneOp.java | 15 +- .../hdfs/server/namenode/FSDirErasureCodingOp.java | 17 +- .../namenode/FSDirSatisfyStoragePolicyOp.java | 3 +- .../server/namenode/FSDirStatAndListingOp.java | 25 +- .../hdfs/server/namenode/FSDirTruncateOp.java | 9 +- .../hdfs/server/namenode/FSDirWriteFileOp.java | 46 +- .../hadoop/hdfs/server/namenode/FSDirectory.java | 31 +- .../hdfs/server/namenode/FSEditLogLoader.java | 9 +- .../hdfs/server/namenode/FSImageFormatPBINode.java | 5 +- .../hadoop/hdfs/server/namenode/FSNamesystem.java | 672 ++++--- .../hdfs/server/namenode/FSNamesystemLock.java | 44 +- .../hdfs/server/namenode/FSPermissionChecker.java | 15 +- .../hdfs/server/namenode/FSTreeTraverser.java | 7 +- .../hdfs/server/namenode/FsImageValidation.java | 5 +- .../hadoop/hdfs/server/namenode/INodeFile.java | 6 + .../hadoop/hdfs/server/namenode/LeaseManager.java | 15 +- .../hadoop/hdfs/server/namenode/NameNode.java | 25 +- .../hdfs/server/namenode/NameNodeHttpServer.java | 29 +- .../hadoop/hdfs/server/namenode/NamenodeFsck.java | 10 +- .../hdfs/server/namenode/ReencryptionHandler.java | 11 +- .../hdfs/server/namenode/ReencryptionUpdater.java | 7 +- .../hdfs/server/namenode/SecondaryNameNode.java | 7 +- .../hdfs/server/namenode/fgl/FSNLockManager.java | 187 ++ .../namenode/fgl/FineGrainedFSNamesystemLock.java | 285 +++ .../namenode/fgl/GlobalFSNamesystemLock.java | 150 ++ .../hdfs/server/namenode/fgl/package-info.java | 7 +- .../hdfs/server/namenode/ha/EditLogTailer.java | 5 +- .../namenode/snapshot/SnapshotDeletionGc.java | 5 +- .../web/resources/NamenodeWebHdfsMethods.java | 285 ++- .../java/org/apache/hadoop/hdfs/util/RwLock.java | 106 +- .../org/apache/hadoop/hdfs/util/RwLockMode.java | 14 +- .../org/apache/hadoop/hdfs/web/ParamFilter.java | 103 +- .../hdfs/web/resources/ExceptionHandler.java | 11 +- .../hdfs/web/resources/TokenServiceParam.java | 2 - .../hadoop/hdfs/web/resources/UserProvider.java | 35 +- .../src/main/resources/hdfs-default.xml | 63 + .../src/main/webapps/balancer/balancer.html | 114 ++ .../src/main/webapps/balancer/balancer.js | 95 + .../src/main/webapps/balancer/index.html | 24 + .../main/webapps/{datanode => balancer}/robots.txt | 0 .../src/site/markdown/HdfsProvidedStorage.md | 2 +- .../hadoop-hdfs/src/site/markdown/NamenodeFGL.md | 210 ++ .../apache/hadoop/hdfs/AdminStatesBaseTest.java | 4 + .../hadoop/hdfs/TestBlocksScheduledCounter.java | 11 +- .../org/apache/hadoop/hdfs/TestDecommission.java | 51 +- .../org/apache/hadoop/hdfs/TestFileCorruption.java | 13 +- .../org/apache/hadoop/hdfs/TestFileCreation.java | 20 +- .../apache/hadoop/hdfs/TestMaintenanceState.java | 50 +- .../hdfs/TestStoragePolicyPermissionSettings.java | 24 +- .../hadoop/hdfs/server/balancer/TestBalancer.java | 19 + .../server/balancer/TestBalancerHttpServer.java | 100 + .../balancer/TestBalancerLongRunningTasks.java | 60 + .../hdfs/server/balancer/TestBalancerService.java | 51 + .../blockmanagement/BlockManagerTestUtil.java | 22 +- .../server/blockmanagement/TestBlockManager.java | 15 +- .../blockmanagement/TestBlockManagerSafeMode.java | 3 + .../blockmanagement/TestBlockTokenWithDFS.java | 3 + .../TestBlocksWithNotEnoughRacks.java | 5 +- .../blockmanagement/TestComputeInvalidateWork.java | 25 +- .../blockmanagement/TestDatanodeManager.java | 15 +- .../blockmanagement/TestHeartbeatHandling.java | 9 +- .../TestNameNodePrunesMissingStorages.java | 10 +- .../hdfs/server/blockmanagement/TestNodeCount.java | 5 +- .../blockmanagement/TestOverReplicatedBlocks.java | 9 +- .../blockmanagement/TestPendingReconstruction.java | 17 +- .../blockmanagement/TestProvidedStorageMap.java | 3 +- ...tReconstructStripedBlocksWithRackAwareness.java | 10 +- .../blockmanagement/TestReplicationPolicy.java | 8 + .../TestReplicationPolicyConsiderLoad.java | 10 +- .../TestReplicationPolicyExcludeSlowNodes.java | 11 +- ...licationPolicyRatioConsiderLoadWithStorage.java | 6 +- .../hdfs/server/datanode/TestDataNodeMetrics.java | 20 + .../hdfs/server/namenode/NameNodeAdapter.java | 17 +- .../hdfs/server/namenode/TestAddBlockRetry.java | 14 +- .../TestAddOverReplicatedStripedBlocks.java | 6 +- .../TestBlockPlacementPolicyRackFaultTolerant.java | 6 +- .../hdfs/server/namenode/TestCacheDirectives.java | 17 +- .../hdfs/server/namenode/TestDeleteRace.java | 5 +- .../server/namenode/TestDiskspaceQuotaUpdate.java | 5 +- .../hdfs/server/namenode/TestEditLogRace.java | 6 +- .../server/namenode/TestFSImageWithSnapshot.java | 9 +- .../hdfs/server/namenode/TestFSNamesystem.java | 5 +- .../hdfs/server/namenode/TestFSNamesystemLock.java | 20 +- .../server/namenode/TestFSNamesystemMBean.java | 7 +- .../hdfs/server/namenode/TestFileTruncate.java | 9 +- .../hadoop/hdfs/server/namenode/TestFsck.java | 9 +- .../server/namenode/TestGetBlockLocations.java | 14 +- .../server/namenode/TestLargeDirectoryDelete.java | 5 +- .../hdfs/server/namenode/TestLeaseManager.java | 5 + .../hdfs/server/namenode/TestListOpenFiles.java | 5 +- .../namenode/TestNameNodeMetadataConsistency.java | 11 +- .../namenode/TestReconstructStripedBlocks.java | 5 +- .../server/namenode/TestSecurityTokenEditLog.java | 5 +- .../namenode/fgl/FSNLockBenchmarkThroughput.java | 322 +++ .../fgl/TestFSNLockBenchmarkThroughput.java | 104 + .../fgl/TestFineGrainedFSNamesystemLock.java | 276 +++ .../hdfs/server/namenode/ha/TestDNFencing.java | 5 +- .../namenode/metrics/TestNameNodeMetrics.java | 13 +- ...TestINodeFileUnderConstructionWithSnapshot.java | 5 +- .../org/apache/hadoop/hdfs/tools/TestDFSAdmin.java | 5 +- .../hdfs/web/TestWebHdfsFileSystemContract.java | 10 +- .../src/test/resources/log4j.properties | 4 - .../hadoop-mapreduce-client-app/pom.xml | 44 + .../jobhistory/JobHistoryEventHandler.java | 8 +- .../mapreduce/v2/app/client/MRClientService.java | 28 +- .../hadoop/mapreduce/v2/app/webapp/AMWebApp.java | 19 +- .../mapreduce/v2/app/webapp/AMWebServices.java | 11 +- .../apache/hadoop/mapreduce/v2/app/webapp/App.java | 7 +- .../v2/app/webapp/JAXBContextResolver.java | 15 +- .../mapreduce/v2/app/webapp/TestAMWebApp.java | 45 +- .../mapreduce/v2/app/webapp/TestAMWebServices.java | 245 ++- .../v2/app/webapp/TestAMWebServicesAttempt.java | 145 +- .../v2/app/webapp/TestAMWebServicesAttempts.java | 246 ++- .../v2/app/webapp/TestAMWebServicesJobConf.java | 124 +- .../v2/app/webapp/TestAMWebServicesJobs.java | 434 ++-- .../v2/app/webapp/TestAMWebServicesTasks.java | 427 ++-- .../hadoop-mapreduce-client-common/pom.xml | 5 + .../hadoop-mapreduce-client-core/pom.xml | 20 + .../org/apache/hadoop/mapred/LineRecordReader.java | 7 +- .../hadoop-mapreduce-client-hs/pom.xml | 30 + .../mapreduce/v2/hs/HistoryClientService.java | 38 + .../hadoop/mapreduce/v2/hs/webapp/HsWebApp.java | 4 - .../mapreduce/v2/hs/webapp/HsWebServices.java | 34 +- .../v2/hs/webapp/JAXBContextResolver.java | 10 +- .../mapreduce/v2/hs/webapp/TestHsWebServices.java | 253 ++- .../v2/hs/webapp/TestHsWebServicesAttempts.java | 257 ++- .../v2/hs/webapp/TestHsWebServicesJobConf.java | 120 +- .../v2/hs/webapp/TestHsWebServicesJobs.java | 468 ++--- .../v2/hs/webapp/TestHsWebServicesJobsQuery.java | 471 +++-- .../v2/hs/webapp/TestHsWebServicesLogs.java | 398 ++-- .../v2/hs/webapp/TestHsWebServicesLogsExtend.java | 399 ++++ .../v2/hs/webapp/TestHsWebServicesTasks.java | 446 ++--- .../reader/ContainerLogsInfoMessageBodyReader.java | 103 + .../reader/RemoteLogPathsMessageBodyReader.java | 88 + .../hadoop-mapreduce-client-jobclient/pom.xml | 21 + .../hadoop-mapreduce-client-nativetask/pom.xml | 20 + .../hadoop-mapreduce-client-shuffle/pom.xml | 5 + .../hadoop-mapreduce-client/pom.xml | 9 +- .../hadoop-mapreduce-examples/pom.xml | 9 +- hadoop-project/pom.xml | 209 +- hadoop-project/src/site/site.xml | 2 +- hadoop-tools/hadoop-archive-logs/pom.xml | 20 + hadoop-tools/hadoop-archives/pom.xml | 20 + hadoop-tools/hadoop-aws/pom.xml | 73 +- .../java/org/apache/hadoop/fs/s3a/Constants.java | 40 +- .../java/org/apache/hadoop/fs/s3a/Listing.java | 49 +- .../org/apache/hadoop/fs/s3a/S3AFileSystem.java | 194 +- .../java/org/apache/hadoop/fs/s3a/S3AUtils.java | 1 - .../apache/hadoop/fs/s3a/WriteOperationHelper.java | 25 +- .../fs/s3a/auth/CredentialProviderListFactory.java | 4 - .../fs/s3a/commit/impl/CommitOperations.java | 2 +- .../fs/s3a/commit/magic/S3MagicCommitTracker.java | 4 +- .../hadoop/fs/s3a/impl/DirMarkerTracker.java | 26 - .../apache/hadoop/fs/s3a/impl/DirectoryPolicy.java | 110 -- .../hadoop/fs/s3a/impl/DirectoryPolicyImpl.java | 212 -- .../apache/hadoop/fs/s3a/impl/MkdirOperation.java | 15 +- .../hadoop/fs/s3a/impl/PutObjectOptions.java | 38 +- .../hadoop/fs/s3a/impl/S3AMultipartUploader.java | 2 +- .../org/apache/hadoop/fs/s3a/s3guard/S3Guard.java | 6 - .../apache/hadoop/fs/s3a/s3guard/S3GuardTool.java | 67 +- .../org/apache/hadoop/fs/s3a/tools/MarkerTool.java | 93 +- .../hadoop/fs/s3native/NativeS3FileSystem.java | 148 -- .../apache/hadoop/fs/s3native/S3xLoginHelper.java | 87 +- .../services/org.apache.hadoop.fs.FileSystem | 16 - .../markdown/tools/hadoop-aws/assumed_roles.md | 11 +- .../markdown/tools/hadoop-aws/directory_markers.md | 466 +---- .../site/markdown/tools/hadoop-aws/encryption.md | 31 +- .../src/site/markdown/tools/hadoop-aws/index.md | 8 +- .../site/markdown/tools/hadoop-aws/performance.md | 10 +- .../src/site/markdown/tools/hadoop-aws/s3guard.md | 7 +- .../src/site/markdown/tools/hadoop-aws/s3n.md | 52 - .../src/site/markdown/tools/hadoop-aws/testing.md | 63 +- .../fs/contract/s3a/ITestS3AContractCreate.java | 5 + .../s3a/ITestS3AContractMkdirWithCreatePerf.java | 4 + .../contract/s3a/ITestS3AContractVectoredRead.java | 29 +- .../apache/hadoop/fs/s3a/AbstractS3ATestBase.java | 51 - .../hadoop/fs/s3a/ITestDowngradeSyncable.java | 5 - .../fs/s3a/ITestS3AClientSideEncryption.java | 2 +- .../hadoop/fs/s3a/ITestS3AFileOperationCost.java | 31 +- .../hadoop/fs/s3a/ITestS3AMiscOperations.java | 2 +- .../fs/s3a/ITestS3APrefetchingCacheFiles.java | 4 - .../fs/s3a/ITestS3APrefetchingInputStream.java | 4 - .../fs/s3a/ITestS3APrefetchingLruEviction.java | 1 - .../apache/hadoop/fs/s3a/MockS3AFileSystem.java | 8 - .../apache/hadoop/fs/s3a/MultipartTestUtils.java | 2 +- .../org/apache/hadoop/fs/s3a/S3ATestConstants.java | 11 +- .../org/apache/hadoop/fs/s3a/S3ATestUtils.java | 10 +- .../hadoop/fs/s3a/TestS3ABlockOutputStream.java | 2 +- .../fs/s3a/audit/ITestAuditAccessChecks.java | 4 - .../hadoop/fs/s3a/audit/ITestAuditManager.java | 4 - .../fs/s3a/audit/ITestAuditManagerDisabled.java | 4 - .../fs/s3a/commit/ITestCommitOperationCost.java | 45 +- .../fs/s3a/impl/ITestPartialRenamesDeletes.java | 4 - .../hadoop/fs/s3a/impl/ITestRenameDeleteRace.java | 23 +- .../apache/hadoop/fs/s3a/impl/ITestXAttrCost.java | 4 - .../fs/s3a/impl/TestDirectoryMarkerPolicy.java | 163 -- .../hadoop/fs/s3a/impl/TestRequestFactory.java | 6 +- .../fs/s3a/performance/AbstractS3ACostTest.java | 91 +- .../fs/s3a/performance/ITestCreateFileCost.java | 6 +- .../performance/ITestDirectoryMarkerListing.java | 82 +- .../fs/s3a/performance/ITestS3ADeleteCost.java | 105 +- .../s3a/performance/ITestS3AMiscOperationCost.java | 7 +- .../fs/s3a/performance/ITestS3AMkdirCost.java | 23 - .../fs/s3a/performance/ITestS3AOpenCost.java | 4 - .../fs/s3a/performance/ITestS3ARenameCost.java | 52 +- .../fs/s3a/performance/ITestUnbufferDraining.java | 7 - .../s3a/s3guard/AbstractS3GuardToolTestBase.java | 6 +- .../fs/s3a/s3guard/TestAuthoritativePath.java | 132 -- .../fs/s3a/scale/ITestS3ADirectoryPerformance.java | 9 +- .../test/MinimalWriteOperationHelperCallbacks.java | 7 - .../fs/s3a/tools/AbstractMarkerToolTest.java | 95 +- .../hadoop/fs/s3a/tools/ITestMarkerTool.java | 172 +- .../hadoop/fs/s3native/TestS3xLoginHelper.java | 205 -- hadoop-tools/hadoop-azure-datalake/pom.xml | 21 + hadoop-tools/hadoop-azure/pom.xml | 25 +- .../hadoop/fs/azurebfs/AbfsConfiguration.java | 45 +- .../hadoop/fs/azurebfs/AzureBlobFileSystem.java | 52 +- .../fs/azurebfs/AzureBlobFileSystemStore.java | 78 +- .../fs/azurebfs/constants/AbfsHttpConstants.java | 35 + .../fs/azurebfs/constants/FSOperationType.java | 3 +- .../constants/FileSystemConfigurations.java | 8 +- .../azurebfs/constants/FileSystemUriSchemes.java | 4 +- .../fs/azurebfs/constants/HttpQueryParams.java | 5 + .../services/BlobListResultEntrySchema.java | 238 +++ .../contracts/services/BlobListResultSchema.java | 71 + .../contracts/services/BlobListXmlParser.java | 304 +++ ...rySchema.java => DfsListResultEntrySchema.java} | 48 +- ...tResultSchema.java => DfsListResultSchema.java} | 21 +- .../contracts/services/ListResultEntrySchema.java | 218 +-- .../contracts/services/ListResultSchema.java | 29 +- .../services/StorageErrorResponseSchema.java | 62 + .../fs/azurebfs/services/AbfsAHCHttpOperation.java | 32 +- .../fs/azurebfs/services/AbfsBlobClient.java | 481 ++++- .../hadoop/fs/azurebfs/services/AbfsClient.java | 67 +- .../services/AbfsClientThrottlingIntercept.java | 2 + .../hadoop/fs/azurebfs/services/AbfsDfsClient.java | 193 +- .../fs/azurebfs/services/AbfsHttpOperation.java | 283 ++- .../fs/azurebfs/services/AbfsInputStream.java | 14 + .../fs/azurebfs/services/AbfsJdkHttpOperation.java | 12 +- .../fs/azurebfs/services/AbfsRestOperation.java | 31 +- .../fs/azurebfs/services/ListingSupport.java | 2 +- .../apache/hadoop/fs/azurebfs/utils/UriUtils.java | 29 +- .../apache/hadoop/fs/azurebfs/ITestAbfsClient.java | 6 +- .../azurebfs/ITestAzureBlobFileSystemCreate.java | 22 +- .../azurebfs/ITestAzureBlobFileSystemDelete.java | 10 +- .../ITestAzureBlobFileSystemInitAndCreate.java | 11 +- .../ITestAzureBlobFileSystemListStatus.java | 10 +- .../extensions/MockDelegationSASTokenProvider.java | 2 +- .../fs/azurebfs/services/ITestAbfsClient.java | 109 +- .../services/ITestAbfsPaginatedDelete.java | 3 +- .../services/ITestExponentialRetryPolicy.java | 18 + .../fs/azurebfs/services/TestAbfsPerfTracker.java | 18 +- .../hadoop/fs/azurebfs/utils/TestMockHelpers.java | 59 - .../hadoop/fs/azurebfs/utils/TestUriUtils.java | 60 + hadoop-tools/hadoop-datajoin/pom.xml | 20 + hadoop-tools/hadoop-distcp/pom.xml | 20 + .../hadoop-dynamometer-blockgen/pom.xml | 20 + .../hadoop-dynamometer-infra/pom.xml | 20 + .../hadoop-dynamometer-workload/pom.xml | 20 + hadoop-tools/hadoop-extras/pom.xml | 20 + hadoop-tools/hadoop-federation-balance/pom.xml | 20 + hadoop-tools/hadoop-fs2img/pom.xml | 20 + .../namenode/ITestProvidedImplementation.java | 13 +- hadoop-tools/hadoop-gridmix/pom.xml | 20 + hadoop-tools/hadoop-resourceestimator/pom.xml | 53 +- .../service/ResourceEstimatorService.java | 33 +- .../service/GuiceServletConfig.java | 42 - .../service/TestResourceEstimatorService.java | 69 +- hadoop-tools/hadoop-rumen/pom.xml | 20 + hadoop-tools/hadoop-sls/pom.xml | 20 + hadoop-tools/hadoop-streaming/pom.xml | 20 + .../hadoop-yarn/hadoop-yarn-api/pom.xml | 4 +- .../api/records/timeline/TimelineEntities.java | 2 + .../yarn/api/records/timeline/TimelineEntity.java | 11 +- .../yarn/api/records/timeline/TimelineEvent.java | 2 + .../yarn/api/records/timeline/TimelineEvents.java | 5 +- .../api/records/timeline/TimelinePutResponse.java | 7 + .../timeline/reader/TimelineDomainReader.java | 57 + .../timeline/reader/TimelineEntitiesReader.java | 57 + .../timeline/reader/TimelinePutResponseReader.java | 58 + .../api/records/timeline/reader/package-info.java} | 10 +- .../timeline/writer/TimelineDomainWriter.java | 65 + .../timeline/writer/TimelineDomainsWriter.java | 65 + .../timeline/writer/TimelineEntitiesWriter.java | 65 + .../timeline/writer/TimelineEntityWriter.java | 65 + .../timeline/writer/TimelineEventsWriter.java | 66 + .../timeline/writer/TimelinePutResponseWriter.java | 66 + .../api/records/timeline/writer/package-info.java} | 10 +- .../records/timelineservice/TimelineEntities.java | 2 + .../records/timelineservice/TimelineEntity.java | 6 + .../api/records/timelineservice/TimelineEvent.java | 3 + .../records/timelineservice/TimelineMetric.java | 12 +- .../reader/TimelineDomainReader.java | 57 + .../reader/TimelineEntitiesReader.java | 57 + .../reader/TimelineEntityReader.java | 57 + .../timelineservice/reader/package-info.java} | 10 +- .../writer/TimelineDomainWriter.java | 65 + .../writer/TimelineEntitiesWriter.java | 65 + .../writer/TimelineEntitySetWriter.java | 67 + .../writer/TimelineEntityWriter.java | 67 + .../writer/TimelineHealthWriter.java | 66 + .../timelineservice/writer/package-info.java} | 10 +- .../pom.xml | 23 - .../appcatalog/application/YarnServiceClient.java | 80 +- .../src/main/webapp/WEB-INF/web.xml | 8 +- .../pom.xml | 17 + .../distributedshell/ApplicationMaster.java | 10 +- .../distributedshell/TestDSTimelineV10.java | 37 +- .../hadoop-yarn-services-api/pom.xml | 10 +- .../yarn/service/client/ApiServiceClient.java | 110 +- .../src/main/webapp/WEB-INF/web.xml | 8 +- .../apache/hadoop/yarn/service/TestApiServer.java | 53 +- .../hadoop-yarn-services-core/pom.xml | 20 +- .../hadoop/yarn/service/ServiceScheduler.java | 14 +- .../apache/hadoop/yarn/service/utils/HttpUtil.java | 13 +- .../hadoop/yarn/service/ServiceTestUtils.java | 21 +- .../hadoop-yarn/hadoop-yarn-client/pom.xml | 17 +- .../org/apache/hadoop/yarn/client/cli/LogsCLI.java | 268 ++- .../hadoop/yarn/client/cli/SchedConfCLI.java | 138 +- .../apache/hadoop/yarn/client/cli/TestLogsCLI.java | 23 +- .../hadoop/yarn/client/cli/TestSchedConfCLI.java | 114 +- .../hadoop-yarn/hadoop-yarn-common/pom.xml | 74 +- .../yarn/client/api/impl/DirectTimelineWriter.java | 9 +- .../client/api/impl/FileSystemTimelineWriter.java | 8 +- .../yarn/client/api/impl/TimelineClientImpl.java | 12 +- .../yarn/client/api/impl/TimelineConnector.java | 223 +-- .../client/api/impl/TimelineReaderClientImpl.java | 90 +- .../yarn/client/api/impl/TimelineV2ClientImpl.java | 85 +- .../yarn/client/api/impl/TimelineWriter.java | 64 +- .../hadoop/yarn/logaggregation/LogToolUtils.java | 16 +- .../hadoop/yarn/webapp/ConflictException.java} | 37 +- .../yarn/webapp/GenericExceptionHandler.java | 29 +- .../java/org/apache/hadoop/yarn/webapp/WebApp.java | 32 +- .../org/apache/hadoop/yarn/webapp/WebApps.java | 39 +- .../yarn/webapp/YarnJacksonJaxbJsonProvider.java | 2 +- .../hadoop/yarn/webapp/util/WebAppUtils.java | 16 + .../hadoop/yarn/webapp/util/WebServiceClient.java | 52 +- .../yarn/webapp/util/YarnWebServiceUtils.java | 75 +- .../yarn/client/api/impl/TestTimelineClient.java | 80 +- .../api/impl/TestTimelineClientForATS1_5.java | 18 +- .../api/impl/TestTimelineReaderClientImpl.java | 34 +- .../hadoop/yarn/event/TestAsyncDispatcher.java | 5 +- .../apache/hadoop/yarn/webapp/JerseyTestBase.java | 37 +- .../yarn/webapp/MyTestJAXBContextResolver.java | 11 +- .../hadoop/yarn/webapp/MyTestWebService.java | 2 +- .../org/apache/hadoop/yarn/webapp/TestWebApp.java | 110 +- .../yarn/webapp/util/TestWebServiceClient.java | 7 +- .../hadoop-yarn/hadoop-yarn-csi/pom.xml | 9 +- .../pom.xml | 66 +- .../ApplicationHistoryServer.java | 47 +- .../webapp/AHSWebApp.java | 12 +- .../webapp/AHSWebServices.java | 20 +- .../webapp/ContextFactory.java | 2 +- .../webapp/JAXBContextResolver.java | 11 +- .../timeline/webapp/TimelineWebServices.java | 35 +- .../webapp/TestAHSWebServices.java | 461 +++-- .../reader/ContainerLogsInfoListReader.java | 117 ++ .../timeline/reader/TimelineAboutReader.java | 82 + .../timeline/reader/TimelineDomainReader.java | 57 + .../timeline/reader/TimelineDomainsReader.java | 57 + .../timeline/reader/TimelineEntitiesReader.java | 57 + .../timeline/reader/TimelineEntityReader.java | 69 + .../timeline/reader/TimelineEventsReader.java | 80 + .../timeline/reader/TimelinePutResponseReader.java | 57 + .../TestTimelineAuthenticationFilterForV1.java | 4 +- .../timeline/webapp/TestTimelineWebServices.java | 929 +++++---- .../webapp/TestTimelineWebServicesWithSSL.java | 17 +- .../hadoop-yarn-server-common/pom.xml | 24 + .../policies/dao/WeightedPolicyInfo.java | 57 +- .../federation/store/records/SubClusterIdInfo.java | 2 +- .../hadoop/yarn/server/webapp/LogServlet.java | 4 +- .../hadoop/yarn/server/webapp/LogWebService.java | 70 +- .../yarn/server/webapp/LogWebServiceUtils.java | 9 +- .../yarn/server/webapp/dao/ContainerLogsInfo.java | 29 +- .../pom.xml | 27 +- .../server/globalpolicygenerator/GPGUtils.java | 29 +- .../GlobalPolicyGenerator.java | 2 +- .../globalpolicygenerator/webapp/GPGWebApp.java | 23 +- .../webapp/GPGWebServices.java | 10 +- .../policygenerator/TestPolicyGenerator.java | 23 +- .../webapp/TestGPGWebServices.java | 76 +- .../src/test/resources/schedulerInfo1.json | 250 +-- .../src/test/resources/schedulerInfo2.json | 374 ++-- .../hadoop-yarn-server-nodemanager/pom.xml | 96 +- .../server/nodemanager/LinuxContainerExecutor.java | 6 +- .../nodemanager/api/deviceplugin/Device.java | 13 +- .../linux/resources/ResourceHandlerModule.java | 22 +- .../deviceframework/AssignedDevice.java | 4 +- .../resourceplugin/gpu/AssignedGpuDevice.java | 3 + .../resourceplugin/gpu/GpuDevice.java | 3 + .../nodemanager/webapp/JAXBContextResolver.java | 15 +- .../server/nodemanager/webapp/NMWebAppFilter.java | 37 +- .../server/nodemanager/webapp/NMWebServices.java | 50 +- .../yarn/server/nodemanager/webapp/WebServer.java | 79 +- .../server/nodemanager/webapp/dao/AppsInfo.java | 3 +- .../webapp/dao/NMDeviceResourceInfo.java | 8 + .../nodemanager/webapp/dao/NMResourceInfo.java | 13 + .../webapp/dao/gpu/NMGpuResourceInfo.java | 8 + .../TestLinuxContainerExecutorWithMocks.java | 62 +- .../server/nodemanager/webapp/TestNMWebFilter.java | 17 +- .../server/nodemanager/webapp/TestNMWebServer.java | 20 +- .../nodemanager/webapp/TestNMWebServices.java | 492 ++--- .../nodemanager/webapp/TestNMWebServicesApps.java | 404 ++-- .../webapp/TestNMWebServicesAuxServices.java | 155 +- .../webapp/TestNMWebServicesContainers.java | 251 ++- .../nodemanager/webapp/TestNMWebTerminal.java | 19 +- .../hadoop-yarn-server-resourcemanager/pom.xml | 92 +- .../server/resourcemanager/ResourceManager.java | 27 +- .../federation/FederationStateStoreHeartbeat.java | 42 +- .../scheduler/capacity/CapacityScheduler.java | 16 +- .../capacity/CapacitySchedulerConfiguration.java | 2 +- .../PriorityUtilizationQueueOrderingPolicy.java | 6 +- .../resourcemanager/scheduler/fair/FSQueue.java | 2 +- .../fair/converter/FSYarnSiteConverter.java | 2 +- .../webapp/JAXBContextResolver.java | 71 +- .../server/resourcemanager/webapp/RMWebApp.java | 34 +- .../resourcemanager/webapp/RMWebAppFilter.java | 33 +- .../resourcemanager/webapp/RMWebServices.java | 15 +- .../resourcemanager/webapp/dao/AppsInfo.java | 2 +- .../webapp/dao/CapacitySchedulerInfo.java | 2 +- .../webapp/dao/CapacitySchedulerQueueInfoList.java | 2 +- .../yarn/server/resourcemanager/TestRMHA.java | 27 +- .../resourcemanager/TestRMHAForAsyncScheduler.java | 52 + .../TestFederationRMStateStoreService.java | 22 +- .../recovery/TestFSRMStateStore.java | 23 +- .../scheduler/TestAbstractYarnScheduler.java | 8 +- .../TestCapacitySchedulerAsyncScheduling.java | 39 +- ...TestPriorityUtilizationQueueOrderingPolicy.java | 54 + .../fair/converter/TestFSYarnSiteConverter.java | 4 +- .../TestWeightToPercentageConverter.java | 10 +- .../TestWeightToWeightConverter.java | 8 +- .../webapp/ActivitiesTestUtils.java | 26 +- .../resourcemanager/webapp/TestRMWebApp.java | 29 +- .../webapp/TestRMWebAppFairScheduler.java | 38 +- .../webapp/TestRMWebServiceAppsNodelabel.java | 94 +- .../resourcemanager/webapp/TestRMWebServices.java | 369 ++-- .../webapp/TestRMWebServicesAppAttempts.java | 258 +-- .../TestRMWebServicesAppCustomResourceTypes.java | 85 +- .../webapp/TestRMWebServicesApps.java | 1012 +++++----- .../TestRMWebServicesAppsCustomResourceTypes.java | 97 +- .../webapp/TestRMWebServicesAppsModification.java | 669 ++++--- .../webapp/TestRMWebServicesCapacitySched.java | 178 +- ...TestRMWebServicesCapacitySchedDefaultLabel.java | 139 ++ ...estRMWebServicesCapacitySchedDynamicConfig.java | 185 +- ...icesCapacitySchedDynamicConfigAbsoluteMode.java | 140 ++ ...rvicesCapacitySchedDynamicConfigWeightMode.java | 138 ++ ...esCapacitySchedDynamicConfigWeightModeDQC.java} | 172 +- ...ebServicesCapacitySchedLegacyQueueCreation.java | 114 +- ...pacitySchedLegacyQueueCreationAbsoluteMode.java | 140 ++ ...WebServicesCapacitySchedulerConfigMutation.java | 138 +- ...estRMWebServicesCapacitySchedulerMixedMode.java | 216 +- ...itySchedulerMixedModeAbsoluteAndPercentage.java | 121 ++ ...lerMixedModeAbsoluteAndPercentageAndWeight.java | 120 ++ ...edModeAbsoluteAndPercentageAndWeightVector.java | 123 ++ ...edulerMixedModeAbsoluteAndPercentageVector.java | 121 ++ ...apacitySchedulerMixedModeAbsoluteAndWeight.java | 120 ++ ...ySchedulerMixedModeAbsoluteAndWeightVector.java | 121 ++ ...acitySchedulerMixedModePercentageAndWeight.java | 117 ++ ...chedulerMixedModePercentageAndWeightVector.java | 121 ++ .../TestRMWebServicesConfigurationMutation.java | 412 ++-- .../webapp/TestRMWebServicesContainers.java | 113 +- ...estRMWebServicesCustomResourceTypesCommons.java | 16 +- ...RMWebServicesDelegationTokenAuthentication.java | 54 +- .../webapp/TestRMWebServicesDelegationTokens.java | 471 +++-- .../TestRMWebServicesForCSWithPartitions.java | 218 ++- ...TestRMWebServicesHttpStaticUserPermissions.java | 8 +- .../webapp/TestRMWebServicesNodeLabels.java | 266 +-- .../webapp/TestRMWebServicesNodes.java | 573 +++--- .../webapp/TestRMWebServicesReservation.java | 543 ++--- .../TestRMWebServicesSchedulerActivities.java | 393 ++-- ...esSchedulerActivitiesWithMultiNodesEnabled.java | 149 +- .../webapp/TestRMWebappAuthentication.java | 18 +- .../resourcemanager/webapp/TestWebServiceUtil.java | 104 +- .../TestRMWebServicesFairScheduler.java | 117 +- ...ebServicesFairSchedulerCustomResourceTypes.java | 137 +- .../webapp/helper/AppInfoJsonVerifications.java | 2 +- .../webapp/helper/BufferedClientResponse.java | 23 +- .../helper/JsonCustomResourceTypeTestcase.java | 29 +- .../helper/XmlCustomResourceTypeTestCase.java | 23 +- .../webapp/reader/AppStateReader.java | 71 + .../ApplicationSubmissionContextInfoReader.java | 75 + .../webapp/reader/LabelsToNodesInfoReader.java | 74 + .../webapp/reader/NodeLabelsInfoReader.java | 74 + .../webapp/reader/NodeToLabelsInfoReader.java | 74 + .../webapp/reader/ResourceOptionInfoReader.java | 74 + .../ApplicationSubmissionContextInfoWriter.java | 89 + .../webapp/writer/ResourceOptionInfoWriter.java | 87 + .../webapp/writer/SchedConfUpdateInfoWriter.java | 87 + .../hadoop/yarn/webapp/TestRMWithCSRFFilter.java | 117 +- .../src/test/resources/capacity-scheduler.xml | 255 +++ .../src/test/resources/delete-reservation.json | 4 +- .../src/test/resources/submit-reservation.json | 62 +- .../src/test/resources/update-reservation.json | 61 +- ...igmutation-absolute-hierarchy-after-update.json | 552 +++--- ...gmutation-absolute-hierarchy-before-update.json | 560 +++--- ...ion-absolute-hierarchy-legacy-after-update.json | 552 +++--- ...on-absolute-hierarchy-legacy-before-update.json | 560 +++--- .../webapp/dynamic-testAbsoluteMode-0.json | 832 ++++---- .../webapp/dynamic-testAbsoluteMode-16.json | 796 ++++---- .../webapp/dynamic-testAbsoluteMode-32.json | 796 ++++---- .../webapp/dynamic-testAbsoluteMode-legacy-0.json | 824 ++++---- .../webapp/dynamic-testPercentageMode-0.json | 808 ++++---- .../webapp/dynamic-testPercentageMode-16.json | 772 ++++---- .../webapp/dynamic-testPercentageMode-32.json | 772 ++++---- .../dynamic-testPercentageMode-legacy-0.json | 772 ++++---- .../resources/webapp/dynamic-testWeightMode-0.json | 808 ++++---- .../webapp/dynamic-testWeightMode-16.json | 772 ++++---- .../webapp/dynamic-testWeightMode-32.json | 772 ++++---- .../webapp/dynamic-testWeightMode-after-aqc.json | 2068 ++++++++++---------- .../webapp/dynamic-testWeightMode-before-aqc.json | 742 +++---- .../webapp/dynamic-testWeightMode-legacy-0.json | 764 ++++---- .../webapp/dynamic-testWeightMode-legacy-16.json | 764 ++++---- .../webapp/dynamic-testWeightMode-legacy-32.json | 764 ++++---- .../dynamic-testWeightMode-legacy-after-aqc.json | 2052 +++++++++---------- .../dynamic-testWeightMode-legacy-before-aqc.json | 734 +++---- ...mixed-testSchedulerAbsoluteAndPercentage-0.json | 820 ++++---- ...ixed-testSchedulerAbsoluteAndPercentage-16.json | 804 ++++---- ...ixed-testSchedulerAbsoluteAndPercentage-32.json | 784 ++++---- ...tSchedulerAbsoluteAndPercentageAndWeight-0.json | 816 ++++---- ...SchedulerAbsoluteAndPercentageAndWeight-16.json | 800 ++++---- ...SchedulerAbsoluteAndPercentageAndWeight-32.json | 780 ++++---- ...dulerAbsoluteAndPercentageAndWeightMixed-0.json | 818 ++++---- ...ulerAbsoluteAndPercentageAndWeightMixed-16.json | 802 ++++---- ...ulerAbsoluteAndPercentageAndWeightMixed-32.json | 782 ++++---- .../mixed-testSchedulerAbsoluteAndWeight-0.json | 820 ++++---- .../mixed-testSchedulerAbsoluteAndWeight-16.json | 804 ++++---- .../mixed-testSchedulerAbsoluteAndWeight-32.json | 784 ++++---- .../mixed-testSchedulerPercentageAndWeight-0.json | 808 ++++---- .../mixed-testSchedulerPercentageAndWeight-16.json | 772 ++++---- .../mixed-testSchedulerPercentageAndWeight-32.json | 772 ++++---- ...er-response-AbsoluteModeLegacyAutoCreation.json | 418 ++-- .../scheduler-response-PerUserResources.json | 578 +++--- ...-response-PercentageModeLegacyAutoCreation.json | 298 +-- .../test/resources/webapp/scheduler-response.json | 490 ++--- .../hadoop-yarn-server-router/pom.xml | 6 + .../apache/hadoop/yarn/server/router/Router.java | 6 +- .../yarn/server/router/webapp/AppsBlock.java | 4 +- .../webapp/DefaultRequestInterceptorREST.java | 2 +- .../yarn/server/router/webapp/FederationBlock.java | 17 +- .../router/webapp/FederationInterceptorREST.java | 10 +- .../server/router/webapp/MetricsOverviewTable.java | 4 +- .../yarn/server/router/webapp/NodeLabelsBlock.java | 5 +- .../yarn/server/router/webapp/NodesBlock.java | 4 +- .../yarn/server/router/webapp/RouterBlock.java | 19 +- .../yarn/server/router/webapp/RouterWebApp.java | 34 +- .../server/router/webapp/RouterWebServiceUtil.java | 159 +- .../server/router/webapp/RouterWebServices.java | 10 +- .../subcluster/TestFederationSubCluster.java | 133 +- .../TestYarnFederationWithCapacityScheduler.java | 64 +- .../fair/TestYarnFederationWithFairScheduler.java | 85 +- .../router/webapp/TestRouterWebServiceUtil.java | 28 +- .../router/webapp/TestRouterWebServicesREST.java | 322 ++- .../TestTimelineServiceClientIntegration.java | 3 + .../pom.xml | 28 + .../pom.xml | 60 +- .../pom.xml | 4 + .../pom.xml | 4 + .../storage/common/HBaseTimelineServerUtils.java | 3 +- .../hadoop-yarn-server-timelineservice/pom.xml | 21 +- .../collector/NodeTimelineCollectorManager.java | 24 +- .../collector/TimelineCollectorWebService.java | 7 +- .../reader/TimelineReaderManager.java | 1 + .../reader/TimelineReaderServer.java | 26 +- .../reader/TimelineReaderWebServices.java | 11 +- .../storage/FileSystemTimelineWriterImpl.java | 4 + .../reader/TestTimelineReaderWebServices.java | 405 ++-- .../reader/TestTimelineReaderWebServicesACL.java | 50 +- .../reader/TimelineAboutReader.java | 82 + .../reader/TimelineEntityReader.java | 58 + .../reader/TimelineEntitySetReader.java | 94 + .../reader/TimelineHealthReader.java | 57 + .../hadoop-yarn-server-web-proxy/pom.xml | 8 +- .../src/site/markdown/CapacityScheduler.md | 37 + pom.xml | 10 +- 838 files changed, 41576 insertions(+), 33319 deletions(-) create mode 100644 hadoop-cloud-storage-project/hadoop-tos/dev-support/findbugs-exclude.xml delete mode 100644 hadoop-cloud-storage-project/hadoop-tos/hadoop-tos-core/pom.xml delete mode 100644 hadoop-cloud-storage-project/hadoop-tos/hadoop-tos-core/src/main/java/org/apache/hadoop/fs/tosfs/object/exceptions/ChecksumMismatchException.java delete mode 100644 hadoop-cloud-storage-project/hadoop-tos/hadoop-tos-core/src/main/java/org/apache/hadoop/fs/tosfs/util/ParseUtils.java delete mode 100644 hadoop-cloud-storage-project/hadoop-tos/hadoop-tos-shade/pom.xml create mode 100644 hadoop-cloud-storage-project/hadoop-tos/src/main/assembly/hadoop-tos.xml rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/RawFS.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/RawFSUtils.java (86%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/RawFileStatus.java (54%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/RawFileSystem.java (89%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/RawLocatedFileStatus.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/TosChecksum.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/TosFS.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/TosFileSystem.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/commit/CommitContext.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/commit/CommitUtils.java (93%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/commit/Committer.java (93%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/commit/CommitterFactory.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/commit/MagicOutputStream.java (90%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/commit/Pending.java (84%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/commit/PendingSet.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/commit/SuccessData.java (85%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/commit/mapred/Committer.java (86%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/commit/ops/PendingOps.java (91%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/commit/ops/PendingOpsFactory.java (97%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/commit/ops/RawPendingOps.java (95%) copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NMResourceInfo.java => hadoop-cloud-storage-project/hadoop-tos/src/main/java/org/apache/hadoop/fs/tosfs/commit/ops/package-info.java (71%) copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NMResourceInfo.java => hadoop-cloud-storage-project/hadoop-tos/src/main/java/org/apache/hadoop/fs/tosfs/commit/package-info.java (72%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/common/Bytes.java (55%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/common/Chain.java (92%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/common/Tasks.java (96%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/common/ThreadPools.java (93%) copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NMResourceInfo.java => hadoop-cloud-storage-project/hadoop-tos/src/main/java/org/apache/hadoop/fs/tosfs/common/package-info.java (72%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/conf/ArgumentKey.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/conf/ConfKeys.java (99%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/conf/FileStoreKeys.java (96%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/conf/TosKeys.java (97%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/BucketInfo.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/ChecksumInfo.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/ChecksumType.java (72%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/Constants.java (92%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/DirectoryStorage.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/FileStore.java (92%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/InputStreamProvider.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/MultipartUpload.java (100%) copy hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/ObjectConstants.java (96%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/ObjectContent.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/ObjectInfo.java (98%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/ObjectMultiRangeInputStream.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/ObjectOutputStream.java (92%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/ObjectRangeInputStream.java (99%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/ObjectStorage.java (97%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/ObjectStorageFactory.java (92%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/ObjectUtils.java (93%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/Part.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/PrefixStorage.java (96%) copy hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core/src/main/java/org/apache/hadoop/fs/tosfs/object/exceptions/NotAppendableException.java => src/main/java/org/apache/hadoop/fs/tosfs/object/exceptions/ChecksumMismatchException.java} (66%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/exceptions/InvalidObjectKeyException.java (77%) copy hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/exceptions/NotAppendableException.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core/src/main/java/org/apache/hadoop/fs/tosfs/object/exceptions/NotAppendableException.java => src/main/java/org/apache/hadoop/fs/tosfs/object/exceptions/package-info.java} (76%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core/src/main/java/org/apache/hadoop/fs/tosfs/object/ObjectConstants.java => src/main/java/org/apache/hadoop/fs/tosfs/object/package-info.java} (76%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/request/ListObjectsRequest.java (82%) copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NMResourceInfo.java => hadoop-cloud-storage-project/hadoop-tos/src/main/java/org/apache/hadoop/fs/tosfs/object/request/package-info.java (71%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/response/ListObjectsResponse.java (100%) copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NMResourceInfo.java => hadoop-cloud-storage-project/hadoop-tos/src/main/java/org/apache/hadoop/fs/tosfs/object/response/package-info.java (71%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/staging/FileStagingPart.java (97%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/staging/StagingPart.java (84%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/staging/State.java (100%) copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NMResourceInfo.java => hadoop-cloud-storage-project/hadoop-tos/src/main/java/org/apache/hadoop/fs/tosfs/object/staging/package-info.java (71%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/ChainTOSInputStream.java (91%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/DelegationClient.java (57%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/DelegationClientBuilder.java (92%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/GetObjectOutput.java (95%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/TOS.java (86%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/TOSErrorCodes.java (92%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/TOSInputStream.java (86%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/TOSUtils.java (87%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/TosObjectInfo.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/auth/AbstractCredentialsProvider.java (92%) copy hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/auth/CredentialsProvider.java (94%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/auth/DefaultCredentialsProviderChain.java (94%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/auth/EnvironmentCredentialsProvider.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/auth/ExpireableCredential.java (91%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/auth/SimpleCredentialsProvider.java (96%) copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NMResourceInfo.java => hadoop-cloud-storage-project/hadoop-tos/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/auth/package-info.java (71%) copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NMResourceInfo.java => hadoop-cloud-storage-project/hadoop-tos/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/package-info.java (72%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/ops/DefaultFsOps.java (98%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/ops/DirectoryFsOps.java (98%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/ops/FsOps.java (97%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/ops/RenameOp.java (83%) copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NMResourceInfo.java => hadoop-cloud-storage-project/hadoop-tos/src/main/java/org/apache/hadoop/fs/tosfs/ops/package-info.java (72%) copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/NMResourceInfo.java => hadoop-cloud-storage-project/hadoop-tos/src/main/java/org/apache/hadoop/fs/tosfs/package-info.java (73%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/CommonUtils.java (98%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/FSUtils.java (84%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/FuseUtils.java (96%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/Iterables.java (99%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/JsonCodec.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/LazyReload.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/LazyReloadIter.java (92%) create mode 100644 hadoop-cloud-storage-project/hadoop-tos/src/main/java/org/apache/hadoop/fs/tosfs/util/ParseUtils.java rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/Range.java (83%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/Reload.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/RemoteIterators.java (97%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/RetryableUtils.java (93%) copy hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/Serializer.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/TOSClientContextUtils.java (98%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/main/java/org/apache/hadoop/fs/tosfs/util/UUIDUtils.java (97%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core/src/main/java/org/apache/hadoop/fs/tosfs/util/Serializer.java => src/main/java/org/apache/hadoop/fs/tosfs/util/package-info.java} (76%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/site/markdown/cloud-storage/index.md (98%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/TestEnv.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/TestRawFSUtils.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/TestRawFileSystem.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/TestTosChecksum.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/TestTosFileSystem.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/commit/BaseJobSuite.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/commit/CommitterTestBase.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/commit/JobSuite.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/commit/MRJobTestBase.java (97%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/commit/TestCommitter.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/commit/TestMRJob.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/commit/TestMagicOutputStream.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/commit/mapred/CommitterTestBase.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/commit/mapred/JobSuite.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/commit/mapred/TestCommitter.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/contract/TestChecksum.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/contract/TestCreate.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/contract/TestDelete.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/contract/TestDistCp.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/contract/TestGetFileStatus.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/contract/TestMkdir.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/contract/TestOpen.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/contract/TestRename.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/contract/TestRootDir.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/contract/TestSeek.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/contract/TestUnbuffer.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/contract/TestXAttr.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/contract/TosContract.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/ObjectStorageTestBase.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/ObjectTestUtils.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/TestDirectoryStorage.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/TestObjectMultiRangeInputStream.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/TestObjectOutputStream.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/TestObjectRangeInputStream.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/TestObjectStorage.java (99%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/tos/TestChainTOSInputStream.java (98%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/tos/TestDelegationClientBuilder.java (94%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/tos/TestTOSInputStream.java (94%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/tos/TestTOSObjectStorage.java (99%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/tos/TestTOSRetryPolicy.java (93%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/tos/auth/TestAbstractCredentialsProvider.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/tos/auth/TestDefaultCredentialsProviderChain.java (99%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/tos/auth/TestEnvironmentCredentialsProvider.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/object/tos/auth/TestSimpleCredentialsProvider.java (97%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/ops/TestBaseFsOps.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/ops/TestBaseOps.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/ops/TestDefaultFsOps.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/ops/TestDirectoryFsOps.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/ops/TestRenameOp.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/util/TempFiles.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/util/TestFSUtils.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/util/TestIterables.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/util/TestLazyReload.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/util/TestRange.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/java/org/apache/hadoop/fs/tosfs/util/TestUtility.java (100%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/resources/contract/tos.xml (98%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/resources/core-site.xml (94%) rename hadoop-cloud-storage-project/hadoop-tos/{hadoop-tos-core => }/src/test/resources/log4j.properties (100%) create mode 100644 hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/Sizes.java create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/BalancerHttpServer.java rename hadoop-cloud-storage-project/hadoop-tos/hadoop-tos-core/src/main/java/org/apache/hadoop/fs/tosfs/object/tos/auth/CredentialsProvider.java => hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/BalancerMXBean.java (61%) copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/test/java/org/apache/hadoop/yarn/server/timelineservice/collector/TestAppLevelTimelineCollector.java => hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/package-info.java (68%) create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/fgl/FSNLockManager.java create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/fgl/FineGrainedFSNamesystemLock.java create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/fgl/GlobalFSNamesystemLock.java copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/test/java/org/apache/hadoop/yarn/server/timelineservice/collector/TestAppLevelTimelineCollector.java => hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/fgl/package-info.java (87%) copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/test/java/org/apache/hadoop/yarn/server/timelineservice/collector/TestAppLevelTimelineCollector.java => hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/util/RwLockMode.java (86%) create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/balancer/balancer.html create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/balancer/balancer.js create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/balancer/index.html copy hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/{datanode => balancer}/robots.txt (100%) create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/NamenodeFGL.md create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerHttpServer.java create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/fgl/FSNLockBenchmarkThroughput.java create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/fgl/TestFSNLockBenchmarkThroughput.java create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/fgl/TestFineGrainedFSNamesystemLock.java create mode 100644 hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHsWebServicesLogsExtend.java create mode 100644 hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/reader/ContainerLogsInfoMessageBodyReader.java create mode 100644 hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/reader/RemoteLogPathsMessageBodyReader.java delete mode 100644 hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/DirectoryPolicy.java delete mode 100644 hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/DirectoryPolicyImpl.java delete mode 100644 hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3native/NativeS3FileSystem.java delete mode 100644 hadoop-tools/hadoop-aws/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem delete mode 100644 hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/s3n.md delete mode 100644 hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/impl/TestDirectoryMarkerPolicy.java delete mode 100644 hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/s3guard/TestAuthoritativePath.java delete mode 100644 hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3native/TestS3xLoginHelper.java create mode 100644 hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/contracts/services/BlobListResultEntrySchema.java create mode 100644 hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/contracts/services/BlobListResultSchema.java create mode 100644 hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/contracts/services/BlobListXmlParser.java copy hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/contracts/services/{ListResultEntrySchema.java => DfsListResultEntrySchema.java} (85%) copy hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/contracts/services/{ListResultSchema.java => DfsListResultSchema.java} (71%) create mode 100644 hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/contracts/services/StorageErrorResponseSchema.java delete mode 100644 hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/utils/TestMockHelpers.java delete mode 100644 hadoop-tools/hadoop-resourceestimator/src/test/java/org/apache/hadoop/resourceestimator/service/GuiceServletConfig.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timeline/reader/TimelineDomainReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timeline/reader/TimelineEntitiesReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timeline/reader/TimelinePutResponseReader.java copy hadoop-yarn-project/hadoop-yarn/{hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/test/java/org/apache/hadoop/yarn/server/timelineservice/collector/TestAppLevelTimelineCollector.java => hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timeline/reader/package-info.java} (77%) create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timeline/writer/TimelineDomainWriter.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timeline/writer/TimelineDomainsWriter.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timeline/writer/TimelineEntitiesWriter.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timeline/writer/TimelineEntityWriter.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timeline/writer/TimelineEventsWriter.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timeline/writer/TimelinePutResponseWriter.java copy hadoop-yarn-project/hadoop-yarn/{hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/test/java/org/apache/hadoop/yarn/server/timelineservice/collector/TestAppLevelTimelineCollector.java => hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timeline/writer/package-info.java} (77%) create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timelineservice/reader/TimelineDomainReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timelineservice/reader/TimelineEntitiesReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timelineservice/reader/TimelineEntityReader.java copy hadoop-yarn-project/hadoop-yarn/{hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/test/java/org/apache/hadoop/yarn/server/timelineservice/collector/TestAppLevelTimelineCollector.java => hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timelineservice/reader/package-info.java} (77%) create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timelineservice/writer/TimelineDomainWriter.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timelineservice/writer/TimelineEntitiesWriter.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timelineservice/writer/TimelineEntitySetWriter.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timelineservice/writer/TimelineEntityWriter.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timelineservice/writer/TimelineHealthWriter.java rename hadoop-yarn-project/hadoop-yarn/{hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/test/java/org/apache/hadoop/yarn/server/timelineservice/collector/TestAppLevelTimelineCollector.java => hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/timelineservice/writer/package-info.java} (77%) copy hadoop-yarn-project/hadoop-yarn/{hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/webapp/dao/AppsInfo.java => hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/ConflictException.java} (53%) create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/timeline/reader/ContainerLogsInfoListReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/timeline/reader/TimelineAboutReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/timeline/reader/TimelineDomainReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/timeline/reader/TimelineDomainsReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/timeline/reader/TimelineEntitiesReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/timeline/reader/TimelineEntityReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/timeline/reader/TimelineEventsReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/timeline/reader/TimelinePutResponseReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySchedDefaultLabel.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySchedDynamicConfigAbsoluteMode.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySchedDynamicConfigWeightMode.java copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/{TestRMWebServicesCapacitySchedDynamicConfig.java => TestRMWebServicesCapacitySchedDynamicConfigWeightModeDQC.java} (54%) create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySchedLegacyQueueCreationAbsoluteMode.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySchedulerMixedModeAbsoluteAndPercentage.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySchedulerMixedModeAbsoluteAndPercentageAndWeight.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySchedulerMixedModeAbsoluteAndPercentageAndWeightVector.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySchedulerMixedModeAbsoluteAndPercentageVector.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySchedulerMixedModeAbsoluteAndWeight.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySchedulerMixedModeAbsoluteAndWeightVector.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySchedulerMixedModePercentageAndWeight.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySchedulerMixedModePercentageAndWeightVector.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/reader/AppStateReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/reader/ApplicationSubmissionContextInfoReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/reader/LabelsToNodesInfoReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/reader/NodeLabelsInfoReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/reader/NodeToLabelsInfoReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/reader/ResourceOptionInfoReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/writer/ApplicationSubmissionContextInfoWriter.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/writer/ResourceOptionInfoWriter.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/writer/SchedConfUpdateInfoWriter.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/capacity-scheduler.xml create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/test/java/org/apache/hadoop/yarn/server/timelineservice/reader/TimelineAboutReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/test/java/org/apache/hadoop/yarn/server/timelineservice/reader/TimelineEntityReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/test/java/org/apache/hadoop/yarn/server/timelineservice/reader/TimelineEntitySetReader.java create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/test/java/org/apache/hadoop/yarn/server/timelineservice/reader/TimelineHealthReader.java --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org