This is an automated email from the ASF dual-hosted git repository. cnauroth pushed a change to branch HADOOP-19343 in repository https://gitbox.apache.org/repos/asf/hadoop.git
omit 0924da44f29 HADOOP-19343: Add support for open() and rename() omit 0b4e83312b9 HADOOP-19343: Add instruction for running tests omit 13614c3bd3e HADOOP-19343: Add support for mkdir() and getFileStatus() omit 579bd2be410 HADOOP-19343: GCS / Add implementation for create() API add 1e6c2256127 HDFS-17783. [ARR] Optimize the debug log of method asyncIpcClient to print concrete call info. (#7686). Contributed by hfutatzhanghb. add 54e72c40371 YARN-11825. Yarn-ui2 build fails with java17 (#7735) Contributed by D M Murali Krishna Reddy. add b050ede7368 MAPREDUCE-7506. Fix Jobhistoryserver UI - WebAppException controller for jobhistory not found (#7736) Contributed by D M Murali Krishna Reddy. add 8345235b663 HADOOP-19415. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-common Part6. (#7419) add 93b0453f723 HDFS-12431. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-hdfs Part5. (#7733) add f088f91edba YARN-11820. Fix UTs for TestCombinedSystemMetricsPublisher (#7691) add fd380ef5650 HADOOP-19415. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-common Part10. (#7670) add c4abdd7da94 HADOOP-19415. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-common Part7. (#7664) new 49354056abb HADOOP-19343: GCS / Add implementation for create() API new d90291a6efd HADOOP-19343: Add support for mkdir() and getFileStatus() new 3d29867a625 HADOOP-19343: Add instruction for running tests new 1b12f77c8a2 HADOOP-19343: Add support for open() and rename() This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (0924da44f29) \ N -- N -- N refs/heads/HADOOP-19343 (1b12f77c8a2) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 4 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: dev-support/docker/Dockerfile_windows_10 | 5 + .../hadoop/fs/obs/TestOBSContractAppend.java | 5 +- .../org/apache/hadoop/conf/TestConfigRedactor.java | 2 +- .../java/org/apache/hadoop/fs/TestFileUtil.java | 440 +++++++------ .../apache/hadoop/fs/TestLocalFSCopyFromLocal.java | 2 +- .../test/java/org/apache/hadoop/fs/TestPath.java | 103 +-- .../test/java/org/apache/hadoop/fs/TestStat.java | 36 +- .../hadoop/fs/audit/TestCommonAuditContext.java | 2 +- .../fs/contract/AbstractContractAppendTest.java | 4 +- .../contract/AbstractContractBulkDeleteTest.java | 4 +- .../fs/contract/AbstractContractConcatTest.java | 4 +- .../AbstractContractContentSummaryTest.java | 2 +- .../AbstractContractCopyFromLocalTest.java | 22 +- .../fs/contract/AbstractContractCreateTest.java | 38 +- .../fs/contract/AbstractContractDeleteTest.java | 14 +- .../fs/contract/AbstractContractEtagTest.java | 2 +- .../contract/AbstractContractGetEnclosingRoot.java | 60 +- .../AbstractContractGetFileStatusTest.java | 53 +- .../AbstractContractLeaseRecoveryTest.java | 2 +- .../fs/contract/AbstractContractMkdirTest.java | 2 +- .../AbstractContractMultipartUploaderTest.java | 23 +- .../fs/contract/AbstractContractOpenTest.java | 46 +- .../contract/AbstractContractPathHandleTest.java | 96 +-- .../fs/contract/AbstractContractRenameTest.java | 33 +- .../AbstractContractRootDirectoryTest.java | 20 +- .../fs/contract/AbstractContractSafeModeTest.java | 2 +- .../fs/contract/AbstractContractSeekTest.java | 28 +- .../fs/contract/AbstractContractSetTimesTest.java | 4 +- .../AbstractContractStreamIOStatisticsTest.java | 8 +- .../fs/contract/AbstractContractUnbufferTest.java | 20 +- .../contract/AbstractContractVectoredReadTest.java | 164 +++-- .../hadoop/fs/contract/AbstractFSContract.java | 5 +- .../fs/contract/AbstractFSContractTestBase.java | 46 +- .../hadoop/fs/contract/ContractTestUtils.java | 120 ++-- .../apache/hadoop/fs/contract/ftp/FTPContract.java | 4 +- .../localfs/TestLocalFSContractCreate.java | 2 +- .../localfs/TestLocalFSContractLoaded.java | 10 +- .../localfs/TestLocalFSContractVectoredRead.java | 26 +- ...TestRawLocalContractUnderlyingFileBehavior.java | 12 +- .../rawlocal/TestRawLocalContractVectoredRead.java | 3 +- .../rawlocal/TestRawlocalContractPathHandle.java | 6 +- .../rawlocal/TestRawlocalContractRename.java | 2 +- .../org/apache/hadoop/fs/impl/TestFlagSet.java | 48 +- .../apache/hadoop/fs/impl/TestLeakReporter.java | 10 +- .../hadoop/fs/impl/prefetch/TestBlockCache.java | 12 +- .../hadoop/fs/impl/prefetch/TestBlockData.java | 8 +- .../fs/impl/prefetch/TestBlockOperations.java | 4 +- .../fs/impl/prefetch/TestBoundedResourcePool.java | 12 +- .../hadoop/fs/impl/prefetch/TestBufferData.java | 12 +- .../hadoop/fs/impl/prefetch/TestBufferPool.java | 10 +- .../prefetch/TestExecutorServiceFuturePool.java | 16 +- .../hadoop/fs/impl/prefetch/TestFilePosition.java | 8 +- .../hadoop/fs/impl/prefetch/TestRetryer.java | 6 +- .../hadoop/fs/impl/prefetch/TestValidate.java | 2 +- .../apache/hadoop/fs/shell/TestFsShellConcat.java | 28 +- .../apache/hadoop/fs/shell/TestTextCommand.java | 43 +- .../hadoop/fs/statistics/TestDurationTracking.java | 10 +- .../fs/statistics/TestDynamicIOStatistics.java | 9 +- .../fs/statistics/TestEmptyIOStatistics.java | 2 +- .../fs/statistics/TestIOStatisticsSetters.java | 66 +- .../fs/statistics/TestIOStatisticsSnapshot.java | 6 +- .../fs/statistics/TestIOStatisticsStore.java | 24 +- .../hadoop/fs/statistics/TestMeanStatistic.java | 46 +- .../hadoop/fs/store/TestFSBuilderSupport.java | 2 +- .../hadoop/fs/viewfs/TestChRootedFileSystem.java | 171 ++--- .../fs/viewfs/TestHCFSMountTableConfigLoader.java | 41 +- .../hadoop/fs/viewfs/TestNestedMountPoint.java | 313 +++++----- .../hadoop/fs/viewfs/TestRegexMountPoint.java | 54 +- .../viewfs/TestViewFileSystemLocalFileSystem.java | 2 - ...ViewFileSystemWithAuthorityLocalFileSystem.java | 23 +- .../viewfs/TestViewFsOverloadSchemeListStatus.java | 22 +- .../hadoop/fs/viewfs/ViewFileSystemBaseTest.java | 452 +++++++------- .../apache/hadoop/fs/viewfs/ViewFsTestSetup.java | 7 +- .../org/apache/hadoop/ha/ClientBaseWithFixes.java | 687 ++++++++++----------- .../hadoop/ha/TestActiveStandbyElectorRealZK.java | 82 +-- .../apache/hadoop/ha/TestZKFailoverController.java | 53 +- .../hadoop/ha/TestZKFailoverControllerStress.java | 20 +- .../hadoop/io/wrappedio/impl/TestWrappedIO.java | 8 +- .../io/wrappedio/impl/TestWrappedStatistics.java | 62 +- .../hadoop/ipc/TestShadedProtobufHelper.java | 2 +- .../hadoop/metrics2/impl/MetricsRecords.java | 8 +- .../sink/RollingFileSystemSinkTestBase.java | 47 +- .../sink/TestRollingFileSystemSinkWithLocal.java | 18 +- .../hadoop/security/TestUserGroupInformation.java | 202 +++--- .../TestZKDelegationTokenSecretManager.java | 100 +-- ...egationTokenAuthenticationHandlerWithMocks.java | 338 +++++----- .../org/apache/hadoop/service/ServiceAssert.java | 16 +- .../service/TestGlobalStateChangeListener.java | 18 +- .../hadoop/service/TestServiceLifecycle.java | 10 +- .../apache/hadoop/test/AbstractHadoopTestBase.java | 32 +- .../org/apache/hadoop/test/GenericTestUtils.java | 41 +- .../org/apache/hadoop/test/LambdaTestUtils.java | 18 +- .../org/apache/hadoop/test/MetricsAsserts.java | 53 +- .../java/org/apache/hadoop/test/MoreAsserts.java | 24 +- .../org/apache/hadoop/tools/GetGroupsTestBase.java | 36 +- .../hdfs/protocolPB/AsyncRpcProtocolPBUtil.java | 3 + .../federation/router/ThreadLocalContext.java | 1 + .../router/TestRouterHDFSContractAppend.java | 8 +- .../router/TestRouterHDFSContractAppendSecure.java | 8 +- .../router/TestRouterHDFSContractConcat.java | 8 +- .../router/TestRouterHDFSContractConcatSecure.java | 8 +- .../router/TestRouterHDFSContractCreate.java | 8 +- .../router/TestRouterHDFSContractCreateSecure.java | 8 +- .../TestRouterHDFSContractDelegationToken.java | 20 +- .../router/TestRouterHDFSContractDelete.java | 8 +- .../router/TestRouterHDFSContractDeleteSecure.java | 8 +- .../TestRouterHDFSContractGetFileStatus.java | 8 +- .../TestRouterHDFSContractGetFileStatusSecure.java | 8 +- .../router/TestRouterHDFSContractMkdir.java | 8 +- .../router/TestRouterHDFSContractMkdirSecure.java | 8 +- .../router/TestRouterHDFSContractOpen.java | 8 +- .../router/TestRouterHDFSContractOpenSecure.java | 8 +- .../router/TestRouterHDFSContractRename.java | 8 +- .../router/TestRouterHDFSContractRenameSecure.java | 8 +- .../TestRouterHDFSContractRootDirectory.java | 8 +- .../TestRouterHDFSContractRootDirectorySecure.java | 8 +- .../router/TestRouterHDFSContractSeek.java | 8 +- .../router/TestRouterHDFSContractSeekSecure.java | 8 +- .../router/TestRouterHDFSContractSetTimes.java | 8 +- .../TestRouterHDFSContractSetTimesSecure.java | 8 +- .../web/TestRouterWebHDFSContractAppend.java | 8 +- .../web/TestRouterWebHDFSContractConcat.java | 8 +- .../web/TestRouterWebHDFSContractCreate.java | 8 +- .../web/TestRouterWebHDFSContractDelete.java | 8 +- .../router/web/TestRouterWebHDFSContractMkdir.java | 8 +- .../router/web/TestRouterWebHDFSContractOpen.java | 10 +- .../web/TestRouterWebHDFSContractRename.java | 8 +- .../TestRouterWebHDFSContractRootDirectory.java | 8 +- .../router/web/TestRouterWebHDFSContractSeek.java | 8 +- .../hadoop/fs/contract/hdfs/HDFSContract.java | 8 +- .../hadoop/fs/contract/hdfs/TestDFSWrappedIO.java | 8 +- .../fs/contract/hdfs/TestHDFSContractAppend.java | 8 +- .../contract/hdfs/TestHDFSContractBulkDelete.java | 8 +- .../fs/contract/hdfs/TestHDFSContractConcat.java | 8 +- .../fs/contract/hdfs/TestHDFSContractCreate.java | 8 +- .../fs/contract/hdfs/TestHDFSContractDelete.java | 8 +- .../hdfs/TestHDFSContractGetFileStatus.java | 8 +- .../hdfs/TestHDFSContractLeaseRecovery.java | 8 +- .../fs/contract/hdfs/TestHDFSContractMkdir.java | 8 +- .../hdfs/TestHDFSContractMultipartUploader.java | 8 +- .../fs/contract/hdfs/TestHDFSContractOpen.java | 8 +- .../contract/hdfs/TestHDFSContractPathHandle.java | 13 +- .../fs/contract/hdfs/TestHDFSContractRename.java | 8 +- .../hdfs/TestHDFSContractRootDirectory.java | 8 +- .../fs/contract/hdfs/TestHDFSContractSafeMode.java | 8 +- .../fs/contract/hdfs/TestHDFSContractSeek.java | 8 +- .../fs/contract/hdfs/TestHDFSContractSetTimes.java | 8 +- .../fs/contract/hdfs/TestHDFSContractUnbuffer.java | 8 +- .../hdfs/TestHDFSContractVectoredRead.java | 11 +- .../org/apache/hadoop/hdfs/AppendTestUtil.java | 19 +- .../org/apache/hadoop/hdfs/FileAppendTest4.java | 10 +- .../hdfs/ReadStripedFileWithDecodingHelper.java | 18 +- .../apache/hadoop/hdfs/StripedFileTestUtil.java | 46 +- .../org/apache/hadoop/hdfs/TestAbandonBlock.java | 18 +- .../org/apache/hadoop/hdfs/TestAclsEndToEnd.java | 309 ++++----- .../hadoop/hdfs/TestAppendDifferentChecksum.java | 19 +- .../hadoop/hdfs/TestAppendSnapshotTruncate.java | 29 +- .../hadoop/hdfs/TestApplyingStoragePolicy.java | 14 +- .../apache/hadoop/hdfs/TestBalancerBandwidth.java | 10 +- .../hadoop/hdfs/TestBatchedListDirectories.java | 87 ++- .../hadoop/hdfs/TestBlockMissingException.java | 6 +- .../apache/hadoop/hdfs/TestBlockStoragePolicy.java | 170 ++--- .../hadoop/hdfs/TestBlocksScheduledCounter.java | 24 +- .../apache/hadoop/hdfs/TestByteBufferPread.java | 18 +- .../TestClientProtocolForPipelineRecovery.java | 69 ++- .../hadoop/hdfs/TestClientReportBadBlock.java | 30 +- .../java/org/apache/hadoop/hdfs/TestClose.java | 4 +- .../java/org/apache/hadoop/hdfs/TestConnCache.java | 18 +- .../org/apache/hadoop/hdfs/TestCrcCorruption.java | 30 +- .../apache/hadoop/hdfs/TestDFSAddressConfig.java | 10 +- .../hadoop/hdfs/TestDFSClientExcludedNodes.java | 25 +- .../apache/hadoop/hdfs/TestDFSClientRetries.java | 62 +- .../hadoop/hdfs/TestDFSClientSocketSize.java | 16 +- .../org/apache/hadoop/hdfs/TestDFSFinalize.java | 10 +- .../hdfs/TestDFSInotifyEventInputStream.java | 361 +++++------ .../TestDFSInotifyEventInputStreamKerberized.java | 35 +- .../org/apache/hadoop/hdfs/TestDFSInputStream.java | 39 +- .../hdfs/TestDFSInputStreamBlockLocations.java | 111 ++-- .../java/org/apache/hadoop/hdfs/TestDFSMkdirs.java | 24 +- .../apache/hadoop/hdfs/TestDFSOutputStream.java | 58 +- .../org/apache/hadoop/hdfs/TestDFSPermission.java | 85 +-- .../org/apache/hadoop/hdfs/TestDataStream.java | 14 +- .../hadoop/hdfs/TestDataTransferKeepalive.java | 31 +- .../hadoop/hdfs/TestDataTransferProtocol.java | 12 +- .../org/apache/hadoop/hdfs/TestDatanodeConfig.java | 24 +- .../org/apache/hadoop/hdfs/TestDatanodeDeath.java | 22 +- .../hadoop/hdfs/TestDatanodeLayoutUpgrade.java | 2 +- .../org/apache/hadoop/hdfs/TestDatanodeReport.java | 8 +- .../TestDatanodeStartupFixesLegacyStorageIDs.java | 21 +- .../apache/hadoop/hdfs/TestDeadNodeDetection.java | 31 +- .../hadoop/hdfs/TestDecommissionWithStriped.java | 140 +++-- .../org/apache/hadoop/hdfs/TestDeprecatedKeys.java | 6 +- .../org/apache/hadoop/hdfs/TestEnclosingRoot.java | 10 +- .../server/namenode/ha/TestGetGroupsWithHA.java | 8 +- .../apache/hadoop/hdfs/tools/TestGetGroups.java | 8 +- .../org/apache/hadoop/hdfs/util/TestXMLUtils.java | 6 +- .../manifest/AbstractManifestCommitterTest.java | 8 +- .../committer/manifest/TestCleanupStage.java | 4 +- .../committer/manifest/TestCommitTaskStage.java | 4 +- .../manifest/TestCreateOutputDirectoriesStage.java | 4 +- .../manifest/TestJobThroughManifestCommitter.java | 10 +- .../committer/manifest/TestLoadManifestsStage.java | 6 +- .../manifest/TestManifestCommitProtocol.java | 10 +- .../committer/manifest/TestRenameStageFailure.java | 10 +- .../committer/manifest/TestTaskManifestFileIO.java | 4 +- .../committer/manifest/impl/TestEntryFileIO.java | 10 +- .../mapreduce/v2/hs/HistoryClientService.java | 2 +- .../hadoop/mapreduce/v2/hs/webapp/HsWebApp.java | 1 + hadoop-project/pom.xml | 2 +- .../TestAliyunOSSContractGetFileStatusV1List.java | 2 + .../oss/contract/TestAliyunOSSContractSeek.java | 2 +- .../fs/aliyun/oss/yarn/TestOSSMiniYarnCluster.java | 13 +- ...TestS3AContractAnalyticsStreamVectoredRead.java | 10 +- .../contract/s3a/ITestS3AContractBulkDelete.java | 38 +- .../s3a/ITestS3AContractContentSummary.java | 2 +- .../fs/contract/s3a/ITestS3AContractCreate.java | 61 +- .../fs/contract/s3a/ITestS3AContractDistCp.java | 9 +- .../s3a/ITestS3AContractGetFileStatus.java | 2 + .../s3a/ITestS3AContractMkdirWithCreatePerf.java | 4 +- .../s3a/ITestS3AContractMultipartUploader.java | 2 + .../fs/contract/s3a/ITestS3AContractOpen.java | 2 +- .../fs/contract/s3a/ITestS3AContractRename.java | 4 +- .../fs/contract/s3a/ITestS3AContractRootDir.java | 6 +- .../fs/contract/s3a/ITestS3AContractSeek.java | 78 ++- .../contract/s3a/ITestS3AContractVectoredRead.java | 52 +- .../apache/hadoop/fs/s3a/AbstractS3ATestBase.java | 14 +- .../hadoop/fs/s3a/AbstractTestS3AEncryption.java | 14 +- .../hadoop/fs/s3a/ITestDowngradeSyncable.java | 2 +- .../fs/s3a/ITestLocatedFileStatusFetcher.java | 4 +- .../hadoop/fs/s3a/ITestS3ABlockOutputArray.java | 40 +- .../apache/hadoop/fs/s3a/ITestS3ABlocksize.java | 21 +- .../hadoop/fs/s3a/ITestS3ABucketExistence.java | 21 +- .../apache/hadoop/fs/s3a/ITestS3ACannedACLs.java | 2 +- .../fs/s3a/ITestS3AClientSideEncryption.java | 29 +- .../fs/s3a/ITestS3AClientSideEncryptionKms.java | 5 +- .../org/apache/hadoop/fs/s3a/ITestS3AClosedFS.java | 10 +- .../hadoop/fs/s3a/ITestS3AConfiguration.java | 110 ++-- .../hadoop/fs/s3a/ITestS3AContentEncoding.java | 2 +- .../s3a/ITestS3AContractGetFileStatusV1List.java | 2 + .../hadoop/fs/s3a/ITestS3ACopyFromLocalFile.java | 37 +- ...TestS3ADSSEEncryptionWithDefaultS3Settings.java | 4 +- .../apache/hadoop/fs/s3a/ITestS3ADelayedFNF.java | 2 +- .../apache/hadoop/fs/s3a/ITestS3ADeleteOnExit.java | 2 +- .../hadoop/fs/s3a/ITestS3AEmptyDirectory.java | 4 +- .../s3a/ITestS3AEncryptionAlgorithmValidation.java | 56 +- .../hadoop/fs/s3a/ITestS3AEncryptionSSEC.java | 8 +- .../fs/s3a/ITestS3AEncryptionSSEKMSDefaultKey.java | 10 +- .../ITestS3AEncryptionWithDefaultS3Settings.java | 10 +- .../hadoop/fs/s3a/ITestS3AEndpointRegion.java | 7 +- .../hadoop/fs/s3a/ITestS3AFailureHandling.java | 6 +- .../hadoop/fs/s3a/ITestS3AFileOperationCost.java | 8 +- .../s3a/ITestS3AFileSystemIsolatedClassloader.java | 2 +- .../hadoop/fs/s3a/ITestS3AIOStatisticsContext.java | 10 +- .../hadoop/fs/s3a/ITestS3AInputStreamLeakage.java | 4 +- .../org/apache/hadoop/fs/s3a/ITestS3AMetrics.java | 10 +- .../hadoop/fs/s3a/ITestS3AMiscOperations.java | 21 +- .../hadoop/fs/s3a/ITestS3AMultipartUtils.java | 2 +- .../fs/s3a/ITestS3APrefetchingCacheFiles.java | 24 +- .../fs/s3a/ITestS3APrefetchingInputStream.java | 35 +- .../fs/s3a/ITestS3APrefetchingLruEviction.java | 19 +- .../hadoop/fs/s3a/ITestS3ARequesterPays.java | 2 +- .../apache/hadoop/fs/s3a/ITestS3AStorageClass.java | 48 +- .../fs/s3a/ITestS3ATemporaryCredentials.java | 32 +- .../org/apache/hadoop/fs/s3a/ITestS3AUnbuffer.java | 23 +- .../apache/hadoop/fs/s3a/ITestS3AUrlScheme.java | 2 +- .../hadoop/fs/s3a/TestBucketConfiguration.java | 32 +- .../fs/s3a/TestInstrumentationLifecycle.java | 5 +- .../fs/s3a/TestS3AAWSCredentialsProvider.java | 107 ++-- .../hadoop/fs/s3a/TestS3AExceptionTranslation.java | 56 +- .../org/apache/hadoop/fs/s3a/TestS3AProxy.java | 8 +- .../fs/s3a/TestS3AccessGrantConfiguration.java | 9 +- .../apache/hadoop/fs/s3a/TestSSEConfiguration.java | 34 +- .../fs/s3a/TestWildflyAndOpenSSLBinding.java | 6 +- .../hadoop/fs/s3a/audit/AbstractAuditingTest.java | 8 +- .../fs/s3a/audit/ITestAuditAccessChecks.java | 4 +- .../hadoop/fs/s3a/audit/ITestAuditManager.java | 2 +- .../fs/s3a/audit/ITestAuditManagerDisabled.java | 2 +- .../hadoop/fs/s3a/audit/TestAuditIntegration.java | 5 +- .../fs/s3a/audit/TestAuditSpanLifecycle.java | 6 +- .../fs/s3a/audit/TestHttpReferrerAuditHeader.java | 11 +- .../hadoop/fs/s3a/audit/TestLoggingAuditor.java | 6 +- .../impl/TestActiveAuditManagerThreadLeakage.java | 32 +- .../apache/hadoop/fs/s3a/auth/ITestAssumeRole.java | 16 +- .../s3a/auth/ITestAssumedRoleCommitOperations.java | 4 + .../hadoop/fs/s3a/auth/ITestCustomSigner.java | 27 +- .../apache/hadoop/fs/s3a/auth/ITestHttpSigner.java | 6 +- .../apache/hadoop/fs/s3a/auth/ITestJceksIO.java | 10 +- .../fs/s3a/auth/ITestRestrictedReadAccess.java | 6 +- .../auth/TestIAMInstanceCredentialsProvider.java | 8 +- .../hadoop/fs/s3a/auth/TestSignerManager.java | 60 +- .../s3a/auth/delegation/AbstractDelegationIT.java | 19 +- .../delegation/ILoadTestSessionCredentials.java | 9 +- .../s3a/auth/delegation/ITestDelegatedMRJob.java | 55 +- .../ITestRoleDelegationInFilesystem.java | 2 + .../auth/delegation/ITestRoleDelegationTokens.java | 6 +- .../ITestSessionDelegationInFilesystem.java | 144 ++--- .../delegation/ITestSessionDelegationTokens.java | 73 +-- .../hadoop/fs/s3a/commit/AbstractCommitITest.java | 26 +- .../fs/s3a/commit/AbstractITCommitProtocol.java | 60 +- .../fs/s3a/commit/AbstractYarnClusterITest.java | 21 +- .../fs/s3a/commit/ITestCommitOperationCost.java | 6 +- .../fs/s3a/commit/ITestCommitOperations.java | 14 +- .../fs/s3a/commit/ITestS3ACommitterFactory.java | 57 +- .../hadoop/fs/s3a/commit/ITestUploadRecovery.java | 49 +- .../commit/integration/ITestS3ACommitterMRJob.java | 95 +-- .../s3a/commit/magic/ITestMagicCommitProtocol.java | 21 +- .../magic/ITestMagicCommitProtocolFailure.java | 2 +- .../s3a/commit/magic/ITestS3AHugeMagicCommits.java | 10 +- .../integration/ITestDirectoryCommitProtocol.java | 10 +- .../integration/ITestStagingCommitProtocol.java | 13 +- .../ITestStagingCommitProtocolFailure.java | 2 +- .../fs/s3a/commit/terasort/ITestTerasortOnS3A.java | 88 ++- .../hadoop/fs/s3a/impl/ITestAwsSdkWorkarounds.java | 2 +- .../fs/s3a/impl/ITestConnectionTimeouts.java | 4 +- .../fs/s3a/impl/ITestPartialRenamesDeletes.java | 101 +-- .../hadoop/fs/s3a/impl/ITestRenameDeleteRace.java | 2 +- .../hadoop/fs/s3a/impl/ITestTreewalkProblems.java | 4 +- .../ITestUploadPurgeOnDirectoryOperations.java | 4 +- .../apache/hadoop/fs/s3a/impl/ITestXAttrCost.java | 2 +- .../hadoop/fs/s3a/impl/TestAwsClientConfig.java | 24 +- .../hadoop/fs/s3a/impl/TestClientManager.java | 36 +- .../hadoop/fs/s3a/impl/TestErrorTranslation.java | 6 +- .../hadoop/fs/s3a/impl/TestNetworkBinding.java | 2 +- .../hadoop/fs/s3a/impl/TestS3ExpressStorage.java | 6 +- .../s3a/impl/logging/TestLogControllerFactory.java | 22 +- .../fs/s3a/impl/streams/TestStreamFactories.java | 19 +- .../fs/s3a/performance/AbstractS3ACostTest.java | 2 + .../fs/s3a/performance/ITestCreateFileCost.java | 81 ++- .../s3a/performance/ITestCreateSessionTimeout.java | 4 +- .../performance/ITestDirectoryMarkerListing.java | 20 +- .../fs/s3a/performance/ITestS3ADeleteCost.java | 4 +- .../s3a/performance/ITestS3AMiscOperationCost.java | 43 +- .../fs/s3a/performance/ITestS3AMkdirCost.java | 2 +- .../fs/s3a/performance/ITestS3AOpenCost.java | 10 +- .../fs/s3a/performance/ITestS3ARenameCost.java | 2 +- .../fs/s3a/performance/ITestUnbufferDraining.java | 6 +- .../fs/s3a/prefetch/TestS3ABlockManager.java | 4 +- .../s3a/prefetch/TestS3ACachingBlockManager.java | 18 +- .../fs/s3a/prefetch/TestS3ARemoteInputStream.java | 4 +- .../fs/s3a/prefetch/TestS3ARemoteObject.java | 2 +- .../fs/s3a/prefetch/TestS3ARemoteObjectReader.java | 4 +- .../s3a/s3guard/AbstractS3GuardToolTestBase.java | 12 +- .../hadoop/fs/s3a/s3guard/ITestS3GuardTool.java | 14 +- .../fs/s3a/s3guard/TestMetastoreChecking.java | 10 +- .../fs/s3a/scale/AbstractSTestS3AHugeFiles.java | 34 +- .../scale/ILoadTestS3ABulkDeleteThrottling.java | 68 +- .../ITestS3ABlockOutputStreamInterruption.java | 70 ++- .../hadoop/fs/s3a/scale/ITestS3AConcurrentOps.java | 10 +- .../fs/s3a/scale/ITestS3ACreatePerformance.java | 8 +- .../fs/s3a/scale/ITestS3ADeleteManyFiles.java | 4 +- .../fs/s3a/scale/ITestS3ADirectoryPerformance.java | 34 +- .../fs/s3a/scale/ITestS3AHugeFilesEncryption.java | 2 + .../s3a/scale/ITestS3AHugeFilesSSECDiskBlocks.java | 2 + .../s3a/scale/ITestS3AHugeFilesStorageClass.java | 5 +- .../s3a/scale/ITestS3AInputStreamPerformance.java | 78 ++- .../scale/ITestS3AMultipartUploadSizeLimits.java | 2 +- .../hadoop/fs/s3a/scale/S3AScaleTestBase.java | 2 + .../fs/s3a/select/ITestSelectUnsupported.java | 2 +- .../statistics/ITestAWSStatisticCollection.java | 2 +- .../s3a/statistics/ITestAggregateIOStatistics.java | 2 +- .../statistics/ITestS3AFileSystemStatistic.java | 6 +- .../fs/s3a/statistics/TestErrorCodeMapping.java | 28 +- .../hadoop/fs/s3a/tools/ITestBucketTool.java | 4 +- .../hadoop/fs/s3a/tools/ITestMarkerTool.java | 2 +- .../s3a/tools/ITestMarkerToolRootOperations.java | 10 +- .../org/apache/hadoop/fs/s3a/yarn/ITestS3A.java | 25 +- .../fs/s3a/yarn/ITestS3AMiniYarnCluster.java | 18 +- .../org/apache/hadoop/fs/sdk/TestAWSV2SDK.java | 2 +- .../fs/adl/live/TestAdlContractAppendLive.java | 2 +- .../fs/adl/live/TestAdlContractConcatLive.java | 2 +- .../contract/ITestAzureNativeContractDistCp.java | 2 + .../fs/azurebfs/TestAbfsErrorTranslation.java | 2 +- .../azurebfs/commit/AbstractAbfsClusterITest.java | 8 +- .../fs/azurebfs/commit/ITestAbfsCleanupStage.java | 2 + .../azurebfs/commit/ITestAbfsCommitTaskStage.java | 2 + .../ITestAbfsCreateOutputDirectoriesStage.java | 2 + .../ITestAbfsJobThroughManifestCommitter.java | 2 + .../commit/ITestAbfsLoadManifestsStage.java | 2 + .../commit/ITestAbfsManifestCommitProtocol.java | 2 + .../commit/ITestAbfsManifestStoreOperations.java | 4 +- .../commit/ITestAbfsRenameStageFailure.java | 3 + .../commit/ITestAbfsTaskManifestFileIO.java | 2 + .../fs/azurebfs/commit/ITestAbfsTerasort.java | 9 +- .../contract/ITestAbfsContractBulkDelete.java | 2 + .../contract/ITestAbfsContractUnbuffer.java | 2 + .../ITestAbfsFileSystemContractAppend.java | 4 +- .../ITestAbfsFileSystemContractConcat.java | 2 + .../ITestAbfsFileSystemContractCreate.java | 2 + .../ITestAbfsFileSystemContractDelete.java | 2 + .../ITestAbfsFileSystemContractDistCp.java | 7 +- .../contract/ITestAbfsFileSystemContractEtag.java | 2 + .../ITestAbfsFileSystemContractGetFileStatus.java | 2 + .../contract/ITestAbfsFileSystemContractMkdir.java | 2 + .../contract/ITestAbfsFileSystemContractOpen.java | 2 + .../ITestAbfsFileSystemContractRename.java | 2 + .../ITestAbfsFileSystemContractRootDirectory.java | 2 + .../contract/ITestAbfsFileSystemContractSeek.java | 8 +- .../ITestAbfsFileSystemContractSetTimes.java | 2 + .../ITestAbfsFileSystemContractVectoredRead.java | 5 +- .../fs/azurebfs/contract/ITestAbfsWrappedIO.java | 2 + .../tools/contract/AbstractContractDistCpTest.java | 54 +- .../tools/contract/TestHDFSContractDistCp.java | 8 +- .../hadoop-yarn/hadoop-yarn-ui/pom.xml | 7 + 403 files changed, 5730 insertions(+), 5004 deletions(-) --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org