This is an automated email from the ASF dual-hosted git repository.
chenxi pushed a change to branch ozone-1.4
in repository https://gitbox.apache.org/repos/asf/ozone.git
from 9c6a58620c HDDS-10433. Add Prometheus scrape target for Datanodes in
Compose v2 (#6288)
add 994182bce3 HDDS-8882. Manage status of DeleteBlocksCommand in SCM to
avoid sending duplicates to Datanode (#4988)
add bdc79242d6 HDDS-6152. Migrate TestOzoneFileSystem to JUnit5 (#5795)
add 7a72e577ac HDDS-9966. Bump maven-shade-plugin to 3.5.1 (#5823)
add 1999ba7034 HDDS-9807. Consider volume committed space when checking if
datanode can host new container (#5721)
add d301b97e56 HDDS-9922. Migrate TestOzoneFileInterfaces to JUnit5 (#5838)
add a78f1e6015 HDDS-10027. NPE in VolumeInfoMetrics.getCommitted() (#5885)
add 3563c82af0 HDDS-10007. Rename ManagedSstFileReader in
rocksdb-checkpoint-differ (#5859)
add 18b9ccf44d HDDS-9959. Propagate group remove to other datanodes during
pipeline close (#5827)
add 82c6118237 HDDS-9883. Recon - Improve the performance of processing
IncrementalContainerReport from DN (#5793)
add dc3473ed1e HDDS-10046. Replace PrecomputedVolumeSpace with
SpaceUsageSource.Fixed (#5904)
add b7659bda78 HDDS-8982. Log flooded by WritableRatisContainerProvider if
pipeline's nodes are not found (#5911)
add 08bf39f85e HDDS-10070. Intermittent failure in
TestWritableRatisContainerProvider (#5930)
add 96d78646b0 HDDS-8888. Consider Datanode queue capacity when sending
DeleteBlocks command (#4939)
add ef9d276f47 HDDS-10178. Shaded Jar build failure in case-insensitive
filesystem (#6045)
add 9f7c812570 HDDS-10219. Bump frontend-maven-plugin to 1.15.0 (#6104)
add 2dbe114f63 HDDS-10225. Speed up TestSCMHAManagerImpl. (#6109)
add fd207b99ee HDDS-10029. Improved logs for
SCMDeletedBlockTransactionStatusManager (#5888)
add 8ba17b04c3 HDDS-10246. Remove KeyValueHandler.checkContainerIsHealthy
to improve read performance (#6127)
add 01754f74c2 HDDS-10262. Encapsulate SnapshotCache inside
OmSnapshotManager (#6135)
add b0dcb7a952 HDDS-10250. Use SnapshotId as key in SnapshotCache (#6139)
add ae38ec324e HDDS-7810. Support namespace summaries (du, dist & counts)
for OBJECT_STORE buckets. (#4245)
add 03c658d72c HDDS-10504. Remove unused VolumeInfo#configuredCapacity
(#6363)
add 5c9e0972a2 HDDS-10505. Move space reservation logic to VolumeUsage
(#6370)
add fee68d71dd HDDS-5865. Make read retry interval and attempts in
BlockInputStream configurable (#6408)
add 6eb81f3282 HDDS-9534. Support namespace summaries (du, dist & counts)
for LEGACY buckets with file system disabled (#5517)
add c01dd83d8d HDDS-10206. Expose jmx metrics for snapshot cache size on
the ozone manager. (#6138)
add bb4f066d87 HDDS-10452. Improve Recon Disk Usage to fetch and display
Top N records based on size. (#6318)
add 9fc80a3e7c HDDS-10156. Optimize Snapshot Cache get and eviction (#6024)
add 84e768e03a HDDS-10652. EC Reconstruction fails with "IOException: None
of the block data have checksum" after upgrade (#6520)
add 392dc66b6c HDDS-10614. Avoid decreasing cached space usage below zero
(#6508)
add 427f901497 HDDS-10783. Close SstFileReaderIterator in
RocksDBCheckpointDiffer (#6616)
add e40d6283a9 HDDS-10784. Multipart upload to encrypted bucket fails with
ClassCastException (#6618)
add 42faa4f1d3 HDDS-10792. Bump Netty to 4.1.109.Final (#6622)
add 95e55a836d HDDS-10720. Datanode volume DU reserved percent should have
a non-zero default value. (#6561)
add e1e13e9cd4 HDDS-10787. Updated rocksdb-checkpoint-differ to use
managed RocksDB objects (#6625)
add eec54eda4d HDDS-10806. Bump Bouncy Castle to 1.78.1 (#6632)
add 0690cff051 HDDS-10803. HttpServer fails to start with wildcard
principal (#6631)
add e57c906f19 HDDS-10815. Bump Spring Framework to 5.3.34 (#6643)
add 08e470eeb5 HDDS-10834. Revert snapshot diff output change added in
HDDS-9360 (#6660)
add 8792c9a51e HDDS-10608. Recon can't get full key when using Recon API.
(#6492)
add a747f105eb HDDS-10696. Fix test failure caused by empty snapshot
installation (#6659)
add 1233977220 HDDS-10781. Do not use OFSPath in O3FS
BasicOzoneClientAdapterImpl (#6614)
add 10cdd6e1bb HDDS-10371. NPE in OzoneAclUtils.isOwner (#6676)
add 3df726c636 HDDS-10875. XceiverRatisServer#getRaftPeersInPipeline
should be called before XceiverRatisServer#removeGroup (#6696)
add daf454862b HDDS-10832. Client should switch to streaming based on
OpenKeySession replication (#6683)
add cff394123d HDDS-10924. TestSCMHAManagerImpl#testAddSCM fails on ratis
master (#6753)
add 4bf580adcb HDDS-10999. Remove dependency on ratis-server from Ozone
Client (#6800)
add 5fde0fb3aa HDDS-11013. Ensure version is always set in
ContainerCommandRequestProto (#6812)
add 91567d9427 HDDS-10983. EC Key read corruption when the replica index
of container in DN mismatches (#6779)
add e2a8671891 HDDS-10910. Bump Ratis to 3.1.0 (#6872)
add ec7ceea47d HDDS-11104. Bump maven-dependency-plugin to 3.7.1 (#6903)
add 955619bdea HDDS-11172. Bump vite to 4.5.3 (#6918)
add 2b67ac98ef HDDS-11186. First container log missing from bundle (#6952)
No new revisions were added by this update.
Summary of changes:
.github/workflows/ci.yml | 6 +-
dev-support/ci/selective_ci_checks.bats | 25 +-
hadoop-hdds/client/pom.xml | 2 +-
.../apache/hadoop/hdds/scm/OzoneClientConfig.java | 33 +
.../apache/hadoop/hdds/scm/XceiverClientGrpc.java | 25 +-
.../hadoop/hdds/scm/storage/BlockInputStream.java | 52 +-
.../hadoop/hdds/scm/storage/ChunkInputStream.java | 25 +-
.../hdds/scm/storage/ECBlockOutputStream.java | 24 +-
.../ozone/client/io/BlockInputStreamFactory.java | 7 +-
.../client/io/BlockInputStreamFactoryImpl.java | 14 +-
.../hadoop/ozone/client/io/ECBlockInputStream.java | 23 +-
.../ozone/client/io/ECBlockInputStreamFactory.java | 6 +-
.../client/io/ECBlockInputStreamFactoryImpl.java | 13 +-
.../ozone/client/io/ECBlockInputStreamProxy.java | 14 +-
.../io/ECBlockReconstructedStripeInputStream.java | 10 +-
.../hdds/scm/storage/DummyBlockInputStream.java | 9 +-
.../storage/DummyBlockInputStreamWithRetry.java | 9 +-
.../hdds/scm/storage/TestBlockInputStream.java | 26 +-
.../storage/TestBlockOutputStreamCorrectness.java | 95 +-
.../hadoop/ozone/client/io/ECStreamTestUtil.java | 6 +-
.../client/io/TestBlockInputStreamFactoryImpl.java | 26 +-
.../ozone/client/io/TestECBlockInputStream.java | 110 +-
.../client/io/TestECBlockInputStreamProxy.java | 13 +-
.../io/TestECBlockReconstructedInputStream.java | 10 +-
.../TestECBlockReconstructedStripeInputStream.java | 12 +-
hadoop-hdds/common/pom.xml | 12 +-
.../org/apache/hadoop/hdds/client/BlockID.java | 57 +-
.../hadoop/hdds/fs/CachingSpaceUsageSource.java | 14 +-
.../apache/hadoop/hdds/fs/SpaceUsageSource.java | 43 +
.../hdds/ratis/ContainerCommandRequestMessage.java | 4 +
.../org/apache/hadoop/hdds/ratis/RatisHelper.java | 7 +
.../hdds/scm/PipelineRequestInformation.java | 2 +-
.../org/apache/hadoop/hdds/scm/ScmConfigKeys.java | 3 +-
.../apache/hadoop/hdds/scm/pipeline/Pipeline.java | 15 +-
.../hdds/scm/storage/ContainerProtocolCalls.java | 47 +-
.../org/apache/hadoop/ozone/ClientVersion.java | 4 +
.../org/apache/hadoop/ozone/OzoneConfigKeys.java | 8 +
.../common/src/main/resources/ozone-default.xml | 38 +-
.../hadoop/hdds/fs/MockSpaceUsageSource.java | 44 +-
.../hdds/fs/TestCachingSpaceUsageSource.java | 14 +
.../ratis/TestContainerCommandRequestMessage.java | 3 +
.../ozone/container/ContainerTestHelper.java | 22 +-
.../container/common/impl/HddsDispatcher.java | 8 +-
.../common/impl/StorageLocationReport.java | 56 +-
.../interfaces/StorageLocationReportMXBean.java | 4 +
.../report/CommandStatusReportPublisher.java | 2 +-
.../common/statemachine/DatanodeConfiguration.java | 6 +-
.../common/statemachine/DatanodeStateMachine.java | 4 +-
.../ClosePipelineCommandHandler.java | 69 +-
.../transport/server/ratis/XceiverServerRatis.java | 10 +
.../common/volume/AvailableSpaceFilter.java | 8 +-
.../ozone/container/common/volume/HddsVolume.java | 4 +-
.../container/common/volume/MutableVolumeSet.java | 4 +
.../container/common/volume/StorageVolume.java | 13 +-
.../ozone/container/common/volume/VolumeInfo.java | 97 +-
.../container/common/volume/VolumeInfoMetrics.java | 5 +
.../ozone/container/common/volume/VolumeUsage.java | 140 ++-
.../ECReconstructionCoordinator.java | 7 +-
.../ozone/container/keyvalue/KeyValueHandler.java | 47 +-
.../container/keyvalue/helpers/BlockUtils.java | 23 +-
.../container/keyvalue/impl/BlockManagerImpl.java | 20 +-
.../keyvalue/interfaces/BlockManager.java | 4 +-
.../ozone/container/ozoneimpl/OzoneContainer.java | 2 +-
.../container/common/helpers/TestBlockData.java | 2 +-
.../container/common/impl/TestHddsDispatcher.java | 6 +-
.../common/report/TestReportPublisher.java | 4 +-
.../TestClosePipelineCommandHandler.java | 144 +++
.../volume/TestCapacityVolumeChoosingPolicy.java | 4 +
.../container/common/volume/TestHddsVolume.java | 1 +
.../common/volume/TestReservedVolumeSpace.java | 89 +-
.../volume/TestRoundRobinVolumeChoosingPolicy.java | 6 +
.../TestKeyValueHandlerWithUnhealthyContainer.java | 59 +
.../impl/TestKeyValueStreamDataChannel.java | 4 +-
.../static/swagger-resources/recon-api.yaml | 6 +
.../org/apache/hadoop/hdds/utils/db/RDBStore.java | 2 +-
hadoop-hdds/hadoop-dependency-server/pom.xml | 8 +
.../interface-client/src/main/proto/hdds.proto | 2 +
.../proto/ScmServerDatanodeHeartbeatProtocol.proto | 2 +
.../utils/db/managed/ManagedSstFileReader.java | 21 +-
hadoop-hdds/rocksdb-checkpoint-differ/pom.xml | 37 -
...gedSstFileReader.java => SstFileSetReader.java} | 42 +-
.../ozone/rocksdiff/RocksDBCheckpointDiffer.java | 84 +-
.../org/apache/ozone/rocksdiff/RocksDiffUtils.java | 9 +-
...stFileReader.java => TestSstFileSetReader.java} | 6 +-
.../rocksdiff/TestRocksDBCheckpointDiffer.java | 110 +-
hadoop-hdds/server-scm/pom.xml | 4 +
.../hadoop/hdds/scm/SCMCommonPlacementPolicy.java | 13 +-
.../hadoop/hdds/scm/block/DeletedBlockLog.java | 37 +-
.../hadoop/hdds/scm/block/DeletedBlockLogImpl.java | 238 ++--
.../hdds/scm/block/SCMBlockDeletingService.java | 51 +-
.../SCMDeletedBlockTransactionStatusManager.java | 581 ++++++++++
.../scm/command/CommandStatusReportHandler.java | 36 +-
.../container/balancer/ContainerBalancerTask.java | 2 +-
.../scm/container/placement/metrics/NodeStat.java | 15 +-
.../container/placement/metrics/SCMNodeMetric.java | 16 +-
.../container/placement/metrics/SCMNodeStat.java | 48 +-
.../hadoop/hdds/scm/ha/SCMHAManagerImpl.java | 19 +-
.../apache/hadoop/hdds/scm/ha/SCMStateMachine.java | 4 +-
.../hadoop/hdds/scm/node/DatanodeUsageInfo.java | 2 +
.../hadoop/hdds/scm/node/DeadNodeHandler.java | 20 +
.../apache/hadoop/hdds/scm/node/NodeManager.java | 13 +
.../hadoop/hdds/scm/node/SCMNodeManager.java | 33 +-
.../hadoop/hdds/scm/pipeline/PipelineProvider.java | 8 +-
.../hdds/scm/pipeline/RatisPipelineProvider.java | 2 +-
.../hdds/scm/pipeline/RatisPipelineUtils.java | 65 +-
.../pipeline/WritableRatisContainerProvider.java | 173 ++-
.../hdds/scm/server/ContainerReportQueue.java | 8 +
.../scm/server/SCMDatanodeHeartbeatDispatcher.java | 13 +
.../hdds/scm/server/StorageContainerManager.java | 4 +
.../hdds/scm/TestSCMCommonPlacementPolicy.java | 73 +-
.../hadoop/hdds/scm/block/TestDeletedBlockLog.java | 221 +++-
.../scm/block/TestSCMBlockDeletingService.java | 177 +++
.../TestSCMDeleteBlocksCommandStatusManager.java | 256 +++++
.../hadoop/hdds/scm/container/MockNodeManager.java | 2 +-
.../balancer/TestContainerBalancerTask.java | 3 +-
.../container/balancer/TestFindTargetStrategy.java | 22 +-
.../TestSCMContainerPlacementCapacity.java | 8 +-
.../hadoop/hdds/scm/ha/TestSCMHAManagerImpl.java | 164 +--
.../hadoop/hdds/scm/node/TestDeadNodeHandler.java | 12 +-
.../hadoop/hdds/scm/node/TestSCMNodeManager.java | 5 +-
.../TestWritableRatisContainerProvider.java | 179 +++
.../container/placement/TestDatanodeMetrics.java | 8 +-
.../hdds/scm/cli/datanode/UsageInfoSubcommand.java | 24 +-
.../scm/cli/datanode/TestUsageInfoSubcommand.java | 33 +
.../client/checksum/ECFileChecksumHelper.java | 7 +-
.../checksum/ReplicatedFileChecksumHelper.java | 8 +-
.../ozone/client/io/ECBlockOutputStreamEntry.java | 4 +-
.../hadoop/ozone/client/io/KeyInputStream.java | 34 +-
.../apache/hadoop/ozone/client/rpc/RpcClient.java | 105 +-
.../ozone/client/io/TestKeyInputStreamEC.java | 12 +-
.../main/java/org/apache/hadoop/ozone/OmUtils.java | 41 +
.../org/apache/hadoop/ozone/om/OMConfigKeys.java | 9 +-
.../ozone/snapshot/SnapshotDiffReportOzone.java | 16 +-
.../src/main/compose/ozonesecure/docker-config | 5 +-
.../dist/src/main/compose/ozonesecure/test.sh | 9 +
hadoop-ozone/dist/src/main/compose/testlib.sh | 7 +-
hadoop-ozone/dist/src/main/license/jar-report.txt | 3 +
.../dev-support/findbugsExcludeFile.xml | 8 -
...ystem.java => AbstractOzoneFileSystemTest.java} | 726 ++++++++----
...ava => AbstractOzoneFileSystemTestWithFSO.java} | 170 +--
.../java/org/apache/hadoop/fs/ozone/TestO3FS.java | 21 +-
.../apache/hadoop/fs/ozone/TestO3FSWithFSO.java | 15 +-
.../hadoop/fs/ozone/TestO3FSWithFSOAndOMRatis.java | 15 +-
.../hadoop/fs/ozone/TestO3FSWithFSPaths.java | 21 +-
.../fs/ozone/TestO3FSWithFSPathsAndOMRatis.java | 21 +-
.../hadoop/fs/ozone/TestO3FSWithOMRatis.java | 21 +-
.../hadoop/fs/ozone/TestOzoneFileInterfaces.java | 647 -----------
.../fs/ozone/TestOzoneFileInterfacesWithFSO.java | 44 -
.../org/apache/hadoop/fs/ozone/TestSafeMode.java | 15 +
.../hdds/scm/storage/TestContainerCommandsEC.java | 9 +-
.../org/apache/hadoop/ozone/TestBlockTokens.java | 7 +-
.../hadoop/ozone/TestOzoneConfigurationFields.java | 5 +-
.../client/rpc/TestOzoneRpcClientWithRatis.java | 19 +-
.../ozone/container/TestContainerReplication.java | 195 ++++
.../hadoop/ozone/freon/TestOMSnapshotDAG.java | 41 +-
.../hadoop/ozone/om/TestAddRemoveOzoneManager.java | 2 -
.../ozone/om/TestSnapshotBackgroundServices.java | 16 +-
.../ozone/om/TestSnapshotDeletingService.java | 23 +-
.../hadoop/ozone/om/snapshot/TestOmSnapshot.java | 4 +-
.../ozone/recon/TestReconContainerEndpoint.java | 222 ++++
.../hadoop/ozone/scm/TestXceiverClientGrpc.java | 6 +-
.../hadoop/ozone/om/OMDBCheckpointServlet.java | 13 +-
.../java/org/apache/hadoop/ozone/om/OMMetrics.java | 13 +
.../hadoop/ozone/om/OmMetadataManagerImpl.java | 19 +-
.../org/apache/hadoop/ozone/om/OmSnapshot.java | 10 +-
.../apache/hadoop/ozone/om/OmSnapshotManager.java | 144 ++-
.../org/apache/hadoop/ozone/om/OzoneAclUtils.java | 12 +-
.../org/apache/hadoop/ozone/om/OzoneManager.java | 47 +-
.../hadoop/ozone/om/SstFilteringService.java | 18 +-
.../hadoop/ozone/om/request/OMClientRequest.java | 5 +-
.../request/snapshot/OMSnapshotPurgeRequest.java | 4 +-
.../key/OMDirectoriesPurgeResponseWithFSO.java | 12 +-
.../ozone/om/response/key/OMKeyPurgeResponse.java | 12 +-
.../OMSnapshotMoveDeletedKeysResponse.java | 21 +-
.../ozone/om/service/DirectoryDeletingService.java | 10 +-
.../ozone/om/service/KeyDeletingService.java | 32 +-
.../ozone/om/service/SnapshotDeletingService.java | 23 +-
.../service/SnapshotDirectoryCleaningService.java | 32 +-
.../hadoop/ozone/om/snapshot/ReferenceCounted.java | 10 +-
.../om/snapshot/ReferenceCountedCallback.java} | 7 +-
.../hadoop/ozone/om/snapshot/SnapshotCache.java | 219 ++--
.../ozone/om/snapshot/SnapshotDiffManager.java | 30 +-
.../apache/hadoop/ozone/om/TestChunkStreams.java | 14 +-
.../hadoop/ozone/om/TestOmSnapshotManager.java | 19 +-
.../hadoop/ozone/om/TestSstFilteringService.java | 12 +-
.../key/TestOMKeyPurgeRequestAndResponse.java | 12 +-
.../ozone/om/request/key/TestOMKeyRequest.java | 3 +-
.../s3/multipart/TestS3MultipartRequest.java | 3 +-
.../snapshot/TestOMSnapshotDeleteRequest.java | 3 -
.../TestOMSnapshotPurgeRequestAndResponse.java | 3 +-
.../ozone/om/service/TestKeyDeletingService.java | 10 +-
.../ozone/om/snapshot/TestSnapshotCache.java | 179 +--
.../ozone/om/snapshot/TestSnapshotDiffManager.java | 109 +-
.../fs/ozone/BasicOzoneClientAdapterImpl.java | 19 +-
.../ozone/BasicRootedOzoneClientAdapterImpl.java | 4 +-
.../apache/hadoop/fs/ozone/OzoneClientUtils.java | 9 +-
.../hadoop/fs/ozone/OzoneFSStorageStatistics.java | 9 +
hadoop-ozone/pom.xml | 2 -
.../apache/hadoop/ozone/recon/ReconConstants.java | 5 +
.../hadoop/ozone/recon/ReconServerConfigKeys.java | 17 +
.../org/apache/hadoop/ozone/recon/ReconUtils.java | 171 ++-
.../ozone/recon/api/ClusterStateEndpoint.java | 3 +-
.../hadoop/ozone/recon/api/ContainerEndpoint.java | 48 +-
.../hadoop/ozone/recon/api/NSSummaryEndpoint.java | 12 +-
.../hadoop/ozone/recon/api/NodeEndpoint.java | 3 +-
.../recon/api/handlers/BucketEntityHandler.java | 13 +-
.../ozone/recon/api/handlers/BucketHandler.java | 39 +-
.../recon/api/handlers/DirectoryEntityHandler.java | 13 +-
.../ozone/recon/api/handlers/EntityHandler.java | 105 +-
.../ozone/recon/api/handlers/FSOBucketHandler.java | 2 +-
.../ozone/recon/api/handlers/KeyEntityHandler.java | 2 +-
.../recon/api/handlers/LegacyBucketHandler.java | 2 +-
.../ozone/recon/api/handlers/OBSBucketHandler.java | 268 +++++
.../recon/api/handlers/RootEntityHandler.java | 15 +-
.../recon/api/handlers/UnknownEntityHandler.java | 2 +-
.../recon/api/handlers/VolumeEntityHandler.java | 13 +-
.../recon/api/types/DatanodeStorageReport.java | 9 +-
.../hadoop/ozone/recon/api/types/KeyMetadata.java | 11 +
.../hadoop/ozone/recon/api/types/KeysResponse.java | 9 +-
.../hadoop/ozone/recon/api/types/NSSummary.java | 15 +-
.../hadoop/ozone/recon/codec/NSSummaryCodec.java | 17 +-
.../hadoop/ozone/recon/heatmap/HeatMapUtil.java | 2 +-
.../recon/recovery/ReconOMMetadataManager.java | 8 +
.../recon/recovery/ReconOmMetadataManagerImpl.java | 5 +
.../ozone/recon/scm/ReconContainerManager.java | 4 +
...Manager.java => ReconContainerReportQueue.java} | 34 +-
.../ReconIncrementalContainerReportHandler.java | 33 +-
.../scm/ReconStorageContainerManagerFacade.java | 29 +-
.../recon/spi/ReconNamespaceSummaryManager.java | 3 +
.../spi/impl/ReconNamespaceSummaryManagerImpl.java | 12 +-
.../hadoop/ozone/recon/tasks/NSSummaryTask.java | 44 +-
.../recon/tasks/NSSummaryTaskDbEventHandler.java | 2 +
.../ozone/recon/tasks/NSSummaryTaskWithLegacy.java | 308 ++++--
.../ozone/recon/tasks/NSSummaryTaskWithOBS.java | 236 ++++
.../webapps/recon/ozone-recon-web/api/db.json | 57 +-
.../webapps/recon/ozone-recon-web/package.json | 2 +-
.../webapps/recon/ozone-recon-web/pnpm-lock.yaml | 26 +-
.../src/components/storageBar/storageBar.less | 5 +
.../src/components/storageBar/storageBar.tsx | 5 +-
.../ozone-recon-web/src/types/datanode.types.tsx | 1 +
.../src/views/datanodes/datanodes.tsx | 4 +-
.../ozone/recon/OMMetadataManagerTestUtils.java | 16 +-
.../recon/api/TestNSSummaryDiskUsageOrdering.java | 421 +++++++
.../recon/api/TestNSSummaryEndpointWithFSO.java | 197 +++-
.../recon/api/TestNSSummaryEndpointWithLegacy.java | 89 +-
... => TestNSSummaryEndpointWithOBSAndLegacy.java} | 1165 +++++++++++---------
...TestReconIncrementalContainerReportHandler.java | 15 +-
.../impl/TestReconNamespaceSummaryManagerImpl.java | 6 +-
.../ozone/recon/tasks/TestNSSummaryTask.java | 4 +-
.../recon/tasks/TestNSSummaryTaskWithFSO.java | 54 +-
...a => TestNSSummaryTaskWithLegacyOBSLayout.java} | 452 ++++----
...maryTask.java => TestNSSummaryTaskWithOBS.java} | 428 +++----
.../hadoop/ozone/s3/endpoint/ObjectEndpoint.java | 11 +-
pom.xml | 50 +-
254 files changed, 8733 insertions(+), 4130 deletions(-)
create mode 100644
hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/common/statemachine/commandhandler/TestClosePipelineCommandHandler.java
rename
hadoop-hdds/rocksdb-checkpoint-differ/src/main/java/org/apache/ozone/rocksdb/util/{ManagedSstFileReader.java
=> SstFileSetReader.java} (87%)
rename
hadoop-hdds/rocksdb-checkpoint-differ/src/test/java/org/apache/ozone/rocksdb/util/{TestManagedSstFileReader.java
=> TestSstFileSetReader.java} (98%)
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/block/SCMDeletedBlockTransactionStatusManager.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/block/TestSCMBlockDeletingService.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/block/TestSCMDeleteBlocksCommandStatusManager.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/pipeline/TestWritableRatisContainerProvider.java
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/{TestOzoneFileSystem.java
=> AbstractOzoneFileSystemTest.java} (70%)
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/{TestOzoneFileSystemWithFSO.java
=> AbstractOzoneFileSystemTestWithFSO.java} (80%)
copy
hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/utils/TestIOUtils.java
=>
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestO3FS.java
(73%)
copy
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/server/events/IEventInfo.java
=>
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestO3FSWithFSO.java
(77%)
copy
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/server/events/IEventInfo.java
=>
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestO3FSWithFSOAndOMRatis.java
(76%)
copy
hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/utils/TestIOUtils.java
=>
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestO3FSWithFSPaths.java
(72%)
copy
hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/utils/TestIOUtils.java
=>
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestO3FSWithFSPathsAndOMRatis.java
(70%)
copy
hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/utils/TestIOUtils.java
=>
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestO3FSWithOMRatis.java
(72%)
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileInterfaces.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileInterfacesWithFSO.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/recon/TestReconContainerEndpoint.java
copy
hadoop-ozone/{tools/src/main/java/org/apache/hadoop/ozone/repair/om/package-info.java
=>
ozone-manager/src/main/java/org/apache/hadoop/ozone/om/snapshot/ReferenceCountedCallback.java}
(81%)
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/handlers/OBSBucketHandler.java
copy
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/scm/{ReconSafeModeManager.java
=> ReconContainerReportQueue.java} (51%)
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/tasks/NSSummaryTaskWithOBS.java
create mode 100644
hadoop-ozone/recon/src/test/java/org/apache/hadoop/ozone/recon/api/TestNSSummaryDiskUsageOrdering.java
copy
hadoop-ozone/recon/src/test/java/org/apache/hadoop/ozone/recon/api/{TestNSSummaryEndpointWithLegacy.java
=> TestNSSummaryEndpointWithOBSAndLegacy.java} (53%)
copy
hadoop-ozone/recon/src/test/java/org/apache/hadoop/ozone/recon/tasks/{TestNSSummaryTask.java
=> TestNSSummaryTaskWithLegacyOBSLayout.java} (55%)
copy
hadoop-ozone/recon/src/test/java/org/apache/hadoop/ozone/recon/tasks/{TestNSSummaryTask.java
=> TestNSSummaryTaskWithOBS.java} (57%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
