This is an automated email from the ASF dual-hosted git repository.
szetszwo pushed a change to branch HDDS-4454
in repository https://gitbox.apache.org/repos/asf/ozone.git.
omit 5395f71 HDDS-6388. [Ozone-Streaming] Streaming write support both
pipeline model and star model (#3145)
omit 28934b6 HDDS-6355. [Ozone-Streaming] Fix CheckStyle problem (#3119)
omit f637b1e HDDS-6229. [Ozone-Streaming] Data Channel abstraction on
datanode (#3023)
omit aac9215 HDDS-6282. Fix BlockDataStreamOutput#doFlushIfNeeded NPE
(#3060)
omit 6ea2d98 HDDS-5487. [Ozone-Streaming] BlockDataStreamOutput support
FlushDelay. (#3002)
omit 517fba7 HDDS-6298. Add XceiverServerRatis stream config (#3070)
omit bc87050 HDDS-6138.[Ozone-Streaming] Define a limit on the size of the
retry bufferList. (#2946)
omit 0870644 HDDS-6281. Update ratis version to 2.3.0-94db58b-SNAPSHOT
version (#3059)
omit a70176b HDDS-6178. [Ozone-Streaming] Fix NPE in HDDS-6139. (#2984)
omit ca6cb3b [Ozone-Streaming] HDDS-6139. Fix incorrect computation of
totalAckDataLength. (#2978)
omit fc6b037 HDDS-6130. [Ozone-Streaming] When releaseBuffers will get
“Couldn 't find the required future” (#2939)
omit ce1d880 HDDS-6039. Define a minimum packet size during streaming
writes. (#2883)
omit e1f1546 HDDS-5851. [Ozone-Streaming] Define a PutBlock/maxBuffer
fixed boundary for streaming writes. (#2866)
omit 0ecd119 HDDS-5743. [Ozone-Streaming] Add option to write files via
streaming api in ofs and o3fs. (#2770)
omit a65c5d1 HDDS-5879. [Ozone-Streaming] OzoneBucket add the
createMultipartStreamKey method (#2760)
omit 6e01261 HDDS-5961. [Ozone-Streaming] update the usage space of
Containers in the stream write (#2833)
omit 39eb48e HDDS-5987. [Ozone-Streaming] Add XceiverClientRatis stream
config (#2841)
omit 26be29c HDDS-5763. Provide an Executor for each LocalStream in
ContainerStateMachine (#2782)
omit d9bc47b HDDS-5895. [Ozone-Streaming] Make
raft.server.data-stream.client.pool.size configurable (#2766)
omit 48b8b84 HDDS-5674.[Ozone-Streaming] Handle client retries on
exception (#2701)
omit ff9da44 HDDS-5849. [Ozone-Streaming]Write exceptions occur after
checksum is enabled (#2729)
omit 7b45206 HDDS-5486. [Ozone-Streaming] Streaming supports writing in
Pipline mode (#2682)
omit acf5ff4 HDDS-5742. Avoid unnecessary Bytebuffer conversions (#2673)
omit 7b2a704 HDDS-5705. [Ozone-Streaming] Change ByteBufStreamOutput to
ByteBufferStreamOutput (#2603)
omit 4830d36 HDDS-5599. [Ozone-Streaming]drop BufferPool and ChunkBuffer
to avoid buffer copying (#2557)
omit 5e69065 HDDS-5488. [Ozone-Streaming] Add a new
BlockOutputStream/KeyOutputStream to support streaming api (#2495)
omit 1abee11 HDDS-5480. [Ozone-Streaming] Client and server should support
stream setup. (#2452)
omit 95838f5 HDDS-5481. Fix stream() and link() method in
ContainerStateMachine. (#2451)
omit e1d92a5 HDDS-5452. Add link method to ContainerStateMachine for Ratis
streaming (#2422)
omit 3cefeb9 HDDS-5366. [Ozone-Streaming] Implement stream method to
ContainerStateMachine. (#2358). Contributed by mingchao zhao
add 8c5fefe HDDS-6330. Remove unnecessary duplicate semicolons (#3097)
add ff0209d HDDS-6331. Remove toString in debug log parameters within
SCMCommonPlacementPolicy (#3098)
add 2c561d0 HDDS-6283. Change ContainerStateMachine ContainerOpExecutor
name (#3055)
add eb0f56b HDDS-6324. Do not trigger CI by reopening PR (#3092)
add c87b059 HDDS-6284. Add BlockDeletingService worker size config (#3056)
add 51f47fc HDDS-6314. ConcurrentModificationException getting
SCMContainerMetrics (#3101)
add 53fa44d HDDS-6290. operational-state and node-state options in
datanode list CLI not working correctly (#3105)
add 91cf777 HDDS-6262. ozone insight log stops working after OM DBUpdates
message (#3044)
add 07fa775 HDDS-6234. Repair containers affected by incorrect used bytes
and block count. (#3042)
add 788ff0f HDDS-6212. SCM Container DB bootstrap on Recon startup for
secure cluster (#3027)
add ad33ac6 HDDS-6292. Ensure immutable ContainerReplica set is returned
from ContainerStateManagerImpl (#3071)
add 8ad0796 HDDS-6329. New checkstyle: AvoidStarImport (#3096)
add 7f6e6fb HDDS-6350. Rename TestStandardOutputUtil to observe naming
conventions (#3114)
add 4b935c5 HDDS-6328. Add metrics - number of FSO bucket deletes (#3107)
add e848ab7 HDDS-6327. Upgrade acceptance test doesn't collect logs when
the test fails (#3106)
add 68c5ac5 HDDS-6351. [Docs] Update prefix-based FSO documentation.
(#3115)
add 239d889 HDDS-5267. Full Container Report can remove replicas added by
an Incremental Report (#2963)
add f0ee98a HDDS-6363. Update checkstyle version to 9.3 (#3123)
add 1c7ff7e HDDS-6221. Update versions covered by cross-compatibility
test (#3017)
add a195100 HDDS-5359. Incorrect BLOCKCOUNT and BYTESUSED in container
DB. (#3034)
add 5f4c31a HDDS-6349. IncompleteReadError on get MPU key from TDE bucket
(#3116)
add a53a3a3 HDDS-6235. Empty KeyValueContainers are replicated without
chunks directory. (#3052)
add 7310491 HDDS-5194. Provide kustomize descriptors for Ozone kubernetes
examples (#2221)
add 93631a1 HDDS-6334. Remove ContainerID to Proto to ContainerID
conversion in ContainerStateManagerImpl (#3110)
add 17d86f1 HDDS-6361. Modify docs build flow to replace image tags with
shortcodes. (#3122)
add da93105 HDDS-6369. PARTIAL_RENAME does not update OM DB (#3126)
add fbce851 HDDS-6374. Fix incorrect queueTime metrics of ReplicationTask
(#3135)
add ebbe9b5 HDDS-6337. [FSO] Disable recursive access check flag for
directories with no children. (#3134)
add 898ccbb HDDS-6376. Docs: Fix classpath for ofs and o3fs (#3138)
add 53d25b9 HDDS-6307. Improve processing and memory efficiency of full
container reports (#3085)
add 6e117f6 HDDS-6395. Intermittent failure in
TestReconScmHASnapshot.testScmHASnapshot (#3149)
add 2ed5994 HDDS-6268. Include audit log in acceptance test bundle (#3045)
add 5f029d0 HDDS-6317: Export ReconTaskStatus as Prometheus metrics
(#3088)
add ba31f8c HDDS-6333. Add a metric to record sequence number lag between
Recon and OM (#3100)
add e9722b7 HDDS-6401. Fix flaky
TestFilePerBlockStrategy.testWriteAndReadChunkMultipleTimes (#3152)
add d0cde3a HDDS-5712. make it configurable to trigger refresh datanode
usage info before start a new balance iteration (#2944)
add b83c1f9 HDDS-6244. ContainerBalancer metrics don't show updated
values in JMX (#3049)
add e716c18 HDDS-6321. Avoid refresh pipeline for key lookup in checkAcls
(#3103)
add fe6f060 HDDS-6370. Document connecting IDE to Ozone on Kubernetes
(#3132)
add 94598d1 HDDS-6420. Ratis and Standalone ReplicationConfig should
return a static instance (#3165)
add 5217134 HDDS-6360. Create stack dump on acceptance test failure
(#3154)
add b439802 HDDS-6417 - Fix console output message when container
balancer does not start (#3164)
add bf38696 HDDS-6423. Fix typo in TestTools.md (#3170)
add 2a1b6ba HDDS-6379. Not deducting the STANDALONE pipelines when
counting pipelines on each datanode to check the pipeline limit (#3158)
add 58207a2 HDDS-6153. Add simple integration test to the read-replicas
debug tool. (#3065)
add 1c58d79 HDDS-6415 - add Over-Utilized and Under-Utilized DN details
in debug log (#3171)
add 5587023 HDDS-6357. RenameKey request has memory leak (#3121)
add 2a776a3 HDDS-6306 - Fix picocli warnings in ozone container balancer
help (#3162)
add ea06d26 HDDS-6419. Provide better error message for malformed auth
header (#3167)
add 759ac57 HDDS-6407. Unwrap RemoteException in getClientProtocol (#3157)
add 933a19c HDDS-5656. Move old objects to delete table on overwriting
multipart objects (#2813)
add 1c414bf HDDS-6299. Remove Log4J2 from Ozone FS shaded jars (#3073)
add a720211 HDDS-6267. Recon is accessing mock classes. (#3084)
add 27aad3c HDDS-6391. ClientVersions and DatanodeVersions class to
define an enum with version and description (#3155)
add 7cfd846 HDDS-6251. EC: Smoketest for ozone admin datanode expects
exactly 3 nodes (#3182)
add b01138c HDDS-6392. Introduce OzoneManagerVersion enum (#3159)
add bb212de HDDS-6418. Datanode usage info uses wrong version number
(#3173)
add f826d12 HDDS-6431. Fix usedBytes for FSO bucket (#3178)
new 22f977a HDDS-5366. [Ozone-Streaming] Implement stream method to
ContainerStateMachine. (#2358). Contributed by mingchao zhao
new 0aabbc0 HDDS-5452. Add link method to ContainerStateMachine for Ratis
streaming (#2422)
new 82af9d7 HDDS-5481. Fix stream() and link() method in
ContainerStateMachine. (#2451)
new decaa57 HDDS-5480. [Ozone-Streaming] Client and server should support
stream setup. (#2452)
new 0634daf HDDS-5488. [Ozone-Streaming] Add a new
BlockOutputStream/KeyOutputStream to support streaming api (#2495)
new c49edfe HDDS-5599. [Ozone-Streaming]drop BufferPool and ChunkBuffer
to avoid buffer copying (#2557)
new 50e96dd HDDS-5705. [Ozone-Streaming] Change ByteBufStreamOutput to
ByteBufferStreamOutput (#2603)
new 7f503b9 HDDS-5742. Avoid unnecessary Bytebuffer conversions (#2673)
new aba2b3b HDDS-5486. [Ozone-Streaming] Streaming supports writing in
Pipline mode (#2682)
new 0ee0c63 HDDS-5849. [Ozone-Streaming]Write exceptions occur after
checksum is enabled (#2729)
new eede797 HDDS-5674.[Ozone-Streaming] Handle client retries on
exception (#2701)
new 786d09a HDDS-5895. [Ozone-Streaming] Make
raft.server.data-stream.client.pool.size configurable (#2766)
new 253ee38 HDDS-5763. Provide an Executor for each LocalStream in
ContainerStateMachine (#2782)
new d86e5fe HDDS-5987. [Ozone-Streaming] Add XceiverClientRatis stream
config (#2841)
new 06dbec5 HDDS-5961. [Ozone-Streaming] update the usage space of
Containers in the stream write (#2833)
new b6f5244 HDDS-5879. [Ozone-Streaming] OzoneBucket add the
createMultipartStreamKey method (#2760)
new 9491324 HDDS-5743. [Ozone-Streaming] Add option to write files via
streaming api in ofs and o3fs. (#2770)
new d75ea44 HDDS-5851. [Ozone-Streaming] Define a PutBlock/maxBuffer
fixed boundary for streaming writes. (#2866)
new 4e21bdf HDDS-6039. Define a minimum packet size during streaming
writes. (#2883)
new 6ab6d0d HDDS-6130. [Ozone-Streaming] When releaseBuffers will get
“Couldn 't find the required future” (#2939)
new fbeda1c HDDS-6139. [Ozone-Streaming] Fix incorrect computation of
totalAckDataLength. (#2978)
new 1792363 HDDS-6178. [Ozone-Streaming] Fix NPE in HDDS-6139. (#2984)
new e8257f9 HDDS-6281. Update ratis version to 2.3.0-94db58b-SNAPSHOT
version (#3059)
new 4f9265e HDDS-6138.[Ozone-Streaming] Define a limit on the size of the
retry bufferList. (#2946)
new 5dfdbcb HDDS-6298. Add XceiverServerRatis stream config (#3070)
new 9134b73 HDDS-5487. [Ozone-Streaming] BlockDataStreamOutput support
FlushDelay. (#3002)
new 45d8f51 HDDS-6282. Fix BlockDataStreamOutput#doFlushIfNeeded NPE
(#3060)
new 4dcc108 HDDS-6229. [Ozone-Streaming] Data Channel abstraction on
datanode (#3023)
new bb39d10 HDDS-6355. [Ozone-Streaming] Fix CheckStyle problem (#3119)
new b6f1921 HDDS-6388. [Ozone-Streaming] Streaming write support both
pipeline model and star model (#3145)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (5395f71)
\
N -- N -- N refs/heads/HDDS-4454 (b6f1921)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 30 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/post-commit.yml | 2 +-
.../hadoop/hdds/scm/storage/BlockInputStream.java | 2 +-
.../storage/DummyBlockInputStreamWithRetry.java | 2 +-
hadoop-hdds/common/pom.xml | 13 +-
...DatanodeVersions.java => ComponentVersion.java} | 24 +-
.../org/apache/hadoop/hdds/DatanodeVersion.java | 65 +++
.../org/apache/hadoop/hdds/HddsConfigKeys.java | 1 -
.../hadoop/hdds/client/RatisReplicationConfig.java | 34 +-
.../hadoop/hdds/client/ReplicationConfig.java | 4 +-
.../hdds/client/StandaloneReplicationConfig.java | 34 +-
.../hadoop/hdds/protocol/DatanodeDetails.java | 13 +-
.../RequestTypeDependentRetryPolicyCreator.java | 6 +-
.../hadoop/hdds/scm/container/ContainerInfo.java | 21 +-
.../org/apache/hadoop/hdds/scm/ha/SCMHAUtils.java | 9 +-
.../apache/hadoop/hdds/scm/net/InnerNodeImpl.java | 2 +-
.../protocol/StorageContainerLocationProtocol.java | 11 +-
.../org/apache/hadoop/ozone/ClientVersion.java | 69 +++
.../org/apache/hadoop/ozone/ClientVersions.java | 38 --
.../org/apache/hadoop/ozone/OzoneConfigKeys.java | 5 +
.../apache/hadoop/ozone/OzoneManagerVersion.java | 64 +++
.../common/src/main/resources/ozone-default.xml | 8 +
.../hdds/TestComponentVersionInvariants.java | 98 +++++
.../client/TestReplicationConfigValidator.java | 16 +-
.../hadoop/hdds/protocol/TestDatanodeDetails.java | 11 +-
.../hadoop/hdds/scm/pipeline/MockPipeline.java | 4 +-
.../hadoop/hdds/scm/pipeline/TestPipeline.java | 9 +-
.../ozone/container/ContainerTestHelper.java | 68 ---
.../TestDefaultUpgradeFinalizationExecutor.java | 3 +-
.../apache/hadoop/ozone/HddsDatanodeService.java | 8 +-
.../ozone/container/common/impl/ContainerData.java | 46 +-
.../ozone/container/common/impl/ContainerSet.java | 16 +-
.../common/interfaces/ContainerInspector.java | 72 ++++
.../ozone/container/common/interfaces/Handler.java | 12 +-
.../common/report/ContainerReportPublisher.java | 5 +-
.../common/report/IncrementalReportSender.java} | 16 +-
.../common/statemachine/DatanodeStateMachine.java | 6 +-
.../common/statemachine/StateContext.java | 131 +++---
.../states/datanode/RunningDatanodeState.java | 8 +-
.../states/endpoint/HeartbeatEndpointTask.java | 23 +-
.../server/ratis/ContainerStateMachine.java | 7 +-
.../transport/server/ratis/XceiverServerRatis.java | 6 +-
.../common/utils/ContainerInspectorUtil.java | 87 ++++
.../container/common/volume/AbstractFuture.java | 13 +-
.../container/keyvalue/KeyValueContainer.java | 76 +++-
.../container/keyvalue/KeyValueContainerData.java | 10 +-
.../KeyValueContainerMetadataInspector.java | 463 +++++++++++++++++++++
.../ozone/container/keyvalue/KeyValueHandler.java | 95 ++---
.../container/keyvalue/TarContainerPacker.java | 55 ++-
.../container/keyvalue/helpers/ChunkUtils.java | 4 +
.../keyvalue/helpers/KeyValueContainerUtil.java | 23 +-
.../container/keyvalue/impl/BlockManagerImpl.java | 104 +++--
.../keyvalue/impl/ChunkManagerDispatcher.java | 18 +-
.../background/BlockDeletingService.java | 108 +++--
.../container/metadata/AbstractDatanodeStore.java | 6 +-
.../ozone/container/ozoneimpl/ContainerReader.java | 6 +-
.../ozone/container/ozoneimpl/OzoneContainer.java | 40 +-
.../container/replication/MeasuredReplicator.java | 3 +-
.../commands/RefreshVolumeUsageCommand.java | 57 +++
.../hadoop/ozone/container/common/ScmTestMock.java | 7 +-
.../container/common/TestBlockDeletingService.java | 6 +-
.../common/TestKeyValueContainerData.java | 6 +-
.../TestSchemaOneBackwardsCompatibility.java | 2 +-
.../common/helpers/TestDatanodeVersionFile.java | 4 +-
.../impl/TestContainerDeletionChoosingPolicy.java | 2 +-
.../common/impl/TestContainerPersistence.java | 47 ---
.../container/common/impl/TestHddsDispatcher.java | 7 +-
.../common/statemachine/TestStateContext.java | 71 +++-
.../common/volume/TestStorageVolumeChecker.java | 12 +-
.../keyvalue/TestKeyValueBlockIterator.java | 10 +-
.../container/keyvalue/TestKeyValueContainer.java | 67 ++-
.../keyvalue/TestKeyValueContainerCheck.java | 158 +------
...a => TestKeyValueContainerIntegrityChecks.java} | 160 ++-----
.../TestKeyValueContainerMetadataInspector.java | 360 ++++++++++++++++
.../container/keyvalue/TestKeyValueHandler.java | 19 +-
.../TestKeyValueHandlerWithUnhealthyContainer.java | 14 -
.../keyvalue/impl/CommonChunkManagerTestCases.java | 1 -
.../keyvalue/impl/TestBlockManagerImpl.java | 57 +--
.../container/ozoneimpl/TestContainerReader.java | 2 +-
.../container/ozoneimpl/TestOzoneContainer.java | 6 +-
.../replication/TestMeasuredReplicator.java | 15 +
.../testutils/BlockDeletingServiceTestImpl.java | 2 +-
hadoop-hdds/dev-support/checkstyle/checkstyle.xml | 1 +
hadoop-hdds/docs/content/concept/Containers.md | 3 +-
hadoop-hdds/docs/content/concept/Datanodes.md | 4 +-
hadoop-hdds/docs/content/concept/OzoneManager.md | 6 +-
hadoop-hdds/docs/content/concept/Recon.md | 9 +-
hadoop-hdds/docs/content/feature/OM-HA.md | 4 +-
hadoop-hdds/docs/content/feature/PrefixFSO.md | 68 ++-
hadoop-hdds/docs/content/feature/SCM-HA.md | 2 +-
hadoop-hdds/docs/content/interface/O3fs.md | 2 +-
hadoop-hdds/docs/content/interface/O3fs.zh.md | 4 +-
hadoop-hdds/docs/content/interface/Ofs.md | 2 +-
hadoop-hdds/docs/content/tools/TestTools.md | 4 +-
hadoop-hdds/docs/content/tools/TestTools.zh.md | 4 +-
hadoop-hdds/docs/dev-support/bin/generate-site.sh | 12 +-
.../docs/dev-support/bin/make_images_responsive.py | 57 +++
.../themes/ozonedoc/layouts/shortcodes/image.html | 2 +-
hadoop-hdds/framework/pom.xml | 8 +
.../hadoop/hdds/protocol/SCMSecurityProtocol.java | 12 +
.../SCMSecurityProtocolClientSideTranslatorPB.java | 37 ++
...lockLocationProtocolClientSideTranslatorPB.java | 4 +-
...inerLocationProtocolClientSideTranslatorPB.java | 9 +-
.../scm/update/client/UpdateServiceConfig.java | 5 +-
.../authority/PKIProfiles/DefaultProfile.java | 32 +-
...ateClient.java => CommonCertificateClient.java} | 116 +++---
.../certificate/client/OMCertificateClient.java | 79 +---
.../certificate/client/ReconCertificateClient.java | 37 +-
...va => FixedThreadPoolWithAffinityExecutor.java} | 70 +++-
.../hadoop/hdds/utils/db/DBUpdatesWrapper.java | 9 +
.../org/apache/hadoop/hdds/utils/db/RDBStore.java | 1 +
.../hadoop/hdds/utils/db/cache/EpochEntry.java | 75 ----
.../hadoop/hdds/utils/db/cache/FullTableCache.java | 50 ++-
.../hdds/utils/db/cache/PartialTableCache.java | 56 +--
.../hadoop/hdds/utils/db/cache/TableCache.java | 4 +-
.../client/TestDefaultCertificateClient.java | 2 +-
.../hadoop/hdds/server/events/TestEventQueue.java | 35 +-
.../hadoop/hdds/server/http/TestHtmlQuoting.java | 5 +-
.../hadoop/hdds/utils/db/cache/TestTableCache.java | 77 +++-
.../src/main/proto/DatanodeClientProtocol.proto | 4 +-
.../interface-client/src/main/proto/hdds.proto | 7 +
.../proto/ScmServerDatanodeHeartbeatProtocol.proto | 11 +-
.../src/main/proto/ScmServerSecurityProtocol.proto | 8 +-
.../hadoop/hdds/scm/SCMCommonPlacementPolicy.java | 2 +-
.../container/AbstractContainerReportHandler.java | 44 +-
.../hdds/scm/container/ContainerManager.java | 7 +
.../hdds/scm/container/ContainerManagerImpl.java | 78 ++--
.../hdds/scm/container/ContainerReportHandler.java | 141 +++++--
.../hdds/scm/container/ContainerStateManager.java | 10 +-
.../scm/container/ContainerStateManagerImpl.java | 24 +-
.../IncrementalContainerReportHandler.java | 18 +-
.../hdds/scm/container/ReplicationManager.java | 4 +-
.../scm/container/balancer/ContainerBalancer.java | 133 ++++--
.../balancer/ContainerBalancerConfiguration.java | 23 +-
.../balancer/ContainerBalancerMetrics.java | 139 ++++---
.../scm/container/states/ContainerStateMap.java | 27 +-
.../apache/hadoop/hdds/scm/events/SCMEvents.java | 2 +-
.../hadoop/hdds/scm/ha/InterSCMGrpcClient.java | 4 +-
.../org/apache/hadoop/hdds/scm/ha/RatisUtil.java | 4 +-
.../hdds/scm/ha/SCMDBCheckpointProvider.java | 2 +-
...ffer.java => SCMHADBTransactionBufferStub.java} | 8 +-
...MockSCMHAManager.java => SCMHAManagerStub.java} | 24 +-
.../hadoop/hdds/scm/ha/SCMServiceManager.java | 3 +-
.../hdds/scm/metadata/MoveDataNodePairCodec.java | 6 +-
.../hadoop/hdds/scm/metadata/PipelineCodec.java | 6 +-
.../hdds/scm/node/DatanodeAdminMonitorImpl.java | 9 +-
.../hadoop/hdds/scm/node/DatanodeUsageInfo.java | 15 +-
.../apache/hadoop/hdds/scm/node/NodeManager.java | 18 +
.../hadoop/hdds/scm/node/NodeStateManager.java | 18 +-
.../hadoop/hdds/scm/node/SCMNodeManager.java | 34 +-
.../hdds/scm/node/states/Node2ObjectsMap.java | 2 +-
.../hadoop/hdds/scm/node/states/NodeStateMap.java | 4 +-
.../hdds/scm/pipeline/PipelineManagerImpl.java | 4 +-
.../hdds/scm/pipeline/PipelinePlacementPolicy.java | 54 +--
.../hadoop/hdds/scm/pipeline/PipelineStateMap.java | 11 +-
.../hdds/scm/pipeline/RatisPipelineProvider.java | 6 +-
.../hdds/scm/pipeline/RatisPipelineUtils.java | 3 +-
.../SCMSecurityProtocolServerSideTranslatorPB.java | 28 ++
...inerLocationProtocolServerSideTranslatorPB.java | 9 +-
.../scm/safemode/HealthyPipelineSafeModeRule.java | 2 +-
.../safemode/OneReplicaPipelineSafeModeRule.java | 2 +-
.../hdds/scm/server/SCMClientProtocolServer.java | 14 +-
.../scm/server/SCMDatanodeHeartbeatDispatcher.java | 20 +
.../hdds/scm/server/SCMDatanodeProtocolServer.java | 12 +-
.../hadoop/hdds/scm/server/SCMPolicyProvider.java | 5 +-
.../hdds/scm/server/SCMSecurityProtocolServer.java | 16 +-
.../hadoop/hdds/scm/server/SCMStorageConfig.java | 2 +-
.../hdds/scm/server/StorageContainerManager.java | 51 ++-
.../org/apache/hadoop/hdds/scm/HddsTestUtils.java | 14 +-
.../hadoop/hdds/scm/TestHddsServerUtils.java | 2 +-
.../hadoop/hdds/scm/block/TestBlockManager.java | 7 +-
.../hadoop/hdds/scm/block/TestDeletedBlockLog.java | 8 +-
.../hadoop/hdds/scm/container/MockNodeManager.java | 21 +
.../hdds/scm/container/SimpleMockNodeManager.java | 20 +-
.../container/TestCloseContainerEventHandler.java | 8 +-
.../scm/container/TestContainerManagerImpl.java | 26 +-
.../scm/container/TestContainerReportHandler.java | 34 +-
.../scm/container/TestContainerStateManager.java | 14 +-
.../TestIncrementalContainerReportHandler.java | 30 +-
.../hdds/scm/container/TestReplicationManager.java | 140 +++----
.../scm/container/TestUnknownContainerReport.java | 4 +-
.../container/balancer/TestContainerBalancer.java | 84 ++--
.../states/TestContainerReplicaCount.java | 5 +-
.../hdds/scm/ha/TestReplicationAnnotation.java | 10 +-
.../hdds/scm/ha/TestSequenceIDGenerator.java | 4 +-
.../hdds/scm/node/TestContainerPlacement.java | 6 +-
.../hdds/scm/node/TestDatanodeAdminMonitor.java | 7 +-
.../hadoop/hdds/scm/node/TestDeadNodeHandler.java | 3 +-
.../hadoop/hdds/scm/node/TestNodeStateManager.java | 24 ++
.../hadoop/hdds/scm/node/TestSCMNodeManager.java | 12 +-
.../hdds/scm/node/TestSCMNodeStorageStatMap.java | 5 +-
.../hdds/scm/pipeline/MockPipelineManager.java | 4 +-
.../TestPipelineDatanodesIntersection.java | 13 +-
.../hdds/scm/pipeline/TestPipelineManagerImpl.java | 119 +++---
.../scm/pipeline/TestPipelinePlacementPolicy.java | 158 ++++++-
.../scm/pipeline/TestPipelineStateManagerImpl.java | 62 +--
.../scm/pipeline/TestRatisPipelineProvider.java | 50 ++-
.../scm/pipeline/TestSimplePipelineProvider.java | 18 +-
.../safemode/TestHealthyPipelineSafeModeRule.java | 20 +-
.../TestOneReplicaPipelineSafeModeRule.java | 10 +-
.../hdds/scm/safemode/TestSCMSafeModeManager.java | 22 +-
.../scm/server/TestSCMBlockProtocolServer.java | 10 +-
.../server/TestSCMDatanodeHeartbeatDispatcher.java | 54 +--
.../server/TestStorageContainerManagerStarter.java | 6 +-
.../testutils/ReplicationNodeManagerMock.java | 14 +
.../org/apache/ozone/test/GenericTestUtils.java | 18 +-
.../scm/cli/ContainerBalancerStartSubcommand.java | 8 +-
.../hdds/scm/cli/ContainerOperationClient.java | 9 +-
.../hadoop/hdds/scm/cli/cert/CertCommands.java | 4 +-
.../hdds/scm/cli/datanode/ListInfoSubcommand.java | 38 +-
.../hdds/scm/cli/container/TestInfoSubCommand.java | 4 +-
.../datanode/TestContainerBalancerSubCommand.java | 6 +-
.../hadoop/ozone/client/OzoneClientFactory.java | 5 +-
.../checksum/ReplicatedFileChecksumHelper.java | 2 +-
.../client/io/BlockOutputStreamEntryPool.java | 1 -
.../client/io/MultipartCryptoKeyInputStream.java | 4 +
.../checksum/TestReplicatedFileChecksumHelper.java | 21 +-
.../hadoop/ozone/client/rpc/TestOzoneKMSUtil.java | 3 +-
.../apache/hadoop/ozone/om/helpers/DBUpdates.java | 10 +
.../hadoop/ozone/om/helpers/OmDirectoryInfo.java | 7 +-
.../hadoop/ozone/om/helpers/OmVolumeArgs.java | 4 +-
...OzoneManagerProtocolClientSideTranslatorPB.java | 21 +-
.../apache/hadoop/ozone/protocolPB/OMPBHelper.java | 37 +-
.../apache/hadoop/ozone/security/acl/OzoneObj.java | 3 +-
.../apache/hadoop/ozone/web/utils/OzoneUtils.java | 18 +-
.../org/apache/hadoop/ozone/TestOzoneAcls.java | 10 +-
.../hadoop/ozone/om/helpers/TestOmKeyInfo.java | 12 +-
.../ozone/om/helpers/TestOmMultipartKeyInfo.java | 4 +-
.../ozone/security/acl/TestOzoneObjInfo.java | 5 +-
hadoop-ozone/dev-support/checks/_lib.sh | 2 +-
hadoop-ozone/dev-support/checks/acceptance.sh | 3 +-
hadoop-ozone/dist/pom.xml | 2 +-
.../dist/src/main/compose/ozone/docker-config | 4 +
hadoop-ozone/dist/src/main/compose/ozone/test.sh | 2 +
.../src/main/compose/ozonesecure/docker-config | 4 +
.../dist/src/main/compose/ozonesecure/test.sh | 2 +-
hadoop-ozone/dist/src/main/compose/testlib.sh | 82 +++-
.../dist/src/main/compose/upgrade/testlib.sh | 1 -
.../dist/src/main/compose/xcompat/clients.yaml | 18 +
hadoop-ozone/dist/src/main/compose/xcompat/test.sh | 17 +-
hadoop-ozone/dist/src/main/k8s/README.md | 68 +++
.../k8s/definitions/ozone-csi/csi-controller.yaml | 2 +-
.../main/k8s/examples/getting-started/Flekszible | 2 +
.../examples/getting-started/config-configmap.yaml | 1 +
.../examples/getting-started/kustomization.yaml} | 20 +-
.../dist/src/main/k8s/examples/minikube/Flekszible | 2 +
.../k8s/examples/minikube/config-configmap.yaml | 1 +
.../examples/minikube/kustomization.yaml} | 20 +-
.../src/main/k8s/examples/ozone-dev/Flekszible | 1 +
.../k8s/examples/ozone-dev/config-configmap.yaml | 1 +
.../main/k8s/examples/ozone-dev/kustomization.yaml | 31 +-
.../dist/src/main/k8s/examples/ozone-ha/Flekszible | 3 +
.../examples/ozone-ha/kustomization.yaml} | 16 +-
.../dist/src/main/k8s/examples/ozone/Flekszible | 3 +-
.../main/k8s/examples/ozone/config-configmap.yaml | 1 +
.../examples/ozone/kustomization.yaml} | 16 +-
.../src/main/smoketest/admincli/datanode.robot | 6 +-
.../debug/ozone-debug-corrupt-block.robot | 41 ++
.../debug/ozone-debug-dead-datanode.robot | 44 ++
.../debug/ozone-debug-stale-datanode.robot | 45 ++
.../main/smoketest/debug/ozone-debug-tests.robot | 58 +++
.../src/main/smoketest/debug/ozone-debug.robot | 64 ++-
.../src/main/smoketest/s3/MultipartUpload.robot | 21 +-
.../dist/src/main/smoketest/s3/bucketlist.robot | 7 +-
.../dist/src/main/smoketest/s3/commonawslib.robot | 36 ++
.../hadoop/ozone/TestAllMiniChaosOzoneCluster.java | 2 +-
.../hadoop/ozone/insight/TestBaseInsightPoint.java | 7 +-
.../hadoop/fs/ozone/TestOzoneFileSystem.java | 2 +-
.../fs/ozone/TestOzoneFileSystemWithLinks.java | 14 +-
.../hadoop/fs/ozone/TestRootedOzoneFileSystem.java | 2 +-
.../hadoop/hdds/scm/TestRatisPipelineLeader.java | 4 +-
.../hadoop/hdds/scm/TestSCMInstallSnapshot.java | 6 +-
.../apache/hadoop/hdds/scm/TestSCMSnapshot.java | 5 +-
.../TestContainerStateManagerIntegration.java | 28 +-
.../metrics/TestSCMContainerManagerMetrics.java | 4 +-
.../hdds/scm/pipeline/TestLeaderChoosePolicy.java | 10 +-
.../hdds/scm/pipeline/TestNode2PipelineMap.java | 2 +-
.../hadoop/hdds/scm/pipeline/TestNodeFailure.java | 2 +-
.../hdds/scm/pipeline/TestPipelineClose.java | 4 +-
.../TestRatisPipelineCreateAndDestroy.java | 14 +-
.../hadoop/hdds/scm/pipeline/TestSCMRestart.java | 6 +-
.../safemode/TestSCMSafeModeWithPipelineRules.java | 7 +-
.../org/apache/hadoop/ozone/MiniOzoneCluster.java | 2 +
.../apache/hadoop/ozone/MiniOzoneClusterImpl.java | 14 +-
...OutputUtil.java => StandardOutputTestBase.java} | 2 +-
.../hadoop/ozone/TestContainerOperations.java | 35 +-
.../apache/hadoop/ozone/TestMiniOzoneCluster.java | 2 +-
.../hadoop/ozone/TestMiniOzoneOMHACluster.java | 2 +-
.../hadoop/ozone/TestSecureOzoneCluster.java | 13 +-
.../hadoop/ozone/TestStorageContainerManager.java | 5 +-
.../ozone/client/TestOzoneClientFactory.java | 75 ++++
.../apache/hadoop/ozone/client/rpc/TestBCSID.java | 7 +-
.../rpc/TestCloseContainerHandlingByClient.java | 14 +-
.../client/rpc/TestContainerStateMachine.java | 4 +-
.../TestContainerStateMachineFailureOnRead.java | 2 +-
.../rpc/TestContainerStateMachineFlushDelay.java | 14 +-
.../client/rpc/TestDeleteWithSlowFollower.java | 10 +-
.../client/rpc/TestFailureHandlingByClient.java | 124 +++++-
.../rpc/TestFailureHandlingByClientFlushDelay.java | 8 +-
.../rpc/TestMultiBlockWritesWithDnFailures.java | 10 +-
.../client/rpc/TestOzoneAtRestEncryption.java | 28 +-
.../client/rpc/TestOzoneRpcClientAbstract.java | 29 ++
.../rpc/TestOzoneRpcClientForAclAuditLog.java | 3 +-
.../ozone/client/rpc/TestSecureOzoneRpcClient.java | 6 +-
.../ozone/client/rpc/read/TestKeyInputStream.java | 2 +-
.../ozone/container/TestContainerReplication.java | 2 +-
.../apache/hadoop/ozone/container/TestHelper.java | 8 +-
.../commandhandler/TestBlockDeletion.java | 9 +-
.../TestCloseContainerByPipeline.java | 8 +-
.../commandhandler/TestCloseContainerHandler.java | 2 +-
.../commandhandler/TestDeleteContainerHandler.java | 2 +-
...ler.java => TestRefreshVolumeUsageHandler.java} | 121 +++---
.../transport/server/ratis/TestCSMMetrics.java | 3 +-
.../container/ozoneimpl/TestOzoneContainer.java | 25 +-
.../ozoneimpl/TestOzoneContainerWithTLS.java | 6 +-
.../server/TestSecureContainerServer.java | 10 -
.../hadoop/ozone/fsck/TestContainerMapper.java | 16 +-
.../apache/hadoop/ozone/om/TestBucketOwner.java | 27 +-
.../ozone/om/TestContainerReportWithKeys.java | 7 +-
.../apache/hadoop/ozone/om/TestKeyManagerImpl.java | 36 +-
.../apache/hadoop/ozone/om/TestObjectStore.java | 12 +-
.../hadoop/ozone/om/TestOmBlockVersioning.java | 2 +-
.../org/apache/hadoop/ozone/om/TestOmLDBCli.java | 5 +-
.../hadoop/ozone/om/TestOzoneManagerRestart.java | 47 ++-
.../hadoop/ozone/om/TestSecureOzoneManager.java | 3 +-
.../hadoop/ozone/recon/TestReconAsPassiveScm.java | 8 +-
.../hadoop/ozone/recon/TestReconScmSnapshot.java | 2 +-
.../apache/hadoop/ozone/recon/TestReconTasks.java | 2 +-
.../ozone/recon/TestReconWithOzoneManager.java | 7 +-
.../ozone/recon/TestReconWithOzoneManagerHA.java | 2 +-
.../hadoop/ozone/scm/TestFailoverWithSCMHA.java | 5 +-
.../ozone/scm/TestSCMInstallSnapshotWithHA.java | 2 +-
.../org/apache/hadoop/ozone/scm/TestSCMMXBean.java | 4 +-
.../ozone/scm/TestStorageContainerManagerHA.java | 2 +-
.../hadoop/ozone/scm/TestXceiverClientGrpc.java | 2 +-
.../scm/node/TestDecommissionAndMaintenance.java | 6 +-
.../ozone/scm/pipeline/TestSCMPipelineMetrics.java | 2 +-
.../hadoop/ozone/shell/TestNSSummaryAdmin.java | 4 +-
.../src/main/proto/OmClientProtocol.proto | 1 +
.../hadoop/ozone/om/codec/OmKeyInfoCodec.java | 6 +-
.../ozone/om/codec/RepeatedOmKeyInfoCodec.java | 6 +-
.../hadoop/ozone/om/codec/TestOmKeyInfoCodec.java | 4 +-
.../om/codec/TestOmMultipartKeyInfoCodec.java | 3 +-
.../ozone/om/codec/TestRepeatedOmKeyInfoCodec.java | 3 +-
.../hadoop/ozone/om/DirectoryDeletingService.java | 7 +-
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 106 ++---
.../java/org/apache/hadoop/ozone/om/OMMetrics.java | 10 +
.../org/apache/hadoop/ozone/om/OzoneManager.java | 1 +
.../hadoop/ozone/om/OzonePrefixPathImpl.java | 20 +
.../hadoop/ozone/om/TrashOzoneFileSystem.java | 1 +
.../hadoop/ozone/om/codec/OMDBDefinition.java | 10 +-
.../hadoop/ozone/om/request/OMClientRequest.java | 15 +-
.../om/request/bucket/OMBucketCreateRequest.java | 8 +-
.../om/request/bucket/OMBucketDeleteRequest.java | 9 +-
.../file/OMDirectoryCreateRequestWithFSO.java | 5 +-
.../ozone/om/request/file/OMFileRequest.java | 4 +-
.../ozone/om/request/key/OMKeyCommitRequest.java | 52 +--
.../om/request/key/OMKeyCommitRequestWithFSO.java | 20 +-
.../om/request/key/OMKeyDeleteRequestWithFSO.java | 2 +-
.../om/request/key/OMKeyRenameRequestWithFSO.java | 2 +-
.../hadoop/ozone/om/request/key/OMKeyRequest.java | 27 ++
.../S3MultipartUploadCompleteRequest.java | 64 ++-
.../S3MultipartUploadCompleteRequestWithFSO.java | 12 +-
.../response/key/OMKeyRenameResponseWithFSO.java | 3 +-
.../om/response/key/OMKeysRenameResponse.java | 10 +
.../multipart/S3MultipartUploadAbortResponse.java | 6 +-
.../S3MultipartUploadCommitPartResponse.java | 6 +-
.../S3MultipartUploadCompleteResponse.java | 33 +-
.../S3MultipartUploadCompleteResponseWithFSO.java | 9 +-
...OzoneManagerProtocolServerSideTranslatorPB.java | 2 +-
.../protocolPB/OzoneManagerRequestHandler.java | 2 +
.../ozone/om/ScmBlockLocationTestingClient.java | 2 +-
.../hadoop/ozone/om/TestBucketManagerImpl.java | 15 +-
.../hadoop/ozone/om/TestKeyDeletingService.java | 2 +-
.../apache/hadoop/ozone/om/TestKeyManagerUnit.java | 14 +-
.../hadoop/ozone/om/TestOzoneManagerStarter.java | 4 +-
.../apache/hadoop/ozone/om/TestTrashService.java | 4 +-
....java => TestOMBucketDeleteRequestWithFSO.java} | 72 +---
.../request/key/TestOMKeyDeleteRequestWithFSO.java | 97 ++++-
.../ozone/om/request/key/TestOMKeyRequest.java | 2 +-
.../TestS3MultipartUploadCompleteRequest.java | 32 +-
.../om/response/key/TestOMKeyDeleteResponse.java | 3 +-
.../s3/multipart/TestS3MultipartResponse.java | 19 +-
...stS3MultipartUploadCompleteResponseWithFSO.java | 17 +-
.../ozone/security/TestAWSV4AuthValidator.java | 2 +-
.../security/acl/TestOzoneNativeAuthorizer.java | 8 +-
.../hadoop/ozone/security/acl/TestParentAcl.java | 2 +-
.../hadoop/ozone/security/acl/TestVolumeOwner.java | 2 +-
hadoop-ozone/ozonefs-shaded/pom.xml | 4 +
.../hadoop/ozone/recon/ReconControllerModule.java | 2 +
.../org/apache/hadoop/ozone/recon/ReconServer.java | 125 ++++++
.../org/apache/hadoop/ozone/recon/ReconUtils.java | 29 ++
.../recon/metrics/OzoneManagerSyncMetrics.java | 12 +
.../recon/metrics/ReconTaskStatusMetrics.java | 83 ++++
.../hadoop/ozone/recon/scm/ReconNodeManager.java | 18 +-
.../ozone/recon/scm/ReconPipelineManager.java | 4 +-
.../hadoop/ozone/recon/scm/ReconStorageConfig.java | 61 ++-
.../scm/ReconStorageContainerManagerFacade.java | 11 +-
.../spi/impl/OzoneManagerServiceProviderImpl.java | 14 +-
.../impl/StorageContainerServiceProviderImpl.java | 20 +-
.../ozone/recon/OMMetadataManagerTestUtils.java | 12 +-
.../ozone/recon/api/TestContainerEndpoint.java | 2 +-
.../hadoop/ozone/recon/api/TestEndpoints.java | 7 +-
.../ozone/recon/api/TestOpenContainerCount.java | 16 +-
.../recon/fsck/TestContainerHealthStatus.java | 4 +-
.../ozone/recon/fsck/TestContainerHealthTask.java | 6 +-
.../TestContainerHealthTaskRecordGenerator.java | 3 +-
.../recovery/TestReconOmMetadataManagerImpl.java | 4 +-
.../scm/AbstractReconContainerManagerTest.java | 20 +-
.../ozone/recon/scm/TestReconContainerManager.java | 2 +-
.../ozone/recon/scm/TestReconNodeManager.java | 12 +-
.../ozone/recon/scm/TestReconPipelineManager.java | 15 +-
.../impl/TestReconNamespaceSummaryManagerImpl.java | 6 +-
.../recon/tasks/TestContainerKeyMapperTask.java | 4 +-
.../ozone/recon/tasks/TestNSSummaryTask.java | 4 +-
.../ozone/recon/tasks/TestOMDBUpdatesHandler.java | 4 +-
.../hadoop/ozone/s3/OzoneClientProducer.java | 14 +-
.../ozone/s3/endpoint/ListBucketResponse.java | 6 +-
.../hadoop/ozone/s3/exception/S3ErrorTable.java | 9 +
.../hadoop/ozone/client/OzoneBucketStub.java | 3 +-
.../apache/hadoop/ozone/debug/ChunkKeyHandler.java | 3 +-
.../apache/hadoop/ozone/debug/ReadReplicas.java | 5 +-
.../ozone/freon/LeaderAppendLogEntryGenerator.java | 2 +-
.../apache/hadoop/ozone/freon/OmKeyGenerator.java | 2 +-
.../hadoop/ozone/freon/SCMThroughputBenchmark.java | 2 +-
.../freon/containergenerator/GeneratorOm.java | 5 +-
.../freon/containergenerator/GeneratorScm.java | 4 +-
.../apache/hadoop/ozone/fsck/ContainerMapper.java | 5 +-
.../apache/hadoop/ozone/freon/TestProgressBar.java | 6 +-
pom.xml | 19 +-
429 files changed, 6520 insertions(+), 2893 deletions(-)
rename
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/{DatanodeVersions.java
=> ComponentVersion.java} (67%)
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/DatanodeVersion.java
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/ClientVersion.java
delete mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/ClientVersions.java
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/OzoneManagerVersion.java
create mode 100644
hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/TestComponentVersionInvariants.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/interfaces/ContainerInspector.java
copy
hadoop-hdds/container-service/src/{test/java/org/apache/hadoop/ozone/container/common/report/package-info.java
=>
main/java/org/apache/hadoop/ozone/container/common/report/IncrementalReportSender.java}
(75%)
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/utils/ContainerInspectorUtil.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/KeyValueContainerMetadataInspector.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/protocol/commands/RefreshVolumeUsageCommand.java
copy
hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/keyvalue/{TestKeyValueContainerCheck.java
=> TestKeyValueContainerIntegrityChecks.java} (52%)
create mode 100644
hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/keyvalue/TestKeyValueContainerMetadataInspector.java
create mode 100644 hadoop-hdds/docs/dev-support/bin/make_images_responsive.py
copy
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/certificate/client/{OMCertificateClient.java
=> CommonCertificateClient.java} (51%)
copy
hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/exception/BadRequestExceptionMapper.java
=>
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/certificate/client/ReconCertificateClient.java
(57%)
rename
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/server/events/{FixedThreadPoolExecutor.java
=> FixedThreadPoolWithAffinityExecutor.java} (59%)
delete mode 100644
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/db/cache/EpochEntry.java
rename
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/ha/{MockSCMHADBTransactionBuffer.java
=> SCMHADBTransactionBufferStub.java} (92%)
rename
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/ha/{MockSCMHAManager.java
=> SCMHAManagerStub.java} (91%)
create mode 100644 hadoop-ozone/dist/src/main/k8s/README.md
copy
hadoop-ozone/dist/src/main/{compose/common/grafana/provisioning/dashboards/dashboards.yml
=> k8s/examples/getting-started/kustomization.yaml} (71%)
mode change 100755 => 100644
copy
hadoop-ozone/dist/src/main/{compose/common/grafana/provisioning/dashboards/dashboards.yml
=> k8s/examples/minikube/kustomization.yaml} (71%)
mode change 100755 => 100644
copy hadoop-hdds/server-scm/src/test/resources/rack-mapping =>
hadoop-ozone/dist/src/main/k8s/examples/ozone-dev/kustomization.yaml (56%)
copy
hadoop-ozone/dist/src/main/{compose/common/grafana/provisioning/dashboards/dashboards.yml
=> k8s/examples/ozone-ha/kustomization.yaml} (78%)
mode change 100755 => 100644
copy
hadoop-ozone/dist/src/main/{compose/common/grafana/provisioning/dashboards/dashboards.yml
=> k8s/examples/ozone/kustomization.yaml} (78%)
mode change 100755 => 100644
create mode 100644
hadoop-ozone/dist/src/main/smoketest/debug/ozone-debug-corrupt-block.robot
create mode 100644
hadoop-ozone/dist/src/main/smoketest/debug/ozone-debug-dead-datanode.robot
create mode 100644
hadoop-ozone/dist/src/main/smoketest/debug/ozone-debug-stale-datanode.robot
create mode 100644
hadoop-ozone/dist/src/main/smoketest/debug/ozone-debug-tests.robot
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/{TestStandardOutputUtil.java
=> StandardOutputTestBase.java} (98%)
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/TestOzoneClientFactory.java
copy
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/container/common/statemachine/commandhandler/{TestCloseContainerHandler.java
=> TestRefreshVolumeUsageHandler.java} (55%)
copy
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/bucket/{TestOMBucketDeleteRequest.java
=> TestOMBucketDeleteRequestWithFSO.java} (54%)
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/metrics/ReconTaskStatusMetrics.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
