This is an automated email from the ASF dual-hosted git repository.
szetszwo pushed a change to branch HDDS-4454
in repository https://gitbox.apache.org/repos/asf/ozone.git.
omit 99ddf5a HDDS-5851. [Ozone-Streaming] Define a PutBlock/maxBuffer
fixed boundary for streaming writes. (#2866)
omit 320ae54 HDDS-5743.[Ozone-Streaming] Add option to write files via
streaming api in ofs and o3fs. (#2770)
omit f400954 HDDS-5879. [Ozone-Streaming] OzoneBucket add the
createMultipartStreamKey method (#2760)
omit 153ef3e HDDS-5961. [Ozone-Streaming] update the usage space of
Containers in the stream write (#2833)
omit b3d995b HDDS-5987. [Ozone-Streaming] Add XceiverClientRatis stream
config (#2841)
omit 64c9933 HDDS-5763. Provide an Executor for each LocalStream in
ContainerStateMachine (#2782)
omit 573f718 HDDS-5895. [Ozone-Streaming] Make
raft.server.data-stream.client.pool.size configurable (#2766)
omit ed05656 HDDS-5674.[Ozone-Streaming] Handle client retries on
exception (#2701)
omit d90fd93 HDDS-5849. [Ozone-Streaming]Write exceptions occur after
checksum is enabled (#2729)
omit 836a67c HDDS-5486. [Ozone-Streaming] Streaming supports writing in
Pipline mode (#2682)
omit 27079cc HDDS-5742. Avoid unnecessary Bytebuffer conversions (#2673)
omit 7126b3b HDDS-5705. [Ozone-Streaming] Change ByteBufStreamOutput to
ByteBufferStreamOutput (#2603)
omit 8fd34de HDDS-5599. [Ozone-Streaming]drop BufferPool and ChunkBuffer
to avoid buffer copying (#2557)
omit d3226b6 HDDS-5488. [Ozone-Streaming] Add a new
BlockOutputStream/KeyOutputStream to support streaming api (#2495)
omit 91a4d82 HDDS-5480. [Ozone-Streaming] Client and server should support
stream setup. (#2452)
omit 8e8af7f HDDS-5481. Fix stream() and link() method in
ContainerStateMachine. (#2451)
omit 58b7209 HDDS-5452. Add link method to ContainerStateMachine for Ratis
streaming (#2422)
omit 3fe52be HDDS-5366. [Ozone-Streaming] Implement stream method to
ContainerStateMachine. (#2358). Contributed by mingchao zhao
add 5b0604d HDDS-5702. SCM remote benchmark tool. (#2600)
add 2341c7c HDDS-5936. Duplicate Test Ozone Shell invocation (#2803)
add 1892230 HDDS-6054. Fix resource leak due to OzoneManager.createOm
(#2876)
add ec77f6c HDDS-6000. Freon datanode chunk validator fails checksum
validation (#2850)
add 090672d HDDS-6055. Refactor isFileSystemOptimized usage in
OzoneManagerUtils (#2877)
add b69a3d1 HDDS-5959. Handles bucket layout validation logic in ofs/o3fs
client. (#2837)
add b8e1e8f HDDS-5999. Freon datanode chunk validator does not find
pipeline from param (#2879)
add 3012cd1 HDDS-6014. Add proto.lock files from ozone-1.2 release branch
to master (#2865)
add ef1f3d3 HDDS-5962. Limit grpc threads in XceiverServerGrpc. (#2824)
add d6e0e47 HDDS-5997 Centralize string based replication config
validation via ReplicationConfigValidator (#2871)
add 8ef63ec HDDS-6058. Bump aws-java-sdk to latest 1.12 (#2881)
add 66c581d HDDS-6041. [FSO] Revisit robot test cases related to
prefix/simple me… (#2885)
add ab3b731 HDDS-6061. Peer datanode cannot add group for pipeline in
secure env (#2882)
add e86119f HDDS-5965. Recon should be able to distinguish between
containers that have no replicas and those have all replicas as UNHEALTHY.
(#2874)
add 9c4bb72 HDDS-5973. Changed sequence of steps during pipeline close.
(#2847)
add df0489a HDDS-5903. Add Support for Bucket Owner Acls (#2826)
add 3097d2b HDDS-6059. Change Cannot close container log message from
WARN to DEBUG (#2890)
add ea53dc1 HDDS-3227. Ensure eviction of stateMachineData from cache
only when both followers catch up (#2704)
add 46c95ba HDDS-6067. Improve Debugging around unhealthy container state
on Datanode. (#2888)
add 937a3d0 HDDS-6071. ResourceLimitCache leaks permits (#2895)
add 176ef94 HDDS-5385. [FSO] Remove ozone.om.metadata.layout config in OM
(#2887)
add ab8cc32 HDDS-6073. Document: Fix images alignment in the doc pages
(#2898)
add d972c7b HDDS-6069: Fix XmlRootElement for CopyObjectResponse (#2891)
add 41f6844 HDDS-6046. Multi-threaded validator for freon
RandomKeyGenerator. (#2869)
add 8532e08 HDDS-6078. Move BucketManagerImpl#resolveLinkBucketLayout
into utilit… (#2902)
add 831b195 HDDS-5974. Remove OMClientResponse#getBucketLayout override
in subclasses - part1 (#2894)
add 173f46a HDDS-6085. Update log4j to 2.15 (#2906)
add 5dd1144 HDDS-6066. Cleanup OmService injection. (#2896)
add 0bc100a HDDS-6090. Collect output.log from acceptance tests (#2908)
add 8587de7 HDDS-6096. S3 copy object fails for source key with special
char (#2912)
add dfcc69c HDDS-6018 Closing state to quasiclosed (#2854)
add 09b06eb HDDS-6104. Update log4j version to 2.16.0 version. (#2920)
add 4d1b5da HDDS-6053. Fix too short container scrubber data scan
interval. (#2875)
add e1bef2c HDDS-6080. Simplify the logic in
SimpleContainerDownloader.getContainerDataFromReplicas (#2903)
add 47cd204 HDDS-6107. Exclude hugo lock file from source tarball (#2923)
add c4579ec HDDS-6089. Remove OMClientResponse#getBucketLayout override
in subclasses - part2 (#2915)
add b75ec9d HDDS-6072. Fix increased integration test execution time
(#2900)
add 56d0ebb HDDS-6105. remove db cache size config (#2922)
add af4730a HDDS-5912. Add description of hdds.datanode.dir in Getting
Started (#2783)
new 95860a8 HDDS-5366. [Ozone-Streaming] Implement stream method to
ContainerStateMachine. (#2358). Contributed by mingchao zhao
new 88c59bd HDDS-5452. Add link method to ContainerStateMachine for Ratis
streaming (#2422)
new e1b438a HDDS-5481. Fix stream() and link() method in
ContainerStateMachine. (#2451)
new dd6ee7b HDDS-5480. [Ozone-Streaming] Client and server should support
stream setup. (#2452)
new aaf2d2e HDDS-5488. [Ozone-Streaming] Add a new
BlockOutputStream/KeyOutputStream to support streaming api (#2495)
new 834ed01 HDDS-5599. [Ozone-Streaming]drop BufferPool and ChunkBuffer
to avoid buffer copying (#2557)
new feafa4f HDDS-5705. [Ozone-Streaming] Change ByteBufStreamOutput to
ByteBufferStreamOutput (#2603)
new 7aac0e0 HDDS-5742. Avoid unnecessary Bytebuffer conversions (#2673)
new b29c729 HDDS-5486. [Ozone-Streaming] Streaming supports writing in
Pipline mode (#2682)
new f4bccbb HDDS-5849. [Ozone-Streaming]Write exceptions occur after
checksum is enabled (#2729)
new fbc7e95 HDDS-5674.[Ozone-Streaming] Handle client retries on
exception (#2701)
new f8f740e HDDS-5895. [Ozone-Streaming] Make
raft.server.data-stream.client.pool.size configurable (#2766)
new ca623ff HDDS-5763. Provide an Executor for each LocalStream in
ContainerStateMachine (#2782)
new 7ed5729 HDDS-5987. [Ozone-Streaming] Add XceiverClientRatis stream
config (#2841)
new 29c9592 HDDS-5961. [Ozone-Streaming] update the usage space of
Containers in the stream write (#2833)
new 848f8cb HDDS-5879. [Ozone-Streaming] OzoneBucket add the
createMultipartStreamKey method (#2760)
new 6c2179b HDDS-5743. [Ozone-Streaming] Add option to write files via
streaming api in ofs and o3fs. (#2770)
new d1e4eea HDDS-5851. [Ozone-Streaming] Define a PutBlock/maxBuffer
fixed boundary for streaming writes. (#2866)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (99ddf5a)
\
N -- N -- N refs/heads/HDDS-4454 (d1e4eea)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 18 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../hadoop/hdds/client/RatisReplicationConfig.java | 27 +-
.../hdds/client/ReplicatedReplicationConfig.java} | 20 +-
.../hadoop/hdds/client/ReplicationConfig.java | 138 +--
.../hdds/client/ReplicationConfigValidator.java | 5 +-
.../hdds/client/StandaloneReplicationConfig.java | 23 +-
.../org/apache/hadoop/hdds/ratis/RatisHelper.java | 1 +
.../org/apache/hadoop/hdds/scm/ScmConfigKeys.java | 4 -
.../hadoop/hdds/scm/container/ContainerInfo.java | 3 +-
.../apache/hadoop/hdds/scm/pipeline/Pipeline.java | 2 +-
.../hadoop/hdds/utils/ResourceLimitCache.java | 7 +-
.../common/src/main/resources/ozone-default.xml | 53 -
.../hadoop/hdds/client/TestReplicationConfig.java | 280 +++---
.../hadoop/hdds/utils/TestResourceLimitCache.java | 46 +-
.../ozone/container/common/interfaces/Handler.java | 2 +-
.../common/statemachine/DatanodeConfiguration.java | 43 +
.../common/statemachine/DatanodeStateMachine.java | 2 +-
.../CloseContainerCommandHandler.java | 17 +-
.../common/transport/server/XceiverServerGrpc.java | 52 +-
.../server/ratis/ContainerStateMachine.java | 73 +-
.../transport/server/ratis/XceiverServerRatis.java | 2 +-
.../container/keyvalue/KeyValueContainer.java | 4 +
.../ozoneimpl/ContainerScrubberConfiguration.java | 65 +-
.../ozone/container/ozoneimpl/OzoneContainer.java | 11 +
.../container/replication/ContainerDownloader.java | 3 +-
.../replication/DownloadAndImportReplicator.java | 19 +-
.../replication/SimpleContainerDownloader.java | 39 +-
.../TestCloseContainerCommandHandler.java | 4 +-
.../TestContainerScrubberConfiguration.java | 97 ++
.../replication/TestReplicationSupervisor.java | 4 +-
.../replication/TestSimpleContainerDownloader.java | 13 +-
hadoop-hdds/docs/content/concept/Containers.md | 2 +-
hadoop-hdds/docs/content/concept/Datanodes.md | 4 +-
hadoop-hdds/docs/content/concept/OzoneManager.md | 6 +-
hadoop-hdds/docs/content/concept/Recon.md | 6 +-
hadoop-hdds/docs/content/feature/OM-HA.md | 5 +-
hadoop-hdds/docs/content/feature/PrefixFSO.md | 8 +-
hadoop-hdds/docs/content/feature/SCM-HA.md | 2 +-
hadoop-hdds/docs/content/start/OnPrem.md | 1 +
hadoop-hdds/docs/content/start/OnPrem.zh.md | 2 +
.../ozonedoc/layouts/shortcodes/image.html} | 7 +-
.../scm/protocol/ScmBlockLocationProtocol.java | 2 +-
.../interface-admin/src/main/resources/proto.lock | 504 ++++++++++
.../interface-client/src/main/proto/hdds.proto | 11 +
.../interface-client/src/main/resources/proto.lock | 408 +++++++-
.../interface-server/src/main/resources/proto.lock | 1024 ++++++++++++++++++++
.../scm/container/CloseContainerEventHandler.java | 12 +-
.../hdds/scm/container/ReplicationManager.java | 10 +-
.../org/apache/hadoop/hdds/scm/ha/SCMContext.java | 23 +-
.../scm/pipeline/BackgroundPipelineCreator.java | 2 +-
.../hdds/scm/pipeline/PipelineManagerImpl.java | 25 +-
...lockLocationProtocolServerSideTranslatorPB.java | 2 +-
.../hdds/scm/server/SCMClientProtocolServer.java | 4 +-
.../scm/server/upgrade/SCMUpgradeFinalizer.java | 5 +-
.../hdds/scm/node/TestContainerPlacement.java | 2 +-
.../hadoop/hdds/scm/node/TestDeadNodeHandler.java | 6 +
.../hadoop/hdds/scm/node/TestSCMNodeManager.java | 11 +-
.../scm/pipeline/MockRatisPipelineProvider.java | 2 +-
.../hdds/scm/pipeline/TestPipelineManagerImpl.java | 59 +-
.../scm/pipeline/TestPipelineStateManagerImpl.java | 8 +-
.../org/apache/hadoop/ozone/client/BucketArgs.java | 21 +-
.../apache/hadoop/ozone/client/OzoneBucket.java | 30 +
.../ozone/client/protocol/ClientProtocol.java | 1 +
.../apache/hadoop/ozone/client/rpc/RpcClient.java | 20 +-
.../org/apache/hadoop/ozone/om/OMConfigKeys.java | 11 -
.../hadoop/ozone/om/helpers/OmBucketInfo.java | 32 +-
.../apache/hadoop/ozone/om/helpers/OmKeyInfo.java | 2 +-
.../ozone/om/helpers/OmMultipartKeyInfo.java | 2 +-
.../hadoop/ozone/om/helpers/OzoneFSUtils.java | 17 +
...OzoneManagerProtocolClientSideTranslatorPB.java | 4 +-
hadoop-ozone/dev-support/checks/acceptance.sh | 5 +-
hadoop-ozone/dev-support/checks/kubernetes.sh | 4 +-
.../dist/src/main/assemblies/ozone-src.xml | 1 +
.../dist/src/main/compose/ozone-mr/common-config | 1 -
hadoop-ozone/dist/src/main/compose/ozone/README.md | 6 -
.../src/main/compose/ozone/docker-compose.yaml | 10 -
hadoop-ozone/dist/src/main/compose/ozone/run.sh | 4 -
hadoop-ozone/dist/src/main/compose/ozone/test.sh | 29 +-
.../src/main/compose/ozonesecure/docker-config | 1 -
.../dist/src/main/compose/xcompat/docker-config | 1 +
.../main/smoketest/basic/ozone-shell-single.robot | 2 +-
.../src/main/smoketest/basic/ozone-shell.robot | 15 +-
.../dist/src/main/smoketest/createmrenv.robot | 2 +-
.../dist/src/main/smoketest/freon/generate.robot | 9 +
.../dist/src/main/smoketest/freon/validate.robot | 9 +
.../dist/src/main/smoketest/ozonefs/setup.robot | 12 +-
.../dist/src/main/smoketest/s3/objectcopy.robot | 20 +-
.../dist/src/main/smoketest/s3/objectdelete.robot | 32 +-
.../src/main/smoketest/s3/objectmultidelete.robot | 24 +-
.../dist/src/main/smoketest/s3/objectputget.robot | 42 +-
.../main/smoketest/security/ozone-secure-fs.robot | 10 +-
.../hadoop/fs/ozone/TestOzoneFSInputStream.java | 4 +
.../hadoop/fs/ozone/TestOzoneFileInterfaces.java | 45 +
.../hadoop/fs/ozone/TestOzoneFileSystem.java | 7 +-
.../fs/ozone/TestOzoneFileSystemMissingParent.java | 2 +
.../fs/ozone/TestOzoneFileSystemWithLinks.java | 248 +++++
.../apache/hadoop/fs/ozone/TestOzoneFsHAURLs.java | 5 +
.../hadoop/fs/ozone/contract/OzoneContract.java | 5 +-
.../hdds/scm/pipeline/TestMultiRaftSetup.java | 4 +-
.../hadoop/hdds/upgrade/TestHDDSUpgrade.java | 2 +-
.../hadoop/ozone/TestStandardOutputUtil.java | 84 ++
.../rpc/TestContainerStateMachineFailures.java | 83 ++
.../rpc/TestOzoneClientMultipartUploadWithFSO.java | 4 +-
.../client/rpc/TestOzoneRpcClientAbstract.java | 9 +-
.../client/rpc/TestOzoneRpcClientWithRatis.java | 4 +-
.../hadoop/ozone/client/rpc/TestReadRetries.java | 14 +-
.../ozone/freon/TestHadoopDirTreeGenerator.java | 5 +-
.../freon/TestHadoopDirTreeGeneratorWithFSO.java | 4 +-
.../ozone/freon/TestHadoopNestedDirGenerator.java | 3 +
.../apache/hadoop/ozone/om/TestBucketOwner.java | 244 +++++
.../apache/hadoop/ozone/om/TestObjectStore.java | 2 +
.../org/apache/hadoop/ozone/om/TestOmAcls.java | 6 +-
.../hadoop/ozone/om/TestRecursiveAclWithFSO.java | 3 +-
.../hadoop/ozone/shell/TestNSSummaryAdmin.java | 120 ++-
.../src/main/proto/OmClientProtocol.proto | 1 +
.../interface-client/src/main/resources/proto.lock | 826 +++++++++++++++-
.../apache/hadoop/ozone/om/BucketManagerImpl.java | 57 +-
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 2 +-
.../org/apache/hadoop/ozone/om/OzoneAclUtils.java | 125 +++
.../org/apache/hadoop/ozone/om/OzoneManager.java | 96 +-
.../hadoop/ozone/om/OzoneManagerStarter.java | 16 +-
.../apache/hadoop/ozone/om/OzoneManagerUtils.java | 180 ++++
.../om/ratis/utils/OzoneManagerRatisUtils.java | 249 +----
.../hadoop/ozone/om/request/OMClientRequest.java | 90 +-
.../ozone/om/request/OMKeyRequestFactory.java | 139 +++
.../om/request/bucket/OMBucketCreateRequest.java | 1 -
.../om/request/file/OMDirectoryCreateRequest.java | 19 +-
.../file/OMDirectoryCreateRequestWithFSO.java | 2 +-
.../ozone/om/request/file/OMFileCreateRequest.java | 15 +-
.../request/file/OMFileCreateRequestWithFSO.java | 2 +-
.../om/request/key/OMAllocateBlockRequest.java | 18 +-
.../request/key/OMAllocateBlockRequestWithFSO.java | 4 +-
.../ozone/om/request/key/OMKeyCommitRequest.java | 15 +-
.../om/request/key/OMKeyCommitRequestWithFSO.java | 2 +-
.../ozone/om/request/key/OMKeyCreateRequest.java | 16 +-
.../om/request/key/OMKeyCreateRequestWithFSO.java | 2 +-
.../ozone/om/request/key/OMKeyDeleteRequest.java | 17 +-
.../om/request/key/OMKeyDeleteRequestWithFSO.java | 2 +-
.../ozone/om/request/key/OMKeyRenameRequest.java | 18 +-
.../om/request/key/OMKeyRenameRequestWithFSO.java | 5 +-
.../hadoop/ozone/om/request/key/OMKeyRequest.java | 9 +-
.../ozone/om/request/key/OMKeysDeleteRequest.java | 3 +-
.../om/request/key/OMPathsPurgeRequestWithFSO.java | 7 +-
.../om/request/key/OMTrashRecoverRequest.java | 2 +-
.../ozone/om/request/key/acl/OMKeyAclRequest.java | 28 +-
.../om/request/key/acl/OMKeyAclRequestWithFSO.java | 9 +-
.../om/request/key/acl/OMKeyAddAclRequest.java | 5 +-
.../request/key/acl/OMKeyAddAclRequestWithFSO.java | 8 +-
.../om/request/key/acl/OMKeyRemoveAclRequest.java | 4 +-
.../key/acl/OMKeyRemoveAclRequestWithFSO.java | 9 +-
.../om/request/key/acl/OMKeySetAclRequest.java | 4 +-
.../request/key/acl/OMKeySetAclRequestWithFSO.java | 8 +-
.../S3InitiateMultipartUploadRequest.java | 20 +-
.../S3InitiateMultipartUploadRequestWithFSO.java | 6 +-
.../multipart/S3MultipartUploadAbortRequest.java | 19 +-
.../S3MultipartUploadAbortRequestWithFSO.java | 4 +-
.../S3MultipartUploadCommitPartRequest.java | 17 +-
.../S3MultipartUploadCommitPartRequestWithFSO.java | 2 +-
.../S3MultipartUploadCompleteRequest.java | 21 +-
.../S3MultipartUploadCompleteRequestWithFSO.java | 5 +-
.../response/file/OMDirectoryCreateResponse.java | 10 +-
.../file/OMDirectoryCreateResponseWithFSO.java | 15 +-
.../om/response/file/OMFileCreateResponse.java | 6 +-
.../response/file/OMFileCreateResponseWithFSO.java | 5 +-
.../response/key/AbstractOMKeyDeleteResponse.java | 16 +-
.../om/response/key/OMAllocateBlockResponse.java | 13 +-
.../key/OMAllocateBlockResponseWithFSO.java | 14 +-
.../ozone/om/response/key/OMKeyCommitResponse.java | 11 +-
.../response/key/OMKeyCommitResponseWithFSO.java | 5 +-
.../ozone/om/response/key/OMKeyCreateResponse.java | 11 +-
.../response/key/OMKeyCreateResponseWithFSO.java | 6 +-
.../ozone/om/response/key/OMKeyDeleteResponse.java | 8 +-
.../response/key/OMKeyDeleteResponseWithFSO.java | 5 +-
.../ozone/om/response/key/OMKeyPurgeResponse.java | 3 +-
.../ozone/om/response/key/OMKeyRenameResponse.java | 18 +-
.../response/key/OMKeyRenameResponseWithFSO.java | 9 +-
.../om/response/key/OMKeysDeleteResponse.java | 6 +-
.../om/response/key/OMOpenKeysDeleteRequest.java | 2 +-
.../om/response/key/OMOpenKeysDeleteResponse.java | 6 +-
.../response/key/OMPathsPurgeResponseWithFSO.java | 13 +-
.../om/response/key/OMTrashRecoverResponse.java | 8 +-
.../key/OmKeyResponse.java} | 30 +-
.../om/response/key/acl/OMKeyAclResponse.java | 17 +-
.../response/key/acl/OMKeyAclResponseWithFSO.java | 16 +-
.../S3InitiateMultipartUploadResponse.java | 14 +-
.../S3InitiateMultipartUploadResponseWithFSO.java | 10 +-
.../multipart/S3MultipartUploadAbortResponse.java | 18 +-
.../S3MultipartUploadAbortResponseWithFSO.java | 13 +-
.../S3MultipartUploadCommitPartResponse.java | 14 +-
...S3MultipartUploadCommitPartResponseWithFSO.java | 9 +-
.../S3MultipartUploadCompleteResponse.java | 40 +-
.../S3MultipartUploadCompleteResponseWithFSO.java | 11 +-
.../hadoop/ozone/security/AWSV4AuthValidator.java | 10 -
.../ozone/om/request/TestOMRequestUtils.java | 24 +-
.../ozone/om/request/bucket/TestBucketRequest.java | 1 -
.../bucket/TestOMBucketCreateRequestWithFSO.java | 3 -
.../file/TestOMDirectoryCreateRequestWithFSO.java | 3 +-
.../ozone/om/request/key/TestOMKeyAclRequest.java | 10 +-
.../om/request/key/TestOMKeyAclRequestWithFSO.java | 16 +-
.../ozone/om/response/TestCleanupTableInfo.java | 5 +-
.../file/TestOMDirectoryCreateResponse.java | 2 +-
.../file/TestOMDirectoryCreateResponseWithFSO.java | 4 +-
.../response/key/TestOMAllocateBlockResponse.java | 2 +-
.../key/TestOMAllocateBlockResponseWithFSO.java | 2 +-
.../om/response/key/TestOMKeyRenameResponse.java | 6 +-
.../s3/multipart/TestS3MultipartResponse.java | 13 +-
.../TestS3MultipartUploadAbortResponseWithFSO.java | 6 +-
.../fs/ozone/BasicOzoneClientAdapterImpl.java | 18 +-
.../ozone/BasicRootedOzoneClientAdapterImpl.java | 17 +-
.../apache/hadoop/fs/ozone/OzoneClientUtils.java | 67 ++
.../recon/schema/ContainerSchemaDefinition.java | 3 +-
.../hadoop/ozone/recon/ReconServerConfigKeys.java | 4 -
.../codec/ContainerReplicaHistoryListCodec.java | 45 +-
.../ozone/recon/fsck/ContainerHealthStatus.java | 17 +-
.../persistence/ContainerHealthSchemaManager.java | 12 +-
.../ozone/recon/persistence/ContainerHistory.java | 9 +-
.../ozone/recon/scm/ContainerReplicaHistory.java | 27 +-
.../recon/scm/ContainerReplicaHistoryList.java | 32 +-
.../ozone/recon/scm/ReconContainerManager.java | 21 +-
.../scm/ReconStorageContainerManagerFacade.java | 5 +-
.../impl/ReconContainerMetadataManagerImpl.java | 4 +-
.../ozone/recon/spi/impl/ReconDBDefinition.java | 13 +-
.../ozone/recon/api/TestContainerEndpoint.java | 26 +-
.../ozone/recon/fsck/TestContainerHealthTask.java | 16 +-
.../ozone/recon/scm/TestReconContainerManager.java | 13 +-
.../ozone/recon/scm/TestReconPipelineManager.java | 5 +
.../hadoop/ozone/s3/OzoneClientProducer.java | 4 -
.../hadoop/ozone/s3/OzoneServiceProvider.java | 25 +-
.../ozone/s3/endpoint/CopyObjectResponse.java | 2 +-
.../hadoop/ozone/s3/endpoint/ObjectEndpoint.java | 19 +-
.../s3/signature/AuthorizationV4QueryParser.java | 5 +-
.../ozone/s3/signature/StringToSignProducer.java | 5 +-
.../apache/hadoop/ozone/s3/util/OzoneS3Util.java | 81 --
.../org/apache/hadoop/ozone/s3/util/S3Utils.java | 30 +-
.../hadoop/ozone/s3/endpoint/TestObjectPut.java | 15 +-
.../hadoop/ozone/s3/util/TestOzoneS3Util.java | 136 ---
.../ozone/admin/nssummary/DiskUsageSubCommand.java | 2 +-
.../admin/nssummary/FileSizeDistSubCommand.java | 2 +-
.../ozone/admin/nssummary/NSSummaryAdmin.java | 36 +-
.../ozone/admin/nssummary/NSSummaryCLIUtils.java | 8 +-
.../admin/nssummary/QuotaUsageSubCommand.java | 2 +-
.../ozone/admin/nssummary/SummarySubCommand.java | 2 +-
.../apache/hadoop/ozone/debug/PrefixParser.java | 12 +-
.../hadoop/ozone/freon/DatanodeChunkGenerator.java | 1 -
.../hadoop/ozone/freon/DatanodeChunkValidator.java | 155 ++-
.../java/org/apache/hadoop/ozone/freon/Freon.java | 3 +-
.../hadoop/ozone/freon/RandomKeyGenerator.java | 54 +-
.../hadoop/ozone/freon/SCMThroughputBenchmark.java | 908 +++++++++++++++++
.../ozone/genesis/BenchMarkContainerStateMap.java | 2 +-
.../ozone/shell/bucket/CreateBucketHandler.java | 14 +-
.../hadoop/ozone/shell/keys/CopyKeyHandler.java | 18 +-
.../hadoop/ozone/shell/keys/PutKeyHandler.java | 18 +-
pom.xml | 4 +-
252 files changed, 7192 insertions(+), 1831 deletions(-)
copy
hadoop-hdds/{container-service/src/main/java/org/apache/hadoop/ozone/container/stream/StreamingSource.java
=>
common/src/main/java/org/apache/hadoop/hdds/client/ReplicatedReplicationConfig.java}
(62%)
create mode 100644
hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/ozoneimpl/TestContainerScrubberConfiguration.java
copy hadoop-hdds/docs/{archetypes/default.md =>
themes/ozonedoc/layouts/shortcodes/image.html} (86%)
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileSystemWithLinks.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/TestStandardOutputUtil.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/TestBucketOwner.java
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneAclUtils.java
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManagerUtils.java
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/OMKeyRequestFactory.java
copy
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/{ratis/helpers/DoubleBufferEntry.java
=> response/key/OmKeyResponse.java} (56%)
create mode 100644
hadoop-ozone/ozonefs-common/src/main/java/org/apache/hadoop/fs/ozone/OzoneClientUtils.java
delete mode 100644
hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/util/OzoneS3Util.java
copy
hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/ClientVersions.java =>
hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/util/S3Utils.java
(60%)
delete mode 100644
hadoop-ozone/s3gateway/src/test/java/org/apache/hadoop/ozone/s3/util/TestOzoneS3Util.java
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/SCMThroughputBenchmark.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
