This is an automated email from the ASF dual-hosted git repository.
szetszwo pushed a change to branch HDDS-4454
in repository https://gitbox.apache.org/repos/asf/ozone.git.
omit ced177b HDDS-5895. [Ozone-Streaming] Make
raft.server.data-stream.client.pool.size configurable (#2766)
omit abeec5a HDDS-5674.[Ozone-Streaming] Handle client retries on
exception (#2701)
omit edbcf28 HDDS-5849. [Ozone-Streaming]Write exceptions occur after
checksum is enabled (#2729)
omit c9ca832 HDDS-5486. [Ozone-Streaming] Streaming supports writing in
Pipline mode (#2682)
omit d22551d HDDS-5742. Avoid unnecessary Bytebuffer conversions (#2673)
omit 14ba242 HDDS-5705. [Ozone-Streaming] Change ByteBufStreamOutput to
ByteBufferStreamOutput (#2603)
omit d9cbd7d HDDS-5599. [Ozone-Streaming]drop BufferPool and ChunkBuffer
to avoid buffer copying (#2557)
omit a710076 HDDS-5488. [Ozone-Streaming] Add a new
BlockOutputStream/KeyOutputStream to support streaming api (#2495)
omit 501dc12 HDDS-5480. [Ozone-Streaming] Client and server should support
stream setup. (#2452)
omit b98d551 HDDS-5481. Fix stream() and link() method in
ContainerStateMachine. (#2451)
omit 11860d3 HDDS-5452. Add link method to ContainerStateMachine for Ratis
streaming (#2422)
omit 8ea027b HDDS-5366. [Ozone-Streaming] Implement stream method to
ContainerStateMachine. (#2358). Contributed by mingchao zhao
add bc81dcf HDDS-5734. add a command to trigger datanode executing du
immediately (#2685)
add a1701e5 HDDS-5850. Update default value of
'ozone.scm.ha.ratis.segment.size' and 'preallocated.size' to improve SCM write
perf. (#2732)
add 7d79d73 HDDS-5812. Increase Ratis version to 2.2.0 (#2753)
add fbb8cf0 HDDS-5794. The misleading "No available thread in pool for
past * second" log message in DN StateContext (#2693)
add 996518a HDDS-5860. Shade Jackson for Ozone Filesystem (#2744)
add 42d3de3 HDDS-5725. Catch possible AlreadyExistsException for create
pipeline command. (#2623)
add 2a4fcde HDDS-5888. Handle InterruptedException in OzoneClientProducer
and ContainerBalancer (#2761)
add ba038e4 HDDS-5875. Do not cache tokens as part of Key Information.
(#2754)
add 2a4bc83 HDDS-5461. Move old objects to delete table on overwrite
(#2433)
add 6e5db67 HDDS-5871. Fix ContainerBalancerConfiguration annotation
string (#2762)
add d8d42b5 HDDS-5868. Change getBucketInfo annotation (#2749)
add 0828afc HDDS-5843. SCM terminates when adding container to a pipeline
during startup (#2745)
add c5aaad8 HDDS-3371. Cleanup of old write-path of key in OM (#2703)
add fc666fa HDDS-5893. Potential data loss on multipart upload commit
(#2763)
add a51822f HDDS-5882 Changes to protobuf messages for HDDS-5881 (#2774)
add f133303 HDDS-5707. List container supports replication factor filter.
(#2606)
add 990db75 HDDS-5835. Follow up task to use bucket layout specific DB
table in OmMetadataManager.getKeyTable() - part2 (#2751)
add 0906337 HDDS-5902 Ambiguous OM kerberos keytab settings (#2769)
new 471cadb HDDS-5366. [Ozone-Streaming] Implement stream method to
ContainerStateMachine. (#2358). Contributed by mingchao zhao
new 7787247 HDDS-5452. Add link method to ContainerStateMachine for Ratis
streaming (#2422)
new 6211d74 HDDS-5481. Fix stream() and link() method in
ContainerStateMachine. (#2451)
new b9368a5 HDDS-5480. [Ozone-Streaming] Client and server should support
stream setup. (#2452)
new 8f9924e HDDS-5488. [Ozone-Streaming] Add a new
BlockOutputStream/KeyOutputStream to support streaming api (#2495)
new f6f8715 HDDS-5599. [Ozone-Streaming]drop BufferPool and ChunkBuffer
to avoid buffer copying (#2557)
new c6950c7 HDDS-5705. [Ozone-Streaming] Change ByteBufStreamOutput to
ByteBufferStreamOutput (#2603)
new 64dab05 HDDS-5742. Avoid unnecessary Bytebuffer conversions (#2673)
new 51664a3 HDDS-5486. [Ozone-Streaming] Streaming supports writing in
Pipline mode (#2682)
new 26dd5cd HDDS-5849. [Ozone-Streaming]Write exceptions occur after
checksum is enabled (#2729)
new 4480394 HDDS-5674.[Ozone-Streaming] Handle client retries on
exception (#2701)
new 976b141 HDDS-5895. [Ozone-Streaming] Make
raft.server.data-stream.client.pool.size configurable (#2766)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (ced177b)
\
N -- N -- N refs/heads/HDDS-4454 (976b141)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 12 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../hadoop/hdds/fs/CachingSpaceUsageSource.java | 23 +-
.../org/apache/hadoop/hdds/scm/ScmConfigKeys.java | 4 +-
.../apache/hadoop/hdds/scm/client/ScmClient.java | 7 +-
.../hadoop/hdds/scm/container/ContainerInfo.java | 4 +
.../protocol/StorageContainerLocationProtocol.java | 20 +
.../common/src/main/resources/ozone-default.xml | 16 +-
.../common/statemachine/DatanodeStateMachine.java | 6 +-
.../common/statemachine/StateContext.java | 14 +-
.../CreatePipelineCommandHandler.java | 10 +-
....java => RefreshVolumeUsageCommandHandler.java} | 67 +-
.../container/common/volume/MutableVolumeSet.java | 4 +
.../container/common/volume/StorageVolume.java | 4 +
.../ozone/container/common/volume/VolumeInfo.java | 8 +-
.../ozone/container/common/volume/VolumeUsage.java | 3 +
...inerLocationProtocolClientSideTranslatorPB.java | 12 +-
.../src/main/proto/ScmAdminProtocol.proto | 1 +
.../proto/ScmServerDatanodeHeartbeatProtocol.proto | 1 +
.../scm/container/ContainerStateManagerImpl.java | 4 +-
.../scm/container/balancer/ContainerBalancer.java | 4 +-
.../balancer/ContainerBalancerConfiguration.java | 2 +-
.../hadoop/hdds/scm/pipeline/PipelineManager.java | 10 +
.../hdds/scm/pipeline/PipelineManagerImpl.java | 7 +
.../hdds/scm/pipeline/PipelineStateManager.java | 5 +
.../scm/pipeline/PipelineStateManagerImpl.java | 12 +
.../hadoop/hdds/scm/pipeline/PipelineStateMap.java | 27 +
...inerLocationProtocolServerSideTranslatorPB.java | 6 +-
.../hdds/scm/server/SCMClientProtocolServer.java | 47 +-
.../hdds/scm/pipeline/MockPipelineManager.java | 6 +
.../hdds/scm/pipeline/TestPipelineManagerImpl.java | 26 +
.../hdds/scm/cli/ContainerOperationClient.java | 5 +-
.../hdds/scm/cli/container/ListSubcommand.java | 6 +-
.../main/java/org/apache/hadoop/ozone/OmUtils.java | 2 +-
.../org/apache/hadoop/ozone/om/OMConfigKeys.java | 2 -
.../apache/hadoop/ozone/om/helpers/OmKeyInfo.java | 14 +-
.../ozone/om/protocol/OzoneManagerProtocol.java | 168 ++++-
.../src/main/smoketest/admincli/container.robot | 8 +
.../dev-support/findbugsExcludeFile.xml | 4 +
.../hadoop/fs/ozone/TestOzoneFileSystem.java | 24 +-
.../client/rpc/TestOzoneRpcClientAbstract.java | 101 ++-
.../commandhandler/TestBlockDeletion.java | 10 +-
.../hadoop/ozone/om/TestOmBlockVersioning.java | 27 +-
.../org/apache/hadoop/ozone/om/TestOmMetrics.java | 273 ++++---
.../ozone/recon/TestReconWithOzoneManager.java | 19 +-
.../hadoop/ozone/shell/TestOzoneShellHA.java | 14 +
.../src/main/proto/OmClientProtocol.proto | 11 +
.../apache/hadoop/ozone/om/OMMetadataManager.java | 2 -
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 2 +-
.../java/org/apache/hadoop/ozone/om/OMMetrics.java | 14 +
.../hadoop/ozone/om/OmMetadataManagerImpl.java | 11 -
.../org/apache/hadoop/ozone/om/OzoneManager.java | 782 +--------------------
.../ozone/om/request/file/OMFileRequest.java | 17 +
.../ozone/om/request/key/OMKeyCommitRequest.java | 76 +-
.../om/request/key/OMKeyCommitRequestWithFSO.java | 26 +-
.../hadoop/ozone/om/request/key/OMKeyRequest.java | 23 +-
.../ozone/om/request/key/OMKeysRenameRequest.java | 9 +-
.../ozone/om/response/key/OMKeyCommitResponse.java | 18 +-
.../response/key/OMKeyCommitResponseWithFSO.java | 11 +-
.../om/response/key/OMKeysRenameResponse.java | 11 +-
.../response/key/OMPathsPurgeResponseWithFSO.java | 4 +-
.../om/response/key/OMTrashRecoverResponse.java | 2 +-
.../S3MultipartUploadCompleteResponse.java | 4 +-
.../protocolPB/OzoneManagerRequestHandler.java | 25 -
.../hadoop/ozone/om/TestBucketManagerImpl.java | 8 +-
.../ozone/om/request/TestOMRequestUtils.java | 37 +-
.../om/request/key/TestOMKeyCommitRequest.java | 71 +-
.../request/key/TestOMKeyCommitRequestWithFSO.java | 2 +-
.../om/request/key/TestOMKeyCreateRequest.java | 4 +-
.../ozone/om/request/key/TestOMKeyRequest.java | 2 +
.../om/response/key/TestOMKeyCommitResponse.java | 28 +-
.../key/TestOMKeyCommitResponseWithFSO.java | 5 +-
.../ozone/om/response/key/TestOMKeyResponse.java | 3 +
...stS3MultipartUploadCompleteResponseWithFSO.java | 73 +-
.../hadoop/ozone/security/acl/TestParentAcl.java | 21 +-
hadoop-ozone/ozonefs-shaded/pom.xml | 2 +
.../hadoop/ozone/recon/api/ContainerEndpoint.java | 9 +-
.../ozone/recon/tasks/ContainerKeyMapperTask.java | 8 +-
.../ozone/recon/tasks/FileSizeCountTask.java | 8 +-
.../ozone/recon/api/TestContainerEndpoint.java | 8 +-
.../hadoop/ozone/recon/api/TestEndpoints.java | 7 +-
.../recovery/TestReconOmMetadataManagerImpl.java | 25 +-
.../impl/TestOzoneManagerServiceProviderImpl.java | 17 +-
.../recon/tasks/TestContainerKeyMapperTask.java | 9 +-
.../ozone/recon/tasks/TestFileSizeCountTask.java | 9 +-
.../ozone/recon/tasks/TestNSSummaryTask.java | 14 +-
.../ozone/recon/tasks/TestOMDBUpdatesHandler.java | 30 +-
.../hadoop/ozone/s3/OzoneClientProducer.java | 16 +-
.../apache/hadoop/ozone/fsck/ContainerMapper.java | 7 +-
pom.xml | 2 +-
88 files changed, 1311 insertions(+), 1199 deletions(-)
copy
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/statemachine/commandhandler/{ReplicateContainerCommandHandler.java
=> RefreshVolumeUsageCommandHandler.java} (51%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
