This is an automated email from the ASF dual-hosted git repository.
szetszwo pushed a change to branch HDDS-4454
in repository https://gitbox.apache.org/repos/asf/ozone.git.
omit 7ce4e01 HDDS-6130. [Ozone-Streaming] When releaseBuffers will get
“Couldn 't find the required future” (#2939)
omit cd143c5 HDDS-6039.Define a minimum packet size during streaming
writes. (#2883)
omit 89a12ad HDDS-5851. [Ozone-Streaming] Define a PutBlock/maxBuffer
fixed boundary for streaming writes. (#2866)
omit 41edd49 HDDS-5743. [Ozone-Streaming] Add option to write files via
streaming api in ofs and o3fs. (#2770)
omit 26877bd HDDS-5879. [Ozone-Streaming] OzoneBucket add the
createMultipartStreamKey method (#2760)
omit b1753e6 HDDS-5961. [Ozone-Streaming] update the usage space of
Containers in the stream write (#2833)
omit 7d462ac HDDS-5987. [Ozone-Streaming] Add XceiverClientRatis stream
config (#2841)
omit 38757c7 HDDS-5763. Provide an Executor for each LocalStream in
ContainerStateMachine (#2782)
omit 151b19a HDDS-5895. [Ozone-Streaming] Make
raft.server.data-stream.client.pool.size configurable (#2766)
omit 37d5755 HDDS-5674.[Ozone-Streaming] Handle client retries on
exception (#2701)
omit c756f97 HDDS-5849. [Ozone-Streaming]Write exceptions occur after
checksum is enabled (#2729)
omit 59475f4 HDDS-5486. [Ozone-Streaming] Streaming supports writing in
Pipline mode (#2682)
omit fa5f8d0 HDDS-5742. Avoid unnecessary Bytebuffer conversions (#2673)
omit fbe9ded HDDS-5705. [Ozone-Streaming] Change ByteBufStreamOutput to
ByteBufferStreamOutput (#2603)
omit f54627e HDDS-5599. [Ozone-Streaming]drop BufferPool and ChunkBuffer
to avoid buffer copying (#2557)
omit a4bb32f HDDS-5488. [Ozone-Streaming] Add a new
BlockOutputStream/KeyOutputStream to support streaming api (#2495)
omit d84c201 HDDS-5480. [Ozone-Streaming] Client and server should support
stream setup. (#2452)
omit cf6b269 HDDS-5481. Fix stream() and link() method in
ContainerStateMachine. (#2451)
omit 4e50144 HDDS-5452. Add link method to ContainerStateMachine for Ratis
streaming (#2422)
omit fec7521 HDDS-5366. [Ozone-Streaming] Implement stream method to
ContainerStateMachine. (#2358). Contributed by mingchao zhao
add 69e8617 HDDS-6125. Support Hugo 0.91.0. (#2934)
add e01b471 HDDS-5602. make it configurable to choose the nearest one as
the target in the candidates according to networkTopology (#2756)
add 26a9cdb HDDS-6101. use FileUtils.moveDirectory instead of Files.move
when installing snapshot (#2918)
add 6cd9211 HDDS-5975. Serve url-encoded key and prefix name for
ListObjectResponse (#2834)
add 9dc63a3 HDDS-5807. [FSO] Merge HDDS-4653 changes to support TDE for
MPU Keys in FSO bucket layout. (#2941)
add 97143b8 HDDS-6129. OM has thread unsafe issues that can cause OM
shutdown. (#2938)
add b570d0a HDDS-6070. ContainerBalancerConfig doesn't read config from
ozone-site.xml (#2893)
add 4ed3ef8 HDDS-6121. DatanodeAdminMonitor should log detailed
information for a limited number of containers (#2932)
add 9103aa0 HDDS-5993. Disable flaky
TestRandomKeyGenerator#cleanObjectsTest
add a5cc886 HDDS-5319 Intermittent failure in
TestSCMUpdateServiceGrpcServer (#2558)
add d6cbb15 HDDS-6143. Update log4j version to 2.17.1 (#2952)
new 03a8ba5 HDDS-5366. [Ozone-Streaming] Implement stream method to
ContainerStateMachine. (#2358). Contributed by mingchao zhao
new 939f270 HDDS-5452. Add link method to ContainerStateMachine for Ratis
streaming (#2422)
new 433979d HDDS-5481. Fix stream() and link() method in
ContainerStateMachine. (#2451)
new 27b112f HDDS-5480. [Ozone-Streaming] Client and server should support
stream setup. (#2452)
new 29754da HDDS-5488. [Ozone-Streaming] Add a new
BlockOutputStream/KeyOutputStream to support streaming api (#2495)
new e5fdb95 HDDS-5599. [Ozone-Streaming]drop BufferPool and ChunkBuffer
to avoid buffer copying (#2557)
new 435f8da HDDS-5705. [Ozone-Streaming] Change ByteBufStreamOutput to
ByteBufferStreamOutput (#2603)
new e6222f8 HDDS-5742. Avoid unnecessary Bytebuffer conversions (#2673)
new b3bbc00 HDDS-5486. [Ozone-Streaming] Streaming supports writing in
Pipline mode (#2682)
new 9f9b3a2 HDDS-5849. [Ozone-Streaming]Write exceptions occur after
checksum is enabled (#2729)
new 066b43d HDDS-5674.[Ozone-Streaming] Handle client retries on
exception (#2701)
new 9ad4ff5 HDDS-5895. [Ozone-Streaming] Make
raft.server.data-stream.client.pool.size configurable (#2766)
new 0872bd8 HDDS-5763. Provide an Executor for each LocalStream in
ContainerStateMachine (#2782)
new ad42ca4 HDDS-5987. [Ozone-Streaming] Add XceiverClientRatis stream
config (#2841)
new c659513 HDDS-5961. [Ozone-Streaming] update the usage space of
Containers in the stream write (#2833)
new bd13493 HDDS-5879. [Ozone-Streaming] OzoneBucket add the
createMultipartStreamKey method (#2760)
new 057726b HDDS-5743. [Ozone-Streaming] Add option to write files via
streaming api in ofs and o3fs. (#2770)
new bf634f3 HDDS-5851. [Ozone-Streaming] Define a PutBlock/maxBuffer
fixed boundary for streaming writes. (#2866)
new 839bc63 HDDS-6039. Define a minimum packet size during streaming
writes. (#2883)
new ab016f3 HDDS-6130. [Ozone-Streaming] When releaseBuffers will get
“Couldn 't find the required future” (#2939)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (7ce4e01)
\
N -- N -- N refs/heads/HDDS-4454 (ab016f3)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 20 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
hadoop-hdds/docs/config.yaml | 5 +
.../java/org/apache/hadoop/hdds/utils/HAUtils.java | 2 +-
...etGreedy.java => AbstractFindTargetGreedy.java} | 87 +++++----
.../scm/container/balancer/ContainerBalancer.java | 57 +++++-
.../balancer/ContainerBalancerConfiguration.java | 91 ++++------
.../FindTargetGreedyByNetworkTopology.java | 79 +++++++++
.../balancer/FindTargetGreedyByUsageInfo.java | 52 ++++++
.../hdds/scm/node/DatanodeAdminMonitorImpl.java | 24 +++
.../hdds/scm/server/SCMClientProtocolServer.java | 2 +-
.../hdds/scm/server/SCMDatanodeProtocolServer.java | 3 +-
.../hdds/scm/server/StorageContainerManager.java | 9 +-
.../container/balancer/TestContainerBalancer.java | 30 +++-
.../container/balancer/TestFindTargetStrategy.java | 196 +++++++++++++++++++++
.../server/TestSCMUpdateServiceGrpcServer.java | 8 +-
.../hadoop/ozone/om/helpers/RepeatedOmKeyInfo.java | 4 +
.../dist/src/main/smoketest/s3/awss3.robot | 8 +
.../client/rpc/TestOzoneAtRestEncryption.java | 27 ++-
.../hadoop/ozone/freon/TestRandomKeyGenerator.java | 1 +
.../ozone/om/codec/RepeatedOmKeyInfoCodec.java | 2 +-
.../ozone/om/codec/TestRepeatedOmKeyInfoCodec.java | 36 +++-
.../org/apache/hadoop/ozone/om/OzoneManager.java | 2 +-
.../ozone/om/request/file/OMFileRequest.java | 25 +++
.../om/request/key/OMKeyCreateRequestWithFSO.java | 27 +++
.../hadoop/ozone/om/request/key/OMKeyRequest.java | 35 +++-
.../S3InitiateMultipartUploadRequestWithFSO.java | 15 +-
.../S3MultipartUploadCompleteRequest.java | 7 -
.../S3MultipartUploadCompleteRequestWithFSO.java | 15 +-
.../hadoop/ozone/s3/commontypes/CommonPrefix.java | 2 +
.../hadoop/ozone/s3/commontypes/KeyMetadata.java | 1 +
...oDateAdapter.java => ObjectKeyNameAdapter.java} | 29 ++-
.../TestObjectKeyNameAdapter.java} | 27 +--
pom.xml | 2 +-
32 files changed, 718 insertions(+), 192 deletions(-)
rename
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/balancer/{FindTargetGreedy.java
=> AbstractFindTargetGreedy.java} (80%)
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/balancer/FindTargetGreedyByNetworkTopology.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/balancer/FindTargetGreedyByUsageInfo.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/balancer/TestFindTargetStrategy.java
copy
hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/commontypes/{IsoDateAdapter.java
=> ObjectKeyNameAdapter.java} (63%)
copy
hadoop-ozone/s3gateway/src/test/java/org/apache/hadoop/ozone/s3/{endpoint/TestBucketResponse.java
=> commontypes/TestObjectKeyNameAdapter.java} (59%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
