This is an automated email from the ASF dual-hosted git repository.
rakeshr pushed a change to branch HDDS-2939
in repository https://gitbox.apache.org/repos/asf/ozone.git.
discard 310db14 HDDS-2942. Putkey : create key table entries for intermediate
directories in the key path (#1764)
omit 48c925a HDDS-4514. AllocateBlock : lookup and update open file table
for the given path (#1679)
omit ab855f4 HDDS-4596. Directory table, fileTable and openFile Table is
missing from the OM DB Definition. (#1724)
omit 9c1a59d HDDS-4321. Fix compilation errors : merge HDDS-4308 and
HDDS-4473 changes into the branch (#1668)
omit 6481a55 HDDS-4358: Delete : make delete an atomic operation (#1607)
omit 4db579f HDDS-4357: Rename : make rename an atomic ops by updating key
path entry in dir/file table (#1557)
omit 5df200e HDDS-4332: ListFileStatus - do lookup in directory and file
tables (#1503)
omit 9eafa1b HDDS-4266: CreateFile : store parent dir entries into
DirTable and file entry into separate FileTable (#1473)
omit 4107ef0 HDDS-2949: mkdir : store directory entries in a separate
table (#1404)
add c8d3088 HDDS-4627. Disable coverage upload to codecov (#1741)
add 85abcaf HDDS-4185. Disable IncrementalByteBuffer by default in Ozone
Client (#1631)
add a0a936d HDDS-4496. Separate client and server2server GRPC services of
datanode (#1636)
add 8146368 HDDS-4419. Misleading SCM web UI Safe mode status (#1599)
add 628c8b6 Revert "HDDS-4369. Datanode should store the delete
transaction as is in rocksDB (#1702)"
add 431e909 HDDS-4369. Datanode should store the delete transaction as is
in rocksDB (#1702)
add 7a3144b HDDS-4646. Remove redundant log placeholders (#1759)
add f9e5d26 HDDS.4387. Create a Trash File System that will be used by
Trash Emptier (#1732)
add 448ec75 HDDS-4639. Safemode wait may end without checking (#1751)
add 6844ea4 HDDS-4619. Intermittent error exporting same container to
multiple datanodes (#1730)
add 7c21518 HDDS-4647. Avoid hadoop-ozone-filesystem-shaded as transitive
dependency (#1761)
add 1bbbf73 HDDS-4649. Upgrade ratis to 1.1.0-35f17fa-SNAPSHOT to address
incompatible changes (#1763)
add 5e82a1b HDDS-4659. No cleanup in TestOzoneFSWithObjectStoreCreate
(#1767)
add d5c60d4 HDDS-4605. Enable Multi Raft by default in Ozone. (#1717)
add 247dad5 HDDS-4524. Create freon test to measure closed container
replication (#1635)
add 48acba4 [HDDS-4662] Fix typo in S3.md (#1769)
add 217feb0 HDDS-4664. Remove redundant log statement (#1770)
add 77bf7ad HDDS-4607. Intermittent failure in
TestDecommissionAndMaintenance (#1752)
new 2a00120 HDDS-2949: mkdir : store directory entries in a separate
table (#1404)
new dae775f HDDS-4266: CreateFile : store parent dir entries into
DirTable and file entry into separate FileTable (#1473)
new 18a29ed HDDS-4332: ListFileStatus - do lookup in directory and file
tables (#1503)
new 44e1902 HDDS-4357: Rename : make rename an atomic ops by updating key
path entry in dir/file table (#1557)
new 031e666 HDDS-4358: Delete : make delete an atomic operation (#1607)
new ffdff84 HDDS-4321. Fix compilation errors : merge HDDS-4308 and
HDDS-4473 changes into the branch (#1668)
new 92c0f8f HDDS-4596. Directory table, fileTable and openFile Table is
missing from the OM DB Definition. (#1724)
new bd69d47 HDDS-4514. AllocateBlock : lookup and update open file table
for the given path (#1679)
new 224ac17 HDDS-2942. Putkey : create key table entries for intermediate
directories in the key path (#1764)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (310db14)
\
N -- N -- N refs/heads/HDDS-2939 (224ac17)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 9 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/post-commit.yml | 7 -
.../apache/hadoop/hdds/scm/OzoneClientConfig.java | 18 +
.../hadoop/hdds/scm/storage/BlockOutputStream.java | 7 +-
.../hadoop/hdds/protocol/DatanodeDetails.java | 18 +-
.../common/src/main/resources/ozone-default.xml | 4 +-
.../apache/hadoop/ozone/HddsDatanodeService.java | 12 +-
.../common/transport/server/XceiverServerGrpc.java | 8 +-
.../server/ratis/ContainerStateMachine.java | 6 +-
.../transport/server/ratis/XceiverServerRatis.java | 14 +-
.../container/keyvalue/KeyValueContainer.java | 46 ++-
.../ozone/container/keyvalue/KeyValueHandler.java | 9 +-
.../ozone/container/ozoneimpl/OzoneContainer.java | 39 +-
.../replication/GrpcReplicationClient.java | 15 +-
.../container/replication/ReplicationServer.java | 149 +++++++
.../replication/ReplicationSupervisor.java | 5 +-
.../replication/SimpleContainerDownloader.java | 6 +-
.../container/keyvalue/TestKeyValueContainer.java | 145 ++++---
.../replication/TestSimpleContainerDownloader.java | 4 +-
hadoop-hdds/docs/content/interface/S3.md | 6 +-
.../server/http/RatisNameRewriteSampleBuilder.java | 2 +-
.../server/http/TestRatisDropwizardExports.java | 9 +-
.../hdds/scm/pipeline/PipelinePlacementPolicy.java | 7 +-
.../hdds/scm/safemode/ContainerSafeModeRule.java | 19 +-
.../hdds/scm/safemode/DataNodeSafeModeRule.java | 5 +-
.../scm/safemode/HealthyPipelineSafeModeRule.java | 7 +-
.../safemode/OneReplicaPipelineSafeModeRule.java | 24 +-
.../apache/hadoop/hdds/scm/server/SCMMXBean.java | 6 +-
.../hdds/scm/server/StorageContainerManager.java | 10 +-
.../main/resources/webapps/scm/scm-overview.html | 12 +-
.../hadoop/hdds/scm/node/TestDeadNodeHandler.java | 2 +
.../hdds/scm/pipeline/TestSCMPipelineManager.java | 8 +-
.../choose/algorithms/TestLeaderChoosePolicy.java | 2 +-
.../ozone/container/common/TestEndPoint.java | 54 +--
.../hdds/scm/cli/SafeModeWaitSubcommand.java | 20 +-
hadoop-ozone/dev-support/intellij/ozone-site.xml | 4 +
.../dist/src/main/compose/ozone-ha/docker-config | 1 +
.../dist/src/main/compose/ozone/docker-config | 2 +
.../src/main/compose/ozonesecure/docker-config | 2 +
.../src/main/k8s/definitions/ozone/config.yaml | 1 +
.../dist/src/main/smoketest/ozonefs/ozonefs.robot | 15 +-
.../fs/ozone/TestOzoneFSWithObjectStoreCreate.java | 9 +
.../hadoop/hdds/scm/pipeline/TestNodeFailure.java | 2 +
.../apache/hadoop/ozone/MiniOzoneClusterImpl.java | 3 +
.../apache/hadoop/ozone/TestMiniOzoneCluster.java | 2 +
.../rpc/TestBlockOutputStreamWithFailures.java | 3 +-
.../rpc/TestCloseContainerHandlingByClient.java | 2 +
.../client/rpc/TestContainerStateMachine.java | 2 +
.../client/rpc/TestDeleteWithSlowFollower.java | 1 +
.../client/rpc/TestDiscardPreallocatedBlocks.java | 1 +
.../ozone/client/rpc/TestKeyInputStream.java | 1 +
.../ozone/client/rpc/TestWatchForCommit.java | 5 +-
.../container/metrics/TestContainerMetrics.java | 13 +-
.../container/server/TestContainerServer.java | 75 ++--
.../server/TestSecureContainerServer.java | 57 +--
.../ozone/om/TestOzoneManagerHAMetadataOnly.java | 47 ++-
.../scm/node/TestDecommissionAndMaintenance.java | 37 +-
.../apache/hadoop/ozone/om/OMMetadataManager.java | 10 +
.../apache/hadoop/ozone/om/KeyDeletingService.java | 15 +-
.../hadoop/ozone/om/OmMetadataManagerImpl.java | 10 +
.../org/apache/hadoop/ozone/om/OzoneManager.java | 17 +-
.../hadoop/ozone/om/TrashOzoneFileSystem.java | 457 +++++++++++++++++++++
.../apache/hadoop/ozone/om/ha/OMHANodeDetails.java | 3 -
.../ozone/om/ratis/OzoneManagerRatisServer.java | 16 +-
hadoop-ozone/ozonefs-hadoop2/pom.xml | 1 +
hadoop-ozone/ozonefs-hadoop3/pom.xml | 1 +
.../hadoop/ozone/s3/OzoneClientProducer.java | 2 +-
.../hadoop/ozone/freon/BaseFreonGenerator.java | 8 +
.../ozone/freon/ClosedContainerReplicator.java | 213 ++++++++++
.../java/org/apache/hadoop/ozone/freon/Freon.java | 3 +-
pom.xml | 2 +-
70 files changed, 1372 insertions(+), 376 deletions(-)
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/replication/ReplicationServer.java
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/TrashOzoneFileSystem.java
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/ClosedContainerReplicator.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
