This is an automated email from the ASF dual-hosted git repository.
rakeshr pushed a change to branch HDDS-2939
in repository https://gitbox.apache.org/repos/asf/ozone.git.
omit e4800c1 HDDS-4486. Feature Config: Make proper enableFSPaths and OFS
optimized flag combinations (#1848)
omit 5d70bbe HDDS-4720. RenameKey : add unit test to verify
bucket#renameKey (#1847)
omit bb337c0 HDDS-4717. Fix TestOzoneFileSystemV1 and TestObjectStoreV1
cases (#1815)
omit 5c82da5 HDDS-4658. LookupKey: do lookup in dir and file tables (#1775)
omit e64d32b HDDS-2942. Putkey : create key table entries for intermediate
directories in the key path (#1764)
omit e32813f HDDS-4514. AllocateBlock : lookup and update open file table
for the given path (#1679)
omit 08e40b6 HDDS-4596. Directory table, fileTable and openFile Table is
missing from the OM DB Definition. (#1724)
omit dd2fdce HDDS-4321. Fix compilation errors : merge HDDS-4308 and
HDDS-4473 changes into the branch (#1668)
omit 2f2df59 HDDS-4358: Delete : make delete an atomic operation (#1607)
omit 0096652 HDDS-4357: Rename : make rename an atomic ops by updating key
path entry in dir/file table (#1557)
omit 123037e HDDS-4332: ListFileStatus - do lookup in directory and file
tables (#1503)
omit 7e928da HDDS-4266: CreateFile : store parent dir entries into
DirTable and file entry into separate FileTable (#1473)
omit a6754ab HDDS-2949: mkdir : store directory entries in a separate
table (#1404)
add 669a3ac HDDS-4752. TestOzoneFileSystem is not picking the configured
'Parameters' (#1846)
add cb8f818 HDDS-4785. Document run configuration launch order (#1872)
add 23d2182 HDDS-4258. Set GDPR to a Security submenu in EN and CN
document (#1524)
add 5f3e202 HDDS-4731. Fix compatibility issue caused by new enum
DatanodeDetails.Port.Name.REPLICATION (#1844)
add 9759542 HDDS-4098. Improve om admin getserviceroles error message.
(#1881)
add d054faa HDDS-4766: Recon resets the Operational State of datanodes to
IN_SERVICE (#1857)
add 60e0787 HDDS-4763. Owner field of S3AUTHINFO type delegation token
should be validated (#1871)
add 9cd00c6 HDDS-4767. Intermittent failure in
TestOzoneManagerDoubleBufferWithDummyResponse (#1869)
new 8892f38 HDDS-2949: mkdir : store directory entries in a separate
table (#1404)
new 4f341ed HDDS-4266: CreateFile : store parent dir entries into
DirTable and file entry into separate FileTable (#1473)
new 165ca13 HDDS-4332: ListFileStatus - do lookup in directory and file
tables (#1503)
new 2583c14 HDDS-4357: Rename : make rename an atomic ops by updating key
path entry in dir/file table (#1557)
new d199b2e HDDS-4358: Delete : make delete an atomic operation (#1607)
new 361ccd5 HDDS-4321. Fix compilation errors : merge HDDS-4308 and
HDDS-4473 changes into the branch (#1668)
new 82c1233 HDDS-4596. Directory table, fileTable and openFile Table is
missing from the OM DB Definition. (#1724)
new d5a930d HDDS-4514. AllocateBlock : lookup and update open file table
for the given path (#1679)
new 159ef0c HDDS-2942. Putkey : create key table entries for intermediate
directories in the key path (#1764)
new 0ee3287 HDDS-4658. LookupKey: do lookup in dir and file tables (#1775)
new 6399200 HDDS-4717. Fix TestOzoneFileSystemV1 and TestObjectStoreV1
cases (#1815)
new 91740cd HDDS-4720. RenameKey : add unit test to verify
bucket#renameKey (#1847)
new 74aeda0 HDDS-4486. Feature Config: Make proper enableFSPaths and OFS
optimized flag combinations (#1848)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (e4800c1)
\
N -- N -- N refs/heads/HDDS-2939 (74aeda0)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 13 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
CONTRIBUTING.md | 9 +
.../hadoop/hdds/protocol/DatanodeDetails.java | 106 ++++++++---
.../common/helpers/ContainerWithPipeline.java | 4 +-
.../apache/hadoop/hdds/scm/pipeline/Pipeline.java | 9 +-
.../protocol/StorageContainerLocationProtocol.java | 3 +-
.../org/apache/hadoop/ozone/ClientVersions.java} | 28 +--
.../hadoop/hdds/protocol/MockDatanodeDetails.java | 23 ++-
.../hadoop/hdds/protocol/TestDatanodeDetails.java | 63 +++++++
.../hadoop/hdds/scm/pipeline/TestPipeline.java | 51 ++++++
.../apache/hadoop/ozone/HddsDatanodeService.java | 3 +-
hadoop-hdds/docs/content/feature/_index.md | 10 +-
.../docs/content/{feature => security}/GDPR.md | 2 +-
.../docs/content/{feature => security}/GDPR.zh.md | 3 +
...lockLocationProtocolClientSideTranslatorPB.java | 2 +
...inerLocationProtocolClientSideTranslatorPB.java | 8 +-
.../src/main/proto/ScmAdminProtocol.proto | 1 +
.../src/main/proto/DatanodeClientProtocol.proto | 3 +
.../src/main/proto/ScmServerProtocol.proto | 1 +
.../hdds/scm/container/ReplicationManager.java | 3 +-
.../hadoop/hdds/scm/metadata/PipelineCodec.java | 4 +-
.../hadoop/hdds/scm/node/SCMNodeManager.java | 11 +-
...lockLocationProtocolServerSideTranslatorPB.java | 22 ++-
...inerLocationProtocolServerSideTranslatorPB.java | 64 ++++---
.../hdds/scm/server/SCMClientProtocolServer.java | 6 +-
.../scm/server/TestSCMBlockProtocolServer.java | 5 +-
.../hdds/scm/cli/ContainerOperationClient.java | 4 +-
.../apache/hadoop/ozone/om/helpers/OmKeyInfo.java | 18 +-
.../hadoop/ozone/om/helpers/OmKeyLocationInfo.java | 12 +-
.../ozone/om/helpers/OmKeyLocationInfoGroup.java | 6 +-
.../hadoop/ozone/om/helpers/OzoneFileStatus.java | 3 +-
.../hadoop/ozone/om/helpers/RepeatedOmKeyInfo.java | 4 +-
...OzoneManagerProtocolClientSideTranslatorPB.java | 16 +-
.../hadoop/ozone/om/helpers/TestOmKeyInfo.java | 3 +-
hadoop-ozone/dist/src/main/compose/testlib.sh | 14 +-
.../main/compose/{ozonescripts => xcompat}/.env | 0
.../freon-ockg.yaml => xcompat/clients.yaml} | 30 ++-
.../{compatibility => xcompat}/docker-config | 27 ++-
.../new-cluster.yaml} | 43 ++---
.../old-cluster.yaml} | 50 +++--
hadoop-ozone/dist/src/main/compose/xcompat/test.sh | 93 ++++++++++
.../{kinit.robot => compatibility/read.robot} | 14 +-
.../{kinit.robot => compatibility/write.robot} | 14 +-
.../dist/src/main/smoketest/ozone-lib/shell.robot | 8 +-
.../hadoop/fs/ozone/TestOzoneFileSystem.java | 8 +-
.../ozone/container/TestContainerReplication.java | 203 ++++++++-------------
.../org/apache/hadoop/ozone/om/TestOmLDBCli.java | 5 +-
.../src/main/proto/OmClientProtocol.proto | 1 +
.../hadoop/ozone/om/codec/OmKeyInfoCodec.java | 6 +-
.../ozone/om/codec/RepeatedOmKeyInfoCodec.java | 6 +-
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 4 +-
.../ozone/om/request/file/OMFileCreateRequest.java | 5 +-
.../om/request/file/OMFileCreateRequestV1.java | 3 +-
.../om/request/key/OMAllocateBlockRequest.java | 2 +-
.../ozone/om/request/key/OMKeyCreateRequest.java | 6 +-
.../ozone/om/request/key/OMKeyCreateRequestV1.java | 3 +-
.../S3MultipartUploadCommitPartRequest.java | 3 +-
.../protocolPB/OzoneManagerRequestHandler.java | 37 ++--
.../OzoneDelegationTokenSecretManager.java | 13 ++
...tOzoneManagerDoubleBufferWithDummyResponse.java | 2 +-
.../TestOzoneDelegationTokenSecretManager.java | 28 +--
.../hadoop/ozone/recon/scm/ReconNodeManager.java | 8 +-
.../ozone/recon/scm/TestReconNodeManager.java | 25 +++
.../org/apache/hadoop/ozone/admin/om/OMAdmin.java | 16 +-
.../apache/hadoop/ozone/fsck/ContainerMapper.java | 4 +-
64 files changed, 763 insertions(+), 428 deletions(-)
copy
hadoop-hdds/{container-service/src/main/java/org/apache/hadoop/ozone/DNMXBeanImpl.java
=> common/src/main/java/org/apache/hadoop/ozone/ClientVersions.java} (63%)
create mode 100644
hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/protocol/TestDatanodeDetails.java
create mode 100644
hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/scm/pipeline/TestPipeline.java
rename hadoop-hdds/docs/content/{feature => security}/GDPR.md (99%)
rename hadoop-hdds/docs/content/{feature => security}/GDPR.zh.md (97%)
copy hadoop-ozone/dist/src/main/compose/{ozonescripts => xcompat}/.env (100%)
copy hadoop-ozone/dist/src/main/compose/{ozone/freon-ockg.yaml =>
xcompat/clients.yaml} (67%)
copy hadoop-ozone/dist/src/main/compose/{compatibility =>
xcompat}/docker-config (83%)
copy hadoop-ozone/dist/src/main/compose/{ozone/docker-compose.yaml =>
xcompat/new-cluster.yaml} (78%)
copy hadoop-ozone/dist/src/main/compose/{compatibility/docker-compose.yaml =>
xcompat/old-cluster.yaml} (73%)
create mode 100755 hadoop-ozone/dist/src/main/compose/xcompat/test.sh
copy hadoop-ozone/dist/src/main/smoketest/{kinit.robot =>
compatibility/read.robot} (77%)
copy hadoop-ozone/dist/src/main/smoketest/{kinit.robot =>
compatibility/write.robot} (78%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]