This is an automated email from the ASF dual-hosted git repository.
rakeshr pushed a change to branch HDDS-2939
in repository https://gitbox.apache.org/repos/asf/ozone.git.
discard 9ebaddb HDDS-5072. [FSO] Addendum patch to fix compilation error
(#2130)
omit 8a37b9e HDDS-4691. [FSO]Authorizer: OM can do recursive ACL check for
subpaths (#2011)
omit a7fb5d5 HDDS-4727. [FSO]OMConfig: Modify 'ozone.om.layout.version'
config (#2118)
omit bf340bc HDDS-5018. [FSO] Add robot tests for new Filesystem layout
(#2071)
omit 055771e HDDS-4495. [FSO]Delete : Implement async cleanup of garbage
and orphan sub-dirs/files (#2093)
omit be94af8 HDDS-4932. [FSO] Provide list subpaths function to perform
recursive ACL check during delete and rename op (#2008)
omit 31687bf HDDS-4917.[FSO]Implement ACL requests for new layout (#2024)
omit 188861f HDDS-4790. Add a tool to parse entries in the prefix format
(#1891)
omit ad4eb75 HDDS-4973. [FSO] Missed to cleanup new FileTables in
OMRequests (#2035)
omit 2b657cd HDDS-4924. [FSO]S3Multipart: Implement OzoneBucket#listParts
(#2016)
omit 72dbf17 HDDS-4835. [FSO]S3Multipart: Implement UploadAbortRequest
(#1997)
omit 11f6c9c HDDS-4490.[FSO]RenameAndDelete : make ofs#rename and
ofs#delete an atomic operation. (#1965)
omit 2dbcaca HDDS-4683. [FSO]ListKeys: do lookup in dir and file tables
(#1954)
omit f61d74e HDDS-4513.[FSO]OzoneContract unit test case fixes (#1945)
omit 15aa093 HDDS-4813. [FSO]S3Multipart: Implement UploadCompleteRequest
(#1923)
omit 4cb5091 HDDS-4742. Make trash work with FS Optimised Buckets. (#1915)
omit 81a3e81 HDDS-4781. [FSO]S3MultiPart: Implement create and commit
upload part file (#1897)
omit 68aa4fd HDDS-4805. [FSO]Fix findbugs issues after HDDS-2195 (#1906)
omit f6abf23 HDDS-4771. [FSO]S3MultiPart: Implement
InitiateMultiPartUpload (#1877)
omit ffdd1a8 HDDS-4486. Feature Config: Make proper enableFSPaths and OFS
optimized flag combinations (#1848)
omit 93716f0 HDDS-4720. RenameKey : add unit test to verify
bucket#renameKey (#1847)
omit ea5b396 HDDS-4717. Fix TestOzoneFileSystemV1 and TestObjectStoreV1
cases (#1815)
omit 21ffe0e HDDS-4658. LookupKey: do lookup in dir and file tables (#1775)
omit 765b00b HDDS-2942. Putkey : create key table entries for intermediate
directories in the key path (#1764)
omit aec4ca5 HDDS-4514. AllocateBlock : lookup and update open file table
for the given path (#1679)
omit 6febe52 HDDS-4596. Directory table, fileTable and openFile Table is
missing from the OM DB Definition. (#1724)
omit aebaa81 HDDS-4321. Fix compilation errors : merge HDDS-4308 and
HDDS-4473 changes into the branch (#1668)
omit 4295d4e HDDS-4358: Delete : make delete an atomic operation (#1607)
omit 623da7b HDDS-4357: Rename : make rename an atomic ops by updating key
path entry in dir/file table (#1557)
omit 3070276 HDDS-4332: ListFileStatus - do lookup in directory and file
tables (#1503)
omit f67dde1 HDDS-4266: CreateFile : store parent dir entries into
DirTable and file entry into separate FileTable (#1473)
omit 7565c97 HDDS-2949: mkdir : store directory entries in a separate
table (#1404)
add 68265b8 HDDS-4925. Introduce ContainerBalancer in SCM with start/stop
capabilities. (#2097)
add ee4f759 HDDS-5011. Introduce Java based ReplicationConfig
implementation (#2089)
add 33ddcb3 HDDS-5062. Add a config to bypass clusterId validation for
bootstrapping SCM. (#2114)
add 6822b10 HDDS-5032. Fix findbugs (#2120)
add e40c638 HDDS-5027. [SCM HA Security] Handle leader changes during
bootstrap. (#2113)
add 534eefa HDDS-5056. Avoid false positiver error messages during
pipeline creations (#2105)
add abf38f4 HDDS-4988. Cancel duplicate PR workflows (#2053)
new d6f4d07 HDDS-2949: mkdir : store directory entries in a separate
table (#1404)
new 8e17992 HDDS-4266: CreateFile : store parent dir entries into
DirTable and file entry into separate FileTable (#1473)
new 60dd692 HDDS-4332: ListFileStatus - do lookup in directory and file
tables (#1503)
new 172ab51 HDDS-4357: Rename : make rename an atomic ops by updating key
path entry in dir/file table (#1557)
new 995b3bd HDDS-4358: Delete : make delete an atomic operation (#1607)
new d810193 HDDS-4321. Fix compilation errors : merge HDDS-4308 and
HDDS-4473 changes into the branch (#1668)
new b9771e4 HDDS-4596. Directory table, fileTable and openFile Table is
missing from the OM DB Definition. (#1724)
new c10abe6 HDDS-4514. AllocateBlock : lookup and update open file table
for the given path (#1679)
new 0bdbe41 HDDS-2942. Putkey : create key table entries for intermediate
directories in the key path (#1764)
new f132f1e HDDS-4658. LookupKey: do lookup in dir and file tables (#1775)
new 9003eca HDDS-4717. Fix TestOzoneFileSystemV1 and TestObjectStoreV1
cases (#1815)
new f5e4167 HDDS-4720. RenameKey : add unit test to verify
bucket#renameKey (#1847)
new b4d75d6 HDDS-4486. Feature Config: Make proper enableFSPaths and OFS
optimized flag combinations (#1848)
new 5b86a07 HDDS-4771. [FSO]S3MultiPart: Implement
InitiateMultiPartUpload (#1877)
new 797cf96 HDDS-4805. [FSO]Fix findbugs issues after HDDS-2195 (#1906)
new 85f07a2 HDDS-4781. [FSO]S3MultiPart: Implement create and commit
upload part file (#1897)
new b3327bc HDDS-4742. Make trash work with FS Optimised Buckets. (#1915)
new 30d9fa4 HDDS-4813. [FSO]S3Multipart: Implement UploadCompleteRequest
(#1923)
new f28699c HDDS-4513.[FSO]OzoneContract unit test case fixes (#1945)
new 0dfad20 HDDS-4683. [FSO]ListKeys: do lookup in dir and file tables
(#1954)
new 7be14c8 HDDS-4490.[FSO]RenameAndDelete : make ofs#rename and
ofs#delete an atomic operation. (#1965)
new 46d9192 HDDS-4835. [FSO]S3Multipart: Implement UploadAbortRequest
(#1997)
new cdc7855 HDDS-4924. [FSO]S3Multipart: Implement OzoneBucket#listParts
(#2016)
new 7ca2c5f HDDS-4973. [FSO] Missed to cleanup new FileTables in
OMRequests (#2035)
new 2f7606b HDDS-4790. Add a tool to parse entries in the prefix format
(#1891)
new 81361d6 HDDS-4917.[FSO]Implement ACL requests for new layout (#2024)
new 5ed34df HDDS-4932. [FSO] Provide list subpaths function to perform
recursive ACL check during delete and rename op (#2008)
new 459e990 HDDS-4495. [FSO]Delete : Implement async cleanup of garbage
and orphan sub-dirs/files (#2093)
new 9ecfafe HDDS-5018. [FSO] Add robot tests for new Filesystem layout
(#2071)
new bd22405 HDDS-4727. [FSO]OMConfig: Modify 'ozone.om.layout.version'
config (#2118)
new c326199 HDDS-4691. [FSO]Authorizer: OM can do recursive ACL check for
subpaths (#2011)
new f9910c6 HDDS-5072. [FSO] Addendum patch to fix compilation error
(#2130)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (9ebaddb)
\
N -- N -- N refs/heads/HDDS-2939 (f9910c6)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 32 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../workflows/{comments.yaml => cancel-ci.yaml} | 27 ++--
.../hadoop/hdds/client/RatisReplicationConfig.java | 82 ++++++++++++
.../hadoop/hdds/client/ReplicationConfig.java | 98 +++++++++++++++
.../hdds/client/StandaloneReplicationConfig.java} | 47 ++++---
.../org/apache/hadoop/hdds/scm/ScmConfigKeys.java | 17 +++
.../common/src/main/resources/ozone-default.xml | 9 ++
.../org/apache/hadoop/hdds/conf/ConfigTag.java | 3 +-
.../container/ozoneimpl/TestContainerReader.java | 2 +-
.../certificate/authority/CertificateStore.java | 5 +
.../hdds/scm/protocol/TestReplicationConfig.java | 66 ++++++++++
.../scm/container/balancer/ContainerBalancer.java | 137 +++++++++++++++++++++
.../balancer/ContainerBalancerConfiguration.java | 115 +++++++++++++++++
.../hdds/scm/container/balancer}/package-info.java | 6 +-
.../apache/hadoop/hdds/scm/ha/HASecurityUtils.java | 94 ++++++++++++--
.../hadoop/hdds/scm/ha/MockSCMHAManager.java | 6 +
.../hadoop/hdds/scm/ha/SCMHAInvocationHandler.java | 25 +++-
.../apache/hadoop/hdds/scm/ha/SCMRatisServer.java | 4 +
.../hadoop/hdds/scm/ha/SCMRatisServerImpl.java | 17 ++-
.../hdds/scm/pipeline/PipelineManagerV2Impl.java | 2 +-
.../SCMSecurityProtocolServerSideTranslatorPB.java | 12 +-
.../hdds/scm/server/StorageContainerManager.java | 115 +++++++++--------
.../hdds/scm/ha/TestReplicationAnnotation.java | 8 +-
.../ozone/scm/TestStorageContainerManagerHA.java | 19 +++
23 files changed, 802 insertions(+), 114 deletions(-)
copy .github/workflows/{comments.yaml => cancel-ci.yaml} (62%)
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/client/RatisReplicationConfig.java
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/client/ReplicationConfig.java
copy
hadoop-hdds/{framework/src/main/java/org/apache/hadoop/hdds/utils/db/cache/CacheKey.java
=>
common/src/main/java/org/apache/hadoop/hdds/client/StandaloneReplicationConfig.java}
(51%)
create mode 100644
hadoop-hdds/framework/src/test/java/org/apache/hadoop/hdds/scm/protocol/TestReplicationConfig.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/balancer/ContainerBalancer.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/balancer/ContainerBalancerConfiguration.java
copy hadoop-hdds/{common/src/main/java/org/apache/hadoop/ozone/ha =>
server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/balancer}/package-info.java
(86%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
