This is an automated email from the ASF dual-hosted git repository.
erose pushed a change to branch HDDS-10239-container-reconciliation
in repository https://gitbox.apache.org/repos/asf/ozone.git
from cfcabf1422 Merge branch 'master' of https://github.com/apache/ozone
into HDDS-10239-container-reconciliation-merge
add 0a0cffcc6e HDDS-11964. Allow ozone sh bucket create to take obs and
fso as options. (#7599)
add 0306d97400 HDDS-11961. Improve existing repair tests (#7595)
add 7af38a9864 HDDS-11963. Add parent interface of component and layout
versions for use in request validator (#7598)
add e41ba9b81b HDDS-11982. Bump jersey2 to 2.46 (#7604)
add e25e6bf12a HDDS-11983. Bump junit to 5.11.4 (#7605)
add ed9ac7add5 HDDS-11984. Bump reload4j to 1.2.26 (#7608)
add be18a496ab HDDS-11985. Bump assertj-core to 3.27.0 (#7607)
add 16322fdfa5 Add flush to buffer (#7609)
add 5b27f6d938 HDDS-11941. Include fork timeout in integration check
summary (#7582)
add f34cf34d85 HDDS-11857. Freon log flooded by HSync message (#7613)
add f125363700 HDDS-11878. Use CommandSpec to find top-level command.
(#7575)
add ddd5433374 HDDS-11986. Enable SCM Ratis in TestSCMNodeManager (#7624)
add 345c46850f HDDS-11995. Acceptance Test test-all script fails to delete
old result directories. (#7622)
add c3003fd870 HDDS-11992. Replace GenericCli#createOzoneConfiguration
calls with getOzoneConf. (#7623)
add ad108c86b1 HDDS-11997. Duplicate snapshot purge request causes NPE
(#7627)
add f57cf017c7 HDDS-11993. Move OzoneAdmin to ozone-tools (#7619)
add 14756bf4aa HDDS-11865. Remove tests for non-Ratis OM (#7535)
add f2e6d38ad7 HDDS-11994. Convert Freon to pluggable model (#7620)
add 0d1a0ce1f0 HDDS-11880. Intermediate subcommands do not need to
implement Callable (#7617)
add 9aae7a5c0b HDDS-9791. Add tests for Datanodes page (#7626)
add 9b5cedd0f9 HDDS-11951. Enable sortpom in hadoop-hdds sub-modules :
annotations, client, common & config. (#7631)
add c282d91b78 HDDS-8175. getFileChecksum() throws exception in debug
mode. (#7611)
add 4121aa21f6 HDDS-11726. Add leader readiness state to OM UI (#7628)
add 47c1b3584b HDDS-12001. Create parent class for repair tools (#7633)
add bf112aa36b HDDS-11990. Use arity in decommission subcommands (#7618)
add fbb792d46d HDDS-11945. Improve startup message for ozone repair
commands (#7591)
add 69206e9681 HDDS-11902. Remove upgrade tests for non-ha and om-ha
(#7610)
add d013188032 HDDS-11727. Block `ozone repair om fso-tree` if OM is
running (#7589)
add 99fd5fcbb5 HDDS-11801. Logs missing if kubernetes check fails before
tests (#7496)
add 60a7fdb628 HDDS-11819. Improve mock datanode version handling in
MiniOzoneCluster (#7632)
add ce6fb458e3 HDDS-11999. Remove `ozone repair ldb command` and move its
subcommands to `ozone repair om` (#7634)
add 2dd8a71cfa HDDS-11731. ContainerSafeModeRule Refactor (#7587)
add 91d95371dc HDDS-12013. Bump sqlite-jdbc to 3.47.2.0 (#7641)
add df6e119f4c HDDS-12006. Enable sortpom in hdds-container-service,
hdds-crypto-api, hdds-crypto-default, hdds-docs (#7638)
add de79c37c61 HDDS-12014. Bump assertj-core to 3.27.1 (#7642)
add 138cbe3157 HDDS-11998. BlockDataStreamOutput should
decrPendingContainerOpsMetrics (#7636)
add 53fc590878 HDDS-12019. Bump zstd-jni to 1.5.6-9 (#7643)
add 24a721182e HDDS-7188. Read chunk files using netty ChunkedNioFile.
(#7625)
add 6280c6643d HDDS-11952. Enable sortpom in hadoop-ozone. (#7646)
add f9bd055667 HDDS-12020. Enable sortpom in hdds-erasurecode,
hdds-server-framework, hdds-hadoop-dependency-client. (#7644)
add 71de2a200a HDDS-10469. Ozone Manager should continue to work when S3
secret storage is unavailable (#6339)
add 8f2689dfe5 HDDS-11864. Remove config from OM for disabling Ratis
(#7640)
add ab161dd72a HDDS-11949. Ozone Recon - Update Recon OM Sync default
configs and docker configs. (#7600)
add 3d35b01e62 HDDS-12011. Show PID of running service. (#7648)
add 2ec05cb122 HDDS-11987. Remove duplicate Quota In Bytes field from DU
metadata (#7649)
add 5354cec5d4 HDDS-12027. Mark
TestBlockDataStreamOutput#testMultiBlockWrite as flaky
add ae9a56fc47 HDDS-11991. Use picocli built-in for missing subcommand of
GenericCli (#7635)
add 6b8b844dfa HDDS-12009. Merge FSORepairTool and FSORepairCLI (#7639)
add 8a774a57df HDDS-11989. Enable SCM Ratis in tests related to
DeletedBlockLog (#7615)
add 44ba9a3f5d HDDS-12023. Enable SCM Ratis in TestContainerCommandsEC
(#7650)
add e8d96f422e HDDS-12022. Enable SCM Ratis in TestStorageContainerManager
(#7651)
add 3dfd2410a0 HDDS-11753. Deprecate file per chunk layout from datanode
code. (#7654)
add 984027cc25 HDDS-12035. Enable sortpom in hdds-hadoop-dependency-server
and -test (#7659)
add 2fc9c6e5f1 HDDS-12034. Enable sortpom in hdds-interface-admin, -client
and -server. (#7660)
add 36a430db45 HDDS-7307. Move S3 Gateway web content to separate port
(#6898)
add f8394cf5b7 HDDS-11975. wrap TermIndex in ExecutionContext (#7602)
add 14bba1ee7a HDDS-5045. Create acceptance test for using rclone with s3
protocol (#7571)
add a1324b66a7 HDDS-11511. Introduce metrics in deletion services of OM
(#7377)
add ab29a55eae HDDS-7990. Add acceptance test for HA Proxy with secure
Ozone S3 Gateway (#7562)
add ae1843f0f5 HDDS-12045. S3 secret admin test fails with HAProxy (#7668)
add 400e94d543 HDDS-11959. Remove tests for non-Ratis SCM (#7612)
add e21e724d75 HDDS-12003. Reduce code duplication related to tracing init
(#7658)
add f1f0ec323d HDDS-12007. BlockDataStreamOutput should only send one
PutBlock during close. (#7645)
add 80dc87a652 HDDS-12039. Move quota subcommands under ozone repair om
(#7662)
add a4f48211b3 HDDS-11969. getFilechecksum() API fails if checksum type is
NONE. (#7656)
add 990b5bf8c9 HDDS-12038. Bump maven-remote-resources-plugin to 3.3.0
(#7661)
add 93dab91667 HDDS-11816. Ozone stream to support Hsync,Hflush. (#7592)
add 9670965428 HDDS-11699. Remove unnecessary information about parts when
downloading multipart files. (#7558)
add 76ac396611 HDDS-12036. Add storage indicators when reaching capacity
(#7663)
add 49efad97a7 HDDS-12012. Defer ozone repair prompt after subcommand
validation (#7653)
add 7c13de865e HDDS-12041. Add ozone repair scm cert command and its
subcommand (#7671)
add 9c391bc29e HDDS-12049. Rename OM ID and OM Service ID to Ozone Service
ID. (#7679)
add da8fa24791 HDDS-12054. Move ozone debug prefix to ozone debug om
prefix (#7674)
add 62f24bd3bd HDDS-12066. Bump jetty to 9.4.57.v20241219 (#7683)
add 9b8ef74573 HDDS-12043. Mark fixed column with disabled checkbox (#7667)
add 75bed82a76 HDDS-12067. Bump assertj-core to 3.27.2 (#7684)
add 1d95f67e8d HDDS-12055. Move ozone debug container to ozone debug
datanode container (#7675)
add 19c8136afe HDDS-11962. [Docs] Hive Integration (#7596)
add 468c35d76c HDDS-11947. [Docs] Impala Integration (#7584)
add b89b6e021d HDDS-12058. Use CommandLine out/err in GenericCli
subclasses (#7673)
add 12def8a0f1 HDDS-11326. Speed up TestBlockOutputStreamWithFailures
(#7374)
add 67fdb88b95 HDDS-12068. Enable sortpom in remaining hdds modules (#7686)
add c387656530 HDDS-12063. Speed up TestLeaseRecovery (#7688)
add 2516ea6eba HDDS-12002. Move up out() and err() to AbstractSubcommand
(#7687)
add b024a6bb51 HDDS-12042. Fix capacity count for cluster capacity card in
new vs old UI (#7666)
add 864c8a58b8 HDDS-10312. Speed up TestOMDbCheckpointServlet (#7691)
add 147318b049 HDDS-12074. Enable sortpom in ozone-insight,
s3-secret-store, s3gateway and tools (#7692)
add 0723902ac9 HDDS-12082. CI checks fail with Maven 3.9.9 (#7699)
add 2f6e229dea HDDS-12029. Move ozone debug recover to ozone admin om
lease recover (#7670)
add af36d73823 HDDS-12083. Publish build scans to develocity.apache.org
(#7701)
add 85e752123f HDDS-12056. Move ozone debug chunkinfo to ozone debug
replicas chunk-info (#7702)
add 6c41a9aa3c HDDS-12064. Optimize bootstrap logic to reduce loop while
checking file links (#7676)
add 7f70729d03 HDDS-12092. Enable sortpom in Recon (#7707)
add e76d99041f HDDS-12088. Speed up TestStorageContainerManager (#7706)
add 1859176699 HDDS-12101. Bump sqlite-jdbc to 3.48.0.0 (#7712)
add 90466e4022 HDDS-12102. Bump Bouncy Castle to 1.80 (#7713)
add 81d098255b HDDS-12021. Enable sortpom in hadoop-ozone client, common,
csi and datanode. (#7717)
add c9a530a9ad HDDS-12104. Enable sortpom in ozonefs modules (#7718)
add f90e625eea HDDS-11680. Enhance Recon Metrics For Improved
Observability (#7517)
add 3a6b05efbc HDDS-12105. Enable sortpom in ozone-manager and
httpfsgateway. (#7720)
add c006c572c5 HDDS-12016. Fixed duplicate entries when changing path in
DU page (#7657)
add 98b4e55543 HDDS-11948. [Docs] DistCp integration (#7588)
add 7239594abf HDDS-11775. Add tool to create RocksDB checkpoint (#7664)
add 9bf597a251 HDDS-12107. Enable sortpom in ozone-dist and
ozone-interface modules (#7721)
add ce82d123cf HDDS-12093. Exclude generated code for import restrictions
(#7709)
add 0d75ed6dde HDDS-11300. Update Swagger documentation for Recon APIs
(#7678)
add 7d50d77223 HDDS-12086. Allow --db option at leaf subcommand in debug
tools (#7710)
add 7b4df04beb HDDS-12030. Update SCM-HA.zh.md (#7669)
add fefaf9beea HDDS-11070. Separate KeyCodec from reading and storing keys
to disk (#6871)
add 52930c50af HDDS-12005. Refactor TestBlockDataStreamOutput (#7716)
add e2718dda4a HDDS-12100. Move CI dependency installer functions out of
_lib.sh (#7715)
add a0be99a3ba HDDS-12095. Include AWS request ID in S3G audit logs (#7725)
add 4df73d568e HDDS-12106. Enable sortpom in integration-test and
fault-injection-test. (#7734)
add bb96826af2 HDDS-12124. Disable resource filtering for VI swap files
(#7736)
add 642b1c74b9 HDDS-12057. ReadReplicas should handle key names containing
/ (#7735)
add 518338f476 HDDS-11946. Require all ozone repair commands to support a
--dry-run option (#7682)
add c2d810e15d HDDS-12108. Grafana Dashboard for OM CommitIndex (#7719)
add 47525b297a HDDS-12050. Implement TransactionInfoRepair command for SCM
(#7689)
add c0a6ffd6dd HDDS-12130. Improve assertion compatibility with old Hadoop
(#7738)
add db059c6a3c HDDS-12131. NPE in OM when overwriting empty file using
multipart upload (#7739)
add 82c1ddaa81 HDDS-12089. Move execute_debug_tests out of testlib.sh
(#7744)
add b6cc4af598 HDDS-12114. Prevent delete commands running after a long
lock wait and send ICR earlier (#7726)
add 1bd721b2fd HDDS-12081. TestKeyInputStream repeats tests with default
container layout (#7704)
add 22367c6c9d HDDS-12138. Bump assertj-core to 3.27.3 (#7751)
add 98cb75cd92 HDDS-12098. Bump Hugo to 0.141.0 (#7731)
add 95b4fdcf72 HDDS-12122. Add unit test for SnapshotChainRepair (#7741)
add 8133be836a HDDS-11798. Move SafeModeRule names to respective rules
(#7742)
add efd8adcf59 HDDS-12115. RM selects replicas to delete
non-deterministically if nodes are overloaded (#7728)
add e8aea7c07d HDDS-11892. Remove config from SCM for disabling Ratis.
(#7711)
add d7616ec22a HDDS-12135. Set RM default deadline to 12 minutes and
datanode offset to 6 minutes (#7747)
add ffa097f98a HDDS-12099. Generate kubernetes Robot report in container
(#7754)
add ab9a0a21e5 HDDS-12117. Create endpoint builders for S3G tests (#7753)
add 692b229216 HDDS-12084. Persist currently selected UI type (new/old)
between refreshes (#7705)
add 3498af81f2 HDDS-11837. Support executing multiple commands in Ozone
CLI (#7727)
add c2ad1b0ae5 HDDS-12032. Remove DefaultConfigManager from SCM. (#7757)
add f1b59f16ad HDDS-12139. Refactor TestSnapshotChainRepair. (#7752)
add 04f6255295 HDDS-12127. RM should not expire pending deletes, but retry
until delete is confirmed or node is dead (#7746)
add 6d07e984b2 HDDS-12141. Replace direct dependency on hadoop-hdfs-client
(#7762)
add 2d87299dee HDDS-12140. Replace leftover rebot in
k8s/examples/test-all.sh (#7756)
add 6b3226f76e HDDS-11125. Do not log user-controlled data in
HddsConfServlet (#7767)
add bf8eefea09 HDDS-12147. Remove server dependencies from hdds-tools
(#7771)
add fc89ba6aef HDDS-12116. Customizable prefix for shaded protobuf in
ozonefs-hadoop3-client (#7729)
add 34792eda72 HDDS-12010. Block ozone repair if service is running (#7758)
add a2825fd11a HDDS-12155. Create new submodule for ozone shell (#7775)
add c7872f7d65 HDDS-12162. Log available space of HddsVolume and DbVolume
upon Datanode startup (#7777)
add fb2738cabf HDDS-12143. Generate list of integration check splits
dynamically (#7766)
add 4fc4a9a460 HDDS-12040. `ozone freon cr` fails with NPE in
ReplicationSupervisor (#7776)
add dd0821d6d7 HDDS-12144. Remove unsupported replication types from
config description (#7764)
add 6d65d4fbe9 HDDS-11277. Remove dependency on hadoop-hdfs in Ozone
client (#7781)
add 182d106c40 HDDS-12132. Parameterize testUpdateTransactionInfoTable for
SCM (#7768)
add 3eabfe1e18 HDDS-12085. Add manual refresh button for DU page (#7780)
add 80426c5ba3 HDDS-12165. Refactor VolumeInfoMetrics to use
getCurrentUsage (#7784)
add 6e8d443ab6 HDDS-12181. Bump jline to 3.29.0 (#7789)
add d9c7d1deed HDDS-12176. Trivial dependency cleanup.(#7787)
add 8f16a3b94b HDDS-12163. Reduce number of individual
getCapacity/getAvailable/getUsedSpace calls (#7790)
add 8cbf459e4f HDDS-12142. Save logs from build check (#7782)
add cd996f0468 HDDS-12073. Don't show Source Bucket and Volume if null in
DU metadata (#7760)
add 24aab04e5c HDDS-11508. Decouple delete batch limits from Ratis request
size for DirectoryDeletingService. (#7365)
add bd02526cc1 HDDS-12186. Avoid array allocation for table iterator.
(#7797)
add e79b198685 HDDS-12186. (addendum) Avoid array allocation for table
iterator (#7799)
add cfe56dee0e HDDS-11714. resetDeletedBlockRetryCount with --all may fail
and can cause long db lock in large cluster. (#7665)
add 260434fe46 HDDS-12183. Reuse cluster across safe test classes (#7793)
add 7efa081c70 HDDS-12203. Initialize block length before skip (#7809)
add bb860d2402 HDDS-12202. OpsCreate and OpsAppend metrics not incremented
(#7811)
add 1a9cf6cfe0 HDDS-12200. Fix grammar in OM HA, EC and Snapshot doc
(#7806)
add 182bd53bef HDDS-12195. Implement skip() in OzoneFSInputStream (#7801)
add d8c94fb9a9 HDDS-12212. Fix grammar in decommissioning and
observability documentation (#7815)
add 98c765402e HDDS-12112. Fix interval used for Chunk Read/Write
Dashboard (#7724)
new 2cfd22a407 Merge branch 'master' into
HDDS-10239-container-reconciliation
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/ci.yml | 48 +-
.github/workflows/intermittent-test-check.yml | 2 +-
.github/workflows/repeat-acceptance.yml | 2 +-
.mvn/develocity.xml | 3 +-
.mvn/extensions.xml | 2 +-
...{acceptance_suites.sh => integration_suites.sh} | 5 +-
dev-support/ci/selective_ci_checks.sh | 6 +-
hadoop-hdds/annotations/pom.xml | 15 +-
hadoop-hdds/client/pom.xml | 60 +-
.../apache/hadoop/hdds/scm/OzoneClientConfig.java | 12 +-
.../hdds/scm/storage/BlockDataStreamOutput.java | 25 +-
.../hdds/scm/storage/ByteBufferStreamOutput.java | 4 +-
.../hdds/scm/storage/MultipartInputStream.java | 5 +
.../hadoop/hdds/scm/storage/StreamBuffer.java | 4 +-
hadoop-hdds/common/pom.xml | 215 ++--
.../org/apache/hadoop/hdds/ComponentVersion.java | 9 +-
.../org/apache/hadoop/hdds/cli/AbstractMixin.java | 41 +-
.../apache/hadoop/hdds/cli/AbstractSubcommand.java | 89 ++
.../hadoop/hdds/cli/ExtensibleParentCommand.java | 6 +-
.../org/apache/hadoop/hdds/cli/GenericCli.java | 75 +-
.../hadoop/hdds/cli/GenericParentCommand.java | 3 +-
.../hdds/cli/MissingSubcommandException.java | 31 -
.../apache/hadoop/hdds/client/ReplicationType.java | 1 +
.../hadoop/hdds/conf/DefaultConfigManager.java | 58 -
.../apache/hadoop/hdds/fs/SpaceUsageSource.java | 5 +
.../org/apache/hadoop/hdds/scm/ScmConfigKeys.java | 11 +-
.../balancer/ContainerBalancerConfiguration.java | 0
.../hdds/scm/container/balancer/package-info.java | 2 +-
.../org/apache/hadoop/hdds/scm/ha/SCMHAUtils.java | 12 +-
.../ContainerCommandResponseBuilders.java | 4 +-
.../hadoop/hdds/security/SecurityConfig.java | 33 +-
.../hadoop/hdds/security/SecurityConstants.java | 49 +
.../hadoop/hdds/security/x509/keys/KeyCodec.java | 128 +++
.../hadoop/hdds/security/x509/keys/KeyStorage.java | 249 +++++
.../org/apache/hadoop/ozone/ClientVersion.java | 5 +-
.../apache/hadoop/ozone/OzoneManagerVersion.java | 3 +
.../java/org/apache/hadoop/ozone/Versioned.java} | 11 +-
.../apache/hadoop/ozone/common/ChecksumCache.java | 2 +-
.../apache/hadoop/ozone/common/ChunkBuffer.java | 55 +-
.../ozone/common/ChunkBufferToByteString.java | 93 ++
.../common/ChunkBufferToByteStringByByteBufs.java | 101 ++
.../ozone/common/IncrementalChunkBuffer.java | 4 +-
.../apache/hadoop/ozone/upgrade/LayoutFeature.java | 9 +-
.../common/src/main/resources/ozone-default.xml | 72 +-
.../security/x509/keys/TestHDDSKeyGenerator.java | 0
.../hdds/security/x509/keys/TestKeyCodec.java | 78 ++
.../hdds/security/x509/keys/TestKeyStorage.java | 344 ++++++
.../hdds/security/x509/keys/package-info.java | 0
hadoop-hdds/config/pom.xml | 12 +-
hadoop-hdds/container-service/pom.xml | 161 ++-
.../apache/hadoop/ozone/HddsDatanodeService.java | 25 +-
.../common/impl/ContainerLayoutVersion.java | 3 +-
.../container/common/impl/HddsDispatcher.java | 7 +-
.../common/statemachine/DatanodeConfiguration.java | 14 +
.../transport/server/GrpcXceiverService.java | 13 +-
.../server/ratis/ContainerStateMachine.java | 40 +-
.../transport/server/ratis/DispatcherContext.java | 30 +-
.../common/volume/AvailableSpaceFilter.java | 7 +-
.../volume/CapacityVolumeChoosingPolicy.java | 4 +-
.../ozone/container/common/volume/DbVolume.java | 4 +-
.../ozone/container/common/volume/HddsVolume.java | 7 +-
.../container/common/volume/MutableVolumeSet.java | 8 +-
.../container/common/volume/StorageVolume.java | 14 -
.../ozone/container/common/volume/VolumeInfo.java | 22 -
.../container/common/volume/VolumeInfoMetrics.java | 111 +-
.../ozone/container/common/volume/VolumeUsage.java | 24 +-
.../ozone/container/keyvalue/KeyValueHandler.java | 56 +-
.../container/keyvalue/helpers/ChunkUtils.java | 40 +-
.../container/keyvalue/impl/BlockManagerImpl.java | 12 +-
.../keyvalue/impl/ChunkManagerDispatcher.java | 7 +-
.../keyvalue/impl/FilePerBlockStrategy.java | 11 +-
.../keyvalue/impl/FilePerChunkStrategy.java | 10 +-
.../keyvalue/impl/KeyValueStreamDataChannel.java | 65 +-
.../keyvalue/interfaces/BlockManager.java | 3 +
.../keyvalue/interfaces/ChunkManager.java | 3 +-
.../replication/ReplicationSupervisor.java | 14 +-
.../upgrade/VersionedDatanodeFeatures.java | 6 +-
.../hadoop/ozone/TestHddsSecureDatanodeInit.java | 22 +-
.../common/impl/TestContainerPersistence.java | 6 +-
.../volume/TestCapacityVolumeChoosingPolicy.java | 6 +-
.../container/common/volume/TestHddsVolume.java | 40 +-
.../common/volume/TestReservedVolumeSpace.java | 4 +-
.../volume/TestRoundRobinVolumeChoosingPolicy.java | 4 +-
.../container/common/volume/TestVolumeSet.java | 2 +-
.../keyvalue/ContainerLayoutTestInfo.java | 2 +-
.../container/keyvalue/TestKeyValueHandler.java | 75 +-
.../keyvalue/impl/TestChunkManagerDummyImpl.java | 4 +-
.../keyvalue/impl/TestFilePerBlockStrategy.java | 15 +-
.../impl/TestKeyValueStreamDataChannel.java | 65 +-
.../container/ozoneimpl/TestOzoneContainer.java | 2 +-
.../upgrade/TestDatanodeUpgradeToScmHA.java | 604 -----------
hadoop-hdds/crypto-api/pom.xml | 35 +-
hadoop-hdds/crypto-default/pom.xml | 35 +-
hadoop-hdds/docs/content/feature/Decommission.md | 2 +-
hadoop-hdds/docs/content/feature/ErasureCoding.md | 6 +-
hadoop-hdds/docs/content/feature/OM-HA.md | 10 +-
hadoop-hdds/docs/content/feature/OM-HA.zh.md | 9 -
hadoop-hdds/docs/content/feature/Observability.md | 2 +-
hadoop-hdds/docs/content/feature/SCM-HA.md | 24 +-
hadoop-hdds/docs/content/feature/SCM-HA.zh.md | 27 +-
hadoop-hdds/docs/content/feature/Snapshot.md | 4 +-
hadoop-hdds/docs/content/integration/DistCp.md | 89 ++
hadoop-hdds/docs/content/integration/Hive.md | 169 +++
hadoop-hdds/docs/content/integration/Impala.md | 101 ++
.../_index.zh.md => integration/_index.md} | 6 +-
hadoop-hdds/docs/pom.xml | 12 +-
.../static/swagger-resources/recon-api.yaml | 1146 ++++++++++++++------
hadoop-hdds/erasurecode/pom.xml | 29 +-
hadoop-hdds/framework/pom.xml | 275 +++--
.../apache/hadoop/hdds/conf/HddsConfServlet.java | 9 -
.../hadoop/hdds/security/OzoneSecretKey.java | 23 +-
.../certificate/authority/DefaultCAServer.java | 110 +-
.../client/DefaultCertificateClient.java | 50 +-
.../hadoop/hdds/security/x509/keys/KeyCodec.java | 425 --------
.../hdds/security/x509/keys/SecurityUtil.java | 90 --
.../hdds/security/x509/keys/package-info.java | 23 -
.../hadoop/hdds/server/http/BaseHttpServer.java | 22 +-
.../hadoop/hdds/server/http/HttpServer2.java | 47 +-
.../org/apache/hadoop/hdds/utils/db/Table.java | 47 +
.../apache/hadoop/hdds/utils/db/TypedTable.java | 11 +-
.../certificate/authority/TestDefaultCAServer.java | 57 +-
.../client/TestDefaultCertificateClient.java | 21 +-
.../client/TestDnCertificateClientInit.java | 10 +-
.../hdds/security/x509/keys/TestKeyCodec.java | 235 ----
.../hadoop/hdds/utils/db/TestRDBTableStore.java | 5 +-
hadoop-hdds/hadoop-dependency-client/pom.xml | 251 ++---
hadoop-hdds/hadoop-dependency-server/pom.xml | 125 +--
hadoop-hdds/hadoop-dependency-test/pom.xml | 35 +-
hadoop-hdds/interface-admin/pom.xml | 20 +-
hadoop-hdds/interface-client/pom.xml | 80 +-
hadoop-hdds/interface-server/pom.xml | 60 +-
hadoop-hdds/managed-rocksdb/pom.xml | 31 +-
hadoop-hdds/pom.xml | 130 +--
hadoop-hdds/rocks-native/pom.xml | 125 +--
hadoop-hdds/rocksdb-checkpoint-differ/pom.xml | 69 +-
hadoop-hdds/server-scm/pom.xml | 184 ++--
.../hadoop/hdds/scm/block/DeletedBlockLog.java | 4 +-
.../hadoop/hdds/scm/block/DeletedBlockLogImpl.java | 46 +-
.../hdds/scm/container/ContainerManager.java | 3 +
.../hdds/scm/container/ContainerManagerImpl.java | 7 +
.../hdds/scm/container/ContainerStateManager.java | 7 +
.../scm/container/ContainerStateManagerImpl.java | 8 +
.../AbstractOverReplicationHandler.java | 5 +-
.../container/replication/ContainerReplicaOp.java | 12 +-
.../replication/ContainerReplicaPendingOps.java | 36 +-
.../replication/ECUnderReplicationHandler.java | 2 +-
.../replication/RatisOverReplicationHandler.java | 12 +-
.../container/replication/ReplicationManager.java | 41 +-
.../scm/container/states/ContainerStateMap.java | 2 +-
.../hadoop/hdds/scm/ha/SCMHANodeDetails.java | 33 +-
.../hdds/scm/safemode/ContainerSafeModeRule.java | 171 +--
.../hdds/scm/safemode/DataNodeSafeModeRule.java | 6 +-
.../scm/safemode/HealthyPipelineSafeModeRule.java | 7 +-
.../safemode/OneReplicaPipelineSafeModeRule.java | 6 +-
.../hdds/scm/safemode/SCMSafeModeManager.java | 5 -
.../hadoop/hdds/scm/safemode/SafeModeExitRule.java | 12 +
.../hdds/scm/safemode/SafeModeRuleFactory.java | 35 +-
.../hdds/scm/security/RootCARotationManager.java | 9 +-
.../hdds/scm/server/StorageContainerManager.java | 14 +-
.../scm/server/StorageContainerManagerStarter.java | 9 +-
.../ScmHAUnfinalizedStateValidationAction.java | 6 +-
.../hadoop/hdds/scm/block/TestBlockManager.java | 3 +-
.../hadoop/hdds/scm/block/TestDeletedBlockLog.java | 2 -
.../scm/container/balancer/TestMoveManager.java | 28 +-
.../TestContainerReplicaPendingOps.java | 176 +--
.../replication/TestECContainerReplicaCount.java | 4 +-
.../TestRatisOverReplicationHandler.java | 44 +-
.../replication/TestReplicationManager.java | 38 +-
.../TestReplicationManagerScenarios.java | 4 +-
...onfiguration.java => TestSCMConfiguration.java} | 83 +-
.../ha/TestStatefulServiceStateManagerImpl.java | 2 -
.../hadoop/hdds/scm/node/TestSCMNodeManager.java | 5 +-
.../hdds/scm/pipeline/TestPipelineManagerImpl.java | 4 +-
.../safemode/TestHealthyPipelineSafeModeRule.java | 6 +-
.../TestOneReplicaPipelineSafeModeRule.java | 2 +-
.../hdds/scm/safemode/TestSCMSafeModeManager.java | 20 +-
.../TestSCMHAUnfinalizedStateValidationAction.java | 57 +-
hadoop-hdds/test-utils/pom.xml | 47 +-
.../org/apache/ozone/test/GenericTestUtils.java | 127 ++-
.../java/org/apache/ozone/test/IntLambda.java} | 35 +-
hadoop-hdds/tools/pom.xml | 129 +--
.../hdds/scm/cli/ContainerBalancerCommands.java | 15 +-
.../hdds/scm/cli/ReplicationManagerCommands.java | 15 +-
.../hadoop/hdds/scm/cli/SafeModeCommands.java | 15 +-
.../org/apache/hadoop/hdds/scm/cli/ScmOption.java | 17 +-
.../apache/hadoop/hdds/scm/cli/ScmSubcommand.java | 3 +-
.../hadoop/hdds/scm/cli/cert/CertCommands.java | 16 +-
.../hdds/scm/cli/container/ContainerCommands.java | 24 +-
.../hdds/scm/cli/container/InfoSubcommand.java | 11 +-
.../hdds/scm/cli/container/ListSubcommand.java | 6 +-
.../hdds/scm/cli/container/UpgradeSubcommand.java | 15 +-
.../hdds/scm/cli/datanode/DatanodeCommands.java | 15 +-
.../scm/cli/datanode/DecommissionSubCommand.java | 54 +-
.../hdds/scm/cli/datanode/HostNameParameters.java | 49 +-
.../scm/cli/datanode/MaintenanceSubCommand.java | 50 +-
.../scm/cli/datanode/RecommissionSubCommand.java | 48 +-
.../hdds/scm/cli/datanode/StatusSubCommand.java | 13 +-
.../hdds/scm/cli/pipeline/PipelineCommands.java | 15 +-
.../dev-support/findbugsExcludeFile.xml | 7 +-
.../tools => hadoop-ozone/cli-shell}/pom.xml | 152 ++-
.../hadoop/ozone/shell/ClearSpaceQuotaOptions.java | 0
.../org/apache/hadoop/ozone/shell/Handler.java | 39 +-
.../org/apache/hadoop/ozone/shell/ListOptions.java | 0
.../ozone/shell/MandatoryReplicationOptions.java | 0
.../apache/hadoop/ozone/shell/OzoneAddress.java | 4 +-
.../org/apache/hadoop/ozone/shell/OzoneShell.java | 15 -
.../java/org/apache/hadoop/ozone/shell/REPL.java | 17 +-
.../hadoop/ozone/shell/ReplicationOptions.java | 0
.../hadoop/ozone/shell/SetSpaceQuotaOptions.java | 0
.../java/org/apache/hadoop/ozone/shell/Shell.java | 41 +-
.../ozone/shell/ShellReplicationOptions.java | 0
.../apache/hadoop/ozone/shell/StoreTypeOption.java | 0
.../apache/hadoop/ozone/shell/acl/AclHandler.java | 0
.../apache/hadoop/ozone/shell/acl/AclOption.java | 8 +-
.../hadoop/ozone/shell/acl/GetAclHandler.java | 0
.../hadoop/ozone/shell/acl/package-info.java | 0
.../ozone/shell/bucket/AddAclBucketHandler.java | 0
.../hadoop/ozone/shell/bucket/BucketCommands.java | 28 +-
.../hadoop/ozone/shell/bucket/BucketHandler.java | 0
.../hadoop/ozone/shell/bucket/BucketUri.java | 0
.../ozone/shell/bucket/ClearQuotaHandler.java | 0
.../ozone/shell/bucket/CreateBucketHandler.java | 33 +-
.../ozone/shell/bucket/DeleteBucketHandler.java | 0
.../ozone/shell/bucket/GetAclBucketHandler.java | 0
.../ozone/shell/bucket/InfoBucketHandler.java | 0
.../ozone/shell/bucket/LinkBucketHandler.java | 0
.../ozone/shell/bucket/ListBucketHandler.java | 0
.../ozone/shell/bucket/RemoveAclBucketHandler.java | 0
.../ozone/shell/bucket/SetAclBucketHandler.java | 0
.../ozone/shell/bucket/SetEncryptionKey.java | 0
.../hadoop/ozone/shell/bucket/SetQuotaHandler.java | 0
.../shell/bucket/SetReplicationConfigHandler.java | 0
.../ozone/shell/bucket/UpdateBucketHandler.java | 0
.../hadoop/ozone/shell/bucket/package-info.java | 0
.../ozone/shell/common/VolumeBucketHandler.java | 0
.../hadoop/ozone/shell/common/VolumeBucketUri.java | 0
.../hadoop/ozone/shell/common/package-info.java | 0
.../hadoop/ozone/shell/keys/AddAclKeyHandler.java | 0
.../hadoop/ozone/shell/keys/CatKeyHandler.java | 0
.../ozone/shell/keys/ChecksumKeyHandler.java | 0
.../hadoop/ozone/shell/keys/CopyKeyHandler.java | 0
.../hadoop/ozone/shell/keys/DeleteKeyHandler.java | 0
.../hadoop/ozone/shell/keys/GetAclKeyHandler.java | 0
.../hadoop/ozone/shell/keys/GetKeyHandler.java | 0
.../hadoop/ozone/shell/keys/InfoKeyHandler.java | 0
.../hadoop/ozone/shell/keys/KeyCommands.java | 28 +-
.../apache/hadoop/ozone/shell/keys/KeyHandler.java | 0
.../org/apache/hadoop/ozone/shell/keys/KeyUri.java | 0
.../hadoop/ozone/shell/keys/ListKeyHandler.java | 0
.../hadoop/ozone/shell/keys/PutKeyHandler.java | 0
.../ozone/shell/keys/RemoveAclKeyHandler.java | 0
.../hadoop/ozone/shell/keys/RenameKeyHandler.java | 0
.../hadoop/ozone/shell/keys/RewriteKeyHandler.java | 0
.../hadoop/ozone/shell/keys/SetAclKeyHandler.java | 0
.../hadoop/ozone/shell/keys/package-info.java | 0
.../apache/hadoop/ozone/shell/package-info.java | 4 +-
.../ozone/shell/prefix/AddAclPrefixHandler.java | 0
.../ozone/shell/prefix/GetAclPrefixHandler.java | 0
.../hadoop/ozone/shell/prefix/PrefixCommands.java | 27 +-
.../hadoop/ozone/shell/prefix/PrefixUri.java | 0
.../ozone/shell/prefix/RemoveAclPrefixHandler.java | 0
.../ozone/shell/prefix/SetAclPrefixHandler.java | 0
.../hadoop/ozone/shell/prefix/package-info.java | 0
.../hadoop/ozone/shell/s3/GetS3SecretHandler.java | 0
.../ozone/shell/s3/RevokeS3SecretHandler.java | 0
.../apache/hadoop/ozone/shell/s3/S3Handler.java | 0
.../org/apache/hadoop/ozone/shell/s3/S3Shell.java | 14 -
.../hadoop/ozone/shell/s3/SetS3SecretHandler.java | 0
.../apache/hadoop/ozone/shell/s3/package-info.java | 0
.../shell/snapshot/BucketSnapshotHandler.java | 0
.../shell/snapshot/CreateSnapshotHandler.java | 0
.../shell/snapshot/DeleteSnapshotHandler.java | 0
.../ozone/shell/snapshot/InfoSnapshotHandler.java | 0
.../shell/snapshot/ListSnapshotDiffHandler.java | 0
.../ozone/shell/snapshot/ListSnapshotHandler.java | 0
.../shell/snapshot/RenameSnapshotHandler.java | 0
.../ozone/shell/snapshot/SnapshotCommands.java | 27 +-
.../ozone/shell/snapshot/SnapshotDiffHandler.java | 12 +-
.../hadoop/ozone/shell/snapshot/SnapshotUri.java | 0
.../hadoop/ozone/shell/snapshot/package-info.java | 0
.../ozone/shell/tenant/GetUserInfoHandler.java | 10 -
.../shell/tenant/TenantAssignAdminHandler.java | 0
.../tenant/TenantAssignUserAccessIdHandler.java | 0
.../shell/tenant/TenantBucketLinkHandler.java | 0
.../ozone/shell/tenant/TenantCreateHandler.java | 0
.../ozone/shell/tenant/TenantDeleteHandler.java | 0
.../ozone/shell/tenant/TenantGetSecretHandler.java | 0
.../hadoop/ozone/shell/tenant/TenantHandler.java | 0
.../ozone/shell/tenant/TenantListHandler.java | 0
.../ozone/shell/tenant/TenantListUsersHandler.java | 0
.../shell/tenant/TenantRevokeAdminHandler.java | 0
.../tenant/TenantRevokeUserAccessIdHandler.java | 0
.../ozone/shell/tenant/TenantSetSecretHandler.java | 0
.../hadoop/ozone/shell/tenant/TenantShell.java | 15 +-
.../ozone/shell/tenant/TenantUserCommands.java | 27 +-
.../hadoop/ozone/shell/tenant/package-info.java | 0
.../ozone/shell/token/CancelTokenHandler.java | 0
.../hadoop/ozone/shell/token/GetTokenHandler.java | 0
.../ozone/shell/token/PrintTokenHandler.java | 0
.../ozone/shell/token/RenewTokenHandler.java | 0
.../hadoop/ozone/shell/token/RenewerOption.java | 0
.../hadoop/ozone/shell/token/TokenCommands.java | 28 +-
.../hadoop/ozone/shell/token/TokenHandler.java | 0
.../hadoop/ozone/shell/token/TokenOption.java | 0
.../hadoop/ozone/shell/token/package-info.java | 0
.../ozone/shell/volume/AddAclVolumeHandler.java | 0
.../ozone/shell/volume/ClearQuotaHandler.java | 0
.../ozone/shell/volume/CreateVolumeHandler.java | 0
.../ozone/shell/volume/DeleteVolumeHandler.java | 0
.../ozone/shell/volume/GetAclVolumeHandler.java | 0
.../ozone/shell/volume/InfoVolumeHandler.java | 0
.../ozone/shell/volume/ListVolumeHandler.java | 0
.../ozone/shell/volume/RemoveAclVolumeHandler.java | 0
.../ozone/shell/volume/SetAclVolumeHandler.java | 0
.../hadoop/ozone/shell/volume/SetQuotaHandler.java | 0
.../ozone/shell/volume/UpdateVolumeHandler.java | 0
.../hadoop/ozone/shell/volume/VolumeCommands.java | 27 +-
.../hadoop/ozone/shell/volume/VolumeHandler.java | 0
.../hadoop/ozone/shell/volume/VolumeUri.java | 0
.../hadoop/ozone/shell/volume/package-info.java | 0
.../hadoop/ozone/shell/TestOzoneAddress.java | 0
.../shell/TestOzoneAddressClientCreation.java | 0
.../ozone/shell/keys/TestChecksumKeyHandler.java | 0
.../hadoop/ozone/shell/keys/package-info.java | 0
.../apache/hadoop/ozone/shell/package-info.java | 0
hadoop-ozone/client/pom.xml | 71 +-
.../client/checksum/BaseFileChecksumHelper.java | 35 +-
.../client/checksum/ECFileChecksumHelper.java | 29 -
.../checksum/ReplicatedFileChecksumHelper.java | 46 -
.../client/io/BlockDataStreamOutputEntry.java | 12 +
.../client/io/BlockDataStreamOutputEntryPool.java | 29 +
.../ozone/client/io/KeyDataStreamOutput.java | 20 +-
.../ozone/client/io/OzoneDataStreamOutput.java | 70 +-
.../hadoop/ozone/client/io/OzoneOutputStream.java | 6 +
.../apache/hadoop/ozone/client/rpc/RpcClient.java | 52 +-
hadoop-ozone/common/pom.xml | 148 ++-
.../main/java/org/apache/hadoop/ozone/OmUtils.java | 3 +-
.../ozone/client/io/SelectorOutputStream.java | 17 +-
.../org/apache/hadoop/ozone/om/OMConfigKeys.java | 11 -
.../apache/hadoop/ozone/om/helpers/OmKeyArgs.java | 11 +-
.../hadoop/ozone/om/helpers/OzoneFSUtils.java | 2 +-
hadoop-ozone/csi/pom.xml | 199 ++--
.../org/apache/hadoop/ozone/csi/CsiServer.java | 2 +-
hadoop-ozone/datanode/pom.xml | 38 +-
hadoop-ozone/dev-support/checks/_build.sh | 16 +-
hadoop-ozone/dev-support/checks/_lib.sh | 105 --
.../dev-support/checks/_mvn_unit_report.sh | 10 +-
hadoop-ozone/dev-support/checks/acceptance.sh | 19 +
hadoop-ozone/dev-support/checks/bats.sh | 6 +-
hadoop-ozone/dev-support/checks/build.sh | 3 +-
.../dev-support/checks/{build.sh => compile.sh} | 7 +-
hadoop-ozone/dev-support/checks/docs.sh | 2 +-
hadoop-ozone/dev-support/checks/findbugs.sh | 3 +-
.../checks/install/bats.sh} | 34 +-
.../checks/install/flekszible.sh} | 34 +-
.../checks/install/hugo.sh} | 70 +-
.../checks/{native.sh => install/k3s.sh} | 15 +-
.../checks/{_summary.sh => install/spotbugs.sh} | 29 +-
hadoop-ozone/dev-support/checks/kubernetes.sh | 8 +-
hadoop-ozone/dev-support/checks/native.sh | 2 +-
hadoop-ozone/dev-support/checks/repro.sh | 17 +-
.../dev-support/intellij/ozone-site-ha.xml | 4 -
hadoop-ozone/dev-support/intellij/ozone-site.xml | 4 -
.../intellij/runConfigurations/OzoneShell-ha.xml | 2 +-
.../intellij/runConfigurations/OzoneShell.xml | 2 +-
.../intellij/runConfigurations/ScmRoles.xml | 2 +-
.../dist/dev-support/bin/dist-layout-stitching | 2 +-
hadoop-ozone/dist/pom.xml | 226 ++--
.../Datanode Chunk Read_Write Dashboard.json | 85 +-
.../dashboards/Ozone - OMComittedIndexMetrics.json | 166 +++
.../dist/src/main/compose/common/replicas-test.sh | 48 +
.../{s3-haproxy.yaml => s3-haproxy-secure.yaml} | 13 +-
.../dist/src/main/compose/common/s3-haproxy.cfg | 10 +
.../dist/src/main/compose/common/s3a-test.sh | 2 +-
.../src/main/compose/ozone-balancer/docker-config | 2 -
.../dist/src/main/compose/ozone-ha/docker-config | 2 -
.../src/main/compose/ozone-om-ha/docker-config | 1 -
.../main/compose/ozone-om-prepare/docker-config | 1 -
.../src/main/compose/ozone/docker-compose.yaml | 2 +
.../dist/src/main/compose/ozone/prometheus.yml | 4 +-
hadoop-ozone/dist/src/main/compose/ozone/test.sh | 4 +-
.../src/main/compose/ozonesecure-ha/docker-config | 2 -
.../test.sh => ozonesecure/test-haproxy-s3g.sh} | 25 +-
hadoop-ozone/dist/src/main/compose/test-all.sh | 4 +-
hadoop-ozone/dist/src/main/compose/testlib.sh | 70 +-
.../dist/src/main/compose/upgrade/README.md | 18 +-
.../main/compose/upgrade/compose/ha/docker-config | 2 -
.../src/main/compose/upgrade/compose/non-ha/.env | 22 -
.../upgrade/compose/non-ha/docker-compose.yaml | 155 ---
.../compose/upgrade/compose/non-ha/docker-config | 49 -
.../main/compose/upgrade/compose/non-ha/load.sh | 29 -
.../src/main/compose/upgrade/compose/om-ha/.env | 27 -
.../upgrade/compose/om-ha/docker-compose.yaml | 178 ---
.../compose/upgrade/compose/om-ha/docker-config | 65 --
.../src/main/compose/upgrade/compose/om-ha/load.sh | 30 -
.../upgrade/upgrades/manual-upgrade/README.md | 19 -
.../upgrade/upgrades/manual-upgrade/driver.sh | 54 -
.../k8s/definitions/ozone/definitions/om-ha.yaml | 1 -
.../k8s/definitions/ozone/definitions/scm-ha.yaml | 1 -
.../k8s/examples/ozone-ha/config-configmap.yaml | 1 -
.../dist/src/main/k8s/examples/test-all.sh | 23 +-
hadoop-ozone/dist/src/main/k8s/examples/testlib.sh | 5 +-
hadoop-ozone/dist/src/main/license/jar-report.txt | 1 +
.../dist/src/main/smoketest/admincli/admin.robot | 2 +-
.../src/main/smoketest/admincli/container.robot | 24 +-
.../src/main/smoketest/admincli/datanode.robot | 2 +-
.../lease-recovery.robot} | 10 +-
.../src/main/smoketest/admincli/pipeline.robot | 2 +-
.../smoketest/admincli/replicationmanager.robot | 2 +-
.../src/main/smoketest/admincli/safemode.robot | 2 +-
.../dist/src/main/smoketest/basic/links.robot | 47 +-
.../src/main/smoketest/basic/ozone-shell-lib.robot | 39 +-
.../smoketest/compatibility/dn-one-rocksdb.robot | 2 +-
.../src/main/smoketest/compatibility/read.robot | 2 +-
.../dist/src/main/smoketest/createmrenv.robot | 2 +-
.../src/main/smoketest/debug/ozone-debug-ldb.robot | 8 +-
.../src/main/smoketest/debug/ozone-debug.robot | 5 -
.../dist/src/main/smoketest/ozone-lib/shell.robot | 5 +
.../main/smoketest/recon/recon-taskstatus.robot | 125 +++
.../src/main/smoketest/s3/MultipartUpload.robot | 6 +
.../dist/src/main/smoketest/s3/bucketcreate.robot | 12 +-
.../dist/src/main/smoketest/s3/commonawslib.robot | 14 +
.../dist/src/main/smoketest/s3/objectputget.robot | 39 +-
.../smoketest/s3/{freon.robot => rclone.robot} | 25 +-
.../src/main/smoketest/s3/s3_compatbility_check.sh | 1 +
.../src/main/smoketest/s3/secretgenerate.robot | 2 +-
.../dist/src/main/smoketest/s3/secretrevoke.robot | 3 +-
.../dist/src/main/smoketest/s3/webui.robot | 13 +-
.../dist/src/main/smoketest/spnego/web.robot | 2 +-
hadoop-ozone/dist/src/main/smoketest/testlib.sh | 50 +
hadoop-ozone/dist/src/shell/ozone/ozone | 44 +-
.../fault-injection-test/mini-chaos-tests/pom.xml | 33 +-
.../fault-injection-test/network-tests/pom.xml | 25 +-
hadoop-ozone/fault-injection-test/pom.xml | 11 +-
hadoop-ozone/httpfsgateway/pom.xml | 178 ++-
.../apache/ozone/fs/http/server/FSOperations.java | 2 +
hadoop-ozone/insight/pom.xml | 77 +-
.../ozone/insight/ConfigurationSubCommand.java | 2 +-
.../apache/hadoop/ozone/insight/LogSubcommand.java | 2 +-
.../hadoop/ozone/insight/MetricsSubCommand.java | 2 +-
hadoop-ozone/integration-test/pom.xml | 229 ++--
.../AbstractContractGetFileStatusTest.java | 16 +-
.../fs/ozone/AbstractOzoneFileSystemTest.java | 82 +-
.../ozone/AbstractOzoneFileSystemTestWithFSO.java | 4 +-
.../ozone/AbstractRootedOzoneFileSystemTest.java | 18 +-
.../AbstractRootedOzoneFileSystemTestWithFSO.java | 4 +-
.../ozone/TestDirectoryDeletingServiceWithFSO.java | 99 +-
.../java/org/apache/hadoop/fs/ozone/TestHSync.java | 36 +-
.../apache/hadoop/fs/ozone/TestHSyncUpgrade.java | 2 -
.../apache/hadoop/fs/ozone/TestLeaseRecovery.java | 239 ++--
.../java/org/apache/hadoop/fs/ozone/TestO3FS.java | 2 +-
.../apache/hadoop/fs/ozone/TestO3FSWithFSO.java | 2 +-
.../hadoop/fs/ozone/TestO3FSWithFSPaths.java | 2 +-
.../fs/ozone/TestO3FSWithFSPathsAndOMRatis.java | 28 -
.../hadoop/fs/ozone/TestO3FSWithOMRatis.java | 28 -
.../java/org/apache/hadoop/fs/ozone/TestOFS.java | 2 +-
.../hadoop/fs/ozone/TestOFSWithCacheOnly.java | 28 -
.../org/apache/hadoop/fs/ozone/TestOFSWithFSO.java | 2 +-
.../fs/ozone/TestOFSWithFSOAndCacheOnly.java | 27 -
.../hadoop/fs/ozone/TestOFSWithFSOAndOMRatis.java | 27 -
.../TestOFSWithFSOAndOMRatisAndCacheOnly.java | 27 -
.../apache/hadoop/fs/ozone/TestOFSWithFSPaths.java | 2 +-
.../fs/ozone/TestOFSWithFSPathsAndOMRatis.java | 28 -
.../ozone/TestOFSWithFSPathsAndOMRatisAndACL.java | 28 -
.../TestOFSWithFSPathsAndOMRatisAndCacheOnly.java | 28 -
.../apache/hadoop/fs/ozone/TestOFSWithOMRatis.java | 28 -
.../fs/ozone/TestOzoneFileSystemPrefixParser.java | 2 +-
.../fs/ozone/TestOzoneFileSystemWithStreaming.java | 8 +-
.../apache/hadoop/fs/ozone/TestOzoneFsHAURLs.java | 51 +-
.../hadoop/fs/ozone/TestRootedDDSWithFSO.java | 2 -
.../ozone/contract/AbstractOzoneContractTest.java | 62 +-
.../fs/ozone/contract/TestOzoneContractFSO.java | 4 +-
.../fs/ozone/contract/TestOzoneContractLegacy.java | 4 +-
.../hadoop/hdds/scm/TestAllocateContainer.java | 26 +-
.../hdds/scm/TestContainerReportWithKeys.java | 59 +-
.../hadoop/hdds/scm/TestContainerSmallFile.java | 32 +-
.../scm/TestGetCommittedBlockLengthAndPutKey.java | 30 +-
.../hadoop/hdds/scm/TestSCMInstallSnapshot.java | 3 +-
.../hadoop/hdds/scm/TestSCMNodeManagerMXBean.java | 36 +-
.../apache/hadoop/hdds/scm/TestSCMSnapshot.java | 1 -
.../hadoop/hdds/scm/TestSecretKeySnapshot.java | 2 -
.../apache/hadoop/hdds/scm/TestSecretKeysApi.java | 2 -
.../hdds/scm/TestStorageContainerManager.java | 491 ++++-----
.../hdds/scm/TestStorageContainerManagerHA.java | 2 -
.../metrics/TestSCMContainerManagerMetrics.java | 1 +
.../scm/pipeline/TestPipelineManagerMXBean.java | 25 +-
.../hdds/scm/storage/TestContainerCommandsEC.java | 7 +-
.../org/apache/hadoop/ozone/MiniOzoneCluster.java | 28 -
.../apache/hadoop/ozone/MiniOzoneClusterImpl.java | 46 +-
.../hadoop/ozone/MiniOzoneHAClusterImpl.java | 3 -
.../org/apache/hadoop/ozone/OzoneTestUtils.java | 33 +
.../org/apache/hadoop/ozone/TestBlockTokens.java | 2 -
.../apache/hadoop/ozone/TestBlockTokensCLI.java | 6 +-
.../org/apache/hadoop/ozone/TestCpuMetrics.java | 18 +-
.../apache/hadoop/ozone/TestDelegationToken.java | 6 +-
.../ozone/TestGetClusterTreeInformation.java | 33 +-
.../hadoop/ozone/TestMultipartObjectGet.java | 4 +-
.../hadoop/ozone/TestOzoneConfigurationFields.java | 3 +-
.../hadoop/ozone/TestSecureOzoneCluster.java | 63 +-
.../hadoop/ozone/UniformDatanodesFactory.java | 26 +
.../om/lease}/TestLeaseRecoverer.java | 2 +-
.../client/rpc/TestBlockDataStreamOutput.java | 401 ++++---
.../ozone/client/rpc/TestBlockOutputStream.java | 7 +-
.../rpc/TestBlockOutputStreamWithFailures.java | 31 +-
.../client/rpc/TestContainerStateMachine.java | 2 +
.../ozone/client/rpc/TestDatanodeVersion.java | 143 ---
.../client/rpc/TestDeleteWithInAdequateDN.java | 3 +
.../rpc/TestOzoneClientMultipartUploadWithFSO.java | 157 ++-
.../ozone/client/rpc/TestOzoneRpcClient.java | 4 +-
.../client/rpc/TestOzoneRpcClientWithRatis.java | 55 -
.../client/rpc/read/TestChunkInputStream.java | 18 +-
.../ozone/client/rpc/read/TestInputStreamBase.java | 48 +-
.../ozone/client/rpc/read/TestKeyInputStream.java | 86 +-
.../commandhandler/TestBlockDeletion.java | 50 +-
.../commandhandler/TestDeleteContainerHandler.java | 6 +
.../commandhandler/TestFinalizeBlock.java | 28 +-
.../metrics/TestDatanodeQueueMetrics.java | 51 +-
.../org/apache/hadoop/ozone/debug/TestLDBCli.java | 4 +-
.../hadoop/ozone/freon/TestDNRPCLoadGenerator.java | 56 +-
.../apache/hadoop/ozone/om/TestKeyManagerImpl.java | 102 +-
.../org/apache/hadoop/ozone/om/TestKeyPurging.java | 2 -
.../hadoop/ozone/om/TestOMDbCheckpointServlet.java | 184 ++--
.../hadoop/ozone/om/TestOMEpochForNonRatis.java | 215 ----
.../apache/hadoop/ozone/om/TestObjectStore.java | 33 +-
.../hadoop/ozone/om/TestObjectStoreWithFSO.java | 42 +-
.../hadoop/ozone/om/TestOmBlockVersioning.java | 44 +-
.../ozone/om/TestOzoneManagerConfiguration.java | 1 -
.../ozone/om/TestOzoneManagerRestInterface.java | 24 +-
.../hadoop/ozone/om/TestSecureOzoneManager.java | 6 +-
.../om/ratis/TestOzoneManagerRatisRequest.java | 18 +-
.../snapshot/TestOzoneManagerSnapshotProvider.java | 1 -
...TestSnapshotDeletingServiceIntegrationTest.java | 3 -
.../TestReconInsightsForDeletedDirectories.java | 41 +-
.../hadoop/ozone/recon/TestReconScmHASnapshot.java | 65 --
.../ozone/recon/TestReconScmNonHASnapshot.java | 64 --
.../apache/hadoop/ozone/recon/TestReconTasks.java | 1 +
.../ozone/recon/TestReconWithOzoneManager.java | 4 +-
.../ozone/recon/TestReconWithOzoneManagerHA.java | 2 -
.../hadoop/ozone/repair/om/TestFSORepairTool.java | 281 +++--
.../ozone/s3/awssdk/v1/AbstractS3SDKV1Tests.java | 60 +
.../hadoop/ozone/s3/awssdk/v1/TestS3SDKV1.java | 4 +-
.../ozone/s3/awssdk/v1/TestS3SDKV1WithRatis.java | 49 -
.../awssdk/v1/TestS3SDKV1WithRatisStreaming.java | 2 -
.../ozone/shell/TestDeletedBlocksTxnShell.java | 2 -
.../hadoop/ozone/shell/TestNSSummaryAdmin.java | 2 +-
.../hadoop/ozone/shell/TestOzoneDebugShell.java | 4 +-
.../hadoop/ozone/shell/TestOzoneRepairShell.java | 139 ++-
.../hadoop/ozone/shell/TestOzoneShellHA.java | 2 +-
.../hadoop/ozone/shell/TestOzoneTenantShell.java | 48 +-
.../hadoop/ozone/shell/TestReconfigShell.java | 2 +-
.../apache/hadoop/ozone/shell/TestScmAdminHA.java | 41 +-
.../ozone/shell/TestTransferLeadershipShell.java | 2 +-
.../org/apache/ozone/test/ClusterForTests.java | 96 ++
.../test/java/org/apache/ozone/test/HATests.java | 83 ++
.../java/org/apache/ozone/test/NonHATests.java | 141 +++
.../apache/ozone/test/TestOzoneIntegrationHA.java | 16 +-
.../test/TestOzoneIntegrationNonHA.java} | 16 +-
.../java/org/apache/ozone/test}/package-info.java | 8 +-
hadoop-ozone/interface-client/pom.xml | 92 +-
hadoop-ozone/interface-storage/pom.xml | 59 +-
hadoop-ozone/ozone-manager/pom.xml | 387 +++----
...dingKeysDeletion.java => DeleteKeysResult.java} | 37 +-
.../hadoop/ozone/om/DeletingServiceMetrics.java | 163 +++
.../org/apache/hadoop/ozone/om/KeyManager.java | 10 +-
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 65 +-
.../hadoop/ozone/om/OMDBCheckpointServlet.java | 46 +-
.../java/org/apache/hadoop/ozone/om/OMMetrics.java | 1 -
.../hadoop/ozone/om/OmMetadataManagerImpl.java | 7 +-
.../org/apache/hadoop/ozone/om/OzoneManager.java | 16 +-
.../hadoop/ozone/om/OzoneManagerStarter.java | 5 +-
.../execution/flowcontrol/ExecutionContext.java} | 42 +-
.../om/execution/flowcontrol}/package-info.java | 5 +-
.../ozone/om/ratis/OzoneManagerStateMachine.java | 4 +-
.../hadoop/ozone/om/request/OMClientRequest.java | 8 +-
.../om/request/bucket/OMBucketCreateRequest.java | 6 +-
.../om/request/bucket/OMBucketDeleteRequest.java | 6 +-
.../om/request/bucket/OMBucketSetOwnerRequest.java | 6 +-
.../request/bucket/OMBucketSetPropertyRequest.java | 6 +-
.../om/request/bucket/acl/OMBucketAclRequest.java | 6 +-
.../request/bucket/acl/OMBucketAddAclRequest.java | 6 +-
.../bucket/acl/OMBucketRemoveAclRequest.java | 6 +-
.../request/bucket/acl/OMBucketSetAclRequest.java | 6 +-
.../om/request/file/OMDirectoryCreateRequest.java | 6 +-
.../file/OMDirectoryCreateRequestWithFSO.java | 6 +-
.../ozone/om/request/file/OMFileCreateRequest.java | 6 +-
.../request/file/OMFileCreateRequestWithFSO.java | 6 +-
.../om/request/file/OMRecoverLeaseRequest.java | 6 +-
.../om/request/key/OMAllocateBlockRequest.java | 6 +-
.../request/key/OMAllocateBlockRequestWithFSO.java | 6 +-
.../key/OMDirectoriesPurgeRequestWithFSO.java | 25 +-
.../ozone/om/request/key/OMKeyCommitRequest.java | 6 +-
.../om/request/key/OMKeyCommitRequestWithFSO.java | 6 +-
.../ozone/om/request/key/OMKeyCreateRequest.java | 6 +-
.../om/request/key/OMKeyCreateRequestWithFSO.java | 6 +-
.../ozone/om/request/key/OMKeyDeleteRequest.java | 6 +-
.../om/request/key/OMKeyDeleteRequestWithFSO.java | 6 +-
.../ozone/om/request/key/OMKeyPurgeRequest.java | 16 +-
.../ozone/om/request/key/OMKeyRenameRequest.java | 6 +-
.../om/request/key/OMKeyRenameRequestWithFSO.java | 6 +-
.../ozone/om/request/key/OMKeySetTimesRequest.java | 6 +-
.../request/key/OMKeySetTimesRequestWithFSO.java | 6 +-
.../ozone/om/request/key/OMKeysDeleteRequest.java | 6 +-
.../ozone/om/request/key/OMKeysRenameRequest.java | 6 +-
.../om/request/key/OMOpenKeysDeleteRequest.java | 6 +-
.../ozone/om/request/key/acl/OMKeyAclRequest.java | 6 +-
.../om/request/key/acl/OMKeyAclRequestWithFSO.java | 6 +-
.../om/request/key/acl/OMKeyAddAclRequest.java | 6 +-
.../request/key/acl/OMKeyAddAclRequestWithFSO.java | 6 +-
.../om/request/key/acl/OMKeyRemoveAclRequest.java | 6 +-
.../key/acl/OMKeyRemoveAclRequestWithFSO.java | 6 +-
.../om/request/key/acl/OMKeySetAclRequest.java | 6 +-
.../request/key/acl/OMKeySetAclRequestWithFSO.java | 6 +-
.../request/key/acl/prefix/OMPrefixAclRequest.java | 6 +-
.../S3ExpiredMultipartUploadsAbortRequest.java | 6 +-
.../S3InitiateMultipartUploadRequest.java | 6 +-
.../S3InitiateMultipartUploadRequestWithFSO.java | 6 +-
.../multipart/S3MultipartUploadAbortRequest.java | 6 +-
.../S3MultipartUploadCommitPartRequest.java | 6 +-
.../S3MultipartUploadCompleteRequest.java | 6 +-
.../om/request/s3/security/OMSetSecretRequest.java | 6 +-
.../om/request/s3/security/S3GetSecretRequest.java | 14 +-
.../request/s3/security/S3RevokeSecretRequest.java | 4 +-
.../s3/tagging/S3DeleteObjectTaggingRequest.java | 6 +-
.../S3DeleteObjectTaggingRequestWithFSO.java | 6 +-
.../s3/tagging/S3PutObjectTaggingRequest.java | 6 +-
.../tagging/S3PutObjectTaggingRequestWithFSO.java | 6 +-
.../tenant/OMSetRangerServiceVersionRequest.java | 6 +-
.../s3/tenant/OMTenantAssignAdminRequest.java | 6 +-
.../tenant/OMTenantAssignUserAccessIdRequest.java | 6 +-
.../request/s3/tenant/OMTenantCreateRequest.java | 6 +-
.../request/s3/tenant/OMTenantDeleteRequest.java | 6 +-
.../s3/tenant/OMTenantRevokeAdminRequest.java | 6 +-
.../tenant/OMTenantRevokeUserAccessIdRequest.java | 6 +-
.../security/OMCancelDelegationTokenRequest.java | 6 +-
.../security/OMGetDelegationTokenRequest.java | 6 +-
.../security/OMRenewDelegationTokenRequest.java | 6 +-
.../request/snapshot/OMSnapshotCreateRequest.java | 8 +-
.../request/snapshot/OMSnapshotDeleteRequest.java | 6 +-
.../snapshot/OMSnapshotMoveDeletedKeysRequest.java | 12 +-
.../snapshot/OMSnapshotMoveTableKeysRequest.java | 12 +-
.../request/snapshot/OMSnapshotPurgeRequest.java | 14 +-
.../request/snapshot/OMSnapshotRenameRequest.java | 9 +-
.../snapshot/OMSnapshotSetPropertyRequest.java | 6 +-
.../om/request/upgrade/OMCancelPrepareRequest.java | 8 +-
.../request/upgrade/OMFinalizeUpgradeRequest.java | 6 +-
.../ozone/om/request/upgrade/OMPrepareRequest.java | 10 +-
.../om/request/util/OMEchoRPCWriteRequest.java | 4 +-
.../om/request/validation/VersionExtractor.java | 63 ++
.../om/request/volume/OMQuotaRepairRequest.java | 6 +-
.../om/request/volume/OMVolumeCreateRequest.java | 6 +-
.../om/request/volume/OMVolumeDeleteRequest.java | 6 +-
.../om/request/volume/OMVolumeSetOwnerRequest.java | 6 +-
.../om/request/volume/OMVolumeSetQuotaRequest.java | 6 +-
.../om/request/volume/acl/OMVolumeAclRequest.java | 6 +-
.../request/volume/acl/OMVolumeAddAclRequest.java | 6 +-
.../volume/acl/OMVolumeRemoveAclRequest.java | 6 +-
.../request/volume/acl/OMVolumeSetAclRequest.java | 6 +-
.../S3MultipartUploadCompleteResponse.java | 2 +
.../S3MultipartUploadCompleteResponseWithFSO.java | 13 +-
.../response/s3/security/S3GetSecretResponse.java | 9 +-
.../response/snapshot/OMSnapshotPurgeResponse.java | 6 +
.../om/service/AbstractKeyDeletingService.java | 67 +-
.../ozone/om/service/DirectoryDeletingService.java | 52 +-
.../ozone/om/service/KeyDeletingService.java | 5 +
...OzoneManagerProtocolServerSideTranslatorPB.java | 19 +-
.../protocolPB/OzoneManagerRequestHandler.java | 12 +-
.../hadoop/ozone/protocolPB/RequestHandler.java | 14 +-
.../OzoneDelegationTokenSecretManager.java | 5 +-
.../webapps/ozoneManager/om-overview.html | 3 +
.../hadoop/ozone/om/TestOmSnapshotManager.java | 60 +-
...TestOzoneManagerDoubleBufferWithOMResponse.java | 10 +-
.../ozone/om/request/key/TestOMKeyRequest.java | 4 +
.../s3/security/TestS3GetSecretRequest.java | 28 +
.../TestOMSnapshotPurgeRequestAndResponse.java | 37 +
.../request/validation/TestVersionExtractor.java | 66 ++
.../om/service/TestDirectoryDeletingService.java | 62 +-
.../security/TestOmCertificateClientInit.java | 10 +-
hadoop-ozone/ozonefs-common/pom.xml | 100 +-
.../fs/ozone/BasicOzoneClientAdapterImpl.java | 8 +-
.../hadoop/fs/ozone/BasicOzoneFileSystem.java | 7 +-
.../ozone/BasicRootedOzoneClientAdapterImpl.java | 8 +-
.../fs/ozone/BasicRootedOzoneFileSystem.java | 7 +-
...am.java => CapableOzoneFSDataStreamOutput.java} | 34 +-
.../hadoop/fs/ozone/OzoneFSDataStreamOutput.java | 16 +
.../apache/hadoop/fs/ozone/OzoneFSInputStream.java | 5 +
hadoop-ozone/ozonefs-hadoop2/pom.xml | 68 +-
hadoop-ozone/ozonefs-hadoop3-client/pom.xml | 45 +-
hadoop-ozone/ozonefs-hadoop3/pom.xml | 21 +-
.../apache/hadoop/fs/ozone/OzoneFileSystem.java | 6 +
.../hadoop/fs/ozone/RootedOzoneFileSystem.java | 6 +
hadoop-ozone/ozonefs-shaded/pom.xml | 94 +-
hadoop-ozone/ozonefs/pom.xml | 117 +-
.../apache/hadoop/fs/ozone/OzoneFileSystem.java | 6 +
.../hadoop/fs/ozone/RootedOzoneFileSystem.java | 6 +
hadoop-ozone/pom.xml | 244 +++--
hadoop-ozone/recon-codegen/pom.xml | 48 +-
.../recon/schema/ReconTaskSchemaDefinition.java | 2 +
hadoop-ozone/recon/pom.xml | 693 ++++++------
.../hadoop/ozone/recon/ReconControllerModule.java | 2 +
.../org/apache/hadoop/ozone/recon/ReconServer.java | 5 +-
.../hadoop/ozone/recon/ReconServerConfigKeys.java | 6 +-
.../hadoop/ozone/recon/api/TaskStatusService.java | 5 +-
.../ozone/recon/fsck/ContainerHealthTask.java | 23 +-
.../hadoop/ozone/recon/scm/PipelineSyncTask.java | 22 +-
.../ozone/recon/scm/ReconDeadNodeHandler.java | 4 +-
.../hadoop/ozone/recon/scm/ReconScmTask.java | 44 +-
.../ozone/recon/scm/ReconStaleNodeHandler.java | 2 +-
.../scm/ReconStorageContainerManagerFacade.java | 34 +-
.../spi/impl/OzoneManagerServiceProviderImpl.java | 127 ++-
.../ozone/recon/tasks/ContainerKeyMapperTask.java | 6 +-
.../ozone/recon/tasks/ContainerSizeCountTask.java | 61 +-
.../ozone/recon/tasks/FileSizeCountTask.java | 4 +-
.../hadoop/ozone/recon/tasks/NSSummaryTask.java | 3 +
.../ozone/recon/tasks/OMDBUpdatesHandler.java | 9 +
.../ozone/recon/tasks/OMUpdateEventBatch.java | 10 +-
.../ozone/recon/tasks/OmTableInsightTask.java | 4 +-
.../ozone/recon/tasks/ReconTaskController.java | 14 +-
.../ozone/recon/tasks/ReconTaskControllerImpl.java | 263 +++--
.../ozone/recon/tasks/types/NamedCallableTask.java | 34 +-
.../recon/tasks/types/TaskExecutionException.java | 21 +-
.../ozone/recon/tasks/types}/package-info.java | 6 +-
.../tasks/updater/ReconTaskStatusUpdater.java | 123 +++
.../updater/ReconTaskStatusUpdaterManager.java | 69 ++
.../ozone/recon/tasks/updater}/package-info.java | 4 +-
.../ozone/recon/upgrade/ReconLayoutFeature.java | 3 +-
.../upgrade/ReconTaskStatusTableUpgradeAction.java | 104 ++
.../webapps/recon/ozone-recon-web/package.json | 1 +
.../webapps/recon/ozone-recon-web/pnpm-lock.yaml | 12 +
.../src/__tests__/datanodes/Datanodes.test.tsx | 191 ++++
.../__tests__/datanodes/DatanodesTable.test.tsx | 151 +++
.../src/__tests__/locators/locators.ts | 13 +-
.../mocks/datanodeMocks/datanodeResponseMocks.ts | 212 ++++
.../datanodeServer.ts} | 51 +-
.../src/__tests__/utils/datanodes.utils.tsx | 8 +-
.../webapps/recon/ozone-recon-web/src/app.tsx | 9 +-
.../src/components/overviewCard/overviewCard.tsx | 9 +-
.../recon/ozone-recon-web/src/utils/common.tsx | 29 +
.../components/duBreadcrumbNav/duBreadcrumbNav.tsx | 8 +-
.../src/v2/components/duMetadata/duMetadata.tsx | 340 +++---
.../overviewCard/overviewStorageCard.tsx | 8 +-
.../src/v2/components/plots/duPieChart.tsx | 2 +-
.../src/v2/components/search/search.tsx | 6 +-
.../src/v2/components/select/multiSelect.tsx | 6 +-
.../src/v2/components/storageBar/storageBar.less | 29 +-
.../src/v2/components/storageBar/storageBar.tsx | 46 +-
.../src/v2/components/tables/datanodesTable.tsx | 8 +-
.../src/v2/pages/datanodes/datanodes.tsx | 13 +-
.../src/v2/pages/diskUsage/diskUsage.less | 1 +
.../src/v2/pages/diskUsage/diskUsage.tsx | 25 +-
.../src/v2/pages/overview/overview.tsx | 27 +-
.../src/views/overview/overview.tsx | 2 +-
.../hadoop/ozone/recon/api/TestEndpoints.java | 2 +-
.../ozone/recon/api/TestTaskStatusService.java | 21 +-
.../ozone/recon/api/TestTriggerDBSyncEndpoint.java | 16 +-
.../ozone/recon/fsck/TestContainerHealthTask.java | 34 +-
.../TestReconInternalSchemaDefinition.java | 6 +-
.../persistence/TestReconWithDifferentSqlDBs.java | 2 +-
.../recon/persistence/TestSqlSchemaSetup.java | 10 +-
.../impl/TestOzoneManagerServiceProviderImpl.java | 115 +-
.../recon/tasks/TestContainerKeyMapperTask.java | 6 +-
.../recon/tasks/TestContainerSizeCountTask.java | 22 +-
.../ozone/recon/tasks/TestFileSizeCountTask.java | 8 +-
.../ozone/recon/tasks/TestNSSummaryTask.java | 2 +-
.../recon/tasks/TestNSSummaryTaskWithFSO.java | 2 +-
.../recon/tasks/TestNSSummaryTaskWithLegacy.java | 2 +-
.../TestNSSummaryTaskWithLegacyOBSLayout.java | 2 +-
.../recon/tasks/TestNSSummaryTaskWithOBS.java | 2 +-
.../ozone/recon/tasks/TestOmTableInsightTask.java | 18 +-
.../recon/tasks/TestReconTaskControllerImpl.java | 53 +-
.../recon/tasks/TestReconTaskStatusUpdater.java | 101 ++
hadoop-ozone/s3-secret-store/pom.xml | 30 +-
.../ozone/s3/remote/vault/VaultS3SecretStore.java | 8 +-
hadoop-ozone/s3gateway/pom.xml | 239 ++--
.../hadoop/ozone/s3/AuthorizationFilter.java | 6 -
.../java/org/apache/hadoop/ozone/s3/Gateway.java | 11 +-
.../apache/hadoop/ozone/s3/GatewayApplication.java | 2 +-
.../hadoop/ozone/s3/RootPageDisplayFilter.java | 64 --
.../hadoop/ozone/s3/S3GatewayConfigKeys.java | 14 +
.../hadoop/ozone/s3/S3GatewayHttpServer.java | 80 +-
...ttpServer.java => S3GatewayWebAdminServer.java} | 59 +-
.../hadoop/ozone/s3/VirtualHostStyleFilter.java | 7 -
.../hadoop/ozone/s3/endpoint/EndpointBase.java | 12 +
.../hadoop/ozone/s3/endpoint/RootEndpoint.java | 5 +-
.../Application.java} | 8 +-
.../ozone/s3secret/S3SecretManagementEndpoint.java | 2 +-
.../webapps/{s3gateway => s3g-web}/WEB-INF/web.xml | 30 +-
.../webapps/{static => s3g-web}/images/ozone.ico | Bin
.../webapps/{static => s3g-web}/index.html | 24 +-
.../resources/webapps/s3gateway/WEB-INF/web.xml | 11 +-
.../src/main/resources/webapps/static/s3g.js | 21 -
.../hadoop/ozone/client/OzoneBucketStub.java | 10 +
.../ozone/client/OzoneDataStreamOutputStub.java | 2 +-
.../hadoop/ozone/s3/TestAuthorizationFilter.java | 22 -
.../hadoop/ozone/s3/TestS3GatewayAuditLog.java | 39 +-
.../ozone/s3/TestVirtualHostStyleFilter.java | 23 -
.../hadoop/ozone/s3/endpoint/EndpointBuilder.java | 125 +++
.../endpoint/ObjectEndpointBuilder.java} | 27 +-
.../s3/endpoint/TestAbortMultipartUpload.java | 10 +-
.../hadoop/ozone/s3/endpoint/TestBucketAcl.java | 5 +-
.../hadoop/ozone/s3/endpoint/TestBucketDelete.java | 5 +-
.../hadoop/ozone/s3/endpoint/TestBucketHead.java | 5 +-
.../hadoop/ozone/s3/endpoint/TestBucketList.java | 26 +-
.../hadoop/ozone/s3/endpoint/TestBucketPut.java | 5 +-
.../s3/endpoint/TestInitiateMultipartUpload.java | 10 +-
.../hadoop/ozone/s3/endpoint/TestListParts.java | 34 +-
.../s3/endpoint/TestMultipartUploadComplete.java | 35 +-
.../s3/endpoint/TestMultipartUploadWithCopy.java | 2 +
.../hadoop/ozone/s3/endpoint/TestObjectDelete.java | 7 +-
.../hadoop/ozone/s3/endpoint/TestObjectGet.java | 9 +-
.../hadoop/ozone/s3/endpoint/TestObjectHead.java | 6 +-
.../ozone/s3/endpoint/TestObjectMultiDelete.java | 10 +-
.../hadoop/ozone/s3/endpoint/TestObjectPut.java | 13 +-
.../ozone/s3/endpoint/TestObjectTaggingDelete.java | 16 +-
.../ozone/s3/endpoint/TestObjectTaggingGet.java | 11 +-
.../ozone/s3/endpoint/TestObjectTaggingPut.java | 19 +-
.../hadoop/ozone/s3/endpoint/TestPartUpload.java | 51 +-
.../s3/endpoint/TestPartUploadWithStream.java | 34 +-
.../ozone/s3/endpoint/TestPermissionCheck.java | 90 +-
.../hadoop/ozone/s3/endpoint/TestRootList.java | 5 +-
.../ozone/s3/endpoint/TestUploadWithStream.java | 42 +-
.../ozone/s3/metrics/TestS3GatewayMetrics.java | 18 +-
hadoop-ozone/tools/pom.xml | 211 ++--
.../org/apache/hadoop/ozone/admin}/OzoneAdmin.java | 17 +-
.../ozone/admin/nssummary/NSSummaryAdmin.java | 6 +-
.../org/apache/hadoop/ozone/admin/om/OMAdmin.java | 6 +-
.../{debug => admin/om/lease}/LeaseRecoverer.java | 13 +-
.../ozone/admin/om/lease/LeaseSubCommand.java | 26 +-
.../hadoop/ozone/admin/om/lease}/package-info.java | 4 +-
.../ozone/admin/reconfig/ReconfigureCommands.java | 17 +-
.../ozone/admin/scm/DeletedBlocksTxnCommands.java | 13 +-
.../apache/hadoop/ozone/admin/scm/ScmAdmin.java | 2 +-
.../org/apache/hadoop/ozone/conf/OzoneGetConf.java | 26 +-
.../org/apache/hadoop/ozone/debug/OzoneDebug.java | 5 +-
.../apache/hadoop/ozone/debug/ReadReplicas.java | 9 +-
.../datanode/DatanodeDebug.java} | 29 +-
.../container/ContainerCommands.java | 32 +-
.../{ => datanode}/container/ExportSubcommand.java | 4 +-
.../{ => datanode}/container/InfoSubcommand.java | 6 +-
.../container/InspectSubcommand.java | 9 +-
.../{ => datanode}/container/ListSubcommand.java | 6 +-
.../{ => datanode}/container/package-info.java | 2 +-
.../debug/{chunk => datanode}/package-info.java | 4 +-
.../debug/ldb/{DropTable.java => Checkpoint.java} | 51 +-
.../apache/hadoop/ozone/debug/ldb/DBScanner.java | 28 +-
.../apache/hadoop/ozone/debug/ldb/RDBParser.java | 18 +-
.../apache/hadoop/ozone/debug/ldb/ValueSchema.java | 26 +-
.../om/OMDebug.java} | 28 +-
.../hadoop/ozone/debug/{ => om}/PrefixParser.java | 12 +-
.../{repair/ldb => debug/om}/package-info.java | 4 +-
.../replicas/ReplicasDebug.java} | 34 +-
.../{ => replicas}/chunk/ChunkDataNodeDetails.java | 2 +-
.../debug/{ => replicas}/chunk/ChunkDetails.java | 2 +-
.../{ => replicas}/chunk/ChunkKeyHandler.java | 20 +-
.../debug/{ => replicas}/chunk/ChunkType.java | 2 +-
.../{ => replicas}/chunk/ContainerChunkInfo.java | 2 +-
.../debug/{ => replicas}/chunk/package-info.java | 4 +-
.../debug/{chunk => replicas}/package-info.java | 4 +-
.../hadoop/ozone/freon/BaseFreonGenerator.java | 5 +-
.../hadoop/ozone/freon/ChunkManagerDiskWrite.java | 2 +
.../ozone/freon/ClosedContainerReplicator.java | 40 +-
.../hadoop/ozone/freon/DNRPCLoadGenerator.java | 6 +-
.../hadoop/ozone/freon/DatanodeBlockPutter.java | 2 +
.../hadoop/ozone/freon/DatanodeChunkGenerator.java | 2 +
.../hadoop/ozone/freon/DatanodeChunkValidator.java | 2 +
.../hadoop/ozone/freon/DatanodeSimulator.java | 6 +-
.../freon/FollowerAppendLogEntryGenerator.java | 2 +
.../java/org/apache/hadoop/ozone/freon/Freon.java | 51 +-
.../hadoop/ozone/freon/FreonSubcommand.java} | 10 +-
.../hadoop/ozone/freon/HadoopDirTreeGenerator.java | 2 +
.../hadoop/ozone/freon/HadoopFsGenerator.java | 2 +
.../hadoop/ozone/freon/HadoopFsValidator.java | 2 +
.../ozone/freon/HadoopNestedDirGenerator.java | 2 +
.../apache/hadoop/ozone/freon/HsyncGenerator.java | 4 +-
.../ozone/freon/LeaderAppendLogEntryGenerator.java | 2 +
.../hadoop/ozone/freon/OmBucketGenerator.java | 2 +
.../ozone/freon/OmBucketReadWriteFileOps.java | 3 +-
.../ozone/freon/OmBucketReadWriteKeyOps.java | 3 +-
.../apache/hadoop/ozone/freon/OmBucketRemover.java | 2 +
.../apache/hadoop/ozone/freon/OmKeyGenerator.java | 2 +
.../hadoop/ozone/freon/OmMetadataGenerator.java | 2 +
.../hadoop/ozone/freon/OmRPCLoadGenerator.java | 2 +
.../hadoop/ozone/freon/OzoneClientCreator.java | 2 +
.../ozone/freon/OzoneClientKeyGenerator.java | 2 +
.../freon/OzoneClientKeyReadWriteListOps.java | 2 +
.../hadoop/ozone/freon/OzoneClientKeyRemover.java | 2 +
.../ozone/freon/OzoneClientKeyValidator.java | 2 +
.../hadoop/ozone/freon/RandomKeyGenerator.java | 8 +-
.../hadoop/ozone/freon/RangeKeysGenerator.java | 2 +
.../hadoop/ozone/freon/S3BucketGenerator.java | 2 +
.../apache/hadoop/ozone/freon/S3KeyGenerator.java | 2 +
.../hadoop/ozone/freon/SCMThroughputBenchmark.java | 9 +-
.../apache/hadoop/ozone/freon/SameKeyReader.java | 2 +
.../hadoop/ozone/freon/StreamingGenerator.java | 2 +
.../containergenerator/GeneratorDatanode.java | 3 +
.../freon/containergenerator/GeneratorOm.java | 4 +
.../freon/containergenerator/GeneratorScm.java | 4 +
.../GenerateOzoneRequiredConfigurations.java | 48 +-
.../apache/hadoop/ozone/repair/OzoneRepair.java | 31 +-
.../{package-info.java => ReadOnlyCommand.java} | 9 +-
.../org/apache/hadoop/ozone/repair/RepairTool.java | 150 +++
.../repair/{ldb => }/TransactionInfoRepair.java | 94 +-
.../apache/hadoop/ozone/repair/ldb/RDBRepair.java | 57 -
.../hadoop/ozone/repair/om/FSORepairCLI.java | 78 --
.../hadoop/ozone/repair/om/FSORepairTool.java | 730 +++++++------
.../apache/hadoop/ozone/repair/om/OMRepair.java | 20 +-
.../SnapshotChainRepair.java} | 91 +-
.../om/{package-info.java => SnapshotRepair.java} | 16 +-
.../ozone/repair/{ => om}/quota/QuotaRepair.java | 32 +-
.../ozone/repair/{ => om}/quota/QuotaStatus.java | 17 +-
.../ozone/repair/{ => om}/quota/QuotaTrigger.java | 34 +-
.../ozone/repair/{ => om/quota}/package-info.java | 4 +-
.../hadoop/ozone/repair/quota/package-info.java | 22 -
.../{om/OMRepair.java => scm/SCMRepair.java} | 29 +-
.../hadoop/ozone/repair/scm/cert/CertRepair.java | 24 +-
.../{ => scm/cert}/RecoverSCMCertificate.java | 70 +-
.../ldb => repair/scm/cert}/package-info.java | 4 +-
.../ozone/repair/{ldb => scm}/package-info.java | 4 +-
.../org/apache/hadoop/ozone/shell/OzoneRatis.java | 2 +-
.../ozone/shell/checknative/CheckNative.java | 11 +-
.../hadoop/ozone/conf/TestGetConfOptions.java | 76 +-
.../hadoop/ozone/repair/TestOzoneRepair.java | 65 +-
.../ozone/repair/TestTransactionInfoRepair.java | 158 +++
.../repair/ldb/TestTransactionInfoRepair.java | 146 ---
.../ozone/repair/om/TestSnapshotChainRepair.java | 304 ++++++
.../ozone/scm/TestDecommissionScmSubcommand.java | 2 +-
pom.xml | 176 ++-
926 files changed, 15206 insertions(+), 14387 deletions(-)
copy dev-support/ci/{acceptance_suites.sh => integration_suites.sh} (88%)
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/om/OMRepair.java
=>
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/cli/AbstractMixin.java
(59%)
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/cli/AbstractSubcommand.java
delete mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/cli/MissingSubcommandException.java
delete mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/conf/DefaultConfigManager.java
rename hadoop-hdds/{server-scm =>
common}/src/main/java/org/apache/hadoop/hdds/scm/container/balancer/ContainerBalancerConfiguration.java
(100%)
copy hadoop-hdds/{server-scm =>
common}/src/main/java/org/apache/hadoop/hdds/scm/container/balancer/package-info.java
(99%)
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/security/SecurityConstants.java
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/security/x509/keys/KeyCodec.java
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/security/x509/keys/KeyStorage.java
copy
hadoop-hdds/{container-service/src/main/java/org/apache/hadoop/ozone/HddsDatanodeStopService.java
=> common/src/main/java/org/apache/hadoop/ozone/Versioned.java} (86%)
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/common/ChunkBufferToByteString.java
create mode 100644
hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/common/ChunkBufferToByteStringByByteBufs.java
rename hadoop-hdds/{framework =>
common}/src/test/java/org/apache/hadoop/hdds/security/x509/keys/TestHDDSKeyGenerator.java
(100%)
create mode 100644
hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/security/x509/keys/TestKeyCodec.java
create mode 100644
hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/security/x509/keys/TestKeyStorage.java
rename hadoop-hdds/{framework =>
common}/src/test/java/org/apache/hadoop/hdds/security/x509/keys/package-info.java
(100%)
delete mode 100644
hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/upgrade/TestDatanodeUpgradeToScmHA.java
create mode 100644 hadoop-hdds/docs/content/integration/DistCp.md
create mode 100644 hadoop-hdds/docs/content/integration/Hive.md
create mode 100644 hadoop-hdds/docs/content/integration/Impala.md
copy hadoop-hdds/docs/content/{interface/_index.zh.md =>
integration/_index.md} (83%)
delete mode 100644
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/keys/KeyCodec.java
delete mode 100644
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/keys/SecurityUtil.java
delete mode 100644
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/keys/package-info.java
delete mode 100644
hadoop-hdds/framework/src/test/java/org/apache/hadoop/hdds/security/x509/keys/TestKeyCodec.java
rename
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/ha/{TestSCMHAConfiguration.java
=> TestSCMConfiguration.java} (79%)
copy
hadoop-hdds/{common/src/main/java/org/apache/hadoop/ozone/common/statemachine/InvalidStateTransitionException.java
=> test-utils/src/main/java/org/apache/ozone/test/IntLambda.java} (54%)
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/ldb/ListTables.java
=>
hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/datanode/HostNameParameters.java
(50%)
copy hadoop-ozone/{s3gateway => cli-shell}/dev-support/findbugsExcludeFile.xml
(83%)
copy {hadoop-hdds/tools => hadoop-ozone/cli-shell}/pom.xml (69%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/ClearSpaceQuotaOptions.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/Handler.java (78%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/ListOptions.java (100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/MandatoryReplicationOptions.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/OzoneAddress.java (99%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/OzoneShell.java (82%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/REPL.java (85%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/ReplicationOptions.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/SetSpaceQuotaOptions.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/Shell.java (74%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/ShellReplicationOptions.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/StoreTypeOption.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/acl/AclHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/acl/AclOption.java (97%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/acl/GetAclHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/acl/package-info.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/AddAclBucketHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/BucketCommands.java
(68%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/BucketHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/BucketUri.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/ClearQuotaHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/CreateBucketHandler.java
(81%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/DeleteBucketHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/GetAclBucketHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/InfoBucketHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/LinkBucketHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/ListBucketHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/RemoveAclBucketHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/SetAclBucketHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/SetEncryptionKey.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/SetQuotaHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/SetReplicationConfigHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/UpdateBucketHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/bucket/package-info.java
(100%)
copy hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/common/VolumeBucketHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/common/VolumeBucketUri.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/common/package-info.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/AddAclKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/CatKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/ChecksumKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/CopyKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/DeleteKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/GetAclKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/GetKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/InfoKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/KeyCommands.java
(67%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/KeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/KeyUri.java (100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/ListKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/PutKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/RemoveAclKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/RenameKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/RewriteKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/SetAclKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/keys/package-info.java
(100%)
copy hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/package-info.java (95%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/prefix/AddAclPrefixHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/prefix/GetAclPrefixHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/prefix/PrefixCommands.java
(63%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/prefix/PrefixUri.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/prefix/RemoveAclPrefixHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/prefix/SetAclPrefixHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/prefix/package-info.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/s3/GetS3SecretHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/s3/RevokeS3SecretHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/s3/S3Handler.java (100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/s3/S3Shell.java (75%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/s3/SetS3SecretHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/s3/package-info.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/snapshot/BucketSnapshotHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/snapshot/CreateSnapshotHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/snapshot/DeleteSnapshotHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/snapshot/InfoSnapshotHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/snapshot/ListSnapshotDiffHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/snapshot/ListSnapshotHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/snapshot/RenameSnapshotHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/snapshot/SnapshotCommands.java
(65%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/snapshot/SnapshotDiffHandler.java
(96%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/snapshot/SnapshotUri.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/snapshot/package-info.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/GetUserInfoHandler.java
(93%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantAssignAdminHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantAssignUserAccessIdHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantBucketLinkHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantCreateHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantDeleteHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantGetSecretHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantListHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantListUsersHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantRevokeAdminHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantRevokeUserAccessIdHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantSetSecretHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantShell.java
(76%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/TenantUserCommands.java
(67%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/tenant/package-info.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/token/CancelTokenHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/token/GetTokenHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/token/PrintTokenHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/token/RenewTokenHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/token/RenewerOption.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/token/TokenCommands.java
(63%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/token/TokenHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/token/TokenOption.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/token/package-info.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/AddAclVolumeHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/ClearQuotaHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/CreateVolumeHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/DeleteVolumeHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/GetAclVolumeHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/InfoVolumeHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/ListVolumeHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/RemoveAclVolumeHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/SetAclVolumeHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/SetQuotaHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/UpdateVolumeHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/VolumeCommands.java
(67%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/VolumeHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/VolumeUri.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/main/java/org/apache/hadoop/ozone/shell/volume/package-info.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/test/java/org/apache/hadoop/ozone/shell/TestOzoneAddress.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/test/java/org/apache/hadoop/ozone/shell/TestOzoneAddressClientCreation.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/test/java/org/apache/hadoop/ozone/shell/keys/TestChecksumKeyHandler.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/test/java/org/apache/hadoop/ozone/shell/keys/package-info.java
(100%)
rename hadoop-ozone/{tools =>
cli-shell}/src/test/java/org/apache/hadoop/ozone/shell/package-info.java (100%)
copy hadoop-ozone/dev-support/checks/{build.sh => compile.sh} (92%)
copy hadoop-ozone/{dist/dev-support/bin/dist-tar-stitching =>
dev-support/checks/install/bats.sh} (62%)
mode change 100755 => 100644
copy hadoop-ozone/{dist/dev-support/bin/dist-tar-stitching =>
dev-support/checks/install/flekszible.sh} (63%)
mode change 100755 => 100644
copy hadoop-ozone/{dist/src/test/shell/k8s_testlib.bats =>
dev-support/checks/install/hugo.sh} (55%)
copy hadoop-ozone/dev-support/checks/{native.sh => install/k3s.sh} (70%)
mode change 100755 => 100644
copy hadoop-ozone/dev-support/checks/{_summary.sh => install/spotbugs.sh} (67%)
mode change 100755 => 100644
create mode 100644
hadoop-ozone/dist/src/main/compose/common/grafana/dashboards/Ozone -
OMComittedIndexMetrics.json
create mode 100755 hadoop-ozone/dist/src/main/compose/common/replicas-test.sh
copy hadoop-ozone/dist/src/main/compose/common/{s3-haproxy.yaml =>
s3-haproxy-secure.yaml} (78%)
copy hadoop-ozone/dist/src/main/compose/{ozonesecure-ha/test.sh =>
ozonesecure/test-haproxy-s3g.sh} (79%)
delete mode 100644
hadoop-ozone/dist/src/main/compose/upgrade/compose/non-ha/.env
delete mode 100644
hadoop-ozone/dist/src/main/compose/upgrade/compose/non-ha/docker-compose.yaml
delete mode 100644
hadoop-ozone/dist/src/main/compose/upgrade/compose/non-ha/docker-config
delete mode 100755
hadoop-ozone/dist/src/main/compose/upgrade/compose/non-ha/load.sh
delete mode 100644
hadoop-ozone/dist/src/main/compose/upgrade/compose/om-ha/.env
delete mode 100644
hadoop-ozone/dist/src/main/compose/upgrade/compose/om-ha/docker-compose.yaml
delete mode 100644
hadoop-ozone/dist/src/main/compose/upgrade/compose/om-ha/docker-config
delete mode 100755
hadoop-ozone/dist/src/main/compose/upgrade/compose/om-ha/load.sh
delete mode 100644
hadoop-ozone/dist/src/main/compose/upgrade/upgrades/manual-upgrade/README.md
delete mode 100755
hadoop-ozone/dist/src/main/compose/upgrade/upgrades/manual-upgrade/driver.sh
rename
hadoop-ozone/dist/src/main/smoketest/{debug/ozone-debug-lease-recovery.robot =>
admincli/lease-recovery.robot} (89%)
create mode 100644
hadoop-ozone/dist/src/main/smoketest/recon/recon-taskstatus.robot
copy hadoop-ozone/dist/src/main/smoketest/s3/{freon.robot => rclone.robot}
(66%)
create mode 100644 hadoop-ozone/dist/src/main/smoketest/testlib.sh
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestO3FSWithFSPathsAndOMRatis.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestO3FSWithOMRatis.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOFSWithCacheOnly.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOFSWithFSOAndCacheOnly.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOFSWithFSOAndOMRatis.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOFSWithFSOAndOMRatisAndCacheOnly.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOFSWithFSPathsAndOMRatis.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOFSWithFSPathsAndOMRatisAndACL.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOFSWithFSPathsAndOMRatisAndCacheOnly.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOFSWithOMRatis.java
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/{debug =>
admin/om/lease}/TestLeaseRecoverer.java (99%)
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestDatanodeVersion.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestOzoneRpcClientWithRatis.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/TestOMEpochForNonRatis.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/recon/TestReconScmHASnapshot.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/recon/TestReconScmNonHASnapshot.java
delete mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/s3/awssdk/v1/TestS3SDKV1WithRatis.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/ozone/test/ClusterForTests.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/ozone/test/HATests.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/ozone/test/NonHATests.java
copy
hadoop-hdds/rocksdb-checkpoint-differ/src/main/java/org/apache/ozone/graph/Edge.java
=>
hadoop-ozone/integration-test/src/test/java/org/apache/ozone/test/TestOzoneIntegrationHA.java
(73%)
rename
hadoop-ozone/integration-test/src/test/java/org/apache/{hadoop/fs/ozone/TestO3FSWithFSOAndOMRatis.java
=> ozone/test/TestOzoneIntegrationNonHA.java} (74%)
copy
hadoop-ozone/{fault-injection-test/mini-chaos-tests/src/test/java/org/apache/hadoop/ozone/failure
=> integration-test/src/test/java/org/apache/ozone/test}/package-info.java
(91%)
copy
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/{PendingKeysDeletion.java
=> DeleteKeysResult.java} (55%)
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/DeletingServiceMetrics.java
copy
hadoop-ozone/{tools/src/main/java/org/apache/hadoop/ozone/debug/chunk/ChunkDetails.java
=>
ozone-manager/src/main/java/org/apache/hadoop/ozone/om/execution/flowcontrol/ExecutionContext.java}
(55%)
copy
hadoop-ozone/{integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc
=>
ozone-manager/src/main/java/org/apache/hadoop/ozone/om/execution/flowcontrol}/package-info.java
(87%)
create mode 100644
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/validation/VersionExtractor.java
create mode 100644
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/validation/TestVersionExtractor.java
copy
hadoop-ozone/ozonefs-common/src/main/java/org/apache/hadoop/fs/ozone/{CapableOzoneFSOutputStream.java
=> CapableOzoneFSDataStreamOutput.java} (60%)
copy
hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/ScmSubcommand.java
=>
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/tasks/types/NamedCallableTask.java
(50%)
copy
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/stream/StreamingException.java
=>
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/tasks/types/TaskExecutionException.java
(67%)
copy {hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security =>
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/tasks/types}/package-info.java
(85%)
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/tasks/updater/ReconTaskStatusUpdater.java
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/tasks/updater/ReconTaskStatusUpdaterManager.java
copy {hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security =>
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/tasks/updater}/package-info.java
(84%)
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/upgrade/ReconTaskStatusTableUpgradeAction.java
create mode 100644
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/__tests__/datanodes/Datanodes.test.tsx
create mode 100644
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/__tests__/datanodes/DatanodesTable.test.tsx
create mode 100644
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/__tests__/mocks/datanodeMocks/datanodeResponseMocks.ts
copy
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/__tests__/mocks/{overviewMocks/overviewServer.ts
=> datanodeMocks/datanodeServer.ts} (54%)
copy
hadoop-hdds/rocks-native/src/main/java/org/apache/hadoop/hdds/utils/db/managed/package-info.java
=>
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/__tests__/utils/datanodes.utils.tsx
(83%)
create mode 100644
hadoop-ozone/recon/src/test/java/org/apache/hadoop/ozone/recon/tasks/TestReconTaskStatusUpdater.java
delete mode 100644
hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/RootPageDisplayFilter.java
copy
hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/{S3GatewayHttpServer.java
=> S3GatewayWebAdminServer.java} (70%)
copy
hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/{s3/GatewayApplication.java
=> s3secret/Application.java} (81%)
copy hadoop-ozone/s3gateway/src/main/resources/webapps/{s3gateway =>
s3g-web}/WEB-INF/web.xml (60%)
rename hadoop-ozone/s3gateway/src/main/resources/webapps/{static =>
s3g-web}/images/ozone.ico (100%)
rename hadoop-ozone/s3gateway/src/main/resources/webapps/{static =>
s3g-web}/index.html (74%)
delete mode 100644
hadoop-ozone/s3gateway/src/main/resources/webapps/static/s3g.js
create mode 100644
hadoop-ozone/s3gateway/src/test/java/org/apache/hadoop/ozone/s3/endpoint/EndpointBuilder.java
copy
hadoop-ozone/s3gateway/src/test/java/org/apache/hadoop/ozone/{client/OzoneClientStub.java
=> s3/endpoint/ObjectEndpointBuilder.java} (62%)
rename {hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/cli =>
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/admin}/OzoneAdmin.java
(74%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/{debug =>
admin/om/lease}/LeaseRecoverer.java (83%)
copy
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/MetaStoreIterator.java
=>
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/admin/om/lease/LeaseSubCommand.java
(72%)
copy {hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/util =>
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/admin/om/lease}/package-info.java
(90%)
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/{shell/common/VolumeBucketHandler.java
=> debug/datanode/DatanodeDebug.java} (62%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ =>
datanode}/container/ContainerCommands.java (89%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ =>
datanode}/container/ExportSubcommand.java (96%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ =>
datanode}/container/InfoSubcommand.java (88%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ =>
datanode}/container/InspectSubcommand.java (89%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ =>
datanode}/container/ListSubcommand.java (87%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ =>
datanode}/container/package-info.java (93%)
copy hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{chunk =>
datanode}/package-info.java (90%)
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/ldb/{DropTable.java
=> Checkpoint.java} (53%)
rename
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/{shell/common/VolumeBucketHandler.java
=> debug/om/OMDebug.java} (67%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ =>
om}/PrefixParser.java (95%)
copy hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/{repair/ldb =>
debug/om}/package-info.java (91%)
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/{repair/om/OMRepair.java
=> debug/replicas/ReplicasDebug.java} (60%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ =>
replicas}/chunk/ChunkDataNodeDetails.java (96%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ =>
replicas}/chunk/ChunkDetails.java (96%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ =>
replicas}/chunk/ChunkKeyHandler.java (94%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ =>
replicas}/chunk/ChunkType.java (94%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ =>
replicas}/chunk/ContainerChunkInfo.java (98%)
copy hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{ =>
replicas}/chunk/package-info.java (88%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/{chunk
=> replicas}/package-info.java (90%)
copy
hadoop-ozone/{integration-test/src/test/java/org/apache/hadoop/ozone/freon/package-info.java
=> tools/src/main/java/org/apache/hadoop/ozone/freon/FreonSubcommand.java}
(86%)
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/{package-info.java
=> ReadOnlyCommand.java} (87%)
create mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/RepairTool.java
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/{ldb =>
}/TransactionInfoRepair.java (56%)
delete mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/ldb/RDBRepair.java
delete mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/om/FSORepairCLI.java
rename
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/{ldb/SnapshotRepair.java
=> om/SnapshotChainRepair.java} (70%)
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/om/{package-info.java
=> SnapshotRepair.java} (76%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/{ =>
om}/quota/QuotaRepair.java (83%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/{ =>
om}/quota/QuotaStatus.java (82%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/{ =>
om}/quota/QuotaTrigger.java (78%)
copy hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/{ =>
om/quota}/package-info.java (91%)
delete mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/quota/package-info.java
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/{om/OMRepair.java
=> scm/SCMRepair.java} (66%)
copy
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/MetaStoreIterator.java
=>
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/scm/cert/CertRepair.java
(70%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/{ =>
scm/cert}/RecoverSCMCertificate.java (83%)
copy hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/{debug/ldb =>
repair/scm/cert}/package-info.java (91%)
rename hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/{ldb =>
scm}/package-info.java (91%)
create mode 100644
hadoop-ozone/tools/src/test/java/org/apache/hadoop/ozone/repair/TestTransactionInfoRepair.java
delete mode 100644
hadoop-ozone/tools/src/test/java/org/apache/hadoop/ozone/repair/ldb/TestTransactionInfoRepair.java
create mode 100644
hadoop-ozone/tools/src/test/java/org/apache/hadoop/ozone/repair/om/TestSnapshotChainRepair.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
