This is an automated email from the ASF dual-hosted git repository.
adoroszlai pushed a change to branch
dependabot-npm_and_yarn-hadoop-ozone-recon-src-main-resources-webapps-recon-ozone-recon-web-express-4.19.2
in repository https://gitbox.apache.org/repos/asf/ozone.git
from d2d217ba24 [auto] Generated pnpm-lock from actions for
2210a1f05284b95d0c2b86e4c7d76d6080883dc4
add a2fbf92bd0 Revert "[auto] Generated pnpm-lock from actions for
2210a1f05284b95d0c2b86e4c7d76d6080883dc4"
add c6c611fa60 HDDS-10587. Reset ETag's thread-local MessageDigest
instance on exception (#6435)
add 6822d53e93 HDDS-10588. Bump hadoop-shaded-guava to 1.2.0 (#6440)
add 7feafe91f2 HDDS-10518. Create base Builder in WithMetadata and
WithObjectID (#6378)
add e68183e169 HDDS-10574. Improve TestObjectPut (#6426)
add 7559e1f6b9 HDDS-10524. [Snapshot] Invalidate the cache entry from
snapshotInfoTable cache in OMSnapshotPurgeRequest (#6443)
add 3651d6c719 HDDS-10594. Update file encryption info when overwriting
key (#6445)
add 140cf0f162 HDDS-9764. Add Robot test for JSON output where missing
(#6448)
add 38e3add916 HDDS-10600. Bump nimbus-jose-jwt to 9.37.2 (#6454)
add 9f6ac2fc37 HDDS-9242. Merge unit and integration checks into a
combined one (#6199)
add 85c9c97fc5 HDDS-10570. S3A: `fs -touch` creates directory instead of
empty file in FSO bucket (#6452)
add cb5d51983d HDDS-9534. Support namespace summaries (du, dist & counts)
for LEGACY buckets with file system disabled (#5517)
add 29edabb374 HDDS-10618. Bump gson to 2.10.1 (#6459)
add 33c05b42da HDDS-10620. Bump build-helper-maven-plugin to 3.5.0 (#6462)
add 8bd1a92539 HDDS-10622. Bump commons-io to 2.16.0 (#6463)
add 8a257840a4 HDDS-10623. Bump spotbugs-maven-plugin to 3.1.12.2 (#6460)
add 7c20f388a5 HDDS-10624. Bump reflections to 0.10.2 (#6461)
add 0599aeec5b HDDS-10621. Remove TimeoutFuture in favour of the original
one in Guava (#6464)
add 077fff4c4f HDDS-10358. Allow Container Balancer tuning options to be
set in CLI (#6241)
add 83d75861b0 HDDS-10613. Fix typo in Snapshot feature doc (#6465)
add a73fb3731b HDDS-10507. Use equals() instead of == for nodes in
NetworkTopology (#6368)
add f94c9f9a52 HDDS-10597. Use MutableGauge for threshold based
SafeModeMetrics (#6446)
add 92bc617801 HDDS-10462. Fail Datanode Decommission Early (#6367)
add ccaaf57183 HDDS-10316. Speed up TestReconTasks (#6223)
add 129cdc18ed HDDS-10612. Add Robot test to verify Container Balancer for
RATIS containers (#6457)
add f07743096f HDDS-10636. Ozone Recon - Filter EMPTY MISSING Containers
in UnHealthy State Containers API. (#6471)
add a38570a799 HDDS-9930. Remove open keys as well when keys are deleted
from KeyTable (#6079) (#6472)
add 7da5ecb585 HDDS-10590. [Snapshot] Synchronized snapshot purge, set
snapshot property and SstFilteringService (#6456)
add 3467db1b1c HDDS-9200. [Snapshot] Added logs and metrics for snapshot
purge and set property APIs (#6453)
add e34de9fbdb HDDS-5567. interface/Cli.md translation (#6474)
add 6b92a37af1 HDDS-10644. Intermittent failure in testBalancer.robot
(#6481)
add 301664e46a HDDS-10206. Expose jmx metrics for snapshot cache size on
the ozone manager. (#6138)
add 87dd27347c HDDS-10661. Bump zstd-jni to 1.5.6-2 (#6483)
add 31c2cfb0ab Revert "HDDS-10316. Speed up TestReconTasks (#6223)"
add df6c386a53 HDDS-10659. Remove cglib dependency (#6488)
add 5759427b02 HDDS-10660. Bump jacoco to 0.8.12 (#6487)
add 91be6b39a2 HDDS-10662. Bump maven-gpg-plugin to 3.2.2 (#6484)
add 6ed1e58dd5 HDDS-10230. Preventing V3 Schema from Creating Container DB
in the Wrong Location (#6113)
add b8faba6b87 HDDS-10643. Avoid terminating SCM by statemachine during
normal SCM stop. (#6478)
add e31e68ab2a HDDS-10560. Link rocksdb lib to Ozone rocksdb tools lib
relative path instead of absolute path (#6414)
add dd1a907367 Merge remote-tracking branch 'origin/master' into
dependabot-npm_and_yarn-hadoop-ozone-recon-src-main-resources-webapps-recon-ozone-recon-web-express-4.19.2
No new revisions were added by this update.
Summary of changes:
.github/workflows/ci.yml | 4 +-
LICENSE.txt | 2 -
dev-support/ci/selective_ci_checks.bats | 53 +-
dev-support/ci/selective_ci_checks.sh | 38 +-
.../apache/hadoop/hdds/scm/client/ScmClient.java | 12 +-
.../hadoop/hdds/scm/net/NetworkTopologyImpl.java | 23 +-
.../protocol/StorageContainerLocationProtocol.java | 11 +-
.../dev-support/findbugsExcludeFile.xml | 12 -
.../container/common/volume/AbstractFuture.java | 1295 -------
.../ozone/container/common/volume/HddsVolume.java | 21 +-
.../container/common/volume/MutableVolumeSet.java | 12 +-
.../common/volume/StorageVolumeChecker.java | 10 +-
.../common/volume/ThrottledAsyncChecker.java | 3 +-
.../container/common/volume/TimeoutFuture.java | 161 -
.../helpers/KeyValueContainerLocationUtil.java | 10 +-
.../container/common/impl/TestHddsDispatcher.java | 9 +
.../container/common/utils/TestHddsVolumeUtil.java | 35 +
.../common/volume/TestVolumeSetDiskChecks.java | 9 +
.../replication/TestGrpcReplicationService.java | 3 +
.../upgrade/TestDatanodeUpgradeToScmHA.java | 3 +
hadoop-hdds/docs/content/feature/Snapshot.md | 2 +-
.../docs/content/interface/{Cli.md => Cli.zh.md} | 104 +-
hadoop-hdds/docs/content/interface/_index.zh.md | 2 +-
...inerLocationProtocolClientSideTranslatorPB.java | 63 +-
hadoop-hdds/hadoop-dependency-client/pom.xml | 20 +
hadoop-hdds/hadoop-dependency-server/pom.xml | 20 +
.../src/main/proto/ScmAdminProtocol.proto | 7 +
.../utils/db/managed/JniLibNamePropertyWriter.java | 5 +-
.../utils/db/managed/ManagedRocksObjectUtils.java | 8 +
hadoop-hdds/rocks-native/pom.xml | 4 +-
hadoop-hdds/rocks-native/src/CMakeLists.txt | 24 +-
.../hadoop/hdds/utils/NativeLibraryLoader.java | 35 +-
.../utils/db/managed/ManagedRawSSTFileReader.java | 4 +-
.../hadoop/hdds/utils/TestNativeLibraryLoader.java | 3 +-
.../scm/container/balancer/ContainerBalancer.java | 5 +
.../balancer/ContainerBalancerConfiguration.java | 4 +
.../apache/hadoop/hdds/scm/ha/SCMStateMachine.java | 2 +-
.../hdds/scm/node/NodeDecommissionManager.java | 78 +-
...inerLocationProtocolServerSideTranslatorPB.java | 38 +-
.../hadoop/hdds/scm/safemode/SafeModeMetrics.java | 19 +-
.../hdds/scm/server/SCMClientProtocolServer.java | 174 +-
.../hdds/scm/server/StorageContainerManager.java | 6 +-
.../hdds/scm/node/TestNodeDecommissionManager.java | 342 +-
.../ozone/container/common/TestEndPoint.java | 4 +-
.../scm/cli/ContainerBalancerStartSubcommand.java | 70 +-
.../hdds/scm/cli/ContainerOperationClient.java | 17 +-
.../scm/cli/datanode/DecommissionSubCommand.java | 7 +-
.../datanode/TestContainerBalancerSubCommand.java | 4 +-
.../cli/datanode/TestDecommissionSubCommand.java | 7 +-
.../cli/datanode/TestMaintenanceSubCommand.java | 3 +-
.../cli/datanode/TestRecommissionSubCommand.java | 3 +-
.../apache/hadoop/ozone/client/OzoneBucket.java | 8 +-
.../apache/hadoop/ozone/client/OzoneVolume.java | 8 +-
.../main/java/org/apache/hadoop/ozone/OmUtils.java | 41 +
.../hadoop/ozone/om/helpers/OmBucketArgs.java | 9 +-
.../hadoop/ozone/om/helpers/OmBucketInfo.java | 56 +-
.../hadoop/ozone/om/helpers/OmDirectoryInfo.java | 32 +-
.../apache/hadoop/ozone/om/helpers/OmKeyInfo.java | 39 +-
.../ozone/om/helpers/OmMultipartKeyInfo.java | 11 +-
.../hadoop/ozone/om/helpers/OmVolumeArgs.java | 55 +-
.../hadoop/ozone/om/helpers/SnapshotInfo.java | 4 +-
.../hadoop/ozone/om/helpers/WithMetadata.java | 45 +-
.../hadoop/ozone/om/helpers/WithObjectID.java | 53 +
.../ozone/om/helpers/WithParentObjectId.java | 31 +
.../dev-support/checks/_mvn_unit_report.sh | 2 +-
hadoop-ozone/dev-support/checks/integration.sh | 2 +-
hadoop-ozone/dev-support/checks/junit.sh | 6 +-
hadoop-ozone/dev-support/checks/unit.sh | 2 -
.../compose/{compatibility => ozone-balancer}/.env | 1 +
.../compose/ozone-balancer/docker-compose.yaml | 179 +
.../{ozone-ha => ozone-balancer}/docker-config | 26 +-
.../test-failures1.sh => ozone-balancer/test.sh} | 14 +-
.../dist/src/main/compose/ozone-ha/test.sh | 8 +-
hadoop-ozone/dist/src/main/license/bin/LICENSE.txt | 2 -
.../src/main/smoketest/admincli/container.robot | 15 +
.../src/main/smoketest/admincli/datanode.robot | 14 +
.../src/main/smoketest/balancer/testBalancer.robot | 144 +
.../dist/src/main/smoketest/s3/commonawslib.robot | 24 +-
.../dist/src/main/smoketest/s3/objecthead.robot | 17 +-
.../dist/src/main/smoketest/s3/objectputget.robot | 24 +-
.../java/org/apache/hadoop/fs/ozone/TestHSync.java | 41 +
.../scm/node/TestDecommissionAndMaintenance.java | 4 +-
.../ozone/TestContainerBalancerOperations.java | 77 +-
.../client/rpc/TestOzoneAtRestEncryption.java | 12 +-
.../container/metrics/TestContainerMetrics.java | 6 +
.../container/ozoneimpl/TestOzoneContainer.java | 6 +
.../ozoneimpl/TestOzoneContainerWithTLS.java | 5 +
.../ozoneimpl/TestSecureOzoneContainer.java | 5 +
.../container/server/TestContainerServer.java | 9 +-
.../server/TestSecureContainerServer.java | 15 +-
.../om/{ => snapshot}/TestOmSnapshotDisabled.java | 3 +-
.../TestOmSnapshotDisabledRestart.java | 3 +-
.../{ => snapshot}/TestOmSnapshotFileSystem.java | 7 +-
.../TestOmSnapshotFileSystemFso.java | 2 +-
.../TestOmSnapshotFileSystemLegacy.java | 2 +-
.../{ => snapshot}/TestOzoneManagerHASnapshot.java | 5 +-
.../TestSnapshotBackgroundServices.java | 7 +-
.../TestSnapshotDeletingService.java | 8 +-
.../TestSnapshotDirectoryCleaningService.java | 3 +-
.../ozone/recon/TestReconAndAdminContainerCLI.java | 4 +-
.../apache/hadoop/ozone/om/OMMetadataManager.java | 33 +-
.../hadoop/ozone/om/helpers/OmPrefixInfo.java | 54 +-
.../hadoop/ozone/om/helpers/TestOmPrefixInfo.java | 11 +-
.../java/org/apache/hadoop/ozone/om/OMMetrics.java | 49 +
.../hadoop/ozone/om/OmMetadataManagerImpl.java | 8 +-
.../apache/hadoop/ozone/om/OmSnapshotManager.java | 2 +-
.../ozone/om/request/key/OMKeyCommitRequest.java | 2 +-
.../ozone/om/request/key/OMKeyDeleteRequest.java | 24 +-
.../om/request/key/OMKeyDeleteRequestWithFSO.java | 23 +-
.../hadoop/ozone/om/request/key/OMKeyRequest.java | 2 +
.../ozone/om/request/key/OMKeysDeleteRequest.java | 36 +-
.../om/request/key/OmKeysDeleteRequestWithFSO.java | 36 +-
.../request/snapshot/OMSnapshotPurgeRequest.java | 222 +-
.../snapshot/OMSnapshotSetPropertyRequest.java | 44 +-
.../om/request/validation/ValidatorRegistry.java | 2 +-
.../ozone/om/response/key/OMKeyDeleteResponse.java | 18 +-
.../response/key/OMKeyDeleteResponseWithFSO.java | 12 +-
.../om/response/key/OMKeysDeleteResponse.java | 17 +-
.../response/key/OMKeysDeleteResponseWithFSO.java | 13 +-
.../response/snapshot/OMSnapshotPurgeResponse.java | 8 +-
.../hadoop/ozone/om/snapshot/SnapshotCache.java | 11 +-
.../ozone/om/upgrade/OMLayoutVersionManager.java | 4 +-
.../TestOMSnapshotPurgeRequestAndResponse.java | 67 +-
...estOMSnapshotSetPropertyRequestAndResponse.java | 48 +-
.../om/response/key/TestOMKeyDeleteResponse.java | 2 +-
.../key/TestOMKeyDeleteResponseWithFSO.java | 2 +-
.../om/response/key/TestOMKeysDeleteResponse.java | 3 +-
.../key/TestOMKeysDeleteResponseWithFSO.java | 3 +-
.../ozone/om/snapshot/TestSnapshotCache.java | 42 +-
.../ozone/om/{ => snapshot}/TestSnapshotChain.java | 5 +-
.../ozone/om/snapshot/TestSnapshotDiffManager.java | 2 +-
.../ozone/om/{ => snapshot}/TestSnapshotInfo.java | 4 +-
.../om/{ => snapshot}/TestSstFilteringService.java | 11 +-
.../hadoop/ozone/recon/api/ContainerEndpoint.java | 8 +-
.../ozone/recon/api/handlers/BucketHandler.java | 35 +-
.../ozone/recon/api/handlers/EntityHandler.java | 103 +-
.../recon/recovery/ReconOMMetadataManager.java | 8 +
.../recon/recovery/ReconOmMetadataManagerImpl.java | 5 +
.../hadoop/ozone/recon/tasks/NSSummaryTask.java | 3 +-
.../ozone/recon/tasks/NSSummaryTaskWithLegacy.java | 308 +-
.../webapps/recon/ozone-recon-web/pnpm-lock.yaml | 3594 +++++++++-----------
.../ozone/recon/OMMetadataManagerTestUtils.java | 16 +-
.../ozone/recon/api/TestContainerEndpoint.java | 17 +
.../recon/api/TestNSSummaryEndpointWithLegacy.java | 11 +-
... => TestNSSummaryEndpointWithOBSAndLegacy.java} | 445 ++-
.../hadoop/ozone/recon/common/CommonUtils.java | 11 +-
...a => TestNSSummaryTaskWithLegacyOBSLayout.java} | 80 +-
hadoop-ozone/s3gateway/pom.xml | 5 +
.../hadoop/ozone/s3/endpoint/ObjectEndpoint.java | 70 +-
.../hadoop/ozone/client/ClientProtocolStub.java | 2 +-
.../hadoop/ozone/client/OzoneBucketStub.java | 82 +-
.../hadoop/ozone/client/OzoneVolumeStub.java | 9 +-
.../hadoop/ozone/s3/endpoint/TestObjectPut.java | 395 ++-
.../hadoop/ozone/s3/endpoint/TestPartUpload.java | 58 +
pom.xml | 107 +-
155 files changed, 5433 insertions(+), 4665 deletions(-)
delete mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/volume/AbstractFuture.java
delete mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/volume/TimeoutFuture.java
copy hadoop-hdds/docs/content/interface/{Cli.md => Cli.zh.md} (58%)
copy hadoop-ozone/dist/src/main/compose/{compatibility => ozone-balancer}/.env
(98%)
create mode 100644
hadoop-ozone/dist/src/main/compose/ozone-balancer/docker-compose.yaml
copy hadoop-ozone/dist/src/main/compose/{ozone-ha =>
ozone-balancer}/docker-config (75%)
copy hadoop-ozone/dist/src/main/compose/{ozone/test-failures1.sh =>
ozone-balancer/test.sh} (84%)
mode change 100755 => 100644
create mode 100644
hadoop-ozone/dist/src/main/smoketest/balancer/testBalancer.robot
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/{ =>
snapshot}/TestOmSnapshotDisabled.java (97%)
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/{ =>
snapshot}/TestOmSnapshotDisabledRestart.java (97%)
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/{ =>
snapshot}/TestOmSnapshotFileSystem.java (99%)
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/{ =>
snapshot}/TestOmSnapshotFileSystemFso.java (95%)
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/{ =>
snapshot}/TestOmSnapshotFileSystemLegacy.java (95%)
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/{ =>
snapshot}/TestOzoneManagerHASnapshot.java (97%)
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/{ =>
snapshot}/TestSnapshotBackgroundServices.java (99%)
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/{ =>
snapshot}/TestSnapshotDeletingService.java (98%)
rename
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/{ =>
snapshot}/TestSnapshotDirectoryCleaningService.java (99%)
rename hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/{
=> snapshot}/TestSnapshotChain.java (98%)
rename hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/{
=> snapshot}/TestSnapshotInfo.java (96%)
rename hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/{
=> snapshot}/TestSstFilteringService.java (97%)
rename
hadoop-ozone/recon/src/test/java/org/apache/hadoop/ozone/recon/api/{TestNSSummaryEndpointWithOBS.java
=> TestNSSummaryEndpointWithOBSAndLegacy.java} (71%)
copy
hadoop-ozone/recon/src/test/java/org/apache/hadoop/ozone/recon/tasks/{TestNSSummaryTaskWithOBS.java
=> TestNSSummaryTaskWithLegacyOBSLayout.java} (90%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
