This is an automated email from the ASF dual-hosted git repository.
pifta pushed a change to branch HDDS-3816-ec
in repository https://gitbox.apache.org/repos/asf/ozone.git.
from 7a67f63 HDDS-5822 : Writing a large buffer to an EC file duplicates
first chunk in block 1 and 2 (#2714)
add 753a5b7 HDDS-5715. Make XceiverServerRatis#raftGids a thread-safe
set. (#2613)
add 6569040 HDDS-5502. [OFS] URI parser throws URISyntaxException when
path contains space (#2500)
add bb37a55 HDDS-5735. Prometheus HTTP API Reference cannot be displayed
normally (#2630)
add 67be640 HDDS-5496. Missing directory name in `start_k8s_env` log
(#2545)
add 9aebf6e HDDS-5720. Reuse mini-clusters in TestOzoneFileInterfaces
(#2619)
add e97ea36 HDDS-5679. Use more defensive sizeRequired for replication
manager for container replication. (#2585)
add 2d57e9f HDDS-5708. Skip sending container close command to unhealthy
replica. (#2610)
add 873c0d2 HDDS-5696. Close grpcReplicationClient on exception. (#2595)
add 6543c67 HDDS-5729. support setting maxSizeEnteringTarget and
maxSizeLeavingSource in command line (#2626)
add ec5c51f HDDS-5335. Method not found: allocateBlock - when tracing is
enabled (#2330)
add c5a012b HDDS-5744. Remove unnecessary duplicate semicolon in
PipelineStateMap (#2641)
add ee19b95 HDDS-5748. Reuse mini-clusters in
TestOzoneFSWithObjectStoreCreate (#2646)
add da18617 HDDS-5717. Refactor TestOzoneManagerListVolumes to reuse
mini-ozone clusters (#2615)
add ed30752 HDDS-5749. Reuse mini-clusters in TestOzoneFsHAURLs (#2647)
add d716bf4 HDDS-5402 Support list node based on NodeOperationalState and
NodeState options in printTopology CLI (#2645)
add fab8a12 HDDS-5728. ContainerBalancer should use remaining space to
calculate utilization. (#2625)
add f2c20ce HDDS-5751. Use Mini Cluster Provider to speed up
TestHDDSUpgrade (#2650)
add 5c972c4 HDDS-5753. Split parts of misc suite (#2654)
add 0b9e23e HDDS-5607. remove container manager v1 code (#2525)
add 2d58933 HDDS-5758. Speed up TestKeyInputStream and
TestChunkInputStream by combining some tests (#2656)
add c68468c HDDS-5761. should not shutdown om when setting a bigger
bucket quota than volume quota (#2659)
add 79da6b7 HDDS-5766. Speed up some OM tests by skipping SCM safemode
check (#2662)
add b8afbbc HDDS-5768. Skip safemode check in
TestOzoneManagerRocksDBLogging (#2665)
add 79716f0 HDDS-5765. Test cluster provider possibly returns null (#2663)
add 2c2d2f3 HDDS-5767. Unit check may timeout (#2664)
add b508b25 HDDS-5771. Speed up TestDatanodeHddsVolumeFailureToleration
by reducing dead interval (#2668)
add fc61be5 HDDS-5691. Restrict Recon NSSummaryEndpoint and
ContainerEndpoint to admins. (#2638)
add 3116fa2 HDDS-5773. Avoid code duplication for mini cluster without
datanodes (#2669)
add c25b6d7 HDDS-5759. Bump aspectj version (#2658)
add 87b4971 HDDS-5770. Silent failures of k3s install are difficult to
debug (#2667)
add 605a734 HDDS-5697. SCMContainerPlacementRackAware should both
affinity nodes before fallback (#2597)
add e5c647e HDDS-5370. [FSO] Handle OMClientRequest based on the bucket
layout. (#2533)
add 181266b HDDS-5777. Provide an option to dump table scan data to file.
(#2675)
add 4b3502f HDDS-5792. Speed up TestNSSummaryAdmin by having zero
Datanodes (#2688)
add 2e3c46c HDDS-5782. DatanodeRatisGrpcConfig use wrong type for config
keys. (#2678)
add 041684f HDDS-5789. Enabling container tokens on a upgraded cluster
fails SCM to start up. (#2691)
add af7dc7e HDDS-5800. Bucket usedByte was incorrect when deleting
duplicate keys.
add 8cc6719 HDDS-5523. Fix multipart upload failure in s3 compatibility
tests (#2509)
add aa9eade HDDS-5757. balancer should stop when the cluster can not be
balanced any more (#2676)
add e2c3ac3 HDDS-5747. Reset default values in
ContainerBalancerConfiguration (#2657)
add 5c2ac71 HDDS-5788. Reduce run time for TestOzoneManagerHA tests
(#2689)
add af5b48e HDDS-5636. Use bucket layout specific DB table in
OmMetadataManager:getOpenKeyTable(). (#2561)
add 093f972 HDDS-5787. Provide capability in Ozone to enable ratis
pre-vote (#2680)
add 05eb172 HDDS-5762. remove piplelineStateManager V1 code (#2661)
add c4cbcad HDDS-5710. initialize sequenceIdToLastIdMap when
SequenceIdGenerator#StateManager reinitializes (#2611)
add 53a0009 HDDS-5793. Speed up TestBlockOutputStreamWithFailures by
combining test cases (#2690)
add 1da0bd8 HDDS-5609. Document CI workflow (#2607)
add c886a2f HDDS-5797. Support setting Datanode Reserved Space in
MiniOzoneCluster. (#2695)
add 7bdc1bb HDDS-5799. Speed up TestOzoneFileSystem by using shorter
trash interval (#2699)
add 1ea1d6c HDDS-5808. Update commons-io to 2.11.0 (#2705)
add 186cd6e HDDS-5817. Extract properties for some dependency versions
(#2710)
add 20e8429 HDDS-5815 FileEncryptionInfo is not necessary to be
referenced inside KeyOutputStream. (#2708)
add a59c501 HDDS-5830. Increase idea.max.intellisense.filesize (#2715)
add 8d885b4 HDDS-5557. Cleanup
OzoneBlockTokenSecretManager#validateToken. (#2711)
add ea81ef8 HDDS-5816 Rearrange code and refactor some logic into new
methods in prep for EC addition. (#2709)
add a16ee9d Merge branch 'master' into HDDS-3816-ec
No new revisions were added by this update.
Summary of changes:
.github/ci.md | 102 ++++
.github/workflows/post-commit.yml | 4 +-
CONTRIBUTING.md | 4 +-
.../apache/hadoop/hdds/recon/ReconConfigKeys.java | 10 +
.../org/apache/hadoop/hdds/scm/ScmConfigKeys.java | 4 +
.../apache/hadoop/hdds/scm/client/ScmClient.java | 4 +-
.../hadoop/hdds/scm/net/NetworkTopology.java | 3 +-
.../hadoop/hdds/scm/net/NetworkTopologyImpl.java | 5 +-
.../protocol/StorageContainerLocationProtocol.java | 4 +-
.../apache/hadoop/hdds/tracing/TraceAllMethod.java | 23 +-
.../apache/hadoop/hdds/tracing/TracingUtil.java | 6 +-
.../common/src/main/resources/ozone-default.xml | 25 +
.../hadoop/hdds/tracing/TestTraceAllMethod.java | 68 +++
.../hadoop/hdds/tracing/TestTracingUtil.java} | 33 +-
.../transport/server/ratis/XceiverServerRatis.java | 6 +-
.../ozone/container/common/volume/VolumeInfo.java | 5 +
.../replication/SimpleContainerDownloader.java | 20 +-
hadoop-hdds/docs/content/interface/ReconApi.md | 23 +-
hadoop-hdds/docs/content/interface/ReconApi.zh.md | 2 +-
.../hadoop/hdds/conf/DatanodeRatisGrpcConfig.java | 4 +-
.../hdds/conf/DatanodeRatisServerConfig.java | 16 +
...inerLocationProtocolClientSideTranslatorPB.java | 19 +-
.../certificate/client/DNCertificateClient.java | 5 -
.../client/DefaultCertificateClient.java | 2 +-
.../certificate/client/OMCertificateClient.java | 5 -
.../certificate/client/SCMCertificateClient.java | 10 +-
.../src/main/proto/ScmAdminProtocol.proto | 2 +
.../hadoop/hdds/scm/block/DeletedBlockLogImpl.java | 6 +-
.../scm/block/DeletedBlockLogStateManagerImpl.java | 12 +-
.../hdds/scm/block/SCMBlockDeletingService.java | 9 +-
.../container/AbstractContainerReportHandler.java | 6 +-
.../scm/container/CloseContainerEventHandler.java | 4 +-
.../hdds/scm/container/ContainerManager.java | 144 ++---
.../hdds/scm/container/ContainerManagerImpl.java | 6 +-
.../hdds/scm/container/ContainerManagerV2.java | 190 ------
.../hdds/scm/container/ContainerReportHandler.java | 6 +-
.../IncrementalContainerReportHandler.java | 2 +-
.../hdds/scm/container/ReplicationManager.java | 31 +-
.../hdds/scm/container/SCMContainerManager.java | 672 ---------------------
.../scm/container/balancer/ContainerBalancer.java | 80 ++-
.../balancer/ContainerBalancerConfiguration.java | 48 +-
.../ContainerBalancerSelectionCriteria.java | 14 +-
.../scm/container/balancer/FindTargetGreedy.java | 6 +-
.../algorithms/SCMContainerPlacementRackAware.java | 72 ++-
.../container/placement/metrics/SCMNodeStat.java | 23 -
.../org/apache/hadoop/hdds/scm/ha/RatisUtil.java | 11 +-
.../hadoop/hdds/scm/ha/SequenceIdGenerator.java | 26 +-
.../hadoop/hdds/scm/node/DatanodeUsageInfo.java | 65 +-
.../hadoop/hdds/scm/node/DeadNodeHandler.java | 6 +-
.../hdds/scm/node/NodeDecommissionManager.java | 8 +-
.../apache/hadoop/hdds/scm/node/NodeManager.java | 8 +
.../hadoop/hdds/scm/node/SCMNodeManager.java | 60 +-
.../hdds/scm/pipeline/ECPipelineProvider.java | 2 +-
.../hadoop/hdds/scm/pipeline/PipelineFactory.java | 2 +-
.../hdds/scm/pipeline/PipelineManagerImpl.java | 12 +-
.../hdds/scm/pipeline/PipelinePlacementPolicy.java | 6 +-
.../hadoop/hdds/scm/pipeline/PipelineProvider.java | 6 +-
.../hdds/scm/pipeline/PipelineStateManager.java | 280 +++------
...erV2Impl.java => PipelineStateManagerImpl.java} | 58 +-
.../hadoop/hdds/scm/pipeline/PipelineStateMap.java | 2 +-
.../hdds/scm/pipeline/RatisPipelineProvider.java | 2 +-
.../hdds/scm/pipeline/RatisPipelineUtils.java | 20 +-
.../hdds/scm/pipeline/SimplePipelineProvider.java | 2 +-
.../hadoop/hdds/scm/pipeline/StateManager.java | 139 -----
.../scm/pipeline/WritableECContainerProvider.java | 6 +-
.../pipeline/WritableRatisContainerProvider.java | 6 +-
.../algorithms/DefaultLeaderChoosePolicy.java | 4 +-
.../choose/algorithms/LeaderChoosePolicy.java | 8 +-
.../algorithms/LeaderChoosePolicyFactory.java | 8 +-
.../algorithms/MinLeaderCountChoosePolicy.java | 6 +-
...inerLocationProtocolServerSideTranslatorPB.java | 15 +-
.../hdds/scm/safemode/ContainerSafeModeRule.java | 10 +-
.../hdds/scm/safemode/SCMSafeModeManager.java | 10 +-
.../scm/server/OzoneStorageContainerManager.java | 4 +-
.../hdds/scm/server/SCMClientProtocolServer.java | 23 +-
.../hadoop/hdds/scm/server/SCMConfigurator.java | 8 +-
.../hdds/scm/server/StorageContainerManager.java | 32 +-
.../java/org/apache/hadoop/hdds/scm/TestUtils.java | 12 +-
.../hadoop/hdds/scm/block/TestBlockManager.java | 6 +-
.../hadoop/hdds/scm/block/TestDeletedBlockLog.java | 6 +-
.../hadoop/hdds/scm/container/MockNodeManager.java | 16 +-
.../hdds/scm/container/SimpleMockNodeManager.java | 5 +
.../container/TestCloseContainerEventHandler.java | 2 +-
.../scm/container/TestContainerManagerImpl.java | 8 +-
.../scm/container/TestContainerReportHandler.java | 4 +-
.../TestIncrementalContainerReportHandler.java | 4 +-
.../hdds/scm/container/TestReplicationManager.java | 33 +-
.../scm/container/TestSCMContainerManager.java | 324 ----------
.../scm/container/TestUnknownContainerReport.java | 4 +-
.../container/balancer/TestContainerBalancer.java | 64 +-
.../TestSCMContainerPlacementRackAware.java | 15 +
.../hdds/scm/node/TestContainerPlacement.java | 122 ++--
.../hadoop/hdds/scm/node/TestDeadNodeHandler.java | 8 +-
.../hdds/scm/pipeline/MockPipelineManager.java | 34 +-
.../scm/pipeline/MockRatisPipelineProvider.java | 6 +-
.../hdds/scm/pipeline/TestECPipelineProvider.java | 3 +-
.../TestPipelineDatanodesIntersection.java | 52 +-
.../scm/pipeline/TestPipelinePlacementPolicy.java | 73 ++-
...ager.java => TestPipelineStateManagerImpl.java} | 237 +++++---
.../scm/pipeline/TestRatisPipelineProvider.java | 66 +-
...TestSCMStoreImplWithOldPipelineIDKeyFormat.java | 209 -------
.../scm/pipeline/TestSimplePipelineProvider.java | 48 +-
.../pipeline/TestWritableECContainerProvider.java | 45 +-
.../choose/algorithms/TestLeaderChoosePolicy.java | 6 +-
.../testutils/ReplicationNodeManagerMock.java | 11 +
.../scm/cli/ContainerBalancerStartSubcommand.java | 13 +-
.../hdds/scm/cli/ContainerOperationClient.java | 7 +-
.../hadoop/hdds/scm/cli/TopologySubcommand.java | 46 +-
.../datanode/TestContainerBalancerSubCommand.java | 6 +-
.../ozone/client/io/BlockOutputStreamEntry.java | 270 ++++++---
.../client/io/BlockOutputStreamEntryPool.java | 86 ++-
.../ozone/client/io/ECBlockOutputStreamEntry.java | 7 +-
.../hadoop/ozone/client/io/KeyOutputStream.java | 16 +-
.../apache/hadoop/ozone/client/rpc/RpcClient.java | 5 +-
.../main/java/org/apache/hadoop/ozone/OFSPath.java | 45 +-
.../org/apache/hadoop/ozone/om/OMConfigKeys.java | 6 +
hadoop-ozone/dev-support/checks/_lib.sh | 8 +-
.../dist/src/main/compose/ozone-ha/test.sh | 2 +
.../src/main/compose/ozone-mr/hadoop27/test.sh | 2 +
.../src/main/compose/ozone-mr/hadoop31/test.sh | 2 +
.../src/main/compose/ozone-mr/hadoop32/test.sh | 2 +
.../src/main/compose/ozone-mr/hadoop33/test.sh | 2 +
.../dist/src/main/compose/ozone-mr/test.sh | 3 +
.../dist/src/main/compose/ozonesecure-ha/test.sh | 2 +
.../dist/src/main/compose/ozonesecure-mr/test.sh | 2 +
.../src/main/compose/ozonesecure/docker-config | 1 +
hadoop-ozone/dist/src/main/k8s/examples/testlib.sh | 2 +-
.../dist/src/main/smoketest/recon/recon-api.robot | 53 +-
.../src/main/smoketest/s3/MultipartUpload.robot | 23 +-
.../dist/src/main/smoketest/topology/cli.robot | 6 +
.../fs/ozone/TestOzoneFSWithObjectStoreCreate.java | 30 +-
.../hadoop/fs/ozone/TestOzoneFileInterfaces.java | 69 ++-
.../fs/ozone/TestOzoneFileInterfacesWithFSO.java | 8 +-
.../hadoop/fs/ozone/TestOzoneFileSystem.java | 15 +-
.../fs/ozone/TestOzoneFileSystemWithFSO.java | 7 +-
.../apache/hadoop/fs/ozone/TestOzoneFsHAURLs.java | 35 +-
.../hadoop/fs/ozone/TestRootedOzoneFileSystem.java | 9 +-
.../hadoop/hdds/scm/TestSCMInstallSnapshot.java | 4 +-
.../apache/hadoop/hdds/scm/TestSCMSnapshot.java | 4 +-
.../TestContainerStateManagerIntegration.java | 140 ++---
.../metrics/TestSCMContainerManagerMetrics.java | 4 +-
.../hdds/scm/pipeline/TestNode2PipelineMap.java | 4 +-
.../hdds/scm/pipeline/TestPipelineClose.java | 4 +-
.../hadoop/hdds/scm/pipeline/TestSCMRestart.java | 6 +-
.../hadoop/hdds/upgrade/TestHDDSUpgrade.java | 41 +-
.../org/apache/hadoop/ozone/MiniOzoneCluster.java | 31 +
.../apache/hadoop/ozone/MiniOzoneClusterImpl.java | 7 +
.../hadoop/ozone/MiniOzoneClusterProvider.java | 3 +
.../ozone/TestContainerBalancerOperations.java | 8 +-
.../apache/hadoop/ozone/TestMiniOzoneCluster.java | 16 +-
.../rpc/TestBlockOutputStreamWithFailures.java | 20 +-
...estBlockOutputStreamWithFailuresFlushDelay.java | 20 +-
.../rpc/TestOzoneClientMultipartUploadWithFSO.java | 30 +-
.../client/rpc/TestOzoneRpcClientAbstract.java | 26 +
.../client/rpc/read/TestChunkInputStream.java | 13 +-
.../ozone/client/rpc/read/TestInputStreamBase.java | 47 --
.../ozone/client/rpc/read/TestKeyInputStream.java | 61 +-
.../apache/hadoop/ozone/container/TestHelper.java | 4 +-
.../hadoop/ozone/dn/scrubber/TestDataScrubber.java | 4 +-
.../TestDatanodeHddsVolumeFailureToleration.java | 40 +-
.../apache/hadoop/ozone/om/TestKeyManagerImpl.java | 7 +-
.../hadoop/ozone/om/TestObjectStoreWithFSO.java | 10 +-
.../org/apache/hadoop/ozone/om/TestOmLDBCli.java | 64 +-
.../org/apache/hadoop/ozone/om/TestOmMetrics.java | 28 +-
.../ozone/om/TestOzoneManagerConfiguration.java | 2 +-
.../apache/hadoop/ozone/om/TestOzoneManagerHA.java | 114 +++-
.../ozone/om/TestOzoneManagerHAMetadataOnly.java | 5 +-
.../ozone/om/TestOzoneManagerHAWithData.java | 98 +--
.../ozone/om/TestOzoneManagerHAWithFailover.java | 65 ++
.../ozone/om/TestOzoneManagerListVolumes.java | 117 ++--
.../hadoop/ozone/om/TestOzoneManagerPrepare.java | 28 +-
.../ozone/om/TestOzoneManagerRocksDBLogging.java | 2 +-
.../apache/hadoop/ozone/om/TestScmSafeMode.java | 7 +-
.../om/ratis/TestOzoneManagerRatisRequest.java | 71 +++
.../hadoop/ozone/recon/TestReconAsPassiveScm.java | 10 +-
.../apache/hadoop/ozone/recon/TestReconTasks.java | 4 +-
.../org/apache/hadoop/ozone/scm/TestSCMMXBean.java | 4 +-
.../scm/node/TestDecommissionAndMaintenance.java | 4 +-
.../hadoop/ozone/shell/TestNSSummaryAdmin.java | 3 +-
.../apache/hadoop/ozone/om/OMMetadataManager.java | 3 +-
hadoop-ozone/ozone-manager/pom.xml | 10 +-
.../hadoop/ozone/om/DirectoryDeletingService.java | 21 +-
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 120 ++--
.../hadoop/ozone/om/OmMetadataManagerImpl.java | 24 +-
.../org/apache/hadoop/ozone/om/OzoneManager.java | 26 +-
.../hadoop/ozone/om/TrashOzoneFileSystem.java | 2 +-
.../ozone/om/ratis/OzoneManagerRatisServer.java | 6 +-
.../om/ratis/utils/OzoneManagerRatisUtils.java | 130 +++-
.../request/bucket/OMBucketSetPropertyRequest.java | 9 +-
.../ozone/om/request/file/OMFileCreateRequest.java | 2 +-
.../request/file/OMFileCreateRequestWithFSO.java | 6 +
.../ozone/om/request/file/OMFileRequest.java | 18 +-
.../om/request/key/OMAllocateBlockRequest.java | 9 +-
.../request/key/OMAllocateBlockRequestWithFSO.java | 6 +
.../ozone/om/request/key/OMKeyCommitRequest.java | 5 +-
.../om/request/key/OMKeyCommitRequestWithFSO.java | 6 +
.../ozone/om/request/key/OMKeyCreateRequest.java | 2 +-
.../om/request/key/OMKeyCreateRequestWithFSO.java | 6 +
.../ozone/om/request/key/OMKeyDeleteRequest.java | 58 +-
.../om/request/key/OMKeyDeleteRequestWithFSO.java | 6 +
.../om/request/key/OMKeyRenameRequestWithFSO.java | 6 +
.../hadoop/ozone/om/request/key/OMKeyRequest.java | 33 +-
.../om/request/key/OMPathsPurgeRequestWithFSO.java | 6 +
.../ozone/om/request/key/acl/OMKeyAclRequest.java | 38 ++
.../S3InitiateMultipartUploadRequest.java | 2 +-
.../S3InitiateMultipartUploadRequestWithFSO.java | 6 +
.../multipart/S3MultipartUploadAbortRequest.java | 16 +-
.../S3MultipartUploadAbortRequestWithFSO.java | 6 +
.../S3MultipartUploadCommitPartRequest.java | 4 +-
.../S3MultipartUploadCommitPartRequestWithFSO.java | 5 +
.../S3MultipartUploadCompleteRequest.java | 5 +-
.../S3MultipartUploadCompleteRequestWithFSO.java | 6 +
.../om/request/volume/OMVolumeSetQuotaRequest.java | 5 +-
.../hadoop/ozone/om/response/OMClientResponse.java | 5 +
.../response/file/OMFileCreateResponseWithFSO.java | 5 +
.../om/response/key/OMAllocateBlockResponse.java | 4 +-
.../key/OMAllocateBlockResponseWithFSO.java | 6 +
.../ozone/om/response/key/OMKeyCommitResponse.java | 4 +-
.../response/key/OMKeyCommitResponseWithFSO.java | 10 +-
.../ozone/om/response/key/OMKeyCreateResponse.java | 4 +-
.../response/key/OMKeyDeleteResponseWithFSO.java | 6 +
.../response/key/OMKeyRenameResponseWithFSO.java | 6 +
.../om/response/key/OMOpenKeysDeleteRequest.java | 5 +-
.../om/response/key/OMOpenKeysDeleteResponse.java | 3 +-
.../response/key/OMPathsPurgeResponseWithFSO.java | 5 +
.../S3InitiateMultipartUploadResponse.java | 4 +-
.../multipart/S3MultipartUploadAbortResponse.java | 4 +-
.../S3MultipartUploadAbortResponseWithFSO.java | 6 +
.../S3MultipartUploadCommitPartResponse.java | 4 +-
...S3MultipartUploadCommitPartResponseWithFSO.java | 6 +
.../S3MultipartUploadCompleteResponse.java | 11 +-
...OzoneManagerProtocolServerSideTranslatorPB.java | 8 +-
.../protocolPB/OzoneManagerRequestHandler.java | 12 +-
.../security/OzoneBlockTokenSecretManager.java | 5 -
.../ozone/om/request/TestOMRequestUtils.java | 42 +-
.../bucket/TestOMBucketSetPropertyRequest.java | 30 +-
.../file/TestOMFileCreateRequestWithFSO.java | 9 +-
.../key/TestOMAllocateBlockRequestWithFSO.java | 18 +-
.../om/request/key/TestOMKeyAclRequestWithFSO.java | 2 +-
.../om/request/key/TestOMKeyCommitRequest.java | 6 +-
.../om/request/key/TestOMKeyCreateRequest.java | 44 +-
.../request/key/TestOMKeyCreateRequestWithFSO.java | 11 +-
.../om/request/key/TestOMKeyDeleteRequest.java | 13 +-
.../request/key/TestOMKeyDeleteRequestWithFSO.java | 10 +-
.../ozone/om/request/key/TestOMKeyRequest.java | 10 +-
.../request/key/TestOMOpenKeysDeleteRequest.java | 10 +-
.../TestS3InitiateMultipartUploadRequest.java | 25 +-
...estS3InitiateMultipartUploadRequestWithFSO.java | 10 +-
.../s3/multipart/TestS3MultipartRequest.java | 5 +
.../TestS3MultipartUploadAbortRequest.java | 4 +-
.../TestS3MultipartUploadCommitPartRequest.java | 5 +-
...tS3MultipartUploadCommitPartRequestWithFSO.java | 6 +
.../TestS3MultipartUploadCompleteRequest.java | 3 +-
.../volume/TestOMVolumeSetQuotaRequest.java | 28 +-
.../file/TestOMFileCreateResponseWithFSO.java | 6 +
.../response/key/TestOMAllocateBlockResponse.java | 12 +-
.../key/TestOMAllocateBlockResponseWithFSO.java | 5 +
.../om/response/key/TestOMKeyCommitResponse.java | 12 +-
.../key/TestOMKeyCommitResponseWithFSO.java | 6 +
.../om/response/key/TestOMKeyCreateResponse.java | 12 +-
.../key/TestOMKeyCreateResponseWithFSO.java | 6 +
.../key/TestOMKeyDeleteResponseWithFSO.java | 6 +
.../ozone/om/response/key/TestOMKeyResponse.java | 5 +
.../response/key/TestOMOpenKeysDeleteResponse.java | 18 +-
.../TestS3InitiateMultipartUploadResponse.java | 3 +-
...stS3InitiateMultipartUploadResponseWithFSO.java | 9 +-
.../s3/multipart/TestS3MultipartResponse.java | 15 +-
.../TestS3MultipartUploadAbortResponse.java | 11 +-
...S3MultipartUploadCommitPartResponseWithFSO.java | 15 +-
...stS3MultipartUploadCompleteResponseWithFSO.java | 21 +-
.../org/apache/hadoop/fs/ozone/TestOFSPath.java | 26 +
.../apache/hadoop/ozone/recon/ReconHttpServer.java | 1 +
.../hadoop/ozone/recon/ReconRestServletModule.java | 144 +++--
.../org/apache/hadoop/ozone/recon/ReconServer.java | 26 +-
.../apache/hadoop/ozone/recon/api/AdminOnly.java | 23 +-
.../hadoop/ozone/recon/api/ContainerEndpoint.java | 1 +
.../hadoop/ozone/recon/api/NSSummaryEndpoint.java | 5 +-
.../ozone/recon/api/filters/ReconAdminFilter.java | 113 ++++
.../ozone/recon/api/filters/ReconAuthFilter.java | 117 ++++
.../recon/api/{ => filters}/package-info.java | 5 +-
.../ozone/recon/fsck/ContainerHealthTask.java | 6 +-
.../recon/scm/ReconContainerReportHandler.java | 4 +-
.../ozone/recon/scm/ReconDeadNodeHandler.java | 4 +-
.../ReconIncrementalContainerReportHandler.java | 4 +-
.../ozone/recon/scm/ReconPipelineManager.java | 10 +-
.../scm/ReconStorageContainerManagerFacade.java | 4 +-
.../ozone/recon/api/TestNSSummaryEndpoint.java | 12 +-
.../ozone/recon/api/filters/TestAdminFilter.java | 161 +++++
.../ozone/recon/fsck/TestContainerHealthTask.java | 6 +-
.../hadoop/ozone/s3/endpoint/ObjectEndpoint.java | 39 +-
.../s3/endpoint/TestMultipartUploadWithCopy.java | 219 +++++--
.../org/apache/hadoop/ozone/debug/DBScanner.java | 74 ++-
pom.xml | 54 +-
293 files changed, 4660 insertions(+), 3580 deletions(-)
create mode 100644 .github/ci.md
create mode 100644
hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/tracing/TestTraceAllMethod.java
copy
hadoop-hdds/{framework/src/test/java/org/apache/hadoop/hdds/server/http/TestHttpRequestLogAppender.java
=> common/src/test/java/org/apache/hadoop/hdds/tracing/TestTracingUtil.java}
(50%)
delete mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/ContainerManagerV2.java
delete mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/SCMContainerManager.java
rename
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/{PipelineStateManagerV2Impl.java
=> PipelineStateManagerImpl.java} (88%)
delete mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/StateManager.java
delete mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/TestSCMContainerManager.java
rename
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/pipeline/{TestPipelineStateManager.java
=> TestPipelineStateManagerImpl.java} (64%)
delete mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/pipeline/TestSCMStoreImplWithOldPipelineIDKeyFormat.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/TestOzoneManagerHAWithFailover.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/ratis/TestOzoneManagerRatisRequest.java
copy
hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/audit/AuditAction.java
=>
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/AdminOnly.java
(61%)
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/filters/ReconAdminFilter.java
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/filters/ReconAuthFilter.java
copy hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/{ =>
filters}/package-info.java (87%)
create mode 100644
hadoop-ozone/recon/src/test/java/org/apache/hadoop/ozone/recon/api/filters/TestAdminFilter.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
