This is an automated email from the ASF dual-hosted git repository.
licheng pushed a change to branch HDDS-2823
in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git.
discard 723d23c HDDS-3196 New PipelineManager interface to persist to
RatisServer. (#980)
omit 4e1c93f HDDS-3192. Handle AllocateContainer operation for HA. (#975)
omit b58d068 HDDS-3186. Introduce generic SCMRatisRequest and
SCMRatisResponse. (#959)
omit d9a5cc9 HDDS-3556 Refactor conf in SCMRatisServer to Java-based conf.
(#907)
omit d3d4604 Resolve conflicts with merge from master.
omit a5f5e2d HDDS-3187 Construct SCM StateMachine. (#819)
omit 3dd5812 HDDS-3185 Construct a standalone ratis server for SCM. (#720)
add a7860d4 HDDS-3649. Add documentation for Cat Key Command (#967)
add 0781377 HDDS-2572. Handle InterruptedException in
SCMSecurityProtocolServer (#960)
add 31c5027 HDDS-3635. Archive jacoco coverage files for unit/integration
tests (#951)
add 9dc8ee7 HDDS-3665. Container info command should print uuid of
datanode (#972)
add d1f8b3c HDDS-3663. Display uuid in recon datanode page to distinguish
each datanode (#973)
add 734862e HDDS-3500. Hide OMFailoverProxyProvider usage behind an
interface
add fb0da02 HDDS-3609. Avoid to use Hadoop3.x IOUtils in Ozone Client
(#944)
add 2ce7407 HDDS-3646. Add a copy command to copy key to a new one. (#963)
add ece8af7 HDDS-2563. Handle InterruptedException in
RunningDatanodeState (#974)
add 796a598 HDDS-3618. Update OM HA acceptance test to Python3 (#965)
add 302f4f3 HDDS-2574. Handle InterruptedException in
OzoneDelegationTokenSecretManager (#961)
add d5f521b HDDS-3607. Lot of warnings at DN startup. (#937)
add b03d7b4 HDDS-2566. Handle InterruptedException in
ContainerDataScanner (#971)
add 5b06294 HDDS-3657. Unregister the metrics source when
replicationmanager stop. (#966)
add ec764af HDDS-3633. Improve UniqueId.next() efficiency. (#968)
add c7bda1a HDDS-3416. Enable
TestSCMNodeManager#testScmStatsFromNodeReport (#909)
add b98850d HDDS-3673. Version information not printed correctly in SCM
WebUI. (#977)
add b66869d HDDS-3309. Add TimedOutTestsListener to surefire and add
timeout to integration tests (#813)
add d3551e2 HDDS-3475. Use transactionInfo table to persist transaction
information. (#856)
add 383b078 HDDS-3550. Fix TestReadRetries. (#979)
add d4befa5 HDDS-3670. Remove property
ozone.scm.container.creation.lease.timeout (#985)
add 9d89446 HDDS-3645. Add a replication type option for putkey command
(#962)
add 5844712 HDDS-2764. security/_index.md translation (#866)
add 4b2dc09 HDDS-3608. NPE while process a pipeline report when
PipelineQuery absent in query2OpenPipelines (#938)
add ad04f31 HDDS-3691. Update gRPC to 1.29.0. (#998)
add b9e36b6 HDDS-3690. Fix a typo in BlockManagerImpl#allocateBlock (#996)
add 764af7c HDDS-3674. add a ozone-style.xml that can be imported into
IDEA. (#978)
new 8c25beb HDDS-3185 Construct a standalone ratis server for SCM. (#720)
new 4c035bb HDDS-3187 Construct SCM StateMachine. (#819)
new a8ac3b2 Resolve conflicts with merge from master.
new cbdae06 HDDS-3556 Refactor conf in SCMRatisServer to Java-based conf.
(#907)
new 59a75b0 HDDS-3186. Introduce generic SCMRatisRequest and
SCMRatisResponse. (#959)
new e1fc4a4 HDDS-3192. Handle AllocateContainer operation for HA. (#975)
new c24a3ed HDDS-3196 New PipelineManager interface to persist to
RatisServer. (#980)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (723d23c)
\
N -- N -- N refs/heads/HDDS-2823 (c24a3ed)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 7 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../java/org/apache/hadoop/hdds/HddsUtils.java | 11 +-
.../org/apache/hadoop/hdds/scm/ScmConfigKeys.java | 6 -
.../org/apache/hadoop/hdds/utils/UniqueId.java | 10 +-
.../common/src/main/resources/ozone-default.xml | 13 -
.../states/datanode/RunningDatanodeState.java | 8 +-
.../container/keyvalue/impl/BlockManagerImpl.java | 4 +-
.../container/ozoneimpl/ContainerDataScanner.java | 14 +-
.../ozone/container/ContainerTestHelper.java | 4 +-
.../content/security/{_index.md => _index.zh.md} | 13 +-
hadoop-hdds/docs/content/shell/KeyCommands.md | 18 +
hadoop-hdds/docs/content/shell/KeyCommands.zh.md | 18 +
.../hadoop/hdds/scm/block/BlockManagerImpl.java | 2 +-
.../hdds/scm/container/ReplicationManager.java | 1 +
.../hadoop/hdds/scm/pipeline/PipelineStateMap.java | 11 +-
.../hdds/scm/server/SCMSecurityProtocolServer.java | 30 +-
.../scm/container/TestSCMContainerManager.java | 6 -
.../hadoop/hdds/scm/node/TestSCMNodeManager.java | 18 +-
.../hdds/scm/cli/container/InfoSubcommand.java | 7 +-
.../hadoop/ozone/client/OzoneClientFactory.java | 8 +-
.../ozone/client/OzoneClientInvocationHandler.java | 62 ----
.../ozone/client/protocol/ClientProtocol.java | 36 +-
.../apache/hadoop/ozone/client/rpc/RpcClient.java | 28 +-
.../ozone/om/protocol/OzoneManagerProtocol.java | 7 -
.../ozone/om/protocolPB/Hadoop3OmTransport.java | 269 ++++++++++++++
.../om/protocolPB/Hadoop3OmTransportFactory.java | 24 +-
.../hadoop/ozone/om/protocolPB/OmTransport.java} | 32 +-
.../ozone/om/protocolPB/OmTransportFactory.java | 63 ++++
...OzoneManagerProtocolClientSideTranslatorPB.java | 256 +------------
hadoop-ozone/dev-support/checks/integration.sh | 3 +
hadoop-ozone/dev-support/checks/unit.sh | 3 +
hadoop-ozone/dev-support/intellij/ozone-style.xml | 57 +++
.../dist/src/main/compose/ozone-om-ha/Dockerfile | 2 +-
.../src/main/smoketest/basic/ozone-shell.robot | 15 +
.../apache/hadoop/ozone/MiniOzoneChaosCluster.java | 3 -
.../hadoop/fs/ozone/TestOzoneFSInputStream.java | 8 +
.../hadoop/fs/ozone/TestOzoneFileInterfaces.java | 8 +
.../hadoop/fs/ozone/TestOzoneFileSystem.java | 8 +
.../apache/hadoop/fs/ozone/TestOzoneFsHAURLs.java | 8 +
.../metrics/TestSCMContainerManagerMetrics.java | 8 +
.../hdds/scm/pipeline/TestNode2PipelineMap.java | 8 +
.../hadoop/hdds/scm/pipeline/TestNodeFailure.java | 8 +
.../hdds/scm/pipeline/TestPipelineClose.java | 8 +
.../hadoop/hdds/scm/pipeline/TestSCMRestart.java | 8 +
.../hadoop/ozone/TestContainerOperations.java | 8 +
.../TestContainerStateMachineIdempotency.java | 8 +
.../apache/hadoop/ozone/TestDelegationToken.java | 406 +++++++++++++++++++++
.../apache/hadoop/ozone/TestMiniOzoneCluster.java | 8 +
.../hadoop/ozone/TestOzoneConfigurationFields.java | 8 +
.../hadoop/ozone/TestSecureOzoneCluster.java | 168 +--------
.../ozone/TestStorageContainerManagerHelper.java | 8 +
.../ozone/client/rpc/Test2BlockOutputStream.java | 8 +
.../ozone/client/rpc/Test2WayCommitInRatis.java | 8 +
.../apache/hadoop/ozone/client/rpc/TestBCSID.java | 8 +
.../ozone/client/rpc/TestBlockOutputStream.java | 8 +
.../rpc/TestBlockOutputStreamWithFailures.java | 8 +
.../rpc/TestCloseContainerHandlingByClient.java | 8 +
.../hadoop/ozone/client/rpc/TestCommitWatcher.java | 8 +
.../client/rpc/TestContainerStateMachine.java | 8 +
.../client/rpc/TestFailureHandlingByClient.java | 8 +
.../client/rpc/TestHybridPipelineOnDatanode.java | 8 +
.../rpc/TestMultiBlockWritesWithDnFailures.java | 8 +
.../rpc/TestOzoneClientRetriesOnException.java | 8 +
.../ozone/client/rpc/TestOzoneRpcClient.java | 8 +
.../client/rpc/TestOzoneRpcClientAbstract.java | 9 +-
.../hadoop/ozone/client/rpc/TestReadRetries.java | 24 +-
.../ozone/client/rpc/TestSecureOzoneRpcClient.java | 8 +
.../commandhandler/TestCloseContainerHandler.java | 8 +
.../commandhandler/TestDeleteContainerHandler.java | 8 +
.../container/metrics/TestContainerMetrics.java | 8 +
.../ozone/dn/ratis/TestDnRatisLogParser.java | 8 +
.../hadoop/ozone/dn/scrubber/TestDataScrubber.java | 8 +
.../freon/TestDataValidateWithDummyContainers.java | 8 +
.../TestDataValidateWithSafeByteOperations.java | 8 +
.../TestDataValidateWithUnsafeByteOperations.java | 8 +
.../freon/TestFreonWithDatanodeFastRestart.java | 8 +
.../ozone/freon/TestFreonWithDatanodeRestart.java | 10 +-
.../hadoop/ozone/fsck/TestContainerMapper.java | 8 +
.../hadoop/ozone/om/OmFailoverProxyUtil.java | 47 +++
.../ozone/om/TestContainerReportWithKeys.java | 7 +
.../apache/hadoop/ozone/om/TestKeyManagerImpl.java | 7 +
.../org/apache/hadoop/ozone/om/TestKeyPurging.java | 8 +
.../hadoop/ozone/om/TestOMRatisSnapshots.java | 22 +-
.../org/apache/hadoop/ozone/om/TestOmAcls.java | 7 +
.../hadoop/ozone/om/TestOmBlockVersioning.java | 7 +
.../org/apache/hadoop/ozone/om/TestOmInit.java | 7 +
.../org/apache/hadoop/ozone/om/TestOmMetrics.java | 8 +
.../org/apache/hadoop/ozone/om/TestOmSQLCli.java | 8 +
.../ozone/om/TestOzoneManagerConfiguration.java | 8 +
.../apache/hadoop/ozone/om/TestOzoneManagerHA.java | 4 +-
.../ozone/om/TestOzoneManagerHAMetadataOnly.java | 21 +-
.../ozone/om/TestOzoneManagerHAWithData.java | 48 +--
.../ozone/om/TestOzoneManagerRestInterface.java | 8 +
.../ozone/om/parser/TestOMRatisLogParser.java | 8 +
.../snapshot/TestOzoneManagerSnapshotProvider.java | 14 +-
.../hadoop/ozone/recon/TestReconAsPassiveScm.java | 7 +
.../apache/hadoop/ozone/recon/TestReconTasks.java | 7 +
.../ozone/recon/TestReconWithOzoneManager.java | 8 +
.../hadoop/ozone/scm/TestAllocateContainer.java | 7 +
.../hadoop/ozone/scm/TestContainerSmallFile.java | 7 +
.../scm/TestGetCommittedBlockLengthAndPutKey.java | 8 +
.../org/apache/hadoop/ozone/scm/TestSCMMXBean.java | 8 +
.../hadoop/ozone/scm/TestSCMNodeManagerMXBean.java | 8 +
.../hadoop/ozone/scm/TestXceiverClientManager.java | 7 +
.../hadoop/ozone/scm/TestXceiverClientMetrics.java | 8 +
.../scm/pipeline/TestPipelineManagerMXBean.java | 8 +
.../TestSCMPipelineBytesWrittenMetrics.java | 8 +
.../ozone/scm/pipeline/TestSCMPipelineMetrics.java | 8 +
.../hadoop/ozone/shell/TestOzoneDatanodeShell.java | 8 +
.../org/apache/hadoop/ozone/om/OzoneManager.java | 21 +-
.../java/org/apache/hadoop/ozone/om/ScmClient.java | 2 +-
.../ozone/om/ratis/OzoneManagerDoubleBuffer.java | 79 +++-
.../ozone/om/ratis/OzoneManagerStateMachine.java | 11 +
...OzoneManagerProtocolServerSideTranslatorPB.java | 32 +-
.../OzoneDelegationTokenSecretManager.java | 34 +-
...tOzoneManagerDoubleBufferWithDummyResponse.java | 14 +
...TestOzoneManagerDoubleBufferWithOMResponse.java | 13 +
.../hadoop/ozone/recon/ReconControllerModule.java | 30 +-
.../hadoop/ozone/recon/api/NodeEndpoint.java | 1 +
.../ozone/recon/api/types/DatanodeMetadata.java | 14 +
.../src/views/datanodes/datanodes.tsx | 10 +
.../apache/hadoop/ozone/debug/ChunkKeyHandler.java | 28 +-
.../hadoop/ozone/freon/BaseFreonGenerator.java | 6 +-
.../ozone/genesis/BenchMarkDatanodeDispatcher.java | 4 +-
.../hadoop/ozone/genesis/BenchMarkOMClient.java | 161 --------
.../{PutKeyHandler.java => CopyKeyHandler.java} | 100 ++---
.../hadoop/ozone/shell/keys/KeyCommands.java | 1 +
.../hadoop/ozone/shell/keys/PutKeyHandler.java | 12 +-
pom.xml | 25 +-
128 files changed, 1955 insertions(+), 972 deletions(-)
copy hadoop-hdds/docs/content/security/{_index.md => _index.zh.md} (62%)
delete mode 100644
hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/OzoneClientInvocationHandler.java
create mode 100644
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocolPB/Hadoop3OmTransport.java
copy
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/db/IntegerCodec.java
=>
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocolPB/Hadoop3OmTransportFactory.java
(63%)
copy
hadoop-ozone/{ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/util/OmResponseUtil.java
=>
common/src/main/java/org/apache/hadoop/ozone/om/protocolPB/OmTransport.java}
(60%)
create mode 100644
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocolPB/OmTransportFactory.java
create mode 100644 hadoop-ozone/dev-support/intellij/ozone-style.xml
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/TestDelegationToken.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/OmFailoverProxyUtil.java
delete mode 100644
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkOMClient.java
copy
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/keys/{PutKeyHandler.java
=> CopyKeyHandler.java} (59%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
