This is an automated email from the ASF dual-hosted git repository.
pifta pushed a change to branch HDDS-5447-httpfs
in repository https://gitbox.apache.org/repos/asf/ozone.git
from 08b028967d Merge branch 'master' into HDDS-5447-httpfs
add 829dfce410 HDDS-7554. Recon UI should show DORMANT in pipeline status
filter (#4010)
add eeeb0b548c HDDS-6615. EC: Improve write performance by pipelining
encode and flush (#3994)
add f1d651d0b5 HDDS-7561. Improve setquota, clrquota CLI usage (#4016)
add 627c90c233 HDDS-7510. Recon: Return number of open containers in
`/clusterState` endpoint (#3989)
add 4de7d56fc4 HDDS-7394. OM RPC FairCallQueue decay decision metrics list
caller username in the metric (#3878)
add 9a5bfb4fbd HDDS-7568. Bump copyright year in NOTICE (#4018)
add 45778cc699 HDDS-7540. Let reusable workflow inherit secrets (#4012)
add cb9caca398 HDDS-7575. Correct showing of RATIS-THREE icon in Recon UI
(#4026)
add fe86f3bb49 HDDS-7567. Invalid entries in LICENSE (#4020)
add 50a9d46d80 HDDS-7497. Fix mkdir does not update bucket's usedNamespace
(#3969)
add be092c4153 HDDS-7563. Add a handler for under replicated Ratis
containers in RM (#4025)
add 984d26a165 HDDS-7562. Suppress warning about long filenames in tar
(#4017)
add 1119f9d949 HDDS-7579. Use Netty 4.1.77 for consistency (#4031)
add 069e038c4f HDDS-7253. Fix exception when '/' in key name (#4038)
add 47a5671cc5 HDDS-7581. Fix update-jar-report for snapshot (#4034)
add b532d2f7f5 HDDS-7541. FSO recursive delete directory with hierarchy
takes much time for cleanup (#4008)
add ee2bd17440 HDDS-7555. Upgrade Ratis to 2.4.2-8b8bdda-SNAPSHOT. (#4028)
add a1bc9b86de HDDS-5704. Ozone URI syntax description in help content
needs to mention about ozone service id (#3862)
add 037492f839 HDDS-7472. EC: Fix NSSummaryEndpoint#getDiskUsage for EC
keys (#3987)
add 721b02593b HDDS-7526. Avoid overwriting replication config on existing
bucket when quota is set (#4013)
add fd3ddc42b2 HDDS-7599. Bump commons-net from 3.6 to 3.9.0 (#4046)
add d50a9dd894 HDDS-7550. Recon: UI sorting not functioning as expected
(#4009)
add 565775c7dd HDDS-7464. Container Report at SCM is not coming separately
for ICR and FCR in prometheus endpoint (#4035)
add a93ca68066 HDDS-7597. Clarify SCM admin access denied message (#4056)
add 8967738e93 HDDS-7492. Extend Placement Policy Interface to select
mis-replicated replicas to copy (#4006)
add ebd1c747ac HDDS-7615. Import Guava classes directly, not from
hadoop-thirdparty (#4062)
add 77d386de5f HDDS-7502. Recon: Show number of open containers on the
Overview page (#4043)
add 6eed1ec3d3 HDDS-7265. ScatterRackPolicy for Ratis pipeline provider
container placement (#4002)
add 845ceff4d6 HDDS-7603. Enable Erasure coding and encryption flag on
FileStatus for ofs (#4060)
add a9bb08889c HDDS-7587. Update NOTICE and LICENSE in license/bin/ (#4039)
add e7567f8958 HDDS-7617. Mark testECContainerRecoveryWithTimedOutRecovery
as flaky
add 66e277386e HDDS-7572. Use keyManager and trustManager provided by
keyStoreFactory in datanode grpc services (#4032)
add 76fb0163df HDDS-7580. Add option to show key count in DBScanner.
(#4033)
add d0e6824eec HDDS-7614. Add subscription mechanism to
ContainerReplicaPendingOps (#4064)
add c9a0e2cd10 HDDS-7589. Unify multipart stream reading. (#4041)
add 3fe4b4e156 HDDS-7595. Add OmId in OM's UI (#4047)
add e4a1993e79 HDDS-7618. Replication Commands should timeout if not
processed on datanodes in time (#4069)
add a6307d71d0 HDDS-7628. Disable flaky
TestOzoneContainerWithTLS#testContainerDownload
add 4c529ebc11 HDDS-7591. Add a handler for over replicated Ratis
containers to RM (#4055)
add d6f63bf2e5 HDDS-7619. Update SCM term in datanode when command is
received (#4072)
add 2279689dd3 HDDS-7008. Mark TestOzoneHARatisLogParser as flaky (#4078)
add 551ef3c020 HDDS-7640. EC: UNHEALTHY replicas not replaced by healthy
replicas from a CLOSED container by RM (#4083)
add 2fc94fa05b HDDS-7582. ECUnderReplicationHandler does not consider
pending adds when finding targets (#4085)
add 6064b84576 HDDS-7503. CLI admin namespace -quota should return whole
file system disk capacity consumed by all replicas (#3976)
add 2ba8bb71f1 HDDS-7643. rocksdb iterator is not closed properly (#4084)
add a756937a16 HDDS-7627. EC: Bug fix for calculating Misreplication Count
(#4088)
add 5eead92666 HDDS-7592. Recursive delete of directory multiple time
impacts some directory not removed (#4068)
add fd0eddda8c HDDS-7642. EC: Add debug logging to the Replication Manager
check handlers (#4087)
add b347fde11b HDDS-7628. Disable flaky
TestOzoneContainerWithTLS#testCreateOzoneContainer
add 2d4bc6a3e2 HDDS-7636. Remove hadoop security dependency in
org.apache.hadoop.hdds.security.ssl package (#4080)
add 1a5e698c6b HDDS-7521. EC: Misreplication Handler changes for Placement
Policy interface changes (#4061)
add 1f7e9cc8ed HDDS-7620. Check term for async commands before processing
(#4096)
add 517e3e15c5 HDDS-7371. Create properties for all dependency versions
(#4059)
add fdf219f179 HDDS-5366. [Ozone-Streaming] Implement stream method to
ContainerStateMachine. (#2358). Contributed by mingchao zhao
add 0afbbc541d HDDS-5452. Add link method to ContainerStateMachine for
Ratis streaming (#2422)
add 9eafca6ee8 HDDS-5481. Fix stream() and link() method in
ContainerStateMachine. (#2451)
add da95602eba HDDS-5480. [Ozone-Streaming] Client and server should
support stream setup. (#2452)
add 82153a26ed HDDS-5488. [Ozone-Streaming] Add a new
BlockOutputStream/KeyOutputStream to support streaming api (#2495)
add 5a294b7d54 HDDS-5599. [Ozone-Streaming]drop BufferPool and
ChunkBuffer to avoid buffer copying (#2557)
add ff59eeb27f HDDS-5705. [Ozone-Streaming] Change ByteBufStreamOutput to
ByteBufferStreamOutput (#2603)
add f27388a5cc HDDS-5742. Avoid unnecessary Bytebuffer conversions (#2673)
add 94f87891a7 HDDS-5486. [Ozone-Streaming] Streaming supports writing in
Pipline mode (#2682)
add 9d01c02c98 HDDS-5849. [Ozone-Streaming]Write exceptions occur after
checksum is enabled (#2729)
add 122f96c029 HDDS-5674.[Ozone-Streaming] Handle client retries on
exception (#2701)
add e063706ed3 HDDS-5895. [Ozone-Streaming] Make
raft.server.data-stream.client.pool.size configurable (#2766)
add 75efaae8cf HDDS-5763. Provide an Executor for each LocalStream in
ContainerStateMachine (#2782)
add 2e86e93321 HDDS-5987. [Ozone-Streaming] Add XceiverClientRatis stream
config (#2841)
add 9a7edb0240 HDDS-5961. [Ozone-Streaming] update the usage space of
Containers in the stream write (#2833)
add 237e0afed3 HDDS-5879. [Ozone-Streaming] OzoneBucket add the
createMultipartStreamKey method (#2760)
add 95e317b551 HDDS-5743. [Ozone-Streaming] Add option to write files via
streaming api in ofs and o3fs. (#2770)
add 9a2de9a530 HDDS-5851. [Ozone-Streaming] Define a PutBlock/maxBuffer
fixed boundary for streaming writes. (#2866)
add ac9921d65d HDDS-6039. Define a minimum packet size during streaming
writes. (#2883)
add a67569fe83 HDDS-6130. [Ozone-Streaming] When releaseBuffers will get
“Couldn 't find the required future” (#2939)
add f85b42dcee HDDS-6139. [Ozone-Streaming] Fix incorrect computation of
totalAckDataLength. (#2978)
add 0e8c8004a1 HDDS-6178. [Ozone-Streaming] Fix NPE in HDDS-6139. (#2984)
add 2657f5ad95 HDDS-6138.[Ozone-Streaming] Define a limit on the size of
the retry bufferList. (#2946)
add 14ffbd9cb1 HDDS-6298. Add XceiverServerRatis stream config (#3070)
add 872e3061fe HDDS-5487. [Ozone-Streaming] BlockDataStreamOutput support
FlushDelay. (#3002)
add 92054a4d2f HDDS-6282. Fix BlockDataStreamOutput#doFlushIfNeeded NPE
(#3060)
add 8a5f2d6192 HDDS-6229. [Ozone-Streaming] Data Channel abstraction on
datanode (#3023)
add 8f68101eb8 HDDS-6355. [Ozone-Streaming] Fix CheckStyle problem (#3119)
add bb3af31757 HDDS-6388. [Ozone-Streaming] Streaming write support both
pipeline model and star model (#3145)
add dfefdf20eb HDDS-5798. [Ozone-Streaming] Setup TlsConf parameters.
(#3207)
add 95dbea64a0 HDDS-6137. [Ozone-Streaming] Refactor KeyDataStreamOutput.
(#3195)
add 6a6384233e HDDS-6500. [Ozone-Streaming] Buffer the PutBlockRequest at
the end of the stream. (#3229)
add 3d821e31ff HDDS-5666. Add option to createKey via streaming api in
Freon (#2574)
add 7f22916889 HDDS-6592. [Ozone-Streaming] Fix
ContainerStateMachine#applyTransaction assert error (#3315)
add 45954da28b HDDS-6842. [Ozone-Streaming] Reduce the number of watch
requests in StreamCommitWatcher. (#3492)
add 7184025ffb HDDS-6867. [Ozone-Streaming] PutKeyHandler should not use
streaming to put EC key. (#3516)
add 07bf1dbcf0 HDDS-6955. [Ozone-streaming] Add explicit stream flag in
ozone shell (#3559)
add 13da2a7c4a HDDS-7431. [Ozone-Streaming] Disable data steam by default.
(#3900)
add 8a0e347105 HDDS-7438. [Ozone-Streaming] Add a createStreamKey method
to OzoneBucket. (#3914)
add 9bbf5a1ada HDDS-7425. Add documentation for the new Streaming Pipeline
feature. (#3913)
add 1e155f3820 HDDS-7478. [Ozone-Streaming] NPE in when creating a file
with o3fs. (#3949)
add 0650ad9b08 HDDS-7426. Add a new acceptance test for Streaming
Pipeline. (#4019)
add 8b2ca00822 HDDS-7616. EC: Refactor Unhealthy Replicated Processor
(#4063)
add 886733b373 HDDS-7605. Improve logging in Container Balancer (#4067)
add ca2d59bde4 HDDS-6650. S3MultipartUpload support update bucket
usedNamespace. (#4081)
add 2ac31e1bcb HDDS-7398. Tool to remove old certs from the scm db (#3972)
add 1235e9b3d1 HDDS-7399. Enable specifying external root ca (#4053)
add d93dcd396f HDDS-7649. S3 multipart upload EC release space quota wrong
for old version (#4095)
add d5f917274c HDDS-7621. Update SCM term in datanode from heartbeat
without any commands (#4101)
add ef480765d8 HDDS-7654. EC: ReplicationManager - merge mis-rep queue
into under replicated queue (#4099)
add 7ca9b5dfa6 HDDS-7565. FSO purge directory for old bucket can update
quota for new bucket (#4021)
add bdeceeedad HDDS-7635. Update failure metrics when allocate block fails
in preExecute. (#4086)
add 204f8e18c5 HDDS-7683. EC: ReplicationManager - UnderRep maintenance
handler should not request nodes if none needed (#4109)
add c7785fa4fd HDDS-7463. SCM Pipeline scrubber never able to cleanup
allocated pipeline. (#4093)
add 9077cb83d1 HDDS-7473. Ratis integration for support of remove
registeration (#4112)
add add8f8bb16 HDDS-7686. Cherry-pick proto.lock files change from
ozone-1.3 release branch to master (#4113)
add 157c591b13 HDDS-7631. Log format error on quotas when exceeding the
space quota (#4076)
add fa8494cd1d HDDS-5331. Recon: Trigger PipelineSyncTask when DN becomes
stale and ContainerHealthTask when DN becomes dead. (#4011)
add 58283b6230 HDDS-7684. Embed Matomo Web Analytics tracking code in
docs. (#4111)
add c40cb07053 HDDS-7576. Prometheus metrics do not remove stale metrics
until restart (#4057)
add a7f06c1964 HDDS-3486. Recon cannot track missing containers that were
created and went missing while it is down. (#3947)
add b167d99d73 HDDS-7692. Remove usage of MonotonicClock and use default
system clock instead (#4121)
add b828881f78 HDDS-7661. Ratis Misreplication Handler (#4100)
add bfc37bb886 HDDS-7641. Namespace quota validation is not present in
multiple places (#4082)
add 98eb2ebd99 HDDS-7644. S3 multipart upload does not update quota
namespace for missing parents (#4091)
add a89ba1a4c4 HDDS-7584. Addition of new OM node expels itself from the
Ratis ring after restart (#4074)
add 7cfaf96b81 HDDS-7525. Migrate key digest from MD5 to SHA256 in Ozone
shell
add 4184499e80 HDDS-7623. Do not compress container re-replication traffic
by default (#4089)
add b352ad03ab HDDS-7409 [doc] Update documents for better presentation
(#3884)
add 1c830c5bc7 HDDS-7564. Update Ozone version after 1.3.0 release (#4115)
add eb031df2ed HDDS-7648. Add a servername tag in UGI metrics. (#4094)
add 04f68c96f4 HDDS-7633. Compile error with Java 11: package
com.sun.jmx.mbeanserver is not visible (#4077)
add c119557241 HDDS-7588. Intermittent failure in
TestObjectStoreWithLegacyFS#testFlatKeyStructureWithOBS (#4040)
add 58da8a90a1 HDDS-7716. Log read requests rejected with permission
denied in OM audit (#4136)
add 21717321c6 HDDS-7714. Docker cluster ozone-om-ha fails during
docker-compose up (#4137)
new c7f230f050 Merge branch 'master' into httpfs-merge
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/ci.yml | 2 +-
.github/workflows/post-commit.yml | 1 +
.github/workflows/scheduled_ci.yml | 1 +
LICENSE.txt | 10 +-
NOTICE.txt | 2 +-
hadoop-hdds/annotations/pom.xml | 4 +-
hadoop-hdds/client/pom.xml | 4 +-
.../apache/hadoop/hdds/scm/OzoneClientConfig.java | 74 +
.../apache/hadoop/hdds/scm/XceiverClientGrpc.java | 2 +-
.../apache/hadoop/hdds/scm/XceiverClientRatis.java | 7 +-
.../hdds/scm/storage/AbstractDataStreamOutput.java | 131 +
.../hdds/scm/storage/BlockDataStreamOutput.java | 733 ++++++
.../hdds/scm/storage/BlockExtendedInputStream.java | 11 +-
.../hadoop/hdds/scm/storage/BlockInputStream.java | 5 -
.../hdds/scm/storage/ByteBufferStreamOutput.java | 57 +
.../hdds/scm/storage/MultipartInputStream.java | 161 +-
...tendedInputStream.java => PartInputStream.java} | 22 +-
.../hadoop/hdds/scm/storage/StreamBuffer.java | 59 +
.../hdds/scm/storage/StreamCommitWatcher.java | 208 ++
.../hadoop/ozone/client/io/ECBlockInputStream.java | 5 -
.../ozone/client/io/ECBlockInputStreamProxy.java | 2 +-
.../client/io/ECBlockReconstructedInputStream.java | 2 +-
.../hadoop/ozone/client/io/ECStreamTestUtil.java | 5 -
.../ozone/client/io/TestECBlockInputStream.java | 5 -
hadoop-hdds/common/pom.xml | 6 +-
.../org/apache/hadoop/hdds/HddsConfigKeys.java | 20 +
.../hadoop/hdds/client/ReplicationConfig.java | 11 +
.../hadoop/hdds/protocol/DatanodeDetails.java | 9 +-
.../org/apache/hadoop/hdds/ratis/RatisHelper.java | 92 +-
.../apache/hadoop/hdds/scm/PlacementPolicy.java | 18 +-
.../org/apache/hadoop/hdds/scm/ScmConfigKeys.java | 2 +
.../scm/container/common/helpers/ExcludeList.java | 4 +-
.../protocol/StorageContainerLocationProtocol.java | 7 +
.../hdds/scm/storage/ContainerProtocolCalls.java | 14 +-
.../hadoop/hdds/security/x509/SecurityConfig.java | 35 +-
.../org/apache/hadoop/ozone/OzoneConfigKeys.java | 26 +
.../org/apache/hadoop/ozone/audit/DNAction.java | 3 +-
.../org/apache/hadoop/ozone/common/Checksum.java | 5 +
.../helpers/ContainerCommandRequestPBHelper.java | 1 +
.../common/src/main/resources/ozone-default.xml | 92 +-
.../hadoop/ozone/audit/AuditLogTestUtils.java | 79 +
.../ozone/container/ContainerTestHelper.java | 30 +-
hadoop-hdds/config/pom.xml | 4 +-
.../org/apache/hadoop/hdds/conf/ConfigTag.java | 3 +-
hadoop-hdds/container-service/pom.xml | 8 +-
.../apache/hadoop/ozone/HddsDatanodeService.java | 17 +-
.../ozone/container/common/impl/ContainerSet.java | 3 +-
.../container/common/impl/HddsDispatcher.java | 21 +-
.../common/interfaces/ContainerDispatcher.java | 10 +
.../ozone/container/common/interfaces/Handler.java | 5 +
.../common/statemachine/DatanodeStateMachine.java | 11 +-
.../common/statemachine/StateContext.java | 36 +-
.../DeleteContainerCommandHandler.java | 67 +-
.../ReconstructECContainersCommandHandler.java | 6 +-
.../ReplicateContainerCommandHandler.java | 3 +-
.../states/endpoint/HeartbeatEndpointTask.java | 7 +
.../common/transport/server/XceiverServerGrpc.java | 4 +-
.../server/ratis/ContainerStateMachine.java | 79 +-
.../common/transport/server/ratis/LocalStream.java | 58 +
.../transport/server/ratis/XceiverServerRatis.java | 43 +-
.../ECReconstructionCommandInfo.java | 28 +-
.../ECReconstructionCoordinator.java | 12 +
.../ECReconstructionCoordinatorTask.java | 29 +-
.../reconstruction/ECReconstructionSupervisor.java | 11 +-
.../ozone/container/keyvalue/KeyValueHandler.java | 52 +
.../container/keyvalue/TarContainerPacker.java | 34 +-
.../keyvalue/impl/ChunkManagerDispatcher.java | 16 +
.../keyvalue/impl/FilePerBlockStrategy.java | 20 +
.../keyvalue/impl/KeyValueStreamDataChannel.java | 277 ++
.../keyvalue/impl/StreamDataChannelBase.java | 96 +
.../keyvalue/interfaces/ChunkManager.java | 13 +
.../replication/ContainerReplicationSource.java | 5 +-
.../replication/CopyContainerCompression.java | 78 +
.../replication/GrpcReplicationClient.java | 20 +-
.../replication/GrpcReplicationService.java | 8 +-
.../OnDemandContainerReplicationSource.java | 19 +-
.../container/replication/ReplicationServer.java | 26 +-
.../replication/ReplicationSupervisor.java | 62 +-
.../replication/ReplicationSupervisorMetrics.java | 5 +-
.../container/replication/ReplicationTask.java | 34 +-
.../replication/SimpleContainerDownloader.java | 12 +-
.../hadoop/ozone/protocol/commands/SCMCommand.java | 35 +
.../container/common/TestDatanodeStateMachine.java | 8 +-
.../common/statemachine/TestStateContext.java | 85 +-
.../TestDeleteContainerCommandHandler.java | 135 +
.../states/endpoint/TestHeartbeatEndpointTask.java | 29 +-
.../TestVolumeIOStatsWithPrometheusSink.java | 2 +-
.../TestECReconstructionSupervisor.java | 96 +-
.../container/keyvalue/TestKeyValueContainer.java | 141 +-
.../container/keyvalue/TestTarContainerPacker.java | 37 +-
.../impl/TestKeyValueStreamDataChannel.java | 313 +++
.../ReplicationSupervisorScheduling.java | 10 +-
.../replication/TestReplicationSupervisor.java | 111 +-
.../upgrade/TestDatanodeUpgradeToSchemaV3.java | 4 +
.../upgrade/TestDatanodeUpgradeToScmHA.java | 2 +-
.../content/feature/Streaming-Write-Pipeline.md | 136 +
hadoop-hdds/docs/content/interface/Ofs.md | 32 +-
hadoop-hdds/docs/content/interface/S3.zh.md | 2 +-
hadoop-hdds/docs/content/security/SecuringTDE.md | 2 +-
hadoop-hdds/docs/content/security/SecurityAcls.md | 9 +-
.../docs/content/security/SecurityAcls.zh.md | 7 +-
.../docs/content/security/SecurityWithRanger.md | 2 +-
.../docs/content/security/SecurityWithRanger.zh.md | 2 +-
hadoop-hdds/docs/pom.xml | 4 +-
.../themes/ozonedoc/layouts/partials/header.html | 22 +
hadoop-hdds/erasurecode/pom.xml | 4 +-
.../framework/dev-support/findbugsExcludeFile.xml | 4 -
hadoop-hdds/framework/pom.xml | 4 +-
.../hdds/conf/DatanodeRatisServerConfig.java | 35 +
...inerLocationProtocolClientSideTranslatorPB.java | 20 +
.../hadoop/hdds/security/ssl/KeyStoresFactory.java | 14 +-
.../hdds/security/ssl/MonitoringTimerTask.java | 6 +-
.../security/ssl/PemFileBasedKeyStoresFactory.java | 15 +-
.../hdds/security/ssl/ReloadingX509KeyManager.java | 7 +-
.../security/ssl/ReloadingX509TrustManager.java | 9 +-
.../certificate/authority/DefaultCAServer.java | 108 +-
.../x509/certificate/client/CertificateClient.java | 13 +-
.../client/DefaultCertificateClient.java | 35 +
.../hadoop/hdds/security/x509/keys/KeyCodec.java | 4 +-
.../hdds/security/x509/keys/SecurityUtil.java | 34 +
.../FixedThreadPoolWithAffinityExecutor.java | 7 +-
.../hdds/server/events/SingleThreadExecutor.java | 6 +-
.../hadoop/hdds/server/http/BaseHttpServer.java | 2 +-
.../hdds/server/http/PrometheusMetricsSink.java | 109 +-
.../hdds/server/http/RatisDropwizardExports.java | 59 +-
.../hadoop/hdds/utils/DecayRpcSchedulerUtil.java | 120 +
.../org/apache/hadoop/hdds/utils/MetricsUtil.java | 100 +
.../hdds/utils/PrometheusMetricsSinkUtil.java | 116 +
.../apache/hadoop/hdds/utils/UgiMetricsUtil.java | 68 +
.../apache/hadoop/hdds/utils/db/RocksDatabase.java | 2 +-
.../ssl/TestPemFileBasedKeyStoresFactory.java | 9 +-
.../hdds/security/x509/CertificateClientTest.java | 17 +
.../certificate/authority/TestDefaultCAServer.java | 99 +-
....java => TestPrometheusMetricsIntegration.java} | 148 +-
.../hdds/utils/TestDecayRpcSchedulerUtil.java | 108 +
.../hdds/utils/TestPrometheusMetricsSinkUtil.java | 229 ++
.../hadoop/hdds/utils/TestUgiMetricsUtil.java | 63 +
hadoop-hdds/hadoop-dependency-client/pom.xml | 4 +-
hadoop-hdds/hadoop-dependency-server/pom.xml | 4 +-
hadoop-hdds/hadoop-dependency-test/pom.xml | 4 +-
hadoop-hdds/interface-admin/pom.xml | 4 +-
.../src/main/proto/ScmAdminProtocol.proto | 1 +
.../interface-admin/src/main/resources/proto.lock | 679 +++--
hadoop-hdds/interface-client/pom.xml | 4 +-
.../src/main/proto/DatanodeClientProtocol.proto | 14 +-
.../interface-client/src/main/resources/proto.lock | 991 ++++++--
hadoop-hdds/interface-server/pom.xml | 4 +-
.../proto/ScmServerDatanodeHeartbeatProtocol.proto | 4 +
.../interface-server/src/main/resources/proto.lock | 840 ++++--
hadoop-hdds/pom.xml | 4 +-
hadoop-hdds/server-scm/pom.xml | 4 +-
.../hadoop/hdds/scm/SCMCommonPlacementPolicy.java | 115 +-
.../hdds/scm/container/ContainerManager.java | 18 +
.../hdds/scm/container/ContainerManagerImpl.java | 21 +
.../balancer/AbstractFindTargetGreedy.java | 31 +-
.../scm/container/balancer/FindSourceGreedy.java | 20 +-
.../ContainerPlacementStatusDefault.java | 36 +-
.../algorithms/SCMContainerPlacementRackAware.java | 8 +
.../SCMContainerPlacementRackScatter.java | 138 +-
.../algorithms/SCMContainerPlacementRandom.java | 3 +-
.../AbstractOverReplicationHandler.java | 4 +-
.../replication/ContainerHealthResult.java | 35 +-
.../replication/ContainerReplicaPendingOps.java | 45 +
.../ContainerReplicaPendingOpsSubscriber.java} | 27 +-
.../replication/ECMisReplicationHandler.java | 71 +
.../replication/ECUnderReplicationHandler.java | 11 +
.../replication/MisReplicationHandler.java | 188 ++
.../replication/OverReplicatedProcessor.java | 94 +-
.../replication/RatisMisReplicationHandler.java | 78 +
.../replication/RatisOverReplicationHandler.java | 247 ++
.../replication/RatisUnderReplicationHandler.java | 242 ++
.../container/replication/ReplicationManager.java | 73 +-
.../container/replication/ReplicationQueue.java | 17 -
.../replication/UnderReplicatedProcessor.java | 95 +-
...sor.java => UnhealthyReplicationProcessor.java} | 79 +-
.../ClosedWithMismatchedReplicasHandler.java | 64 +-
.../health/ClosedWithUnhealthyReplicasHandler.java | 4 +-
.../health/ClosingContainerHandler.java | 7 +
.../health/DeletingContainerHandler.java | 5 +
.../health/ECReplicationCheckHandler.java | 18 +-
.../replication/health/EmptyContainerHandler.java | 6 +-
.../replication/health/OpenContainerHandler.java | 11 +-
.../health/QuasiClosedContainerHandler.java | 4 +
.../health/RatisReplicationCheckHandler.java | 14 +
.../hdds/scm/pipeline/PipelinePlacementPolicy.java | 28 +-
.../pipeline/PipelinePlacementPolicyFactory.java | 52 +
.../hdds/scm/pipeline/RatisPipelineProvider.java | 34 +-
...inerLocationProtocolServerSideTranslatorPB.java | 17 +
.../hdds/scm/server/SCMClientProtocolServer.java | 14 +
.../hdds/scm/server/SCMDatanodeProtocolServer.java | 41 +-
.../hdds/scm/server/StorageContainerManager.java | 34 +-
.../org/apache/hadoop/hdds/scm/HddsTestUtils.java | 32 +-
.../hdds/scm/TestSCMCommonPlacementPolicy.java | 275 +-
.../hadoop/hdds/scm/block/TestBlockManager.java | 6 +-
.../algorithms/TestContainerPlacementFactory.java | 13 +-
.../TestContainerPlacementStatusDefault.java | 22 +-
.../TestSCMContainerPlacementRackScatter.java | 96 +-
.../TestContainerReplicaPendingOps.java | 77 +
.../replication/TestECMisReplicationHandler.java | 174 ++
.../replication/TestECUnderReplicationHandler.java | 87 +
.../replication/TestMisReplicationHandler.java | 182 ++
.../TestRatisMisReplicationHandler.java | 166 ++
.../TestRatisOverReplicationHandler.java | 281 ++
.../TestRatisUnderReplicationHandler.java | 228 ++
.../replication/TestReplicationManager.java | 114 +
.../TestClosedWithMismatchedReplicasHandler.java | 16 +-
.../health/TestECReplicationCheckHandler.java | 6 +-
.../health/TestRatisReplicationCheckHandler.java | 5 +-
.../hdds/scm/node/TestContainerPlacement.java | 4 +-
.../scm/pipeline/TestPipelinePlacementFactory.java | 215 ++
.../scm/pipeline/TestPipelinePlacementPolicy.java | 15 +-
.../scm/pipeline/TestRatisPipelineProvider.java | 22 +-
.../safemode/TestHealthyPipelineSafeModeRule.java | 8 +-
.../hdds/scm/safemode/TestSCMSafeModeManager.java | 14 +-
.../ozone/container/common/TestEndPoint.java | 8 +
hadoop-hdds/test-utils/pom.xml | 5 +-
.../org/apache/ozone/test/GenericTestUtils.java | 10 +
hadoop-hdds/tools/pom.xml | 8 +-
.../hadoop/hdds/scm/cli/cert/CertCommands.java | 1 +
.../hadoop/hdds/scm/cli/cert/CleanExpired.java | 117 +
.../hadoop/hdds/scm/cli/cert/TestCleanExpired.java | 100 +
hadoop-ozone/client/pom.xml | 4 +-
.../apache/hadoop/ozone/client/OzoneBucket.java | 58 +
.../client/io/BlockDataStreamOutputEntry.java | 287 +++
.../client/io/BlockDataStreamOutputEntryPool.java | 290 +++
.../client/io/ECBlockOutputStreamEntryPool.java | 4 +-
.../hadoop/ozone/client/io/ECKeyOutputStream.java | 228 +-
.../ozone/client/io/KeyDataStreamOutput.java | 510 ++++
.../hadoop/ozone/client/io/KeyInputStream.java | 436 +---
.../ozone/client/io/OzoneCryptoInputStream.java | 9 +-
.../ozone/client/io/OzoneDataStreamOutput.java | 70 +
.../ozone/client/protocol/ClientProtocol.java | 38 +
.../apache/hadoop/ozone/client/rpc/RpcClient.java | 151 +-
.../hadoop/ozone/client/TestOzoneECClient.java | 51 +-
hadoop-ozone/common/pom.xml | 4 +-
.../hadoop/ozone/om/helpers/OmBucketArgs.java | 7 +-
.../hadoop/ozone/om/helpers/TestOmBucketArgs.java | 30 +
hadoop-ozone/csi/pom.xml | 4 +-
hadoop-ozone/datanode/pom.xml | 4 +-
hadoop-ozone/dev-support/checks/coverage.sh | 6 +-
hadoop-ozone/dev-support/intellij/ozone-site.xml | 20 +
.../intellij/runConfigurations/Datanode2.xml | 2 +-
.../intellij/runConfigurations/Datanode3.xml | 2 +-
hadoop-ozone/dist/pom.xml | 13 +-
.../main/compose/ozone-om-ha/docker-compose.yaml | 5 +
.../dist/src/main/compose/ozone/docker-config | 2 +
.../src/main/compose/ozonesecure/docker-config | 2 +
hadoop-ozone/dist/src/main/license/bin/LICENSE.txt | 160 +-
hadoop-ozone/dist/src/main/license/bin/NOTICE.txt | 2 +-
.../main/license/bin/licenses/LICENSE-angular.txt | 2 +-
.../src/main/license/bin/licenses/LICENSE-d3.txt | 2 +-
...{LICENSE-angular.txt => LICENSE-glyphicons.txt} | 4 +-
.../main/license/bin/licenses/LICENSE-guava.txt | 13 +
.../LICENSE-javax.activation-activation.txt | 3 -
.../LICENSE-net.sf.jopt-simple-jopt-simple.txt | 24 -
.../license/bin/licenses/LICENSE-org.aspectj.html | 91 -
.../license/bin/licenses/LICENSE-org.aspectj.txt | 279 ++
.../bin/licenses/LICENSE-org.ow2.asm-asm.txt | 1 -
.../license/bin/licenses/LICENSE-org.slf4j.txt | 2 +-
...y-misc.txt => NOTICE-ratis-thirdparty-misc.txt} | 24 +-
hadoop-ozone/dist/src/main/license/jar-report.txt | 1 +
.../main/license/src/licenses/LICENSE-angular.txt | 2 +-
.../licenses/LICENSE-bootstrap.txt} | 4 +-
.../src/main/license/src/licenses/LICENSE-d3.txt | 4 +-
.../licenses/LICENSE-glyphicons.txt} | 4 +-
.../main/license/src/licenses/LICENSE-guava.txt | 13 +
.../main/license/src/licenses/LICENSE-jquery.txt | 2 +-
.../src/main/license/src/licenses/LICENSE-nvd3.txt | 17 +-
.../dist/src/main/license/update-jar-report.sh | 2 +-
.../dist/src/main/smoketest/ozonefs/ozonefs.robot | 8 +
.../fault-injection-test/mini-chaos-tests/pom.xml | 4 +-
.../fault-injection-test/network-tests/pom.xml | 2 +-
hadoop-ozone/fault-injection-test/pom.xml | 4 +-
hadoop-ozone/httpfsgateway/pom.xml | 4 +-
hadoop-ozone/insight/pom.xml | 4 +-
hadoop-ozone/integration-test/pom.xml | 4 +-
.../ozone/TestDirectoryDeletingServiceWithFSO.java | 4 +-
.../hadoop/fs/ozone/TestOzoneFileSystem.java | 81 +-
.../fs/ozone/TestOzoneFileSystemWithStreaming.java | 158 ++
.../hadoop/fs/ozone/TestRootedOzoneFileSystem.java | 42 +-
.../hdds/scm/TestSCMDatanodeProtocolServer.java | 54 +
.../hdds/scm/storage/TestContainerCommandsEC.java | 4 +-
.../org/apache/hadoop/ozone/MiniOzoneCluster.java | 20 +
.../apache/hadoop/ozone/MiniOzoneClusterImpl.java | 21 +
.../apache/hadoop/ozone/TestMiniOzoneCluster.java | 4 +
.../hadoop/ozone/TestOzoneConfigurationFields.java | 3 +-
.../hadoop/ozone/TestStorageContainerManager.java | 2 +-
.../ozone/client/CertificateClientTestImpl.java | 136 +-
.../client/rpc/TestBlockDataStreamOutput.java | 273 ++
.../rpc/TestContainerStateMachineStream.java | 219 ++
.../ozone/client/rpc/TestECKeyOutputStream.java | 22 +-
.../client/rpc/TestOzoneAtRestEncryption.java | 6 +-
.../rpc/TestOzoneClientMultipartUploadWithFSO.java | 441 ++--
.../client/rpc/TestOzoneRpcClientAbstract.java | 101 +-
.../client/rpc/TestOzoneRpcClientWithRatis.java | 129 +
.../client/rpc/read/TestChunkInputStream.java | 6 +-
.../ozone/client/rpc/read/TestKeyInputStream.java | 2 +-
.../ozone/container/TestECContainerRecovery.java | 2 +
.../apache/hadoop/ozone/container/TestHelper.java | 42 +-
.../ozoneimpl/TestOzoneContainerWithTLS.java | 187 +-
.../server/TestSecureContainerServer.java | 4 +
.../apache/hadoop/ozone/om/TestKeyManagerImpl.java | 80 +-
.../org/apache/hadoop/ozone/om/TestLDBCli.java | 15 +
.../ozone/om/TestObjectStoreWithLegacyFS.java | 52 +-
.../org/apache/hadoop/ozone/om/TestOmAcls.java | 171 +-
.../org/apache/hadoop/ozone/om/TestOmMetrics.java | 13 +
.../ozone/parser/TestOzoneHARatisLogParser.java | 61 +-
.../apache/hadoop/ozone/recon/TestReconTasks.java | 36 +
.../hadoop/ozone/shell/TestOzoneShellHA.java | 22 +
hadoop-ozone/interface-client/pom.xml | 4 +-
.../interface-client/src/main/resources/proto.lock | 2672 ++++++++++++++++----
hadoop-ozone/interface-storage/pom.xml | 4 +-
.../apache/hadoop/ozone/om/OMMetadataManager.java | 10 +
hadoop-ozone/ozone-manager/pom.xml | 5 +-
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 72 +-
.../hadoop/ozone/om/OmMetadataManagerImpl.java | 5 +
.../org/apache/hadoop/ozone/om/OzoneManager.java | 109 +-
.../request/bucket/OMBucketSetPropertyRequest.java | 4 +
.../om/request/file/OMDirectoryCreateRequest.java | 10 +-
.../file/OMDirectoryCreateRequestWithFSO.java | 25 +-
.../ozone/om/request/file/OMFileCreateRequest.java | 8 +-
.../request/file/OMFileCreateRequestWithFSO.java | 3 +-
.../om/request/key/OMAllocateBlockRequest.java | 3 +-
.../key/OMDirectoriesPurgeRequestWithFSO.java | 9 +-
.../ozone/om/request/key/OMKeyCreateRequest.java | 19 +-
.../om/request/key/OMKeyCreateRequestWithFSO.java | 3 +-
.../hadoop/ozone/om/request/key/OMKeyRequest.java | 7 +-
.../S3InitiateMultipartUploadRequestWithFSO.java | 13 +-
.../S3MultipartUploadCommitPartRequest.java | 8 +-
.../S3MultipartUploadCompleteRequest.java | 3 +-
.../response/file/OMDirectoryCreateResponse.java | 9 +-
.../file/OMDirectoryCreateResponseWithFSO.java | 10 +-
.../response/file/OMFileCreateResponseWithFSO.java | 6 +
.../key/OMDirectoriesPurgeResponseWithFSO.java | 4 +-
.../ozone/om/response/key/OMKeyCreateResponse.java | 7 +
.../response/key/OMKeyDeleteResponseWithFSO.java | 4 +-
.../response/key/OMKeysDeleteResponseWithFSO.java | 4 +-
.../S3InitiateMultipartUploadResponseWithFSO.java | 12 +-
.../ozone/om/service/DirectoryDeletingService.java | 149 +-
.../webapps/ozoneManager/om-overview.html | 4 +
.../apache/hadoop/ozone/om/TestChunkStreams.java | 150 +-
.../ozone/om/request/OMRequestTestUtils.java | 12 +
.../bucket/TestOMBucketSetPropertyRequest.java | 88 +
.../request/file/TestOMDirectoryCreateRequest.java | 37 +
.../file/TestOMDirectoryCreateRequestWithFSO.java | 39 +
.../om/request/file/TestOMFileCreateRequest.java | 34 +-
.../file/TestOMFileCreateRequestWithFSO.java | 31 +
.../TestOMDirectoriesPurgeRequestAndResponse.java | 103 +-
.../om/request/key/TestOMKeyCreateRequest.java | 32 +
.../request/key/TestOMKeyCreateRequestWithFSO.java | 6 +
.../TestS3MultipartUploadCompleteRequest.java | 6 +-
...estS3MultipartUploadCompleteRequestWithFSO.java | 6 +
.../file/TestOMDirectoryCreateResponse.java | 19 +-
.../file/TestOMDirectoryCreateResponseWithFSO.java | 19 +-
.../key/TestOMKeysDeleteResponseWithFSO.java | 7 +-
.../s3/multipart/TestS3MultipartResponse.java | 12 +-
.../TestS3MultipartUploadAbortResponse.java | 3 +-
.../TestS3MultipartUploadAbortResponseWithFSO.java | 12 +-
hadoop-ozone/ozonefs-common/pom.xml | 8 +-
.../fs/ozone/BasicOzoneClientAdapterImpl.java | 27 +-
.../hadoop/fs/ozone/BasicOzoneFileSystem.java | 8 +
.../ozone/BasicRootedOzoneClientAdapterImpl.java | 36 +-
.../fs/ozone/BasicRootedOzoneFileSystem.java | 47 +-
.../apache/hadoop/fs/ozone/OzoneClientAdapter.java | 3 +
.../hadoop/fs/ozone/OzoneFSDataStreamOutput.java | 103 +
hadoop-ozone/ozonefs-hadoop2/pom.xml | 10 +-
.../hadoop/fs/ozone/RootedOzoneFileSystem.java | 20 +-
hadoop-ozone/ozonefs-hadoop3-client/pom.xml | 4 +-
hadoop-ozone/ozonefs-hadoop3/pom.xml | 4 +-
hadoop-ozone/ozonefs-shaded/pom.xml | 4 +-
hadoop-ozone/ozonefs/pom.xml | 4 +-
hadoop-ozone/pom.xml | 9 +-
hadoop-ozone/recon-codegen/pom.xml | 3 +-
hadoop-ozone/recon/pom.xml | 4 +-
.../hadoop/ozone/recon/ReconServerConfigKeys.java | 12 +
.../ozone/recon/api/ClusterStateEndpoint.java | 10 +-
.../ozone/recon/api/handlers/BucketHandler.java | 26 -
.../ozone/recon/api/handlers/FSOBucketHandler.java | 4 +-
.../ozone/recon/api/handlers/KeyEntityHandler.java | 3 +-
.../recon/api/handlers/LegacyBucketHandler.java | 4 +-
.../recon/api/handlers/RootEntityHandler.java | 24 +-
.../recon/api/types/ClusterStateResponse.java | 18 +
.../ozone/recon/fsck/ContainerHealthTask.java | 67 +-
.../hadoop/ozone/recon/scm/PipelineSyncTask.java | 33 +-
.../recon/scm/ReconDatanodeProtocolServer.java | 2 +-
.../ozone/recon/scm/ReconDeadNodeHandler.java | 12 +-
.../ozone/recon/scm/ReconPipelineManager.java | 4 +-
.../ozone/recon/scm/ReconStaleNodeHandler.java | 58 +
.../scm/ReconStorageContainerManagerFacade.java | 180 +-
.../recon/spi/StorageContainerServiceProvider.java | 21 +
.../impl/StorageContainerServiceProviderImpl.java | 15 +
.../resources/webapps/recon/ozone-recon-web/NOTICE | 5 -
.../webapps/recon/ozone-recon-web/api/db.json | 93 +-
.../recon/ozone-recon-web/src/utils/themeIcons.tsx | 6 +-
.../src/views/datanodes/datanodes.tsx | 10 +-
.../src/views/overview/overview.tsx | 13 +-
.../src/views/pipelines/pipelines.tsx | 2 +-
.../ozone/recon/OMMetadataManagerTestUtils.java | 4 +-
.../recon/api/TestNSSummaryEndpointWithFSO.java | 99 +-
.../recon/api/TestNSSummaryEndpointWithLegacy.java | 98 +-
.../recon/api/TestTotalOpenContainerCount.java | 396 +++
.../ozone/recon/fsck/TestContainerHealthTask.java | 11 +-
.../TestContainerHealthTaskRecordGenerator.java | 42 +-
.../scm/AbstractReconContainerManagerTest.java | 4 +-
hadoop-ozone/s3gateway/pom.xml | 5 +-
.../hadoop/ozone/client/ClientProtocolStub.java | 24 +
hadoop-ozone/tools/pom.xml | 4 +-
.../org/apache/hadoop/ozone/debug/DBScanner.java | 31 +-
.../ozone/debug/container/ExportSubcommand.java | 4 +-
.../ozone/freon/ClosedContainerReplicator.java | 14 +-
.../hadoop/ozone/freon/ContentGenerator.java | 18 +
.../ozone/freon/OzoneClientKeyGenerator.java | 29 +-
.../java/org/apache/hadoop/ozone/shell/Shell.java | 21 +-
.../ozone/shell/bucket/ClearQuotaHandler.java | 12 +-
.../hadoop/ozone/shell/bucket/SetQuotaHandler.java | 12 +-
.../hadoop/ozone/shell/keys/GetKeyHandler.java | 4 +-
.../hadoop/ozone/shell/keys/PutKeyHandler.java | 67 +-
.../ozone/shell/volume/ClearQuotaHandler.java | 12 +-
.../hadoop/ozone/shell/volume/SetQuotaHandler.java | 11 +-
pom.xml | 154 +-
420 files changed, 20102 insertions(+), 3973 deletions(-)
create mode 100644
hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/AbstractDataStreamOutput.java
create mode 100644
hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockDataStreamOutput.java
create mode 100644
hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/ByteBufferStreamOutput.java
rename
hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/io/MultipartCryptoKeyInputStream.java
=>
hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/MultipartInputStream.java
(63%)
copy
hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/{BlockExtendedInputStream.java
=> PartInputStream.java} (69%)
create mode 100644
hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/StreamBuffer.java
create mode 100644
hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/StreamCommitWatcher.java
create mode 100644
hadoop-hdds/common/src/test/java/org/apache/hadoop/ozone/audit/AuditLogTestUtils.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/transport/server/ratis/LocalStream.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/impl/KeyValueStreamDataChannel.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/impl/StreamDataChannelBase.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/replication/CopyContainerCompression.java
create mode 100644
hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/common/statemachine/commandhandler/TestDeleteContainerCommandHandler.java
create mode 100644
hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/keyvalue/impl/TestKeyValueStreamDataChannel.java
create mode 100644 hadoop-hdds/docs/content/feature/Streaming-Write-Pipeline.md
create mode 100644
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/DecayRpcSchedulerUtil.java
create mode 100644
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/MetricsUtil.java
create mode 100644
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/PrometheusMetricsSinkUtil.java
create mode 100644
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/UgiMetricsUtil.java
rename
hadoop-hdds/framework/src/test/java/org/apache/hadoop/hdds/server/http/{TestPrometheusMetricsSink.java
=> TestPrometheusMetricsIntegration.java} (55%)
create mode 100644
hadoop-hdds/framework/src/test/java/org/apache/hadoop/hdds/utils/TestDecayRpcSchedulerUtil.java
create mode 100644
hadoop-hdds/framework/src/test/java/org/apache/hadoop/hdds/utils/TestPrometheusMetricsSinkUtil.java
create mode 100644
hadoop-hdds/framework/src/test/java/org/apache/hadoop/hdds/utils/TestUgiMetricsUtil.java
copy
hadoop-hdds/{client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockExtendedInputStream.java
=>
server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/ContainerReplicaPendingOpsSubscriber.java}
(54%)
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/ECMisReplicationHandler.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/MisReplicationHandler.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/RatisMisReplicationHandler.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/RatisOverReplicationHandler.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/RatisUnderReplicationHandler.java
copy
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/{UnderReplicatedProcessor.java
=> UnhealthyReplicationProcessor.java} (52%)
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelinePlacementPolicyFactory.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/TestECMisReplicationHandler.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/TestMisReplicationHandler.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/TestRatisMisReplicationHandler.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/TestRatisOverReplicationHandler.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/TestRatisUnderReplicationHandler.java
create mode 100644
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/pipeline/TestPipelinePlacementFactory.java
create mode 100644
hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/cert/CleanExpired.java
create mode 100644
hadoop-hdds/tools/src/test/java/org/apache/hadoop/hdds/scm/cli/cert/TestCleanExpired.java
create mode 100644
hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/io/BlockDataStreamOutputEntry.java
create mode 100644
hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/io/BlockDataStreamOutputEntryPool.java
create mode 100644
hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/io/KeyDataStreamOutput.java
create mode 100644
hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/io/OzoneDataStreamOutput.java
copy hadoop-ozone/dist/src/main/license/bin/licenses/{LICENSE-angular.txt =>
LICENSE-glyphicons.txt} (93%)
create mode 100644
hadoop-ozone/dist/src/main/license/bin/licenses/LICENSE-guava.txt
delete mode 100644
hadoop-ozone/dist/src/main/license/bin/licenses/LICENSE-net.sf.jopt-simple-jopt-simple.txt
delete mode 100644
hadoop-ozone/dist/src/main/license/bin/licenses/LICENSE-org.aspectj.html
create mode 100644
hadoop-ozone/dist/src/main/license/bin/licenses/LICENSE-org.aspectj.txt
rename
hadoop-ozone/dist/src/main/license/bin/licenses/{NOTICE-ratis-thirtparty-misc.txt
=> NOTICE-ratis-thirdparty-misc.txt} (94%)
copy hadoop-ozone/dist/src/main/license/{bin/licenses/LICENSE-angular.txt =>
src/licenses/LICENSE-bootstrap.txt} (93%)
copy hadoop-ozone/dist/src/main/license/{bin/licenses/LICENSE-angular.txt =>
src/licenses/LICENSE-glyphicons.txt} (93%)
create mode 100644
hadoop-ozone/dist/src/main/license/src/licenses/LICENSE-guava.txt
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileSystemWithStreaming.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/hdds/scm/TestSCMDatanodeProtocolServer.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestBlockDataStreamOutput.java
create mode 100644
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestContainerStateMachineStream.java
create mode 100644
hadoop-ozone/ozonefs-common/src/main/java/org/apache/hadoop/fs/ozone/OzoneFSDataStreamOutput.java
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/scm/ReconStaleNodeHandler.java
delete mode 100644
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/NOTICE
create mode 100644
hadoop-ozone/recon/src/test/java/org/apache/hadoop/ozone/recon/api/TestTotalOpenContainerCount.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
