This is an automated email from the ASF dual-hosted git repository.
licheng pushed a change to branch HDDS-2823
in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git.
omit a3199cc Merge branch 'master' into HDDS-2823
omit 8791179 HDDS-3671. Introduce SCMStateMachineHandler marker interface.
(#1008)
omit 22c71c8 HDDS-3711. Handle inner classes in SCMRatisRequest and
SCMRatisResponse. (#1016)
omit bc68c48 HDDS-3693 Switch to new StateManager interface. (#1007)
omit c24a3ed HDDS-3196 New PipelineManager interface to persist to
RatisServer. (#980)
omit e1fc4a4 HDDS-3192. Handle AllocateContainer operation for HA. (#975)
omit 59a75b0 HDDS-3186. Introduce generic SCMRatisRequest and
SCMRatisResponse. (#959)
omit cbdae06 HDDS-3556 Refactor conf in SCMRatisServer to Java-based conf.
(#907)
omit a8ac3b2 Resolve conflicts with merge from master.
omit 4c035bb HDDS-3187 Construct SCM StateMachine. (#819)
omit 8c25beb HDDS-3185 Construct a standalone ratis server for SCM. (#720)
add 7982e32 HDDS-3710. Addendum: fix exclude pattern after HDDS-3627.
add a800811 HDDS-3562. Datanodes should send ICR when a container replica
deletion is successful. (#1000)
add 23ff99c HDDS-3732. Avoid UUID#toString call in
DatanodeDetails#getUuidString. (#1025)
add 2754e8c HDDS-3719. Datanode may fail to stop. (#1029)
add 3c8da50 Revert "HDDS-3710. Addendum: fix exclude pattern after
HDDS-3627."
add 322bcdd Revert "HDDS-3710. Merge archived jacoco coverage results
(#1014)"
add 69a7588 HDDS-3742. Improve OM performance with 5.29% by avoid
stream.collect (#1030)
add d57e151 HDDS-3668. OzoneManager start fails with RocksDB error on
downgrade to older version. (#982)
add baf8f81 HDDS-3734. Improve the performance of SCM with 3.86% by avoid
TreeSet.addAll (#1027)
add 67244e5 HDDS-3710. Merge archived jacoco coverage results (rebased
version). (#1014)
add e038587 HDDS-3708. fix typo in GDPR doc (#1040)
add 3328d7d HDDS-2720. Ozone Failure injection Service (#956)
add 51edc5a HDDS-3330. TestDeleteWithSlowFollower is still flaky. (#1026)
add 14b98ae HDDS-2564. Handle InterruptedException in
ContainerStateMachine (#1010)
add b0a1562 HDDS-3759. Avoid UUID#toString call in
PipelineID#getProtobuf. (#1042)
add cce41df HDDS-3564. Update Ozone to latest Ratis Snapshot
(0.6.0-3596a58-SNAPSHOT). (#911)
add 10b6470 HDDS-3644. Failed to delete chunk file due to chunk size
mismatch (#995)
add 9798cdb HDDS-3686. Insert an argument of ozone shell to accept jvm
arguments (#991)
add 38e7ca0 HDDS-2879. Update return description of
OzoneManager#openKey(OmKeyArgs args) (#898)
add 2ff6c89 HDDS-3682. Recon UI: Add interactive visualization for file
size counts (#1032)
new 95739ea HDDS-3185 Construct a standalone ratis server for SCM. (#720)
new 31c7386 HDDS-3187 Construct SCM StateMachine. (#819)
new 8f2107a Resolve conflicts with merge from master.
new aa2884c HDDS-3556 Refactor conf in SCMRatisServer to Java-based conf.
(#907)
new 1f3ef36 HDDS-3186. Introduce generic SCMRatisRequest and
SCMRatisResponse. (#959)
new 30e1751 HDDS-3192. Handle AllocateContainer operation for HA. (#975)
new c836720 HDDS-3196 New PipelineManager interface to persist to
RatisServer. (#980)
new 988b23a HDDS-3693 Switch to new StateManager interface. (#1007)
new 5355939 HDDS-3711. Handle inner classes in SCMRatisRequest and
SCMRatisResponse. (#1016)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a3199cc)
\
N -- N -- N refs/heads/HDDS-2823 (5355939)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 9 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/coverage-report.sh | 2 +-
.../hadoop/hdds/protocol/DatanodeDetails.java | 7 +-
.../hadoop/hdds/scm/pipeline/PipelineID.java | 6 +-
.../apache/hadoop/ozone/HddsDatanodeService.java | 18 +-
.../common/statemachine/DatanodeStateMachine.java | 4 +
.../common/statemachine/StateContext.java | 9 +-
.../server/ratis/ContainerStateMachine.java | 26 +-
.../container/keyvalue/KeyValueContainer.java | 3 +
.../ozone/container/keyvalue/KeyValueHandler.java | 2 +
.../keyvalue/impl/FilePerChunkStrategy.java | 28 +-
.../common/statemachine/TestStateContext.java | 69 +-
.../container/keyvalue/TestKeyValueHandler.java | 57 +
.../keyvalue/impl/TestFilePerChunkStrategy.java | 38 +
hadoop-hdds/docs/content/gdpr/_index.md | 2 +-
.../hdds/server/http/RatisDropwizardExports.java | 36 +
.../server/http/RatisNameRewriteSampleBuilder.java | 2 +-
.../org/apache/hadoop/hdds/utils/db/RDBStore.java | 36 +-
.../apache/hadoop/hdds/utils/db/TableConfig.java | 5 +
.../apache/hadoop/hdds/utils/db/TestRDBStore.java | 44 +
.../src/main/proto/DatanodeClientProtocol.proto | 1 +
.../interface-client/src/main/proto/proto.lock | 4 +
.../proto/ScmServerDatanodeHeartbeatProtocol.proto | 1 +
.../interface-server/src/main/proto/proto.lock | 4 +
.../container/AbstractContainerReportHandler.java | 50 +-
.../scm/container/ContainerStateManagerV2.java | 3 +-
.../IncrementalContainerReportHandler.java | 14 +-
.../hadoop/hdds/scm/ha/SCMHAInvocationHandler.java | 22 +-
.../apache/hadoop/hdds/scm/ha/SCMRatisServer.java | 3 +-
.../hadoop/hdds/scm/ha/SCMRatisServerImpl.java | 4 +-
.../apache/hadoop/hdds/scm/ha/SCMStateMachine.java | 7 +-
.../hadoop/hdds/scm/ha/SCMStateMachineHandler.java | 27 -
.../hadoop/hdds/scm/pipeline/StateManager.java | 3 +-
.../hdds/scm/server/SCMClientProtocolServer.java | 15 +-
.../TestIncrementalContainerReportHandler.java | 45 +
.../hadoop/hdds/scm/ha/MockSCMHAManager.java | 4 +-
.../hadoop/ozone/om/helpers/ServiceInfo.java | 19 +-
.../dist/src/shell/hdds/hadoop-functions.sh | 6 +
hadoop-ozone/dist/src/shell/ozone/ozone | 1 +
.../client/rpc/TestDeleteWithSlowFollower.java | 12 +-
.../ozone/om/TestOzoneManagerHAMetadataOnly.java | 5 +-
.../org/apache/hadoop/ozone/om/OzoneManager.java | 26 +-
.../protocolPB/OzoneManagerRequestHandler.java | 13 +-
.../webapps/recon/ozone-recon-web/LICENSE | 3335 ++++++++++++++++++--
.../webapps/recon/ozone-recon-web/api/db.json | 64 +-
.../webapps/recon/ozone-recon-web/api/routes.json | 3 +-
.../webapps/recon/ozone-recon-web/package.json | 8 +-
.../src/components/multiSelect/multiSelect.tsx | 123 +
.../src/components/navBar/navBar.tsx | 5 +
.../src/constants/breadcrumbs.constants.tsx | 3 +-
.../webapps/recon/ozone-recon-web/src/routes.tsx | 5 +
.../src/views/datanodes/datanodes.tsx | 22 +-
.../overview.less => insights/insights.less} | 21 +-
.../src/views/insights/insights.tsx | 279 ++
.../views/missingContainers/missingContainers.tsx | 10 +-
.../src/views/overview/overview.tsx | 8 +-
.../src/views/pipelines/pipelines.tsx | 9 +-
.../webapps/recon/ozone-recon-web/yarn.lock | 3253 ++++++++++++++++++-
pom.xml | 2 +-
tools/fault-injection-service/CMakeLists.txt | 114 +
.../FileSystem/cpp_unit/TestFailureInjector.cc | 175 +
.../FileSystem/cpp_unit/TestFilePathFailures.cc | 138 +
.../FileSystem/failure_injector.cc | 201 ++
.../FileSystem/failure_injector.h | 145 +
.../FileSystem/failure_injector_fs.cc | 912 ++++++
.../FileSystem/failure_injector_fs.h | 176 ++
tools/fault-injection-service/README.md | 56 +
.../Service/cpp/failure_injector_svc_client.cc | 209 ++
.../Service/cpp/failure_injector_svc_client.h | 51 +
.../Service/cpp/failure_injector_svc_server.cc | 93 +
.../Service/cpp/failure_injector_svc_server.h | 63 +
.../Service/cpp/run_grpc_service.cc | 58 +
.../Service/cpp/run_grpc_service.h | 36 +
.../Service/protos/failure_injection_service.proto | 68 +
73 files changed, 9837 insertions(+), 491 deletions(-)
delete mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/ha/SCMStateMachineHandler.java
create mode 100644
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/components/multiSelect/multiSelect.tsx
copy
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/views/{overview/overview.less
=> insights/insights.less} (76%)
create mode 100644
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/views/insights/insights.tsx
create mode 100644 tools/fault-injection-service/CMakeLists.txt
create mode 100644
tools/fault-injection-service/FileSystem/cpp_unit/TestFailureInjector.cc
create mode 100644
tools/fault-injection-service/FileSystem/cpp_unit/TestFilePathFailures.cc
create mode 100644 tools/fault-injection-service/FileSystem/failure_injector.cc
create mode 100644 tools/fault-injection-service/FileSystem/failure_injector.h
create mode 100644
tools/fault-injection-service/FileSystem/failure_injector_fs.cc
create mode 100644
tools/fault-injection-service/FileSystem/failure_injector_fs.h
create mode 100644 tools/fault-injection-service/README.md
create mode 100644
tools/fault-injection-service/Service/cpp/failure_injector_svc_client.cc
create mode 100644
tools/fault-injection-service/Service/cpp/failure_injector_svc_client.h
create mode 100644
tools/fault-injection-service/Service/cpp/failure_injector_svc_server.cc
create mode 100644
tools/fault-injection-service/Service/cpp/failure_injector_svc_server.h
create mode 100644
tools/fault-injection-service/Service/cpp/run_grpc_service.cc
create mode 100644 tools/fault-injection-service/Service/cpp/run_grpc_service.h
create mode 100644
tools/fault-injection-service/Service/protos/failure_injection_service.proto
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
