[
https://issues.apache.org/jira/browse/HDDS-1569?focusedWorklogId=314945&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-314945
]
ASF GitHub Bot logged work on HDDS-1569:
----------------------------------------
Author: ASF GitHub Bot
Created on: 19/Sep/19 10:10
Start Date: 19/Sep/19 10:10
Worklog Time Spent: 10m
Work Description: hadoop-yetus commented on issue #1431: HDDS-1569
Support creating multiple pipelines with same datanode
URL: https://github.com/apache/hadoop/pull/1431#issuecomment-533063582
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
|:----:|----------:|--------:|:--------|
| 0 | reexec | 35 | Docker mode activated. |
||| _ Prechecks _ |
| +1 | dupname | 0 | No case conflicting files found. |
| +1 | @author | 0 | The patch does not contain any @author tags. |
| +1 | test4tests | 0 | The patch appears to include 3 new or modified test
files. |
||| _ HDDS-1564 Compile Tests _ |
| 0 | mvndep | 24 | Maven dependency ordering for branch |
| +1 | mvninstall | 608 | HDDS-1564 passed |
| +1 | compile | 399 | HDDS-1564 passed |
| +1 | checkstyle | 75 | HDDS-1564 passed |
| +1 | mvnsite | 0 | HDDS-1564 passed |
| +1 | shadedclient | 991 | branch has no errors when building and testing
our client artifacts. |
| +1 | javadoc | 177 | HDDS-1564 passed |
| 0 | spotbugs | 443 | Used deprecated FindBugs config; considering
switching to SpotBugs. |
| +1 | findbugs | 652 | HDDS-1564 passed |
||| _ Patch Compile Tests _ |
| 0 | mvndep | 31 | Maven dependency ordering for patch |
| +1 | mvninstall | 630 | the patch passed |
| +1 | compile | 424 | the patch passed |
| +1 | javac | 424 | the patch passed |
| +1 | checkstyle | 85 | the patch passed |
| +1 | mvnsite | 0 | the patch passed |
| +1 | whitespace | 0 | The patch has no whitespace issues. |
| +1 | shadedclient | 755 | patch has no errors when building and testing
our client artifacts. |
| +1 | javadoc | 187 | the patch passed |
| -1 | findbugs | 260 | hadoop-hdds generated 1 new + 0 unchanged - 0 fixed
= 1 total (was 0) |
||| _ Other Tests _ |
| +1 | unit | 310 | hadoop-hdds in the patch passed. |
| -1 | unit | 2026 | hadoop-ozone in the patch failed. |
| +1 | asflicense | 47 | The patch does not generate ASF License warnings. |
| | | 8347 | |
| Reason | Tests |
|-------:|:------|
| FindBugs | module:hadoop-hdds |
| | Dead store to dnDetails in
org.apache.hadoop.hdds.scm.safemode.HealthyPipelineSafeModeRule.process(SCMDatanodeHeartbeatDispatcher$PipelineReportFromDatanode)
At
HealthyPipelineSafeModeRule.java:org.apache.hadoop.hdds.scm.safemode.HealthyPipelineSafeModeRule.process(SCMDatanodeHeartbeatDispatcher$PipelineReportFromDatanode)
At HealthyPipelineSafeModeRule.java:[line 119] |
| Failed junit tests | hadoop.ozone.client.rpc.TestReadRetries |
| | hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis |
| | hadoop.hdds.scm.pipeline.TestSCMPipelineManager |
| | hadoop.ozone.client.rpc.TestBlockOutputStream |
| | hadoop.ozone.client.rpc.TestContainerStateMachineFailures |
| | hadoop.hdds.scm.pipeline.TestRatisPipelineProvider |
| | hadoop.hdds.scm.pipeline.TestSCMRestart |
| | hadoop.ozone.client.rpc.TestOzoneClientRetriesOnException |
| | hadoop.ozone.client.rpc.TestKeyInputStream |
| | hadoop.ozone.client.rpc.TestMultiBlockWritesWithDnFailures |
| | hadoop.ozone.client.rpc.TestSecureOzoneRpcClient |
| | hadoop.hdds.scm.pipeline.TestNodeFailure |
| | hadoop.hdds.scm.safemode.TestSCMSafeModeWithPipelineRules |
| | hadoop.ozone.client.rpc.TestOzoneRpcClient |
| | hadoop.ozone.ozShell.TestOzoneShell |
| | hadoop.ozone.client.rpc.Test2WayCommitInRatis |
| | hadoop.hdds.scm.pipeline.TestPipelineClose |
| | hadoop.ozone.client.rpc.TestHybridPipelineOnDatanode |
| | hadoop.ozone.client.rpc.TestCloseContainerHandlingByClient |
| | hadoop.hdds.scm.pipeline.TestRatisPipelineCreateAndDestroy |
| | hadoop.hdds.scm.pipeline.TestNode2PipelineMap |
| |
hadoop.ozone.container.common.statemachine.commandhandler.TestCloseContainerByPipeline
|
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | Client=19.03.1 Server=19.03.1 base:
https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/2/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hadoop/pull/1431 |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall
mvnsite unit shadedclient findbugs checkstyle |
| uname | Linux a3e22edef6ea 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22
16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/hadoop.sh |
| git revision | HDDS-1564 / 326b5ac |
| Default Java | 1.8.0_222 |
| findbugs |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/2/artifact/out/new-findbugs-hadoop-hdds.html
|
| unit |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/2/artifact/out/patch-unit-hadoop-ozone.txt
|
| Test Results |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/2/testReport/ |
| Max. process+thread count | 5341 (vs. ulimit of 5500) |
| modules | C: hadoop-hdds/server-scm hadoop-ozone/integration-test U: . |
| Console output |
https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/2/console |
| versions | git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1 |
| Powered by | Apache Yetus 0.10.0 http://yetus.apache.org |
This message was automatically generated.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 314945)
Time Spent: 0.5h (was: 20m)
> Add ability to SCM for creating multiple pipelines with same datanode
> ---------------------------------------------------------------------
>
> Key: HDDS-1569
> URL: https://issues.apache.org/jira/browse/HDDS-1569
> Project: Hadoop Distributed Data Store
> Issue Type: Sub-task
> Components: SCM
> Reporter: Siddharth Wagle
> Assignee: Li Cheng
> Priority: Major
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> - Refactor _RatisPipelineProvider.create()_ to be able to create pipelines
> with datanodes that are not a part of sufficient pipelines
> - Define soft and hard upper bounds for pipeline membership
> - Create SCMAllocationManager that can be leveraged to get a candidate set of
> datanodes based on placement policies
> - Add the datanodes to internal datastructures
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
