[ 
https://issues.apache.org/jira/browse/HDDS-1448?focusedWorklogId=236555&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-236555
 ]

ASF GitHub Bot logged work on HDDS-1448:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 02/May/19 20:57
            Start Date: 02/May/19 20:57
    Worklog Time Spent: 10m 
      Work Description: avijayanhwx commented on issue #786: HDDS-1448 : 
RatisPipelineProvider should only consider open pipeline …
URL: https://github.com/apache/hadoop/pull/786#issuecomment-488828795
 
 
   We also have to add the pipelines in ALLOCATED state to the set of DNs being 
excluded. The reason is that the SCMPipelineManager initializes the set of 
pipelines from the pipeline store (RocksDB) in the ALLOCATED state. Hence, when 
the background pipeline creator gets the current pipeline list for creating 
pipelines pro-actively, if we fail to exclude these "ALLOCATED" pipelines which 
may soon transition to "OPEN", we can end up creating duplicate pipelines in 
the same DN ring. 
   
   If the ALLOCATED state becomes OPEN, then it remains a NO-Op and if it 
transitions to CLOSED, the background pipeline will automatically start using 
the DNs in the next creation. 
   
   cc @mukul1987 / @nandakumar131 / @arp7 Can you comment if the above makes 
sense? 
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


Issue Time Tracking
-------------------

    Worklog Id:     (was: 236555)
    Time Spent: 50m  (was: 40m)

> RatisPipelineProvider should only consider open pipeline while excluding dn 
> for pipeline allocation
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HDDS-1448
>                 URL: https://issues.apache.org/jira/browse/HDDS-1448
>             Project: Hadoop Distributed Data Store
>          Issue Type: Bug
>          Components: SCM
>    Affects Versions: 0.3.0
>            Reporter: Mukul Kumar Singh
>            Assignee: Aravindan Vijayan
>            Priority: Major
>              Labels: MiniOzoneChaosCluster, pull-request-available
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> While allocation pipelines, Ratis pipeline provider considers all the 
> pipelines irrespective of the state of the pipeline. This can lead to case 
> where all the datanodes are up but the pipelines are in closing state in SCM.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to