avijayanhwx edited a comment on issue #786: HDDS-1448 : RatisPipelineProvider should only consider open pipeline … URL: https://github.com/apache/hadoop/pull/786#issuecomment-488828795 We also have to add the pipelines in ALLOCATED state to the set of DNs being excluded. The reason is that the SCMPipelineManager initializes the set of pipelines from the pipeline store (RocksDB) in the ALLOCATED state. Hence, when the background pipeline creator gets the current pipeline list for creating pipelines pro-actively, if we fail to exclude these "ALLOCATED" pipelines which may soon transition to "OPEN", we can end up creating duplicate pipelines in the same DN ring. If the ALLOCATED state becomes OPEN, then it remains a NO-Op and if it transitions to CLOSED, the background pipeline will automatically start using the DNs in the next creation. cc @mukul1987 / @nandakumar131 / @arp7 Can you comment if the above makes sense?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
