tanvipenumudy commented on PR #5391: URL: https://github.com/apache/ozone/pull/5391#issuecomment-1778794851
Summarizing the discussion points with @ChenSammi: - The SCM network topology schema file is used only once when SCM starts for building the static information required by NetworkTopology in memory. - However, obtaining this information alone from SCM does not provide a complete solution for shifting sortDatanodes logic to OM. - Another aspect to consider is that the NetworkTopology's [clusterTree](https://github.com/apache/ozone/blob/master/hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/net/NetworkTopologyImpl.java#L68-L70) can dynamically change when a new DN is [registered](https://github.com/apache/ozone/blob/master/hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/SCMNodeManager.java#L397) with SCM or when a DN is [removed](https://github.com/apache/ozone/blob/master/hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/DeadNodeHandler.java#L101) (dead). - This information can be served to OM similarly by introducing a new SCM API - caching and periodically refreshing the clusterTree in case of updates. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
