[ https://issues.apache.org/jira/browse/HDFS-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352096#comment-16352096 ]
Yiqun Lin commented on HDFS-13098: ---------------------------------- Hi, [~elgoiri], comments make sense to me. {quote}In any case, the first version could prevent moving DNs out of the current subcluster. {quote} I also agree with this. >From previous comments, the DataNodes will firstly register in the Router, >then talk to NNs afterwards. I think here the Router will maintain the ><DataNode, NameNode(SubCluster)> mapping, which will be used in DN's >restarting. Do we plan to persist this mapping info in the State Store? > RBF: Datanodes interacting with Routers > --------------------------------------- > > Key: HDFS-13098 > URL: https://issues.apache.org/jira/browse/HDFS-13098 > Project: Hadoop HDFS > Issue Type: Sub-task > Reporter: Íñigo Goiri > Priority: Major > > Datanodes talk to particular Namenodes. We could use the Router > infrastructure for the Datanodes to register/heartbeating into them and the > Routers would forward this to particular Namenodes. This would make the > assignment of Datanodes to subclusters potentially more dynamic. > The implementation would potentially include: > * Router to implement part of DatanodeProtocol > * Forwarding DN messages into Routers > * Policies to assign datanodes to subclusters > * Datanodes to make blockpool configuration dynamic -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org