Yiqun Lin commented on HDFS-13098:

Hi, [~elgoiri], comments make sense to me.
{quote}In any case, the first version could prevent moving DNs out of the 
current subcluster.
I also agree with this.

>From previous comments, the DataNodes will firstly register in the Router, 
>then talk to NNs afterwards. I think here the Router will maintain the 
><DataNode, NameNode(SubCluster)> mapping, which will be used in DN's 
>restarting. Do we plan to persist this mapping info in the State Store?

> RBF: Datanodes interacting with Routers
> ---------------------------------------
>                 Key: HDFS-13098
>                 URL: https://issues.apache.org/jira/browse/HDFS-13098
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Íñigo Goiri
>            Priority: Major
> Datanodes talk to particular Namenodes. We could use the Router 
> infrastructure for the Datanodes to register/heartbeating into them and the 
> Routers would forward this to particular Namenodes. This would make the 
> assignment of Datanodes to subclusters potentially more dynamic.
> The implementation would potentially include:
> * Router to implement part of DatanodeProtocol
> * Forwarding DN messages into Routers
> * Policies to assign datanodes to subclusters
> * Datanodes to make blockpool configuration dynamic

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to