[
https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830075#comment-16830075
]
Surendra Singh Lilhore commented on HDFS-13522:
-----------------------------------------------
Thank you all for discussion.
I tried observer read in router and attached initial patch for this. Patch do
following things
# Store observer state in state store.
# Keep the last transaction id for all the namespace in memory.
# Send the write direct to active NN.
# For read first do the msync() and send read call to observer NN.
# Added two property to support observer read in Router, a)
*dfs.federation.router.observer.read.enable*, b)
*dfs.federation.router.observer.auto-msync-period*.
# Now in client side no change is required.
This is initial patch, others can give their suggestion to improve this.
> Support observer node from Router-Based Federation
> --------------------------------------------------
>
> Key: HDFS-13522
> URL: https://issues.apache.org/jira/browse/HDFS-13522
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: federation, namenode
> Reporter: Erik Krogen
> Assignee: Chao Sun
> Priority: Major
> Attachments: HDFS-13522.001.patch
>
>
> Changes will need to occur to the router to support the new observer node.
> One such change will be to make the router understand the observer state,
> e.g. {{FederationNamenodeServiceState}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
