[
https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542565#comment-17542565
]
Simbarashe Dzinamarira edited comment on HDFS-13522 at 5/26/22 4:45 PM:
------------------------------------------------------------------------
Hi [~zhengchenyu]. The feature can be disabled, either at the client or in the
routers themselves.
Clients can use the property *dfs.observer.read.enable.*
Routers can use disable this using the property
*dfs.federation.router.observer.read.enable.*
In RouterStateIdContext.java, the routers pass through the client's state ID to
the namenodes.
There is a config to set the auto-msync period:
*dfs.federation.router.observer.auto-msync-period*
The patch supports multiple nameservices. In the router, the conf above can be
overridden per nameservice with
*dfs.federation.router.observer.read.enable.EXAMPLENAMESERVICE.*
was (Author: simbadzina):
Hi [~zhengchenyu]. The feature can be disabled, either at the client or in the
routers themselves.
Clients can use the property *dfs.observer.read.enable.*
Routers can use disable this using the property
*dfs.federation.router.observer.read.enable.*
In RouterStateIdContext.java, the routers pass through the client's state ID to
the namenodes.
There is a config to set the auto-msync period:
*dfs.federation.router.observer.auto-msync-period*
The patch supports multiple nameservices. In the router, the conf above can be
overridden per nameservice with
*dfs.federation.router.observer.read.enable.EXAMPLENAMESERVICE.*
> RBF: Support observer node from Router-Based Federation
> -------------------------------------------------------
>
> Key: HDFS-13522
> URL: https://issues.apache.org/jira/browse/HDFS-13522
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: federation, namenode
> Reporter: Erik Krogen
> Assignee: Simbarashe Dzinamarira
> Priority: Major
> Labels: pull-request-available
> Attachments: HDFS-13522.001.patch, HDFS-13522.002.patch,
> HDFS-13522_WIP.patch, RBF_ Observer support.pdf, Router+Observer RPC
> clogging.png, ShortTerm-Routers+Observer.png
>
> Time Spent: 8h 10m
> Remaining Estimate: 0h
>
> Changes will need to occur to the router to support the new observer node.
> One such change will be to make the router understand the observer state,
> e.g. {{FederationNamenodeServiceState}}.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
