simbadzina opened a new pull request, #5298: URL: https://github.com/apache/hadoop/pull/5298
HDFS-16890: Ensures router periodically refreshes its record of a namespace's state. ### Description of PR When using the ObserverReadProxyProvider, clients can set dfs.client.failover.observer.auto-msync-period... to periodically get the Active namenode's state. When using routers without the ObserverReadProxyProvider, this periodic update is lost. In a busy cluster, the Router constantly gets updated with the active namenode's state when There is a write operation. There is an operation (read/write) from a new clients. However, in the scenario when there are no new clients and no write operations, the state kept in the router can lag behind the active's. The router does update its state with responses from the Observer, but the observer may be lagging behind too. We should have a periodic refresh in the router to serve a similar role as dfs.client.failover.observer.auto-msync-period ### How was this patch tested? New test case. TestObserverWithRouter#testPeriodicStateRefreshUsingActiveNamenode() ### For code changes: - [ X] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
