[
https://issues.apache.org/jira/browse/HDFS-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Clampffer updated HDFS-10441:
-----------------------------------
Attachment: HDFS-10441.HDFS-8707.005.patch
New patch:
-can take a nameservice in FileSystem::Connect
-got rid of distinct enum for server exception types
-prepend hdfs:// to namenode authorities to use URI class
-fix bug in default option: max retries defaults to -1, would get cast to
uint64_t and get stuck doing retries
-rename FmtURI method
-added status strings to some error messages, still a few more to go
-follow the <some method>_locked naming convention
-read HA options from config and use them in the retry policy
-support for connection timeout during connection to a HA node: default to
immediate failover
Outstanding work:
-still need to move stuff out of the hdfs_configuration class
-get rid of duplicate data structures in options (services, ha_enabled_,
ha_namenodes_) and just keep Options::services. This one is trickier than it
sounds; to do it right we either need to resolve endpoints for the HA namenodes
in filesystem, or pass the namenode/nameservices down to the RPC engine and do
DNS lookup there (instead of twice). It spans enough of the code that I spend
a good amount of time resolving merge conflicts so I'd like to do these changes
in another JIRA if others thing that is acceptable. A proper refactor of this
will fix a few issues:
1) better looking code
2) full support for multiple HA clusters
3) get rid of extra level of DNS lookup
-still some minor cleanup
> libhdfs++: HA namenode support
> ------------------------------
>
> Key: HDFS-10441
> URL: https://issues.apache.org/jira/browse/HDFS-10441
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: hdfs-client
> Reporter: James Clampffer
> Assignee: James Clampffer
> Attachments: HDFS-10441.HDFS-8707.000.patch,
> HDFS-10441.HDFS-8707.002.patch, HDFS-10441.HDFS-8707.003.patch,
> HDFS-10441.HDFS-8707.004.patch, HDFS-10441.HDFS-8707.005.patch,
> HDFS-8707.HDFS-10441.001.patch
>
>
> If a cluster is HA enabled then do proper failover.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
