Authority-based lookup of proxy provider fails if path becomes canonicalized
----------------------------------------------------------------------------
Key: HDFS-2683
URL: https://issues.apache.org/jira/browse/HDFS-2683
Project: Hadoop HDFS
Issue Type: Sub-task
Components: ha, hdfs client
Affects Versions: HA branch (HDFS-1623)
Reporter: Todd Lipcon
Assignee: Todd Lipcon
Priority: Critical
When testing MapReduce on top of an HA cluster we ran into the following bug:
some uses of HDFS paths go through a canonicalization step which ensures that
the authority component in the URI includes a port number. So our
hdfs://logical-nn-uri/foo path turned into hdfs://logical-nn-uri:8020/foo. The
code which looks up the failover proxy provider then failed to find the
associated config. We should only compare the hostname portion of the URI when
looking up proxy providers.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira