[
https://issues.apache.org/jira/browse/MAPREDUCE-6121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ray Chiang updated MAPREDUCE-6121:
----------------------------------
Description:
Looking at the JobSubmitter.compareFs it doesn't look like it properly handles
HA namespaces. The code tries to lookup the hostname using
InetAddress.getByName, but if you are using namespaces this is going to fail
and its going to copy the file when it doesn't need to.
Edit: JobSubmitter was updated to JobResourceUpdater in MAPREDUCE-6267.
was:Looking at the JobSubmitter.compareFs it doesn't look like it properly
handles HA namespaces. The code tries to lookup the hostname using
InetAddress.getByName, but if you are using namespaces this is going to fail
and its going to copy the file when it doesn't need to.
Summary: JobResourceUpdater#compareFs() doesn't handle HA namespaces
(was: JobSubmitter.compareFs doesn't handle HA namespaces)
> JobResourceUpdater#compareFs() doesn't handle HA namespaces
> -----------------------------------------------------------
>
> Key: MAPREDUCE-6121
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6121
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.5.0
> Reporter: Thomas Graves
> Assignee: Ray Chiang
> Attachments: MAPREDUCE-6121.001.patch, MAPREDUCE-6121.002.patch
>
>
> Looking at the JobSubmitter.compareFs it doesn't look like it properly
> handles HA namespaces. The code tries to lookup the hostname using
> InetAddress.getByName, but if you are using namespaces this is going to fail
> and its going to copy the file when it doesn't need to.
> Edit: JobSubmitter was updated to JobResourceUpdater in MAPREDUCE-6267.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
