[
https://issues.apache.org/jira/browse/HADOOP-6365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Wittenauer resolved HADOOP-6365.
--------------------------------------
Resolution: Fixed
This looks fixed.
> distributed cache doesn't work with HDFS and another file system
> ----------------------------------------------------------------
>
> Key: HADOOP-6365
> URL: https://issues.apache.org/jira/browse/HADOOP-6365
> Project: Hadoop Common
> Issue Type: Bug
> Components: filecache
> Affects Versions: 0.20.1
> Environment: CentOS
> Reporter: Marc Colosimo
> Original Estimate: 0.5h
> Remaining Estimate: 0.5h
>
> This is a continuation of http://issues.apache.org/jira/browse/HADOOP-5635
> (JIRA wouldn't let me edit that one). I found another issue with
> DistributedCache using something besides HDFS. In my case I have TWO active
> file systems, with HDFS being the default file system.
> My fix includes two additional changes (from HADOOP-5635) to get it to work
> with another filesystem scheme (plus the changes from the original patch).
> I've tested this an it works with my code on HDFS with another filesystem. I
> have similar changes to mapreduce.filecacheTaskDistributedCacheManager and
> TrackerDistributedCacheManager (0.22.0).
> Basically, URI.getPath() is called instead of URI.toString(). toString
> returns the scheme plus path which is important in finding the file to copy
> (getting the file system). Otherwise it searches the default file system (in
> this case HDFS) for the file.
--
This message was sent by Atlassian JIRA
(v6.2#6252)