[
https://issues.apache.org/jira/browse/MAPREDUCE-5263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13673530#comment-13673530
]
Zhijie Shen commented on MAPREDUCE-5263:
----------------------------------------
bq. Could you elaborate more on "not significantly"? Do you know that code in
0.23 doesn't call this method, for example?
It seems that the common way in MR2 is to call JobContext#getArchiveTimestamps
and JobContext#getFileTimestamps, which are not changed. JobContextImpl makes
use of DistributedCache#getArchiveTimestamps and JobContext#getFileTimestamps,
and converts longs to strings.
bq. We were under the impression that the mapred APIs were paramount to 1.x
binary compatibility, but since this is not going to be the case for the
mapreduce APIs that the 0.23 mapreduce APIs would be preserved. Is that no
longer the case?
It's still the case. It needs to be clarified here that the code changes are
ultimately for org.apache.hadoop.filecache.DistributedCache, though they are
within org.apache.hadoop.mapreduce.filecache.DistributedCache. The former class
extends the latter one in MR2, and was used in MR1.
> filecache.DistributedCache incompatiblity issues with MR1
> ---------------------------------------------------------
>
> Key: MAPREDUCE-5263
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5263
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Reporter: Zhijie Shen
> Assignee: Zhijie Shen
> Fix For: 2.1.0-beta
>
> Attachments: MAPREDUCE-5263.1.patch, MAPREDUCE-5263.2.patch,
> MAPREDUCE-5263.3.patch, MAPREDUCE-5263.4.patch
>
>
> A couple of methods and variables have been removed:
> void addLocalArchives(Configuration, String)
> void addLocalFiles(Configuration, String)
> void createAllSymlink(Configuration, File, File)
> FileStatus getFileStatus(Configuration, URI)
> long getTimestamp(Configuration, URI)
> void setArchiveTimestamps(Configuration, String)
> void setFileTimestamps(Configuration, String)
> void setLocalArchives(Configuration, String)
> void setLocalFiles(Configuration, String)
> String CACHE_ARCHIVES
> String CACHE_ARCHIVES_SIZES
> String CACHE_ARCHIVES_TIMESTAMPS
> String CACHE_FILES
> String CACHE_FILES_SIZES
> String CACHE_FILES_TIMESTAMPS
> String CACHE_LOCALARCHIVES
> String CACHE_LOCALFILES
> String CACHE_SYMLINK
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
