Job submission should fail if same uri is added for mapred.cache.files and
mapred.cache.archives
------------------------------------------------------------------------------------------------
Key: MAPREDUCE-1641
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1641
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: distributed-cache
Reporter: Amareshwari Sriramadasu
Fix For: 0.22.0
The behavior of mapred.cache.files and mapred.cache.archives is different
during localization in the following way:
If a jar file is added to mapred.cache.files, it will be localized under
TaskTracker under a unique path.
If a jar file is added to mapred.cache.archives, it will be localized under a
unique path in a directory named the jar file name, and will be unarchived
under the same directory.
If same jar file is passed for both the configurations, the behavior undefined.
Thus the job submission should fail.
Currently, since distributed cache processes files before archives, the jar
file will be just localized and not unarchived.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
