[ https://issues.apache.org/jira/browse/HADOOP-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715141#action_12715141 ]
Philip Zeyliger commented on HADOOP-2914: ----------------------------------------- Thanks, Amareshwari. That's exactly what's going on, which means symlinks aren't working in LocalJobRunner, even after this patch. That seems like a fine first step. (Symlinks in local job runner might be tricky anyway --- LocalJobRunner doesn't cd to a working dir, so making symlinks might dirty up your current directory.) I hadn't seen that specific test before, but it passes. The failing tests are: {noformat} org.apache.hadoop.mapred.TestQueueCapacities.testMultipleQueues 0.0010 3 org.apache.hadoop.mapred.lib.TestCombineFileInputFormat.<init> {noformat} which are broken in trunk, I believe. > extend DistributedCache to work locally (LocalJobRunner) > -------------------------------------------------------- > > Key: HADOOP-2914 > URL: https://issues.apache.org/jira/browse/HADOOP-2914 > Project: Hadoop Core > Issue Type: Improvement > Components: mapred > Reporter: sam rash > Assignee: Philip Zeyliger > Priority: Minor > Attachments: HADOOP-2914-v1-full.patch, > HADOOP-2914-v1-since-4041.patch > > > The DistributedCache does not work locally when using the outlined recipe at > http://hadoop.apache.org/core/docs/r0.16.0/api/org/apache/hadoop/filecache/DistributedCache.html > > Ideally, LocalJobRunner would take care of populating the JobConf and copying > remote files to the local file sytem (http, assume hdfs = default fs = local > fs when doing local development. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.