[ 
https://issues.apache.org/jira/browse/HADOOP-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715141#action_12715141
 ] 

Philip Zeyliger commented on HADOOP-2914:
-----------------------------------------

Thanks, Amareshwari.  That's exactly what's going on, which means symlinks 
aren't working in LocalJobRunner, even after this patch.  That seems like a 
fine first step.  (Symlinks in local job runner might be tricky anyway --- 
LocalJobRunner doesn't cd to a working dir, so making symlinks might dirty up 
your current directory.)

I hadn't seen that specific test before, but it passes.

The failing tests are:
{noformat}
org.apache.hadoop.mapred.TestQueueCapacities.testMultipleQueues 0.0010  3
org.apache.hadoop.mapred.lib.TestCombineFileInputFormat.<init>
{noformat}
which are broken in trunk, I believe.

> extend DistributedCache to work locally (LocalJobRunner)
> --------------------------------------------------------
>
>                 Key: HADOOP-2914
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2914
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: sam rash
>            Assignee: Philip Zeyliger
>            Priority: Minor
>         Attachments: HADOOP-2914-v1-full.patch, 
> HADOOP-2914-v1-since-4041.patch
>
>
> The DistributedCache does not work locally when using the outlined recipe at 
> http://hadoop.apache.org/core/docs/r0.16.0/api/org/apache/hadoop/filecache/DistributedCache.html
>  
> Ideally, LocalJobRunner would take care of populating the JobConf and copying 
> remote files to the local file sytem (http, assume hdfs = default fs = local 
> fs when doing local development.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to