[ 
https://issues.apache.org/jira/browse/TEZ-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192398#comment-16192398
 ] 

ASF GitHub Bot commented on TEZ-3848:
-------------------------------------

Github user jacobtolar commented on the issue:

    https://github.com/apache/tez/pull/20
  
    This was merged in b875eb1f2e0a56d4b9c01127b40d81983e9be896


> Tez Local mode doesn't localize distributed cache files
> -------------------------------------------------------
>
>                 Key: TEZ-3848
>                 URL: https://issues.apache.org/jira/browse/TEZ-3848
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Jacob Tolar
>            Assignee: Jacob Tolar
>             Fix For: 0.9.1
>
>         Attachments: TEZ-3848.1.patch
>
>
> Tez doesn't symlink LocalResources into place in LocalContainerLauncher.
> In YARN mode, Yarn takes care of this when it launches the container. But in 
> local mode, if you're depending on a file existing in the distributed cache, 
> it's never symlinked into place (so you're out of luck).
> We test our pig scripts in local mode and have some tools to set up the 
> distributed cache the same way it would work in production. This works fine 
> in Mapreduce mode but are unable to use Pig + Tez local mode for testing due 
> to this problem.
> I have a fix working and will submit a PR once I rebase it.
> [~jeagles] [[email protected]]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to