[
https://issues.apache.org/jira/browse/TEZ-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jacob Tolar updated TEZ-3848:
-----------------------------
Attachment: TEZ-3848.1.patch
https://cwiki.apache.org/confluence/display/TEZ/How+to+Contribute+to+Tez says I
can send a PR but some past github PRs have been closed and asked for a patch.
So here's the patch, in case that's still the case.
> Tez Local mode doesn't localize distributed cache files
> -------------------------------------------------------
>
> Key: TEZ-3848
> URL: https://issues.apache.org/jira/browse/TEZ-3848
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Jacob Tolar
> Attachments: TEZ-3848.1.patch
>
>
> Tez doesn't symlink LocalResources into place in LocalContainerLauncher.
> In YARN mode, Yarn takes care of this when it launches the container. But in
> local mode, if you're depending on a file existing in the distributed cache,
> it's never symlinked into place (so you're out of luck).
> We test our pig scripts in local mode and have some tools to set up the
> distributed cache the same way it would work in production. This works fine
> in Mapreduce mode but are unable to use Pig + Tez local mode for testing due
> to this problem.
> I have a fix working and will submit a PR once I rebase it.
> [~jeagles] [[email protected]]
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
