[
https://issues.apache.org/jira/browse/PIG-4011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14038247#comment-14038247
]
Daniel Dai commented on PIG-4011:
---------------------------------
This is because pigContext.getScriptFiles() also goes to job.jar. That's also
cause problem for tez, we won't be able to reuse session if the script files
are different.
> Pig should not put PigContext in job.jar to help jar dedup
> ----------------------------------------------------------
>
> Key: PIG-4011
> URL: https://issues.apache.org/jira/browse/PIG-4011
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.13.0
> Reporter: Aniket Mokashi
> Fix For: 0.14.0
>
>
> Job jars are largely identical from job to job (just the pig classes and
> their dependencies). However, there is pigContext in the job jar, and that
> seems to change from job to job.As a result, the job jars are basically
> uncacheable in the shared cache. It would be great if we can find a way to
> separate the pig context and store it in the distributed cache separate from
> the (stable) job jar. That would give us a better chance to store the job jar.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
