[
https://issues.apache.org/jira/browse/PIG-4202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151948#comment-14151948
]
Daniel Dai commented on PIG-4202:
---------------------------------
We do ask for a vertex level hook not a DAG level. Pig uses static variable and
we clean it up in AbstractLogicalIOProcessor.close. Now it seems
AbstractLogicalIOProcessor.close is not the right place. We can do clean up in
initialize(), we can also do a second cleanup in OutputCommitter, but the fact
there is no hook for such cleanup is not intuitive and other people will fall
into the same pitfall.
> UDFContext.isFrontend return true for OutputCommitter in local mode
> -------------------------------------------------------------------
>
> Key: PIG-4202
> URL: https://issues.apache.org/jira/browse/PIG-4202
> Project: Pig
> Issue Type: Bug
> Components: impl
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.14.0
>
> Attachments: PIG-4202-1.patch, PIG-4202-2.patch
>
>
> We switch to use UDFContext.isFrontend in PIG-4187. However, it does not work
> as expected in local mode. This causes some local mode test fail
> (TestOrcStoragePushdown.createInputData).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
