[
https://issues.apache.org/jira/browse/PIG-4202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150938#comment-14150938
]
Rohini Palaniswamy commented on PIG-4202:
-----------------------------------------
Container reuse on task is fine and PigProcessor.close() cleanup is working as
expected. It is when the DAG container gets reused for the second DAG, that the
state setup by PigOutputCommitter.commitJob of previous DAG is not cleaned up.
[~bikassaha],
Do we have some API like ProcessorFrameworkInterface.close() on a plugin
that can be implemented for a DAG to cleanup any static state when it
terminates? I could not find any.
> UDFContext.isFrontend return true for OutputCommitter in local mode
> -------------------------------------------------------------------
>
> Key: PIG-4202
> URL: https://issues.apache.org/jira/browse/PIG-4202
> Project: Pig
> Issue Type: Bug
> Components: impl
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.14.0
>
> Attachments: PIG-4202-1.patch
>
>
> We switch to use UDFContext.isFrontend in PIG-4187. However, it does not work
> as expected in local mode. This causes some local mode test fail
> (TestOrcStoragePushdown.createInputData).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
