[ 
https://issues.apache.org/jira/browse/PIG-4202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14148420#comment-14148420
 ] 

Daniel Dai commented on PIG-4202:
---------------------------------

The change is made to fix Orc_3. It seems OutputCommitter still get stale 
UDFContext even we clean it up in PigProcessor.close:
{code}
Caused by: java.lang.NullPointerException
        at 
org.apache.pig.impl.util.orc.OrcUtils.createObjectInspector(OrcUtils.java:645)
        at 
org.apache.pig.builtin.OrcStorage.setStoreLocation(OrcStorage.java:240)
        at 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.setLocation(PigOutputFormat.java:169)
        at 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputCommitter.setUpContext(PigOutputCommitter.java:116)
        at 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputCommitter.getCommitters(PigOutputCommitter.java:90)
        at 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputCommitter.<init>(PigOutputCommitter.java:71)
        at 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getOutputCommitter(PigOutputFormat.java:292)
        at 
org.apache.tez.mapreduce.committer.MROutputCommitter.getOutputCommitter(MROutputCommitter.java:136)
{code}

> UDFContext.isFrontend return true for OutputCommitter in local mode
> -------------------------------------------------------------------
>
>                 Key: PIG-4202
>                 URL: https://issues.apache.org/jira/browse/PIG-4202
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.14.0
>
>         Attachments: PIG-4202-1.patch
>
>
> We switch to use UDFContext.isFrontend in PIG-4187. However, it does not work 
> as expected in local mode. This causes some local mode test fail 
> (TestOrcStoragePushdown.createInputData).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to