[
https://issues.apache.org/jira/browse/PIG-4649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14658752#comment-14658752
]
Rohini Palaniswamy commented on PIG-4649:
-----------------------------------------
bq. We can remove this once HIVE-11456 is fully fixed, right?
We can keep the setting, but change default to none. If there are other
custom storefuncs which do not handle it in OutputCommitter well, it will be an
option to turn of for that StoreFunc instead of turning off the optimizer all
together.
> [Pig on Tez] Union followed by HCatStorer misses some data
> ----------------------------------------------------------
>
> Key: PIG-4649
> URL: https://issues.apache.org/jira/browse/PIG-4649
> Project: Pig
> Issue Type: Bug
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.16.0, 0.15.1
>
> Attachments: PIG-4649-1.patch
>
>
> Script to reproduce:
> {code}
> A = LOAD 'data01.txt' USING PigStorage() as (id:chararray, message:chararray);
> B = LOAD 'data02.txt' USING PigStorage() as (id:chararray, message:chararray);
> C = UNION A, B;
> STORE C INTO 'db.table1' USING org.apache.hive.hcatalog.pig.HCatStorer();
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
