[ 
https://issues.apache.org/jira/browse/PIG-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776681#comment-13776681
 ] 

Rohini Palaniswamy commented on PIG-3480:
-----------------------------------------

[~dvryaboy],
   We have been running it with pig.tmpfilecompression=true and 
pig.tmpfilecompression.codec=lzo as defaults from 2010 and have not encountered 
any issues so far. The problem might be elsewhere and TFile might not be the 
issue.
                
> TFile-based tmpfile compression crashes in some cases
> -----------------------------------------------------
>
>                 Key: PIG-3480
>                 URL: https://issues.apache.org/jira/browse/PIG-3480
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Dmitriy V. Ryaboy
>             Fix For: 0.12
>
>         Attachments: PIG-3480.patch
>
>
> When pig tmpfile compression is on, some jobs fail inside core hadoop 
> internals.
> Suspect TFile is the problem, because an experiment in replacing TFile with 
> SequenceFile succeeded.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to