[
https://issues.apache.org/jira/browse/PIG-1257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12846027#action_12846027
]
Benjamin Reed commented on PIG-1257:
------------------------------------
excellent work pradeep. just one minor thing: you always append a \n before
inputData in your test case, so you never test the case when you end with just
\r
> PigStorage per the new load-store redesign should support splitting of bzip
> files
> ---------------------------------------------------------------------------------
>
> Key: PIG-1257
> URL: https://issues.apache.org/jira/browse/PIG-1257
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: Pradeep Kamath
> Assignee: Pradeep Kamath
> Fix For: 0.7.0
>
> Attachments: blockEndingInCR.txt.bz2,
> blockHeaderEndsAt136500.txt.bz2, PIG-1257-2.patch, PIG-1257-3.patch,
> PIG-1257.patch, recordLossblockHeaderEndsAt136500.txt.bz2
>
>
> PigStorage implemented per new load-store-redesign (PIG-966) is based on
> TextInputFormat for reading data. TextInputFormat has support for reading
> bzip data but without support for splitting bzip files. In pig 0.6, splitting
> was enabled for bzip files - we should attempt to enable that feature.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
