[
https://issues.apache.org/jira/browse/PIG-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13818378#comment-13818378
]
Cheolsoo Park commented on PIG-3505:
------------------------------------
+1.
> Make AvroStorage sync interval take default from io.file.buffer.size
> ---------------------------------------------------------------------
>
> Key: PIG-3505
> URL: https://issues.apache.org/jira/browse/PIG-3505
> Project: Pig
> Issue Type: Improvement
> Affects Versions: 0.11
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.13.0
>
> Attachments: PIG-3505-1.patch
>
>
> The default sync interval is 16K which is very bad for bzip compression
> which can take bigger chunk of data for compression. Hadoop's Bzip2code uses
> io.file.buffer.size as the buffer size. Most tuned environments have it set
> to 128K which gives better compression.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
