[
https://issues.apache.org/jira/browse/PIG-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13842208#comment-13842208
]
Ashish Kaduskar commented on PIG-3614:
--------------------------------------
I just realized that sync interval can be set in later versions/latest version
of pig so closing this jira:
Here is the relevant code in PigAvroOutputFormat.java that does that :
// Do max as core-default.xml has io.file.buffer.size as 4K
writer.setSyncInterval(conf.getInt(SYNC_INTERVAL_KEY, Math.max(
conf.getInt("io.file.buffer.size", DEFAULT_SYNC_INTERVAL),
DEFAULT_SYNC_INTERVAL)));
> Set Avro sync interval in Pig scripts
> -------------------------------------
>
> Key: PIG-3614
> URL: https://issues.apache.org/jira/browse/PIG-3614
> Project: Pig
> Issue Type: Improvement
> Components: piggybank
> Reporter: Ashish Kaduskar
> Priority: Minor
>
> As part of AVRO-719 , Avro exposed sync interval configuration. However
> there is no way to set it in Pig scripts.
> Is it possible to allow setting Avro Sync Interval with following statement
> in Pig scripts?
> SET avro.mapred.sync.interval 1048576;
--
This message was sent by Atlassian JIRA
(v6.1#6144)
