[
https://issues.apache.org/jira/browse/FLUME-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507849#comment-13507849
]
Roshan Naik commented on FLUME-1076:
------------------------------------
I see that the following sinks have their batch sizes at 100 ..
- Rolling File, HDFS, HBase, Async HBase, Null, Avro
The avro sink seems to be picking up its default in a relatively complicated
manner from RpcClientConfigurationConstants.DEFAULT_BATCH_SIZE inside
NettyAvroRpcClient.configure()
Following Sinks do not use batch size.. and its probably ok that way (they
operate as if batch size = 1).
- IRC, Logger
The following do not have any default although the documentation claims
otherwise :
- ElasticSearch
In ElasticSearch it defaults to 0. This appears to be a bug.
I dont see any other variation as such in the default batch sizes.
> SInk batch sizes vary wildy
> ---------------------------
>
> Key: FLUME-1076
> URL: https://issues.apache.org/jira/browse/FLUME-1076
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v1.1.0
> Reporter: Brock Noland
> Fix For: v1.4.0
>
> Attachments: FLUME-1076.patch
>
>
> AvroSink default batch size is 100
> HDFSEventSink default batch size is 1
> RollingFileSink has no configurable batch size
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
