[
https://issues.apache.org/jira/browse/STORM-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved STORM-1680.
---------------------------------
Resolution: Fixed
Fix Version/s: 1.0.1
Thanks [~supermonk], I merged into master and 1.x-branch.
> Provide configuration to set min fetch size in KafkaSpout
> ---------------------------------------------------------
>
> Key: STORM-1680
> URL: https://issues.apache.org/jira/browse/STORM-1680
> Project: Apache Storm
> Issue Type: Improvement
> Components: storm-kafka, trident
> Reporter: Sachin Pasalkar
> Assignee: Narendra Bidari
> Fix For: 1.0.1
>
>
> Kafka consumer has provided the configuration to set minimum fetch size.
> However, storms kafka spout is not exposing these functionality. This is
> helpful in some case where someone writing data to hdfs & want file size of
> X.
> Below are changes needs to be done
> 1. In KafkaUtils class update fetchMessages API with below change
> FetchRequest fetchRequest = builder.addFetch(topic, partitionId, offset,
> config.fetchSizeBytes).clientId(config.clientId).maxWait(config.fetchMaxWait).minBytes(config.minFetchByte).build();
> 2. Update KafkaConfig class with instance variable as minFetchByte
> (Default value is 0 as mentioned in FetchRequestBuilder class)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
