[
https://issues.apache.org/jira/browse/STORM-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283832#comment-16283832
]
Evan Rosebrook commented on STORM-2847:
---------------------------------------
[~Srdo] Here is the requested info:
kafka-clients: 0.10.2.0
kafka-broker: 0.10.1.0
val retryService = new KafkaSpoutRetryExponentialBackoff(
KafkaSpoutRetryExponentialBackoff.TimeInterval.microSeconds(500),
KafkaSpoutRetryExponentialBackoff.TimeInterval.milliSeconds(2),
10,
KafkaSpoutRetryExponentialBackoff.TimeInterval.seconds(10))
val recordTranslator = new CustomRecordTranslator(topics,
SerializableFactories.getDeserializer)
new KafkaSpoutConfig.Builder(hosts, classOf[CustomDeserializer],
classOf[CustomDeserializer], topics)
.setGroupId(consumerGroup)
.setRetry(retryService)
.setRecordTranslator(recordTranslator)
.setProp(ConsumerConfig.FETCH_MAX_WAIT_MS_CONFIG, 10000)
.setProp(ConsumerConfig.ENABLE_AUTO_COMMIT_CONFIG, "false")
.setProp(ConsumerConfig.RECEIVE_BUFFER_CONFIG, 1048576)
.setOffsetCommitPeriodMs(500)
.build()
> Exception thrown after rebalance IllegalArgumentException
> ---------------------------------------------------------
>
> Key: STORM-2847
> URL: https://issues.apache.org/jira/browse/STORM-2847
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-kafka-client
> Affects Versions: 1.2.0
> Reporter: Evan Rosebrook
> Assignee: Stig Rohde Døssing
>
> After rebalance the storm-kafka-client spout attempts to check the current
> position of partitions that are no longer assigned to the current spout. This
> occurs in a topology with multiple spout instances.
> java.lang.IllegalArgumentException: You can only check the position for
> partitions assigned to this consumer. at
> org.apache.kafka.clients.consumer.KafkaConsumer.position(KafkaConsumer.java:1262)
> at
> org.apache.storm.kafka.spout.KafkaSpout.commitOffsetsForAckedTuples(KafkaSpout.java:473)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
