[
https://issues.apache.org/jira/browse/STORM-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16286149#comment-16286149
]
Evan Rosebrook commented on STORM-2847:
---------------------------------------
[~Srdo] I Tried your branch and got an error. Apparently the partitions
provided to onPartitionsRevoked can be empty. I was able to resolve this by
adding " && partitions.size() > 0" to line 152.
Partitions revoked. [consumer-group=MyStormTopology,
consumer=org.apache.kafka.clients.consumer.KafkaConsumer@2ada06e4,
topic-partitions=[]]
2017-12-11 15:21:19.908 o.a.s.k.s.KafkaSpout Thread-34-uisspout-executor[703
703] [DEBUG] Offsets successfully committed to Kafka
[{uis-12=OffsetAndMetadata{offset=6606783674,
metadata='{topic-partition=uis-12, offset=6606783673, numFails=0,
thread='Thread-34-uisspout-executor[703 703]'}'},
uis-28=OffsetAndMetadata{offset=4262625500, metadata='{topic-partition=uis-28,
offset=4262625499, numFails=0, thread='Thread-34-uisspout-executor[703
703]'}'}, uis-44=OffsetAndMetadata{offset=4263152272,
metadata='{topic-partition=uis-44, offset=4263152271, numFails=0,
thread='Thread-34-uisspout-executor[703 703]'}'},
uis-60=OffsetAndMetadata{offset=3855749917, metadata='{topic-partition=uis-60,
offset=3855749916, numFails=0, thread='Thread-34-uisspout-executor[703
703]'}'}, uis-76=OffsetAndMetadata{offset=3196437627,
metadata='{topic-partition=uis-76, offset=3196437626, numFails=0,
thread='Thread-34-uisspout-executor[703 703]'}'},
uis-92=OffsetAndMetadata{offset=3209173441, metadata='{topic-partition=uis-92,
offset=3209173440, numFails=0, thread='Thread-34-uisspout-executor[703
703]'}'}}]
at
org.apache.storm.kafka.spout.KafkaSpout.commitOffsetsForAckedTuples(KafkaSpout.java:467)
~[stormjar.jar:local]
at
org.apache.storm.kafka.spout.KafkaSpout.access$400(KafkaSpout.java:59)
~[stormjar.jar:local]
at
org.apache.storm.kafka.spout.KafkaSpout$KafkaSpoutConsumerRebalanceListener.onPartitionsRevoked(KafkaSpout.java:154)
~[stormjar.jar:local]
at
org.apache.storm.kafka.spout.KafkaSpout.subscribeKafkaConsumer(KafkaSpout.java:564)
~[stormjar.jar:local]
at
org.apache.storm.kafka.spout.KafkaSpout.activate(KafkaSpout.java:555)
~[stormjar.jar:local]
at
org.apache.storm.kafka.spout.KafkaSpout.commitOffsetsForAckedTuples(KafkaSpout.java:467)
~[stormjar.jar:local]
at
org.apache.storm.kafka.spout.KafkaSpout.access$400(KafkaSpout.java:59)
~[stormjar.jar:local]
at
org.apache.storm.kafka.spout.KafkaSpout$KafkaSpoutConsumerRebalanceListener.onPartitionsRevoked(KafkaSpout.java:154)
~[stormjar.jar:local]
at
org.apache.storm.kafka.spout.KafkaSpout.subscribeKafkaConsumer(KafkaSpout.java:564)
~[stormjar.jar:local]
at
org.apache.storm.kafka.spout.KafkaSpout.activate(KafkaSpout.java:555)
~[stormjar.jar:local]
> Exception thrown after rebalance IllegalArgumentException
> ---------------------------------------------------------
>
> Key: STORM-2847
> URL: https://issues.apache.org/jira/browse/STORM-2847
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-kafka-client
> Affects Versions: 2.0.0, 1.2.0
> Reporter: Evan Rosebrook
> Assignee: Stig Rohde Døssing
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> After rebalance the storm-kafka-client spout attempts to check the current
> position of partitions that are no longer assigned to the current spout. This
> occurs in a topology with multiple spout instances.
> java.lang.IllegalArgumentException: You can only check the position for
> partitions assigned to this consumer. at
> org.apache.kafka.clients.consumer.KafkaConsumer.position(KafkaConsumer.java:1262)
> at
> org.apache.storm.kafka.spout.KafkaSpout.commitOffsetsForAckedTuples(KafkaSpout.java:473)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
