[ https://issues.apache.org/jira/browse/STORM-2104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hugo Louro updated STORM-2104: ------------------------------ Component/s: (was: storm-kafka) storm-kafka-client > New Kafka spout crashes if partitions are reassigned while tuples are > in-flight > ------------------------------------------------------------------------------- > > Key: STORM-2104 > URL: https://issues.apache.org/jira/browse/STORM-2104 > Project: Apache Storm > Issue Type: Bug > Components: storm-kafka-client > Affects Versions: 2.0.0, 1.1.0 > Reporter: Stig Rohde Døssing > Assignee: Stig Rohde Døssing > Fix For: 2.0.0, 1.1.0, 1.0.4 > > Time Spent: 4h 20m > Remaining Estimate: 0h > > The new KafkaSpout may throw NPEs if partitions are reassigned while tuples > are in-flight. The ack function assumes that the spout instance is always > responsible for tuples it emitted, which isn't true if partitions were > reassigned since the tuple was emitted. The fail function also assumes that > failed tuples should be replayed, which is useless if the tuple is for a > partition the spout isn't assigned, since it then can't commit the tuple if > it succeeds. Both functions should check that the spout instance is > responsible for the incoming tuple before scheduling it for retry or adding > it to the acked list. -- This message was sent by Atlassian JIRA (v6.4.14#64029)