Stig Rohde Døssing created STORM-2104:

             Summary: New Kafka spout crashes if partitions are reassigned 
while tuples are in-flight
                 Key: STORM-2104
             Project: Apache Storm
          Issue Type: Bug
          Components: storm-kafka
    Affects Versions: 2.0.0, 1.1.0
            Reporter: Stig Rohde Døssing
            Assignee: Stig Rohde Døssing

The new KafkaSpout may throw NPEs if partitions are reassigned while tuples are 
in-flight. The ack function assumes that the spout instance is always 
responsible for tuples it emitted, which isn't true if partitions were 
reassigned since the tuple was emitted. The fail function also assumes that 
failed tuples should be replayed, which is useless if the tuple is for a 
partition the spout isn't assigned, since it then can't commit the tuple if it 
succeeds. Both functions should check that the spout instance is responsible 
for the incoming tuple before scheduling it for retry or adding it to the acked 

This message was sent by Atlassian JIRA

Reply via email to