Stig Rohde Døssing created STORM-2184:
-----------------------------------------

             Summary: New Kafka spout may fail to commit offsets on shutdown if 
polling thread is not blocked in poll when KafkaConsumer.wakeup is called
                 Key: STORM-2184
                 URL: https://issues.apache.org/jira/browse/STORM-2184
             Project: Apache Storm
          Issue Type: Bug
            Reporter: Stig Rohde Døssing
            Assignee: Stig Rohde Døssing
            Priority: Trivial


If a thread is blocking in one of a number of calls to KafkaConsumer and wakeup 
is called, the thread will throw WakeupException. If there is no such thread, 
the next call to one of the blocking methods will throw WakeupException instead.

The spout currently calls wakeup, then attempts to commit offsets to Kafka when 
shutting down. If there was no other thread to wake up (e.g. the async loop 
thread was doing something other than hanging in KakfaConsumer.poll), the call 
to KafkaConsumer.commitSync from the closing thread will throw WakeupException.

The thread running KafkaSpout.close shouldn't be interrupting itself, and 
should ignore WakeupExceptions when committing offsets.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to