A. Sophie Blee-Goldman created KAFKA-12740:
----------------------------------------------
Summary: 3. Resume processing from last-cleared processor after
soft crash
Key: KAFKA-12740
URL: https://issues.apache.org/jira/browse/KAFKA-12740
Project: Kafka
Issue Type: Sub-task
Components: streams
Reporter: A. Sophie Blee-Goldman
Building off of that, we can go one step further and avoid duplicate work
within the subtopology itself. Any time a record is partially processed through
a subtopology before hitting an error, all of the processors up to that point
will be applied again when the record is reprocessed. If we can keep track of
how far along the subtopology a record was processed, then we can start
reprocessing it from the last processor it had cleared before hitting an error.
This proposal is the most likely to benefit from letting a StreamThread recover
after an unexpected exception rather than letting it die and starting up a new
one, as we don’t need to worry about handing anything off from the dying thread
to its replacement.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
