Shadi A. Noghabi created SAMZA-889:
--------------------------------------
Summary: Change log not working properly with In memory Store
Key: SAMZA-889
URL: https://issues.apache.org/jira/browse/SAMZA-889
Project: Samza
Issue Type: Bug
Reporter: Shadi A. Noghabi
Changle log does not work correctly with InMemory store. If you kill a job and
start it again, it will not read from the beginning of the change log and
bootstrap the state. Instead it will read from the newest offset.
The reason for this bug is that the OFFSET file will be created even if the
RocksDB store is not used. When a job is restated it checks if an OFFSET file
exist, and if it does it will use those offsets as the offset to read from the
change log. However, for an InMemory store, the state has to be rebuilt form
the beginning since there is not snapshot on the disk, even though the OFFSET
file is there.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)