igalshilman opened a new pull request #168: URL: https://github.com/apache/flink-statefun/pull/168
This PR allows creating and restoring from savepoints that contain elements in the feedback log, taken as of this PR and moving forward. Restoring from savepoints taken prior to this PR (with elements in the feedback log) requires a followup work. This PR changes the on the wire checkpoint format for the feedback log. For each key group written to the raw keyed stream (empty or not), we now write the following header: `<statefun version: int><statefun magic header: int>` We start with the version 0 and a magic header that is a constant random number. Writing the version and the magic header are made for safety and format evolution. The version number `0` is carefully chosen as a workaround to FLINK-19692. This is because the InternalTimerManager reads that first 0 (that we wrote as a version) and it will not try to read anything else from the stream. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org