Saisai Shao created SPARK-5998:
----------------------------------
Summary: Make Spark Streaming checkpoint version compatible
Key: SPARK-5998
URL: https://issues.apache.org/jira/browse/SPARK-5998
Project: Spark
Issue Type: Improvement
Components: Streaming
Affects Versions: 1.3.0
Reporter: Saisai Shao
Currently Spark Streaming's checkpointing(serialization) mechanism is version
mutable, if the code is updated or any changes happened. The old checkpointing
files cannot be read again. To keep the long-running and upgradability of
streaming App, making the checkpointing mechanism version compatible is meaning.
Here creating a JIRA as stub of this issue, I'm currently working on this, a
design doc will be posted later.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
