squito commented on issue #25943: [WIP][SPARK-29261][SQL][CORE] Support recover 
live entities from KVStore for (SQL)AppStatusListener
URL: https://github.com/apache/spark/pull/25943#issuecomment-540197120
 
 
   Sorry I am getting caught up on a lot of stuff here -- how is this related 
to https://github.com/apache/spark/pull/25577 ? 
   
   They seem to be two different approaches to the same problem (though 
https://github.com/apache/spark/pull/25577 does a little bit more than just 
what is here).  Just for storing live entities, this approach seems more 
promising to me -- using Java serialization is really bad for compatibility, 
any changes to classes will break deserialization.  If we want the snapshot / 
checkpoint files to be able to entirely replace the event log files, we'll need 
the compatibility.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to