Andrew Or created SPARK-2296:
--------------------------------
Summary: Refactor util.JsonProtocol for evolvability
Key: SPARK-2296
URL: https://issues.apache.org/jira/browse/SPARK-2296
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.1.0
Reporter: Andrew Or
The current design is not very evolvable. For backwards compatibility, every
time we add a new field in one of the relevant objects (e.g. StageInfo) we need
to add a default value to the field. Otherwise, the test suite still passes,
but it throws some sort of obscure json exception if the field does not exist.
We should let a common interface (JsonSerializable) handle this logic, so we
don't need to do it for all classes.
--
This message was sent by Atlassian JIRA
(v6.2#6252)