Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/10368#issuecomment-167673871
As @zsxwing pointed out, the existing unit tests are not sufficient because
they didn't catch the fact that `ShuffleReadMetrics` et al must also be
registered. This is because these fields are options. In the future, people are
free to add more options fields and it will be hard for reviewers to maintain
this additional requirement of registering it with Kryo.
Given this the suggestion is to close this issue for now. Eventually when
we get rid of closure serializer altogether (SPARK-12414) we can just replace
this one with Java serializer, and add a huge comment why it can't be Kryo.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
