Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/17163
FWIW, if there is something related to serialization that people should be
pushing for in Hadoop 3, it is making all the little types serializable, such
as `Path`, `FileStatus` and the like; those little things that you discover you
can't use in closures because somebody forgot to mark them as `Serializable`.
Easily fixed, if someone provides the patches. As it is, they only tend to go
in when my code doesn't work, so coverage is limited to the classes I use
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
