Github user marmbrus commented on the pull request:
https://github.com/apache/spark/pull/233#issuecomment-38755014
Okay, I looked into this. Part of it is #142 again... ugh. I bumped that
PR so we can hopefully get it in and have more helpful error messages in the
future. The other problem is that Scala maps are not serializable as they
don't have a no arg constructor. To alleviate this I added a custom serializer
in #243 that handles Maps as Arrays and then converts them back on the other
side. Not super efficient, but we are going to write out own serializer soon
enough.
After those are in, I think this PR will pass tests and be good to go.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
