Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/7410#issuecomment-128515729
Hey all, this is a pretty good PR. Unfortunately, I havent been able to
spend cycles on this as I was busy with higher priority PRs. The Java data
being serialized in python does add some overheads, and introduces some data
structures, that we need to think a bit. So I think I am going to bump this to
Spark 1.6. But this is important feature for python parity so we are definitely
going to have this in 1.6.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
