Github user rxin commented on the pull request:
https://github.com/apache/spark/pull/7592#issuecomment-124398910
@davies this is ok, but what I had in mind was pretty different. What I had
in mind was to create a version of the join operator, that could take more
advantage of what unsafe provides. There are still quite a bit of conversions
involved right now. HashRelation is also limiting you, due to the shared
variable across multiple threads.
I think we will need to create a new join operator soon anyway, in order to
avoid the join row conversion.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
