Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/11805#issuecomment-202671868
Alright, this should now be ready for an initial review pass. I just pushed
a somewhat hacky patch to work around the direct buffer allocation limit
(42d0356) and added a few simple tests. I also addressed the potential leak of
direct memory in cases where partially serialized blocks' iterators aren't
fully consumed.
I'm sure that this probably needs a bit more work and I'll do more
self-review tomorrow once I've had time to set this aside for a bit.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
