Github user massie commented on the pull request:
https://github.com/apache/spark/pull/6423#issuecomment-106952818
I rebased this work on ToT and added a new commit that uses an InputStream
decorator to ensure that the buffer is released on `close()`. The code is a lot
more cleaner with that change. However, I'm sure that one test will fail:
`test("release current unexhausted buffer in case the task completes early") `
in `ShuffleBlockFetcherIteratorSuite`.
I'll update this PR to fix this test soon (next Monday). I wanted to give
you a look at what I was doing early for comment.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
