Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/5868#issuecomment-100753077
While working on some compression related stuff, I think that I might have
found a bug in LZO/LZFOutputStream or how we're using them. Take a look at
https://gist.github.com/JoshRosen/8463241e9cc092c79a75: it seems that these
output streams end up silently discarding input once it exceeds the block size.
I'd love it if someone could look over my gist to see if I'm somehow misusing
these streams.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]