Github user mridulm commented on the pull request:
https://github.com/apache/spark/pull/1609#issuecomment-50306633
@witgo I did not understand the space issue : stylecheck seems to run fine.
Regarding the actual issues : the JIRA lists some of them - unfortunately
it is not exhaustive.
Spark code assumes a few things :
1) A flush followed by close should not cause additional data to be written
to the stream - which is not valid in general case (close can still write more
data).
2) reading an object from stream will consume all data written as part of
the object - which is not valid in general case, additional info could have
been written after the object was written (like reset markers in java serde).
So stream wrapping has to account for that.
3)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
