Github user mridulm commented on the pull request:
https://github.com/apache/spark/pull/397#issuecomment-40284529
There are two issues here:
a) If we are going to override and deprecate/throw exception for every
method which is not exposed by OutputStream - while overriding functionality
for most others in ByteArrayOutputStream : then I dont see the value in
extending BOAS.
b) More importantly, we do not get to control how array growth happens,
what the thresholds are, etc. For example, relying on Integer.MAX_VALUE always
is not the best option - we would need to have that configurable, to control
what the maximum block size in spark can be per ByteBuffer : this has perf
implications in terms of mmap'ing files, reading/writing to other
ByteBuffers/sockets, etc.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
