Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/3119#discussion_r20829821
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -42,27 +43,37 @@ trait CompressionCodec {
def compressedOutputStream(s: OutputStream): OutputStream
def compressedInputStream(s: InputStream): InputStream
-}
+ def isAvailable() : Boolean = true
--- End diff --
This trait is exposed to adding a method here will actually break binary
compatibility with any user-defined compression codecs. We've usually tried not
to do this in the past unless we had a situation where there was no work
around, so what about just dealing with this directly inside the Snappy codec?
I.e. just check when the snappy codec is instantiated and throw this exception
if it's not available. It's slightly less general, but a simpler patch and we
don't risk breaking user-defined codecs.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
