Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21070
@scottcarey, Parquet will use the compressors if they are available. You
can add them from an external Jar and it will work. LZ4 should also work out of
the box because it is included in Hadoop 2.7.
I agree that it would be nice if Parquet didn't rely on Hadoop for
compression libraries, but that's how it is at the moment. Feel free to fix it.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
