L. C. Hsieh created SPARK-36679:
-----------------------------------
Summary: Remove lz4 hadoop wrapper classes after Hadoop 3.3.2
Key: SPARK-36679
URL: https://issues.apache.org/jira/browse/SPARK-36679
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.3.0
Reporter: L. C. Hsieh
Lz4-java as provided dependency is not correctly excluded from relocation in
Hadoop shaded client libraries in Hadoop 3.3.1. (HADOOP-17891)
In order to deal the issue without reverting back to non-shade client
libraries, we add a few Lz4 Hadoop wrapper classes `LZ4Factory`,
`LZ4Compressor`, and `LZ4SafeDecompressor`, under the package
`org.apache.hadoop.shaded.net.jpountz.lz4`.
We should remove these wrapper classes after Hadoop 3.3.2 release which should
include the fix.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
