wenweijian created HADOOP-18788: ----------------------------------- Summary: Support LZ4 compressionLevel Key: HADOOP-18788 URL: https://issues.apache.org/jira/browse/HADOOP-18788 Project: Hadoop Common Issue Type: New Feature Components: common Reporter: wenweijian
The Hadoop's LZ4 compression codec now depends on lz4-java. There two type of compressor in lz4, `fastCompressor` and `highCompressor`. The default lz4 compressor in hadoop is fastCompressor, we also can use highCompressor by using config `IO_COMPRESSION_CODEC_LZ4_USELZ4HC_DEFAULT` When we want to use highCompressor in hadoop, we only can use the default compression level, which is level 9. while highCompressor in lz4-java supports compression level from 1 to 17. I think we can set a configuration to let users to choose different compresssionLevel for lz4 highCompressor. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org