This is an automated email from the ASF dual-hosted git repository.
gabor pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/parquet-mr.git
The following commit(s) were added to refs/heads/master by this push:
new a3a1ad4 PARQUET-2044: Enable ZSTD buffer pool by default (#903)
a3a1ad4 is described below
commit a3a1ad4e58518a469970b45ccef2fb64695c1894
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Tue May 11 01:39:39 2021 -0700
PARQUET-2044: Enable ZSTD buffer pool by default (#903)
This PR aims to enable ZSTD buffer pool by default to improve the
performance.
The default value of config and documentation is updated.
---
parquet-hadoop/README.md | 2 +-
.../src/main/java/org/apache/parquet/hadoop/codec/ZstandardCodec.java | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/parquet-hadoop/README.md b/parquet-hadoop/README.md
index e40c93c..b0c3443 100644
--- a/parquet-hadoop/README.md
+++ b/parquet-hadoop/README.md
@@ -340,7 +340,7 @@ ParquetInputFormat to materialize records. It should be a
the descendant class o
**Property:** `parquet.compression.codec.zstd.bufferPool.enabled`
**Description:** If it is true,
[RecyclingBufferPool](https://github.com/luben/zstd-jni/blob/master/src/main/java/com/github/luben/zstd/RecyclingBufferPool.java)
is used.
-**Default value:** `false`
+**Default value:** `true`
---
diff --git
a/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/codec/ZstandardCodec.java
b/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/codec/ZstandardCodec.java
index 73908da..fe4804a 100644
---
a/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/codec/ZstandardCodec.java
+++
b/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/codec/ZstandardCodec.java
@@ -47,7 +47,7 @@ import java.io.OutputStream;
public class ZstandardCodec implements Configurable, CompressionCodec {
public final static String PARQUET_COMPRESS_ZSTD_BUFFERPOOL_ENABLED =
"parquet.compression.codec.zstd.bufferPool.enabled";
- public final static boolean DEFAULT_PARQUET_COMPRESS_ZSTD_BUFFERPOOL_ENABLED
= false;
+ public final static boolean DEFAULT_PARQUET_COMPRESS_ZSTD_BUFFERPOOL_ENABLED
= true;
public final static String PARQUET_COMPRESS_ZSTD_LEVEL =
"parquet.compression.codec.zstd.level";
public final static int DEFAULT_PARQUET_COMPRESS_ZSTD_LEVEL = 3;
public final static String PARQUET_COMPRESS_ZSTD_WORKERS =
"parquet.compression.codec.zstd.workers";