patchwork01 created PARQUET-2176:
------------------------------------
Summary: Parquet writers should allow for configurable
index/statistics truncation
Key: PARQUET-2176
URL: https://issues.apache.org/jira/browse/PARQUET-2176
Project: Parquet
Issue Type: Improvement
Components: parquet-mr
Affects Versions: 1.12.3
Reporter: patchwork01
ParquetWriter does not expose any way to set the properties for column index or
statistics truncation.
With ParquetOutputFormat those can be set with
parquet.columnindex.truncate.length and parquet.statistics.truncate.length.
These are not applied for ParquetWriter.
See also:
https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/README.md
--
This message was sent by Atlassian Jira
(v8.20.10#820010)