[jira] [Commented] (PARQUET-2176) Parquet writers should allow for configurable index/statistics truncation

2022-10-09 Thread ASF GitHub Bot (Jira) 


[ 
https://issues.apache.org/jira/browse/PARQUET-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614791#comment-17614791
 ] 

ASF GitHub Bot commented on PARQUET-2176:
-

shangxinli merged PR #989:
URL: https://github.com/apache/parquet-mr/pull/989




> Parquet writers should allow for configurable index/statistics truncation
> -
>
> Key: PARQUET-2176
> URL: https://issues.apache.org/jira/browse/PARQUET-2176
> Project: Parquet
>  Issue Type: Improvement
>  Components: parquet-mr
>Affects Versions: 1.12.3
>Reporter: patchwork01
>Priority: Major
>
> ParquetWriter does not expose any way to set the properties for column index 
> or statistics truncation.
> With ParquetOutputFormat those can be set with 
> parquet.columnindex.truncate.length and parquet.statistics.truncate.length. 
> These are not applied for ParquetWriter.
> These properties are documented here: 
> [https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/README.md]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[jira] [Commented] (PARQUET-2176) Parquet writers should allow for configurable index/statistics truncation

2022-09-26 Thread ASF GitHub Bot (Jira) 


[ 
https://issues.apache.org/jira/browse/PARQUET-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609799#comment-17609799
 ] 

ASF GitHub Bot commented on PARQUET-2176:
-

shangxinli commented on PR #989:
URL: https://github.com/apache/parquet-mr/pull/989#issuecomment-1258906980

   LGTM, Thanks for the contribution! 




> Parquet writers should allow for configurable index/statistics truncation
> -
>
> Key: PARQUET-2176
> URL: https://issues.apache.org/jira/browse/PARQUET-2176
> Project: Parquet
>  Issue Type: Improvement
>  Components: parquet-mr
>Affects Versions: 1.12.3
>Reporter: patchwork01
>Priority: Major
>
> ParquetWriter does not expose any way to set the properties for column index 
> or statistics truncation.
> With ParquetOutputFormat those can be set with 
> parquet.columnindex.truncate.length and parquet.statistics.truncate.length. 
> These are not applied for ParquetWriter.
> These properties are documented here: 
> [https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/README.md]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[jira] [Commented] (PARQUET-2176) Parquet writers should allow for configurable index/statistics truncation

2022-08-24 Thread ASF GitHub Bot (Jira) 


[ 
https://issues.apache.org/jira/browse/PARQUET-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17584199#comment-17584199
 ] 

ASF GitHub Bot commented on PARQUET-2176:
-

patchwork01 opened a new pull request, #989:
URL: https://github.com/apache/parquet-mr/pull/989

   Make sure you have checked _all_ steps below.
   
   ### Jira
   
   - [x] My PR addresses the following [Parquet 
Jira](https://issues.apache.org/jira/browse/PARQUET/) issues and references 
them in the PR title. For example, "PARQUET-1234: My Parquet PR"
 - https://issues.apache.org/jira/browse/PARQUET-2176
   
   ### Tests
   
   - [x] My PR adds the following unit tests __OR__ does not need testing for 
this extremely good reason:
 - Truncation for column index and statistics in 
`TestParquetWriterTruncation`
   
   ### Commits
   
   - [x] My commits all reference Jira issues in their subject lines. In 
addition, my commits follow the guidelines from "[How to write a good git 
commit message](http://chris.beams.io/posts/git-commit/)":
 1. Subject is separated from body by a blank line
 1. Subject is limited to 50 characters (not including Jira issue reference)
 1. Subject does not end with a period
 1. Subject uses the imperative mood ("add", not "adding")
 1. Body wraps at 72 characters
 1. Body explains "what" and "why", not "how"
   
   ### Documentation
   
   - [x] In case of new functionality, my PR adds documentation that describes 
how to use it.
 - All the public functions and the classes in the PR contain Javadoc that 
explain what it does
   




> Parquet writers should allow for configurable index/statistics truncation
> -
>
> Key: PARQUET-2176
> URL: https://issues.apache.org/jira/browse/PARQUET-2176
> Project: Parquet
>  Issue Type: Improvement
>  Components: parquet-mr
>Affects Versions: 1.12.3
>Reporter: patchwork01
>Priority: Major
>
> ParquetWriter does not expose any way to set the properties for column index 
> or statistics truncation.
> With ParquetOutputFormat those can be set with 
> parquet.columnindex.truncate.length and parquet.statistics.truncate.length. 
> These are not applied for ParquetWriter.
> See also: 
> https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/README.md



--
This message was sent by Atlassian Jira
(v8.20.10#820010)