Writing min/max for rowgroup to Parquet

HI All, I am writing parquet files but when I read metadata using parquet-tools I don’t see any min/max for any type of variables. Is there any specific configuration that needs to be turned on for the same. Regards, Piyush

[jira] [Commented] (PARQUET-2069) Parquet file containing arrays, written by Parquet-MR, cannot be read again by Parquet-MR

[ https://issues.apache.org/jira/browse/PARQUET-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522406#comment-17522406 ] Timothy Miller commented on PARQUET-2069: - I found a fix for the problem. This is going to look

[jira] [Commented] (PARQUET-2069) Parquet file containing arrays, written by Parquet-MR, cannot be read again by Parquet-MR

[ https://issues.apache.org/jira/browse/PARQUET-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522405#comment-17522405 ] ASF GitHub Bot commented on PARQUET-2069: - theosib-amazon opened a new pull request, #957: URL:

[GitHub] [parquet-mr] theosib-amazon opened a new pull request, #957: PARQUET-2069: Allow list and array record types to be compatible.

theosib-amazon opened a new pull request, #957: URL: https://github.com/apache/parquet-mr/pull/957 This PR addresses the following JIRA entry: https://issues.apache.org/jira/browse/PARQUET-2069 ParquetMR breaks compatibility with itself by including a JSON representation of a

[jira] [Commented] (PARQUET-2136) File writer construction with encryptor

[ https://issues.apache.org/jira/browse/PARQUET-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522404#comment-17522404 ] ASF GitHub Bot commented on PARQUET-2136: - shangxinli merged PR #954: URL:

[jira] [Commented] (PARQUET-2136) File writer construction with encryptor

[ https://issues.apache.org/jira/browse/PARQUET-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522403#comment-17522403 ] ASF GitHub Bot commented on PARQUET-2136: - shangxinli commented on PR #954: URL:

[GitHub] [parquet-mr] shangxinli merged pull request #954: PARQUET-2136: File writer construction with encryptor

shangxinli merged PR #954: URL: https://github.com/apache/parquet-mr/pull/954 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [parquet-mr] shangxinli commented on pull request #954: PARQUET-2136: File writer construction with encryptor

shangxinli commented on PR #954: URL: https://github.com/apache/parquet-mr/pull/954#issuecomment-1099348386 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (PARQUET-2136) File writer construction with encryptor

[ https://issues.apache.org/jira/browse/PARQUET-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522402#comment-17522402 ] ASF GitHub Bot commented on PARQUET-2136: - shangxinli commented on code in PR #954: URL:

[GitHub] [parquet-mr] shangxinli commented on a diff in pull request #954: PARQUET-2136: File writer construction with encryptor

shangxinli commented on code in PR #954: URL: https://github.com/apache/parquet-mr/pull/954#discussion_r850595178 ## parquet-hadoop/src/main/java/org/apache/parquet/hadoop/ParquetFileWriter.java: ## @@ -336,20 +354,30 @@ public ParquetFileWriter(OutputFile file, MessageType

[jira] [Commented] (PARQUET-2136) File writer construction with encryptor

[ https://issues.apache.org/jira/browse/PARQUET-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522383#comment-17522383 ] ASF GitHub Bot commented on PARQUET-2136: - ggershinsky commented on code in PR #954: URL:

[GitHub] [parquet-mr] ggershinsky commented on a diff in pull request #954: PARQUET-2136: File writer construction with encryptor

ggershinsky commented on code in PR #954: URL: https://github.com/apache/parquet-mr/pull/954#discussion_r850561540 ## parquet-hadoop/src/main/java/org/apache/parquet/hadoop/ParquetFileWriter.java: ## @@ -336,20 +354,30 @@ public ParquetFileWriter(OutputFile file, MessageType

[jira] [Commented] (PARQUET-2136) File writer construction with encryptor

[ https://issues.apache.org/jira/browse/PARQUET-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522379#comment-17522379 ] ASF GitHub Bot commented on PARQUET-2136: - shangxinli commented on code in PR #954: URL:

[jira] [Commented] (PARQUET-2136) File writer construction with encryptor

[ https://issues.apache.org/jira/browse/PARQUET-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522378#comment-17522378 ] ASF GitHub Bot commented on PARQUET-2136: - shangxinli commented on code in PR #954: URL:

[GitHub] [parquet-mr] shangxinli commented on a diff in pull request #954: PARQUET-2136: File writer construction with encryptor

shangxinli commented on code in PR #954: URL: https://github.com/apache/parquet-mr/pull/954#discussion_r850550025 ## parquet-hadoop/src/main/java/org/apache/parquet/hadoop/ParquetFileWriter.java: ## @@ -336,20 +354,30 @@ public ParquetFileWriter(OutputFile file, MessageType

[GitHub] [parquet-mr] shangxinli commented on a diff in pull request #954: PARQUET-2136: File writer construction with encryptor

shangxinli commented on code in PR #954: URL: https://github.com/apache/parquet-mr/pull/954#discussion_r850550025 ## parquet-hadoop/src/main/java/org/apache/parquet/hadoop/ParquetFileWriter.java: ## @@ -336,20 +354,30 @@ public ParquetFileWriter(OutputFile file, MessageType

[jira] [Commented] (PARQUET-2136) File writer construction with encryptor

[ https://issues.apache.org/jira/browse/PARQUET-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522375#comment-17522375 ] ASF GitHub Bot commented on PARQUET-2136: - ggershinsky commented on code in PR #954: URL:

[GitHub] [parquet-mr] ggershinsky commented on a diff in pull request #954: PARQUET-2136: File writer construction with encryptor

ggershinsky commented on code in PR #954: URL: https://github.com/apache/parquet-mr/pull/954#discussion_r850543188 ## parquet-hadoop/src/main/java/org/apache/parquet/hadoop/ParquetFileWriter.java: ## @@ -336,20 +354,30 @@ public ParquetFileWriter(OutputFile file, MessageType

[jira] [Commented] (PARQUET-2136) File writer construction with encryptor

[ https://issues.apache.org/jira/browse/PARQUET-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522364#comment-17522364 ] ASF GitHub Bot commented on PARQUET-2136: - ggershinsky commented on code in PR #954: URL:

[GitHub] [parquet-mr] ggershinsky commented on a diff in pull request #954: PARQUET-2136: File writer construction with encryptor

ggershinsky commented on code in PR #954: URL: https://github.com/apache/parquet-mr/pull/954#discussion_r850534162 ## parquet-hadoop/src/main/java/org/apache/parquet/hadoop/ParquetFileWriter.java: ## @@ -336,20 +354,30 @@ public ParquetFileWriter(OutputFile file, MessageType

[jira] [Commented] (PARQUET-2136) File writer construction with encryptor

[ https://issues.apache.org/jira/browse/PARQUET-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522354#comment-17522354 ] ASF GitHub Bot commented on PARQUET-2136: - shangxinli commented on code in PR #954: URL:

[GitHub] [parquet-mr] shangxinli commented on a diff in pull request #954: PARQUET-2136: File writer construction with encryptor

shangxinli commented on code in PR #954: URL: https://github.com/apache/parquet-mr/pull/954#discussion_r850523822 ## parquet-hadoop/src/main/java/org/apache/parquet/hadoop/ParquetFileWriter.java: ## @@ -336,20 +354,30 @@ public ParquetFileWriter(OutputFile file, MessageType

[jira] [Commented] (PARQUET-2069) Parquet file containing arrays, written by Parquet-MR, cannot be read again by Parquet-MR

[ https://issues.apache.org/jira/browse/PARQUET-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522347#comment-17522347 ] Timothy Miller commented on PARQUET-2069: - This appears to occur due to the reader and writer

[jira] [Commented] (PARQUET-2136) File writer construction with encryptor

[ https://issues.apache.org/jira/browse/PARQUET-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522338#comment-17522338 ] ASF GitHub Bot commented on PARQUET-2136: - ggershinsky commented on PR #954: URL:

[GitHub] [parquet-mr] ggershinsky commented on pull request #954: PARQUET-2136: File writer construction with encryptor

ggershinsky commented on PR #954: URL: https://github.com/apache/parquet-mr/pull/954#issuecomment-1099243404 (it basically adds a new constructor, so shouldn't affect the existing stuff) -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [parquet-mr] ggershinsky commented on pull request #954: PARQUET-2136: File writer construction with encryptor

ggershinsky commented on PR #954: URL: https://github.com/apache/parquet-mr/pull/954#issuecomment-1099230977 Hi @shangxinli , can you have a quick look at this one? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the