[
https://issues.apache.org/jira/browse/PARQUET-1881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Khasim Shaik updated PARQUET-1881:
----------------------------------
Description:
I want to understand how can we enable the flag "sortedArray" information in
metadata while writing a row group or column
I am exploring parquet.thrift to understand more about metadata,
I observed a field in metadata which is related to below struct in
parquet.thrift
I am wondering how to set these fields from parquet while writing a column or
rowgroup
struct SortingColumn {
/** The column index (in this row group) **/
1: required i32 column_idx
/** If true, indicates this column is sorted in descending order. **/
2: required bool descending
/** If true, nulls will come before non-null values, otherwise,
* nulls go at the end. */
3: required bool nulls_first
}
was:I want to understand how can we enable the flag "sortedArray" information
in metadata while writing a row group or column
updated with a detailed description
> How to enable sorted array flag while writing a column using parquet-mr
> -----------------------------------------------------------------------
>
> Key: PARQUET-1881
> URL: https://issues.apache.org/jira/browse/PARQUET-1881
> Project: Parquet
> Issue Type: Task
> Components: parquet-mr
> Reporter: Khasim Shaik
> Priority: Blocker
> Labels: newbie
>
> I want to understand how can we enable the flag "sortedArray" information in
> metadata while writing a row group or column
> I am exploring parquet.thrift to understand more about metadata,
> I observed a field in metadata which is related to below struct in
> parquet.thrift
> I am wondering how to set these fields from parquet while writing a column or
> rowgroup
> struct SortingColumn {
> /** The column index (in this row group) **/
> 1: required i32 column_idx
> /** If true, indicates this column is sorted in descending order. **/
> 2: required bool descending
> /** If true, nulls will come before non-null values, otherwise,
> * nulls go at the end. */
> 3: required bool nulls_first
> }
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
