[ 
https://issues.apache.org/jira/browse/ARROW-13269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377946#comment-17377946
 ] 

Joris Van den Bossche commented on ARROW-13269:
-----------------------------------------------

[~westonpace] I don't fully understand your updated title. In the doc example, 
the {{_common_metadata}} and {{_metadata}} files are written with two separate 
{{pq.write_metadata}} calls, and so you can pass a different schema to each (eg 
{{table.schema}} for {{_common_metadata}} and {{table.select([.. all column 
except partitioning columns ..]).schema}} for {{_metadata}}).

> [C++] [Dataset] pyarrow.parquet.write_metadata does not allow common_metadata 
> and _metadata schemas to differ
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: ARROW-13269
>                 URL: https://issues.apache.org/jira/browse/ARROW-13269
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: C++
>    Affects Versions: 4.0.0
>            Reporter: Weston Pace
>            Priority: Major
>
> If there are partition columns specified then the writers will only write the 
> non-partition columns and thus they will not contain the fields used for the 
> partition.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to