[
https://issues.apache.org/jira/browse/ARROW-13269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376806#comment-17376806
]
Weston Pace commented on ARROW-13269:
-------------------------------------
If the intent is for the metadata object to only contain the columns written
then that does make things simpler. I suppose the same question holds for
common_metadata. Should common_metadata contain only the columns written? Or
should it also contain the partition columns? Also, I think we need to support
individual files having different metadata? That should probably be tested as
part of this feature as well.
> [C++] [Dataset] pyarrow.parquet.write_to_dataset does not send full schema to
> metadata_collector
> ------------------------------------------------------------------------------------------------
>
> Key: ARROW-13269
> URL: https://issues.apache.org/jira/browse/ARROW-13269
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Affects Versions: 4.0.0
> Reporter: Weston Pace
> Priority: Major
>
> If there are partition columns specified then the writers will only write the
> non-partition columns and thus they will not contain the fields used for the
> partition.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
