etseidl opened a new pull request, #49707:
URL: https://github.com/apache/arrow/pull/49707

   
   ### Rationale for this change
   
   `path_in_schema` in the `ColumnMetaData` is redundant. 
https://github.com/apache/parquet-format/issues/563 proposes fixing this by 
marking the field `optional` in the Thrift definition.
   
   ### What changes are included in this PR?
   Modify the thrift generated code after makeing `path_in_schema` optional. 
Add options to `WriterProperties` to control the behavior, with the default 
being to continue writing the field. Makes changes to the metadata to account 
for the field now being optional.
   
   ### Are these changes tested?
   Yes, adds a unit test to confirm the field is not present when that is 
requested.
   
   ### Are there any user-facing changes?
   
   Adds a new configuration option, but no behavioral changes by default.
   
   - Closes #49706 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to