Niltra commented on issue #34905:
URL: https://github.com/apache/arrow/issues/34905#issuecomment-6531754815
Thanks @Reranko05!
I opened #55345 for this. The `segment_encoding` option already existed on
`HivePartitioning`, but it was only applied when reading:
`HivePartitioning::FormatValues` still URI-encoded partition values when
writing. The PR makes the write path honour the option, leaving the default
`"uri"` unchanged.
This now works:
```python
import pyarrow.dataset as ds
import pyarrow.parquet as pq
partitioning = ds.HivePartitioning(
table.select(partition_cols).schema,
segment_encoding="none",
)
pq.write_to_dataset(table, path, partitioning=partitioning, filesystem=fs)
```
`part=My Fancy Product` is written as-is, while the default still produces
`part=My%20Fancy%20Product`. C++ and Python tests cover both modes, including
read-back. Ready for review.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
