davlee1972 opened a new issue, #39447:
URL: https://github.com/apache/arrow/issues/39447
### Describe the enhancement requested
The default basename_template is “part-{i}.” + format.default_extname in
pyarrow.dataset.write_dataset
https://arrow.apache.org/docs/python/generated/pyarrow.dataset.write_dataset.html
Can we add partitioning_columns in the template.. If I have additional
partitioning columns like:
fx_currency
fx_year
fx_month
Could we support a basename_template like
"fx_rates.{fx_currency}_{fx_year}_{fx_month}.part-{i}.parquet"?
This would ensure all filenames are unique even if they use hive or
directory partitioning..
### Component(s)
C++, Python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
