assignUser opened a new issue, #278: URL: https://github.com/apache/arrow-cookbook/issues/278
The pyarrow [docs](https://arrow.apache.org/docs/python/generated/pyarrow.dataset.write_dataset.html#pyarrow.dataset.write_dataset) for the `exisiting_data_behavior` param contains this hint: > This behavior, in combination with a unique basename_template for each write, will allow for an append workflow. > >‘delete_matching’ is useful when you are writing a partitioned dataset. The first time each partition directory is encountered the entire directory will be deleted. This allows you to overwrite old partitions completely. A fully formed recipe for this would be nice as this hint is a bit hidden. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
