John created ARROW-18052:
----------------------------
Summary: pyarrow.parquet.write_to_dataset permssion denied when
write to s3 bucket in another account
Key: ARROW-18052
URL: https://issues.apache.org/jira/browse/ARROW-18052
Project: Apache Arrow
Issue Type: Bug
Components: Python
Affects Versions: 9.0.0
Reporter: John
We are using pyarrow.parquet.write_to_dataset to write to an s3 file system in
another account. This fails because write_to_dataset calls
pyarrow.dataset.write_dataset with create_dir=True. There is not a parameter
in the call to write_to_dataset that allows you to set create_dir to False.
When setting it to False, this works correctly.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
