westonpace commented on issue #10634: URL: https://github.com/apache/arrow/issues/10634#issuecomment-871906909
It appears us-east-1 has special rules regarding the LocationConstraint. See https://github.com/boto/boto3/issues/125 for details. I've created ARROW-13228 to track this. Are you sure you are using `my-existing-bucket` in both cases? Note that the error you are getting says "When creating bucket". Both dataset write methods will create a bucket if it does not exist so my guess is that path does not start with "my-existing-bucket". If you are intentionally creating a new bucket then you can workaround this error by manually creating the destination bucket outside of Arrow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org