Alejandro Marco Ramos created ARROW-17064:
---------------------------------------------
Summary: Python hangs when use pyarrow.fs.copy_files is used with
"used_threads=True"
Key: ARROW-17064
URL: https://issues.apache.org/jira/browse/ARROW-17064
Project: Apache Arrow
Issue Type: Bug
Components: Python
Affects Versions: 8.0.0
Reporter: Alejandro Marco Ramos
When try to copy a local path to s3 remote filesystem using
`pyarrow.fs.copy_files` and using default parameter `use_threads=True`, the
system hangs. If use "use_threads=False` the operation must complete ok (but
more slow).
My code is:
{code:java}
>>> import pyarrow as pa
>>> s3fs=pa.fs.S3FileSystem(endpoint_override="http://xxxxxx")
>>> pa.fs.copy_files("tests/data/payments", "bucket/payments",
>>> destination_filesystem=s3fs)
... (don't return){code}
If check remote s3, all files appear, but the function don't return
--
This message was sent by Atlassian Jira
(v8.20.10#820010)