Alejandro Marco Ramos created ARROW-17064:
---------------------------------------------

             Summary: Python hangs when use pyarrow.fs.copy_files is used with 
"used_threads=True"
                 Key: ARROW-17064
                 URL: https://issues.apache.org/jira/browse/ARROW-17064
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
    Affects Versions: 8.0.0
            Reporter: Alejandro Marco Ramos


When try to copy a local path to s3 remote filesystem using 
`pyarrow.fs.copy_files` and using default parameter `use_threads=True`, the 
system hangs. If use "use_threads=False` the operation must complete ok (but 
more slow).

 

My code is:
{code:java}
>>> import pyarrow as pa
>>> s3fs=pa.fs.S3FileSystem(endpoint_override="http://xxxxxx";)
>>> pa.fs.copy_files("tests/data/payments", "bucket/payments", 
>>> destination_filesystem=s3fs)
... (don't return){code}
If check remote s3, all files appear, but the function don't return



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to