Neal Richardson created ARROW-9868:
--------------------------------------
Summary: [C++] Provide utility for copying files between
filesystems
Key: ARROW-9868
URL: https://issues.apache.org/jira/browse/ARROW-9868
Project: Apache Arrow
Issue Type: New Feature
Components: C++
Reporter: Neal Richardson
Fix For: 2.0.0
{{CopyStream}} in arrow/filesystem/util_internal.h does this, but we should
expose it, multithread it (can read in one thread while the other thread
writes), and further see if there are filesystem-specific optimizations (e.g.
S3 multipart uploading/downloading). We may also want a version that takes a
FileSelector or vector of paths and parallelizes the operations on them.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
