[
https://issues.apache.org/jira/browse/ARROW-9870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neal Richardson updated ARROW-9870:
-----------------------------------
Description:
The Filesystem methods don't provide a human-friendly interface for basic
operations like ls, mkdir, etc. Since we provide access to S3 and potentially
other cloud storage, it would be nice to have simple methods for exploring it.
Additional ideas:
* S3Bucket class/constructor: it's basically a SubTreeFileSystem containing
S3FS and a path, except that we can auto-detect a bucket's region.
* Add a class like the FileLocator C++ struct list(fs, path). _also_ kinda like
a SubTreeFileSystem, but with different methods and intents. Aside from use in
ls/mkdir/cp, it could be used in file reader/writers instead of having an extra
{{filesystem}} argument added everywhere, e.g. {{fs$path("path/to/file")}}. See
https://github.com/apache/arrow/pull/8197#discussion_r494325934
was:The Filesystem methods don't provide a human-friendly interface for basic
operations like ls, mkdir, etc. Since we provide access to S3 and potentially
other cloud storage, it would be nice to have simple methods for exploring it.
> [R] Friendly interface for filesystems (S3)
> -------------------------------------------
>
> Key: ARROW-9870
> URL: https://issues.apache.org/jira/browse/ARROW-9870
> Project: Apache Arrow
> Issue Type: New Feature
> Components: R
> Reporter: Neal Richardson
> Assignee: Neal Richardson
> Priority: Major
> Fix For: 2.0.0
>
>
> The Filesystem methods don't provide a human-friendly interface for basic
> operations like ls, mkdir, etc. Since we provide access to S3 and potentially
> other cloud storage, it would be nice to have simple methods for exploring it.
> Additional ideas:
> * S3Bucket class/constructor: it's basically a SubTreeFileSystem containing
> S3FS and a path, except that we can auto-detect a bucket's region.
> * Add a class like the FileLocator C++ struct list(fs, path). _also_ kinda
> like a SubTreeFileSystem, but with different methods and intents. Aside from
> use in ls/mkdir/cp, it could be used in file reader/writers instead of having
> an extra {{filesystem}} argument added everywhere, e.g.
> {{fs$path("path/to/file")}}. See
> https://github.com/apache/arrow/pull/8197#discussion_r494325934
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
