[
https://issues.apache.org/jira/browse/ARROW-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17660669#comment-17660669
]
Rok Mihevc commented on ARROW-3646:
-----------------------------------
This issue has been migrated to [issue
#19953|https://github.com/apache/arrow/issues/19953] on GitHub. Please see the
[migration documentation|https://github.com/apache/arrow/issues/14542] for
further details.
> [Python] Add convenience factories to create IO streams
> -------------------------------------------------------
>
> Key: ARROW-3646
> URL: https://issues.apache.org/jira/browse/ARROW-3646
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
> Affects Versions: 0.11.0
> Reporter: Antoine Pitrou
> Assignee: Antoine Pitrou
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.12.0
>
> Time Spent: 3h 20m
> Remaining Estimate: 0h
>
> Currently, creating IO streams requires invoking various constructors with
> irregular names. It would be nice to expose a higher-level interface.
> For example:
> {code:python}
> def open_reader(source, compression='detect'):
> """
> Create an Arrow input stream.
> Parameters
> ----------
> source: str, Path, buffer, file-like object, ...
> The source to open for reading
> compression: str or None
> The compression algorithm to use for on-the-fly decompression.
> If 'detect' and source is a file path, then compression will be
> chosen based on the file extension.
> If None, no compression will be applied.
> Otherwise, a well-known algorithm name must be supplied (e.g. "gzip")
> """
> def open_writer(source, compression='detect'):
> """
> Create an Arrow output stream.
> Parameters
> ----------
> source: str, Path, buffer, file-like object, ...
> The source to open for writing
> compression: str or None
> The compression algorithm to use for on-the-fly compression.
> If 'detect' and source is a file path, then compression will be
> chosen based on the file extension.
> If None, no compression will be applied.
> Otherwise, a well-known algorithm name must be supplied (e.g. "gzip")
> """
> {code}
> Thoughts?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
