[
https://issues.apache.org/jira/browse/BEAM-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Halperin updated BEAM-1441:
----------------------------------
Summary: Add FileSystem support to Python SDK (was: Add an
IOChannelFactory interface to Python SDK)
> Add FileSystem support to Python SDK
> ------------------------------------
>
> Key: BEAM-1441
> URL: https://issues.apache.org/jira/browse/BEAM-1441
> Project: Beam
> Issue Type: New Feature
> Components: sdk-py
> Reporter: Chamikara Jayalath
> Assignee: Sourabh Bajaj
> Fix For: First stable release
>
>
> Based on proposal [1], an IOChannelFactory interface was added to Java SDK
> [2].
> We should add a similar interface to Python SDK and provide proper
> implementations for native files, GCS, and other useful formats.
> Python SDK currently has a basic ChannelFactory interface [3] which is used
> by FileBasedSource [4].
> [1]
> https://docs.google.com/document/d/11TdPyZ9_zmjokhNWM3Id-XJsVG3qel2lhdKTknmZ_7M/edit#heading=h.kpqagzh8i11w
> [2]
> https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/util/IOChannelFactory.java
> [3]
> https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/fileio.py#L107
> [4]
> https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/filebasedsource.py
>
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
