[ 
https://issues.apache.org/jira/browse/BEAM-12435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anonymous updated BEAM-12435:
-----------------------------
    Status: Triage Needed  (was: Resolved)

> Generalize S3FileSystem
> -----------------------
>
>                 Key: BEAM-12435
>                 URL: https://issues.apache.org/jira/browse/BEAM-12435
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-aws
>            Reporter: Matt Rudary
>            Assignee: Matt Rudary
>            Priority: P2
>              Labels: aws, aws-s3
>             Fix For: 2.32.0
>
>          Time Spent: 6h 40m
>  Remaining Estimate: 0h
>
> I'm working with multiple storage systems that speak the S3 api. I would like 
> to support FileIO operations for these storage systems, but S3FileSystem 
> hardcodes the s3 scheme (the various systems use different URI schemes) and 
> it is in any case impossible to instantiate more than one in the current 
> design.
> I'd like to refactor the code in org.apache.beam.sdk.io.aws.s3 (and maybe 
> ...aws.options) somewhat to enable this use-case. I haven't worked out the 
> details yet, but it will take some thought to make this work in a non-hacky 
> way.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to