[ 
https://issues.apache.org/jira/browse/BEAM-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16163539#comment-16163539
 ] 

Luke Cwik commented on BEAM-2868:
---------------------------------

Currently FileSystems.copy() enforces that the same scheme is used because it 
just forwards the call to a specific file system implementation.To support this 
feature request you want to split the list of copy requests into ones which are 
for the same scheme and ones which are for different schemes. For the ones in 
the different scheme you effectively want to have some support code which uses 
FileSystems.create(...) and FileSystems.read(...) and perform a ByteChannel 
copy. Typically you want to perform these copies in parallel to mitigate the 
overhead of copying small files.

> Allow FileSystems.copy() to copy between different scheme
> ---------------------------------------------------------
>
>                 Key: BEAM-2868
>                 URL: https://issues.apache.org/jira/browse/BEAM-2868
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>            Reporter: Reza ardeshir rokni
>            Assignee: Luke Cwik
>            Priority: Minor
>
> It would be useful to allow FileSystem.copy() to be able to copy from 
> different scheme. For example when copying files from a Object store to the 
> worker. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to