[ 
https://issues.apache.org/jira/browse/HADOOP-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381617#comment-14381617
 ] 

Thomas Demoor commented on HADOOP-9565:
---------------------------------------

Any ideas on how we can test the changes in other packages 
(CommandWithDestination, FileOutputCommiiter) vs an AWS bucket with maven? 
We're currently moving offices so I can't access to my test cluster so no 
extensive tests for now. Guess I'll have to wait it out.

Moving to FileContext is probably fine but I'm slightly concerned about 
external projects/ still using the old API. How many are there? 

FYI THe FileOutputCommitter has seen some patches recently (MAPREDUCE-4815, 
MAPREDUCE-6275).


> Add a Blobstore interface to add to blobstore FileSystems
> ---------------------------------------------------------
>
>                 Key: HADOOP-9565
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9565
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs, fs/s3, fs/swift
>    Affects Versions: 2.6.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>         Attachments: HADOOP-9565-001.patch, HADOOP-9565-002.patch, 
> HADOOP-9565-003.patch
>
>
> We can make the fact that some {{FileSystem}} implementations are really 
> blobstores, with different atomicity and consistency guarantees, by adding a 
> {{Blobstore}} interface to add to them. 
> This could also be a place to add a {{Copy(Path,Path)}} method, assuming that 
> all blobstores implement at server-side copy operation as a substitute for 
> rename.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to