[ 
https://issues.apache.org/jira/browse/HADOOP-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255929#comment-15255929
 ] 

Yi Liu commented on HADOOP-12756:
---------------------------------

Thanks for mingfei and Lei for the work. 

Hi [~ste...@apache.org] and [~cnauroth], regarding testability, they have 
talked with me offline, Aliyun created an account for the test and they 
retained the account for Hadoop, they wanted to pass the username/password 
through "-D" in mvn command. So the basic functionalities could be verified by 
unit tests.  Does this make sense to you?

Mingfei and Lei:
About the ali-oss client, does it rely on a different version of httpclient? 
Could we use the version which hadoop is using?

I will post my detailed comments later.



> Incorporate Aliyun OSS file system implementation
> -------------------------------------------------
>
>                 Key: HADOOP-12756
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12756
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs
>            Reporter: shimingfei
>            Assignee: shimingfei
>         Attachments: 0001-OSS-filesystem-integration-with-Hadoop.patch, HCFS 
> User manual.md, OSS integration.pdf, OSS integration.pdf
>
>
> Aliyun OSS is widely used among China’s cloud users, but currently it is not 
> easy to access data laid on OSS storage from user’s Hadoop/Spark application, 
> because of no original support for OSS in Hadoop.
> This work aims to integrate Aliyun OSS with Hadoop. By simple configuration, 
> Spark/Hadoop applications can read/write data from OSS without any code 
> change. Narrowing the gap between user’s APP and data storage, like what have 
> been done for S3 in Hadoop 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to