Kai Zheng commented on HADOOP-12756:

Hi [~ste...@apache.org], [~cnauroth], [~hitliuyi], [~aw], [~umamaheswararao], 
[~eddyxu] and all,

Thank you for your suggestions, guidances and driving! Since the branch was 
created, this runs pretty well. The code base is improved and cleaned, more 
tests are added, the user documentation is provided, and the design doc is 
updated, aligning with the conventions for aws/s3a, azure and etc. Importantly, 
the major functionality has already been running in production environment for 
quite some time and many users are expecting to see this as part of formal 
Hadoop offering. Recently I looked around this reviewing the work and now feel 
it's time to merge it into trunk. The whole work generates a patch in 
HADOOP-13584 in size of {{138 kB}}, which isn't quite large. It adds a new 
standalone module (hadoop-aliyun) in {{hadoop-tools}} and doesn't affect 
existing functionalities. There shouldn't be conflict merging into trunk and 
the risk is low. Note after this is in, some optimization work will be easier 
to do altogether with on-going efforts, like HADOOP-13345, making Hadoop become 
more and more friendly towards cloud platforms. I'm happy to contribute in this 
direction as well with my colleagues.

Hope this sounds good to everybody and your further suggestion is very welcome. 
If no further inputs in following days, I'd like to take and help do the merge. 
Thank you.

> Incorporate Aliyun OSS file system implementation
> -------------------------------------------------
>                 Key: HADOOP-12756
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12756
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: HADOOP-12756
>            Reporter: shimingfei
>            Assignee: shimingfei
>             Fix For: HADOOP-12756
>         Attachments: Aliyun-OSS-integration-v2.pdf, 
> Aliyun-OSS-integration.pdf, HADOOP-12756-v02.patch, HADOOP-12756.003.patch, 
> HADOOP-12756.004.patch, HADOOP-12756.005.patch, HADOOP-12756.006.patch, 
> HADOOP-12756.007.patch, HADOOP-12756.008.patch, HADOOP-12756.009.patch, 
> HADOOP-12756.010.patch, HCFS User manual.md, OSS integration.pdf
> Aliyun OSS is widely used among China’s cloud users, but currently it is not 
> easy to access data laid on OSS storage from user’s Hadoop/Spark application, 
> because of no original support for OSS in Hadoop.
> This work aims to integrate Aliyun OSS with Hadoop. By simple configuration, 
> Spark/Hadoop applications can read/write data from OSS without any code 
> change. Narrowing the gap between user’s APP and data storage, like what have 
> been done for S3 in Hadoop 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to