[
https://issues.apache.org/jira/browse/HADOOP-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15511801#comment-15511801
]
Kai Zheng commented on HADOOP-12756:
------------------------------------
Hi [~ste...@apache.org], [~cnauroth], [~hitliuyi], [~aw], [~umamaheswararao],
[~eddyxu] and all,
Thank you for your suggestions, guidances and driving! Since the branch was
created, this runs pretty well. The code base is improved and cleaned, more
tests are added, the user documentation is provided, and the design doc is
updated, aligning with the conventions for aws/s3a, azure and etc. Importantly,
the major functionality has already been running in production environment for
quite some time and many users are expecting to see this as part of formal
Hadoop offering. Recently I looked around this reviewing the work and now feel
it's time to merge it into trunk. The whole work generates a patch in
HADOOP-13584 in size of {{138 kB}}, which isn't quite large. It adds a new
standalone module (hadoop-aliyun) in {{hadoop-tools}} and doesn't affect
existing functionalities. There shouldn't be conflict merging into trunk and
the risk is low. Note after this is in, some optimization work will be easier
to do altogether with on-going efforts, like HADOOP-13345, making Hadoop become
more and more friendly towards cloud platforms. I'm happy to contribute in this
direction as well with my colleagues.
Hope this sounds good to everybody and your further suggestion is very welcome.
If no further inputs in following days, I'd like to take and help do the merge.
Thank you.
> Incorporate Aliyun OSS file system implementation
> -------------------------------------------------
>
> Key: HADOOP-12756
> URL: https://issues.apache.org/jira/browse/HADOOP-12756
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs
> Affects Versions: HADOOP-12756
> Reporter: shimingfei
> Assignee: shimingfei
> Fix For: HADOOP-12756
>
> Attachments: Aliyun-OSS-integration-v2.pdf,
> Aliyun-OSS-integration.pdf, HADOOP-12756-v02.patch, HADOOP-12756.003.patch,
> HADOOP-12756.004.patch, HADOOP-12756.005.patch, HADOOP-12756.006.patch,
> HADOOP-12756.007.patch, HADOOP-12756.008.patch, HADOOP-12756.009.patch,
> HADOOP-12756.010.patch, HCFS User manual.md, OSS integration.pdf
>
>
> Aliyun OSS is widely used among China’s cloud users, but currently it is not
> easy to access data laid on OSS storage from user’s Hadoop/Spark application,
> because of no original support for OSS in Hadoop.
> This work aims to integrate Aliyun OSS with Hadoop. By simple configuration,
> Spark/Hadoop applications can read/write data from OSS without any code
> change. Narrowing the gap between user’s APP and data storage, like what have
> been done for S3 in Hadoop
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
