[
https://issues.apache.org/jira/browse/HADOOP-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15521000#comment-15521000
]
Steve Loughran commented on HADOOP-12756:
-----------------------------------------
great to see this work in.
Based on the experiences with the other object stores, it invariably takes time
for problems to surface; as well as code review, people need to play with it to
see what breaks
in particular: {{hadoop fs}} experience; the S3a phase II JIRA has shown up
some issues there (home dir, trash, ...) which may now need to be left unfixed
for compatibility. I'd recommend someone spends time working with the FS, and
doing some scale tests, including big distcp operations. It's that leap from
local integration tests to large runs which shows up the surprises
> Incorporate Aliyun OSS file system implementation
> -------------------------------------------------
>
> Key: HADOOP-12756
> URL: https://issues.apache.org/jira/browse/HADOOP-12756
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs
> Affects Versions: HADOOP-12756
> Reporter: shimingfei
> Assignee: shimingfei
> Fix For: HADOOP-12756
>
> Attachments: Aliyun-OSS-integration-v2.pdf,
> Aliyun-OSS-integration.pdf, HADOOP-12756-v02.patch, HADOOP-12756.003.patch,
> HADOOP-12756.004.patch, HADOOP-12756.005.patch, HADOOP-12756.006.patch,
> HADOOP-12756.007.patch, HADOOP-12756.008.patch, HADOOP-12756.009.patch,
> HADOOP-12756.010.patch, HCFS User manual.md, OSS integration.pdf
>
>
> Aliyun OSS is widely used among China’s cloud users, but currently it is not
> easy to access data laid on OSS storage from user’s Hadoop/Spark application,
> because of no original support for OSS in Hadoop.
> This work aims to integrate Aliyun OSS with Hadoop. By simple configuration,
> Spark/Hadoop applications can read/write data from OSS without any code
> change. Narrowing the gap between user’s APP and data storage, like what have
> been done for S3 in Hadoop
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
