[
https://issues.apache.org/jira/browse/HADOOP-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16548780#comment-16548780
]
Junping Du edited comment on HADOOP-15616 at 7/19/18 4:14 AM:
--------------------------------------------------------------
Thank you, Steve! Yes. My colleague and myself will help to maintain this. The
initial plan is we will share design and code in next few days for community
review. The code has been running in production environment for a while but we
are very open for comments and review from community. For test part, if
necessary, we can setup some test account for community reviewer. :)
bq. as its a new module, can you put it under hadoop-cloud-storage-project
I noticed most previous work like s3, adl, oss, etc. are all put under
hadoop-tools. Do we have plan to move them all to under
hadoop-cloud-storage-project?
bq. Anything you can point us to about the store in terms of: consistency,
rename performance, atomicity, etc, as in "how close does this come to a
filesystem"
That's very key to hadoop behavior over a cloud storage. We will discuss this
in our design doc and we can start discussion from that.
bq. not got any time to review this, going to have to find others to do
anything...i'll try to keep an eye on the process though.
Understand. Thanks for heads up for our effort here.
was (Author: djp):
Thank you, Steve! Yes. My colleague and myself will help to maintain this. The
initial plan is we will share design
and code in next few days for community review. The code has been running in
production environment for a while but we are very open for comments and review
from community. For test part, if necessary, we can setup some test account for
community reviewer. :)
bq. as its a new module, can you put it under hadoop-cloud-storage-project
I noticed most previous work like s3, adl, oss, etc. are all put under
hadoop-tools. Do we have plan to move them all to under
hadoop-cloud-storage-project?
bq. Anything you can point us to about the store in terms of: consistency,
rename performance, atomicity, etc, as in "how close does this come to a
filesystem"
That's very key to hadoop behavior over a cloud storage. We will discuss this
in our design doc and we can start discussion from that.
bq. not got any time to review this, going to have to find others to do
anything...i'll try to keep an eye on the process though.
Understand. Thanks for heads up for our effort here.
> Incorporate Tencent Cloud COS File System Implementation
> --------------------------------------------------------
>
> Key: HADOOP-15616
> URL: https://issues.apache.org/jira/browse/HADOOP-15616
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs/cos
> Reporter: Junping Du
> Priority: Major
>
> Tencent cloud is top 2 cloud vendors in China market and the object store COS
> is widely used among China’s cloud users but now it is hard for hadoop user
> to access data laid on COS storage as no native support for COS in Hadoop.
> This work aims to integrate Tencent cloud COS with Hadoop, just like what we
> do before for S3, ADL, OSS, etc. With simple configuration, Hadoop
> applications can read/write data from COS without any code change.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
