[
https://issues.apache.org/jira/browse/HADOOP-16492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154327#comment-17154327
]
zhongjun commented on HADOOP-16492:
-----------------------------------
[~brahmareddy] Thanks for your comments.
{quote} * {color:#7a869a}Looks the docuement states diff between s3a and obs
but I didn't any feature difference and perfomance difference. are you planing
update on that..?{color}{quote}
In the 2nd page of the attached [^Difference Between OBSA and S3A.pdf], we list
some advantages of OBSA over S3A on append, rename, and list features.
{quote} * looks it's more approiarte to move under
"hadoop-cloud-storage-project" instead of the tools.?{quote}
Like hadoop-cos, we have moved hadoop-huaweicloud under
'hadoop-cloud-storage-project'.
{quote} * All tests against the live store should have the prefix ITest, not
Test, and set up so that they run in the mvn verify stage. And all which can
run in parallel do so, for performance. Look at hadoop-azure and hadoop-aws for
examples here.{quote}
We write tests by referring to recently hadoop-azure-datalake, hadoop-aliyun,
and hadoop-cos, which do not use the prefix ITest, and do not set test
parallelization in pom.xml.
{quote} * Please share acount details, so that we can execute the some
testcase.{quote}
To verify all necessary tests, we can send you a test account by email as in
the HADOOP-15616 case. In order to run all unit tests, the 'auth-keys.xml' need
to be created under the directory:
'${HADOOP_HOME}/hadoop-cloud-storage-project/hadoop-huaweicloud/src/test/resource/'.
Can you help to review it again? At the same time, we can send you a test
account to verify all necessary tests.
> Support HuaweiCloud Object Storage as a Hadoop Backend File System
> ------------------------------------------------------------------
>
> Key: HADOOP-16492
> URL: https://issues.apache.org/jira/browse/HADOOP-16492
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs
> Affects Versions: 3.4.0
> Reporter: zhongjun
> Priority: Major
> Attachments: Difference Between OBSA and S3A.pdf,
> HADOOP-16492.001.patch, HADOOP-16492.002.patch, HADOOP-16492.003.patch,
> HADOOP-16492.004.patch, HADOOP-16492.005.patch, HADOOP-16492.006.patch,
> HADOOP-16492.007.patch, HADOOP-16492.008.patch, HADOOP-16492.009.patch,
> HADOOP-16492.010.patch, HADOOP-16492.011.patch, HADOOP-16492.012.patch,
> HADOOP-16492.013.patch, HADOOP-16492.014.patch, OBSA HuaweiCloud OBS Adapter
> for Hadoop Support.pdf
>
>
> Added support for HuaweiCloud OBS
> ([https://www.huaweicloud.com/en-us/product/obs.html]) to Hadoop file system,
> just like what we do before for S3, ADLS, OSS, etc. With simple
> configuration, Hadoop applications can read/write data from OBS without any
> code change.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
