[
https://issues.apache.org/jira/browse/HADOOP-16492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225844#comment-17225844
]
Brahma Reddy Battula commented on HADOOP-16492:
-----------------------------------------------
[~zhongjun] thanks for continuous effort.
{quote}In the 2nd page of the attached Difference Between OBSA and S3A.pdf, we
list some advantages of OBSA over S3A on append, rename, and list features.
{quote}
Looks interesting.
{quote}private static final AtomicInteger POOLNUMBER = new AtomicInteger(1);
{quote}
Use case sensitive for variables.
why the loglevel is debug here, let it be WARN or ERROR..?
{code:java}
// code placeholder
195 private synchronized OBSDataBlocks.DataBlock createBlockIfNeeded()
195 private synchronized OBSDataBlocks.DataBlock createBlockIfNeeded()
196 throws IOException {197 if (activeBlock == null) {
198 blockCount++;
199 if (blockCount >= OBSConstants.MAX_MULTIPART_COUNT) {
200 LOG.debug(
201 "Number of partitions in stream exceeds limit for OBS: "
202 + OBSConstants.MAX_MULTIPART_COUNT203 + "
write may fail.");
204 }
205 activeBlock = blockFactory.create(blockCount, this.blockSize);
206 }
207 return activeBlock;
208 }
{code}
Looks so much code is used from the S3, can you try to extend the existing S3
code..?
> Support HuaweiCloud Object Storage as a Hadoop Backend File System
> ------------------------------------------------------------------
>
> Key: HADOOP-16492
> URL: https://issues.apache.org/jira/browse/HADOOP-16492
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs
> Affects Versions: 3.4.0
> Reporter: zhongjun
> Priority: Major
> Attachments: Difference Between OBSA and S3A.pdf,
> HADOOP-16492.001.patch, HADOOP-16492.002.patch, HADOOP-16492.003.patch,
> HADOOP-16492.004.patch, HADOOP-16492.005.patch, HADOOP-16492.006.patch,
> HADOOP-16492.007.patch, HADOOP-16492.008.patch, HADOOP-16492.009.patch,
> HADOOP-16492.010.patch, HADOOP-16492.011.patch, HADOOP-16492.012.patch,
> HADOOP-16492.013.patch, HADOOP-16492.014.patch, HADOOP-16492.015.patch,
> HADOOP-16492.016.patch, OBSA HuaweiCloud OBS Adapter for Hadoop Support.pdf
>
>
> Added support for HuaweiCloud OBS
> ([https://www.huaweicloud.com/en-us/product/obs.html]) to Hadoop file system,
> just like what we do before for S3, ADLS, OSS, etc. With simple
> configuration, Hadoop applications can read/write data from OBS without any
> code change.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
