[
https://issues.apache.org/jira/browse/HADOOP-16492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17236639#comment-17236639
]
zhongjun edited comment on HADOOP-16492 at 11/21/20, 11:00 AM:
---------------------------------------------------------------
[~brahmareddy] Thanks for your comments.
* private static final AtomicInteger POOLNUMBER = new AtomicInteger(1);
The class of the code has been changed to extend the class in the
hadoop-common package.
* why the loglevel is debug here, let it be WARN or ERROR..?
!image-2020-11-21-18-51-51-981.png!
debug has been changed to warn.
* Looks so much code is used from the S3, can you try to extend the existing
S3 code..?
The BlockingThreadPoolExecutorService and SemaphoredDelegatingExecutor
classes are deleted and extend the class in the hadoop-common package.
We will continue to optimize this solution. Thank you for your
suggestions.
was (Author: zhongjun):
[~brahmareddy] Thanks for your comments.
* private static final AtomicInteger POOLNUMBER = new AtomicInteger(1);
The class of the code has been changed to extend the class in the
hadoop-common package.
* why the loglevel is debug here, let it be WARN or ERROR..?
* !image-2020-11-21-18-51-51-981.png!
debug has been changed to warn.
* Looks so much code is used from the S3, can you try to extend the existing
S3 code..?
The BlockingThreadPoolExecutorService and SemaphoredDelegatingExecutor
classes are deleted and extend the class in the hadoop-common package.
We will continue to optimize this solution. Thank you for your
suggestions.
> Support HuaweiCloud Object Storage as a Hadoop Backend File System
> ------------------------------------------------------------------
>
> Key: HADOOP-16492
> URL: https://issues.apache.org/jira/browse/HADOOP-16492
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs
> Affects Versions: 3.4.0
> Reporter: zhongjun
> Priority: Major
> Attachments: Difference Between OBSA and S3A.pdf,
> HADOOP-16492.001.patch, HADOOP-16492.002.patch, HADOOP-16492.003.patch,
> HADOOP-16492.004.patch, HADOOP-16492.005.patch, HADOOP-16492.006.patch,
> HADOOP-16492.007.patch, HADOOP-16492.008.patch, HADOOP-16492.009.patch,
> HADOOP-16492.010.patch, HADOOP-16492.011.patch, HADOOP-16492.012.patch,
> HADOOP-16492.013.patch, HADOOP-16492.014.patch, HADOOP-16492.015.patch,
> HADOOP-16492.016.patch, HADOOP-16492.017.patch, OBSA HuaweiCloud OBS Adapter
> for Hadoop Support.pdf, image-2020-11-21-18-51-51-981.png
>
>
> Added support for HuaweiCloud OBS
> ([https://www.huaweicloud.com/en-us/product/obs.html]) to Hadoop file system,
> just like what we do before for S3, ADLS, OSS, etc. With simple
> configuration, Hadoop applications can read/write data from OBS without any
> code change.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
