[
https://issues.apache.org/jira/browse/HADOOP-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16311600#comment-16311600
]
wujinhu commented on HADOOP-15027:
----------------------------------
Updated the patch! Thanks [~Sammi] for the review. Here are my updates for your
comments:
1 & 2 fixed
3. store.close() will not throw any exception, OSSClient.shutdown() catches
Exception.
4. Yes, fs.oss.max.total.tasks is the max queue length used for read ahead.
5. fsDataInputStream.seek() is not missed, you can see it in 007.patch
6. I have added another test case for AliyunOSSFileReaderTask and will continue
to add more test cases.
Please help to review again. Thanks
> AliyunOSS: Support multi-thread pre-read to improve read from Hadoop to
> Aliyun OSS performance
> ----------------------------------------------------------------------------------------------
>
> Key: HADOOP-15027
> URL: https://issues.apache.org/jira/browse/HADOOP-15027
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/oss
> Affects Versions: 3.0.0
> Reporter: wujinhu
> Assignee: wujinhu
> Attachments: HADOOP-15027.001.patch, HADOOP-15027.002.patch,
> HADOOP-15027.003.patch, HADOOP-15027.004.patch, HADOOP-15027.005.patch,
> HADOOP-15027.006.patch, HADOOP-15027.007.patch, HADOOP-15027.008.patch,
> HADOOP-15027.009.patch
>
>
> Currently, AliyunOSSInputStream uses single thread to read data from
> AliyunOSS, so we can do some refactoring by using multi-thread pre-read to
> improve read performance.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
