Yong Yang has uploaded a new patch set (#5). ( http://gerrit.cloudera.org:8080/17455 )
Change subject: IMPALA-10695: add dedicated thread pool for OSS/JindoFS. ...................................................................... IMPALA-10695: add dedicated thread pool for OSS/JindoFS. OSS is the object store in ali cloud, just like s3a, and jindofs is a gateway based on Ali cloud object store. The following is about the JindoFS, https://github.com/aliyun/alibabacloud-jindofs. If ali object store would be treated as local disk without this change, the query performance is not good. This change would create a dedicate queue for this kind of target, and improved the OSS scan performance. I have tested it in our environment, and observed at least double the scan speed. Change-Id: I4643105628f3860e3145c85d9ed205fe20291add Signed-off-by: Yong Yang <[email protected]> --- M be/src/runtime/io/disk-io-mgr-test.cc M be/src/runtime/io/disk-io-mgr.cc M be/src/runtime/io/disk-io-mgr.h M be/src/util/hdfs-util.cc M be/src/util/hdfs-util.h 5 files changed, 25 insertions(+), 1 deletion(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/55/17455/5 -- To view, visit http://gerrit.cloudera.org:8080/17455 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I4643105628f3860e3145c85d9ed205fe20291add Gerrit-Change-Number: 17455 Gerrit-PatchSet: 5 Gerrit-Owner: Yong Yang <[email protected]> Gerrit-Reviewer: Andrew Sherman <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Yong Yang <[email protected]>
