[
https://issues.apache.org/jira/browse/KYLIN-5187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17553006#comment-17553006
]
ASF subversion and git services commented on KYLIN-5187:
--------------------------------------------------------
Commit f22abfa2e6fb3c4d58a0d1be4e3ca3e7bba74670 in kylin's branch
refs/heads/kylin-soft-affinity-local-cache from Zhichao Zhang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=f22abfa2e6 ]
KYLIN-5187 Support soft affinity and local cache feature
1. Implement LocalDataCacheManager
2. base xiaoxiang's PR
3. Implement CacheFileScanRDD
4. Implement AbstractCacheFileSystem
5. Optimize performance
6. Support soft affinity for hdfs
7. Support ByteBuffer to read data, and avoid to read data one byte by one
byte
8. Support to cache small files in memory : ByteBufferPageStore extends
PageStore to support cache data in memory
9. Pre-init KylinCacheFileSystem to fix s3a issue
10. Upgrade alluxio client verion to 2.7.4
> Support Alluxio Local Cache + Soft Affinity to speed up the query performance
> on the cloud
> ------------------------------------------------------------------------------------------
>
> Key: KYLIN-5187
> URL: https://issues.apache.org/jira/browse/KYLIN-5187
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
> Affects Versions: v4.0.1
> Reporter: Zhichao Zhang
> Assignee: Zhichao Zhang
> Priority: Major
> Fix For: v4.1.0
>
>
> Support Alluxio Local Cache + Soft Affinity to speed up the query performance
> on the cloud.
> Currently, this feature could be only supported for Spark 3.1.
> Refer to : [Presto RaptorX|https://prestodb.io/blog/2021/02/04/raptorx]
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
