[
https://issues.apache.org/jira/browse/KYLIN-5187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556758#comment-17556758
]
ASF subversion and git services commented on KYLIN-5187:
--------------------------------------------------------
Commit 9706a9dd76486ea4c4fd4fa86abe1f53602edb28 in kylin's branch
refs/heads/main from Zhichao Zhang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=9706a9dd76 ]
KYLIN-5187 Support soft affinity and local cache feature
1. Implement LocalDataCacheManager
2. base xiaoxiang's PR
3. Implement CacheFileScanRDD
4. Implement AbstractCacheFileSystem
5. Optimize performance
6. Support soft affinity for hdfs
7. Support ByteBuffer to read data, and avoid to read data one byte by one
byte
8. Support to cache small files in memory : ByteBufferPageStore extends
PageStore to support cache data in memory
9. Pre-init KylinCacheFileSystem to fix s3a issue
10. Upgrade alluxio client verion to 2.7.4
> Support Alluxio Local Cache + Soft Affinity to speed up the query performance
> on the cloud
> ------------------------------------------------------------------------------------------
>
> Key: KYLIN-5187
> URL: https://issues.apache.org/jira/browse/KYLIN-5187
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
> Affects Versions: v4.0.1
> Reporter: Zhichao Zhang
> Assignee: Zhichao Zhang
> Priority: Major
> Fix For: v4.1.0
>
>
> Support Alluxio Local Cache + Soft Affinity to speed up the query performance
> on the cloud.
> Currently, this feature could be only supported for Spark 3.1.
> Refer to : [Presto RaptorX|https://prestodb.io/blog/2021/02/04/raptorx]
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
