[
https://issues.apache.org/jira/browse/KYLIN-4713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185625#comment-17185625
]
ASF subversion and git services commented on KYLIN-4713:
--------------------------------------------------------
Commit 3f0b2a8eaa14e42a36df314b16263b1e90efc44d in kylin's branch
refs/heads/kylin-on-parquet-v2 from yaqian.zhang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3f0b2a8 ]
KYLIN-4713 Support use diff spark schedule pool for diff query
> Support use diff spark schedule pool for diff query
> ---------------------------------------------------
>
> Key: KYLIN-4713
> URL: https://issues.apache.org/jira/browse/KYLIN-4713
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
> Reporter: Yaqian Zhang
> Assignee: Yaqian Zhang
> Priority: Minor
> Fix For: v4.0.0-alpha
>
>
> Kylin 4.0 use fair scheduler as spark scheduler mode in query module. The
> fair scheduler supports grouping jobs into pools, and setting different
> scheduling options (e.g. weight) for each pool.
> User can config different spark pool in project level and sql level, and the
> configuration priority of SQL level is higher than that of project level.
> There are four spark pool in Kylin, which are 'query_pushdown',
> 'heavy_tasks', 'lightweight_tasks' and 'vip_tasks'.
> If the user does not specify spark pool at both the SQL level and the project
> level, kylin will automatically adjust the spark pool used by SQL according
> to some configuration.
> This feature can achieve resource isolation between different SQL to a
> certain extent, and avoid blocking the operation of lightweight SQL by SQL
> that takes more resources.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
