[
https://issues.apache.org/jira/browse/KYLIN-4713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185623#comment-17185623
]
ASF GitHub Bot commented on KYLIN-4713:
---------------------------------------
hit-lacus commented on pull request #1377:
URL: https://github.com/apache/kylin/pull/1377#issuecomment-681597740
This patch LGTM, thank you @zhangayqian .
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Support use diff spark schedule pool for diff query
> ---------------------------------------------------
>
> Key: KYLIN-4713
> URL: https://issues.apache.org/jira/browse/KYLIN-4713
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
> Reporter: Yaqian Zhang
> Assignee: Yaqian Zhang
> Priority: Minor
> Fix For: v4.0.0-alpha
>
>
> Kylin 4.0 use fair scheduler as spark scheduler mode in query module. The
> fair scheduler supports grouping jobs into pools, and setting different
> scheduling options (e.g. weight) for each pool.
> User can config different spark pool in project level and sql level, and the
> configuration priority of SQL level is higher than that of project level.
> There are four spark pool in Kylin, which are 'query_pushdown',
> 'heavy_tasks', 'lightweight_tasks' and 'vip_tasks'.
> If the user does not specify spark pool at both the SQL level and the project
> level, kylin will automatically adjust the spark pool used by SQL according
> to some configuration.
> This feature can achieve resource isolation between different SQL to a
> certain extent, and avoid blocking the operation of lightweight SQL by SQL
> that takes more resources.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
