[
https://issues.apache.org/jira/browse/KYLIN-4713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yaqian Zhang updated KYLIN-4713:
--------------------------------
Description:
Kylin 4.0 use fair scheduler as spark scheduler mode in query module. The fair
scheduler supports grouping jobs into pools, and setting different scheduling
options (e.g. weight) for each pool. There are five spark pool in Kylin, which
are 'query_pushdown', 'heavy_tasks', 'lightweight_tasks' and 'vip_tasks'.
User can config different spark pool in project level and sql level, and the
configuration priority of SQL level is higher than that of project level. There
are five spark pool,
If the user does not specify spark pool at both the SQL level and the project
level, kylin will automatically adjust the spark pool used by SQL according to
some configuration.
This feature can achieve resource isolation between different SQL to a certain
extent, and avoid blocking the operation of lightweight SQL by SQL that takes
more resources.
was:
User can config different spark pool in project level and sql level, and the
configuration priority of SQL level is higher than that of project level.
If the user does not specify spark pool at both the SQL level and the project
level, kylin will automatically adjust the spark pool used by SQL according to
some configuration.
This feature can achieve resource isolation between different SQL to a certain
extent, and avoid blocking the operation of lightweight SQL by SQL that takes
more resources.
> Support use diff spark schedule pool for diff query
> ---------------------------------------------------
>
> Key: KYLIN-4713
> URL: https://issues.apache.org/jira/browse/KYLIN-4713
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
> Reporter: Yaqian Zhang
> Assignee: Yaqian Zhang
> Priority: Minor
> Fix For: v4.0.0-beta
>
>
> Kylin 4.0 use fair scheduler as spark scheduler mode in query module. The
> fair scheduler supports grouping jobs into pools, and setting different
> scheduling options (e.g. weight) for each pool. There are five spark pool in
> Kylin, which are 'query_pushdown', 'heavy_tasks', 'lightweight_tasks' and
> 'vip_tasks'.
> User can config different spark pool in project level and sql level, and the
> configuration priority of SQL level is higher than that of project level.
> There are five spark pool,
> If the user does not specify spark pool at both the SQL level and the project
> level, kylin will automatically adjust the spark pool used by SQL according
> to some configuration.
> This feature can achieve resource isolation between different SQL to a
> certain extent, and avoid blocking the operation of lightweight SQL by SQL
> that takes more resources.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
