[ 
https://issues.apache.org/jira/browse/KYLIN-4713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xiaoxiang Yu resolved KYLIN-4713.
---------------------------------
    Resolution: Fixed

> Support use diff spark schedule pool for diff query
> ---------------------------------------------------
>
>                 Key: KYLIN-4713
>                 URL: https://issues.apache.org/jira/browse/KYLIN-4713
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Query Engine
>            Reporter: Yaqian Zhang
>            Assignee: Yaqian Zhang
>            Priority: Minor
>             Fix For: v4.0.0-alpha
>
>
> Kylin 4.0 use fair scheduler as spark scheduler mode in query module. The 
> fair scheduler supports grouping jobs into pools, and setting different 
> scheduling options (e.g. weight) for each pool. 
> User can config different spark pool in project level and sql level, and the 
> configuration priority of SQL level is higher than that of project level. 
> There are four spark pool in Kylin, which are 'query_pushdown', 
> 'heavy_tasks', 'lightweight_tasks' and 'vip_tasks'.
> If the user does not specify spark pool at both the SQL level and the project 
> level, kylin will automatically adjust the spark pool used by SQL according 
> to some configuration.
> This feature can achieve resource isolation between different SQL to a 
> certain extent, and avoid blocking the operation of lightweight SQL by SQL 
> that takes more resources.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to