[
https://issues.apache.org/jira/browse/DRILL-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hanifi Gunes updated DRILL-4136:
--------------------------------
Issue Type: Sub-task (was: Improvement)
Parent: DRILL-4186
> Enhance queue support to take query cost & available cluster resources into
> account
> -----------------------------------------------------------------------------------
>
> Key: DRILL-4136
> URL: https://issues.apache.org/jira/browse/DRILL-4136
> Project: Apache Drill
> Issue Type: Sub-task
> Components: Execution - Flow
> Affects Versions: 1.3.0
> Reporter: Hanifi Gunes
> Assignee: Hanifi Gunes
>
> Current queue support relies on a distributed semaphore around a fix
> pre-defined number. This semaphore indicates the number of queries Drill can
> run concurrently. Presently, we define small and large queues where we
> classify queries based on a threshold and use two semaphores around small and
> large queues individually.
> This issue proposes to come up with an enhanced queueing or query dispatch
> mechanism where a query is granted execution based on its cost and
> availability of system resources(cpu, io, memory etc). Enhancing cost planing
> and introducing a distributed resource management should be addressed later
> to fully benefit from this enhancement. The proposal is a non-blocking and
> asynchronous mechanism that assumes eventual consistency around available
> system resources.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
