Riza Suminto created IMPALA-12300:
-------------------------------------

             Summary: Turn Scheduler::CheckEffectiveInstanceCount to print 
warning 
                 Key: IMPALA-12300
                 URL: https://issues.apache.org/jira/browse/IMPALA-12300
             Project: IMPALA
          Issue Type: Improvement
            Reporter: Riza Suminto
            Assignee: Riza Suminto


Scheduler::CheckEffectiveInstanceCount was added to check consistency between 
FE planning and BE scheduling if COMPUTE_PROCESSING_COST=true. This consistency 
can be broken if there is a cluster membership change (new executor becomes 
online) between FE planning and BE scheduling. Say, in executor group size 10 
with 90% health threshold, admission-controller is allowed to run a query when 
only 9 executor is available. If 10th executor is online during BE scheduling, 
CheckEffectiveInstanceCount can fail and return error.

It should be OK to turn this error form CheckEffectiveInstanceCount into 
warning since query plan for fewer executor should generally OK to run in 
larger executor group size.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to