milton0825 edited a comment on issue #4949: [AIRFLOW-1557] Backfill should 
respect pool limit
URL: https://github.com/apache/airflow/pull/4949#issuecomment-475507984
 
 
   @feng-tao  
   The description is correct. The backfill should either be limited by the 
default `non_pooled_backfill_task_slot_count` or the pool specified through 
`backfill --pool`. 
   I think we should use a different pool for backfill instead of re-using the 
pool used by the normal scheduling. We can prevent backfill tasks from 
occupying all the pool slots and starve the normal tasks.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to