insomnes opened a new issue, #46787:
URL: https://github.com/apache/airflow/issues/46787

   ### Description
   
   We should be able to configure parallelism limit separately for each 
executor.
   
   Or at least for local / k8s pair
   
   ### Use case/motivation
   
   With the practical `LocalExecutor` <-> `KubernetesExecutor` pair for example 
we can have tons of tasks running freely in the k8s environment, but we need to 
limit the local executor to some small value to not overload the scheduler pod. 
 And it's very tedious to run an extra scheduler for k8s environment 
unleashing. 
   
   I believe, that for other multiple configurations idea of total parallelism, 
limitation would depend on used executor too. 
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [x] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to