filipe-alves-itech opened a new issue, #33657: URL: https://github.com/apache/airflow/issues/33657
### Description Allow pools to be set dynamically for each dynamic mapped task index via the `expand` method as opposed to being limited to the current behaviour that forces only allows a static definition for all mapped tasks via the `partial` method. ### Use case/motivation Pools are very useful for having control over resource usage on the backend systems that can oftentimes be overwhelmed by the concurrent tasks triggered by Airflow. With dynamic mapped tasks, we can have a scenario where different mapped instances may start work in different backend servers where different pools come in handy to have control of the number of running for each backend server separately. Dynamic tasks were a game changer allowing to dynamically define parts of the DAG, making it more like a first-class citizen that benefits from the other stabilished Airflow features like pools is another step forward. ### Related issues _No response_ ### Are you willing to submit a PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
