GitHub user potiuk added a comment to the discussion: How to trigger a dagrun and specify a queue, so that the same dag can be executed on different workers.
I think the only way you can try to achieve it is by introducing a custom cluster policy https://airflow.apache.org/docs/apache-airflow/stable/administration-and-deployment/cluster-policies.html -> generally speaking queue is not overrideable at runtime by the user - because it is part of the dag defintion, but "task_instance_mutation_hook" is executed before the task instance is queued, and then it can - I think - modify the queue based on any of the parameters passed. It has to be done carefully of course, and such dag run will not respect some of the assertions that schedulers calculate (for example scheduler will not schedule for exection tasks if their queue is full). but assuming this is something you want to "override" and you want to rely on the user knowing what they are doing, I think it might be doable. GitHub link: https://github.com/apache/airflow/discussions/46880#discussioncomment-12247706 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
