aa1371 opened a new pull request #16829: URL: https://github.com/apache/airflow/pull/16829
This change allows specifying queues while using the DaskExecutor to route tasks to specific subsets of workers. Tests and docs updated. This can introduce breaking changes, since with this change if the dask workers are not started with complementary resources to match the specified queues, it will now result in an AirflowException, whereas before it would have just ignored the queue argument. I think this is an acceptable breaking change since it reduces ambiguity in how the DAGs are executed. closes: #16739 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
