jens-scheffler-bosch commented on issue #35174: URL: https://github.com/apache/airflow/issues/35174#issuecomment-1781515443
Such feature is indirectly supported with a single "label" using the "queue" feature. You can assign tasks to "queues" and workers can pull work from one or multiple queues. (See https://airflow.apache.org/docs/apache-airflow/stable/core-concepts/executor/celery.html#queues) What is not currently possible is an `&&` and `||` selection with multiple labels. But this is hard to achieve - at least in Celery - because the work is queues in Redis (if not configured otherwise) and the queue names are used for the Redis queue. Adding a logic of multiple labels would probably re-work a lot of logic. But it is mainly inherited from the Celery-project. It is not specific to Airflow. So I assume (from my background) you need to request the feature rather in Celery (--> https://github.com/celery/celery) and once Airflow upgrades the feature much probably propagates here. Otherwise you can convince me of any other that this/such feature can be implemented in Airflow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
