GitHub user trikker added a comment to the discussion: Is there a function that allows the celery worker provided by airflow to take DAG from the Rabbitmq Quorum queue?
> Thank you for your kind answer. After looking at various issues and official > documents, my conclusion is that Celery currently provided by Airflow does > not seem to be able to conceive the Quorum Queue of RabbitMQ or the Stream > type Queue. I think an environment variable or an additional config field > should be added, but if I have a chance, I will contribute. Thank you again. Hi, I find a configuration "task_default_queue_type" in celery but it is added in Celery 5.5, its default value is "classic" https://docs.celeryq.dev/en/latest/userguide/configuration.html#task-default-queue-type it can be set to "quorum", but the version of celery in airflow(2.10.3, currently newest) is 5.4, so we cannot use it for now. So we need to wait for the version upgrade of Celery in airflow or request the version upgrade of Celery by writing a issue. GitHub link: https://github.com/apache/airflow/discussions/35649#discussioncomment-11287306 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
