GitHub user trikker added a comment to the discussion: Is there a function that allows the celery worker provided by airflow to take DAG from the Rabbitmq Quorum queue?
> @trikker Oh, thank you for the information. I've been stuck using RabbitMQ > 3.xx because quorum queue support wasn't available, but if Airflow upgrades > the Celery version soon, I should be able to use RabbitMQ 4.xx. That means I > won't have to worry about setting up RabbitMQ clusters or mirroring anymore. > Thanks for letting me know! Welcome. I am new to RabbitMQ, but I find that RabbitMQ 3.13 supports Quorum Queues, link: https://www.rabbitmq.com/docs/3.13/quorum-queues , so I think you don't have to upgrade to RabbitMQ 4.xx to use the Quorum Queues. But we need to wait for Airflow to upgrade its Celery version. GitHub link: https://github.com/apache/airflow/discussions/35649#discussioncomment-11291645 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
