GitHub user jojaeng2 added a comment to the discussion: Is there a function that allows the celery worker provided by airflow to take DAG from the Rabbitmq Quorum queue?
Ah, thanks. You're right—I had forgotten since I've been thinking about this issue for a long time. As you mentioned, it's true that I don’t necessarily need to upgrade RabbitMQ to use quorum queues, but there are several reasons why I want to move to version 4.xx. Currently, I’m using version 3.12.xx, which is nearing its EOL. In addition, with version 3.xx, there are too many considerations when setting up clustering, mirroring, and handling network partitions. I believe quorum queues offer a good solution to these issues, which is why I’m eager to upgrade to 4.xx. However, starting from 4.xx, classic queues are no longer supported, so I have to keep 3.xx for compatibility with Airflow. GitHub link: https://github.com/apache/airflow/discussions/35649#discussioncomment-11299656 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
