GitHub user coolacid added a comment to the discussion: Is there a function that allows the celery worker provided by airflow to take DAG from the Rabbitmq Quorum queue?
Celery now support quorum queues. https://github.com/celery/celery/issues/6067 You add the queue type to the Queue definition: ``` queue_arguments={'x-queue-type': 'quorum'} ``` However, in my work outside of Airflow, Celery really prefers using topic exchanges with routing keys in order to make use of quorum queues. Another note, you can't change queue types, you have to delete the old queue, then re-create the queue. So, the act of changing from classic to quorum queues would be a breaking change. I'm not sure the level of effort to make Airflow make use of celery with quorum queues yet. GitHub link: https://github.com/apache/airflow/discussions/35649#discussioncomment-12910911 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
