Hi All,
We have requirement to run 10k(s) of concurrent tasks. We are exploring 
Airflow's Celery Executor for same. Horizontally Scaling of worker nodes seem 
possible but it can only have one active scheduler.
So will Airflow scheduler be able to handle these many concurrent tasks.
Is there any benchmarking number  around airflow scheduler's scalability.

Reply via email to