GitHub user potiuk added a comment to the discussion: Scaling Airflow 3 on EKS — API server OOMs, PgBouncer saturation, and health check flakiness at 8K concurrent tasks
> the workers still open DB connections to the airflow_db ? thanks They open connection to **a** backend. If you use airflow as backend, then yes. But it's up to deployment manager to set the backend - they were always logically completely different - Celery manages it's own schema creation and communication. Also celery has different characteristics of accessing DB (I think - you will need to double check it) - one connection per celery worker, not per task as it was in Airlfow 2. GitHub link: https://github.com/apache/airflow/discussions/62117#discussioncomment-17991189 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
