GitHub user paj26 added a comment to the discussion: Scaling Airflow 3 on EKS — API server OOMs, PgBouncer saturation, and health check flakiness at 8K concurrent tasks
> @gilt-cl thanks for the analysis and particularly the configs. Have you > managed to get anywhere on this? Am particularly interested in the assertion > that pgbouncer is no longer needed, am struggling with getting Postgres > running on this. Also have split my api-server into core and execution, but > that’s not my bottleneck. I should mention on this one, I was working with 3.2.0 and having an incredibly difficult time getting it working, probably ended up with a much more complex set up (PGBouncer) than needed, because there was apparently a bug in 3.2.0 related to this. Moving to 3.2.1 works super smoothly (still using PGBouncer) GitHub link: https://github.com/apache/airflow/discussions/62117#discussioncomment-17966584 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
