GitHub user 202201142 added a comment to the discussion: Should Airflow keep SQLAlchemy connection pooling enabled when using PgBouncer (transaction pooling mode)?
Hello @archsyscall, Are you still using PgBouncer with Airflow 3.2.x? I'm considering adding PgBouncer because my PostgreSQL database is using around 2 GB of memory, and pg_stat_activity shows 60+ open idle connections. Before adding that I'd like to understand how to determine or figure out the right configuration. How did you decide on the pool size for each Airflow component (scheduler, workers, webserver, dag processor, etc.)? Also, what approach did you use to determine the appropriate max_connections and PgBouncer pool settings? Any guidance on where to start or best practices for sizing the pools would be greatly appreciated. Thank you! GitHub link: https://github.com/apache/airflow/discussions/56890#discussioncomment-17433448 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
