syun64 commented on PR #13265: URL: https://github.com/apache/airflow/pull/13265#issuecomment-1496631859
Just following up on my own bug report on this PR for anyone who's facing a similar issue: I wasn't able to find the root cause for my issue, but I was able to resolve the issue by disabling connection pooling by setting **sql_alchemy_pool_enabled** to False. I am not an expert in database connections to put much weight on this, but there seem to be folks [recommending the use of NullPool](https://news.ycombinator.com/item?id=5346975) when the DB access is already managed through PgBouncer. And this seems to be anecdotally consistent with our experience in debugging our issue. Using NullPool resolved all of the connection issues we were having with our deployment, where the some of the schedulers would go into a bad state with the PostgreSQL DB connection, and the number of connections were still being managed by PgBouncer, with no visible performance degradations as a result of disabling connection pools. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
