FloChehab commented on issue #12995:
URL: https://github.com/apache/airflow/issues/12995#issuecomment-760367553
Thanks for the fast feedback @Squigilum !
After heavy investigations we found that SQLalchemy connection pooling was
causing the error (we already have pgbouncer in front of postgres).
So we set `sql_alchemy_pool_enabled` to `False` in airflow config and
changed the `celery_config_options` in celery config to point to a file
containing:
```python
from airflow.config_templates.default_celery import DEFAULT_CELERY_CONFIG
from sqlalchemy.pool import NullPool
CUSTOM_CELERY_CONFIG = {
**DEFAULT_CELERY_CONFIG,
"database_engine_options": {"poolclass": NullPool},
}
```
Everything seems to work fine now.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
