potiuk edited a comment on issue #18846: URL: https://github.com/apache/airflow/issues/18846#issuecomment-942554333
> could not receive data from client: An existing connection was forcibly closed by the remote host. Asume you see it in the Postgres DB logs? Then likely something in-between - some firewall likely. If both parties are seing the other party closed connection, then it must be the firewall. Maybe the keepalive configuration did not work for some reason (you need to double check if they are actually coming) or mayb the firewall is more aggressive. One thing that COULD help a bit (though it would not likely address the root cause) is if you put PGBouncer between Airflow and Postgres DB (if you don't have it already). This is a recommended solution for Postgres (See the notes in "Setting Up the Database" https://airflow.apache.org/docs/apache-airflow/stable/howto/set-up-database.html?highlight=pgbouncer#setting-up-a-postgresql-database) and while it is unlikely it will cure the cause, if you put it close to Airflow and not behind the firewall, you might instead configure PGBouncer to do more aggressive KeepAlives and possibly even recover after connection is dropped. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
