Hi!

Not sure if this is the proper place for this question; of not please let me 
know.

We're running airflow on a mariadb/galera cluster, and we 're using haproxy to 
provide HA connections. Sometimes (mostly due to maintenance) one node is 
temporarily unavailalble, which forces haproxy to drop connections to this node 
after which new connections are passed to another (still running) node. This is 
quite common, and we use it for other software too. See 
https://galeracluster.com/library/documentation/ha-proxy.html.<https://galeracluster.com/library/documentation/ha-proxy.html>
 for more info.

The issue we're running into however is the fact that airflow gets lost in this 
situation which to airflow is something like a dropped connection. airflow 
services seem to be running (they themselves thing they are running) but 
they're just stuck. So they don't do anything, but we don't know.

Aiming at a HA setup, this is deffinitely not what we want. Colleages actually 
are now at the point that they disqualify airflow.

Of course I can provide more details if needed, but I'd like to know first if 
this is the right place to bring this up.

Best,

Rolf

Reply via email to