I'm always interested in better alternatives, thanks for the advise! For all kinds of historical reasons we are using a lot of MariaDB/Galera. In particular the scalability provided by Galera (active-active clusters) is of value, and has no equivalent altternative I think. And the headaches ... not really so far.
For airflow we could consider postgress though; will look into that. On Wed, 2021-07-21 at 10:18 +0200, Jarek Potiuk wrote: And one more comment - if you are still at the "choose database" stage Rolf, I HIGHLY, HIGHLY recommend Postgres. Postgres is ROCK SOLID. The number of problems (especially in big installation) that user raise with Postgres comparing to MySQL is like "ZERO". Things like locking, HA, database encoding problems, etc. etc. are continuous PAIN. It's such a pain that even Google's Cloud Composer team took the difficult decision to migrate to Postgres for Airflow 2 even if they used MySQL in 1.10. This is mostly anecdotal, but Some of our committers who have year experience mentioned that they've never, ever had to worry about postgres. I've even seen a tweet recently "Postgres is better Mongo than Mongo" and I heartily agree with it. So in short - choose Postgres if you can. It will save you a lot of headaches, especially if you want a "serious" installation. Also it is recommended to use PGbouncer with Airflow (it's part of the official Helm Chart - https://airflow.apache.org/docs/helm-chart/stable/index.html ) and I think that can make setting up HA even easier. J. .
