And one more comment - if you are still at the "choose database" stage
Rolf, I HIGHLY, HIGHLY recommend Postgres.

Postgres is ROCK SOLID. The number of problems (especially in big
installation) that user raise with Postgres comparing to MySQL is like
"ZERO". Things like locking, HA, database encoding problems, etc. etc. are
continuous PAIN. It's such a pain that even Google's Cloud Composer team
took the difficult decision to migrate to Postgres for Airflow 2 even if
they used MySQL in 1.10.
This is mostly anecdotal, but Some of our committers who have year
experience mentioned that they've never, ever had to worry about postgres.
I've even seen a tweet recently "Postgres is better Mongo than Mongo" and I
heartily agree with it.

So in short - choose Postgres if you can. It will save you a lot of
headaches, especially if you want a "serious" installation.  Also it is
recommended to use PGbouncer with Airflow (it's part of the official Helm
Chart - https://airflow.apache.org/docs/helm-chart/stable/index.html ) and
I think that can make setting up HA  even easier.

J.
.

Reply via email to