Good luck. Let us know how it goes! On Wed, Jul 21, 2021 at 10:49 AM Rolf Fokkens <[email protected]> wrote:
> I'm always interested in better alternatives, thanks for the advise! > > For all kinds of historical reasons we are using a lot of MariaDB/Galera. > In particular the scalability provided by Galera (active-active clusters) > is of value, and has no equivalent altternative I think. And the headaches > ... not really so far. > > For airflow we could consider postgress though; will look into that. > > On Wed, 2021-07-21 at 10:18 +0200, Jarek Potiuk wrote: > > And one more comment - if you are still at the "choose database" stage > Rolf, I HIGHLY, HIGHLY recommend Postgres. > > Postgres is ROCK SOLID. The number of problems (especially in big > installation) that user raise with Postgres comparing to MySQL is like > "ZERO". Things like locking, HA, database encoding problems, etc. etc. are > continuous PAIN. It's such a pain that even Google's Cloud Composer team > took the difficult decision to migrate to Postgres for Airflow 2 even if > they used MySQL in 1.10. > This is mostly anecdotal, but Some of our committers who have year > experience mentioned that they've never, ever had to worry about postgres. > I've even seen a tweet recently "Postgres is better Mongo than Mongo" and I > heartily agree with it. > > So in short - choose Postgres if you can. It will save you a lot of > headaches, especially if you want a "serious" installation. Also it is > recommended to use PGbouncer with Airflow (it's part of the official Helm > Chart - https://airflow.apache.org/docs/helm-chart/stable/index.html ) > and I think that can make setting up HA even easier. > > J. > . > > > -- +48 660 796 129
