Hi folks,

Here at Clover we're excitedly migrating to Airflow 1.10 (thanks for
everyone's hard work on that!). We're finding that it's taking about 2
hours to apply all the migrations to go from Airflow 1.8 to 1.10, largely
driven by the 10 million rows in our task_instance table. That got us
wondering what kind of maintenance people do on their Airflow metadata
databases. Do folks mostly put up with long migrations and generally longer
queries, or are y'all doing periodic cleanups of your metadata DB to keep
it fairly light?

Matt Davis

Reply via email to