ashb commented on code in PR #58814:
URL: https://github.com/apache/airflow/pull/58814#discussion_r2580607360
##########
airflow-core/src/airflow/config_templates/config.yml:
##########
@@ -712,6 +712,20 @@ database:
type: integer
example: ~
default: "10000"
+ metadata_indexes:
+ description: |
+ JSON list of additional indexes to create on the metadata database at
API server startup.
+
+ Each item must be a string specifying the table and one or more
columns:
+ - "table(column1, column2, ...)"
+
+ Existing indexes are detected and skipped. On PostgreSQL, indexes are
created
+ CONCURRENTLY to avoid locking tables. Other databases attempt
non-blocking creation
+ where supported, otherwise fallback to standard index creation.
+ version_added: 3.2.0
+ type: string
+ example: "task_instance(dag_id, task_id,
run_id)|log(dttm)|dag_run(dag_id, run_id)"
Review Comment:
Spitballing some other ideas:
We could package this up as a plugin via an external DB manager.
We could have a special `indexes.sql` that we apply every time at start up.
We could just document "go apply these indexes".
The one disadvantage of the "just document it" approach is that it's
probably a lot easier for people to set configs or drop a special file in place
than it is to run SQL directly -- for instance on many managed service
providers you might not have SSH or SQL access to the DB anymore.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
