[
https://issues.apache.org/jira/browse/AIRFLOW-1980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dan Davydov updated AIRFLOW-1980:
---------------------------------
Description:
DB queries in the scheduler should be batched, since the larger ones can get
quite big and cause lock wait timeouts.
One example is the queries in the _change_state_for_tis_without_dagrun function
in jobs.py
The orphan task cleanup is another such piece of code that should have the
queries done in batch.
was:
DB queries in the scheduler should be batched, since the larger ones can get
quite big and cause lock wait timeouts.
One example is the queries in the _change_state_for_tis_without_dagrun function
in jobs.py
The orphan task cleanup is another such piece of code.
> Scheduler DB Queries Should be Batched
> --------------------------------------
>
> Key: AIRFLOW-1980
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1980
> Project: Apache Airflow
> Issue Type: Bug
> Components: scheduler
> Reporter: Dan Davydov
>
> DB queries in the scheduler should be batched, since the larger ones can get
> quite big and cause lock wait timeouts.
> One example is the queries in the _change_state_for_tis_without_dagrun
> function in jobs.py
> The orphan task cleanup is another such piece of code that should have the
> queries done in batch.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
