[ 
https://issues.apache.org/jira/browse/AIRFLOW-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16952875#comment-16952875
 ] 

chen xianxin commented on AIRFLOW-5642:
---------------------------------------

max_tis_per_query seems to only work in here 
[https://github.com/apache/airflow/blob/v1-10-stable/airflow/jobs/scheduler_job.py#L1172-L1183,]
 if executor.queued_tasks has too many tasks were not executed, 
sqlalchemy.exc.OperationalError will occur

> sqlalchemy.exc.OperationalError happens when sql is too long, which cause 
> scheduler processor will be exited
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-5642
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5642
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 1.10.5
>            Reporter: chen xianxin
>            Priority: Minor
>
> h2. code
> https://github.com/apache/airflow/blob/v1-10-stable/airflow/jobs/scheduler_job.py#L1060-L1069
> h2. Error description
> {{if there is too many queued_tasks, sqlalchemy.exc.OperationalError will 
> occur. details are as follow:}}
> {{<}}
> {{sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (2006, 
> "MySQL server has gone away (BrokenPipeError(32, 'Broken pipe'))")}}
>  [SQL: SELECT ...]
> (Background on this error at: [http://sqlalche.me/e/e3q8])
> {{> }}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to