[jira] [Updated] (AIRFLOW-5639) DagFileProcessor: parse dag files every time, which consume lots of resources and is unnecessary

2019-10-11 Thread chen xianxin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chen xianxin updated AIRFLOW-5639: -- Description: h2. Code airflow\models\dagbag.py: process_file(self, filepath,

[jira] [Updated] (AIRFLOW-5642) sqlalchemy.exc.OperationalError happens when sql is too long

2019-10-11 Thread chen xianxin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chen xianxin updated AIRFLOW-5642: -- Description: h2. code

[jira] [Created] (AIRFLOW-5642) sqlalchemy.exc.OperationalError happens when sql is too long

2019-10-11 Thread chen xianxin (Jira)
chen xianxin created AIRFLOW-5642: - Summary: sqlalchemy.exc.OperationalError happens when sql is too long Key: AIRFLOW-5642 URL: https://issues.apache.org/jira/browse/AIRFLOW-5642 Project: Apache

[jira] [Updated] (AIRFLOW-5642) sqlalchemy.exc.OperationalError happens when sql is too long, which cause scheduler processor be exited

2019-10-11 Thread chen xianxin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chen xianxin updated AIRFLOW-5642: -- Summary: sqlalchemy.exc.OperationalError happens when sql is too long, which cause scheduler

[jira] [Updated] (AIRFLOW-5642) sqlalchemy.exc.OperationalError happens when sql is too long, which cause scheduler processor will be exited

2019-10-11 Thread chen xianxin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chen xianxin updated AIRFLOW-5642: -- Summary: sqlalchemy.exc.OperationalError happens when sql is too long, which cause scheduler

[jira] [Updated] (AIRFLOW-5639) DagFileProcessor: parse dag files every time, which consume lots of resources and is unnecessary

2019-10-12 Thread chen xianxin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chen xianxin updated AIRFLOW-5639: -- Description:   h2. Code

[jira] [Updated] (AIRFLOW-5639) DagFileProcessor: parse dag files every time, which consume lots of resources and is unnecessary

2019-10-12 Thread chen xianxin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chen xianxin updated AIRFLOW-5639: -- Description:   h2. Code

[jira] [Updated] (AIRFLOW-5639) DagFileProcessor: parse dag files every time, which consume lots of resources and is unnecessary

2019-10-12 Thread chen xianxin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chen xianxin updated AIRFLOW-5639: -- Description: h2. Code airflow\models\dagbag.py: process_file(self, filepath,

[jira] [Updated] (AIRFLOW-5642) sqlalchemy.exc.OperationalError happens when sql is too long, which cause scheduler processor will be exited

2019-10-12 Thread chen xianxin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chen xianxin updated AIRFLOW-5642: -- Description: h2. code

[jira] [Closed] (AIRFLOW-5639) DagFileProcessor: parse dag files every time, which consume lots of resources and is unnecessary

2019-10-13 Thread chen xianxin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chen xianxin closed AIRFLOW-5639. - Resolution: Not A Problem Importing dag files provide task-dependencies and other information

[jira] [Updated] (AIRFLOW-5639) DagFileProcessor: parse dag files every time, which consume lots of resources and is unnecessary

2019-10-11 Thread chen xianxin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chen xianxin updated AIRFLOW-5639: -- Description: airflow\models\dagbag.py: process_file(self, filepath, only_if_updated=True,

[jira] [Created] (AIRFLOW-5639) DagFileProcessor: parse dag files every time, which consume lots of resources and is unnecessary

2019-10-11 Thread chen xianxin (Jira)
chen xianxin created AIRFLOW-5639: - Summary: DagFileProcessor: parse dag files every time, which consume lots of resources and is unnecessary Key: AIRFLOW-5639 URL:

[jira] [Comment Edited] (AIRFLOW-5642) sqlalchemy.exc.OperationalError happens when sql is too long, which cause scheduler processor will be exited

2019-10-16 Thread chen xianxin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952875#comment-16952875 ] chen xianxin edited comment on AIRFLOW-5642 at 10/16/19 2:25 PM: -

[jira] [Commented] (AIRFLOW-5642) sqlalchemy.exc.OperationalError happens when sql is too long, which cause scheduler processor will be exited

2019-10-16 Thread chen xianxin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952875#comment-16952875 ] chen xianxin commented on AIRFLOW-5642: --- max_tis_per_query seems to only work in here