[jira] [Commented] (AIRFLOW-6804) Add the basic test for example DAGs

[ https://issues.apache.org/jira/browse/AIRFLOW-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036770#comment-17036770 ] ASF GitHub Bot commented on AIRFLOW-6804: - mik-laj commented on pull request #7

[GitHub] [airflow] mik-laj opened a new pull request #7419: [AIRFLOW-6804][depends on AIRFLOW-6792] Add the basic test for all example DAGs

mik-laj opened a new pull request #7419: [AIRFLOW-6804][depends on AIRFLOW-6792] Add the basic test for all example DAGs URL: https://github.com/apache/airflow/pull/7419 When DAG is loaded, simple checks are performed, e.g. whether python code syntactically correct, whether valid argument

[jira] [Work started] (AIRFLOW-6799) webgui cannot display all tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-6799 started by Soeren Laursen. --- > webgui cannot display all tasks > --- > >

[jira] [Closed] (AIRFLOW-2195) Task get terminatet before timeout reached

[ https://issues.apache.org/jira/browse/AIRFLOW-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Soeren Laursen closed AIRFLOW-2195. --- Resolution: Fixed > Task get terminatet before timeout reached > --

[GitHub] [airflow] codecov-io commented on issue #7415: [AIRFLOW-6800] Close file object after parsing ssh config

codecov-io commented on issue #7415: [AIRFLOW-6800] Close file object after parsing ssh config URL: https://github.com/apache/airflow/pull/7415#issuecomment-586149010 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7415?src=pr&el=h1) Report > Merging [#7415](https://codecov.io/gh

[GitHub] [airflow] mik-laj merged pull request #7415: [AIRFLOW-6800] Close file object after parsing ssh config

mik-laj merged pull request #7415: [AIRFLOW-6800] Close file object after parsing ssh config URL: https://github.com/apache/airflow/pull/7415 This is an automated message from the Apache Git Service. To respond to the messag

[jira] [Closed] (AIRFLOW-6800) SSHHook: Close file object when reading ssh config

[ https://issues.apache.org/jira/browse/AIRFLOW-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-6800. -- Fix Version/s: 1.10.10 Resolution: Fixed > SSHHook: Close file object when reading ssh

[jira] [Commented] (AIRFLOW-6800) SSHHook: Close file object when reading ssh config

[ https://issues.apache.org/jira/browse/AIRFLOW-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036786#comment-17036786 ] ASF GitHub Bot commented on AIRFLOW-6800: - mik-laj commented on pull request #7

[jira] [Commented] (AIRFLOW-6800) SSHHook: Close file object when reading ssh config

[ https://issues.apache.org/jira/browse/AIRFLOW-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036787#comment-17036787 ] ASF subversion and git services commented on AIRFLOW-6800: -- Co

[jira] [Created] (AIRFLOW-6805) Optimize conf.get ussage

Kamil Bregula created AIRFLOW-6805: -- Summary: Optimize conf.get ussage Key: AIRFLOW-6805 URL: https://issues.apache.org/jira/browse/AIRFLOW-6805 Project: Apache Airflow Issue Type: Bug

[jira] [Assigned] (AIRFLOW-6805) Optimize conf.get ussage

[ https://issues.apache.org/jira/browse/AIRFLOW-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula reassigned AIRFLOW-6805: -- Assignee: Kamil Bregula > Optimize conf.get ussage > > >

[jira] [Commented] (AIRFLOW-2219) Race condition to DagRun.verify_integrity between Scheduler and Webserver

[ https://issues.apache.org/jira/browse/AIRFLOW-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036815#comment-17036815 ] wei chea commented on AIRFLOW-2219: --- We seems to be facing the same issue as well. Th

[GitHub] [airflow] ashb merged pull request #7416: [AIRFLOW-6802] honor dag.max_active_run in scheduler

ashb merged pull request #7416: [AIRFLOW-6802] honor dag.max_active_run in scheduler URL: https://github.com/apache/airflow/pull/7416 This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [airflow] potiuk commented on issue #7191: [AIRFLOW-4030] second attempt to add singularity to airflow

potiuk commented on issue #7191: [AIRFLOW-4030] second attempt to add singularity to airflow URL: https://github.com/apache/airflow/pull/7191#issuecomment-586169342 > High level feedback since this was a topic earlier: > > * the extra linting for the Dockerfile, which comes down to f

[jira] [Commented] (AIRFLOW-6802) scheduler not honoring dag.max_active_run config

[ https://issues.apache.org/jira/browse/AIRFLOW-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036820#comment-17036820 ] ASF subversion and git services commented on AIRFLOW-6802: -- Co

[jira] [Resolved] (AIRFLOW-6802) scheduler not honoring dag.max_active_run config

[ https://issues.apache.org/jira/browse/AIRFLOW-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-6802. Fix Version/s: 2.0.0 Resolution: Fixed > scheduler not honoring dag.max_ac

[jira] [Commented] (AIRFLOW-6802) scheduler not honoring dag.max_active_run config

[ https://issues.apache.org/jira/browse/AIRFLOW-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036819#comment-17036819 ] ASF GitHub Bot commented on AIRFLOW-6802: - ashb commented on pull request #7416

[jira] [Updated] (AIRFLOW-4064) Edit DAG in FAB UI

[ https://issues.apache.org/jira/browse/AIRFLOW-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Fialkovsky updated AIRFLOW-4064: --- Description: The FAB UI haven't got an "edit" button I have a role "Admin" with al

[jira] [Created] (AIRFLOW-6806) Kubernetes Executor : Sometimes, task is succeeded, but pod is not completed ( keep running ) .

Matsubara Yuya created AIRFLOW-6806: --- Summary: Kubernetes Executor : Sometimes, task is succeeded, but pod is not completed ( keep running ) . Key: AIRFLOW-6806 URL: https://issues.apache.org/jira/browse/AIRFLO

[jira] [Updated] (AIRFLOW-6806) Kubernetes Executor : Sometimes, task is succeeded, but pod is not completed ( keep running ) .

[ https://issues.apache.org/jira/browse/AIRFLOW-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matsubara Yuya updated AIRFLOW-6806: Component/s: executors > Kubernetes Executor : Sometimes, task is succeeded, but pod is n

[jira] [Updated] (AIRFLOW-6806) Kubernetes Executor : Sometimes, task is succeeded, but pod is not completed ( keep running ) .

[ https://issues.apache.org/jira/browse/AIRFLOW-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matsubara Yuya updated AIRFLOW-6806: Description: The task completes successfully, and the result is able to check on the UI.

[GitHub] [airflow] ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379324932 ## File path: airflow/ti_deps/deps/branch_dep.py ## @@ -0,0 +1,63 @@ +# +# Licensed to the

[jira] [Updated] (AIRFLOW-6806) Kubernetes Executor : Sometimes, task is succeeded, but pod is not completed ( keep running ) . Zombie pod is born.

[ https://issues.apache.org/jira/browse/AIRFLOW-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matsubara Yuya updated AIRFLOW-6806: Summary: Kubernetes Executor : Sometimes, task is succeeded, but pod is not completed (

[jira] [Updated] (AIRFLOW-6806) Kubernetes Executor : Sometimes, task is succeeded, but pod is not completed ( keep running ) . Zombie pod is born.

[ https://issues.apache.org/jira/browse/AIRFLOW-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matsubara Yuya updated AIRFLOW-6806: Description: The task completes successfully, and the result is able to check on the UI.

[GitHub] [airflow] potiuk commented on issue #7389: [AIRFLOW-6763] Make systems tests ready for backport tests

potiuk commented on issue #7389: [AIRFLOW-6763] Make systems tests ready for backport tests URL: https://github.com/apache/airflow/pull/7389#issuecomment-586177817 Ping. This is an automated message from the Apache Git Servic

[GitHub] [airflow] potiuk closed pull request #6507: [DO NOT MERGE] POC of adding backportable packages

potiuk closed pull request #6507: [DO NOT MERGE] POC of adding backportable packages URL: https://github.com/apache/airflow/pull/6507 This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [airflow] potiuk commented on issue #6507: [DO NOT MERGE] POC of adding backportable packages

potiuk commented on issue #6507: [DO NOT MERGE] POC of adding backportable packages URL: https://github.com/apache/airflow/pull/6507#issuecomment-586178226 Can be closed. It was superseded by #7389 and #7391 This is an autom

[GitHub] [airflow] vsoch commented on issue #7191: [AIRFLOW-4030] second attempt to add singularity to airflow

vsoch commented on issue #7191: [AIRFLOW-4030] second attempt to add singularity to airflow URL: https://github.com/apache/airflow/pull/7191#issuecomment-586178588 I totally agree on all points! I can’t imagine what managing a PR board like this must be like. I’m mostly happy that t

[GitHub] [airflow] ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379328108 ## File path: airflow/models/skipmixin.py ## @@ -98,3 +98,17 @@ def skip_all_except(self,

[GitHub] [airflow] ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379329062 ## File path: airflow/operators/branch_operator.py ## @@ -48,4 +48,21 @@ def choose_branch

[GitHub] [airflow] ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379333409 ## File path: airflow/ti_deps/deps/branch_dep.py ## @@ -0,0 +1,63 @@ +# +# Licensed to the

[GitHub] [airflow] ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379327408 ## File path: airflow/ti_deps/deps/branch_dep.py ## @@ -0,0 +1,63 @@ +# +# Licensed to the

[GitHub] [airflow] ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379326946 ## File path: airflow/ti_deps/deps/branch_dep.py ## @@ -0,0 +1,63 @@ +# +# Licensed to the

[GitHub] [airflow] ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379332710 ## File path: airflow/ti_deps/deps/branch_dep.py ## @@ -0,0 +1,63 @@ +# +# Licensed to the

[GitHub] [airflow] ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379333613 ## File path: tests/operators/test_python.py ## @@ -396,7 +397,7 @@ def test_without_dag_r

[GitHub] [airflow] ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379334969 ## File path: airflow/models/baseoperator.py ## @@ -650,6 +651,7 @@ def deps(self) -> Set[

[GitHub] [airflow] ashb commented on a change in pull request #7413: [AIRFLOW-6793] Respect env variable in airflow config command

ashb commented on a change in pull request #7413: [AIRFLOW-6793] Respect env variable in airflow config command URL: https://github.com/apache/airflow/pull/7413#discussion_r379337056 ## File path: airflow/configuration.py ## @@ -372,6 +371,26 @@ def getsection(self, sectio

[GitHub] [airflow] ashb commented on a change in pull request #7413: [AIRFLOW-6793] Respect env variable in airflow config command

ashb commented on a change in pull request #7413: [AIRFLOW-6793] Respect env variable in airflow config command URL: https://github.com/apache/airflow/pull/7413#discussion_r379337486 ## File path: airflow/configuration.py ## @@ -372,6 +371,26 @@ def getsection(self, sectio

[GitHub] [airflow] ashb commented on a change in pull request #7413: [AIRFLOW-6793] Respect env variable in airflow config command

ashb commented on a change in pull request #7413: [AIRFLOW-6793] Respect env variable in airflow config command URL: https://github.com/apache/airflow/pull/7413#discussion_r379337848 ## File path: tests/cli/commands/test_config_command.py ## @@ -43,3 +43,10 @@ def test_cli

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7419: [AIRFLOW-6804][depends on AIRFLOW-6792] Add the basic test for all example DAGs

nuclearpinguin commented on a change in pull request #7419: [AIRFLOW-6804][depends on AIRFLOW-6792] Add the basic test for all example DAGs URL: https://github.com/apache/airflow/pull/7419#discussion_r379340229 ## File path: tests/test_project_structure.py ## @@ -251,3 +2

[jira] [Assigned] (AIRFLOW-6799) webgui cannot display all tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Soeren Laursen reassigned AIRFLOW-6799: --- Assignee: (was: Soeren Laursen) > webgui cannot display all tasks > --

[GitHub] [airflow] yuqian90 commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

yuqian90 commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379340298 ## File path: airflow/ti_deps/deps/branch_dep.py ## @@ -0,0 +1,63 @@ +# +# Licensed to

[jira] [Created] (AIRFLOW-6807) Kubernetes Executor in example fails with securityContext unknown parameter

Jarek Potiuk created AIRFLOW-6807: - Summary: Kubernetes Executor in example fails with securityContext unknown parameter Key: AIRFLOW-6807 URL: https://issues.apache.org/jira/browse/AIRFLOW-6807 Proje

[jira] [Commented] (AIRFLOW-6807) Kubernetes Executor in example fails with securityContext unknown parameter

[ https://issues.apache.org/jira/browse/AIRFLOW-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036852#comment-17036852 ] Jarek Potiuk commented on AIRFLOW-6807: --- Logs from there:  [https://travis-ci.org

[jira] [Updated] (AIRFLOW-6807) Kubernetes Executor in example fails with securityContext unknown parameter

[ https://issues.apache.org/jira/browse/AIRFLOW-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-6807: -- Attachment: 2020-02-13_kind_650079870_650079876.tar.gz > Kubernetes Executor in example fails

[jira] [Updated] (AIRFLOW-6799) webgui cannot display all tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Soeren Laursen updated AIRFLOW-6799: Priority: Blocker (was: Major) > webgui cannot display all tasks > -

[jira] [Updated] (AIRFLOW-6799) webgui cannot display all tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Soeren Laursen updated AIRFLOW-6799: Component/s: ui > webgui cannot display all tasks > --- > >

[GitHub] [airflow] yuqian90 commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

yuqian90 commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379344105 ## File path: tests/operators/test_python.py ## @@ -396,7 +397,7 @@ def test_without_d

[jira] [Updated] (AIRFLOW-6807) Kubernetes Executor in example fails with securityContext unknown parameter

[ https://issues.apache.org/jira/browse/AIRFLOW-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-6807: -- Description: I have found in the logs of kubernetes tests that there is a suspicious error w

[GitHub] [airflow] ashb commented on issue #7389: [AIRFLOW-6763] Make systems tests ready for backport tests

ashb commented on issue #7389: [AIRFLOW-6763] Make systems tests ready for backport tests URL: https://github.com/apache/airflow/pull/7389#issuecomment-586189517 Does this fall under AIP-4? That is still draft. Should we vote on that AIP? ---

[GitHub] [airflow] yuqian90 commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

yuqian90 commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379350352 ## File path: airflow/operators/branch_operator.py ## @@ -48,4 +48,21 @@ def choose_br

[jira] [Closed] (AIRFLOW-6806) Kubernetes Executor : Sometimes, task is succeeded, but pod is not completed ( keep running ) . Zombie pod is born.

[ https://issues.apache.org/jira/browse/AIRFLOW-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matsubara Yuya closed AIRFLOW-6806. --- Resolution: Not A Bug > Kubernetes Executor : Sometimes, task is succeeded, but pod is not

[jira] [Updated] (AIRFLOW-6806) Kubernetes Executor : Sometimes, task is succeeded, but pod is not completed ( keep running ) . Zombie pod is born.

[ https://issues.apache.org/jira/browse/AIRFLOW-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matsubara Yuya updated AIRFLOW-6806: Priority: Blocker (was: Critical) > Kubernetes Executor : Sometimes, task is succeeded,

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7322: [AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators

nuclearpinguin commented on a change in pull request #7322: [AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators URL: https://github.com/apache/airflow/pull/7322#discussion_r379367456 ## File path: airflow/providers/google/cloud/hooks/stackdriver.py ## @@ -0,0 +

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7322: [AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators

nuclearpinguin commented on a change in pull request #7322: [AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators URL: https://github.com/apache/airflow/pull/7322#discussion_r379368245 ## File path: airflow/providers/google/cloud/operators/stackdriver.py ## @@ -0

[GitHub] [airflow] peter-volkov commented on issue #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

peter-volkov commented on issue #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#issuecomment-586215220 @nuclearpinguin @potiuk that is good. Hope you will find some time to review it -

[GitHub] [airflow] yuqian90 commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

yuqian90 commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379379912 ## File path: airflow/operators/branch_operator.py ## @@ -48,4 +48,21 @@ def choose_br

[GitHub] [airflow] nuclearpinguin opened a new pull request #7420: [AIRFLOW-6558] Campaign Manager operators for conversions

nuclearpinguin opened a new pull request #7420: [AIRFLOW-6558] Campaign Manager operators for conversions URL: https://github.com/apache/airflow/pull/7420 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to mark the boxes below

[GitHub] [airflow] yuqian90 commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

yuqian90 commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379380497 ## File path: airflow/models/baseoperator.py ## @@ -650,6 +651,7 @@ def deps(self) ->

[jira] [Commented] (AIRFLOW-6558) Campaign Manager Operators to insert and modify conversions

[ https://issues.apache.org/jira/browse/AIRFLOW-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036925#comment-17036925 ] ASF GitHub Bot commented on AIRFLOW-6558: - nuclearpinguin commented on pull req

[jira] [Created] (AIRFLOW-6808) Add Google Cloud Container Operators

Jithin Sukumar created AIRFLOW-6808: --- Summary: Add Google Cloud Container Operators Key: AIRFLOW-6808 URL: https://issues.apache.org/jira/browse/AIRFLOW-6808 Project: Apache Airflow Issue T

[GitHub] [airflow] potiuk commented on issue #7389: [AIRFLOW-6763] Make systems tests ready for backport tests

potiuk commented on issue #7389: [AIRFLOW-6763] Make systems tests ready for backport tests URL: https://github.com/apache/airflow/pull/7389#issuecomment-586260298 Sure. I can start a discussion and vote on it - but I think we could merge that one independently (and show it as an example)

[GitHub] [airflow] potiuk edited a comment on issue #7389: [AIRFLOW-6763] Make systems tests ready for backport tests

potiuk edited a comment on issue #7389: [AIRFLOW-6763] Make systems tests ready for backport tests URL: https://github.com/apache/airflow/pull/7389#issuecomment-586260298 Sure. I can start a discussion and vote on it - but I think we could merge that one independently (and show it as an ex

[GitHub] [airflow] potiuk edited a comment on issue #7389: [AIRFLOW-6763] Make systems tests ready for backport tests

potiuk edited a comment on issue #7389: [AIRFLOW-6763] Make systems tests ready for backport tests URL: https://github.com/apache/airflow/pull/7389#issuecomment-586260298 Sure. I can start a discussion and vote on it - but I think we could merge that one independently (and show it as an ex

[GitHub] [airflow] ashb opened a new pull request #7421: [AIRFLOW-XXXX] Speed up mypy runs.

ashb opened a new pull request #7421: [AIRFLOW-] Speed up mypy runs. URL: https://github.com/apache/airflow/pull/7421 This PR does two things: 1. It enables the mypy cache (default folder name .mypy_cache) so that repeated runs locally are quicker 2. It _disables_ passing

[GitHub] [airflow] ashb commented on issue #7421: [AIRFLOW-XXXX] Speed up mypy runs.

ashb commented on issue #7421: [AIRFLOW-] Speed up mypy runs. URL: https://github.com/apache/airflow/pull/7421#issuecomment-586270461 I'm a little bit surprised by the difference, but it was consistent on my laptop. Would appreciate others testing too. -

[jira] [Created] (AIRFLOW-6809) Test for presto operators

Sayed Mohammad Hossein Torabi created AIRFLOW-6809: -- Summary: Test for presto operators Key: AIRFLOW-6809 URL: https://issues.apache.org/jira/browse/AIRFLOW-6809 Project: Apache Airflo

[jira] [Updated] (AIRFLOW-6808) Add Google Cloud Container Operators

[ https://issues.apache.org/jira/browse/AIRFLOW-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jithin Sukumar updated AIRFLOW-6808: Description: Add GCP Container management operators * Cluster creation * Node Pool Mana

[GitHub] [airflow] blcksrx opened a new pull request #7422: [AIRFLOW-6809] - Test for presto operators

blcksrx opened a new pull request #7422: [AIRFLOW-6809] - Test for presto operators URL: https://github.com/apache/airflow/pull/7422 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to mark the boxes below before creating PR:

[jira] [Commented] (AIRFLOW-6809) Test for presto operators

[ https://issues.apache.org/jira/browse/AIRFLOW-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036979#comment-17036979 ] ASF GitHub Bot commented on AIRFLOW-6809: - blcksrx commented on pull request #7

[GitHub] [airflow] ashb commented on issue #7421: [AIRFLOW-XXXX] Speed up mypy runs.

ashb commented on issue #7421: [AIRFLOW-] Speed up mypy runs. URL: https://github.com/apache/airflow/pull/7421#issuecomment-586290473 Seems to give a modest speed up on Travis (25s to 19s) This is an automated message from

[GitHub] [airflow] ashb commented on a change in pull request #6538: [AIRFLOW-5886] Selective copying of sources in Docker image.

ashb commented on a change in pull request #6538: [AIRFLOW-5886] Selective copying of sources in Docker image. URL: https://github.com/apache/airflow/pull/6538#discussion_r379436725 ## File path: Dockerfile ## @@ -357,6 +341,29 @@ RUN chmod +x "${HOME}/run-tests-complete"

[GitHub] [airflow] ashb commented on a change in pull request #6538: [AIRFLOW-5886] Selective copying of sources in Docker image.

ashb commented on a change in pull request #6538: [AIRFLOW-5886] Selective copying of sources in Docker image. URL: https://github.com/apache/airflow/pull/6538#discussion_r379438095 ## File path: Dockerfile ## @@ -357,6 +341,29 @@ RUN chmod +x "${HOME}/run-tests-complete"

[GitHub] [airflow] feluelle commented on a change in pull request #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results

feluelle commented on a change in pull request #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results URL: https://github.com/apache/airflow/pull/6075#discussion_r379362690 ## File path: airflow/providers/amazon/aws/hooks/athena.py ## @@ -116,7 +120,7 @@ def

[GitHub] [airflow] feluelle commented on a change in pull request #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results

feluelle commented on a change in pull request #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results URL: https://github.com/apache/airflow/pull/6075#discussion_r379362800 ## File path: airflow/providers/amazon/aws/hooks/athena.py ## @@ -132,7 +136,37 @@ def

[jira] [Closed] (AIRFLOW-1370) Scheduler is crashing because of IntegrityError

[ https://issues.apache.org/jira/browse/AIRFLOW-1370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor closed AIRFLOW-1370. -- Resolution: Cannot Reproduce Not happening in the scheduler anymore. Issues with thi

[jira] [Issue Comment Deleted] (AIRFLOW-2219) Race condition to DagRun.verify_integrity between Scheduler and Webserver

[ https://issues.apache.org/jira/browse/AIRFLOW-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-2219: --- Comment: was deleted (was: i get same error using trigger_dag in cli:   env local

[jira] [Commented] (AIRFLOW-2219) Race condition to DagRun.verify_integrity between Scheduler and Webserver

[ https://issues.apache.org/jira/browse/AIRFLOW-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036991#comment-17036991 ] Ash Berlin-Taylor commented on AIRFLOW-2219: [~weichea] Yours is a differen

[jira] [Comment Edited] (AIRFLOW-2219) Race condition to DagRun.verify_integrity between Scheduler and Webserver

[ https://issues.apache.org/jira/browse/AIRFLOW-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036991#comment-17036991 ] Ash Berlin-Taylor edited comment on AIRFLOW-2219 at 2/14/20 2:02 PM:

[jira] [Comment Edited] (AIRFLOW-2219) Race condition to DagRun.verify_integrity between Scheduler and Webserver

[ https://issues.apache.org/jira/browse/AIRFLOW-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036815#comment-17036815 ] wei chea edited comment on AIRFLOW-2219 at 2/14/20 2:03 PM:

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7363: [AIRFLOW-6730] Use total_seconds instead of seconds

nuclearpinguin commented on a change in pull request #7363: [AIRFLOW-6730] Use total_seconds instead of seconds URL: https://github.com/apache/airflow/pull/7363#discussion_r379452203 ## File path: tests/providers/google/cloud/operators/test_dataproc.py ## @@ -104,7 +104,7

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

nuclearpinguin commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#discussion_r379454451 ## File path: airflow/providers/yandex/operators/yandexcloud_dataproc_operator.py ## @@ -

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

nuclearpinguin commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#discussion_r379455746 ## File path: airflow/providers/yandex/operators/yandexcloud_dataproc_operator.py ## @@ -

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

nuclearpinguin commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#discussion_r379455746 ## File path: airflow/providers/yandex/operators/yandexcloud_dataproc_operator.py ## @@ -

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

nuclearpinguin commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#discussion_r379456748 ## File path: airflow/providers/yandex/operators/yandexcloud_dataproc_operator.py ## @@ -

[GitHub] [airflow] feluelle commented on a change in pull request #7422: [AIRFLOW-6809] Test for presto operators

feluelle commented on a change in pull request #7422: [AIRFLOW-6809] Test for presto operators URL: https://github.com/apache/airflow/pull/7422#discussion_r379456567 ## File path: tests/providers/presto/operators/test_presto_check.py ## @@ -0,0 +1,224 @@ +# +# Licensed to

[GitHub] [airflow] feluelle commented on issue #7422: [AIRFLOW-6809] Test for presto operators

feluelle commented on issue #7422: [AIRFLOW-6809] Test for presto operators URL: https://github.com/apache/airflow/pull/7422#issuecomment-586311321 Let me know when you have fixed the static checks / linting issues. :) This is

[GitHub] [airflow] peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#discussion_r379461908 ## File path: airflow/providers/yandex/operators/yandexcloud_dataproc_operator.py ## @@ -0,

[GitHub] [airflow] peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#discussion_r379461908 ## File path: airflow/providers/yandex/operators/yandexcloud_dataproc_operator.py ## @@ -0,

[GitHub] [airflow] blcksrx commented on issue #7422: [AIRFLOW-6809] Test for presto operators

blcksrx commented on issue #7422: [AIRFLOW-6809] Test for presto operators URL: https://github.com/apache/airflow/pull/7422#issuecomment-586314391 > Let me know when you have fixed the static checks / linting issues. :) thanks. can you check my last PR until I fix this =

[GitHub] [airflow] ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379470137 ## File path: airflow/ti_deps/deps/branch_dep.py ## @@ -0,0 +1,63 @@ +# +# Licensed to the

[GitHub] [airflow] ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared

ashb commented on a change in pull request #7276: [AIRFLOW-5391] Do not run skipped tasks when they are cleared URL: https://github.com/apache/airflow/pull/7276#discussion_r379470709 ## File path: tests/operators/test_python.py ## @@ -396,7 +397,7 @@ def test_without_dag_r

[GitHub] [airflow] ashb commented on issue #7421: [AIRFLOW-XXXX] Speed up mypy runs.

ashb commented on issue #7421: [AIRFLOW-] Speed up mypy runs. URL: https://github.com/apache/airflow/pull/7421#issuecomment-586350360 Sure, I'll test that out. This is an automated message from the Apache Git Service. To r

[jira] [Created] (AIRFLOW-6810) KubernetesPodOperator pod is completed but xcom side car is stuck

Maxence Cramet created AIRFLOW-6810: --- Summary: KubernetesPodOperator pod is completed but xcom side car is stuck Key: AIRFLOW-6810 URL: https://issues.apache.org/jira/browse/AIRFLOW-6810 Project: Ap

[GitHub] [airflow] stale[bot] closed pull request #5812: [AIRFLOW-4449] updated default permission for custom roles to 'Viewer'

stale[bot] closed pull request #5812: [AIRFLOW-4449] updated default permission for custom roles to 'Viewer' URL: https://github.com/apache/airflow/pull/5812 This is an automated message from the Apache Git Service. To respo

[jira] [Commented] (AIRFLOW-4449) Default permissions for custom roles

[ https://issues.apache.org/jira/browse/AIRFLOW-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17037106#comment-17037106 ] ASF GitHub Bot commented on AIRFLOW-4449: - stale[bot] commented on pull request

[jira] [Commented] (AIRFLOW-6795) serialized_dag table's data column text type is too small for mysql

[ https://issues.apache.org/jira/browse/AIRFLOW-6795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17037109#comment-17037109 ] ASF GitHub Bot commented on AIRFLOW-6795: - nritholtz commented on pull request

[GitHub] [airflow] nritholtz closed pull request #7414: [AIRFLOW-6795] Increase text size on data column in serialized_dag for MySQL

nritholtz closed pull request #7414: [AIRFLOW-6795] Increase text size on data column in serialized_dag for MySQL URL: https://github.com/apache/airflow/pull/7414 This is an automated message from the Apache Git Service. To

[GitHub] [airflow] potiuk commented on issue #7421: [AIRFLOW-XXXX] Speed up mypy runs.

potiuk commented on issue #7421: [AIRFLOW-] Speed up mypy runs. URL: https://github.com/apache/airflow/pull/7421#issuecomment-586372061 And BTW this is totally expect with our codebase if you think of it. It is yet another consequence of our airflow.__init__.py which immediately loads

[GitHub] [airflow] potiuk edited a comment on issue #7421: [AIRFLOW-XXXX] Speed up mypy runs.

potiuk edited a comment on issue #7421: [AIRFLOW-] Speed up mypy runs. URL: https://github.com/apache/airflow/pull/7421#issuecomment-586372061 And BTW this is totally expected with our codebase if you think of it. It is yet another consequence of our airflow.__init__.py which immediate

  1   2   >