[GitHub] [airflow] mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#discussion_r357000170 ## File path: airflow/jobs/scheduler_job.py ## @@ -1006,8 +978,7 @@ def _change_sta

[GitHub] [airflow] mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#discussion_r357000170 ## File path: airflow/jobs/scheduler_job.py ## @@ -1006,8 +978,7 @@ def _change_sta

[GitHub] [airflow] mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#discussion_r357000170 ## File path: airflow/jobs/scheduler_job.py ## @@ -1006,8 +978,7 @@ def _change_sta

[GitHub] [airflow] mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#discussion_r356997115 ## File path: airflow/models/dagrun.py ## @@ -286,25 +321,27 @@ def update_state(se

[GitHub] [airflow] RosterIn commented on issue #2460: [AIRFLOW-1424] make the next execution date of DAGs visible

RosterIn commented on issue #2460: [AIRFLOW-1424] make the next execution date of DAGs visible URL: https://github.com/apache/airflow/pull/2460#issuecomment-564890113 Would it be possible for this column to be configured from airflow.cfg with default `False`? Something like: `show_ne

[GitHub] [airflow] mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#discussion_r356995764 ## File path: airflow/models/dagrun.py ## @@ -263,10 +294,14 @@ def update_state(se

[GitHub] [airflow] mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#discussion_r356994088 ## File path: airflow/models/dagrun.py ## @@ -263,10 +294,14 @@ def update_state(se

[GitHub] [airflow] albertusk95 commented on a change in pull request #6795: Adjust the MASTER_URL of spark-submit in SparkSubmitHook

albertusk95 commented on a change in pull request #6795: Adjust the MASTER_URL of spark-submit in SparkSubmitHook URL: https://github.com/apache/airflow/pull/6795#discussion_r356992460 ## File path: airflow/contrib/hooks/spark_submit_hook.py ## @@ -185,6 +185,8 @@ def _res

[GitHub] [airflow] mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#discussion_r356991452 ## File path: airflow/jobs/scheduler_job.py ## @@ -1057,30 +1027,34 @@ def _find_ex

[GitHub] [airflow] mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#discussion_r356988665 ## File path: airflow/jobs/scheduler_job.py ## @@ -1006,8 +978,7 @@ def _change_sta

[GitHub] [airflow] mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#discussion_r356988211 ## File path: airflow/jobs/scheduler_job.py ## @@ -686,10 +664,10 @@ def _process_d

[GitHub] [airflow] mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#discussion_r356986778 ## File path: airflow/__init__.py ## @@ -48,3 +48,8 @@ login: Optional[Callable] =

[GitHub] [airflow] mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#discussion_r356986173 ## File path: airflow/ti_deps/deps/trigger_rule_dep.py ## @@ -34,9 +35,38 @@ class

[GitHub] [airflow] mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

mik-laj commented on a change in pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#discussion_r356986173 ## File path: airflow/ti_deps/deps/trigger_rule_dep.py ## @@ -34,9 +35,38 @@ class

[GitHub] [airflow] mik-laj commented on issue #6791: [AIRFLOW-XXX] Add link to XCom section in concepts.rst

mik-laj commented on issue #6791: [AIRFLOW-XXX] Add link to XCom section in concepts.rst URL: https://github.com/apache/airflow/pull/6791#issuecomment-564874675 @dimberman This is just a change in the documentation. Does this require a ticket? -

[jira] [Comment Edited] (AIRFLOW-6214) Spark driver status tracking for standalone, YARN, Mesos and K8s with cluster deploy mode

[ https://issues.apache.org/jira/browse/AIRFLOW-6214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16994276#comment-16994276 ] xifeng edited comment on AIRFLOW-6214 at 12/12/19 6:32 AM: --- H

[jira] [Commented] (AIRFLOW-6214) Spark driver status tracking for standalone, YARN, Mesos and K8s with cluster deploy mode

[ https://issues.apache.org/jira/browse/AIRFLOW-6214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16994276#comment-16994276 ] xifeng commented on AIRFLOW-6214: - yes, I agree, I think the conn.host should be only h

[jira] [Commented] (AIRFLOW-6212) SparkSubmitHook failed to execute spark-submit to standalone cluster

[ https://issues.apache.org/jira/browse/AIRFLOW-6212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16994260#comment-16994260 ] xifeng commented on AIRFLOW-6212: - Fix it with: https://github.com/apache/airflow/pull/

[GitHub] [airflow] baolsen commented on a change in pull request #6773: [AIRFLOW-6038] AWS DataSync example_dags added

baolsen commented on a change in pull request #6773: [AIRFLOW-6038] AWS DataSync example_dags added URL: https://github.com/apache/airflow/pull/6773#discussion_r356971393 ## File path: airflow/providers/amazon/aws/operators/datasync.py ## @@ -27,25 +25,45 @@ from airflow.

[GitHub] [airflow] mikolaje opened a new pull request #6795: Adjust the MASTER_URL of spark-submit in SparkSubmitHook

mikolaje opened a new pull request #6795: Adjust the MASTER_URL of spark-submit in SparkSubmitHook URL: https://github.com/apache/airflow/pull/6795 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.

[GitHub] [airflow] baolsen commented on a change in pull request #6773: [AIRFLOW-6038] AWS DataSync example_dags added

baolsen commented on a change in pull request #6773: [AIRFLOW-6038] AWS DataSync example_dags added URL: https://github.com/apache/airflow/pull/6773#discussion_r356970395 ## File path: airflow/providers/amazon/aws/operators/datasync.py ## @@ -27,25 +25,45 @@ from airflow.

[GitHub] [airflow] baolsen commented on a change in pull request #6773: [AIRFLOW-6038] AWS DataSync example_dags added

baolsen commented on a change in pull request #6773: [AIRFLOW-6038] AWS DataSync example_dags added URL: https://github.com/apache/airflow/pull/6773#discussion_r356969219 ## File path: airflow/providers/amazon/aws/example_dags/example_datasync_complex.py ## @@ -0,0 +1,101

[jira] [Comment Edited] (AIRFLOW-6214) Spark driver status tracking for standalone, YARN, Mesos and K8s with cluster deploy mode

[ https://issues.apache.org/jira/browse/AIRFLOW-6214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16994238#comment-16994238 ] Albertus Kelvin edited comment on AIRFLOW-6214 at 12/12/19 5:44 AM: -

[jira] [Commented] (AIRFLOW-6214) Spark driver status tracking for standalone, YARN, Mesos and K8s with cluster deploy mode

[ https://issues.apache.org/jira/browse/AIRFLOW-6214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16994238#comment-16994238 ] Albertus Kelvin commented on AIRFLOW-6214: -- hi [~dennisli], thanks for your co

[GitHub] [airflow] baolsen commented on issue #6773: [AIRFLOW-6038] AWS DataSync example_dags added

baolsen commented on issue #6773: [AIRFLOW-6038] AWS DataSync example_dags added URL: https://github.com/apache/airflow/pull/6773#issuecomment-564857060 Thanks for the great feedback @potiuk and @dimberman , I'll work through them now. A good opportunity for me to try some of the Git featur

[GitHub] [airflow] vsoch commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

vsoch commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-564847214 I thought so too! This is an automated message from the Apache Git

[GitHub] [airflow] pbranson commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

pbranson commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-564846284 I would like to add some community support for this to be merged please 👍 We would make use of this for using airflow in

[GitHub] [airflow] codecov-io edited a comment on issue #6765: [AIRFLOW-5889] Fix polling for AWS Batch job status

codecov-io edited a comment on issue #6765: [AIRFLOW-5889] Fix polling for AWS Batch job status URL: https://github.com/apache/airflow/pull/6765#issuecomment-563889078 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6765?src=pr&el=h1) Report > Merging [#6765](https://codecov.io/g

[GitHub] [airflow] codecov-io edited a comment on issue #6765: [AIRFLOW-5889] Fix polling for AWS Batch job status

codecov-io edited a comment on issue #6765: [AIRFLOW-5889] Fix polling for AWS Batch job status URL: https://github.com/apache/airflow/pull/6765#issuecomment-563889078 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6765?src=pr&el=h1) Report > Merging [#6765](https://codecov.io/g

[GitHub] [airflow] codecov-io edited a comment on issue #6765: [AIRFLOW-5889] Fix polling for AWS Batch job status

codecov-io edited a comment on issue #6765: [AIRFLOW-5889] Fix polling for AWS Batch job status URL: https://github.com/apache/airflow/pull/6765#issuecomment-563889078 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6765?src=pr&el=h1) Report > Merging [#6765](https://codecov.io/g

[jira] [Commented] (AIRFLOW-4184) Add an AWS Athena Helper to insert into table

[ https://issues.apache.org/jira/browse/AIRFLOW-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16994113#comment-16994113 ] Junyoung Park commented on AIRFLOW-4184: Now Athena support INSERT INTO clause.

[GitHub] [airflow] codecov-io edited a comment on issue #6794: [AIRFLOW-6231] Display DAG run conf in the graph view

codecov-io edited a comment on issue #6794: [AIRFLOW-6231] Display DAG run conf in the graph view URL: https://github.com/apache/airflow/pull/6794#issuecomment-564805241 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6794?src=pr&el=h1) Report > Merging [#6794](https://codecov.io

[GitHub] [airflow] codecov-io commented on issue #6794: [AIRFLOW-6231] Display DAG run conf in the graph view

codecov-io commented on issue #6794: [AIRFLOW-6231] Display DAG run conf in the graph view URL: https://github.com/apache/airflow/pull/6794#issuecomment-564805241 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6794?src=pr&el=h1) Report > Merging [#6794](https://codecov.io/gh/apa

[GitHub] [airflow] darrenleeweber commented on a change in pull request #6765: [AIRFLOW-5889] Fix polling for AWS Batch job status

darrenleeweber commented on a change in pull request #6765: [AIRFLOW-5889] Fix polling for AWS Batch job status URL: https://github.com/apache/airflow/pull/6765#discussion_r356908610 ## File path: airflow/contrib/operators/awsbatch_operator.py ## @@ -156,32 +179,68 @@ def

[GitHub] [airflow] darrenleeweber commented on a change in pull request #6765: [WIP][AIRFLOW-5889] Fix polling for AWS Batch job status

darrenleeweber commented on a change in pull request #6765: [WIP][AIRFLOW-5889] Fix polling for AWS Batch job status URL: https://github.com/apache/airflow/pull/6765#discussion_r356908842 ## File path: airflow/contrib/operators/awsbatch_operator.py ## @@ -156,32 +179,68 @@

[GitHub] [airflow] darrenleeweber commented on a change in pull request #6765: [WIP][AIRFLOW-5889] Fix polling for AWS Batch job status

darrenleeweber commented on a change in pull request #6765: [WIP][AIRFLOW-5889] Fix polling for AWS Batch job status URL: https://github.com/apache/airflow/pull/6765#discussion_r356908610 ## File path: airflow/contrib/operators/awsbatch_operator.py ## @@ -156,32 +179,68 @@

[GitHub] [airflow] konqui0 commented on a change in pull request #6767: [AIRFLOW-6208] Implement fileno in StreamLogWriter

konqui0 commented on a change in pull request #6767: [AIRFLOW-6208] Implement fileno in StreamLogWriter URL: https://github.com/apache/airflow/pull/6767#discussion_r356894253 ## File path: airflow/utils/log/logging_mixin.py ## @@ -116,6 +116,13 @@ def isatty(self):

[GitHub] [airflow] dimberman commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error

dimberman commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error URL: https://github.com/apache/airflow/pull/6643#issuecomment-564787657 @ashb @davlum bumping this ticket as I would like to get this merged.

[jira] [Commented] (AIRFLOW-6084) Add info endpoint to experimental api

[ https://issues.apache.org/jira/browse/AIRFLOW-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16994007#comment-16994007 ] ASF GitHub Bot commented on AIRFLOW-6084: - dimberman commented on pull request

[jira] [Commented] (AIRFLOW-6084) Add info endpoint to experimental api

[ https://issues.apache.org/jira/browse/AIRFLOW-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16994008#comment-16994008 ] ASF subversion and git services commented on AIRFLOW-6084: -- Co

[GitHub] [airflow] dimberman merged pull request #6651: [AIRFLOW-6084] Add info endpoint to experimental api

dimberman merged pull request #6651: [AIRFLOW-6084] Add info endpoint to experimental api URL: https://github.com/apache/airflow/pull/6651 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] dimberman commented on issue #6791: [AIRFLOW-XXX] Add link to XCom section in concepts.rst

dimberman commented on issue #6791: [AIRFLOW-XXX] Add link to XCom section in concepts.rst URL: https://github.com/apache/airflow/pull/6791#issuecomment-564786532 @pradeepbhadani please create a JIRA and add to the title of this PR --

[jira] [Work started] (AIRFLOW-6231) Show DAG Run conf in graph view

[ https://issues.apache.org/jira/browse/AIRFLOW-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-6231 started by Daniel Huang. - > Show DAG Run conf in graph view > --- > >

[jira] [Commented] (AIRFLOW-6231) Show DAG Run conf in graph view

[ https://issues.apache.org/jira/browse/AIRFLOW-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993998#comment-16993998 ] ASF GitHub Bot commented on AIRFLOW-6231: - dhuang commented on pull request #67

[GitHub] [airflow] dhuang opened a new pull request #6794: [AIRFLOW-6231] Display DAG run conf in the graph view

dhuang opened a new pull request #6794: [AIRFLOW-6231] Display DAG run conf in the graph view URL: https://github.com/apache/airflow/pull/6794 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.org/j

[GitHub] [airflow] konqui0 commented on a change in pull request #6767: [AIRFLOW-6208] Implement fileno in StreamLogWriter

konqui0 commented on a change in pull request #6767: [AIRFLOW-6208] Implement fileno in StreamLogWriter URL: https://github.com/apache/airflow/pull/6767#discussion_r356894253 ## File path: airflow/utils/log/logging_mixin.py ## @@ -116,6 +116,13 @@ def isatty(self):

[jira] [Created] (AIRFLOW-6231) Show DAG Run conf in graph view

Daniel Huang created AIRFLOW-6231: - Summary: Show DAG Run conf in graph view Key: AIRFLOW-6231 URL: https://issues.apache.org/jira/browse/AIRFLOW-6231 Project: Apache Airflow Issue Type: Impr

[jira] [Commented] (AIRFLOW-6211) Document using conda virtualenv for development

[ https://issues.apache.org/jira/browse/AIRFLOW-6211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993988#comment-16993988 ] ASF subversion and git services commented on AIRFLOW-6211: -- Co

[jira] [Commented] (AIRFLOW-6226) warning.catch_warning should not be used in our code

[ https://issues.apache.org/jira/browse/AIRFLOW-6226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993989#comment-16993989 ] ASF subversion and git services commented on AIRFLOW-6226: -- Co

[jira] [Commented] (AIRFLOW-6018) Display task instance in table during backfilling

[ https://issues.apache.org/jira/browse/AIRFLOW-6018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993984#comment-16993984 ] ASF subversion and git services commented on AIRFLOW-6018: -- Co

[jira] [Commented] (AIRFLOW-6191) Adjust pytest verbosity in CI and local environment

[ https://issues.apache.org/jira/browse/AIRFLOW-6191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993986#comment-16993986 ] ASF subversion and git services commented on AIRFLOW-6191: -- Co

[jira] [Commented] (AIRFLOW-6189) Reduce the maximum test duration to 8 minutes

[ https://issues.apache.org/jira/browse/AIRFLOW-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993983#comment-16993983 ] ASF subversion and git services commented on AIRFLOW-6189: -- Co

[jira] [Commented] (AIRFLOW-6216) Allow pytests to be run without "tests"

[ https://issues.apache.org/jira/browse/AIRFLOW-6216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993987#comment-16993987 ] ASF subversion and git services commented on AIRFLOW-6216: -- Co

[jira] [Commented] (AIRFLOW-6018) Display task instance in table during backfilling

[ https://issues.apache.org/jira/browse/AIRFLOW-6018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993985#comment-16993985 ] ASF subversion and git services commented on AIRFLOW-6018: -- Co

[jira] [Commented] (AIRFLOW-1076) Support getting variable by string in templates

[ https://issues.apache.org/jira/browse/AIRFLOW-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993968#comment-16993968 ] ASF GitHub Bot commented on AIRFLOW-1076: - dhuang commented on pull request #67

[GitHub] [airflow] dhuang commented on issue #2223: [AIRFLOW-1076] Add get method for template variable accessor

dhuang commented on issue #2223: [AIRFLOW-1076] Add get method for template variable accessor URL: https://github.com/apache/airflow/pull/2223#issuecomment-564772309 Re-opened a PR in https://github.com/apache/airflow/pull/6793. -

[GitHub] [airflow] dhuang opened a new pull request #6793: [AIRFLOW-1076] Add get method for template variable accessor

dhuang opened a new pull request #6793: [AIRFLOW-1076] Add get method for template variable accessor URL: https://github.com/apache/airflow/pull/6793 Support getting variables in templates by string. This is necessary when fetching variables with characters not allowed in a class attribu

[jira] [Comment Edited] (AIRFLOW-6207) Dag run twice in airflow

[ https://issues.apache.org/jira/browse/AIRFLOW-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993931#comment-16993931 ] anilkumar edited comment on AIRFLOW-6207 at 12/11/19 10:07 PM: --

[jira] [Commented] (AIRFLOW-6207) Dag run twice in airflow

[ https://issues.apache.org/jira/browse/AIRFLOW-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993931#comment-16993931 ] anilkumar commented on AIRFLOW-6207: I have attached my production dags images i ho

[jira] [Updated] (AIRFLOW-6207) Dag run twice in airflow

[ https://issues.apache.org/jira/browse/AIRFLOW-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anilkumar updated AIRFLOW-6207: --- Attachment: airflow11.PNG airflow10.png airflow9.PNG

[jira] [Updated] (AIRFLOW-6207) Dag run twice in airflow

[ https://issues.apache.org/jira/browse/AIRFLOW-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anilkumar updated AIRFLOW-6207: --- Attachment: airflow1.PNG > Dag run twice in airflow > > >

[jira] [Updated] (AIRFLOW-6207) Dag run twice in airflow

[ https://issues.apache.org/jira/browse/AIRFLOW-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anilkumar updated AIRFLOW-6207: --- Attachment: (was: airflow1.PNG) > Dag run twice in airflow > > >

[GitHub] [airflow] antonymayi commented on issue #6088: [AIRFLOW-5349] Add schedulername option for KubernetesPodOperator

antonymayi commented on issue #6088: [AIRFLOW-5349] Add schedulername option for KubernetesPodOperator URL: https://github.com/apache/airflow/pull/6088#issuecomment-564752633 > @antonymayi I don't think you meant to change 1043 files for this PR. ah, sorry, bad rebase... fixed -

[jira] [Commented] (AIRFLOW-203) Scheduler fails to reliably schedule tasks when many dag runs are triggered

[ https://issues.apache.org/jira/browse/AIRFLOW-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993910#comment-16993910 ] Nidhi commented on AIRFLOW-203: --- I am facing the same issue as I have around 60,000 tasks

[jira] [Commented] (AIRFLOW-3909) cant read log file for previous tries with multiply celery workers

[ https://issues.apache.org/jira/browse/AIRFLOW-3909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993909#comment-16993909 ] Nidhi commented on AIRFLOW-3909: I faced the same issues. This issue is solved , you ca

[jira] [Comment Edited] (AIRFLOW-5506) Airflow scheduler stuck

[ https://issues.apache.org/jira/browse/AIRFLOW-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993899#comment-16993899 ] Nidhi edited comment on AIRFLOW-5506 at 12/11/19 9:11 PM: -- I a

[jira] [Commented] (AIRFLOW-5881) Dag gets stuck in "Scheduled" State when scheduling a large number of tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993898#comment-16993898 ] Nidhi commented on AIRFLOW-5881: I am facing the same issue as I have around 60,000 tas

[jira] [Commented] (AIRFLOW-5506) Airflow scheduler stuck

[ https://issues.apache.org/jira/browse/AIRFLOW-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993899#comment-16993899 ] Nidhi commented on AIRFLOW-5506: I am facing the same issue as I have around 60,000 tas

[GitHub] [airflow] ultrabug commented on a change in pull request #2460: [AIRFLOW-1424] make the next execution date of DAGs visible

ultrabug commented on a change in pull request #2460: [AIRFLOW-1424] make the next execution date of DAGs visible URL: https://github.com/apache/airflow/pull/2460#discussion_r356832756 ## File path: airflow/jobs.py ## @@ -892,6 +891,11 @@ def create_dag_run(self, dag, sess

[GitHub] [airflow] ultrabug commented on a change in pull request #2460: [AIRFLOW-1424] make the next execution date of DAGs visible

ultrabug commented on a change in pull request #2460: [AIRFLOW-1424] make the next execution date of DAGs visible URL: https://github.com/apache/airflow/pull/2460#discussion_r356832756 ## File path: airflow/jobs.py ## @@ -892,6 +891,11 @@ def create_dag_run(self, dag, sess

[jira] [Commented] (AIRFLOW-6225) Better Logging for the K8sPodOperator

[ https://issues.apache.org/jira/browse/AIRFLOW-6225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993879#comment-16993879 ] Daniel Imberman commented on AIRFLOW-6225: -- Hi [~xbhuang], We just created th

[jira] [Commented] (AIRFLOW-6225) Better Logging for the K8sPodOperator

[ https://issues.apache.org/jira/browse/AIRFLOW-6225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993877#comment-16993877 ] Xinbin Huang commented on AIRFLOW-6225: --- Hi [~dimberman], what is the progress on

[jira] [Comment Edited] (AIRFLOW-5616) PrestoHook to use prestodb

[ https://issues.apache.org/jira/browse/AIRFLOW-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993875#comment-16993875 ] Gaurav Sehgal edited comment on AIRFLOW-5616 at 12/11/19 8:25 PM: ---

[jira] [Commented] (AIRFLOW-5616) PrestoHook to use prestodb

[ https://issues.apache.org/jira/browse/AIRFLOW-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993875#comment-16993875 ] Gaurav Sehgal commented on AIRFLOW-5616: Hi, if no one working on this. I could

[jira] [Commented] (AIRFLOW-5744) Environment variables not correctly set in Spark submit operator

[ https://issues.apache.org/jira/browse/AIRFLOW-5744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993869#comment-16993869 ] Joseph McCartin commented on AIRFLOW-5744: -- The fix is somewhat simple, but it

[jira] [Commented] (AIRFLOW-5930) Reduce time spent building SQL strings

[ https://issues.apache.org/jira/browse/AIRFLOW-5930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993866#comment-16993866 ] ASF GitHub Bot commented on AIRFLOW-5930: - ashb commented on pull request #6792

[GitHub] [airflow] ashb opened a new pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

ashb opened a new pull request #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792 Make sure you have checked _all_ steps below. ### Jira - [x] https://issues.apache.org/jira/browse/AIRFLOW-5930 ### D

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

nuclearpinguin commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r356806438 ## File path: tests/executors/test_inprocess_executor.py ## @@ -0,0 +1,116 @@ +# Licensed to the Apache S

[GitHub] [airflow] dimberman commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

dimberman commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r356802770 ## File path: tests/executors/test_inprocess_executor.py ## @@ -0,0 +1,116 @@ +# Licensed to the Apache Softwa

[GitHub] [airflow] dimberman commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

dimberman commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r356802582 ## File path: airflow/executors/executor_loader.py ## @@ -57,21 +59,20 @@ def _get_executor(executor_name: str

[jira] [Updated] (AIRFLOW-5744) Environment variables not correctly set in Spark submit operator

[ https://issues.apache.org/jira/browse/AIRFLOW-5744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph McCartin updated AIRFLOW-5744: - Description: AIRFLOW-2380 added support for setting environment variables at runtime fo

[GitHub] [airflow] dimberman commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor

dimberman commented on a change in pull request #6740: [AIRFLOW-6181] Add InProcessExecutor URL: https://github.com/apache/airflow/pull/6740#discussion_r356801542 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -232,6 +232,11 @@ api_client = airflow.api.cl

[GitHub] [airflow] digger commented on a change in pull request #6784: [AIRFLOW-6171] Apply .airflowignore to correct subdirectories

digger commented on a change in pull request #6784: [AIRFLOW-6171] Apply .airflowignore to correct subdirectories URL: https://github.com/apache/airflow/pull/6784#discussion_r356791260 ## File path: tests/dags/subdir1/test_ignore_this.py ## @@ -0,0 +1,40 @@ +# -*- coding:

[GitHub] [airflow] digger commented on a change in pull request #6784: [AIRFLOW-6171] Apply .airflowignore to correct subdirectories

digger commented on a change in pull request #6784: [AIRFLOW-6171] Apply .airflowignore to correct subdirectories URL: https://github.com/apache/airflow/pull/6784#discussion_r356790841 ## File path: tests/dags/subdir2/test_dont_ignore_this.py ## @@ -0,0 +1,35 @@ +# -*- cod

[airflow-site] branch aijamalnk-patch-1 updated (9d62ea2 -> 5347c87)

This is an automated email from the ASF dual-hosted git repository. aizhamal pushed a change to branch aijamalnk-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git. from 9d62ea2 A blog post announcing the new website add 5347c87 adding the links to new and old

[GitHub] [airflow-site] aijamalnk opened a new pull request #218: A blog post announcing the new website

aijamalnk opened a new pull request #218: A blog post announcing the new website URL: https://github.com/apache/airflow-site/pull/218 @mik-laj could you take a look? This is an automated message from the Apache Git Service. To

[airflow-site] branch aijamalnk-patch-1 created (now 9d62ea2)

This is an automated email from the ASF dual-hosted git repository. aizhamal pushed a change to branch aijamalnk-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git. at 9d62ea2 A blog post announcing the new website This branch includes the following new commits:

[airflow-site] 01/01: A blog post announcing the new website

This is an automated email from the ASF dual-hosted git repository. aizhamal pushed a commit to branch aijamalnk-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git commit 9d62ea27a675deb17be7dc45fe6d8cd042be0fd1 Author: Aizhamal Nurmamat kyzy AuthorDate: Wed Dec 11 11:10:

[jira] [Commented] (AIRFLOW-6058) Run tests with pytest

[ https://issues.apache.org/jira/browse/AIRFLOW-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993824#comment-16993824 ] ASF subversion and git services commented on AIRFLOW-6058: -- Co

[GitHub] [airflow] dimberman commented on a change in pull request #6765: [WIP][AIRFLOW-5889] Fix polling for AWS Batch job status

dimberman commented on a change in pull request #6765: [WIP][AIRFLOW-5889] Fix polling for AWS Batch job status URL: https://github.com/apache/airflow/pull/6765#discussion_r356768774 ## File path: airflow/contrib/operators/awsbatch_operator.py ## @@ -156,32 +179,68 @@ def

[GitHub] [airflow] dimberman commented on a change in pull request #6773: [AIRFLOW-6038] AWS DataSync example_dags added

dimberman commented on a change in pull request #6773: [AIRFLOW-6038] AWS DataSync example_dags added URL: https://github.com/apache/airflow/pull/6773#discussion_r356767772 ## File path: airflow/providers/amazon/aws/hooks/datasync.py ## @@ -76,44 +80,52 @@ def create_locat

[GitHub] [airflow] KKcorps commented on issue #6762: [AIRFLOW-XXX] Add task lifecycle image to documentation

KKcorps commented on issue #6762: [AIRFLOW-XXX] Add task lifecycle image to documentation URL: https://github.com/apache/airflow/pull/6762#issuecomment-564660703 Looks great! This is an automated message from the Apache G

[jira] [Closed] (AIRFLOW-6217) KubernetesPodOperator XCom pushes not working

[ https://issues.apache.org/jira/browse/AIRFLOW-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Serdyuk closed AIRFLOW-6217. --- Resolution: Not A Bug This issue relates to the versions incompatibility. Seems like it wa

[jira] [Comment Edited] (AIRFLOW-6217) KubernetesPodOperator XCom pushes not working

[ https://issues.apache.org/jira/browse/AIRFLOW-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993742#comment-16993742 ] Eugene Serdyuk edited comment on AIRFLOW-6217 at 12/11/19 5:36 PM: --

[jira] [Commented] (AIRFLOW-6217) KubernetesPodOperator XCom pushes not working

[ https://issues.apache.org/jira/browse/AIRFLOW-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993742#comment-16993742 ] Eugene Serdyuk commented on AIRFLOW-6217: - Finally got it working even on 1.11.

[jira] [Commented] (AIRFLOW-6230) Improve mocking in GCP tests

[ https://issues.apache.org/jira/browse/AIRFLOW-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993701#comment-16993701 ] ASF subversion and git services commented on AIRFLOW-6230: -- Co

[jira] [Resolved] (AIRFLOW-6230) Improve mocking in GCP tests

[ https://issues.apache.org/jira/browse/AIRFLOW-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-6230. --- Fix Version/s: 1.10.7 Resolution: Fixed > Improve mocking in GCP tests > ---

[GitHub] [airflow] potiuk merged pull request #6789: [Airflow-6230] Improve mocking in GCP tests

potiuk merged pull request #6789: [Airflow-6230] Improve mocking in GCP tests URL: https://github.com/apache/airflow/pull/6789 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] codecov-io edited a comment on issue #6771: [AIRFLOW-6121] [API-21] Rename CloudBuildCreateBuildOperator

codecov-io edited a comment on issue #6771: [AIRFLOW-6121] [API-21] Rename CloudBuildCreateBuildOperator URL: https://github.com/apache/airflow/pull/6771#issuecomment-564572271 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6771?src=pr&el=h1) Report > Merging [#6771](https://cod

[GitHub] [airflow] codecov-io edited a comment on issue #6771: [AIRFLOW-6121] [API-21] Rename CloudBuildCreateBuildOperator

codecov-io edited a comment on issue #6771: [AIRFLOW-6121] [API-21] Rename CloudBuildCreateBuildOperator URL: https://github.com/apache/airflow/pull/6771#issuecomment-564572271 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6771?src=pr&el=h1) Report > Merging [#6771](https://cod

  1   2   3   >