[GitHub] [airflow] mik-laj edited a comment on issue #6622: [AIRLFOW-6024] Do not use the logger in CLI

mik-laj edited a comment on issue #6622: [AIRLFOW-6024] Do not use the logger in CLI URL: https://github.com/apache/airflow/pull/6622#issuecomment-556976441 There is no need to use the logger because all messages are intended to be displayed on the console. This should not be saved to a

[jira] [Created] (AIRFLOW-6028) Add a Looker Hook.

Nathan Hadfield created AIRFLOW-6028: Summary: Add a Looker Hook. Key: AIRFLOW-6028 URL: https://issues.apache.org/jira/browse/AIRFLOW-6028 Project: Apache Airflow Issue Type: New

[jira] [Assigned] (AIRFLOW-6028) Add a Looker Hook.

[ https://issues.apache.org/jira/browse/AIRFLOW-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Hadfield reassigned AIRFLOW-6028: Assignee: Nathan Hadfield > Add a Looker Hook. > -- > >

[GitHub] [airflow] stale[bot] commented on issue #6254: [AIRFLOW-5591] Remove Glyphicons in favor of FontAwesome icons

stale[bot] commented on issue #6254: [AIRFLOW-5591] Remove Glyphicons in favor of FontAwesome icons URL: https://github.com/apache/airflow/pull/6254#issuecomment-557027825 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no

[GitHub] [airflow] ashb commented on issue #6623: Donating Google's Airflow K8s Operator to Apache Foundation

ashb commented on issue #6623: Donating Google's Airflow K8s Operator to Apache Foundation URL: https://github.com/apache/airflow/pull/6623#issuecomment-556995070 Excited to see we finally got here! A couple of thoughts/comments: - Would this be better off in a different repo

[GitHub] [airflow] ashb edited a comment on issue #6623: Donating Google's Airflow K8s Operator to Apache Foundation

ashb edited a comment on issue #6623: Donating Google's Airflow K8s Operator to Apache Foundation URL: https://github.com/apache/airflow/pull/6623#issuecomment-556995070 Excited to see we finally got here! A couple of thoughts/comments: - Would this be better off in a

[jira] [Updated] (AIRFLOW-6028) Add a Looker Hook.

[ https://issues.apache.org/jira/browse/AIRFLOW-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Hadfield updated AIRFLOW-6028: - Description: This addition of a hook for Looker ([https://looker.com/]) will enable

[GitHub] [airflow] mik-laj commented on issue #6622: [AIRLFOW-6024] Do not use the logger in CLI

mik-laj commented on issue #6622: [AIRLFOW-6024] Do not use the logger in CLI URL: https://github.com/apache/airflow/pull/6622#issuecomment-556976441 There is no need to use the logger because all messages are intended to be displayed on the screen. This should not be saved to a file. If

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6622: [AIRLFOW-6024] Do not use the logger in CLI

nuclearpinguin commented on a change in pull request #6622: [AIRLFOW-6024] Do not use the logger in CLI URL: https://github.com/apache/airflow/pull/6622#discussion_r348963624 ## File path: airflow/cli/commands/dag_command.py ## @@ -104,16 +104,15 @@ def dag_trigger(args):

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6622: [AIRLFOW-6024] Do not use the logger in CLI

nuclearpinguin commented on a change in pull request #6622: [AIRLFOW-6024] Do not use the logger in CLI URL: https://github.com/apache/airflow/pull/6622#discussion_r348963675 ## File path: airflow/cli/commands/dag_command.py ## @@ -125,16 +124,15 @@ def dag_delete(args):

[jira] [Created] (AIRFLOW-6029) Allow webserver to bind to multiple address

Mathieu Cinquin created AIRFLOW-6029: Summary: Allow webserver to bind to multiple address Key: AIRFLOW-6029 URL: https://issues.apache.org/jira/browse/AIRFLOW-6029 Project: Apache Airflow

[GitHub] [airflow] ratb3rt commented on a change in pull request #6609: [AIRFLOW-5950] AIP-21 Change import paths for "apache/cassandra" modules

ratb3rt commented on a change in pull request #6609: [AIRFLOW-5950] AIP-21 Change import paths for "apache/cassandra" modules URL: https://github.com/apache/airflow/pull/6609#discussion_r349019087 ## File path: scripts/ci/pylint_todo.txt ## @@ -1,4 +1,5 @@

[GitHub] [airflow] mik-laj edited a comment on issue #6622: [AIRLFOW-6024] Do not use the logger in CLI

mik-laj edited a comment on issue #6622: [AIRLFOW-6024] Do not use the logger in CLI URL: https://github.com/apache/airflow/pull/6622#issuecomment-556976441 There is no need to use the logger because all messages are intended to be displayed on the console. This should not be saved to a

[GitHub] [airflow] mik-laj edited a comment on issue #6622: [AIRLFOW-6024] Do not use the logger in CLI

mik-laj edited a comment on issue #6622: [AIRLFOW-6024] Do not use the logger in CLI URL: https://github.com/apache/airflow/pull/6622#issuecomment-556976441 There is no need to use the logger because all messages are intended to be displayed on the console. This should not be saved to a

[GitHub] [airflow] codecov-io edited a comment on issue #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration

codecov-io edited a comment on issue #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration URL: https://github.com/apache/airflow/pull/6124#issuecomment-556979532 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6124?src=pr=h1) Report >

[GitHub] [airflow] codecov-io commented on issue #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration

codecov-io commented on issue #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration URL: https://github.com/apache/airflow/pull/6124#issuecomment-556979532 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6124?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration

codecov-io edited a comment on issue #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration URL: https://github.com/apache/airflow/pull/6124#issuecomment-556979532 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6124?src=pr=h1) Report >

[GitHub] [airflow] qlemaire22 commented on issue #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration

qlemaire22 commented on issue #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration URL: https://github.com/apache/airflow/pull/6124#issuecomment-556979944 The tests are successful now.

[jira] [Updated] (AIRFLOW-5072) gcs_hook causes out-of-memory error when downloading huge files

[ https://issues.apache.org/jira/browse/AIRFLOW-5072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5072: --- Fix Version/s: (was: 2.0.0) 1.10.7 > gcs_hook causes

[GitHub] [airflow] nuclearpinguin commented on issue #6621: [AIRFLOW-6025] Add label to uniquely identify creator of Pod

nuclearpinguin commented on issue #6621: [AIRFLOW-6025] Add label to uniquely identify creator of Pod URL: https://github.com/apache/airflow/pull/6621#issuecomment-557094437 It seems that we have a flaky test: ``` Traceback (most recent call last):

[jira] [Commented] (AIRFLOW-5931) Spawning new python interpreter for every task slow

[ https://issues.apache.org/jira/browse/AIRFLOW-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979356#comment-16979356 ] ASF GitHub Bot commented on AIRFLOW-5931: - ashb commented on pull request #6627: [AIRFLOW-5931]

[GitHub] [airflow] ashb opened a new pull request #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

ashb opened a new pull request #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627 Make sure you have checked _all_ steps below. ### Jira - [x] https://issues.apache.org/jira/browse/AIRFLOW-5931

[jira] [Comment Edited] (AIRFLOW-6013) Last heartbeat check does not account for execution time of session.commit()

[ https://issues.apache.org/jira/browse/AIRFLOW-6013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979290#comment-16979290 ] Oliver Frost edited comment on AIRFLOW-6013 at 11/21/19 1:57 PM: - Just

[GitHub] [airflow] ashb commented on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

ashb commented on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#issuecomment-557132298 My benchmarking results of this change below. All my tests were of `BashOperator(..., bash_command="true")`.

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349062357 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349052059 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349049920 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349062029 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349063292 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349049272 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349062851 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349052555 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[jira] [Updated] (AIRFLOW-5931) Spawning new python interpreter for every task slow

[ https://issues.apache.org/jira/browse/AIRFLOW-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5931: --- Summary: Spawning new python interpreter for every task slow (was: Spawning new

[jira] [Created] (AIRFLOW-6030) add ability to interact with Marketo

lovk korm created AIRFLOW-6030: -- Summary: add ability to interact with Marketo Key: AIRFLOW-6030 URL: https://issues.apache.org/jira/browse/AIRFLOW-6030 Project: Apache Airflow Issue Type: Bug

[GitHub] [airflow] stale[bot] commented on issue #6273: [AIRFLOW-5039] Fix broken XCom JSON serialization

stale[bot] commented on issue #6273: [AIRFLOW-5039] Fix broken XCom JSON serialization URL: https://github.com/apache/airflow/pull/6273#issuecomment-557049250 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity

[GitHub] [airflow] KKcorps commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

KKcorps commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349088616 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache

[jira] [Closed] (AIRFLOW-5859) Tasks locking and heartbeat warnings

[ https://issues.apache.org/jira/browse/AIRFLOW-5859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacob Ward closed AIRFLOW-5859. --- Resolution: Invalid > Tasks locking and heartbeat warnings >

[GitHub] [airflow] JavierLopezT commented on a change in pull request #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer

JavierLopezT commented on a change in pull request #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer URL: https://github.com/apache/airflow/pull/6396#discussion_r349121915 ## File path: tests/operators/test_redshift_to_s3_operator.py ## @@ -31,7

[GitHub] [airflow] JavierLopezT commented on a change in pull request #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer

JavierLopezT commented on a change in pull request #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer URL: https://github.com/apache/airflow/pull/6396#discussion_r346397018 ## File path: tests/operators/test_redshift_to_s3_operator.py ## @@ -51,23

[GitHub] [airflow] JavierLopezT commented on a change in pull request #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer

JavierLopezT commented on a change in pull request #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer URL: https://github.com/apache/airflow/pull/6396#discussion_r345707738 ## File path: airflow/operators/redshift_to_s3_operator.py ## @@ -103,19

[jira] [Closed] (AIRFLOW-5308) Pass credentials object to pandas_gbq

[ https://issues.apache.org/jira/browse/AIRFLOW-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-5308. -- Fix Version/s: 1.10.7 Resolution: Fixed > Pass credentials object to pandas_gbq >

[GitHub] [airflow] nuclearpinguin opened a new pull request #6626: Test commit

nuclearpinguin opened a new pull request #6626: Test commit URL: https://github.com/apache/airflow/pull/6626 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and

[jira] [Closed] (AIRFLOW-5877) Improve job_id detection in DataflowRunner

[ https://issues.apache.org/jira/browse/AIRFLOW-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-5877. -- Fix Version/s: 2.0.0 Resolution: Fixed > Improve job_id detection in DataflowRunner >

[jira] [Closed] (AIRFLOW-5310) Add PrestoToGoogleStorageOperator

[ https://issues.apache.org/jira/browse/AIRFLOW-5310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-5310. -- Resolution: Duplicate > Add PrestoToGoogleStorageOperator >

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349061827 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349053006 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349053499 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349053798 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349048944 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349052009 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349053904 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349048684 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349051235 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349050914 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349062979 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349061642 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349052306 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349062575 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349052656 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

ashb commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r349053376 ## File path: docs/best-practices.rst ## @@ -0,0 +1,271 @@ + .. Licensed to the Apache Software

[jira] [Created] (AIRFLOW-6031) Check for additional sleep time in LocalTaskJob is flawed

Oliver Frost created AIRFLOW-6031: - Summary: Check for additional sleep time in LocalTaskJob is flawed Key: AIRFLOW-6031 URL: https://issues.apache.org/jira/browse/AIRFLOW-6031 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-6013) Last heartbeat check does not account for execution time of session.commit()

[ https://issues.apache.org/jira/browse/AIRFLOW-6013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979290#comment-16979290 ] Oliver Frost commented on AIRFLOW-6013: --- Just wanted to file the same issue. I think an

[GitHub] [airflow] eserdyuk-exos commented on issue #6614: [AIRFLOW-6020] fix python 3 KubernetesExecutor iteritems exception

eserdyuk-exos commented on issue #6614: [AIRFLOW-6020] fix python 3 KubernetesExecutor iteritems exception URL: https://github.com/apache/airflow/pull/6614#issuecomment-557099468 @mik-laj well, it's fixed now. This is an

[GitHub] [airflow] dimberman commented on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

dimberman commented on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#issuecomment-557130023 I have tested this locally and it seems to work fine. @ashb when are situations where CAN_FORK is

[jira] [Updated] (AIRFLOW-5082) add subject in aws sns hook

[ https://issues.apache.org/jira/browse/AIRFLOW-5082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5082: --- Fix Version/s: (was: 2.0.0) 1.10.7 > add subject in aws sns

[jira] [Commented] (AIRFLOW-4938) next_execution_date is not a Pendulum object

[ https://issues.apache.org/jira/browse/AIRFLOW-4938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979371#comment-16979371 ] jack commented on AIRFLOW-4938: --- Was fixed in 1.10.4: https://issues.apache.org/jira/browse/AIRFLOW-4788

[jira] [Updated] (AIRFLOW-5474) Add Basic Auth to Druid hook

[ https://issues.apache.org/jira/browse/AIRFLOW-5474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5474: --- Fix Version/s: (was: 2.0.0) 1.10.7 > Add Basic Auth to

[GitHub] [airflow] zacharya19 commented on a change in pull request #6489: [AIRFLOW-3959] [AIRFLOW-4026] Add filter by DAG tags

zacharya19 commented on a change in pull request #6489: [AIRFLOW-3959] [AIRFLOW-4026] Add filter by DAG tags URL: https://github.com/apache/airflow/pull/6489#discussion_r349197932 ## File path: airflow/www/views.py ## @@ -213,6 +218,18 @@ def get_int_arg(value,

[GitHub] [airflow] kaxil commented on a change in pull request #6621: [AIRFLOW-6025] Add label to uniquely identify creator of Pod

kaxil commented on a change in pull request #6621: [AIRFLOW-6025] Add label to uniquely identify creator of Pod URL: https://github.com/apache/airflow/pull/6621#discussion_r349232197 ## File path: airflow/contrib/operators/kubernetes_pod_operator.py ## @@ -127,6 +128,15

[GitHub] [airflow] codecov-io edited a comment on issue #6489: [AIRFLOW-3959] [AIRFLOW-4026] Add filter by DAG tags

codecov-io edited a comment on issue #6489: [AIRFLOW-3959] [AIRFLOW-4026] Add filter by DAG tags URL: https://github.com/apache/airflow/pull/6489#issuecomment-552128422 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6489?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-3185) Add chunking to DBAPI_hook by implementing fetchmany and pandas chunksize

[ https://issues.apache.org/jira/browse/AIRFLOW-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979489#comment-16979489 ] jack commented on AIRFLOW-3185: --- [~tomanizer] do you have a final version to PR? > Add chunking to

[jira] [Resolved] (AIRFLOW-5451) Spark Submit Hook don't set namespace if default

[ https://issues.apache.org/jira/browse/AIRFLOW-5451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5451. Fix Version/s: (was: 2.0.0) 1.10.7 Resolution:

[jira] [Updated] (AIRFLOW-6028) Add and Looker Hook and Operators.

[ https://issues.apache.org/jira/browse/AIRFLOW-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Hadfield updated AIRFLOW-6028: - Component/s: operators > Add and Looker Hook and Operators. >

[jira] [Updated] (AIRFLOW-6028) Add and Looker Hook and Operators.

[ https://issues.apache.org/jira/browse/AIRFLOW-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Hadfield updated AIRFLOW-6028: - Summary: Add and Looker Hook and Operators. (was: Add a Looker Hook.) > Add and

[jira] [Commented] (AIRFLOW-6023) Remove deprecated Celery configs

[ https://issues.apache.org/jira/browse/AIRFLOW-6023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979465#comment-16979465 ] ASF subversion and git services commented on AIRFLOW-6023: -- Commit

[GitHub] [airflow] kaxil merged pull request #6620: [AIRFLOW-6023] Remove deprecated Celery configs

kaxil merged pull request #6620: [AIRFLOW-6023] Remove deprecated Celery configs URL: https://github.com/apache/airflow/pull/6620 This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Commented] (AIRFLOW-6023) Remove deprecated Celery configs

[ https://issues.apache.org/jira/browse/AIRFLOW-6023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979464#comment-16979464 ] ASF GitHub Bot commented on AIRFLOW-6023: - kaxil commented on pull request #6620:

[jira] [Created] (AIRFLOW-6034) Fix Deprecation Elasticsearch configs on Master

Kaxil Naik created AIRFLOW-6034: --- Summary: Fix Deprecation Elasticsearch configs on Master Key: AIRFLOW-6034 URL: https://issues.apache.org/jira/browse/AIRFLOW-6034 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-6035) Remove comand method in TaskInstance

[ https://issues.apache.org/jira/browse/AIRFLOW-6035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-6035: --- Summary: Remove comand method in TaskInstance (was: Remove comand method in Task) >

[jira] [Updated] (AIRFLOW-5701) Don't clear xcom explicitly before execution

[ https://issues.apache.org/jira/browse/AIRFLOW-5701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5701: --- Fix Version/s: (was: 2.0.0) > Don't clear xcom explicitly before execution >

[jira] [Reopened] (AIRFLOW-5701) Don't clear xcom explicitly before execution

[ https://issues.apache.org/jira/browse/AIRFLOW-5701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5701: > Don't clear xcom explicitly before execution >

[jira] [Resolved] (AIRFLOW-5701) Don't clear xcom explicitly before execution

[ https://issues.apache.org/jira/browse/AIRFLOW-5701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5701. Resolution: Won't Fix > Don't clear xcom explicitly before execution >

[jira] [Reopened] (AIRFLOW-4940) DynamoDB to S3 backup operator

[ https://issues.apache.org/jira/browse/AIRFLOW-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-4940: > DynamoDB to S3 backup operator > -- > >

[jira] [Resolved] (AIRFLOW-4940) DynamoDB to S3 backup operator

[ https://issues.apache.org/jira/browse/AIRFLOW-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-4940. Fix Version/s: 1.10.7 Resolution: Fixed > DynamoDB to S3 backup operator

[jira] [Created] (AIRFLOW-6033) UI crashes at "Landing Time" after switching task_id caps/small letters

ivan de los santos created AIRFLOW-6033: --- Summary: UI crashes at "Landing Time" after switching task_id caps/small letters Key: AIRFLOW-6033 URL: https://issues.apache.org/jira/browse/AIRFLOW-6033

[jira] [Assigned] (AIRFLOW-6033) UI crashes at "Landing Time" after switching task_id caps/small letters

[ https://issues.apache.org/jira/browse/AIRFLOW-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ivan de los santos reassigned AIRFLOW-6033: --- Assignee: ivan de los santos > UI crashes at "Landing Time" after

[jira] [Assigned] (AIRFLOW-6033) UI crashes at "Landing Time" after switching task_id caps/small letters

[ https://issues.apache.org/jira/browse/AIRFLOW-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ivan de los santos reassigned AIRFLOW-6033: --- Assignee: (was: ivan de los santos) > UI crashes at "Landing Time"

[jira] [Work started] (AIRFLOW-5931) Spawning new python interpreter for every task slow

[ https://issues.apache.org/jira/browse/AIRFLOW-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5931 started by Ash Berlin-Taylor. -- > Spawning new python interpreter for every task slow >

[GitHub] [airflow] kaxil commented on issue #6628: [AIRFLOW-6034] Fix Deprecation Elasticsearch configs on Master

kaxil commented on issue #6628: [AIRFLOW-6034] Fix Deprecation Elasticsearch configs on Master URL: https://github.com/apache/airflow/pull/6628#issuecomment-557211496 I had fixed incorrect label in https://github.com/apache/airflow/pull/6620 but I didn't know that they were wrong i. key

[jira] [Updated] (AIRFLOW-4897) Location not used to create empty dataset by bigquery_hook cursor

[ https://issues.apache.org/jira/browse/AIRFLOW-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-4897: --- Component/s: gcp > Location not used to create empty dataset by bigquery_hook cursor >

[GitHub] [airflow] deshraj commented on issue #6380: [AIRFLOW-3632] Allow replace_microseconds in trigger_dag REST request

deshraj commented on issue #6380: [AIRFLOW-3632] Allow replace_microseconds in trigger_dag REST request URL: https://github.com/apache/airflow/pull/6380#issuecomment-557221923 @ashb may I ask you about the release timeline for this feature?

[jira] [Created] (AIRFLOW-6035) Remove comand method in Task

Kamil Bregula created AIRFLOW-6035: -- Summary: Remove comand method in Task Key: AIRFLOW-6035 URL: https://issues.apache.org/jira/browse/AIRFLOW-6035 Project: Apache Airflow Issue Type: Bug

[GitHub] [airflow] kaxil commented on a change in pull request #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer

kaxil commented on a change in pull request #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer URL: https://github.com/apache/airflow/pull/6396#discussion_r349161658 ## File path: tests/operators/test_redshift_to_s3_operator.py ## @@ -31,7 +32,8 @@

[GitHub] [airflow] OmerJog commented on issue #5317: [AIRFLOW-4562 ] Fix missing try_number parameter in TaskInstance.log_filepath method

OmerJog commented on issue #5317: [AIRFLOW-4562 ] Fix missing try_number parameter in TaskInstance.log_filepath method URL: https://github.com/apache/airflow/pull/5317#issuecomment-557143006 @XD-DENG @nurikk Did you mean for this PR to be forgotten? :(

[jira] [Updated] (AIRFLOW-5936) Allow explicit get_pty in SSHOperator

[ https://issues.apache.org/jira/browse/AIRFLOW-5936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5936: --- Fix Version/s: (was: 2.0.0) 1.10.7 > Allow explicit get_pty

[jira] [Resolved] (AIRFLOW-5928) hive hooks load_file short circuit

[ https://issues.apache.org/jira/browse/AIRFLOW-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5928. Fix Version/s: 1.10.7 Resolution: Fixed > hive hooks load_file short

[GitHub] [airflow] kaxil commented on a change in pull request #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer

kaxil commented on a change in pull request #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer URL: https://github.com/apache/airflow/pull/6396#discussion_r349161658 ## File path: tests/operators/test_redshift_to_s3_operator.py ## @@ -31,7 +32,8 @@

[GitHub] [airflow] kaxil commented on issue #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer

kaxil commented on issue #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer URL: https://github.com/apache/airflow/pull/6396#issuecomment-557171010 @JavierLopezT Apply the following code and the test will pass. Passes on my local machine: ```diff diff

[jira] [Work started] (AIRFLOW-5947) Make the json backend pluggable for DAG Serialization

[ https://issues.apache.org/jira/browse/AIRFLOW-5947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5947 started by Kaxil Naik. --- > Make the json backend pluggable for DAG Serialization >

[GitHub] [airflow] ashb commented on a change in pull request #6620: [AIRFLOW-6023] Remove deprecated Celery configs

ashb commented on a change in pull request #6620: [AIRFLOW-6023] Remove deprecated Celery configs URL: https://github.com/apache/airflow/pull/6620#discussion_r349228457 ## File path: airflow/configuration.py ## @@ -114,14 +112,7 @@ class AirflowConfigParser(ConfigParser):

  1   2   >