[GitHub] [airflow] baolsen edited a comment on issue #6675: [AIRFLOW-6038] AWS DataSync example_dags added

2019-11-26 Thread GitBox
baolsen edited a comment on issue #6675: [AIRFLOW-6038] AWS DataSync example_dags added URL: https://github.com/apache/airflow/pull/6675#issuecomment-558968294 Hi @potiuk Please may I ask for your assistance with this. My build is failing due to cyclic import (it was failing even

[GitHub] [airflow] baolsen commented on issue #6675: [AIRFLOW-6038] AWS DataSync example_dags added

2019-11-26 Thread GitBox
baolsen commented on issue #6675: [AIRFLOW-6038] AWS DataSync example_dags added URL: https://github.com/apache/airflow/pull/6675#issuecomment-558968294 Hi @potiuk Please may I ask for your assistance with this. My build is failing due to cyclic import (it was failing even before

[GitHub] [airflow] houqp commented on issue #6553: [AIRFLOW-5902] avoid unnecessary sleep to maintain local task job heart rate

2019-11-26 Thread GitBox
houqp commented on issue #6553: [AIRFLOW-5902] avoid unnecessary sleep to maintain local task job heart rate URL: https://github.com/apache/airflow/pull/6553#issuecomment-558965123 @ashb type annotation additions are not moved to https://github.com/apache/airflow/pull/6674. --

[GitHub] [airflow] TobKed commented on issue #6657: [AIRFLOW-6059] Fix typo in docs build.sh - path providers instead of provider

2019-11-26 Thread GitBox
TobKed commented on issue #6657: [AIRFLOW-6059] Fix typo in docs build.sh - path providers instead of provider URL: https://github.com/apache/airflow/pull/6657#issuecomment-558953888 Hi @feluelle . I've reopened it unchanged since it is relatively small change and doesn't collide with bigg

[jira] [Commented] (AIRFLOW-6055) Exponential Backoff in Sensors

2019-11-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983204#comment-16983204 ] ASF GitHub Bot commented on AIRFLOW-6055: - msumit commented on pull request #66

[jira] [Commented] (AIRFLOW-6055) Exponential Backoff in Sensors

2019-11-26 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983206#comment-16983206 ] ASF subversion and git services commented on AIRFLOW-6055: -- Co

[GitHub] [airflow] msumit merged pull request #6654: [AIRFLOW-6055] Option for exponential backoff in Sensors

2019-11-26 Thread GitBox
msumit merged pull request #6654: [AIRFLOW-6055] Option for exponential backoff in Sensors URL: https://github.com/apache/airflow/pull/6654 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (AIRFLOW-6038) AWS DataSync example dags

2019-11-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983193#comment-16983193 ] ASF GitHub Bot commented on AIRFLOW-6038: - baolsen commented on pull request #6

[GitHub] [airflow] baolsen opened a new pull request #6675: [AIRFLOW-6038] AWS DataSync example_dags added

2019-11-26 Thread GitBox
baolsen opened a new pull request #6675: [AIRFLOW-6038] AWS DataSync example_dags added URL: https://github.com/apache/airflow/pull/6675 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/br

[GitHub] [airflow] codecov-io commented on issue #6674: [AIRFLOW-6062] fix type error from new version of mypy

2019-11-26 Thread GitBox
codecov-io commented on issue #6674: [AIRFLOW-6062] fix type error from new version of mypy URL: https://github.com/apache/airflow/pull/6674#issuecomment-558935464 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6674?src=pr&el=h1) Report > Merging [#6674](https://codecov.io/gh/ap

[GitHub] [airflow] codecov-io edited a comment on issue #6553: [AIRFLOW-5902] avoid unnecessary sleep to maintain local task job heart rate

2019-11-26 Thread GitBox
codecov-io edited a comment on issue #6553: [AIRFLOW-5902] avoid unnecessary sleep to maintain local task job heart rate URL: https://github.com/apache/airflow/pull/6553#issuecomment-553170084 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6553?src=pr&el=h1) Report > Merging [#6

[GitHub] [airflow] codecov-io edited a comment on issue #6553: [AIRFLOW-5902] avoid unnecessary sleep to maintain local task job heart rate

2019-11-26 Thread GitBox
codecov-io edited a comment on issue #6553: [AIRFLOW-5902] avoid unnecessary sleep to maintain local task job heart rate URL: https://github.com/apache/airflow/pull/6553#issuecomment-553170084 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6553?src=pr&el=h1) Report > Merging [#6

[GitHub] [airflow] codecov-io edited a comment on issue #6553: [AIRFLOW-5902] avoid unnecessary sleep to maintain local task job heart rate

2019-11-26 Thread GitBox
codecov-io edited a comment on issue #6553: [AIRFLOW-5902] avoid unnecessary sleep to maintain local task job heart rate URL: https://github.com/apache/airflow/pull/6553#issuecomment-553170084 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6553?src=pr&el=h1) Report > Merging [#6

[jira] [Commented] (AIRFLOW-5920) Add support to execute OpenCypher query against Neo4j

2019-11-26 Thread Timothy Findlay (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983132#comment-16983132 ] Timothy Findlay commented on AIRFLOW-5920: -- [~jackjack10],  - I have made a fe

[GitHub] [airflow] codecov-io edited a comment on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

2019-11-26 Thread GitBox
codecov-io edited a comment on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#issuecomment-558211492 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6627?src=pr&el=h1) Report > Merging [#6627](

[GitHub] [airflow] tfindlay-tw commented on a change in pull request #6604: [AIRFLOW-5920] *DRAFT* Neo4j operator and hook

2019-11-26 Thread GitBox
tfindlay-tw commented on a change in pull request #6604: [AIRFLOW-5920] *DRAFT* Neo4j operator and hook URL: https://github.com/apache/airflow/pull/6604#discussion_r351080645 ## File path: airflow/contrib/hooks/neo4j_hook.py ## @@ -0,0 +1,106 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] maxirus commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error

2019-11-26 Thread GitBox
maxirus commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error URL: https://github.com/apache/airflow/pull/6643#issuecomment-558903525 The `kube_client_request_args` config parameter is "global" to all of the client requests. Setting `timeout_seconds` here ca

[GitHub] [airflow] codecov-io commented on issue #6604: [AIRFLOW-5920] *DRAFT* Neo4j operator and hook

2019-11-26 Thread GitBox
codecov-io commented on issue #6604: [AIRFLOW-5920] *DRAFT* Neo4j operator and hook URL: https://github.com/apache/airflow/pull/6604#issuecomment-558902885 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6604?src=pr&el=h1) Report > :exclamation: No coverage uploaded for pull reque

[GitHub] [airflow] XD-DENG commented on issue #6673: Pod aliases

2019-11-26 Thread GitBox
XD-DENG commented on issue #6673: Pod aliases URL: https://github.com/apache/airflow/pull/6673#issuecomment-558897376 Hi @dougblack , please follow the instructions in the PR template. On the other hand, if you would like to further test your code change, I would suggest to do that i

[GitHub] [airflow] tyg03485 edited a comment on issue #6665: [AIRFLOW-6068] Make args of KubernetesPodOperator to get dict type

2019-11-26 Thread GitBox
tyg03485 edited a comment on issue #6665: [AIRFLOW-6068] Make args of KubernetesPodOperator to get dict type URL: https://github.com/apache/airflow/pull/6665#issuecomment-55779 Hi @davlum I thought there are some awkward point in args of KubernetesPodOperator. There are classes w

[GitHub] [airflow] tyg03485 edited a comment on issue #6665: [AIRFLOW-6068] Make args of KubernetesPodOperator to get dict type

2019-11-26 Thread GitBox
tyg03485 edited a comment on issue #6665: [AIRFLOW-6068] Make args of KubernetesPodOperator to get dict type URL: https://github.com/apache/airflow/pull/6665#issuecomment-55779 Hi @davlum I thought there are some awkward point in args of KubernetesPodOperator. There are classes w

[GitHub] [airflow] tyg03485 edited a comment on issue #6665: [AIRFLOW-6068] Make args of KubernetesPodOperator to get dict type

2019-11-26 Thread GitBox
tyg03485 edited a comment on issue #6665: [AIRFLOW-6068] Make args of KubernetesPodOperator to get dict type URL: https://github.com/apache/airflow/pull/6665#issuecomment-55779 Hi @davlum I thought there are some awkward point in args of KubernetesPodOperator. There are classes w

[GitHub] [airflow] tyg03485 commented on issue #6665: [AIRFLOW-6068] Make args of KubernetesPodOperator to get dict type

2019-11-26 Thread GitBox
tyg03485 commented on issue #6665: [AIRFLOW-6068] Make args of KubernetesPodOperator to get dict type URL: https://github.com/apache/airflow/pull/6665#issuecomment-55779 Um.. I thought there are some awkward point in args of KubernetesPodOperator. There are classes we optionally use

[GitHub] [airflow] codecov-io commented on issue #6661: [AIRFLOW-5959] AIP-21 Change import paths for "jira" modules

2019-11-26 Thread GitBox
codecov-io commented on issue #6661: [AIRFLOW-5959] AIP-21 Change import paths for "jira" modules URL: https://github.com/apache/airflow/pull/6661#issuecomment-558882971 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6661?src=pr&el=h1) Report > :exclamation: No coverage uploaded

[GitHub] [airflow] ashb commented on a change in pull request #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

2019-11-26 Thread GitBox
ashb commented on a change in pull request #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#discussion_r351053566 ## File path: tests/dags/test_on_kill.py ## @@ -25,6 +25,11 @@ class DummyWit

[GitHub] [airflow] codecov-io edited a comment on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

2019-11-26 Thread GitBox
codecov-io edited a comment on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#issuecomment-558211492 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6627?src=pr&el=h1) Report > Merging [#6627](

[GitHub] [airflow] potiuk commented on issue #6601: [AIRFLOW-6010] Remove cyclic imports and pylint disables

2019-11-26 Thread GitBox
potiuk commented on issue #6601: [AIRFLOW-6010] Remove cyclic imports and pylint disables URL: https://github.com/apache/airflow/pull/6601#issuecomment-558865616 Finally :). Thanks @kaxil This is an automated message from th

[jira] [Commented] (AIRFLOW-6062) Scheduler doesn't delete worker pods from pods in different namespaces

2019-11-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983025#comment-16983025 ] ASF GitHub Bot commented on AIRFLOW-6062: - houqp commented on pull request #667

[GitHub] [airflow] houqp opened a new pull request #6674: [AIRFLOW-6062] fix type error from new version of mypy

2019-11-26 Thread GitBox
houqp opened a new pull request #6674: [AIRFLOW-6062] fix type error from new version of mypy URL: https://github.com/apache/airflow/pull/6674 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.org/j

[jira] [Created] (AIRFLOW-6080) New version of mypy catches more type errors

2019-11-26 Thread QP Hou (Jira)
QP Hou created AIRFLOW-6080: --- Summary: New version of mypy catches more type errors Key: AIRFLOW-6080 URL: https://issues.apache.org/jira/browse/AIRFLOW-6080 Project: Apache Airflow Issue Type: Imp

[jira] [Resolved] (AIRFLOW-6070) On the admin dashboard, the recent tasks column has no tooltip for tasks in 'null' state

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-6070. Resolution: Duplicate This has already been fixed in Airflow. Please note that this is no

[jira] [Commented] (AIRFLOW-6074) Logging to Azure Blob Storage

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982999#comment-16982999 ] Kamil Bregula commented on AIRFLOW-6074: Thanks for reporting it.  I will try

[GitHub] [airflow] mik-laj commented on issue #6644: [AIRFLOW-6047] Simplify the logging configuration template

2019-11-26 Thread GitBox
mik-laj commented on issue #6644: [AIRFLOW-6047] Simplify the logging configuration template URL: https://github.com/apache/airflow/pull/6644#issuecomment-558856882 Related jira: https://issues.apache.org/jira/projects/AIRFLOW/issues/AIRFLOW-6074?filter=addedrecently -

[jira] [Closed] (AIRFLOW-6078) cc

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-6078. -- Resolution: Fixed > cc > -- > > Key: AIRFLOW-6078 > URL: http

[jira] [Resolved] (AIRFLOW-5544) GCP datastore operation pull should have some retry to avoid false alarm

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-5544. Resolution: Fixed Fix is available in community. Changes in not available in Cloud Compos

[jira] [Commented] (AIRFLOW-5544) GCP datastore operation pull should have some retry to avoid false alarm

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982996#comment-16982996 ] Kamil Bregula commented on AIRFLOW-5544: There is a plan to make these operator

[jira] [Commented] (AIRFLOW-6079) Make consistent use of timezone.parse

2019-11-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982992#comment-16982992 ] ASF GitHub Bot commented on AIRFLOW-6079: - kaxil commented on pull request #667

[GitHub] [airflow] kaxil merged pull request #6672: [AIRFLOW-6079] Make consistent use of timezone.parse

2019-11-26 Thread GitBox
kaxil merged pull request #6672: [AIRFLOW-6079] Make consistent use of timezone.parse URL: https://github.com/apache/airflow/pull/6672 This is an automated message from the Apache Git Service. To respond to the message, plea

[jira] [Commented] (AIRFLOW-6079) Make consistent use of timezone.parse

2019-11-26 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982993#comment-16982993 ] ASF subversion and git services commented on AIRFLOW-6079: -- Co

[jira] [Resolved] (AIRFLOW-6079) Make consistent use of timezone.parse

2019-11-26 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-6079. - Resolution: Fixed > Make consistent use of timezone.parse > ---

[GitHub] [airflow] kaxil commented on issue #6672: [AIRFLOW-6079] Make consistent use of timezone.parse

2019-11-26 Thread GitBox
kaxil commented on issue #6672: [AIRFLOW-6079] Make consistent use of timezone.parse URL: https://github.com/apache/airflow/pull/6672#issuecomment-558854779 CI passed: https://travis-ci.org/apache/airflow/builds/617404566 Thi

[GitHub] [airflow] houqp commented on a change in pull request #6553: [AIRFLOW-5902] avoid unnecessary sleep to maintain local task job heart rate

2019-11-26 Thread GitBox
houqp commented on a change in pull request #6553: [AIRFLOW-5902] avoid unnecessary sleep to maintain local task job heart rate URL: https://github.com/apache/airflow/pull/6553#discussion_r351022830 ## File path: airflow/models/taskinstance.py ## @@ -1320,9 +1320,9 @@ def

[GitHub] [airflow] dougblack opened a new pull request #6673: Pod aliases

2019-11-26 Thread GitBox
dougblack opened a new pull request #6673: Pod aliases URL: https://github.com/apache/airflow/pull/6673 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and referenc

[GitHub] [airflow] dimberman commented on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

2019-11-26 Thread GitBox
dimberman commented on issue #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#issuecomment-558849438 @ashb did you ever end up doing a timing comparison with the multiprocessing based solution?

[GitHub] [airflow] mik-laj commented on a change in pull request #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

2019-11-26 Thread GitBox
mik-laj commented on a change in pull request #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#discussion_r351016268 ## File path: tests/dags/test_on_kill.py ## @@ -25,6 +25,11 @@ class Dummy

[jira] [Commented] (AIRFLOW-5544) GCP datastore operation pull should have some retry to avoid false alarm

2019-11-26 Thread Yang Hu (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982972#comment-16982972 ] Yang Hu commented on AIRFLOW-5544: -- Glad there are fixes there, we are on GCP Cloud Co

[GitHub] [airflow] mik-laj commented on a change in pull request #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

2019-11-26 Thread GitBox
mik-laj commented on a change in pull request #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#discussion_r351015019 ## File path: airflow/task/task_runner/standard_task_runner.py ## @@ -17,28 +

[GitHub] [airflow] mik-laj commented on a change in pull request #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution.

2019-11-26 Thread GitBox
mik-laj commented on a change in pull request #6627: [AIRFLOW-5931] Use os.fork when appropriate to speed up task execution. URL: https://github.com/apache/airflow/pull/6627#discussion_r351014526 ## File path: airflow/cli/commands/task_command.py ## @@ -225,6 +226,11 @@ de

[GitHub] [airflow] codecov-io edited a comment on issue #6601: [AIRFLOW-6010] Remove cyclic imports and pylint disables

2019-11-26 Thread GitBox
codecov-io edited a comment on issue #6601: [AIRFLOW-6010] Remove cyclic imports and pylint disables URL: https://github.com/apache/airflow/pull/6601#issuecomment-557836097 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6601?src=pr&el=h1) Report > Merging [#6601](https://codecov

[jira] [Commented] (AIRFLOW-5544) GCP datastore operation pull should have some retry to avoid false alarm

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982961#comment-16982961 ] Kamil Bregula commented on AIRFLOW-5544: Some body from community make change:

[GitHub] [airflow] codecov-io edited a comment on issue #6601: [AIRFLOW-6010] Remove cyclic imports and pylint disables

2019-11-26 Thread GitBox
codecov-io edited a comment on issue #6601: [AIRFLOW-6010] Remove cyclic imports and pylint disables URL: https://github.com/apache/airflow/pull/6601#issuecomment-557836097 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6601?src=pr&el=h1) Report > Merging [#6601](https://codecov

[GitHub] [airflow] codecov-io edited a comment on issue #6601: [AIRFLOW-6010] Remove cyclic imports and pylint disables

2019-11-26 Thread GitBox
codecov-io edited a comment on issue #6601: [AIRFLOW-6010] Remove cyclic imports and pylint disables URL: https://github.com/apache/airflow/pull/6601#issuecomment-557836097 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6601?src=pr&el=h1) Report > Merging [#6601](https://codecov

[jira] [Commented] (AIRFLOW-6010) Remove cyclic imports and pylint hacks

2019-11-26 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982959#comment-16982959 ] ASF subversion and git services commented on AIRFLOW-6010: -- Co

[GitHub] [airflow] kaxil commented on issue #6601: [AIRFLOW-6010] Remove cyclic imports and pylint disables

2019-11-26 Thread GitBox
kaxil commented on issue #6601: [AIRFLOW-6010] Remove cyclic imports and pylint disables URL: https://github.com/apache/airflow/pull/6601#issuecomment-558842390 Thanks @potiuk This is an automated message from the Apache Git

[jira] [Commented] (AIRFLOW-6010) Remove cyclic imports and pylint hacks

2019-11-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982958#comment-16982958 ] ASF GitHub Bot commented on AIRFLOW-6010: - kaxil commented on pull request #660

[GitHub] [airflow] kaxil merged pull request #6601: [AIRFLOW-6010] Remove cyclic imports and pylint disables

2019-11-26 Thread GitBox
kaxil merged pull request #6601: [AIRFLOW-6010] Remove cyclic imports and pylint disables URL: https://github.com/apache/airflow/pull/6601 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Resolved] (AIRFLOW-6010) Remove cyclic imports and pylint hacks

2019-11-26 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-6010. - Fix Version/s: 2.0.0 Resolution: Fixed > Remove cyclic imports and pylint hacks > --

[jira] [Commented] (AIRFLOW-5544) GCP datastore operation pull should have some retry to avoid false alarm

2019-11-26 Thread Yang Hu (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982955#comment-16982955 ] Yang Hu commented on AIRFLOW-5544: -- Hi [~kamil.bregula] What improvements are there?

[GitHub] [airflow-site] ashb commented on issue #198: Publish new website - AIP-11

2019-11-26 Thread GitBox
ashb commented on issue #198: Publish new website - AIP-11 URL: https://github.com/apache/airflow-site/pull/198#issuecomment-558839747 Yes we have mod_rewrite enabled - for example https://git-wip-us.apache.org/repos/asf?p=incubator.git;a=blob;f=assets/.htaccess;h=c1c53fe407a149c52ed853ca45

[GitHub] [airflow] ashb commented on a change in pull request #6553: [AIRFLOW-5902] avoid unnecessary sleep to maintain local task job heart rate

2019-11-26 Thread GitBox
ashb commented on a change in pull request #6553: [AIRFLOW-5902] avoid unnecessary sleep to maintain local task job heart rate URL: https://github.com/apache/airflow/pull/6553#discussion_r351004248 ## File path: airflow/models/taskinstance.py ## @@ -1320,9 +1320,9 @@ def s

[GitHub] [airflow] mik-laj commented on a change in pull request #6644: [AIRFLOW-6047] Simplify the logging configuration template

2019-11-26 Thread GitBox
mik-laj commented on a change in pull request #6644: [AIRFLOW-6047] Simplify the logging configuration template URL: https://github.com/apache/airflow/pull/6644#discussion_r350992546 ## File path: airflow/config_templates/airflow_local_settings.py ## @@ -191,32 +215,6 @@

[jira] [Resolved] (AIRFLOW-3722) Improve BiqQueryHook test coverage

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-3722. Resolution: Won't Do > Improve BiqQueryHook test coverage > -

[GitHub] [airflow] feluelle commented on issue #6672: [AIRFLOW-6079] Make consistent use of timezone.parse

2019-11-26 Thread GitBox
feluelle commented on issue #6672: [AIRFLOW-6079] Make consistent use of timezone.parse URL: https://github.com/apache/airflow/pull/6672#issuecomment-558824727 That's correct. But lets see what the tests have to say ;) This i

[jira] [Resolved] (AIRFLOW-5422) Add type annotations to GCP operators

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-5422. Resolution: Fixed > Add type annotations to GCP operators > -

[jira] [Commented] (AIRFLOW-5544) GCP datastore operation pull should have some retry to avoid false alarm

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982926#comment-16982926 ] Kamil Bregula commented on AIRFLOW-5544: [~coolcute] Is it still valid? My team

[jira] [Commented] (AIRFLOW-6041) Add user agent to the Discovery API client

2019-11-26 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982925#comment-16982925 ] ASF subversion and git services commented on AIRFLOW-6041: -- Co

[jira] [Resolved] (AIRFLOW-6041) Add user agent to the Discovery API client

2019-11-26 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-6041. - Fix Version/s: 2.0.0 Resolution: Fixed > Add user agent to the Discovery API client > --

[jira] [Commented] (AIRFLOW-6041) Add user agent to the Discovery API client

2019-11-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982924#comment-16982924 ] ASF GitHub Bot commented on AIRFLOW-6041: - kaxil commented on pull request #663

[jira] [Commented] (AIRFLOW-5635) Add expiration_time option to BigQueryCreateEmptyTableOperator and BigQueryCreateExternalTableOperator

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982922#comment-16982922 ] Kamil Bregula commented on AIRFLOW-5635: [~zope.manish83] Do you plan to work o

[GitHub] [airflow] kaxil merged pull request #6636: [AIRFLOW-6041] Add user agent to the Discovery API client

2019-11-26 Thread GitBox
kaxil merged pull request #6636: [AIRFLOW-6041] Add user agent to the Discovery API client URL: https://github.com/apache/airflow/pull/6636 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (AIRFLOW-3722) Improve BiqQueryHook test coverage

2019-11-26 Thread Felix Uellendall (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982923#comment-16982923 ] Felix Uellendall commented on AIRFLOW-3722: --- No, don't think so. At least not

[jira] [Updated] (AIRFLOW-6041) Add user agent to the Discovery API client

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-6041: --- Issue Type: New Feature (was: Bug) > Add user agent to the Discovery API client >

[jira] [Closed] (AIRFLOW-2056) Integrate Google Cloud Storage (GCS) operators into 1 file

2019-11-26 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik closed AIRFLOW-2056. --- Resolution: Not A Problem Not Valid Anymore. As a part of refactoring and moving files (part of AIP

[jira] [Commented] (AIRFLOW-2056) Integrate Google Cloud Storage (GCS) operators into 1 file

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982918#comment-16982918 ] Kamil Bregula commented on AIRFLOW-2056: [~kaxilnaik] What is the progress of t

[jira] [Commented] (AIRFLOW-2155) Lack of consistency between project vs. project_id

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982916#comment-16982916 ] Kamil Bregula commented on AIRFLOW-2155: [~maximilianroos] Is it still valid? M

[jira] [Commented] (AIRFLOW-2540) Create an example dag using Google Cloud ML Engine operators

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982912#comment-16982912 ] Kamil Bregula commented on AIRFLOW-2540: [~younghee] Do you plan to work on it?

[jira] [Updated] (AIRFLOW-3401) Properly encode templated fields in Cloud Pub/Sub example DAG

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-3401: --- Description: Context:  [https://groups.google.com/d/msg/cloud-composer-discuss/McHHu582G7o/7

[jira] [Commented] (AIRFLOW-3722) Improve BiqQueryHook test coverage

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982906#comment-16982906 ] Kamil Bregula commented on AIRFLOW-3722: [~feluelle] Gentle ping. Do you plan t

[jira] [Commented] (AIRFLOW-3776) Use maintained google client library for bigquery

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982902#comment-16982902 ] Kamil Bregula commented on AIRFLOW-3776: [~jmcarp]  My team started working on

[jira] [Commented] (AIRFLOW-3759) Add kms_key_name parameter to BigQuery operators to support CMEK

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982904#comment-16982904 ] Kamil Bregula commented on AIRFLOW-3759: [~jasper.smith] It is still valid? >

[jira] [Resolved] (AIRFLOW-4068) Add GoogleCloudStorageFileTransformOperator

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-4068. Resolution: Fixed > Add GoogleCloudStorageFileTransformOperator > ---

[jira] [Commented] (AIRFLOW-4226) DataProcPySparkOperator gets project ID from gcp_conn_id rather than project_id

2019-11-26 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982900#comment-16982900 ] Kaxil Naik commented on AIRFLOW-4226: - Yes in 1.10.6 it is still the case. > DataP

[jira] [Assigned] (AIRFLOW-4226) DataProcPySparkOperator gets project ID from gcp_conn_id rather than project_id

2019-11-26 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik reassigned AIRFLOW-4226: --- Assignee: Kamil Bregula (was: Kaxil Naik) > DataProcPySparkOperator gets project ID from

[jira] [Resolved] (AIRFLOW-4157) FileToGoogleCloudStorageOperator should expose "multipart" uploading supported in GoogleCloudStorageHook.upload()

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-4157. Resolution: Cannot Reproduce We have now Python API library. This ticket is not valid now

[jira] [Commented] (AIRFLOW-4226) DataProcPySparkOperator gets project ID from gcp_conn_id rather than project_id

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982895#comment-16982895 ] Kamil Bregula commented on AIRFLOW-4226: [~kaxilnaik] Is this ticket still vali

[jira] [Commented] (AIRFLOW-4779) Implement GCP Stackdriver' Hook and Operators

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982891#comment-16982891 ] Kamil Bregula commented on AIRFLOW-4779: Hello [~ryan.yuan] Can you tell me wh

[jira] [Commented] (AIRFLOW-4783) Make GCP operators Pylint compatible

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982889#comment-16982889 ] Kamil Bregula commented on AIRFLOW-4783: [~Urbaszek] Do you have suggestion in

[jira] [Commented] (AIRFLOW-4808) Error when getting an already deleted dataproc cluster status

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982888#comment-16982888 ] Kamil Bregula commented on AIRFLOW-4808: [~london_su] Do you plan to work on it

[jira] [Commented] (AIRFLOW-4886) Add routines methods to BigQuery Hooks and Operators

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982887#comment-16982887 ] Kamil Bregula commented on AIRFLOW-4886: Hello [~ryan.yuan] What's up? Is it w

[jira] [Resolved] (AIRFLOW-4894) Add hook and operator for GCP Data Loss Prevention API

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-4894. Fix Version/s: 2.0.0 Resolution: Fixed > Add hook and operator for GCP Data Loss P

[jira] [Resolved] (AIRFLOW-4931) Add KMS Encryption Configuration to BigQuery Hook and Operators

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-4931. Resolution: Fixed > Add KMS Encryption Configuration to BigQuery Hook and Operators > ---

[jira] [Resolved] (AIRFLOW-4964) Add BigQuery Data Transfer Hook and Operator

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-4964. Fix Version/s: 2.0.0 Resolution: Fixed > Add BigQuery Data Transfer Hook and Opera

[jira] [Resolved] (AIRFLOW-4971) Add Google Display & Video 360 integration

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-4971. Fix Version/s: 2.0.0 Resolution: Fixed > Add Google Display & Video 360 integratio

[jira] [Commented] (AIRFLOW-4967) Add Cloud AutoML NL Entity Extraction integration

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982883#comment-16982883 ] Kamil Bregula commented on AIRFLOW-4967: [~Urbaszek] Do you have other suggesti

[jira] [Commented] (AIRFLOW-4966) Add Cloud AutoML NL Classification integration

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982885#comment-16982885 ] Kamil Bregula commented on AIRFLOW-4966: [~Urbaszek] Do you have other suggesti

[jira] [Commented] (AIRFLOW-4968) Add Cloud AutoML NL Sentiment integration

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982881#comment-16982881 ] Kamil Bregula commented on AIRFLOW-4968: [~Urbaszek] Do you have other suggesti

[jira] [Commented] (AIRFLOW-4969) Add Cloud AutoML Tables integration

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982880#comment-16982880 ] Kamil Bregula commented on AIRFLOW-4969: [~Urbaszek] Do you have other suggesti

[jira] [Commented] (AIRFLOW-4972) Add Google Search Ads 360 integration

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982878#comment-16982878 ] Kamil Bregula commented on AIRFLOW-4972: [~Urbaszek] Do you have other suggesti

[jira] [Commented] (AIRFLOW-5013) Add GCP Data Catalog Hook and Operators

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982876#comment-16982876 ] Kamil Bregula commented on AIRFLOW-5013: Hi [~ryan.yuan] Do you plan to work o

[jira] [Commented] (AIRFLOW-5099) Implement Google Cloud AutoML operators

2019-11-26 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982871#comment-16982871 ] Kamil Bregula commented on AIRFLOW-5099: Hi [~Urbaszek] Is it done? Do you hav

  1   2   3   4   >