[jira] [Commented] (AIRFLOW-2843) ExternalTaskSensor: Add option to cease waiting immediately if the external DAG/task doesn't exist

2019-09-13 Thread Wesley (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929083#comment-16929083 ] Wesley commented on AIRFLOW-2843: - Using the operator stumbled upon the case where the

[GitHub] [airflow-site] mik-laj merged pull request #4: Remove HTML comments from the beginning of the files

2019-09-13 Thread GitBox
mik-laj merged pull request #4: Remove HTML comments from the beginning of the files URL: https://github.com/apache/airflow-site/pull/4 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Assigned] (AIRFLOW-5470) Add Apache Livy REST operator

2019-09-13 Thread Luca Cavazzana (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Cavazzana reassigned AIRFLOW-5470: --- Assignee: Luca Cavazzana > Add Apache Livy REST operator >

[GitHub] [airflow] jsurloppe commented on issue #5680: [AIRFLOW-5066] allow k8s fieldref substitution

2019-09-13 Thread GitBox
jsurloppe commented on issue #5680: [AIRFLOW-5066] allow k8s fieldref substitution URL: https://github.com/apache/airflow/pull/5680#issuecomment-531165653 @mik-laj a little yes, didn't expect that much when i switched the target tranch, should'nt have done it before the rebase.

[GitHub] [airflow] jsurloppe edited a comment on issue #5680: [AIRFLOW-5066] allow k8s fieldref substitution

2019-09-13 Thread GitBox
jsurloppe edited a comment on issue #5680: [AIRFLOW-5066] allow k8s fieldref substitution URL: https://github.com/apache/airflow/pull/5680#issuecomment-531165653 @mik-laj a little yes, didn't expect that much when i switched the target tranch, shouldn't have done it before the rebase.

[GitHub] [airflow] mik-laj commented on issue #6074: [AIRFLOW-5390] Remove provide context

2019-09-13 Thread GitBox
mik-laj commented on issue #6074: [AIRFLOW-5390] Remove provide context URL: https://github.com/apache/airflow/pull/6074#issuecomment-531224109 @nuclearpinguin Can you look at this? This is an automated message from the

[GitHub] [airflow] lucacavazzana opened a new pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-09-13 Thread GitBox
lucacavazzana opened a new pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-5470) Add Apache Livy REST operator

2019-09-13 Thread Luca Cavazzana (Jira)
Luca Cavazzana created AIRFLOW-5470: --- Summary: Add Apache Livy REST operator Key: AIRFLOW-5470 URL: https://issues.apache.org/jira/browse/AIRFLOW-5470 Project: Apache Airflow Issue Type:

[GitHub] [airflow] shaikshakeel commented on a change in pull request #5694: [AIRFLOW-5082] add subject in aws sns hook

2019-09-13 Thread GitBox
shaikshakeel commented on a change in pull request #5694: [AIRFLOW-5082] add subject in aws sns hook URL: https://github.com/apache/airflow/pull/5694#discussion_r324114155 ## File path: tests/contrib/hooks/test_aws_sns_hook.py ## @@ -42,9 +42,10 @@ def

[GitHub] [airflow] TobKed opened a new pull request #6091: [AIRFLOW-5471] Fix docstring in GcpTransferServiceOperationsListOperator

2019-09-13 Thread GitBox
TobKed opened a new pull request #6091: [AIRFLOW-5471] Fix docstring in GcpTransferServiceOperationsListOperator URL: https://github.com/apache/airflow/pull/6091 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-5471) Fix docstring in GcpTransferServiceOperationsListOperator

2019-09-13 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-5471: --- Summary: Fix docstring in GcpTransferServiceOperationsListOperator Key: AIRFLOW-5471 URL: https://issues.apache.org/jira/browse/AIRFLOW-5471 Project:

[GitHub] [airflow] nuclearpinguin opened a new pull request #6092: [AIRFLOW-5472] Fix labels in GCS operator

2019-09-13 Thread GitBox
nuclearpinguin opened a new pull request #6092: [AIRFLOW-5472] Fix labels in GCS operator URL: https://github.com/apache/airflow/pull/6092 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5472) Fix labels in GCS operator

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929150#comment-16929150 ] ASF GitHub Bot commented on AIRFLOW-5472: - nuclearpinguin commented on pull request #6092:

[jira] [Created] (AIRFLOW-5473) SLA calculation doesn't work when you have manual triggers

2019-09-13 Thread Thiago Rigo (Jira)
Thiago Rigo created AIRFLOW-5473: Summary: SLA calculation doesn't work when you have manual triggers Key: AIRFLOW-5473 URL: https://issues.apache.org/jira/browse/AIRFLOW-5473 Project: Apache Airflow

[GitHub] [airflow] Fokko commented on issue #6074: [AIRFLOW-5390] Remove provide context

2019-09-13 Thread GitBox
Fokko commented on issue #6074: [AIRFLOW-5390] Remove provide context URL: https://github.com/apache/airflow/pull/6074#issuecomment-531192667 Looks like master is failing  This is an automated message from the Apache Git

[jira] [Commented] (AIRFLOW-5471) Fix docstring in GcpTransferServiceOperationsListOperator

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929107#comment-16929107 ] ASF GitHub Bot commented on AIRFLOW-5471: - TobKed commented on pull request #6091:

[GitHub] [airflow] jsurloppe edited a comment on issue #5680: [AIRFLOW-5066] allow k8s fieldref substitution

2019-09-13 Thread GitBox
jsurloppe edited a comment on issue #5680: [AIRFLOW-5066] allow k8s fieldref substitution URL: https://github.com/apache/airflow/pull/5680#issuecomment-531165653 @mik-laj a little yes, didn't expect that much when i switched the target tranch, shouldn't have done it before the rebase.

[GitHub] [airflow] shaikshakeel commented on a change in pull request #5694: [AIRFLOW-5082] add subject in aws sns hook

2019-09-13 Thread GitBox
shaikshakeel commented on a change in pull request #5694: [AIRFLOW-5082] add subject in aws sns hook URL: https://github.com/apache/airflow/pull/5694#discussion_r324114898 ## File path: airflow/contrib/hooks/aws_sns_hook.py ## @@ -53,8 +55,16 @@ def

[jira] [Comment Edited] (AIRFLOW-2843) ExternalTaskSensor: Add option to cease waiting immediately if the external DAG/task doesn't exist

2019-09-13 Thread Wesley (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929083#comment-16929083 ] Wesley edited comment on AIRFLOW-2843 at 9/13/19 10:08 AM: --- Using the

[jira] [Created] (AIRFLOW-5472) Fix labels in GCS operator

2019-09-13 Thread Tomasz Urbaszek (Jira)
Tomasz Urbaszek created AIRFLOW-5472: Summary: Fix labels in GCS operator Key: AIRFLOW-5472 URL: https://issues.apache.org/jira/browse/AIRFLOW-5472 Project: Apache Airflow Issue Type:

[jira] [Created] (AIRFLOW-5475) Normalize gcp_conn_id in operators and hooks

2019-09-13 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-5475: --- Summary: Normalize gcp_conn_id in operators and hooks Key: AIRFLOW-5475 URL: https://issues.apache.org/jira/browse/AIRFLOW-5475 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-5447) KubernetesExecutor hangs on task queueing

2019-09-13 Thread Henry Cohen (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929191#comment-16929191 ] Henry Cohen commented on AIRFLOW-5447: -- If it helps, my pod running the webserver and scheduler is

[jira] [Commented] (AIRFLOW-5476) Typo in BREEZE.rst

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929195#comment-16929195 ] ASF GitHub Bot commented on AIRFLOW-5476: - dongjinleekr commented on pull request #6094:

[jira] [Commented] (AIRFLOW-5477) Rewrite Google PubSub Hook to Google Cloud Python

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929205#comment-16929205 ] ASF GitHub Bot commented on AIRFLOW-5477: - TobKed commented on pull request #6096:

[jira] [Created] (AIRFLOW-5478) Decode PythonVirtualenvOperator Output to Logs

2019-09-13 Thread Raman Nanda (Jira)
Raman Nanda created AIRFLOW-5478: Summary: Decode PythonVirtualenvOperator Output to Logs Key: AIRFLOW-5478 URL: https://issues.apache.org/jira/browse/AIRFLOW-5478 Project: Apache Airflow

[jira] [Assigned] (AIRFLOW-3912) Hide/Show Paused DAGs Button overrides existing GET Parameter

2019-09-13 Thread Alejandro (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro reassigned AIRFLOW-3912: -- Assignee: Alejandro > Hide/Show Paused DAGs Button overrides existing GET Parameter >

[GitHub] [airflow] mik-laj commented on a change in pull request #6093: [AIRFLOW-5475] Normalize gcp_conn_id in operators and hooks

2019-09-13 Thread GitBox
mik-laj commented on a change in pull request #6093: [AIRFLOW-5475] Normalize gcp_conn_id in operators and hooks URL: https://github.com/apache/airflow/pull/6093#discussion_r324268794 ## File path: UPDATING.md ## @@ -40,6 +40,13 @@ assists users migrating to a new

[GitHub] [airflow] feluelle commented on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test

2019-09-13 Thread GitBox
feluelle commented on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test URL: https://github.com/apache/airflow/pull/6098#issuecomment-531314286 @mik-laj do you know why this is "flaky"? How does this change fix it? This

[GitHub] [airflow] TobKed opened a new pull request #6099: [AIRFLOW-5479] Normalize gcp_conn method in GCP Kubernetes Hook

2019-09-13 Thread GitBox
TobKed opened a new pull request #6099: [AIRFLOW-5479] Normalize gcp_conn method in GCP Kubernetes Hook URL: https://github.com/apache/airflow/pull/6099 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-5479) Normalize get_conn method in GCP Kubernetes hook

2019-09-13 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-5479: --- Summary: Normalize get_conn method in GCP Kubernetes hook Key: AIRFLOW-5479 URL: https://issues.apache.org/jira/browse/AIRFLOW-5479 Project: Apache

[jira] [Commented] (AIRFLOW-5479) Normalize get_conn method in GCP Kubernetes hook

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929369#comment-16929369 ] ASF GitHub Bot commented on AIRFLOW-5479: - TobKed commented on pull request #6099:

[GitHub] [airflow] mik-laj commented on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test

2019-09-13 Thread GitBox
mik-laj commented on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test URL: https://github.com/apache/airflow/pull/6098#issuecomment-531317676 Yes. I know. This is very simple. This tests check ``` ``` This

[GitHub] [airflow] mik-laj removed a comment on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test

2019-09-13 Thread GitBox
mik-laj removed a comment on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test URL: https://github.com/apache/airflow/pull/6098#issuecomment-531317676 Yes. I know. This is very simple. This tests check ``` ```

[jira] [Commented] (AIRFLOW-5387) Pagination is broken when the config variable hide_paused_dags_by_default is set to True because showPaused variable is removed

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929381#comment-16929381 ] ASF GitHub Bot commented on AIRFLOW-5387: - alrolorojas commented on pull request #6100:

[GitHub] [airflow] TobKed commented on a change in pull request #6093: [AIRFLOW-5475] Normalize gcp_conn_id in operators and hooks

2019-09-13 Thread GitBox
TobKed commented on a change in pull request #6093: [AIRFLOW-5475] Normalize gcp_conn_id in operators and hooks URL: https://github.com/apache/airflow/pull/6093#discussion_r324301608 ## File path: UPDATING.md ## @@ -40,6 +40,13 @@ assists users migrating to a new version.

[jira] [Commented] (AIRFLOW-5476) Typo in BREEZE.rst

2019-09-13 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929418#comment-16929418 ] ASF subversion and git services commented on AIRFLOW-5476: -- Commit

[jira] [Commented] (AIRFLOW-5476) Typo in BREEZE.rst

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929417#comment-16929417 ] ASF GitHub Bot commented on AIRFLOW-5476: - mik-laj commented on pull request #6094:

[GitHub] [airflow] codecov-io commented on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test

2019-09-13 Thread GitBox
codecov-io commented on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test URL: https://github.com/apache/airflow/pull/6098#issuecomment-531315985 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6098?src=pr=h1) Report > Merging

[GitHub] [airflow] mik-laj commented on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test

2019-09-13 Thread GitBox
mik-laj commented on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test URL: https://github.com/apache/airflow/pull/6098#issuecomment-531319961 @feluelle II'm not sure why it worked before, but I know why it works now. This test verifies that if we have PYTHONPATH set it will be

[GitHub] [airflow] mik-laj edited a comment on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test

2019-09-13 Thread GitBox
mik-laj edited a comment on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test URL: https://github.com/apache/airflow/pull/6098#issuecomment-531319961 @feluelle II'm not sure why it worked before, but I know why it works now. This test verifies that if we have PYTHONPATH set it will

[GitHub] [airflow] feluelle commented on issue #6098: [AIRFLOW-5480] Fix flaky impersonation test

2019-09-13 Thread GitBox
feluelle commented on issue #6098: [AIRFLOW-5480] Fix flaky impersonation test URL: https://github.com/apache/airflow/pull/6098#issuecomment-531328941 Got it, thanks.  Nice one! :) This is an automated message from the

[GitHub] [airflow] mik-laj commented on issue #6098: [AIRFLOW-5480] Fix flaky impersonation test

2019-09-13 Thread GitBox
mik-laj commented on issue #6098: [AIRFLOW-5480] Fix flaky impersonation test URL: https://github.com/apache/airflow/pull/6098#issuecomment-531330460 It blocks my work a bit. I hope it will be accepted soon. One more thing that I noticed was that it could be related to what Docker

[GitHub] [airflow] mik-laj commented on a change in pull request #6093: [AIRFLOW-5475] Normalize gcp_conn_id in operators and hooks

2019-09-13 Thread GitBox
mik-laj commented on a change in pull request #6093: [AIRFLOW-5475] Normalize gcp_conn_id in operators and hooks URL: https://github.com/apache/airflow/pull/6093#discussion_r324268794 ## File path: UPDATING.md ## @@ -40,6 +40,13 @@ assists users migrating to a new

[GitHub] [airflow] dossett commented on issue #4064: AIRFLOW-3149 Support dataproc cluster deletion on ERROR

2019-09-13 Thread GitBox
dossett commented on issue #4064: AIRFLOW-3149 Support dataproc cluster deletion on ERROR URL: https://github.com/apache/airflow/pull/4064#issuecomment-531308336 Rebase and pushed, awaiting travis This is an automated

[jira] [Created] (AIRFLOW-5480) Fix flaky impersonation test

2019-09-13 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5480: -- Summary: Fix flaky impersonation test Key: AIRFLOW-5480 URL: https://issues.apache.org/jira/browse/AIRFLOW-5480 Project: Apache Airflow Issue Type:

[GitHub] [airflow] mik-laj edited a comment on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test

2019-09-13 Thread GitBox
mik-laj edited a comment on issue #6098: [AIRFLOW-YYY] Fix flaky impersonation test URL: https://github.com/apache/airflow/pull/6098#issuecomment-531319961 @feluelle II'm not sure why it worked before, but I know why it works now. This test verifies that if we have PYTHONPATH set it will

[GitHub] [airflow] alrolorojas opened a new pull request #6100: [AIRFLOW-5387] Fix show paused pagination bug

2019-09-13 Thread GitBox
alrolorojas opened a new pull request #6100: [AIRFLOW-5387] Fix show paused pagination bug URL: https://github.com/apache/airflow/pull/6100 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] dossett commented on issue #5419: [AIRFLOW-XXXX] Update pydoc of mlengine_operator

2019-09-13 Thread GitBox
dossett commented on issue #5419: [AIRFLOW-] Update pydoc of mlengine_operator URL: https://github.com/apache/airflow/pull/5419#issuecomment-531328098 @mik-laj @potiuk Rebased and pushed. There are some test failures, but they don't seem related to my pydoc change, e.g.: ```

[GitHub] [airflow] mik-laj merged pull request #6094: [AIRFLOW-5476] Fix typo in BREEZE.rst

2019-09-13 Thread GitBox
mik-laj merged pull request #6094: [AIRFLOW-5476] Fix typo in BREEZE.rst URL: https://github.com/apache/airflow/pull/6094 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Comment Edited] (AIRFLOW-5354) Scheduler - constant CPU usage of 25% with nothing running and scheduling loop running too frequently

2019-09-13 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929431#comment-16929431 ] Kaxil Naik edited comment on AIRFLOW-5354 at 9/13/19 6:21 PM: -- [~toopt4]

[jira] [Commented] (AIRFLOW-5354) Scheduler - constant CPU usage of 25% with nothing running and scheduling loop running too frequently

2019-09-13 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929431#comment-16929431 ] Kaxil Naik commented on AIRFLOW-5354: - [~toopt4] Add `processor_poll_interval=30` under

[jira] [Created] (AIRFLOW-5476) Typo in BREEZE.rst

2019-09-13 Thread Lee Dongjin (Jira)
Lee Dongjin created AIRFLOW-5476: Summary: Typo in BREEZE.rst Key: AIRFLOW-5476 URL: https://issues.apache.org/jira/browse/AIRFLOW-5476 Project: Apache Airflow Issue Type: Improvement

[GitHub] [airflow] lindsable commented on issue #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results

2019-09-13 Thread GitBox
lindsable commented on issue #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results URL: https://github.com/apache/airflow/pull/6075#issuecomment-531235692 The ci build failed because pylint didn't accept the boto3 parameters I monkey patched. Should I add an ignore to the

[jira] [Commented] (AIRFLOW-5447) KubernetesExecutor hangs on task queueing

2019-09-13 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929200#comment-16929200 ] Kaxil Naik commented on AIRFLOW-5447: - We ([~dimberman] and our other colleagues at Astronomer) but

[jira] [Commented] (AIRFLOW-5474) Add Basic Auth to Druid hook

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929199#comment-16929199 ] ASF GitHub Bot commented on AIRFLOW-5474: - awelsh93 commented on pull request #6095:

[jira] [Assigned] (AIRFLOW-5387) Pagination is broken when the config variable hide_paused_dags_by_default is set to True because showPaused variable is removed

2019-09-13 Thread Alejandro (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro reassigned AIRFLOW-5387: -- Assignee: Alejandro > Pagination is broken when the config variable

[GitHub] [airflow] ramannanda opened a new pull request #6097: [AIRFLOW-5478] Decode PythonVirtualenvOperator Output to Logs

2019-09-13 Thread GitBox
ramannanda opened a new pull request #6097: [AIRFLOW-5478] Decode PythonVirtualenvOperator Output to Logs URL: https://github.com/apache/airflow/pull/6097 - Added decode to subprocess output Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses

[GitHub] [airflow] louisguitton commented on issue #5335: [AIRFLOW-4588] Add GoogleDiscoveryApiHook and GoogleApiToS3Transfer

2019-09-13 Thread GitBox
louisguitton commented on issue #5335: [AIRFLOW-4588] Add GoogleDiscoveryApiHook and GoogleApiToS3Transfer URL: https://github.com/apache/airflow/pull/5335#issuecomment-531233380 congrats on the merge, and thanks for including me on this @feluelle ; I really did not mucho

[GitHub] [airflow] dongjinleekr opened a new pull request #6094: [AIRFLOW-5476] Fix typo in BREEZE.rst

2019-09-13 Thread GitBox
dongjinleekr opened a new pull request #6094: [AIRFLOW-5476] Fix typo in BREEZE.rst URL: https://github.com/apache/airflow/pull/6094 Fix typo: `breezs` → `breeze` This is an automated message from the Apache Git Service. To

[GitHub] [airflow] TobKed opened a new pull request #6096: [AIRFLOW-5477] Rewrite Google PubSub Hook to Google Cloud Python

2019-09-13 Thread GitBox
TobKed opened a new pull request #6096: [AIRFLOW-5477] Rewrite Google PubSub Hook to Google Cloud Python URL: https://github.com/apache/airflow/pull/6096 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-5477) Rewrite Google PubSub Hook to Google Cloud Python

2019-09-13 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-5477: --- Summary: Rewrite Google PubSub Hook to Google Cloud Python Key: AIRFLOW-5477 URL: https://issues.apache.org/jira/browse/AIRFLOW-5477 Project: Apache

[GitHub] [airflow] mik-laj opened a new pull request #6098: [AIRFLOW-YYY] Fix flaky impersonation test

2019-09-13 Thread GitBox
mik-laj opened a new pull request #6098: [AIRFLOW-YYY] Fix flaky impersonation test URL: https://github.com/apache/airflow/pull/6098 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] TobKed opened a new pull request #6093: [AIRFLOW-XXX] Normalize gcp_conn_id in operators and hooks

2019-09-13 Thread GitBox
TobKed opened a new pull request #6093: [AIRFLOW-XXX] Normalize gcp_conn_id in operators and hooks URL: https://github.com/apache/airflow/pull/6093 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-5474) Add Basic Auth to Druid hook

2019-09-13 Thread Adam Welsh (Jira)
Adam Welsh created AIRFLOW-5474: --- Summary: Add Basic Auth to Druid hook Key: AIRFLOW-5474 URL: https://issues.apache.org/jira/browse/AIRFLOW-5474 Project: Apache Airflow Issue Type:

[GitHub] [airflow] awelsh93 opened a new pull request #6095: [AIRFLOW-5474] Add Basic auth to Druid hook

2019-09-13 Thread GitBox
awelsh93 opened a new pull request #6095: [AIRFLOW-5474] Add Basic auth to Druid hook URL: https://github.com/apache/airflow/pull/6095 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] [airflow] milton0825 commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-09-13 Thread GitBox
milton0825 commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-531281411 So a few things to clarify: Is your parent DAG triggered by backfill or scheduler? Via airflow scheduler,

[jira] [Commented] (AIRFLOW-5478) Decode PythonVirtualenvOperator Output to Logs

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929273#comment-16929273 ] ASF GitHub Bot commented on AIRFLOW-5478: - ramannanda commented on pull request #6097:

[jira] [Closed] (AIRFLOW-4774) MLEngineHook should use the built-in Google Discovery API method for retry requests

2019-09-13 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-4774. -- Resolution: Invalid > MLEngineHook should use the built-in Google Discovery API method for

[jira] [Closed] (AIRFLOW-4773) MLEngineHook should retry the request in case of error

2019-09-13 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-4773. -- Resolution: Invalid > MLEngineHook should retry the request in case of error >

[GitHub] [airflow] steven-freed commented on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement

2019-09-13 Thread GitBox
steven-freed commented on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement URL: https://github.com/apache/airflow/pull/5770#issuecomment-531443919 I got everything working but seem to have a build documentation error. I can't seem to figure it out. I am up to date with the

[jira] [Comment Edited] (AIRFLOW-5354) Scheduler - constant CPU usage of 25% with nothing running and scheduling loop running too frequently

2019-09-13 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929431#comment-16929431 ] Kaxil Naik edited comment on AIRFLOW-5354 at 9/13/19 6:25 PM: -- [~toopt4]

[jira] [Updated] (AIRFLOW-796) More configuration settings

2019-09-13 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-796: --- Fix Version/s: (was: 2.0.0) 1.10.6 > More configuration settings >

[jira] [Commented] (AIRFLOW-5480) Fix flaky impersonation test

2019-09-13 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929462#comment-16929462 ] ASF subversion and git services commented on AIRFLOW-5480: -- Commit

[jira] [Commented] (AIRFLOW-5480) Fix flaky impersonation test

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929461#comment-16929461 ] ASF GitHub Bot commented on AIRFLOW-5480: - potiuk commented on pull request #6098:

[GitHub] [airflow] mik-laj commented on issue #6074: [AIRFLOW-5390] Remove provide context

2019-09-13 Thread GitBox
mik-laj commented on issue #6074: [AIRFLOW-5390] Remove provide context URL: https://github.com/apache/airflow/pull/6074#issuecomment-531362560 @Fokko Fixed and merged. I rebased your branch. Cross fingers. This is an

[jira] [Commented] (AIRFLOW-5418) bucket names with a slash in them cause an error with the GCS Download Operator

2019-09-13 Thread Leah (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929480#comment-16929480 ] Leah commented on AIRFLOW-5418: --- I'm attaching two screenshots - one of them shows the path to an Airflow

[jira] [Updated] (AIRFLOW-5418) bucket names with a slash in them cause an error with the GCS Download Operator

2019-09-13 Thread Leah (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leah updated AIRFLOW-5418: -- Attachment: Screen Shot 2019-09-13 at 12.35.33 PM.png Screen Shot 2019-09-13 at 12.36.40

[jira] [Closed] (AIRFLOW-5480) Fix flaky impersonation test

2019-09-13 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-5480. -- Fix Version/s: 1.10.6 Resolution: Fixed > Fix flaky impersonation test >

[jira] [Comment Edited] (AIRFLOW-5418) bucket names with a slash in them cause an error with the GCS Download Operator

2019-09-13 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929486#comment-16929486 ] Kamil Bregula edited comment on AIRFLOW-5418 at 9/13/19 7:46 PM: - dags/

[GitHub] [airflow] kaxil opened a new pull request #6101: [AIRFLOW-5481] Allow Deleting Renamed DAGs

2019-09-13 Thread GitBox
kaxil opened a new pull request #6101: [AIRFLOW-5481] Allow Deleting Renamed DAGs URL: https://github.com/apache/airflow/pull/6101 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira] -

[jira] [Updated] (AIRFLOW-5418) object names with a slash in them cause an error with the GCS Download Operator

2019-09-13 Thread Leah (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leah updated AIRFLOW-5418: -- Summary: object names with a slash in them cause an error with the GCS Download Operator (was: bucket names

[jira] [Comment Edited] (AIRFLOW-5447) KubernetesExecutor hangs on task queueing

2019-09-13 Thread Chris Wegrzyn (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929517#comment-16929517 ] Chris Wegrzyn edited comment on AIRFLOW-5447 at 9/13/19 8:41 PM: - I

[GitHub] [airflow] kaxil merged pull request #6089: add Dentsu to README

2019-09-13 Thread GitBox
kaxil merged pull request #6089: add Dentsu to README URL: https://github.com/apache/airflow/pull/6089 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (AIRFLOW-796) More configuration settings

2019-09-13 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929464#comment-16929464 ] ASF subversion and git services commented on AIRFLOW-796: - Commit

[GitHub] [airflow] mik-laj commented on issue #6036: [AIRFLOW-5428] Dataflow with one job is not done correctly

2019-09-13 Thread GitBox
mik-laj commented on issue #6036: [AIRFLOW-5428] Dataflow with one job is not done correctly URL: https://github.com/apache/airflow/pull/6036#issuecomment-531360720 I finished system tests This is an automated message from

[jira] [Commented] (AIRFLOW-5418) bucket names with a slash in them cause an error with the GCS Download Operator

2019-09-13 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929486#comment-16929486 ] Kamil Bregula commented on AIRFLOW-5418: dags/ data/ is a object us-central-*-bucket is a

[GitHub] [airflow] kaxil opened a new pull request #6102: WIP: [AIRFLOW-4309] Remove Broken Dag error after Dag is deleted

2019-09-13 Thread GitBox
kaxil opened a new pull request #6102: WIP: [AIRFLOW-4309] Remove Broken Dag error after Dag is deleted URL: https://github.com/apache/airflow/pull/6102 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-4309) Delete dag doesn't delete everything

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929492#comment-16929492 ] ASF GitHub Bot commented on AIRFLOW-4309: - kaxil commented on pull request #6102: WIP:

[GitHub] [airflow] codecov-io commented on issue #6091: [AIRFLOW-5471] Fix docstring in GcpTransferServiceOperationsListOperator

2019-09-13 Thread GitBox
codecov-io commented on issue #6091: [AIRFLOW-5471] Fix docstring in GcpTransferServiceOperationsListOperator URL: https://github.com/apache/airflow/pull/6091#issuecomment-53139 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6091?src=pr=h1) Report > Merging

[jira] [Comment Edited] (AIRFLOW-5354) Scheduler - constant CPU usage of 25% with nothing running and scheduling loop running too frequently

2019-09-13 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929431#comment-16929431 ] Kaxil Naik edited comment on AIRFLOW-5354 at 9/13/19 6:26 PM: -- [~toopt4]

[GitHub] [airflow] potiuk merged pull request #6098: [AIRFLOW-5480] Fix flaky impersonation test

2019-09-13 Thread GitBox
potiuk merged pull request #6098: [AIRFLOW-5480] Fix flaky impersonation test URL: https://github.com/apache/airflow/pull/6098 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] codecov-io commented on issue #6036: [AIRFLOW-5428] Dataflow with one job is not done correctly

2019-09-13 Thread GitBox
codecov-io commented on issue #6036: [AIRFLOW-5428] Dataflow with one job is not done correctly URL: https://github.com/apache/airflow/pull/6036#issuecomment-531366685 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6036?src=pr=h1) Report > Merging

[jira] [Comment Edited] (AIRFLOW-5418) bucket names with a slash in them cause an error with the GCS Download Operator

2019-09-13 Thread Leah (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929481#comment-16929481 ] Leah edited comment on AIRFLOW-5418 at 9/13/19 7:41 PM: Looking at your example

[jira] [Created] (AIRFLOW-5481) Allow Deleting Renamed DAGs

2019-09-13 Thread Kaxil Naik (Jira)
Kaxil Naik created AIRFLOW-5481: --- Summary: Allow Deleting Renamed DAGs Key: AIRFLOW-5481 URL: https://issues.apache.org/jira/browse/AIRFLOW-5481 Project: Apache Airflow Issue Type: Bug

[jira] [Commented] (AIRFLOW-5418) bucket names with a slash in them cause an error with the GCS Download Operator

2019-09-13 Thread Leah (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929481#comment-16929481 ] Leah commented on AIRFLOW-5418: --- Looking at your example of the invalid request, I suspect that if the

[GitHub] [airflow] codecov-io commented on issue #6035: [AIRFLOW-5427][depends on AIRFLOW-5428/AIRFLOW-5427] Add system tests for Dataflow integration

2019-09-13 Thread GitBox
codecov-io commented on issue #6035: [AIRFLOW-5427][depends on AIRFLOW-5428/AIRFLOW-5427] Add system tests for Dataflow integration URL: https://github.com/apache/airflow/pull/6035#issuecomment-531366842 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6035?src=pr=h1) Report >

[jira] [Commented] (AIRFLOW-5418) bucket names with a slash in them cause an error with the GCS Download Operator

2019-09-13 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929491#comment-16929491 ] Kamil Bregula commented on AIRFLOW-5418: In 

[jira] [Commented] (AIRFLOW-5418) bucket names with a slash in them cause an error with the GCS Download Operator

2019-09-13 Thread Leah (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929496#comment-16929496 ] Leah commented on AIRFLOW-5418: --- Apologies for the incorrect terminology. I'll update the title of the

[jira] [Commented] (AIRFLOW-5447) KubernetesExecutor hangs on task queueing

2019-09-13 Thread Chris Wegrzyn (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929517#comment-16929517 ] Chris Wegrzyn commented on AIRFLOW-5447: I just upgraded a deployment from 1.10.2 to 1.10.5

[jira] [Created] (AIRFLOW-5496) hive_stats_operator: Unneeded variable assignment

2019-09-13 Thread Jakob Homan (Jira)
Jakob Homan created AIRFLOW-5496: Summary: hive_stats_operator: Unneeded variable assignment Key: AIRFLOW-5496 URL: https://issues.apache.org/jira/browse/AIRFLOW-5496 Project: Apache Airflow

  1   2   >