[jira] [Assigned] (AIRFLOW-5635) Add expiration_time option to BigQueryCreateEmptyTableOperator and BigQueryCreateExternalTableOperator

2019-10-10 Thread Manish Zope (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manish Zope reassigned AIRFLOW-5635: Assignee: Manish Zope > Add expiration_time option to BigQueryCreateEmptyTableOperator a

[jira] [Commented] (AIRFLOW-5126) Read aws_session_token in extra_config of the aws hook

2019-10-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949173#comment-16949173 ] ASF GitHub Bot commented on AIRFLOW-5126: - jojo19893 commented on pull request

[GitHub] [airflow] jojo19893 opened a new pull request #6303: AIRFLOW-5126 Read aws_session_token in extra_config of the aws hook

2019-10-10 Thread GitBox
jojo19893 opened a new pull request #6303: AIRFLOW-5126 Read aws_session_token in extra_config of the aws hook URL: https://github.com/apache/airflow/pull/6303 ### Description Read a temporary token in case it is present this is important, if you don't manage the session tok

[GitHub] [airflow] codecov-io commented on issue #6300: [AIRFLOW-4661] Make airflow/config_templates Pylint compatible

2019-10-10 Thread GitBox
codecov-io commented on issue #6300: [AIRFLOW-4661] Make airflow/config_templates Pylint compatible URL: https://github.com/apache/airflow/pull/6300#issuecomment-540924928 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6300?src=pr&el=h1) Report > Merging [#6300](https://codecov.

[GitHub] [airflow] milton0825 commented on a change in pull request #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for…

2019-10-10 Thread GitBox
milton0825 commented on a change in pull request #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for… URL: https://github.com/apache/airflow/pull/6302#discussion_r333833300 ## File path: airflow/models/baseoperator.py ## @@ -1057,6 +1070,17 @@ def

[GitHub] [airflow] mik-laj commented on issue #6300: [AIRFLOW-4661] Make airflow/config_templates Pylint compatible

2019-10-10 Thread GitBox
mik-laj commented on issue #6300: [AIRFLOW-4661] Make airflow/config_templates Pylint compatible URL: https://github.com/apache/airflow/pull/6300#issuecomment-540916784 I restarted build. This is an automated message from th

[GitHub] [airflow] milton0825 commented on a change in pull request #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for…

2019-10-10 Thread GitBox
milton0825 commented on a change in pull request #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for… URL: https://github.com/apache/airflow/pull/6302#discussion_r333833003 ## File path: airflow/models/baseoperator.py ## @@ -566,7 +566,20 @@ def pr

[GitHub] [airflow] antru commented on issue #2460: [AIRFLOW-1424] make the next execution date of DAGs visible

2019-10-10 Thread GitBox
antru commented on issue #2460: [AIRFLOW-1424] make the next execution date of DAGs visible URL: https://github.com/apache/airflow/pull/2460#issuecomment-540916330 Please make this happen 🙏 This is an automated message from

[GitHub] [airflow] milton0825 commented on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for…

2019-10-10 Thread GitBox
milton0825 commented on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for… URL: https://github.com/apache/airflow/pull/6302#issuecomment-540914101 > This would also help in adding Operator links once we enable Serialized DAGs #5743 Can you share more

[jira] [Created] (AIRFLOW-5637) KubeExecutor - Resource Request and Limits

2019-10-10 Thread F D (Jira)
F D created AIRFLOW-5637: Summary: KubeExecutor - Resource Request and Limits Key: AIRFLOW-5637 URL: https://issues.apache.org/jira/browse/AIRFLOW-5637 Project: Apache Airflow Issue Type: Improvement

[GitHub] [airflow] codecov-io edited a comment on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for…

2019-10-10 Thread GitBox
codecov-io edited a comment on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for… URL: https://github.com/apache/airflow/pull/6302#issuecomment-540867241 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6302?src=pr&el=h1) Report > Merging [#6302](h

[GitHub] [airflow] codecov-io edited a comment on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for…

2019-10-10 Thread GitBox
codecov-io edited a comment on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for… URL: https://github.com/apache/airflow/pull/6302#issuecomment-540867241 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6302?src=pr&el=h1) Report > Merging [#6302](h

[GitHub] [airflow] codecov-io edited a comment on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for…

2019-10-10 Thread GitBox
codecov-io edited a comment on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for… URL: https://github.com/apache/airflow/pull/6302#issuecomment-540867241 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6302?src=pr&el=h1) Report > Merging [#6302](h

[GitHub] [airflow] codecov-io edited a comment on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for…

2019-10-10 Thread GitBox
codecov-io edited a comment on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for… URL: https://github.com/apache/airflow/pull/6302#issuecomment-540867241 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6302?src=pr&el=h1) Report > Merging [#6302](h

[GitHub] [airflow] codecov-io commented on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for…

2019-10-10 Thread GitBox
codecov-io commented on issue #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for… URL: https://github.com/apache/airflow/pull/6302#issuecomment-540867241 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6302?src=pr&el=h1) Report > Merging [#6302](https://

[GitHub] [airflow] codecov-io commented on issue #6301: [AIRFLOW-XXX] Fix Documentation for adding extra Operator Links

2019-10-10 Thread GitBox
codecov-io commented on issue #6301: [AIRFLOW-XXX] Fix Documentation for adding extra Operator Links URL: https://github.com/apache/airflow/pull/6301#issuecomment-540856238 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6301?src=pr&el=h1) Report > Merging [#6301](https://codecov

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-10 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r333787095 ## File path: tests/serialization/test_dag_serialization.py ## @@ -67,

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-10 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r333786118 ## File path: airflow/plugins_manager.py ## @@ -57,8 +57,21 @@ class A

[jira] [Commented] (AIRFLOW-5636) Allow adding or overriding existing Extra Operator Links for existing Operators

2019-10-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949014#comment-16949014 ] ASF GitHub Bot commented on AIRFLOW-5636: - kaxil commented on pull request #630

[GitHub] [airflow] kaxil opened a new pull request #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for…

2019-10-10 Thread GitBox
kaxil opened a new pull request #6302: [AIRFLOW-5636] Allow adding or overriding existing Operator Links for… URL: https://github.com/apache/airflow/pull/6302 … an Operator This will be done via Airflow Plugins Make sure you have checked _all_ steps below. ### Jira

[jira] [Created] (AIRFLOW-5636) Allow adding or overriding existing Extra Operator Links for existing Operators

2019-10-10 Thread Kaxil Naik (Jira)
Kaxil Naik created AIRFLOW-5636: --- Summary: Allow adding or overriding existing Extra Operator Links for existing Operators Key: AIRFLOW-5636 URL: https://issues.apache.org/jira/browse/AIRFLOW-5636 Proje

[GitHub] [airflow] kaxil opened a new pull request #6301: [AIRFLOW-XXX] Fix Documentation for adding extra Operator Links

2019-10-10 Thread GitBox
kaxil opened a new pull request #6301: [AIRFLOW-XXX] Fix Documentation for adding extra Operator Links URL: https://github.com/apache/airflow/pull/6301 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apa

[GitHub] [airflow] nuclearpinguin commented on issue #6300: [AIRFLOW-4661] Make airflow/config_templates Pylint compatible

2019-10-10 Thread GitBox
nuclearpinguin commented on issue #6300: [AIRFLOW-4661] Make airflow/config_templates Pylint compatible URL: https://github.com/apache/airflow/pull/6300#issuecomment-540828742 @mik-laj what do you think about the error? Does it look like a flaky test? https://travis-ci.org/apache/airflow

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests

2019-10-10 Thread GitBox
nuclearpinguin commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests URL: https://github.com/apache/airflow/pull/6299#discussion_r333765299 ## File path: airflow/gcp/hooks/base.py ## @@ -323,8 +341,63 @@ def provide_gcp_credenti

[GitHub] [airflow] KevinYang21 commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-10-10 Thread GitBox
KevinYang21 commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-540824633 thanks @seelmann, sry for the delay, day time job has been a bit crazy these days. Working on it now. --

[jira] [Commented] (AIRFLOW-4956) LocalTaskJob heartbeat can create spamming log

2019-10-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948949#comment-16948949 ] ASF subversion and git services commented on AIRFLOW-4956: -- Co

[jira] [Commented] (AIRFLOW-5408) Fix env variable name in Kubernetes template

2019-10-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948951#comment-16948951 ] ASF subversion and git services commented on AIRFLOW-5408: -- Co

[jira] [Commented] (AIRFLOW-4833) Jinja templating removes newlines

2019-10-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948952#comment-16948952 ] ASF subversion and git services commented on AIRFLOW-4833: -- Co

[jira] [Commented] (AIRFLOW-5102) Workers fail to shutdown jobs after failed heartbeats

2019-10-10 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948950#comment-16948950 ] ASF subversion and git services commented on AIRFLOW-5102: -- Co

[jira] [Created] (AIRFLOW-5635) Add expiration_time option to BigQueryCreateEmptyTableOperator and BigQueryCreateExternalTableOperator

2019-10-10 Thread Joel Croteau (Jira)
Joel Croteau created AIRFLOW-5635: - Summary: Add expiration_time option to BigQueryCreateEmptyTableOperator and BigQueryCreateExternalTableOperator Key: AIRFLOW-5635 URL: https://issues.apache.org/jira/browse/AIRF

[GitHub] [airflow-site] mik-laj opened a new pull request #75: Add more linters

2019-10-10 Thread GitBox
mik-laj opened a new pull request #75: Add more linters URL: https://github.com/apache/airflow-site/pull/75 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] efedotova commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-10 Thread GitBox
efedotova commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#discussion_r333716751 ## File path: BREEZE.rst ## @@ -290,104 +275,85 @@ It is as easy as copy&pasting this line

[GitHub] [airflow-site] mik-laj opened a new pull request #74: Add forbit-tabs lint

2019-10-10 Thread GitBox
mik-laj opened a new pull request #74: Add forbit-tabs lint URL: https://github.com/apache/airflow-site/pull/74 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] codecov-io commented on issue #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
codecov-io commented on issue #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#issuecomment-540752672 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6295?src=pr&el=h1) Report > Merging [#6295](https://codecov.io/gh/apache/air

[GitHub] [airflow-site] mik-laj opened a new pull request #73: Fix all files permisssions

2019-10-10 Thread GitBox
mik-laj opened a new pull request #73: Fix all files permisssions URL: https://github.com/apache/airflow-site/pull/73 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [airflow] jghoman commented on issue #6288: AIRFLOW-5540 adding rise exception when the _resolve_connection method fails

2019-10-10 Thread GitBox
jghoman commented on issue #6288: AIRFLOW-5540 adding rise exception when the _resolve_connection method fails URL: https://github.com/apache/airflow/pull/6288#issuecomment-540738534 Hey @adankro - (sorry for delay). I think we can re-raise the original exception, which will keep the or

[GitHub] [airflow-site] mik-laj closed issue #18: Create a accordian component

2019-10-10 Thread GitBox
mik-laj closed issue #18: Create a accordian component URL: https://github.com/apache/airflow-site/issues/18 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow-site] mik-laj closed issue #22: Create a base text style

2019-10-10 Thread GitBox
mik-laj closed issue #22: Create a base text style URL: https://github.com/apache/airflow-site/issues/22 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow-site] mik-laj closed issue #7: Create a sketchy project

2019-10-10 Thread GitBox
mik-laj closed issue #7: Create a sketchy project URL: https://github.com/apache/airflow-site/issues/7 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [airflow-site] mik-laj commented on a change in pull request #72: Add ordered and unordered list components

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #72: Add ordered and unordered list components URL: https://github.com/apache/airflow-site/pull/72#discussion_r333689986 ## File path: landing-pages/site/assets/scss/_ol-ul.scss ## @@ -0,0 +1,80 @@ +/** + * Licensed to the Apac

[GitHub] [airflow] efedotova commented on a change in pull request #6283: [AIRFLOW-XXXX] Google Season of Docs updates to CONTRIBUTING doc

2019-10-10 Thread GitBox
efedotova commented on a change in pull request #6283: [AIRFLOW-] Google Season of Docs updates to CONTRIBUTING doc URL: https://github.com/apache/airflow/pull/6283#discussion_r333689692 ## File path: CONTRIBUTING.rst ## @@ -0,0 +1,662 @@ + .. Licensed to the Apache So

[GitHub] [airflow-site] mik-laj merged pull request #65: Add accordian

2019-10-10 Thread GitBox
mik-laj merged pull request #65: Add accordian URL: https://github.com/apache/airflow-site/pull/65 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[airflow-site] branch aip-11 updated (cbe2f5c -> 56f53fd)

2019-10-10 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch aip-11 in repository https://gitbox.apache.org/repos/asf/airflow-site.git. from cbe2f5c Add pre-commit (#69) add 56f53fd Add accordian (#65) No new revisions were added by this

[GitHub] [airflow] mik-laj commented on a change in pull request #6283: [AIRFLOW-XXXX] Google Season of Docs updates to CONTRIBUTING doc

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6283: [AIRFLOW-] Google Season of Docs updates to CONTRIBUTING doc URL: https://github.com/apache/airflow/pull/6283#discussion_r333679239 ## File path: CONTRIBUTING.rst ## @@ -0,0 +1,662 @@ + .. Licensed to the Apache Soft

[GitHub] [airflow] efedotova commented on a change in pull request #6283: [AIRFLOW-XXXX] Google Season of Docs updates to CONTRIBUTING doc

2019-10-10 Thread GitBox
efedotova commented on a change in pull request #6283: [AIRFLOW-] Google Season of Docs updates to CONTRIBUTING doc URL: https://github.com/apache/airflow/pull/6283#discussion_r333677737 ## File path: CONTRIBUTING.rst ## @@ -0,0 +1,662 @@ + .. Licensed to the Apache So

[jira] [Created] (AIRFLOW-5634) Disabled DagModelView fields can be edited (classic UI)

2019-10-10 Thread Ash Berlin-Taylor (Jira)
Ash Berlin-Taylor created AIRFLOW-5634: -- Summary: Disabled DagModelView fields can be edited (classic UI) Key: AIRFLOW-5634 URL: https://issues.apache.org/jira/browse/AIRFLOW-5634 Project: Apache

[GitHub] [airflow] mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r333671610 ## File path: docs/scheduler.rst ## @@ -32,161 +30,17 @@ Airflow production environment. To kick it of

[GitHub] [airflow] feluelle commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-10 Thread GitBox
feluelle commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r333669995 ## File path: airflow/contrib/operators/livy_operator.py ## @@ -0,0 +1,175 @@ +# -*- coding: utf-8 -*-

[GitHub] [airflow] mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r333669268 ## File path: docs/dag-run.rst ## @@ -0,0 +1,184 @@ + .. Licensed to the Apache Software Foundation (A

[GitHub] [airflow] mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r333668412 ## File path: docs/dag-run.rst ## @@ -0,0 +1,184 @@ + .. Licensed to the Apache Software Foundation (A

[GitHub] [airflow] mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r333667977 ## File path: docs/dag-run.rst ## @@ -0,0 +1,184 @@ + .. Licensed to the Apache Software Foundation (A

[GitHub] [airflow] mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r333667869 ## File path: docs/dag-run.rst ## @@ -0,0 +1,184 @@ + .. Licensed to the Apache Software Foundation (A

[GitHub] [airflow] mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r333667453 ## File path: docs/dag-run.rst ## @@ -0,0 +1,184 @@ + .. Licensed to the Apache Software Foundation (A

[GitHub] [airflow] mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r333666886 ## File path: docs/dag-run.rst ## @@ -0,0 +1,184 @@ + .. Licensed to the Apache Software Foundation (A

[GitHub] [airflow] mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r333667364 ## File path: docs/dag-run.rst ## @@ -0,0 +1,184 @@ + .. Licensed to the Apache Software Foundation (A

[GitHub] [airflow] mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r333666886 ## File path: docs/dag-run.rst ## @@ -0,0 +1,184 @@ + .. Licensed to the Apache Software Foundation (A

[GitHub] [airflow] mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r333666511 ## File path: docs/dag-run.rst ## @@ -0,0 +1,184 @@ + .. Licensed to the Apache Software Foundation (A

[GitHub] [airflow] Tagar commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2019-10-10 Thread GitBox
Tagar commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r333666158 ## File path: airflow/contrib/hooks/livy_hook.py ## @@ -0,0 +1,297 @@ +# -*- coding: utf-8 -*- +# +# Licen

[GitHub] [airflow] mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r333665532 ## File path: docs/dag-run.rst ## @@ -0,0 +1,184 @@ + .. Licensed to the Apache Software Foundation (A

[GitHub] [airflow] mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r333665351 ## File path: docs/dag-run.rst ## @@ -0,0 +1,184 @@ + .. Licensed to the Apache Software Foundation (A

[GitHub] [airflow] mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6295: [AIRFLOW-XXX] Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r333664883 ## File path: docs/dag-run.rst ## @@ -0,0 +1,184 @@ + .. Licensed to the Apache Software Foundation (A

[GitHub] [airflow] codecov-io edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-10 Thread GitBox
codecov-io edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-529755241 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5743?src=pr&el=h1) Report > Merging

[GitHub] [airflow] yishan-lin commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow

2019-10-10 Thread GitBox
yishan-lin commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow URL: https://github.com/apache/airflow/pull/2708#issuecomment-540703932 In the meantime, we would love people's +1s on this ticket to the Apache Airflow Committee, so we can optimize for bu

[GitHub] [airflow] mik-laj commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests URL: https://github.com/apache/airflow/pull/6299#discussion_r333658530 ## File path: airflow/gcp/hooks/base.py ## @@ -323,8 +341,63 @@ def provide_gcp_credential_file

[jira] [Created] (AIRFLOW-5633) Apache Airflow Integration with HashiCorp Nomad

2019-10-10 Thread Yishan (Jira)
Yishan created AIRFLOW-5633: --- Summary: Apache Airflow Integration with HashiCorp Nomad Key: AIRFLOW-5633 URL: https://issues.apache.org/jira/browse/AIRFLOW-5633 Project: Apache Airflow Issue Type:

[GitHub] [airflow] mik-laj edited a comment on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2019-10-10 Thread GitBox
mik-laj edited a comment on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-540695586 I do rebase on my fork: https://github.com/PolideaInternal/airflow/pull/380/files but i'm waiting for Travis CI. ---

[GitHub] [airflow] mik-laj commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2019-10-10 Thread GitBox
mik-laj commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-540695586 I do rebase on my fork: https://github.com/PolideaInternal/airflow/pull/380/files but i wait for Travis CI. ---

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests

2019-10-10 Thread GitBox
nuclearpinguin commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests URL: https://github.com/apache/airflow/pull/6299#discussion_r333650660 ## File path: airflow/gcp/hooks/base.py ## @@ -323,8 +341,63 @@ def provide_gcp_credenti

[GitHub] [airflow] mik-laj commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests URL: https://github.com/apache/airflow/pull/6299#discussion_r333645166 ## File path: airflow/gcp/hooks/base.py ## @@ -323,8 +341,63 @@ def provide_gcp_credential_file

[GitHub] [airflow] mik-laj commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests URL: https://github.com/apache/airflow/pull/6299#discussion_r333645762 ## File path: airflow/gcp/hooks/base.py ## @@ -323,8 +341,63 @@ def provide_gcp_credential_file

[GitHub] [airflow] mik-laj commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests URL: https://github.com/apache/airflow/pull/6299#discussion_r333645166 ## File path: airflow/gcp/hooks/base.py ## @@ -323,8 +341,63 @@ def provide_gcp_credential_file

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests

2019-10-10 Thread GitBox
nuclearpinguin commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests URL: https://github.com/apache/airflow/pull/6299#discussion_r333638720 ## File path: airflow/gcp/hooks/base.py ## @@ -323,8 +341,63 @@ def provide_gcp_credenti

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests

2019-10-10 Thread GitBox
nuclearpinguin commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests URL: https://github.com/apache/airflow/pull/6299#discussion_r333630818 ## File path: airflow/gcp/hooks/base.py ## @@ -323,8 +341,63 @@ def provide_gcp_credenti

[GitHub] [airflow] mik-laj commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2019-10-10 Thread GitBox
mik-laj commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-540663262 I will try fix it in a moment . Please wait. This is an automat

[jira] [Commented] (AIRFLOW-4030) Add Singularity Container Operator

2019-10-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948742#comment-16948742 ] ASF GitHub Bot commented on AIRFLOW-4030: - vsoch commented on pull request #484

[GitHub] [airflow] vsoch commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2019-10-10 Thread GitBox
vsoch commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-540662329 I'm not sure I can do those merge conflicts - I don't know enough about how airflow works to do it correctly (and I'l likely mess u

[GitHub] [airflow] vsoch opened a new pull request #4846: [AIRFLOW-4030] adding start to singularity for airflow

2019-10-10 Thread GitBox
vsoch opened a new pull request #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846 Hey airflow maintainers! I'm working on an operator for [Singularity containers](https://sylabs.io/guides/3.0/user-guide/), and I have a very basic

[GitHub] [airflow] mik-laj commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2019-10-10 Thread GitBox
mik-laj commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-540656549 I will gladly come back to this topic. Recently, I couldn't do it because I was working on another project. Now I have more time

[GitHub] [airflow] mik-laj commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests

2019-10-10 Thread GitBox
mik-laj commented on a change in pull request #6299: [AIRFLOW-5631] Change way of running GCP system tests URL: https://github.com/apache/airflow/pull/6299#discussion_r333601897 ## File path: airflow/gcp/hooks/base.py ## @@ -323,8 +341,63 @@ def provide_gcp_credential_file

[GitHub] [airflow] mik-laj edited a comment on issue #6290: [AIRFLOW-5618] Remove copy of pygments style

2019-10-10 Thread GitBox
mik-laj edited a comment on issue #6290: [AIRFLOW-5618] Remove copy of pygments style URL: https://github.com/apache/airflow/pull/6290#issuecomment-540651121 I prefer it too, but it is difficult if we have a Python library with CSS code. I don't like Python libraries that have CSS code. T

[GitHub] [airflow] mik-laj commented on issue #6290: [AIRFLOW-5618] Remove copy of pygments style

2019-10-10 Thread GitBox
mik-laj commented on issue #6290: [AIRFLOW-5618] Remove copy of pygments style URL: https://github.com/apache/airflow/pull/6290#issuecomment-540651121 I prefer it too, but it is difficult if we have a Python library with CSS code. I don't like Python libraries that have CSS code. The bound

[jira] [Assigned] (AIRFLOW-5126) Read aws_session_token in extra_config of the aws hook

2019-10-10 Thread Jira
[ https://issues.apache.org/jira/browse/AIRFLOW-5126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johannes Günther reassigned AIRFLOW-5126: - Assignee: Johannes Günther > Read aws_session_token in extra_config of the aws

[GitHub] [airflow] codecov-io edited a comment on issue #6297: [AIRFLOW-5224] Add encoding parameter to GoogleCloudStorageToBigQuery…

2019-10-10 Thread GitBox
codecov-io edited a comment on issue #6297: [AIRFLOW-5224] Add encoding parameter to GoogleCloudStorageToBigQuery… URL: https://github.com/apache/airflow/pull/6297#issuecomment-540080027 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6297?src=pr&el=h1) Report > Merging [#6297](h

[GitHub] [airflow] codecov-io edited a comment on issue #6297: [AIRFLOW-5224] Add encoding parameter to GoogleCloudStorageToBigQuery…

2019-10-10 Thread GitBox
codecov-io edited a comment on issue #6297: [AIRFLOW-5224] Add encoding parameter to GoogleCloudStorageToBigQuery… URL: https://github.com/apache/airflow/pull/6297#issuecomment-540080027 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6297?src=pr&el=h1) Report > Merging [#6297](h

[GitHub] [airflow] vsoch commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2019-10-10 Thread GitBox
vsoch commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-540612745 I kept updating the PR (mostly with linting and rebase with master), all was green, but it was never reviewed or given attention, t

[GitHub] [airflow] kaxil commented on issue #6283: [AIRFLOW-XXXX] Google Season of Docs updates to CONTRIBUTING doc

2019-10-10 Thread GitBox
kaxil commented on issue #6283: [AIRFLOW-] Google Season of Docs updates to CONTRIBUTING doc URL: https://github.com/apache/airflow/pull/6283#issuecomment-540611598 In the first commit msg ```diff - Co-authored-by: Elena Fedotova > + Co-authored-by: Elena Fedotova ```

[GitHub] [airflow] kaxil commented on a change in pull request #6283: [AIRFLOW-XXXX] Google Season of Docs updates to CONTRIBUTING doc

2019-10-10 Thread GitBox
kaxil commented on a change in pull request #6283: [AIRFLOW-] Google Season of Docs updates to CONTRIBUTING doc URL: https://github.com/apache/airflow/pull/6283#discussion_r333548937 ## File path: CONTRIBUTING.rst ## @@ -0,0 +1,662 @@ + .. Licensed to the Apache Softwa

[GitHub] [airflow] kaxil commented on a change in pull request #6283: [AIRFLOW-XXXX] Google Season of Docs updates to CONTRIBUTING doc

2019-10-10 Thread GitBox
kaxil commented on a change in pull request #6283: [AIRFLOW-] Google Season of Docs updates to CONTRIBUTING doc URL: https://github.com/apache/airflow/pull/6283#discussion_r333547005 ## File path: CONTRIBUTING.rst ## @@ -0,0 +1,662 @@ + .. Licensed to the Apache Softwa

[GitHub] [airflow] kaxil commented on a change in pull request #6283: [AIRFLOW-XXXX] Google Season of Docs updates to CONTRIBUTING doc

2019-10-10 Thread GitBox
kaxil commented on a change in pull request #6283: [AIRFLOW-] Google Season of Docs updates to CONTRIBUTING doc URL: https://github.com/apache/airflow/pull/6283#discussion_r333545188 ## File path: CONTRIBUTING.rst ## @@ -0,0 +1,662 @@ + .. Licensed to the Apache Softwa

[GitHub] [airflow] kaxil commented on a change in pull request #6283: [AIRFLOW-XXXX] Google Season of Docs updates to CONTRIBUTING doc

2019-10-10 Thread GitBox
kaxil commented on a change in pull request #6283: [AIRFLOW-] Google Season of Docs updates to CONTRIBUTING doc URL: https://github.com/apache/airflow/pull/6283#discussion_r333543575 ## File path: CONTRIBUTING.rst ## @@ -0,0 +1,662 @@ + .. Licensed to the Apache Softwa

[GitHub] [airflow] kaxil commented on a change in pull request #6283: [AIRFLOW-XXXX] Google Season of Docs updates to CONTRIBUTING doc

2019-10-10 Thread GitBox
kaxil commented on a change in pull request #6283: [AIRFLOW-] Google Season of Docs updates to CONTRIBUTING doc URL: https://github.com/apache/airflow/pull/6283#discussion_r333544610 ## File path: CONTRIBUTING.rst ## @@ -0,0 +1,662 @@ + .. Licensed to the Apache Softwa

[GitHub] [airflow] oguitart commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2019-10-10 Thread GitBox
oguitart commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-540606853 Hello, I'm wondering what is the status of this. It would be very useful to have a singularity operator as there is a Doc

[GitHub] [airflow] kaxil commented on a change in pull request #6283: [AIRFLOW-XXXX] Google Season of Docs updates to CONTRIBUTING doc

2019-10-10 Thread GitBox
kaxil commented on a change in pull request #6283: [AIRFLOW-] Google Season of Docs updates to CONTRIBUTING doc URL: https://github.com/apache/airflow/pull/6283#discussion_r333543575 ## File path: CONTRIBUTING.rst ## @@ -0,0 +1,662 @@ + .. Licensed to the Apache Softwa

[GitHub] [airflow] kaxil commented on a change in pull request #6283: [AIRFLOW-XXXX] Google Season of Docs updates to CONTRIBUTING doc

2019-10-10 Thread GitBox
kaxil commented on a change in pull request #6283: [AIRFLOW-] Google Season of Docs updates to CONTRIBUTING doc URL: https://github.com/apache/airflow/pull/6283#discussion_r333542938 ## File path: CONTRIBUTING.rst ## @@ -0,0 +1,662 @@ + .. Licensed to the Apache Softwa

[GitHub] [airflow] kaxil commented on a change in pull request #6297: [AIRFLOW-5224] Add encoding parameter to GoogleCloudStorageToBigQuery…

2019-10-10 Thread GitBox
kaxil commented on a change in pull request #6297: [AIRFLOW-5224] Add encoding parameter to GoogleCloudStorageToBigQuery… URL: https://github.com/apache/airflow/pull/6297#discussion_r333535926 ## File path: airflow/gcp/hooks/bigquery.py ## @@ -1134,6 +1141,10 @@ def run_lo

[jira] [Created] (AIRFLOW-5632) Rename operators tests

2019-10-10 Thread Jira
Michał Słowikowski created AIRFLOW-5632: --- Summary: Rename operators tests Key: AIRFLOW-5632 URL: https://issues.apache.org/jira/browse/AIRFLOW-5632 Project: Apache Airflow Issue Type: I

[jira] [Commented] (AIRFLOW-5126) Read aws_session_token in extra_config of the aws hook

2019-10-10 Thread Jira
[ https://issues.apache.org/jira/browse/AIRFLOW-5126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948586#comment-16948586 ] Johannes Günther commented on AIRFLOW-5126: --- I think it would actually make a

[GitHub] [airflow] kpathak13 commented on issue #6237: AIRFLOW-5581: Join KubernetesJobWatcher in terminate call and unblock queues from blocking forever

2019-10-10 Thread GitBox
kpathak13 commented on issue #6237: AIRFLOW-5581: Join KubernetesJobWatcher in terminate call and unblock queues from blocking forever URL: https://github.com/apache/airflow/pull/6237#issuecomment-540588073 @ashb , I tested this on my k8 cluster: 1. Scheduled multiple high freq

[jira] [Commented] (AIRFLOW-4661) Make airflow/config_templates Pylint compatible

2019-10-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948583#comment-16948583 ] ASF GitHub Bot commented on AIRFLOW-4661: - arkadiuszbach commented on pull requ

[GitHub] [airflow] arkadiuszbach opened a new pull request #6300: [AIRFLOW-4661] Make airflow/config_templates Pylint compatible

2019-10-10 Thread GitBox
arkadiuszbach opened a new pull request #6300: [AIRFLOW-4661] Make airflow/config_templates Pylint compatible URL: https://github.com/apache/airflow/pull/6300 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://iss

  1   2   >