[GitHub] [airflow] Swalloow commented on pull request #9969: Add typing to amazon provider EMR

2020-09-13 Thread GitBox
Swalloow commented on pull request #9969: URL: https://github.com/apache/airflow/pull/9969#issuecomment-691624673 Replace to #10910 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] Swalloow opened a new pull request #10910: Add typing to amazon provider EMR

2020-09-13 Thread GitBox
Swalloow opened a new pull request #10910: URL: https://github.com/apache/airflow/pull/10910 related: #9708, #9969 Adding type annotations to `amazon/emr`. --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] Swalloow closed pull request #9969: Add typing to amazon provider EMR

2020-09-13 Thread GitBox
Swalloow closed pull request #9969: URL: https://github.com/apache/airflow/pull/9969 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] turbaszek commented on a change in pull request #10901: Add CeleryKubernetesExecutor

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #10901: URL: https://github.com/apache/airflow/pull/10901#discussion_r487505282 ## File path: docs/executor/celery_kubernetes.rst ## @@ -0,0 +1,42 @@ + .. Licensed to the Apache Software Foundation (ASF) under one +or more

[GitHub] [airflow] turbaszek commented on a change in pull request #10901: Add CeleryKubernetesExecutor

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #10901: URL: https://github.com/apache/airflow/pull/10901#discussion_r487505044 ## File path: docs/executor/celery_kubernetes.rst ## @@ -0,0 +1,42 @@ + .. Licensed to the Apache Software Foundation (ASF) under one +or more

[GitHub] [airflow] turbaszek commented on a change in pull request #10901: Add CeleryKubernetesExecutor

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #10901: URL: https://github.com/apache/airflow/pull/10901#discussion_r487504972 ## File path: docs/executor/celery_kubernetes.rst ## @@ -0,0 +1,42 @@ + .. Licensed to the Apache Software Foundation (ASF) under one +or more

[GitHub] [airflow] potiuk merged pull request #10898: Add Secrets backend for Microsoft Azure Key Vault

2020-09-13 Thread GitBox
potiuk merged pull request #10898: URL: https://github.com/apache/airflow/pull/10898 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk closed issue #8258: Implement Azure key vault secrets backend

2020-09-13 Thread GitBox
potiuk closed issue #8258: URL: https://github.com/apache/airflow/issues/8258 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[airflow] branch master updated: Add Secrets backend for Microsoft Azure Key Vault (#10898)

2020-09-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new f77a11d Add Secrets backend for Microsoft

[GitHub] [airflow] turbaszek commented on a change in pull request #10910: Add typing to amazon provider EMR

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #10910: URL: https://github.com/apache/airflow/pull/10910#discussion_r487540164 ## File path: airflow/providers/amazon/aws/operators/emr_add_steps.py ## @@ -52,34 +53,36 @@ class EmrAddStepsOperator(BaseOperator):

[GitHub] [airflow] boring-cyborg[bot] commented on issue #10911: Allow custom behavior on sensor timeout

2020-09-13 Thread GitBox
boring-cyborg[bot] commented on issue #10911: URL: https://github.com/apache/airflow/issues/10911#issuecomment-691649446 Thanks for opening your first issue here! Be sure to follow the issue template! This is an

[GitHub] [airflow] shakedzy opened a new issue #10911: Allow custom behavior on sensor timeout

2020-09-13 Thread GitBox
shakedzy opened a new issue #10911: URL: https://github.com/apache/airflow/issues/10911 **Description** Allow custom behavior on sensor timeout: When sensors timeout, they throw an exception. A custom behavior on such cases can be useful, just like the `on_kill` method.

[GitHub] [airflow] potiuk commented on issue #9781: Release backport package for cncf.kubernetes

2020-09-13 Thread GitBox
potiuk commented on issue #9781: URL: https://github.com/apache/airflow/issues/9781#issuecomment-691678119 @mathiassp , it's delayed a bit but for very good reasons (see the last comment and just updated description in https://github.com/apache/airflow/issues/10014) There is a bug

[airflow] branch master updated (16b02df -> 75bbddf)

2020-09-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 16b02df Add missing closing bracket in CI.rst (#10908) add 75bbddf Make the usage of bash 'shift' consistent

[airflow] branch master updated (16b02df -> 75bbddf)

2020-09-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 16b02df Add missing closing bracket in CI.rst (#10908) add 75bbddf Make the usage of bash 'shift' consistent

[GitHub] [airflow] kaxil commented on pull request #10898: Add Secrets backend for Microsoft Azure Key Vault

2020-09-13 Thread GitBox
kaxil commented on pull request #10898: URL: https://github.com/apache/airflow/pull/10898#issuecomment-691686569 No, I think the test was cancelled because another PR was merged, I can't see any error This is an automated

[airflow] branch constraints-master updated: Updating constraints. Build id:252511905

2020-09-13 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 6251945 Updating

[airflow] branch constraints-master updated: Updating constraints. Build id:252511905

2020-09-13 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 6251945 Updating

[GitHub] [airflow] potiuk commented on pull request #10898: Add Secrets backend for Microsoft Azure Key Vault

2020-09-13 Thread GitBox
potiuk commented on pull request #10898: URL: https://github.com/apache/airflow/pull/10898#issuecomment-691688896 I am running my PR rebased on master now https://github.com/apache/airflow/pull/10912/checks?check_run_id=1108699419

[airflow] branch master updated (16b02df -> 75bbddf)

2020-09-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 16b02df Add missing closing bracket in CI.rst (#10908) add 75bbddf Make the usage of bash 'shift' consistent

[airflow] branch master updated (6dd2a0d -> 16b02df)

2020-09-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 6dd2a0d Update the name of static check without pylint in CI.rst (#10909) add 16b02df Add missing closing

[GitHub] [airflow] potiuk commented on a change in pull request #10906: Fix typos in scripts/ci/docker-compose/local.yml

2020-09-13 Thread GitBox
potiuk commented on a change in pull request #10906: URL: https://github.com/apache/airflow/pull/10906#discussion_r487536437 ## File path: scripts/ci/docker-compose/local.yml ## @@ -20,9 +20,9 @@ services: airflow: stdin_open: true # docker run -i tty: true #

[GitHub] [airflow] potiuk merged pull request #10904: Fix grammar in BREEZE.rst

2020-09-13 Thread GitBox
potiuk merged pull request #10904: URL: https://github.com/apache/airflow/pull/10904 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated (d8237b8 -> 76dc7ed)

2020-09-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from d8237b8 Fix typos in BREEZE.rst (#10905) add 76dc7ed Fix grammar in BREEZE.rst (#10904) No new revisions

[airflow] branch master updated: Fix typos in BREEZE.rst (#10905)

2020-09-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new d8237b8 Fix typos in BREEZE.rst (#10905)

[GitHub] [airflow] potiuk merged pull request #10905: Fix typos in BREEZE.rst

2020-09-13 Thread GitBox
potiuk merged pull request #10905: URL: https://github.com/apache/airflow/pull/10905 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] kaxil commented on pull request #10906: Fix typos in scripts/ci/docker-compose/local.yml

2020-09-13 Thread GitBox
kaxil commented on pull request #10906: URL: https://github.com/apache/airflow/pull/10906#issuecomment-691681453 Committed suggestions This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] potiuk commented on pull request #10898: Add Secrets backend for Microsoft Azure Key Vault

2020-09-13 Thread GitBox
potiuk commented on pull request #10898: URL: https://github.com/apache/airflow/pull/10898#issuecomment-691686288 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] kaxil commented on pull request #10898: Add Secrets backend for Microsoft Azure Key Vault

2020-09-13 Thread GitBox
kaxil commented on pull request #10898: URL: https://github.com/apache/airflow/pull/10898#issuecomment-691686435 Checking This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] potiuk commented on pull request #10898: Add Secrets backend for Microsoft Azure Key Vault

2020-09-13 Thread GitBox
potiuk commented on pull request #10898: URL: https://github.com/apache/airflow/pull/10898#issuecomment-691688716 In another PR This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] potiuk commented on pull request #10898: Add Secrets backend for Microsoft Azure Key Vault

2020-09-13 Thread GitBox
potiuk commented on pull request #10898: URL: https://github.com/apache/airflow/pull/10898#issuecomment-691688694 https://github.com/apache/airflow/runs/1108600218?check_suite_focus=true This is an automated message from the

[GitHub] [airflow] mathiassp commented on issue #9781: Release backport package for cncf.kubernetes

2020-09-13 Thread GitBox
mathiassp commented on issue #9781: URL: https://github.com/apache/airflow/issues/9781#issuecomment-691667635 Any update on the release of the backport package for cncf.kubernetes? I can't seem to find it in the PyPi repository.

[airflow] branch master updated: Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869)

2020-09-13 Thread turbaszek
This is an automated email from the ASF dual-hosted git repository. turbaszek pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 12a652f Fix parameter name collision in

[GitHub] [airflow] turbaszek closed issue #10723: Parameter name collision in AutoMLBatchPredictOperator

2020-09-13 Thread GitBox
turbaszek closed issue #10723: URL: https://github.com/apache/airflow/issues/10723 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] turbaszek merged pull request #10869: Fix parameter name collision in AutoMLBatchPredictOperator #10723

2020-09-13 Thread GitBox
turbaszek merged pull request #10869: URL: https://github.com/apache/airflow/pull/10869 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [airflow] potiuk opened a new pull request #10912: Fixes retrieval of correct branch in non-master related builds

2020-09-13 Thread GitBox
potiuk opened a new pull request #10912: URL: https://github.com/apache/airflow/pull/10912 When we ported the new CI mechanism to v1-10-test it turned out that we have to correct the retrieval of DEFAULT BRANCH. Since we are building the images using the "master" scripts, we need to

[GitHub] [airflow] agonen commented on issue #10791: Async pod launch

2020-09-13 Thread GitBox
agonen commented on issue #10791: URL: https://github.com/apache/airflow/issues/10791#issuecomment-691685228 ? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] potiuk commented on pull request #10898: Add Secrets backend for Microsoft Azure Key Vault

2020-09-13 Thread GitBox
potiuk commented on pull request #10898: URL: https://github.com/apache/airflow/pull/10898#issuecomment-691690782 Hmm. It works. It was an interesting race condition that I must have to take a closer look at :) This is an

[GitHub] [airflow] potiuk commented on pull request #10898: Add Secrets backend for Microsoft Azure Key Vault

2020-09-13 Thread GitBox
potiuk commented on pull request #10898: URL: https://github.com/apache/airflow/pull/10898#issuecomment-691691727 Allright I know @kaxil . It was manifestation of the #10471 Currenlty the image is built using the original commit, but the build itself is run using sources after the

[GitHub] [airflow] potiuk merged pull request #10907: Make the usage of bash 'shift' consistent across Breeze

2020-09-13 Thread GitBox
potiuk merged pull request #10907: URL: https://github.com/apache/airflow/pull/10907 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk merged pull request #10908: Add missing closing bracket in CI.rst

2020-09-13 Thread GitBox
potiuk merged pull request #10908: URL: https://github.com/apache/airflow/pull/10908 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk merged pull request #10909: Update the name of static check without pylint in CI.rst

2020-09-13 Thread GitBox
potiuk merged pull request #10909: URL: https://github.com/apache/airflow/pull/10909 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated (6dd2a0d -> 16b02df)

2020-09-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 6dd2a0d Update the name of static check without pylint in CI.rst (#10909) add 16b02df Add missing closing

[airflow] branch master updated (92eafc0 -> 6dd2a0d)

2020-09-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 92eafc0 Parameterize tests in hashicorp/hooks/test_vault.py (#10903) add 6dd2a0d Update the name of static

[airflow] branch master updated: Update the name of static check without pylint in CI.rst (#10909)

2020-09-13 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 6dd2a0d Update the name of static check

[GitHub] [airflow] turbaszek commented on a change in pull request #10864: Increase typing coverage for postgres provider

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #10864: URL: https://github.com/apache/airflow/pull/10864#discussion_r487541603 ## File path: airflow/providers/postgres/hooks/postgres.py ## @@ -53,13 +58,13 @@ class PostgresHook(DbApiHook): default_conn_name =

[GitHub] [airflow] turbaszek commented on a change in pull request #10864: Increase typing coverage for postgres provider

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #10864: URL: https://github.com/apache/airflow/pull/10864#discussion_r487541603 ## File path: airflow/providers/postgres/hooks/postgres.py ## @@ -53,13 +58,13 @@ class PostgresHook(DbApiHook): default_conn_name =

[GitHub] [airflow] potiuk edited a comment on pull request #10912: Fixes retrieval of correct branch in non-master related builds

2020-09-13 Thread GitBox
potiuk edited a comment on pull request #10912: URL: https://github.com/apache/airflow/pull/10912#issuecomment-691685537 I am close to backport the new CI to v1-10-test. This should immensely speed up the v1-10-test CI builds.

[GitHub] [airflow] potiuk commented on pull request #10912: Fixes retrieval of correct branch in non-master related builds

2020-09-13 Thread GitBox
potiuk commented on pull request #10912: URL: https://github.com/apache/airflow/pull/10912#issuecomment-691685537 I am close to backport the new CI to v1-10-test. This shoudl immensely speed up the v1-10-test CI builds.

[GitHub] [airflow] dimberman opened a new pull request #10916: add example dag_templates

2020-09-13 Thread GitBox
dimberman opened a new pull request #10916: URL: https://github.com/apache/airflow/pull/10916 (cherry picked from commit 634f60a10980696ef279cac6376624202baec9c5) --- **^ Add meaningful description above** Read the **[Pull Request

[jira] [Assigned] (AIRFLOW-3644) AIP-8 Split Hooks/Operators out of core package and repository

2020-09-13 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk reassigned AIRFLOW-3644: - Assignee: Jarek Potiuk > AIP-8 Split Hooks/Operators out of core package and

[GitHub] [airflow] abhilash1in commented on a change in pull request #10873: Add description field to connection (#10840)

2020-09-13 Thread GitBox
abhilash1in commented on a change in pull request #10873: URL: https://github.com/apache/airflow/pull/10873#discussion_r487577386 ## File path: airflow/models/connection.py ## @@ -16,6 +16,8 @@ # specific language governing permissions and limitations # under the License.

[jira] [Updated] (AIRFLOW-3644) AIP-8 Split Hooks/Operators out of core package and repository

2020-09-13 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-3644: -- Description: Based on discussion at

[GitHub] [airflow] kaxil commented on pull request #10906: Fix typos in scripts/ci/docker-compose/local.yml

2020-09-13 Thread GitBox
kaxil commented on pull request #10906: URL: https://github.com/apache/airflow/pull/10906#issuecomment-691726874 > Shoudl be rebased to avoid the #10741-related failures done This is an automated message from the

[airflow] branch master updated (69be4b8 -> 87e7ad9)

2020-09-13 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 69be4b8 Fix typos in scripts/ci/docker-compose/local.yml (#10906) add 87e7ad9 fix bug where multiple

[airflow] branch master updated (69be4b8 -> 87e7ad9)

2020-09-13 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 69be4b8 Fix typos in scripts/ci/docker-compose/local.yml (#10906) add 87e7ad9 fix bug where multiple

[GitHub] [airflow] dimberman merged pull request #10915: fix bug where multiple volume mounts created in helm chart

2020-09-13 Thread GitBox
dimberman merged pull request #10915: URL: https://github.com/apache/airflow/pull/10915 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [airflow] turbaszek commented on a change in pull request #10873: Add description field to connection (#10840)

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #10873: URL: https://github.com/apache/airflow/pull/10873#discussion_r487580249 ## File path: airflow/models/connection.py ## @@ -16,6 +16,8 @@ # specific language governing permissions and limitations # under the License. +#

[GitHub] [airflow] turbaszek commented on a change in pull request #10873: Add description field to connection (#10840)

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #10873: URL: https://github.com/apache/airflow/pull/10873#discussion_r487580249 ## File path: airflow/models/connection.py ## @@ -16,6 +16,8 @@ # specific language governing permissions and limitations # under the License. +#

[airflow] branch master updated: Fix typos in scripts/ci/docker-compose/local.yml (#10906)

2020-09-13 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 69be4b8 Fix typos in

[airflow] branch master updated (12a652f -> 69be4b8)

2020-09-13 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 12a652f Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869) add 69be4b8 Fix typos

[GitHub] [airflow] kaxil merged pull request #10906: Fix typos in scripts/ci/docker-compose/local.yml

2020-09-13 Thread GitBox
kaxil merged pull request #10906: URL: https://github.com/apache/airflow/pull/10906 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] abhilash1in commented on a change in pull request #10873: Add description field to connection (#10840)

2020-09-13 Thread GitBox
abhilash1in commented on a change in pull request #10873: URL: https://github.com/apache/airflow/pull/10873#discussion_r487587396 ## File path: airflow/models/connection.py ## @@ -16,6 +16,8 @@ # specific language governing permissions and limitations # under the License.

[GitHub] [airflow] potiuk commented on pull request #10906: Fix typos in scripts/ci/docker-compose/local.yml

2020-09-13 Thread GitBox
potiuk commented on pull request #10906: URL: https://github.com/apache/airflow/pull/10906#issuecomment-691692199 Shoudl be rebased to avoid the #10741-related failures This is an automated message from the Apache Git

[GitHub] [airflow] potiuk commented on issue #10471: Current CI builds slightly different sources than the one in PR build

2020-09-13 Thread GitBox
potiuk commented on issue #10471: URL: https://github.com/apache/airflow/issues/10471#issuecomment-691692568 I might want to try to fix that one if we have more problems like this.. The problems will manifest in sometimes weird errors if the PR has not been rebased to the latest master.

[GitHub] [airflow] potiuk commented on issue #10471: Current CI builds slightly different sources than the one in PR build

2020-09-13 Thread GitBox
potiuk commented on issue #10471: URL: https://github.com/apache/airflow/issues/10471#issuecomment-691692774 For example missing dependencies that has just been added. In any case, the workaround is simply to rebase such PR to the latest master, but I think I saw several of those

[GitHub] [airflow] potiuk edited a comment on issue #10913: HTTP connection parse path as schema but use as protocol

2020-09-13 Thread GitBox
potiuk edited a comment on issue #10913: URL: https://github.com/apache/airflow/issues/10913#issuecomment-691693194 Yeah @dungdm93 - this is a known problem, It's not a bug per-se, more of a naming problem but it's hard to solve in a backward-compatible way. Would you like to attempt to

[GitHub] [airflow] potiuk edited a comment on issue #10913: HTTP connection parse path as schema but use as protocol

2020-09-13 Thread GitBox
potiuk edited a comment on issue #10913: URL: https://github.com/apache/airflow/issues/10913#issuecomment-691693194 Yeah @dungdm93 - this is a known problem, It's not a bug per-se, more of a naming problem but it's hard to solve in a backward-compatible way. Would you like to attempt to

[GitHub] [airflow] potiuk commented on issue #10913: HTTP connection parse path as schema but use as protocol

2020-09-13 Thread GitBox
potiuk commented on issue #10913: URL: https://github.com/apache/airflow/issues/10913#issuecomment-691693194 Yeah @dungdm93 - this is a known problem, It's not a bug per-se, but it's hard to solve in a backward-compatible way. Would you like to attempt to solve it this way that the

[GitHub] [airflow] potiuk commented on issue #10913: HTTP connection parse path as schema but use as protocol

2020-09-13 Thread GitBox
potiuk commented on issue #10913: URL: https://github.com/apache/airflow/issues/10913#issuecomment-691693409 And it would be great to solve it BTW. it's pretty anoying. This is an automated message from the Apache Git

[GitHub] [airflow] anshul17khanna opened a new issue #10914: Api to fetch all dag ids filtered by tags

2020-09-13 Thread GitBox
anshul17khanna opened a new issue #10914: URL: https://github.com/apache/airflow/issues/10914 **Description** A utility as well as a Restful Api to fetch all the dag ids by a given tag. The method can be implemented as `get_dags_by_tag` and experimental api as `GET

[GitHub] [airflow] turbaszek closed issue #10395: Invalid Syntax Error When Importing hdfs_hook

2020-09-13 Thread GitBox
turbaszek closed issue #10395: URL: https://github.com/apache/airflow/issues/10395 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] turbaszek commented on issue #10395: Invalid Syntax Error When Importing hdfs_hook

2020-09-13 Thread GitBox
turbaszek commented on issue #10395: URL: https://github.com/apache/airflow/issues/10395#issuecomment-691713858 Closing as the issue seems to be solved and it seems that `snakebite-py3` is required for hdfs:

[GitHub] [airflow] turbaszek commented on a change in pull request #9960: Implement passing a list into get_records

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #9960: URL: https://github.com/apache/airflow/pull/9960#discussion_r487567778 ## File path: airflow/hooks/dbapi_hook.py ## @@ -132,14 +133,35 @@ def get_records(self, sql, parameters=None): :type sql: str or list

[GitHub] [airflow] turbaszek commented on a change in pull request #9960: Implement passing a list into get_records

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #9960: URL: https://github.com/apache/airflow/pull/9960#discussion_r487567921 ## File path: airflow/hooks/dbapi_hook.py ## @@ -123,7 +123,8 @@ def get_pandas_df(self, sql, parameters=None, **kwargs): with

[GitHub] [airflow] dimberman opened a new pull request #10915: fix bug where multiple volume mounts created in helm chart

2020-09-13 Thread GitBox
dimberman opened a new pull request #10915: URL: https://github.com/apache/airflow/pull/10915 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for

[GitHub] [airflow] turbaszek commented on pull request #9464: Fix DockerOperator xcom

2020-09-13 Thread GitBox
turbaszek commented on pull request #9464: URL: https://github.com/apache/airflow/pull/9464#issuecomment-691715460 Hey @nullhack can you rebase, please? In the meantime we introduced black formatter in providers packages :)

[GitHub] [airflow] turbaszek commented on a change in pull request #10760: Create salesforce to gcs transfer

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #10760: URL: https://github.com/apache/airflow/pull/10760#discussion_r487570170 ## File path: tests/providers/google/cloud/transfers/test_salesforce_to_gcs_system.py ## @@ -0,0 +1,73 @@ +# Licensed to the Apache Software

[GitHub] [airflow] stale[bot] commented on pull request #10062: [WIP] Try_number as identifying label on a POD when using KubernetesPodOperator

2020-09-13 Thread GitBox
stale[bot] commented on pull request #10062: URL: https://github.com/apache/airflow/pull/10062#issuecomment-691716898 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your

[GitHub] [airflow] potiuk closed issue #10914: Api to fetch all dag ids filtered by tags

2020-09-13 Thread GitBox
potiuk closed issue #10914: URL: https://github.com/apache/airflow/issues/10914 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] potiuk commented on issue #10914: Api to fetch all dag ids filtered by tags

2020-09-13 Thread GitBox
potiuk commented on issue #10914: URL: https://github.com/apache/airflow/issues/10914#issuecomment-691710507 We have a fully-featured API coming in Airflow 2.0. #8107 the current, experimental API is not going to be extended any more. Airflow 2.0 is going to be released by the end of the

[GitHub] [airflow] turbaszek commented on a change in pull request #9960: Implement passing a list into get_records

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #9960: URL: https://github.com/apache/airflow/pull/9960#discussion_r487567645 ## File path: airflow/hooks/dbapi_hook.py ## @@ -132,14 +133,35 @@ def get_records(self, sql, parameters=None): :type sql: str or list

[GitHub] [airflow] turbaszek commented on pull request #10415: Add missing deprecated classes

2020-09-13 Thread GitBox
turbaszek commented on pull request #10415: URL: https://github.com/apache/airflow/pull/10415#issuecomment-691715120 @bhavaniravi can you please take a look at CI errors? This is an automated message from the Apache Git

[GitHub] [airflow] turbaszek commented on pull request #10838: Fix autocommit property for snowflake connection

2020-09-13 Thread GitBox
turbaszek commented on pull request #10838: URL: https://github.com/apache/airflow/pull/10838#issuecomment-691716326 @stijn-meersman would you mind rebasing your PR? It seems that this CI error is not related to your change

[GitHub] [airflow] turbaszek commented on a change in pull request #9246: Few new functionalities and changes in S3ToRedshiftOperator

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #9246: URL: https://github.com/apache/airflow/pull/9246#discussion_r487569977 ## File path: airflow/providers/amazon/aws/transfers/s3_to_redshift.py ## @@ -112,6 +119,17 @@ def execute(self, context):

[GitHub] [airflow] boring-cyborg[bot] commented on issue #10913: HTTP connection parse path as schema but use as protocol

2020-09-13 Thread GitBox
boring-cyborg[bot] commented on issue #10913: URL: https://github.com/apache/airflow/issues/10913#issuecomment-691692859 Thanks for opening your first issue here! Be sure to follow the issue template! This is an

[GitHub] [airflow] dungdm93 opened a new issue #10913: HTTP connection parse path as schema but use as protocol

2020-09-13 Thread GitBox
dungdm93 opened a new issue #10913: URL: https://github.com/apache/airflow/issues/10913 **Apache Airflow version**: 1.10.11 **Environment**: - **Cloud provider or hardware configuration**: - **OS** (e.g. from /etc/os-release): Ubuntu 20.04 - **Kernel** (e.g. `uname

[GitHub] [airflow] boring-cyborg[bot] commented on issue #10914: Api to fetch all dag ids filtered by tags

2020-09-13 Thread GitBox
boring-cyborg[bot] commented on issue #10914: URL: https://github.com/apache/airflow/issues/10914#issuecomment-691708877 Thanks for opening your first issue here! Be sure to follow the issue template! This is an

[GitHub] [airflow] turbaszek commented on issue #10641: Add new connection type - Greenplum

2020-09-13 Thread GitBox
turbaszek commented on issue #10641: URL: https://github.com/apache/airflow/issues/10641#issuecomment-691713482 @mebelousov would you like to open a PR? This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] turbaszek commented on pull request #10337: Update redshift_to_s3.py

2020-09-13 Thread GitBox
turbaszek commented on pull request #10337: URL: https://github.com/apache/airflow/pull/10337#issuecomment-691714947 @selvamshan can I please ask you to leave only one PR open for this issue? Duplicates #10338 #10335 This

[GitHub] [airflow] turbaszek commented on a change in pull request #10873: Add description field to connection (#10840)

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #10873: URL: https://github.com/apache/airflow/pull/10873#discussion_r487569255 ## File path: airflow/models/connection.py ## @@ -16,6 +16,8 @@ # specific language governing permissions and limitations # under the License. +#

[GitHub] [airflow] turbaszek commented on pull request #10873: Add description field to connection (#10840)

2020-09-13 Thread GitBox
turbaszek commented on pull request #10873: URL: https://github.com/apache/airflow/pull/10873#issuecomment-691715965 For me this looks good just one comment  This is an automated message from the Apache Git Service. To

[GitHub] [airflow] turbaszek commented on a change in pull request #10760: Create salesforce to gcs transfer

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #10760: URL: https://github.com/apache/airflow/pull/10760#discussion_r487570484 ## File path: tests/providers/google/cloud/transfers/test_salesforce_to_gcs_system.py ## @@ -0,0 +1,73 @@ +# Licensed to the Apache Software

[GitHub] [airflow] turbaszek commented on a change in pull request #10760: Create salesforce to gcs transfer

2020-09-13 Thread GitBox
turbaszek commented on a change in pull request #10760: URL: https://github.com/apache/airflow/pull/10760#discussion_r487570420 ## File path: docs/howto/operator/google/transfer/salesforce_to_gcs.rst ## @@ -0,0 +1,49 @@ + .. Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] kaxil opened a new pull request #10919: Add Formatted Stacktrace for Spelling Error

2020-09-13 Thread GitBox
kaxil opened a new pull request #10919: URL: https://github.com/apache/airflow/pull/10919 The spelling errors from our spell-check CI job were difficult for some users. This PR adds the code to simplify this and show the summary of all the errors. **Before**:

[GitHub] [airflow] Adil-Ibragimov commented on pull request #10315: Add retry_only_on_pod_launching_failure and log_container_statuses_on…

2020-09-13 Thread GitBox
Adil-Ibragimov commented on pull request #10315: URL: https://github.com/apache/airflow/pull/10315#issuecomment-691803644 @ashb Ping! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] chipmyersjr commented on a change in pull request #10760: Create salesforce to gcs transfer

2020-09-13 Thread GitBox
chipmyersjr commented on a change in pull request #10760: URL: https://github.com/apache/airflow/pull/10760#discussion_r487648438 ## File path: tests/providers/google/cloud/transfers/test_salesforce_to_gcs_system.py ## @@ -0,0 +1,73 @@ +# Licensed to the Apache Software

[GitHub] [airflow] chipmyersjr commented on a change in pull request #10760: Create salesforce to gcs transfer

2020-09-13 Thread GitBox
chipmyersjr commented on a change in pull request #10760: URL: https://github.com/apache/airflow/pull/10760#discussion_r487648711 ## File path: tests/providers/google/cloud/transfers/test_salesforce_to_gcs_system.py ## @@ -0,0 +1,73 @@ +# Licensed to the Apache Software

[GitHub] [airflow] Shivarp1 opened a new issue #10920: KubernetesPodOperatror VolumeMount "read_only" flag set as "False" is not writing to mounted NAS directory

2020-09-13 Thread GitBox
Shivarp1 opened a new issue #10920: URL: https://github.com/apache/airflow/issues/10920 **Description**: The task completes and XCOM returns are successful, but the volume mounts for the worker Pod is not writing to the mounted volume. The readonly flag set as "False" in the Pod

[GitHub] [airflow] anshul17khanna opened a new issue #10921: Asynchrounous run for DatabricksRunNowOperator

2020-09-13 Thread GitBox
anshul17khanna opened a new issue #10921: URL: https://github.com/apache/airflow/issues/10921 **Description** Ability to let `DatabricksRunNowOperator` to run asynchronously based on an optional argument `async=False`. **Use case / motivation** Sometimes a databricks

  1   2   >