[airflow] branch master updated (48da4b4 -> ca88151)

2020-06-18 Thread feluelle
This is an automated email from the ASF dual-hosted git repository. feluelle pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 48da4b4 Replace old Airflow screenshots with new images (#9393) add ca88151 Fix in-breeze CLI tools to work

[GitHub] [airflow] feluelle merged pull request #9376: Fix in-breeze CLI tools to work also on Linux

2020-06-18 Thread GitBox
feluelle merged pull request #9376: URL: https://github.com/apache/airflow/pull/9376 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] feluelle commented on a change in pull request #9350: Add deletion by prefix to S3DeleteObjectsOperator

2020-06-18 Thread GitBox
feluelle commented on a change in pull request #9350: URL: https://github.com/apache/airflow/pull/9350#discussion_r442663134 ## File path: airflow/providers/amazon/aws/operators/s3_delete_objects.py ## @@ -56,22 +59,31 @@ class S3DeleteObjectsOperator(BaseOperator): :type

[GitHub] [airflow] aneesh-joseph commented on a change in pull request #9371: Add git sync option & helm unit tests

2020-06-18 Thread GitBox
aneesh-joseph commented on a change in pull request #9371: URL: https://github.com/apache/airflow/pull/9371#discussion_r442657586 ## File path: scripts/ci/ci_run_helm_testing.sh ## @@ -0,0 +1,28 @@ +#!/usr/bin/env bash +# Licensed to the Apache Software Foundation (ASF) under o

[GitHub] [airflow] buxizhizhoum commented on pull request #9377: Fix Connection reset by peer when there is no log for a long time

2020-06-18 Thread GitBox
buxizhizhoum commented on pull request #9377: URL: https://github.com/apache/airflow/pull/9377#issuecomment-646462559 Is there anything more to do? I could pass **CI Build / Quarantined:Pg9.6,Py3.6 (pull_request)** check in forked repository, however it fails here. --

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #9397: Add sensitive_variable_fields option to extend `DEFAULT_SENSITIVE_VARIABLE_FIELDS`

2020-06-18 Thread GitBox
boring-cyborg[bot] commented on pull request #9397: URL: https://github.com/apache/airflow/pull/9397#issuecomment-646461437 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contr

[GitHub] [airflow] Marloxo opened a new pull request #9397: Add sensitive_variable_fields option to extend `DEFAULT_SENSITIVE_VARIABLE_FIELDS`

2020-06-18 Thread GitBox
Marloxo opened a new pull request #9397: URL: https://github.com/apache/airflow/pull/9397 --- Make sure to mark the boxes below before creating PR: [x] - [x] Description above provides context of the change - [x] Unit tests coverage for changes (not needed for documentation chan

[jira] [Commented] (AIRFLOW-6981) Move Google Cloud Build from Discovery API to Python Library

2020-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140248#comment-17140248 ] ASF GitHub Bot commented on AIRFLOW-6981: - ryanyuan commented on pull request #

[GitHub] [airflow] ryanyuan commented on pull request #8575: [AIRFLOW-6981] Move Google Cloud Build from Discovery API to Python Library

2020-06-18 Thread GitBox
ryanyuan commented on pull request #8575: URL: https://github.com/apache/airflow/pull/8575#issuecomment-646460871 > I saw that a new DAG was not added to the system tests. I prepared change - https://termbin.com/7ezm > To add to your branch, run the following command: > > ```shell

[GitHub] [airflow] omar-binary closed pull request #9396: Add sensitive_variable_fields option to extend `DEFAULT_SENSITIVE_VARIABLE_FIELDS`

2020-06-18 Thread GitBox
omar-binary closed pull request #9396: URL: https://github.com/apache/airflow/pull/9396 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #9396: Add sensitive_variable_fields option to extend `DEFAULT_SENSITIVE_VARIABLE_FIELDS`

2020-06-18 Thread GitBox
boring-cyborg[bot] commented on pull request #9396: URL: https://github.com/apache/airflow/pull/9396#issuecomment-646457053 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contr

[GitHub] [airflow] omar-binary opened a new pull request #9396: Add sensitive_variable_fields option to extend `DEFAULT_SENSITIVE_VARIABLE_FIELDS`

2020-06-18 Thread GitBox
omar-binary opened a new pull request #9396: URL: https://github.com/apache/airflow/pull/9396 --- Make sure to mark the boxes below before creating PR: [x] - [x] Description above provides context of the change - [x] Unit tests coverage for changes (not needed for documentation

[GitHub] [airflow] mik-laj commented on pull request #9390: Unpin Apache Beam

2020-06-18 Thread GitBox
mik-laj commented on pull request #9390: URL: https://github.com/apache/airflow/pull/9390#issuecomment-646452353 @potiuk Can you look again? I fixed pylint issues. This is an automated message from the Apache Git Service. To

[GitHub] [airflow] mik-laj commented on issue #9080: Build and publish API clients automatically

2020-06-18 Thread GitBox
mik-laj commented on issue #9080: URL: https://github.com/apache/airflow/issues/9080#issuecomment-646451117 We have POCs: https://github.com/mik-laj/airflow-api-clients If anyone wants, they can base on it or start from scratch. An example of a successful client generation is Kubernete

[airflow] tag nightly-master updated (d8d48c2 -> 48da4b4)

2020-06-18 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from d8d48c2 (commit) to 48da4b4 (commit) from d8

[airflow] 01/01: [AIRFLOW-4472] Use json.dumps/loads for templating lineage data (#5253)

2020-06-18 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit ba645ec1154051daf8654e94ae170b49bfb6f49f Author: bolkedebruin AuthorDate: Tue May 7 22:42:28 2019 +0200 [AI

[airflow] branch v1-10-test updated (132ea62 -> ba645ec)

2020-06-18 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git. discard 132ea62 [AIRFLOW-4472] Use json.dumps/loads for templating lineage data (#5253) new ba645ec [AIRFLOW-

[GitHub] [airflow] kaxil commented on pull request #9363: Use 'airflow.task' Logger for LocalTaskJob

2020-06-18 Thread GitBox
kaxil commented on pull request #9363: URL: https://github.com/apache/airflow/pull/9363#issuecomment-646395583 > Might this also fix the issue where some logs are disappearing? #8484 Should fix now with the latest commit --

[GitHub] [airflow] thesuperzapper commented on pull request #8777: Add Production Helm chart support

2020-06-18 Thread GitBox
thesuperzapper commented on pull request #8777: URL: https://github.com/apache/airflow/pull/8777#issuecomment-646390926 Is the `master` branch really the correct place to be developing this? Especially as there is currently no release/testing infrastructure in `master` for this chart.

[GitHub] [airflow] kanga333 commented on a change in pull request #9350: Add deletion by prefix to S3DeleteObjectsOperator

2020-06-18 Thread GitBox
kanga333 commented on a change in pull request #9350: URL: https://github.com/apache/airflow/pull/9350#discussion_r442568404 ## File path: airflow/providers/amazon/aws/operators/s3_delete_objects.py ## @@ -56,22 +59,31 @@ class S3DeleteObjectsOperator(BaseOperator): :type

[GitHub] [airflow] kanga333 commented on a change in pull request #9350: Add deletion by prefix to S3DeleteObjectsOperator

2020-06-18 Thread GitBox
kanga333 commented on a change in pull request #9350: URL: https://github.com/apache/airflow/pull/9350#discussion_r442563626 ## File path: airflow/providers/amazon/aws/operators/s3_delete_objects.py ## @@ -56,22 +59,34 @@ class S3DeleteObjectsOperator(BaseOperator): :type

[GitHub] [airflow] kanga333 commented on a change in pull request #9350: Add deletion by prefix to S3DeleteObjectsOperator

2020-06-18 Thread GitBox
kanga333 commented on a change in pull request #9350: URL: https://github.com/apache/airflow/pull/9350#discussion_r442242104 ## File path: airflow/providers/amazon/aws/operators/s3_delete_objects.py ## @@ -56,22 +59,34 @@ class S3DeleteObjectsOperator(BaseOperator): :type

[jira] [Commented] (AIRFLOW-3126) kubernetes executor not allowing new PV

2020-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140066#comment-17140066 ] ASF GitHub Bot commented on AIRFLOW-3126: - brandonwillard commented on pull req

[GitHub] [airflow] brandonwillard commented on pull request #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-06-18 Thread GitBox
brandonwillard commented on pull request #8150: URL: https://github.com/apache/airflow/pull/8150#issuecomment-646363275 [Here's](https://github.com/apache/airflow/pull/8150/checks?check_run_id=786316555#step:6:137) the CI error; not sure how that could be related to these changes. --

[GitHub] [airflow] ephraimbuddy commented on pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
ephraimbuddy commented on pull request #9391: URL: https://github.com/apache/airflow/pull/9391#issuecomment-646353622 Hi @kaxil, please take a look, I have updated the description. Thanks for pointing this out. This is an au

[airflow] branch v1-10-test updated: [AIRFLOW-4472] Use json.dumps/loads for templating lineage data (#5253)

2020-06-18 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v1-10-test by this push: new 132ea62 [AIRFLOW-4472] Use json.dum

[jira] [Commented] (AIRFLOW-3126) kubernetes executor not allowing new PV

2020-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140049#comment-17140049 ] ASF GitHub Bot commented on AIRFLOW-3126: - kaxil commented on a change in pull

[GitHub] [airflow] kaxil commented on a change in pull request #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-06-18 Thread GitBox
kaxil commented on a change in pull request #8150: URL: https://github.com/apache/airflow/pull/8150#discussion_r442545141 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -914,6 +914,15 @@ logs_volume_subpath = # A shared volume claim for the logs logs_volume_

[jira] [Commented] (AIRFLOW-3126) kubernetes executor not allowing new PV

2020-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140047#comment-17140047 ] ASF GitHub Bot commented on AIRFLOW-3126: - kaxil commented on a change in pull

[GitHub] [airflow] kaxil commented on a change in pull request #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-06-18 Thread GitBox
kaxil commented on a change in pull request #8150: URL: https://github.com/apache/airflow/pull/8150#discussion_r442544061 ## File path: airflow/config_templates/config.yml ## @@ -1898,6 +1898,22 @@ type: string example: ~ default: "" +- name: extra_volu

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
ephraimbuddy commented on a change in pull request #9391: URL: https://github.com/apache/airflow/pull/9391#discussion_r442538254 ## File path: airflow/www/views.py ## @@ -679,62 +679,53 @@ def get_logs_with_metadata(self, session=None): return response -

[GitHub] [airflow] muyajil commented on issue #9387: Use enum for task_states/dag_states

2020-06-18 Thread GitBox
muyajil commented on issue #9387: URL: https://github.com/apache/airflow/issues/9387#issuecomment-646338044 Hi, I'd like to help out with this issue. This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
ephraimbuddy commented on a change in pull request #9391: URL: https://github.com/apache/airflow/pull/9391#discussion_r442535463 ## File path: airflow/www/views.py ## @@ -679,62 +679,53 @@ def get_logs_with_metadata(self, session=None): return response -

[GitHub] [airflow] ipeluffo opened a new pull request #9395: Move modules in `airflow.contrib.utils.log` to `airflow.utils.log`

2020-06-18 Thread GitBox
ipeluffo opened a new pull request #9395: URL: https://github.com/apache/airflow/pull/9395 Clean up modules in `airflow.contrib.utils.log` from #9382 --- Make sure to mark the boxes below before creating PR: [x] - [x] Description above provides context of the change - [x

[GitHub] [airflow] kaxil commented on pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
kaxil commented on pull request #9391: URL: https://github.com/apache/airflow/pull/9391#issuecomment-646323685 If we checkmark the box, let's actually follow the guidelines: ![image](https://user-images.githubusercontent.com/8811558/85075467-24ee9080-b1b6-11ea-87a9-88519d759caf.png)

[airflow] branch master updated (6484dea -> 48da4b4)

2020-06-18 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 6484dea Fixes Breeze 'tests' command (#9384) add 48da4b4 Replace old Airflow screenshots with new images (

[GitHub] [airflow] kaxil commented on pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
kaxil commented on pull request #9391: URL: https://github.com/apache/airflow/pull/9391#issuecomment-646323421 Please add a description to the PR This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [airflow] kaxil merged pull request #9393: Renew some Airflow images

2020-06-18 Thread GitBox
kaxil merged pull request #9393: URL: https://github.com/apache/airflow/pull/9393 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
ephraimbuddy commented on a change in pull request #9391: URL: https://github.com/apache/airflow/pull/9391#discussion_r442520906 ## File path: airflow/utils/log/log_reader.py ## @@ -0,0 +1,104 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contribut

[GitHub] [airflow] casassg commented on a change in pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-06-18 Thread GitBox
casassg commented on a change in pull request #8962: URL: https://github.com/apache/airflow/pull/8962#discussion_r442520339 ## File path: docs/concepts.rst ## @@ -116,6 +116,47 @@ DAGs can be used as context managers to automatically assign new operators to th op.dag is

[GitHub] [airflow] casassg commented on pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-06-18 Thread GitBox
casassg commented on pull request #8962: URL: https://github.com/apache/airflow/pull/8962#issuecomment-646321845 Passed +5 (bindings) +2 (non-binding). No opposition to the update in the AIP. This is an automated mes

[GitHub] [airflow] casassg commented on a change in pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-06-18 Thread GitBox
casassg commented on a change in pull request #8962: URL: https://github.com/apache/airflow/pull/8962#discussion_r442518581 ## File path: docs/concepts.rst ## @@ -173,6 +213,61 @@ Each task is a node in our DAG, and there is a dependency from task_1 to task_2: We can say that

[GitHub] [airflow] mik-laj commented on pull request #9276: Add airflow upgrade_check command (MVP)

2020-06-18 Thread GitBox
mik-laj commented on pull request #9276: URL: https://github.com/apache/airflow/pull/9276#issuecomment-646316877 If no one is against it, I will set the target of this PR to v1-10-test when I return to work on this change. I will try to come back quickly so that other people can add their

[GitHub] [airflow] mik-laj commented on a change in pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
mik-laj commented on a change in pull request #9391: URL: https://github.com/apache/airflow/pull/9391#discussion_r442512310 ## File path: airflow/utils/log/log_reader.py ## @@ -0,0 +1,105 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor li

[GitHub] [airflow] ephraimbuddy commented on pull request #9295: added mssql to oracle transfer operator

2020-06-18 Thread GitBox
ephraimbuddy commented on pull request #9295: URL: https://github.com/apache/airflow/pull/9295#issuecomment-646307048 Also @jkbngl you can read about it here https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#backport-providers-packages ---

[GitHub] [airflow] mik-laj commented on a change in pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
mik-laj commented on a change in pull request #9391: URL: https://github.com/apache/airflow/pull/9391#discussion_r442504211 ## File path: airflow/utils/log/log_reader.py ## @@ -0,0 +1,104 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor li

[GitHub] [airflow] mik-laj commented on a change in pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
mik-laj commented on a change in pull request #9391: URL: https://github.com/apache/airflow/pull/9391#discussion_r442503987 ## File path: airflow/utils/log/log_reader.py ## @@ -0,0 +1,104 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor li

[GitHub] [airflow] mik-laj commented on a change in pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
mik-laj commented on a change in pull request #9391: URL: https://github.com/apache/airflow/pull/9391#discussion_r442503491 ## File path: airflow/utils/log/log_reader.py ## @@ -0,0 +1,104 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor li

[GitHub] [airflow] mik-laj commented on a change in pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
mik-laj commented on a change in pull request #9391: URL: https://github.com/apache/airflow/pull/9391#discussion_r442503313 ## File path: airflow/utils/log/log_reader.py ## @@ -0,0 +1,104 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor li

[GitHub] [airflow] mik-laj commented on a change in pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
mik-laj commented on a change in pull request #9391: URL: https://github.com/apache/airflow/pull/9391#discussion_r442503167 ## File path: airflow/utils/log/log_reader.py ## @@ -0,0 +1,104 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor li

[GitHub] [airflow] mik-laj commented on a change in pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
mik-laj commented on a change in pull request #9391: URL: https://github.com/apache/airflow/pull/9391#discussion_r442502120 ## File path: airflow/utils/log/log_reader.py ## @@ -0,0 +1,104 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor li

[GitHub] [airflow] mik-laj commented on pull request #9391: Extract TaskLogReader from views.py

2020-06-18 Thread GitBox
mik-laj commented on pull request #9391: URL: https://github.com/apache/airflow/pull/9391#issuecomment-646304842 @KevinYang21 Could you look at it? We need to extract logic to be able to reuse it in the API.@KevinYang21 Th

[GitHub] [airflow] potiuk commented on pull request #9295: added mssql to oracle transfer operator

2020-06-18 Thread GitBox
potiuk commented on pull request #9295: URL: https://github.com/apache/airflow/pull/9295#issuecomment-646302338 If you look at the error message you will see what's going on @jkbngl --- a/CONTRIBUTING.rst +++ b/CONTRIBUTING.rst @@ -462,7 +462,7 @@ discordht

[GitHub] [airflow] feluelle commented on pull request #9393: Renew some Airflow images

2020-06-18 Thread GitBox
feluelle commented on pull request #9393: URL: https://github.com/apache/airflow/pull/9393#issuecomment-646301984 Wait I want to add one more `add-role`.. This is an automated message from the Apache Git Service. To respond t

[GitHub] [airflow] mik-laj commented on a change in pull request #9391: Extract TaskLogReader from views for uniform use in API & webserver and improve tests

2020-06-18 Thread GitBox
mik-laj commented on a change in pull request #9391: URL: https://github.com/apache/airflow/pull/9391#discussion_r442497333 ## File path: airflow/www/views.py ## @@ -679,62 +679,53 @@ def get_logs_with_metadata(self, session=None): return response -logg

[GitHub] [airflow] feluelle opened a new pull request #9394: Refactor PythonVirtualenvOperator

2020-06-18 Thread GitBox
feluelle opened a new pull request #9394: URL: https://github.com/apache/airflow/pull/9394 This PR refactors the PythonVirtualenvOperator. But it also has a QoL improvement. You don't need to manually pass `dill` as requirement anymore if you have set `use_dill` to `True`. So it w

[GitHub] [airflow] jkbngl commented on pull request #9295: added mssql to oracle transfer operator

2020-06-18 Thread GitBox
jkbngl commented on pull request #9295: URL: https://github.com/apache/airflow/pull/9295#issuecomment-646298216 @ephraimbuddy would you mind helping me again? The checks are failing because of: - Build cross-dependencies for providers packages - Failed ``` -microsoft.mssql

[GitHub] [airflow] potiuk commented on pull request #9276: Add airflow upgrade_check command (MVP)

2020-06-18 Thread GitBox
potiuk commented on pull request #9276: URL: https://github.com/apache/airflow/pull/9276#issuecomment-646297573 Yeah. I had some thoughts and discussed with some of the stakeholders as well (from the Composer team where lots of the Airflow users are), and I think we all agree that going th

[GitHub] [airflow] feluelle opened a new pull request #9393: Renew some Airflow images

2020-06-18 Thread GitBox
feluelle opened a new pull request #9393: URL: https://github.com/apache/airflow/pull/9393 --- Make sure to mark the boxes below before creating PR: [x] - [x] Description above provides context of the change - [x] Unit tests coverage for changes (not needed for documentation cha

[GitHub] [airflow] FlavSF commented on pull request #9364: Add option for Vault token to automatically be renewed

2020-06-18 Thread GitBox
FlavSF commented on pull request #9364: URL: https://github.com/apache/airflow/pull/9364#issuecomment-646287456 > Should not that be rather added in the client? This way it will be available to both - Hook and Secret Backend good point, I can easily move it

[GitHub] [airflow] potiuk commented on pull request #9364: Add option for Vault token to automatically be renewed

2020-06-18 Thread GitBox
potiuk commented on pull request #9364: URL: https://github.com/apache/airflow/pull/9364#issuecomment-646286416 Should not that be rather added in the client? This way it will be available to both - Hook and Secret Backend T

[airflow] branch master updated (4fefaf7 -> 6484dea)

2020-06-18 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 4fefaf7 Fixed crashing webserver after /tmp is mounted from the host (#9378) add 6484dea Fixes Breeze 'tests

[GitHub] [airflow] potiuk merged pull request #9384: Fixes Breeze 'tests' command

2020-06-18 Thread GitBox
potiuk merged pull request #9384: URL: https://github.com/apache/airflow/pull/9384 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [airflow] potiuk commented on issue #9392: 2 notifications send `on_failure`

2020-06-18 Thread GitBox
potiuk commented on issue #9392: URL: https://github.com/apache/airflow/issues/9392#issuecomment-646275175 Following the rule for issues - the issues in Github are not supposed to be used for such investigations. Rather than that try to get some help and input on our Slack http://airflow.a

[GitHub] [airflow] potiuk closed issue #9392: 2 notifications send `on_failure`

2020-06-18 Thread GitBox
potiuk closed issue #9392: URL: https://github.com/apache/airflow/issues/9392 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [airflow] ephraimbuddy commented on pull request #9331: add log endpoint

2020-06-18 Thread GitBox
ephraimbuddy commented on pull request #9331: URL: https://github.com/apache/airflow/pull/9331#issuecomment-646267705 Depends on #9391 This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [airflow] gfelot opened a new issue #9392: 2 notifications send `on_failure`

2020-06-18 Thread GitBox
gfelot opened a new issue #9392: URL: https://github.com/apache/airflow/issues/9392 **Apache Airflow version**: 1.10.9 - **Cloud provider or hardware configuration**: GCP - **OS** (e.g. from /etc/os-release): Debian (VM) **What happened**: Try to send custom em

[GitHub] [airflow] ephraimbuddy opened a new pull request #9391: Extract TaskLogReader from views for uniform use in API & webserver and improve tests

2020-06-18 Thread GitBox
ephraimbuddy opened a new pull request #9391: URL: https://github.com/apache/airflow/pull/9391 --- Make sure to mark the boxes below before creating PR: [x] - [ ] Description above provides context of the change - [ ] Unit tests coverage for changes (not needed for documentation

[GitHub] [airflow] aneesh-joseph commented on a change in pull request #9371: Add git sync option to the Helm chart

2020-06-18 Thread GitBox
aneesh-joseph commented on a change in pull request #9371: URL: https://github.com/apache/airflow/pull/9371#discussion_r442360978 ## File path: chart/values.yaml ## @@ -434,3 +434,23 @@ postgresql: enabled: true postgresqlPassword: postgres postgresqlUsername: postgres

[GitHub] [airflow] gfelot closed issue #9308: Cannot send args in email body

2020-06-18 Thread GitBox
gfelot closed issue #9308: URL: https://github.com/apache/airflow/issues/9308 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [airflow] ipeluffo commented on pull request #9388: Move out weekday from airflow.contrib

2020-06-18 Thread GitBox
ipeluffo commented on pull request #9388: URL: https://github.com/apache/airflow/pull/9388#issuecomment-646261072 @mik-laj , I added the changelog entry into `UPDATING.md` following the same format and content as you used in the other PR. Let me know what you think. Thanks --

[GitHub] [airflow] mik-laj opened a new pull request #9390: Unpin Apache Beam

2020-06-18 Thread GitBox
mik-laj opened a new pull request #9390: URL: https://github.com/apache/airflow/pull/9390 Part of: https://github.com/apache/airflow/issues/8630 --- Make sure to mark the boxes below before creating PR: [x] - [X] Description above provides context of the change - [X] Unit

[GitHub] [airflow] aneesh-joseph commented on a change in pull request #9371: Add git sync option to the Helm chart

2020-06-18 Thread GitBox
aneesh-joseph commented on a change in pull request #9371: URL: https://github.com/apache/airflow/pull/9371#discussion_r442429863 ## File path: chart/values.yaml ## @@ -434,3 +434,23 @@ postgresql: enabled: true postgresqlPassword: postgres postgresqlUsername: postgres

[GitHub] [airflow] Acehaidrey commented on pull request #9280: Functionality to shuffle HMS connections to be used by HiveMetastoreHook facilitating load balancing

2020-06-18 Thread GitBox
Acehaidrey commented on pull request #9280: URL: https://github.com/apache/airflow/pull/9280#issuecomment-646237046 Hi @ashb @turbaszek if either of you have a chance to look at this; sorry to keep pinging. CC @venka56 T

[GitHub] [airflow] casassg commented on a change in pull request #8962: [AIRFLOW-8057] [AIP-31] Add @task decorator

2020-06-18 Thread GitBox
casassg commented on a change in pull request #8962: URL: https://github.com/apache/airflow/pull/8962#discussion_r442416439 ## File path: docs/concepts.rst ## @@ -116,6 +116,46 @@ DAGs can be used as context managers to automatically assign new operators to th op.dag is

[GitHub] [airflow] potiuk closed issue #9389: Could not automatically determine credentials (GOOGLE_APPLICATION_CREDENTIALS)

2020-06-18 Thread GitBox
potiuk closed issue #9389: URL: https://github.com/apache/airflow/issues/9389 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [airflow] potiuk commented on issue #9389: Could not automatically determine credentials (GOOGLE_APPLICATION_CREDENTIALS)

2020-06-18 Thread GitBox
potiuk commented on issue #9389: URL: https://github.com/apache/airflow/issues/9389#issuecomment-646213590 Please - as stated in the message when you created the issue - do not use issues in github for those kind of support questions. we have other means to do it see : https://airflow.apac

[GitHub] [airflow] mik-laj commented on pull request #9388: Move out weekday from airflow.contrib

2020-06-18 Thread GitBox
mik-laj commented on pull request #9388: URL: https://github.com/apache/airflow/pull/9388#issuecomment-646208381 Can you add entry in UPDATING.md? This is an automated message from the Apache Git Service. To respond to the me

[airflow] branch v1-10-test updated (d480352 -> 2bdf471)

2020-06-18 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a change to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git. omit d480352 Add SQL Branch Operator new 2bdf471 Add SQL Branch Operator This update added new revisions a

[airflow] 01/01: Add SQL Branch Operator

2020-06-18 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 2bdf471ed55976323cdb67ad82467994a6280c45 Author: samuelkhtu <46137261+samuelk...@users.noreply.github.com> Author

[GitHub] [airflow] pelayorodriguezgarcia opened a new issue #9389: Could not automatically determine credentials. Please set GOOGLE_APPLICATION_CREDENTIALS

2020-06-18 Thread GitBox
pelayorodriguezgarcia opened a new issue #9389: URL: https://github.com/apache/airflow/issues/9389 I have the following code: `import os from airflow import models from airflow.providers.google.cloud.operators.bigquery import ( BigQueryCreateEmptyDatasetOperator, BigQ

[GitHub] [airflow] boring-cyborg[bot] commented on issue #9389: Could not automatically determine credentials. Please set GOOGLE_APPLICATION_CREDENTIALS

2020-06-18 Thread GitBox
boring-cyborg[bot] commented on issue #9389: URL: https://github.com/apache/airflow/issues/9389#issuecomment-646192604 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] houqp commented on a change in pull request #9273: implement api v1 for variables

2020-06-18 Thread GitBox
houqp commented on a change in pull request #9273: URL: https://github.com/apache/airflow/pull/9273#discussion_r442381705 ## File path: tests/api_connexion/endpoints/test_variable_endpoint.py ## @@ -29,38 +31,142 @@ def setUpClass(cls) -> None: def setUp(self) -> None:

[GitHub] [airflow] potiuk commented on a change in pull request #9375: Remove redundant code from breeze initialization

2020-06-18 Thread GitBox
potiuk commented on a change in pull request #9375: URL: https://github.com/apache/airflow/pull/9375#discussion_r442381734 ## File path: scripts/ci/libraries/_initialization.sh ## @@ -59,8 +59,6 @@ function initialize_common_environment { # Create useful directories if not

[GitHub] [airflow] potiuk commented on a change in pull request #9355: Move out sendgrid email from airflow.contrib

2020-06-18 Thread GitBox
potiuk commented on a change in pull request #9355: URL: https://github.com/apache/airflow/pull/9355#discussion_r442379330 ## File path: docs/integration.rst ## @@ -28,6 +28,7 @@ Airflow has a mechanism that allows you to expand its functionality and integrat * :doc:`Logging

[GitHub] [airflow] potiuk commented on a change in pull request #9355: Move out sendgrid email from airflow.contrib

2020-06-18 Thread GitBox
potiuk commented on a change in pull request #9355: URL: https://github.com/apache/airflow/pull/9355#discussion_r442378536 ## File path: docs/conf.py ## @@ -189,8 +189,6 @@ exclude_patterns: List[str] = [ # We only link to selected subpackages. '_api/airflow/index.rs

[GitHub] [airflow] potiuk commented on a change in pull request #9355: Move out sendgrid email from airflow.contrib

2020-06-18 Thread GitBox
potiuk commented on a change in pull request #9355: URL: https://github.com/apache/airflow/pull/9355#discussion_r442378309 ## File path: airflow/utils/helpers.py ## @@ -195,18 +195,18 @@ def partition(pred: Callable, iterable: Iterable): def chain(*args, **kwargs): -""

[airflow] 01/01: Add SQL Branch Operator

2020-06-18 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit d48035226ce509f97dd79d969c990259812f2eec Author: samuelkhtu <46137261+samuelk...@users.noreply.github.com> Author

[airflow] branch v1-10-test updated (f837c59 -> d480352)

2020-06-18 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a change to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git. omit f837c59 Add SQL Branch Operator new d480352 Add SQL Branch Operator This update added new revisions a

[GitHub] [airflow] potiuk commented on pull request #9376: Fix in-breeze CLI tools to work also on Linux

2020-06-18 Thread GitBox
potiuk commented on pull request #9376: URL: https://github.com/apache/airflow/pull/9376#issuecomment-646181958 Seems Like all important ones passed! This is an automated message from the Apache Git Service. To respond to the

[airflow] branch v1-10-test updated (1f39d39 -> f837c59)

2020-06-18 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a change to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git. discard 1f39d39 * Add SQL Branch Operator new f837c59 Add SQL Branch Operator This update added new revisions

[airflow] 01/01: Add SQL Branch Operator

2020-06-18 Thread dimberman
This is an automated email from the ASF dual-hosted git repository. dimberman pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit f837c5937a4fd4d0a2b33516c60a0e8241b7640b Author: samuelkhtu <46137261+samuelk...@users.noreply.github.com> Author

[GitHub] [airflow] aneesh-joseph commented on a change in pull request #9371: Add git sync option to the Helm chart

2020-06-18 Thread GitBox
aneesh-joseph commented on a change in pull request #9371: URL: https://github.com/apache/airflow/pull/9371#discussion_r442360978 ## File path: chart/values.yaml ## @@ -434,3 +434,23 @@ postgresql: enabled: true postgresqlPassword: postgres postgresqlUsername: postgres

[GitHub] [airflow] ipeluffo opened a new pull request #9388: Move out weekday from airflow.contrib

2020-06-18 Thread GitBox
ipeluffo opened a new pull request #9388: URL: https://github.com/apache/airflow/pull/9388 Close item in #9382 This PR moves `weekday` from `airflow.contrib` into `airflow.utils` --- Make sure to mark the boxes below before creating PR: [x] - [x] Description above provides c

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #9388: Move out weekday from airflow.contrib

2020-06-18 Thread GitBox
boring-cyborg[bot] commented on pull request #9388: URL: https://github.com/apache/airflow/pull/9388#issuecomment-646156484 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contr

[GitHub] [airflow] aneesh-joseph commented on a change in pull request #9371: Add git sync option to the Helm chart

2020-06-18 Thread GitBox
aneesh-joseph commented on a change in pull request #9371: URL: https://github.com/apache/airflow/pull/9371#discussion_r442360978 ## File path: chart/values.yaml ## @@ -434,3 +434,23 @@ postgresql: enabled: true postgresqlPassword: postgres postgresqlUsername: postgres

[jira] [Commented] (AIRFLOW-5607) add all_skipped to trigger_rule

2020-06-18 Thread Diego Argueta (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139531#comment-17139531 ] Diego Argueta commented on AIRFLOW-5607: Just gonna jump in here and say I coul

[GitHub] [airflow] dimberman commented on a change in pull request #9371: Add git sync option to the Helm chart

2020-06-18 Thread GitBox
dimberman commented on a change in pull request #9371: URL: https://github.com/apache/airflow/pull/9371#discussion_r442348859 ## File path: chart/values.yaml ## @@ -434,3 +434,23 @@ postgresql: enabled: true postgresqlPassword: postgres postgresqlUsername: postgres +#

[GitHub] [airflow] dimberman commented on a change in pull request #9371: Add git sync option to the Helm chart

2020-06-18 Thread GitBox
dimberman commented on a change in pull request #9371: URL: https://github.com/apache/airflow/pull/9371#discussion_r442345882 ## File path: chart/values.yaml ## @@ -434,3 +434,23 @@ postgresql: enabled: true postgresqlPassword: postgres postgresqlUsername: postgres +#

[GitHub] [airflow] aneesh-joseph commented on a change in pull request #9371: Add git sync option to the Helm chart

2020-06-18 Thread GitBox
aneesh-joseph commented on a change in pull request #9371: URL: https://github.com/apache/airflow/pull/9371#discussion_r442344592 ## File path: chart/values.yaml ## @@ -434,3 +434,23 @@ postgresql: enabled: true postgresqlPassword: postgres postgresqlUsername: postgres

  1   2   3   >