[airflow] branch main updated (60e2f94 -> 1960e37)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 60e2f94 Chart: Add instructions to run with Example DAGs (#17043) add 1960e37 Chart: Remove hard-coded

[GitHub] [airflow] potiuk merged pull request #17042: Chart: Remove hard-coded namespace in port-forward instructions

2021-07-15 Thread GitBox
potiuk merged pull request #17042: URL: https://github.com/apache/airflow/pull/17042 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Chart: Add instructions to run with Example DAGs (#17043)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 60e2f94 Chart: Add instructions to run with

[GitHub] [airflow] potiuk merged pull request #17043: Chart: Add instructions to run with Example DAGs

2021-07-15 Thread GitBox
potiuk merged pull request #17043: URL: https://github.com/apache/airflow/pull/17043 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #16579: Redact conn secrets in webserver logs

2021-07-15 Thread GitBox
potiuk commented on pull request #16579: URL: https://github.com/apache/airflow/pull/16579#issuecomment-881196509 God call. Marked it as 2.1.3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[airflow] branch main updated (49683e1 -> d9221df)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 49683e1 Chart: Update description for Helm chart to include 'official' (#17040) add d9221df Updated

[GitHub] [airflow] potiuk merged pull request #16978: Updated clean-logs.sh

2021-07-15 Thread GitBox
potiuk merged pull request #16978: URL: https://github.com/apache/airflow/pull/16978 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #16978: Updated clean-logs.sh

2021-07-15 Thread GitBox
boring-cyborg[bot] commented on pull request #16978: URL: https://github.com/apache/airflow/pull/16978#issuecomment-881196075 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[airflow] branch main updated (2ce6e8d -> 49683e1)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 2ce6e8d Fix minor issues in `UPDATING.md` (#17026) add 49683e1 Chart: Update description for Helm chart to

[GitHub] [airflow] potiuk merged pull request #17040: Chart: Update description for Helm chart to include 'official'

2021-07-15 Thread GitBox
potiuk merged pull request #17040: URL: https://github.com/apache/airflow/pull/17040 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #17033: Add autoscaling subcluster support and remove defaults

2021-07-15 Thread GitBox
potiuk commented on pull request #17033: URL: https://github.com/apache/airflow/pull/17033#issuecomment-881191575 BTW @uranusjr . Before constraints mechanism was in place - such a "third-party-release" was a disastrous event breaking everyone PRs and we needed to scramble to fix those as

[GitHub] [airflow] potiuk edited a comment on pull request #17033: Add autoscaling subcluster support and remove defaults

2021-07-15 Thread GitBox
potiuk edited a comment on pull request #17033: URL: https://github.com/apache/airflow/pull/17033#issuecomment-881190154 @uranusjr r FYI. The problem is that new dependency versions got released during the last few days and they broke our tests. Thanks to our constraint mechanism, this -

[GitHub] [airflow] potiuk edited a comment on pull request #17033: Add autoscaling subcluster support and remove defaults

2021-07-15 Thread GitBox
potiuk edited a comment on pull request #17033: URL: https://github.com/apache/airflow/pull/17033#issuecomment-881190154 @uranusjr r FYI. The problem is that new dependency versions got released during the last few days and they broke our tests. Thanks to our constraint mechanism, This -

[GitHub] [airflow] potiuk commented on pull request #17033: Add autoscaling subcluster support and remove defaults

2021-07-15 Thread GitBox
potiuk commented on pull request #17033: URL: https://github.com/apache/airflow/pull/17033#issuecomment-881190154 @uranushr FYI. The problem is that new dependency versions got released during the last few days and they broke our tests. Thanks to our constraint mechanism, This - luckily -

[GitHub] [airflow] github-actions[bot] commented on pull request #17041: Chart: Update ``postgres`` subchart to ``10.5.3``

2021-07-15 Thread GitBox
github-actions[bot] commented on pull request #17041: URL: https://github.com/apache/airflow/pull/17041#issuecomment-881185009 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] ali-hafidz commented on pull request #15311: Sync DAG specific permissions when parsing

2021-07-15 Thread GitBox
ali-hafidz commented on pull request #15311: URL: https://github.com/apache/airflow/pull/15311#issuecomment-881183547 @chodankarcc I also facing the same issue. then already updating store_serialized_dags = False . but I have new issue, the dag that I set running sequentially running not

[GitHub] [airflow] pateash commented on a change in pull request #16931: #16692 show cron description in UI

2021-07-15 Thread GitBox
pateash commented on a change in pull request #16931: URL: https://github.com/apache/airflow/pull/16931#discussion_r670949174 ## File path: airflow/models/dag.py ## @@ -2404,6 +2404,20 @@ def __repr__(self): def timezone(self): return settings.TIMEZONE +

[GitHub] [airflow] pateash commented on a change in pull request #16931: #16692 show cron description in UI

2021-07-15 Thread GitBox
pateash commented on a change in pull request #16931: URL: https://github.com/apache/airflow/pull/16931#discussion_r670949174 ## File path: airflow/models/dag.py ## @@ -2404,6 +2404,20 @@ def __repr__(self): def timezone(self): return settings.TIMEZONE +

[GitHub] [airflow] pateash commented on a change in pull request #16931: #16692 show cron description in UI

2021-07-15 Thread GitBox
pateash commented on a change in pull request #16931: URL: https://github.com/apache/airflow/pull/16931#discussion_r670954242 ## File path: airflow/timetables/base.py ## @@ -83,6 +83,13 @@ def interval(cls, start: DateTime, end: DateTime) -> "DagRunInfo": class

[GitHub] [airflow] pateash commented on a change in pull request #16931: #16692 show cron description in UI

2021-07-15 Thread GitBox
pateash commented on a change in pull request #16931: URL: https://github.com/apache/airflow/pull/16931#discussion_r670949174 ## File path: airflow/models/dag.py ## @@ -2404,6 +2404,20 @@ def __repr__(self): def timezone(self): return settings.TIMEZONE +

[GitHub] [airflow] pateash commented on a change in pull request #16931: #16692 show cron description in UI

2021-07-15 Thread GitBox
pateash commented on a change in pull request #16931: URL: https://github.com/apache/airflow/pull/16931#discussion_r670949174 ## File path: airflow/models/dag.py ## @@ -2404,6 +2404,20 @@ def __repr__(self): def timezone(self): return settings.TIMEZONE +

[GitHub] [airflow] sudarshan2906 opened a new issue #17044: Option to not show DAG import error in the UI

2021-07-15 Thread GitBox
sudarshan2906 opened a new issue #17044: URL: https://github.com/apache/airflow/issues/17044 **Description** It would be good if there is a option in cfg to hide the DAG import error from the UI. Or only to show it to Admin or the role which has permission to view it.

[GitHub] [airflow] kaxil opened a new pull request #17043: Chart: Add instructions to run with Example DAGs

2021-07-15 Thread GitBox
kaxil opened a new pull request #17043: URL: https://github.com/apache/airflow/pull/17043 For quick testing it is easier to show users in Quick Start on how they can run Helm chart with Example DAGs --- **^ Add meaningful description above** Read the **[Pull

[GitHub] [airflow] ferruzzi commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-07-15 Thread GitBox
ferruzzi commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r670910290 ## File path: airflow/providers/amazon/aws/operators/eks.py ## @@ -0,0 +1,709 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] kaxil opened a new pull request #17042: Chart: Remove hard-coded namespace in port-forward instructions

2021-07-15 Thread GitBox
kaxil opened a new pull request #17042: URL: https://github.com/apache/airflow/pull/17042 The port-forward command had a hard-coded namespace. This fixes it and improves formatting - from inline to code-block --- **^ Add meaningful description above** Read

[GitHub] [airflow] kaxil edited a comment on issue #10752: Release Helm Chart officially

2021-07-15 Thread GitBox
kaxil edited a comment on issue #10752: URL: https://github.com/apache/airflow/issues/10752#issuecomment-777805057 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] ferruzzi commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-07-15 Thread GitBox
ferruzzi commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r670886339 ## File path: docs/apache-airflow-providers-amazon/operators/eks.rst ## @@ -0,0 +1,265 @@ + .. Licensed to the Apache Software Foundation (ASF) under

[GitHub] [airflow] ferruzzi commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-07-15 Thread GitBox
ferruzzi commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r670886300 ## File path: docs/apache-airflow-providers-amazon/operators/eks.rst ## @@ -0,0 +1,265 @@ + .. Licensed to the Apache Software Foundation (ASF) under

[GitHub] [airflow] ferruzzi commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-07-15 Thread GitBox
ferruzzi commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r670886177 ## File path: docs/apache-airflow-providers-amazon/operators/eks.rst ## @@ -0,0 +1,265 @@ + .. Licensed to the Apache Software Foundation (ASF) under

[GitHub] [airflow] ferruzzi commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-07-15 Thread GitBox
ferruzzi commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r670885704 ## File path: airflow/providers/amazon/aws/operators/eks.py ## @@ -0,0 +1,737 @@ +# Licensed to the Apache Software Foundation (ASF) under one Review

[GitHub] [airflow] uranusjr commented on a change in pull request #17030: Check for missing DagRun rows for "downstream" tables before migrating DB

2021-07-15 Thread GitBox
uranusjr commented on a change in pull request #17030: URL: https://github.com/apache/airflow/pull/17030#discussion_r670885633 ## File path: airflow/utils/db.py ## @@ -668,47 +667,95 @@ def check_conn_type_null(session=None) -> str: pass if n_nulls: -

[GitHub] [airflow-site] pumpkiny9120 opened a new pull request #454: Fixed a typo.

2021-07-15 Thread GitBox
pumpkiny9120 opened a new pull request #454: URL: https://github.com/apache/airflow-site/pull/454 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] uranusjr commented on a change in pull request #16956: Update spark_kubernetes.py

2021-07-15 Thread GitBox
uranusjr commented on a change in pull request #16956: URL: https://github.com/apache/airflow/pull/16956#discussion_r670880410 ## File path: airflow/providers/cncf/kubernetes/operators/spark_kubernetes.py ## @@ -30,7 +30,8 @@ class SparkKubernetesOperator(BaseOperator):

[GitHub] [airflow] github-actions[bot] closed issue #15540: git-sync with persistent volume claim

2021-07-15 Thread GitBox
github-actions[bot] closed issue #15540: URL: https://github.com/apache/airflow/issues/15540 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on issue #15914: Problem with remote logging when using Azure file share for logs(webserver, scheduler and task logs)

2021-07-15 Thread GitBox
github-actions[bot] commented on issue #15914: URL: https://github.com/apache/airflow/issues/15914#issuecomment-881084504 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] github-actions[bot] closed issue #15914: Problem with remote logging when using Azure file share for logs(webserver, scheduler and task logs)

2021-07-15 Thread GitBox
github-actions[bot] closed issue #15914: URL: https://github.com/apache/airflow/issues/15914 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on issue #15540: git-sync with persistent volume claim

2021-07-15 Thread GitBox
github-actions[bot] commented on issue #15540: URL: https://github.com/apache/airflow/issues/15540#issuecomment-881084539 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] pmalafosse commented on issue #16669: TableauRefreshWorkbookOperator fails when using personal access token (Tableau authentication method)

2021-07-15 Thread GitBox
pmalafosse commented on issue #16669: URL: https://github.com/apache/airflow/issues/16669#issuecomment-881082065 thanks @samgans ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] pmalafosse edited a comment on issue #17038: ECSOperator returns last logs when ECS task fails

2021-07-15 Thread GitBox
pmalafosse edited a comment on issue #17038: URL: https://github.com/apache/airflow/issues/17038#issuecomment-881080730 Yes I was thinking of doing something like that as I'm not sure there is a consistent way to identify the rows corresponding to the Exception message from the code

[GitHub] [airflow] pmalafosse commented on issue #17038: ECSOperator returns last logs when ECS task fails

2021-07-15 Thread GitBox
pmalafosse commented on issue #17038: URL: https://github.com/apache/airflow/issues/17038#issuecomment-881080730 Yes I was thinking of doing something like that as I'm not sure there is a consistent way to identify the rows corresponding to the Exception message from the code running in

[GitHub] [airflow] uranusjr commented on issue #15318: Add CLI to delete roles

2021-07-15 Thread GitBox
uranusjr commented on issue #15318: URL: https://github.com/apache/airflow/issues/15318#issuecomment-881076174 I think the CLI *should* be able to modify permissions on an existing role, so feel free to submit a pull request implementing such an endpoint if you need it. -- This is an

[GitHub] [airflow] uranusjr commented on a change in pull request #16954: PythonVritualenvOperator - Feature: Add support for private pypi repo packages in requirements

2021-07-15 Thread GitBox
uranusjr commented on a change in pull request #16954: URL: https://github.com/apache/airflow/pull/16954#discussion_r670870392 ## File path: airflow/utils/python_virtualenv.py ## @@ -35,12 +38,44 @@ def _generate_virtualenv_cmd(tmp_dir: str, python_bin: str,

[GitHub] [airflow] uranusjr commented on issue #17038: ECSOperator returns last logs when ECS task fails

2021-07-15 Thread GitBox
uranusjr commented on issue #17038: URL: https://github.com/apache/airflow/issues/17038#issuecomment-881074172 Could you describe what exactly you would like to see (and probably how that can be implemented)? The value of `self._last_log_message()`? -- This is an automated message from

[GitHub] [airflow] uranusjr commented on pull request #16579: Redact conn secrets in webserver logs

2021-07-15 Thread GitBox
uranusjr commented on pull request #16579: URL: https://github.com/apache/airflow/pull/16579#issuecomment-881073296 Since `BaseHook.get_connection()` is public API, this should probably still be backported to 2.1. See #17021. -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] uranusjr closed issue #17021: Secrets masking is not applied in the log if get_connection(conn_id) is used

2021-07-15 Thread GitBox
uranusjr closed issue #17021: URL: https://github.com/apache/airflow/issues/17021 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] uranusjr commented on issue #17021: Secrets masking is not applied in the log if get_connection(conn_id) is used

2021-07-15 Thread GitBox
uranusjr commented on issue #17021: URL: https://github.com/apache/airflow/issues/17021#issuecomment-881072886 Already fixed in #16579. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] pmalafosse commented on issue #17038: ECSOperator returns last logs when ECS task fails

2021-07-15 Thread GitBox
pmalafosse commented on issue #17038: URL: https://github.com/apache/airflow/issues/17038#issuecomment-881071040 Sorry I don’t understand what you mean. Now`task` object is in the exception but I would like instead to see, in Airflow alerts, the exception from the code that ran in ECS,

[GitHub] [airflow] kaxil opened a new pull request #17041: Chart: Update ``postgres`` subchart to ``10.5.3``

2021-07-15 Thread GitBox
kaxil opened a new pull request #17041: URL: https://github.com/apache/airflow/pull/17041 We were on 6.3.12 and the current latest version is 10.5.3. We have dropped support for Helm 2 already so Helm 3 users won't be affected. Secondly this postgres should only used for

[GitHub] [airflow] github-actions[bot] commented on pull request #16978: Updated clean-logs.sh

2021-07-15 Thread GitBox
github-actions[bot] commented on pull request #16978: URL: https://github.com/apache/airflow/pull/16978#issuecomment-881065532 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] kaxil edited a comment on issue #17032: Improved SQL rendering within BigQueryInsertJobOperator

2021-07-15 Thread GitBox
kaxil edited a comment on issue #17032: URL: https://github.com/apache/airflow/issues/17032#issuecomment-880826076 Wouldn't just using `strip` where you define the large SQL suffice? ```pycon ❯ python Python 3.8.5 (default, Sep 4 2020, 02:22:02) [Clang 10.0.0 ] :: Anaconda,

[GitHub] [airflow] ferruzzi commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-07-15 Thread GitBox
ferruzzi commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r670855251 ## File path: airflow/providers/amazon/aws/sensors/eks.py ## @@ -0,0 +1,129 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] kaxil opened a new pull request #17040: Chart: Update description for Helm chart to include 'official'

2021-07-15 Thread GitBox
kaxil opened a new pull request #17040: URL: https://github.com/apache/airflow/pull/17040 Including the word "official" should differentiate our chart against others ``` ❯ helm search hub airflow URL CHART VERSION APP VERSION

[GitHub] [airflow] uranusjr commented on pull request #17033: Add autoscaling subcluster support and remove defaults

2021-07-15 Thread GitBox
uranusjr commented on pull request #17033: URL: https://github.com/apache/airflow/pull/17033#issuecomment-881050101 The test failures seem irralevant to your change. (The google and aws providers are broken; we should fix them…) -- This is an automated message from the Apache Git

[GitHub] [airflow] uranusjr commented on issue #17038: ECSOperator returns last logs when ECS task fails

2021-07-15 Thread GitBox
uranusjr commented on issue #17038: URL: https://github.com/apache/airflow/issues/17038#issuecomment-881048668 Would it be better if we include the `task` object in the exception? If we’re to return anything more specific, we can subclass `AirflowException`, which allows putting a lot

[GitHub] [airflow] uranusjr edited a comment on pull request #17034: Refactored waiting function for Tableau Jobs

2021-07-15 Thread GitBox
uranusjr edited a comment on pull request #17034: URL: https://github.com/apache/airflow/pull/17034#issuecomment-881046818 Many whitespace changes besides `amazon.rst` are also irrelavant (or even wrong, like removing the blank line after the first line in a docstring). It’d be best if

[GitHub] [airflow] uranusjr commented on pull request #17034: Refactored waiting function for Tableau Jobs

2021-07-15 Thread GitBox
uranusjr commented on pull request #17034: URL: https://github.com/apache/airflow/pull/17034#issuecomment-881046818 Many changes besides `amazon.rst` are also irrelavant (or even wrong, like removing the blank line after the first line in a docstring). It’d be best if you could revert all

[GitHub] [airflow] uranusjr commented on a change in pull request #16931: #16692 show cron description in UI

2021-07-15 Thread GitBox
uranusjr commented on a change in pull request #16931: URL: https://github.com/apache/airflow/pull/16931#discussion_r670821620 ## File path: airflow/timetables/base.py ## @@ -83,6 +83,13 @@ def interval(cls, start: DateTime, end: DateTime) -> "DagRunInfo": class

[GitHub] [airflow] github-actions[bot] commented on pull request #17027: Core: Enable the use of __init_subclass__ in subclasses of BaseOperator

2021-07-15 Thread GitBox
github-actions[bot] commented on pull request #17027: URL: https://github.com/apache/airflow/pull/17027#issuecomment-881019050 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] mik-laj commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-07-15 Thread GitBox
mik-laj commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r670801679 ## File path: airflow/providers/amazon/aws/sensors/eks.py ## @@ -0,0 +1,129 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] mik-laj commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-07-15 Thread GitBox
mik-laj commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r670801679 ## File path: airflow/providers/amazon/aws/sensors/eks.py ## @@ -0,0 +1,129 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] mik-laj commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-07-15 Thread GitBox
mik-laj commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r670800809 ## File path: airflow/providers/amazon/aws/operators/eks.py ## @@ -0,0 +1,709 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] john-jac commented on pull request #16956: Update spark_kubernetes.py

2021-07-15 Thread GitBox
john-jac commented on pull request #16956: URL: https://github.com/apache/airflow/pull/16956#issuecomment-881001863 Thanks! That makes a lot more sense. I've updated the proposed changes accordingly -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] ferruzzi commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-07-15 Thread GitBox
ferruzzi commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r670780446 ## File path: tests/providers/amazon/aws/utils/eks_test_constants.py ## @@ -0,0 +1,256 @@ +# +# Licensed to the Apache Software Foundation (ASF) under

[GitHub] [airflow] ferruzzi commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-07-15 Thread GitBox
ferruzzi commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r670780104 ## File path: tests/providers/amazon/aws/operators/test_eks.py ## @@ -0,0 +1,299 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [airflow] ferruzzi commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-07-15 Thread GitBox
ferruzzi commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r670779889 ## File path: tests/providers/amazon/aws/operators/test_eks.py ## @@ -0,0 +1,299 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [airflow] Bennyelg commented on a change in pull request #16954: PythonVritualenvOperator - Feature: Add support for private pypi repo packages in requirements

2021-07-15 Thread GitBox
Bennyelg commented on a change in pull request #16954: URL: https://github.com/apache/airflow/pull/16954#discussion_r670363601 ## File path: airflow/utils/python_virtualenv.py ## @@ -35,12 +38,44 @@ def _generate_virtualenv_cmd(tmp_dir: str, python_bin: str,

[GitHub] [airflow] pateash commented on a change in pull request #16931: #16692 show cron description in UI

2021-07-15 Thread GitBox
pateash commented on a change in pull request #16931: URL: https://github.com/apache/airflow/pull/16931#discussion_r670768419 ## File path: airflow/www/views.py ## @@ -619,6 +619,9 @@ def index(self): dag.can_edit = (permissions.ACTION_CAN_EDIT,

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #17039: Calculate duration based on end_time if possible WIP

2021-07-15 Thread GitBox
boring-cyborg[bot] commented on pull request #17039: URL: https://github.com/apache/airflow/pull/17039#issuecomment-880971073 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] TristanJMcCormick opened a new pull request #17039: Calculate duration based on end_time if possible WIP

2021-07-15 Thread GitBox
TristanJMcCormick opened a new pull request #17039: URL: https://github.com/apache/airflow/pull/17039 --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] eladkal commented on a change in pull request #17034: Refactored waiting function for Tableau Jobs

2021-07-15 Thread GitBox
eladkal commented on a change in pull request #17034: URL: https://github.com/apache/airflow/pull/17034#discussion_r670722644 ## File path: airflow/providers/amazon/CHANGELOG.rst ## @@ -39,6 +39,7 @@ Bug Fixes .. Below changes are excluded from the changelog. Move them to

[GitHub] [airflow] pmalafosse opened a new issue #17038: ECSOperator returns last logs when ECS task fails

2021-07-15 Thread GitBox
pmalafosse opened a new issue #17038: URL: https://github.com/apache/airflow/issues/17038 **Description** Currently when the ECSOperator fails because the ECS task is not in 'success' state it returns a generic message like that in Airflow alerts that doesn't have much value when

[GitHub] [airflow] peter-volkov edited a comment on pull request #17033: Add autoscaling subcluster support and remove defaults

2021-07-15 Thread GitBox
peter-volkov edited a comment on pull request #17033: URL: https://github.com/apache/airflow/pull/17033#issuecomment-880926889 > yep. already fixed. rebase to main will fix it. Alright. And what should I do with Mysql test crashes? -- This is an automated message from the Apache

[GitHub] [airflow] peter-volkov commented on pull request #17033: Add autoscaling subcluster support and remove defaults

2021-07-15 Thread GitBox
peter-volkov commented on pull request #17033: URL: https://github.com/apache/airflow/pull/17033#issuecomment-880926889 > yep. already fixed. rebase to main will fix it. Alright. And what should I do with Mysql test crashes? -- This is an automated message from the Apache Git Service.

[GitHub] [airflow-site] potiuk commented on pull request #453: Add docs for July 2021 providers.

2021-07-15 Thread GitBox
potiuk commented on pull request #453: URL: https://github.com/apache/airflow-site/pull/453#issuecomment-880922558 You can do it @kaxil ! don't give up! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[airflow] tag providers-tableau/2.1.0rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-tableau/2.1.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[airflow] tag providers-ssh/2.1.0rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-ssh/2.1.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[airflow-site] branch july-2021-providers created (now 7125b74)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch july-2021-providers in repository https://gitbox.apache.org/repos/asf/airflow-site.git. at 7125b74 Add docs for July 2021 providers. No new revisions were added by this update.

[airflow] tag providers-snowflake/2.1.0rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-snowflake/2.1.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[airflow] tag providers-sftp/2.1.0rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-sftp/2.1.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[airflow] tag providers-postgres/2.1.0rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-postgres/2.1.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[airflow] tag providers-mysql/2.1.0rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-mysql/2.1.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[GitHub] [airflow] potiuk opened a new issue #17037: Status of testing Providers that were prepared on July 15, 2021

2021-07-15 Thread GitBox
potiuk opened a new issue #17037: URL: https://github.com/apache/airflow/issues/17037 have a kind request for all the contributors to the latest provider packages release. Could you help us to test the RC versions of the providers and let us know in the comment, if the issue is

[airflow] tag providers-microsoft-azure/3.1.0rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-microsoft-azure/3.1.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[airflow] tag providers-jenkins/2.0.1rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-jenkins/2.0.1rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[airflow] tag providers-google/4.1.0rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-google/4.1.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[GitHub] [airflow-site] potiuk opened a new pull request #453: Add docs for July 2021 providers.

2021-07-15 Thread GitBox
potiuk opened a new pull request #453: URL: https://github.com/apache/airflow-site/pull/453 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] josh-fell opened a new pull request #17036: Adding `SalesforceToS3Operator` to the Amazon Provider

2021-07-15 Thread GitBox
josh-fell opened a new pull request #17036: URL: https://github.com/apache/airflow/pull/17036 Closes: #16891 Creating an operator to extract data from Salesforce and upload to S3: `SalesforceToS3Operator` Items contained in this PR include: - Operator code:

[airflow] tag providers-docker/2.1.0rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-docker/2.1.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[airflow] tag providers-cncf-kubernetes/2.0.1rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-cncf-kubernetes/2.0.1rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[airflow] tag providers-apache-sqoop/2.0.1rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-apache-sqoop/2.0.1rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[airflow] tag providers-apache-hive/2.0.1rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-apache-hive/2.0.1rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[airflow] tag providers-apache-drill/1.0.0rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-apache-drill/1.0.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

[airflow] tag providers-amazon/2.1.0rc1 created (now d02ded6)

2021-07-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to tag providers-amazon/2.1.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git. at d02ded6 (commit) No new revisions were added by this update.

svn commit: r48845 - /dev/airflow/providers/

2021-07-15 Thread potiuk
Author: potiuk Date: Thu Jul 15 17:31:44 2021 New Revision: 48845 Log: Add artifacts for Airflow Providers 2021-07-15v2 Modified: dev/airflow/providers/apache-airflow-providers-amazon-2.1.0.tar.gz dev/airflow/providers/apache-airflow-providers-amazon-2.1.0.tar.gz.asc

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17035: KubernetesPodOperator 'pod_template_file' not found

2021-07-15 Thread GitBox
boring-cyborg[bot] commented on issue #17035: URL: https://github.com/apache/airflow/issues/17035#issuecomment-880878203 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] evanhlavaty opened a new issue #17035: KubernetesPodOperator 'pod_template_file' not found

2021-07-15 Thread GitBox
evanhlavaty opened a new issue #17035: URL: https://github.com/apache/airflow/issues/17035 **Apache Airflow version**: 2.1.2-python3.8 docker image **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): 1.19.7 **Environment**: - **Cloud

[GitHub] [airflow] potiuk commented on pull request #17033: Add autoscaling subcluster support and remove defaults

2021-07-15 Thread GitBox
potiuk commented on pull request #17033: URL: https://github.com/apache/airflow/pull/17033#issuecomment-880868148 yep. already fixed. rebase to main will fix it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] peter-volkov commented on pull request #17033: Add autoscaling subcluster support and remove defaults

2021-07-15 Thread GitBox
peter-volkov commented on pull request #17033: URL: https://github.com/apache/airflow/pull/17033#issuecomment-880865271 Build Images / Build PROD images 3.6 (pull_request_target) CI check: ```ERROR: Cannot install apache-airflow-providers-sftp==2.1.0.dev0 and

[GitHub] [airflow] potiuk commented on issue #17024: IMAP provider is always installed even if not selected

2021-07-15 Thread GitBox
potiuk commented on issue #17024: URL: https://github.com/apache/airflow/issues/17024#issuecomment-880848306 > Ok. I do not quite agree with that, but ok. Thanks. That's OK. It's OK to have different opinion. We argue about many things in airflow community often and often have

[GitHub] [airflow] baryluk commented on issue #17024: IMAP provider is always installed even if not selected

2021-07-15 Thread GitBox
baryluk commented on issue #17024: URL: https://github.com/apache/airflow/issues/17024#issuecomment-880842039 Ok. I do not quite agree with that, but ok. Thanks. PS. The preinstalled column was hidden, because my web browser windows was not wide enough apparently. -- This is

  1   2   3   >