[GitHub] [airflow] fuguixing edited a comment on issue #17429: Scan the DAGs directory for new files througth restfull API

2021-08-05 Thread GitBox
fuguixing edited a comment on issue #17429: URL: https://github.com/apache/airflow/issues/17429#issuecomment-894013281 Thanks for your reply! In our env, I need to make the new specified DAG file available immediately without waiting for Airflow call **_refresh_dag_dir**(in the

[GitHub] [airflow] fuguixing commented on issue #17429: Scan the DAGs directory for new files througth restfull API

2021-08-05 Thread GitBox
fuguixing commented on issue #17429: URL: https://github.com/apache/airflow/issues/17429#issuecomment-894013281 Thanks for your reply! In our env, I need to make the new specified DAG available immediately without waiting for Airflow call **_refresh_dag_dir**(in the dag_processing.py),

[GitHub] [airflow] baolsen commented on issue #10874: SSHHook get_conn() does not re-use client

2021-08-05 Thread GitBox
baolsen commented on issue #10874: URL: https://github.com/apache/airflow/issues/10874#issuecomment-894009918 PR is up :) Observations and suggestions welcome. Happy to make other improvements based on the feedback. https://github.com/apache/airflow/pull/17378 -- This is an

[GitHub] [airflow] goodhamgupta edited a comment on issue #16728: SparkKubernetesOperator to support arguments

2021-08-05 Thread GitBox
goodhamgupta edited a comment on issue #16728: URL: https://github.com/apache/airflow/issues/16728#issuecomment-894005544 Hi @potiuk, I think I don't understand the issue well enough. I see that for the SparkKubernetesOperator, the following code segment: ```py class

[GitHub] [airflow] goodhamgupta commented on issue #16728: SparkKubernetesOperator to support arguments

2021-08-05 Thread GitBox
goodhamgupta commented on issue #16728: URL: https://github.com/apache/airflow/issues/16728#issuecomment-894005544 Hi @potiuk, I think I don't understand the issue well enough. I see that for the SparkKubernetesOperator, the following code segment: ```py class

[GitHub] [airflow] github-actions[bot] commented on pull request #17456: Adding TaskGroup support in chain()

2021-08-05 Thread GitBox
github-actions[bot] commented on pull request #17456: URL: https://github.com/apache/airflow/pull/17456#issuecomment-894005427 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] uranusjr commented on a change in pull request #16866: Remove default_args pattern + added get_current_context() use for Core Airflow example DAGs

2021-08-05 Thread GitBox
uranusjr commented on a change in pull request #16866: URL: https://github.com/apache/airflow/pull/16866#discussion_r683950115 ## File path: airflow/example_dags/tutorial_taskflow_api_etl_virtualenv.py ## @@ -19,24 +19,14 @@ # [START tutorial] # [START import_module]

[GitHub] [airflow] josh-fell opened a new pull request #17456: Adding TaskGroup support in chain()

2021-08-05 Thread GitBox
josh-fell opened a new pull request #17456: URL: https://github.com/apache/airflow/pull/17456 Related to: #17083, #16635 This PR ensures that `TaskGroups` can be used to set dependencies while calling the `chain()` method. Support for `XComArgs` and `EdgeModifiers` has been

[jira] [Commented] (AIRFLOW-4922) If a task crashes, host name is not committed to the database so logs aren't able to be seen in the UI

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394452#comment-17394452 ] ASF GitHub Bot commented on AIRFLOW-4922: - gowdra01 commented on pull request #6722: URL:

[GitHub] [airflow] gowdra01 commented on pull request #6722: [AIRFLOW-4922]Fix task get log by Web UI

2021-08-05 Thread GitBox
gowdra01 commented on pull request #6722: URL: https://github.com/apache/airflow/pull/6722#issuecomment-893961036 I am stuck with this too I am using 2.1.0 version and getting the error *** Failed to fetch log file from worker. 503 Server Error: Service Unavailable for url: -- This

[jira] [Commented] (AIRFLOW-4922) If a task crashes, host name is not committed to the database so logs aren't able to be seen in the UI

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394442#comment-17394442 ] ASF GitHub Bot commented on AIRFLOW-4922: - xuemengran commented on pull request #6722: URL:

[GitHub] [airflow] xuemengran commented on pull request #6722: [AIRFLOW-4922]Fix task get log by Web UI

2021-08-05 Thread GitBox
xuemengran commented on pull request #6722: URL: https://github.com/apache/airflow/pull/6722#issuecomment-893956847 In the 2.1.1 version, I tried to modify the airflow/utils/log/file_task_handler.py file to obtain the hostname information by reading the log table. I confirmed through

[GitHub] [airflow] Sonins edited a comment on pull request #17428: Fix elasticsearch-secret template port default function

2021-08-05 Thread GitBox
Sonins edited a comment on pull request #17428: URL: https://github.com/apache/airflow/pull/17428#issuecomment-893932430 Thank you for your review @jedcunningham . I did the unit test using pytest in breeze environment, but I don't know how to attach the result to this PR in fancy

[GitHub] [airflow] Sonins commented on pull request #17428: Fix elasticsearch-secret template port default function

2021-08-05 Thread GitBox
Sonins commented on pull request #17428: URL: https://github.com/apache/airflow/pull/17428#issuecomment-893932430 Thank you for your review @jedcunningham . I did the unit test using pytest in breeze environment, but I don't know how to attach the result to this PR in fancy style.

[GitHub] [airflow] mik-laj commented on a change in pull request #16571: Implemented Basic EKS Integration

2021-08-05 Thread GitBox
mik-laj commented on a change in pull request #16571: URL: https://github.com/apache/airflow/pull/16571#discussion_r683872000 ## File path: airflow/providers/amazon/aws/hooks/eks.py ## @@ -0,0 +1,420 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] github-actions[bot] commented on pull request #16268: Change Regex For Inclusive Words

2021-08-05 Thread GitBox
github-actions[bot] commented on pull request #16268: URL: https://github.com/apache/airflow/pull/16268#issuecomment-893904676 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank

[GitHub] [airflow] github-actions[bot] commented on pull request #16012: Fixing Glue hooks/operators

2021-08-05 Thread GitBox
github-actions[bot] commented on pull request #16012: URL: https://github.com/apache/airflow/pull/16012#issuecomment-893904709 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank

[GitHub] [airflow] mik-laj edited a comment on issue #17429: Scan the DAGs directory for new files througth restfull API

2021-08-05 Thread GitBox
mik-laj edited a comment on issue #17429: URL: https://github.com/apache/airflow/issues/17429#issuecomment-893892411 Will the proposed imrpovments from https://github.com/apache/airflow/issues/17437 solve your problem? -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] jarfgit edited a comment on pull request #17145: Adds an s3 list prefixes operator

2021-08-05 Thread GitBox
jarfgit edited a comment on pull request #17145: URL: https://github.com/apache/airflow/pull/17145#issuecomment-893890145 @o-nikolas @iostreamdoth @potiuk Ok, at long last I've updated this pull request: * Refactored `S3ListOperator` to take a `recursive` parameter * Refactored

[GitHub] [airflow] mik-laj commented on issue #17429: Scan the DAGs directory for new files througth restfull API

2021-08-05 Thread GitBox
mik-laj commented on issue #17429: URL: https://github.com/apache/airflow/issues/17429#issuecomment-893892411 Related PR: https://github.com/apache/airflow/issues/17437 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] mik-laj commented on issue #17429: Scan the DAGs directory for new files througth restfull API

2021-08-05 Thread GitBox
mik-laj commented on issue #17429: URL: https://github.com/apache/airflow/issues/17429#issuecomment-893891678 This can be problematic as the webserver is stateless and does not have access to the DAG files. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] mik-laj commented on issue #17443: No link for kibana when using frontend configuration

2021-08-05 Thread GitBox
mik-laj commented on issue #17443: URL: https://github.com/apache/airflow/issues/17443#issuecomment-893891221 To enable external links for logs, you need to use a task handler that supports external links. In this case, you should use

[GitHub] [airflow] jarfgit commented on pull request #17145: Adds an s3 list prefixes operator

2021-08-05 Thread GitBox
jarfgit commented on pull request #17145: URL: https://github.com/apache/airflow/pull/17145#issuecomment-893890145 @o-nikolas @iostreamdoth @potiuk Ok, at long last I've updated this pull request: * Refactored `S3ListOperator` to take a `recursive` parameter * Refactored the S3

[GitHub] [airflow] mik-laj commented on a change in pull request #17400: Example dag slackfile

2021-08-05 Thread GitBox
mik-laj commented on a change in pull request #17400: URL: https://github.com/apache/airflow/pull/17400#discussion_r683846325 ## File path: airflow/providers/slack/operators/slack.py ## @@ -195,49 +196,50 @@ class SlackAPIFileOperator(SlackAPIOperator): :type content: str

[GitHub] [airflow] mik-laj commented on a change in pull request #17426: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-05 Thread GitBox
mik-laj commented on a change in pull request #17426: URL: https://github.com/apache/airflow/pull/17426#discussion_r683844854 ## File path: airflow/cli/cli_parser.py ## @@ -60,10 +62,17 @@ def _check_value(self, action, value): if action.dest == 'subcommand' and value

[GitHub] [airflow] mik-laj commented on a change in pull request #17426: Allow using default celery commands for custom Celery executors subclassed from existing

2021-08-05 Thread GitBox
mik-laj commented on a change in pull request #17426: URL: https://github.com/apache/airflow/pull/17426#discussion_r683844854 ## File path: airflow/cli/cli_parser.py ## @@ -60,10 +62,17 @@ def _check_value(self, action, value): if action.dest == 'subcommand' and value

[GitHub] [airflow] mik-laj commented on a change in pull request #17448: Aws secrets manager backend

2021-08-05 Thread GitBox
mik-laj commented on a change in pull request #17448: URL: https://github.com/apache/airflow/pull/17448#discussion_r683842856 ## File path: airflow/providers/amazon/aws/secrets/secrets_manager.py ## @@ -96,28 +97,74 @@ def __init__( @cached_property def

[GitHub] [airflow] mik-laj commented on a change in pull request #17448: Aws secrets manager backend

2021-08-05 Thread GitBox
mik-laj commented on a change in pull request #17448: URL: https://github.com/apache/airflow/pull/17448#discussion_r683842856 ## File path: airflow/providers/amazon/aws/secrets/secrets_manager.py ## @@ -96,28 +97,74 @@ def __init__( @cached_property def

[GitHub] [airflow] mik-laj commented on pull request #17448: Aws secrets manager backend

2021-08-05 Thread GitBox
mik-laj commented on pull request #17448: URL: https://github.com/apache/airflow/pull/17448#issuecomment-893875377 Can you also update the docs? http://airflow.apache.org/docs/apache-airflow-providers-amazon/stable/secrets-backends/aws-secrets-manager.html -- This is an automated

[GitHub] [airflow] wolfier opened a new issue #17453: SQLAlchemy constraint for apache-airflow-snowflake-provider installation

2021-08-05 Thread GitBox
wolfier opened a new issue #17453: URL: https://github.com/apache/airflow/issues/17453 **Apache Airflow version**: 2.1.0 or really any Airflow versions **What happened**: When I try to install the snowflake provider, the version of SQLAlchemy also get upgraded. Due to the

[GitHub] [airflow] jedcunningham opened a new pull request #17452: Pin snowflake-sqlalchemy

2021-08-05 Thread GitBox
jedcunningham opened a new pull request #17452: URL: https://github.com/apache/airflow/pull/17452 snowflake-sqlalchemy 1.3 now depends on sqlalchemy 1.4+, so pin to a max of 1.2.x. The webserver cannot start when we have sqlalchemy 1.4, throwing the following exceptions:

[GitHub] [airflow] Wittline commented on issue #8177: provide_context=True not working with PythonVirtualenvOperator

2021-08-05 Thread GitBox
Wittline commented on issue #8177: URL: https://github.com/apache/airflow/issues/8177#issuecomment-893833279 Hi @jatejeda Please check my github, I used the **PythonVirtualenvOperator** in a personal project using the version 2. https://github.com/Wittline/uber-expenses-tracking

[GitHub] [airflow] jatejeda commented on issue #8177: provide_context=True not working with PythonVirtualenvOperator

2021-08-05 Thread GitBox
jatejeda commented on issue #8177: URL: https://github.com/apache/airflow/issues/8177#issuecomment-893831486 no, it wasn't fixed ... I have the same bug in 2.0.2 > Hi, > > Was this bug fixed in Airflow version 2? -- This is an automated message from the Apache Git

[GitHub] [airflow] fatmumuhomer commented on a change in pull request #17236: [Airflow 16364] Add conn_timeout and cmd_timeout params to SSHOperator; add conn_timeout param to SSHHook

2021-08-05 Thread GitBox
fatmumuhomer commented on a change in pull request #17236: URL: https://github.com/apache/airflow/pull/17236#discussion_r683804274 ## File path: docs/apache-airflow-providers-ssh/connections/ssh.rst ## @@ -47,7 +47,8 @@ Extra (optional) * ``key_file`` - Full Path of the

[airflow] 17/17: Switches to "/" convention in ghcr.io images (#17356)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 8fc76971c80d1b52a32bc244548c058aaffe27dd Author: Jarek Potiuk AuthorDate: Thu Aug 5 18:39:43 2021 +0200

[airflow] 11/17: Increases timeout for helm chart builds (#17417)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 38c7115599884e1b927fc3c06d8035fb59aff3f2 Author: Jarek Potiuk AuthorDate: Wed Aug 4 22:02:46 2021 +0200

[airflow] 05/17: bump dnspython (#16698)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 867adda5e28b5d3c366e3cd3e1f8f60f5f412c4b Author: kurtqq <47721902+kur...@users.noreply.github.com> AuthorDate: Tue

[airflow] 07/17: Update alias for field_mask in Google Memmcache (#16975)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 37c935d601ff6c3f501fcfab3bf1b57665fddbc1 Author: Jarek Potiuk AuthorDate: Tue Jul 13 20:54:38 2021 +0200

[airflow] 15/17: Improve diagnostics message when users have secret_key misconfigured (#17410)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 2df7e6e41cf6968b48658c21e989868cb3960027 Author: Jarek Potiuk AuthorDate: Wed Aug 4 15:15:38 2021 +0200

[airflow] 13/17: Optimizes structure of the Dockerfiles and use latest tools (#17418)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 106d9f09852090da21f3dfb744c69e4be5fd90e5 Author: Jarek Potiuk AuthorDate: Wed Aug 4 23:32:12 2021 +0200

[airflow] 12/17: Improve image building documentation for new users (#17409)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 8609c82c7cdd3047efee0c55bb214541e3ea293d Author: Jarek Potiuk AuthorDate: Wed Aug 4 23:07:22 2021 +0200

[airflow] 04/17: Add type annotations to setup.py (#16658)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit dfeb73da4f1d3f7a18ad6ab0e320b780588abe13 Author: Ali Muhammad AuthorDate: Fri Jun 25 22:25:52 2021 +0500 Add

[airflow] 16/17: Fix failing static checks in main (#17424)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit f1966908e0f9b7dee4415046c19a213781271fe4 Author: Jarek Potiuk AuthorDate: Wed Aug 4 23:33:29 2021 +0200 Fix

[airflow] 14/17: Add timeout when asking whether to rebuild image (#17412)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 7371f986b0eedec677c76dc7b6db28a996b9c525 Author: Jarek Potiuk AuthorDate: Wed Aug 4 15:44:06 2021 +0200 Add

[airflow] 09/17: Enhancement to bash scripts (#17098)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 7a43960a5c3c5822c56149ece261ab99c6a92282 Author: Shraman Basyal <49772843+bshra...@users.noreply.github.com>

[airflow] 10/17: Do not pull CI image for ownership fixing on first, fresh breeze run (#17419)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 70794b00175e01c18d72fca3ce8eb58ef306e76b Author: Jarek Potiuk AuthorDate: Wed Aug 4 22:00:33 2021 +0200 Do not

[airflow] 06/17: AIRFLOW-5529 Add Apache Drill provider. (#16884)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 42334b0f9145e70eb23938cad78589f6a97731dc Author: dzamo <9107319+dz...@users.noreply.github.com> AuthorDate: Mon Jul

[airflow] 08/17: Updates to FlaskAppBuilder 3.3.2+ (#17208)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 3c0f4d9908a81b662296e747230dba5ddb96f213 Author: Jarek Potiuk AuthorDate: Wed Jul 28 21:37:48 2021 +0200

[airflow] 03/17: Bump Jinja2 upper-bound from 2.12.0 to 4.0.0 (#16595)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit fe5920e5ed3e1158bffbc3a15d24d57c10d79843 Author: Ashwin Madavan AuthorDate: Thu Jun 24 15:07:23 2021 -0400

[airflow] 01/17: Switch back http provider after requests removes LGPL dependency (#16974)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit ab3634a28cc5601c6bb78a81aaa7f349afa27377 Author: Jarek Potiuk AuthorDate: Tue Jul 13 22:13:30 2021 +0200

[airflow] 02/17: Remove SQLAlchemy <1.4 constraint (#16630)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 68977b9ed93e351f55ea93e1848be13ccef0 Author: Tzu-ping Chung AuthorDate: Thu Jun 24 21:10:15 2021 +0800

[airflow] branch v2-1-test updated (4678cf54 -> 8fc7697)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git. discard 4678cf54 Validate type of `priority_weight` during parsing (#16765) discard b558205 Fix calculating duration

[airflow] branch constraints-2-1 updated: Updated to latest constraints

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch constraints-2-1 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-1 by this push: new ced5c9a Updated to latest

[GitHub] [airflow] fatmumuhomer commented on a change in pull request #17236: [Airflow 16364] Add conn_timeout and cmd_timeout params to SSHOperator; add conn_timeout param to SSHHook

2021-08-05 Thread GitBox
fatmumuhomer commented on a change in pull request #17236: URL: https://github.com/apache/airflow/pull/17236#discussion_r683763029 ## File path: airflow/providers/ssh/operators/ssh.py ## @@ -77,9 +87,24 @@ def __init__( self.remote_host = remote_host

[GitHub] [airflow] dstandish commented on a change in pull request #17433: KEDA task count query should ignore k8s queue

2021-08-05 Thread GitBox
dstandish commented on a change in pull request #17433: URL: https://github.com/apache/airflow/pull/17433#discussion_r683756891 ## File path: chart/templates/workers/worker-kedaautoscaler.yaml ## @@ -49,5 +49,7 @@ spec: query: >- SELECT

[GitHub] [airflow] ephraimbuddy commented on pull request #17347: Handle and log exceptions raised during task callback

2021-08-05 Thread GitBox
ephraimbuddy commented on pull request #17347: URL: https://github.com/apache/airflow/pull/17347#issuecomment-893714524 @SamWheating please rebase again -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] jedcunningham commented on pull request #17445: Add info log how to fix: More than one pod running with labels

2021-08-05 Thread GitBox
jedcunningham commented on pull request #17445: URL: https://github.com/apache/airflow/pull/17445#issuecomment-893700450 As I mentioned in the other PR, I think the right fix is to only attempt to reattach to running pods. If we were to offer advice in a log message, setting

[GitHub] [airflow] ephraimbuddy closed pull request #17425: Use `dag_maker` fixture in models/test_taskinstance.py

2021-08-05 Thread GitBox
ephraimbuddy closed pull request #17425: URL: https://github.com/apache/airflow/pull/17425 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #17414: Allow custom timetable as a DAG argument

2021-08-05 Thread GitBox
github-actions[bot] commented on pull request #17414: URL: https://github.com/apache/airflow/pull/17414#issuecomment-893693795 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] jedcunningham commented on a change in pull request #17236: [Airflow 16364] Add conn_timeout and cmd_timeout params to SSHOperator; add conn_timeout param to SSHHook

2021-08-05 Thread GitBox
jedcunningham commented on a change in pull request #17236: URL: https://github.com/apache/airflow/pull/17236#discussion_r683689193 ## File path: tests/providers/ssh/hooks/test_ssh.py ## @@ -475,6 +504,122 @@ def

[GitHub] [airflow] BasPH commented on a change in pull request #17451: Add date format filters to Jinja environment

2021-08-05 Thread GitBox
BasPH commented on a change in pull request #17451: URL: https://github.com/apache/airflow/pull/17451#discussion_r683673558 ## File path: docs/apache-airflow/templates-ref.rst ## @@ -105,14 +105,35 @@ For example, you could use expressions in your templates like ``{{

[GitHub] [airflow] jedcunningham commented on a change in pull request #17433: KEDA task count query should ignore k8s queue

2021-08-05 Thread GitBox
jedcunningham commented on a change in pull request #17433: URL: https://github.com/apache/airflow/pull/17433#discussion_r683648189 ## File path: chart/templates/workers/worker-kedaautoscaler.yaml ## @@ -49,5 +49,7 @@ spec: query: >- SELECT

[airflow] 04/05: Fix calculating duration in tree view (#16695)

2021-08-05 Thread jhtimmins
This is an automated email from the ASF dual-hosted git repository. jhtimmins pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit b558205e817f168df7e5c37c9f006a6af31d576e Author: Brent Bovenzi AuthorDate: Mon Jun 28 11:23:19 2021 -0400

[airflow] 02/05: Fail tasks in scheduler when executor reports they failed (#15929)

2021-08-05 Thread jhtimmins
This is an automated email from the ASF dual-hosted git repository. jhtimmins pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 012321b1325c8d810ae60ad7006ab9f22dfaf95e Author: Ephraim Anierobi AuthorDate: Thu May 20 11:22:01 2021 +0100

[airflow] 01/05: fix(smart_sensor): Unbound variable errors (#14774)

2021-08-05 Thread jhtimmins
This is an automated email from the ASF dual-hosted git repository. jhtimmins pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 673d78a6cc78038121d3f5e99caa6ded488d654a Author: Shivansh Saini AuthorDate: Thu Jun 24 03:52:27 2021 +0530

[airflow] 05/05: Validate type of `priority_weight` during parsing (#16765)

2021-08-05 Thread jhtimmins
This is an automated email from the ASF dual-hosted git repository. jhtimmins pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 4678cf54b5cd651e0232a42746f9be80db43a609 Author: Kaxil Naik AuthorDate: Fri Jul 2 01:52:50 2021 +0100

[airflow] branch v2-1-test updated (ac832a2 -> 4678cf54)

2021-08-05 Thread jhtimmins
This is an automated email from the ASF dual-hosted git repository. jhtimmins pushed a change to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git. from ac832a2 Updates to FlaskAppBuilder 3.3.2+ (#17208) new 673d78a fix(smart_sensor): Unbound variable

[airflow] 03/05: Fix CLI 'kubernetes cleanup-pods' which fails on invalid label key (#17298)

2021-08-05 Thread jhtimmins
This is an automated email from the ASF dual-hosted git repository. jhtimmins pushed a commit to branch v2-1-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 8e8b58aa0a96164c7142d795a9c919d50e2a9aa1 Author: Damir Lampa <60409723+dla...@users.noreply.github.com>

[airflow] branch main updated: Switches to "/" convention in ghcr.io images (#17356)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 1bd3a5c Switches to "/" convention in ghcr.io

[GitHub] [airflow] potiuk merged pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
potiuk merged pull request #17356: URL: https://github.com/apache/airflow/pull/17356 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on a change in pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
potiuk commented on a change in pull request #17356: URL: https://github.com/apache/airflow/pull/17356#discussion_r683616163 ## File path: IMAGES.rst ## @@ -246,19 +246,21 @@ Images with a commit SHA (built for pull requests and pushes) .. code-block:: bash -

[GitHub] [airflow] ashb commented on a change in pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
ashb commented on a change in pull request #17356: URL: https://github.com/apache/airflow/pull/17356#discussion_r683612026 ## File path: scripts/ci/libraries/_parallel.sh ## @@ -82,9 +85,9 @@ function parallel::monitor_loop() { continue fi -

[GitHub] [airflow] potiuk commented on a change in pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
potiuk commented on a change in pull request #17356: URL: https://github.com/apache/airflow/pull/17356#discussion_r683611390 ## File path: scripts/ci/libraries/_parallel.sh ## @@ -82,9 +85,9 @@ function parallel::monitor_loop() { continue fi -

[GitHub] [airflow] github-actions[bot] commented on pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
github-actions[bot] commented on pull request #17356: URL: https://github.com/apache/airflow/pull/17356#issuecomment-893596614 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] ashb commented on a change in pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
ashb commented on a change in pull request #17356: URL: https://github.com/apache/airflow/pull/17356#discussion_r683610137 ## File path: scripts/ci/libraries/_parallel.sh ## @@ -82,9 +85,9 @@ function parallel::monitor_loop() { continue fi -

[GitHub] [airflow] potiuk commented on a change in pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
potiuk commented on a change in pull request #17356: URL: https://github.com/apache/airflow/pull/17356#discussion_r683609643 ## File path: scripts/ci/libraries/_parallel.sh ## @@ -82,9 +85,9 @@ function parallel::monitor_loop() { continue fi -

[GitHub] [airflow] potiuk commented on a change in pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
potiuk commented on a change in pull request #17356: URL: https://github.com/apache/airflow/pull/17356#discussion_r683608694 ## File path: IMAGES.rst ## @@ -246,19 +246,21 @@ Images with a commit SHA (built for pull requests and pushes) .. code-block:: bash -

[GitHub] [airflow] ashb commented on a change in pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
ashb commented on a change in pull request #17356: URL: https://github.com/apache/airflow/pull/17356#discussion_r683608098 ## File path: scripts/ci/libraries/_parallel.sh ## @@ -82,9 +85,9 @@ function parallel::monitor_loop() { continue fi -

[GitHub] [airflow] ashb commented on a change in pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
ashb commented on a change in pull request #17356: URL: https://github.com/apache/airflow/pull/17356#discussion_r683606425 ## File path: IMAGES.rst ## @@ -246,19 +246,21 @@ Images with a commit SHA (built for pull requests and pushes) .. code-block:: bash -

[GitHub] [airflow] ashb commented on pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
ashb commented on pull request #17356: URL: https://github.com/apache/airflow/pull/17356#issuecomment-893591363 Oh yes, this one is wating for review 臘 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] potiuk commented on pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
potiuk commented on pull request #17356: URL: https://github.com/apache/airflow/pull/17356#issuecomment-893590266 It's all complete from my side :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] ashb commented on pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
ashb commented on pull request #17356: URL: https://github.com/apache/airflow/pull/17356#issuecomment-893583079 Let me know where you get to, and I'll try and push this over the line if we don't get it merged before then. -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] ashb commented on a change in pull request #17451: Add date format filters to Jinja environment

2021-08-05 Thread GitBox
ashb commented on a change in pull request #17451: URL: https://github.com/apache/airflow/pull/17451#discussion_r683589210 ## File path: docs/apache-airflow/index.rst ## @@ -110,7 +110,7 @@ unit of work and continuity. Operators and hooks CLI -Macros +

[GitHub] [airflow] ashb commented on a change in pull request #17451: Add date format filters to Jinja environment

2021-08-05 Thread GitBox
ashb commented on a change in pull request #17451: URL: https://github.com/apache/airflow/pull/17451#discussion_r683586341 ## File path: airflow/macros/__init__.py ## @@ -15,7 +15,6 @@ # KIND, either express or implied. See the License for the # specific language governing

[GitHub] [airflow] ashb opened a new pull request #17451: Add date format filters to Jinja environment

2021-08-05 Thread GitBox
ashb opened a new pull request #17451: URL: https://github.com/apache/airflow/pull/17451 On it's own this doesn't add all that much, but this is preparatory work to be combined with the new `data_interval_start` variables we are adding, without having to add the ds/ts/no-dash etc

[GitHub] [airflow] potiuk edited a comment on pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
potiuk edited a comment on pull request #17356: URL: https://github.com/apache/airflow/pull/17356#issuecomment-893561416 I'd love to merge it in to get the latest tests of merged v2-1-test @ashb -> going for a week of vacations tomorrow, I hope GitHub will solve Packages problems as well

[GitHub] [airflow] potiuk commented on pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
potiuk commented on pull request #17356: URL: https://github.com/apache/airflow/pull/17356#issuecomment-893561416 I'd love to merge it in to get the latest tests of merged v2-1-tests @ashb -> going for a week of vacations tomorrow, I hope GitHub will solve Packages problems as well till

[GitHub] [airflow] andrewgodwin commented on pull request #17431: Add back missing permissions to UserModelView controls.

2021-08-05 Thread GitBox
andrewgodwin commented on pull request #17431: URL: https://github.com/apache/airflow/pull/17431#issuecomment-893559902 @uranusjr Given this is blocking a release, I'd suggest it gets landed and then new test refactoring can be done separately. -- This is an automated message from the

[GitHub] [airflow] kosteev opened a new pull request #17450: Add missing menu access for dag dependencies and configurations pages

2021-08-05 Thread GitBox
kosteev opened a new pull request #17450: URL: https://github.com/apache/airflow/pull/17450 closes: #17449 Add missing menu access for following pages for "Op" role: - "Browse" -> "DAG Dependencies" - "Admin" -> "Configurations" -- This is an automated message from the

[GitHub] [airflow] kosteev opened a new issue #17449: Missing menu items in navigation panel for "Op" role

2021-08-05 Thread GitBox
kosteev opened a new issue #17449: URL: https://github.com/apache/airflow/issues/17449 **Apache Airflow version**: 2.1.1 **What happened**: For user with "Op" role following menu items are not visible in navigation panel, however pages are accessible (roles has access to it):

[airflow-site] branch gh-pages updated: Deploying to gh-pages from @ c401267b05ac5c520c29882fafd4c3463451f268 

2021-08-05 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/gh-pages by this push: new 46aabfa Deploying to gh-pages

[airflow-site] branch main updated: Change Seniorlink logo to svg from png (#463)

2021-08-05 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new c401267 Change Seniorlink logo to svg from

[GitHub] [airflow] potiuk commented on pull request #17356: Switches to "/" convention in ghcr.io images

2021-08-05 Thread GitBox
potiuk commented on pull request #17356: URL: https://github.com/apache/airflow/pull/17356#issuecomment-893548359 All looks good - some temporary errors only. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] iostreamdoth edited a comment on pull request #17446: Add support of `path` parameter for GCloud Storage Transfer Service operators

2021-08-05 Thread GitBox
iostreamdoth edited a comment on pull request #17446: URL: https://github.com/apache/airflow/pull/17446#issuecomment-893547790 I see now. PATH was missing earlier from transfer spec for gcs data sink. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] iostreamdoth commented on pull request #17446: Add support of `path` parameter for GCloud Storage Transfer Service operators

2021-08-05 Thread GitBox
iostreamdoth commented on pull request #17446: URL: https://github.com/apache/airflow/pull/17446#issuecomment-893547790 I see now. PATH: self.gcs_path was missing earlier from transfer spec. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow-site] potiuk merged pull request #463: Change Seniorlink logo to svg from png

2021-08-05 Thread GitBox
potiuk merged pull request #463: URL: https://github.com/apache/airflow-site/pull/463 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] iostreamdoth commented on pull request #17446: Add support of `path` parameter for GCloud Storage Transfer Service operators

2021-08-05 Thread GitBox
iostreamdoth commented on pull request #17446: URL: https://github.com/apache/airflow/pull/17446#issuecomment-893530997 Wondering if that should be part of transfer_options. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[airflow] branch main updated (82bda99 -> e478999)

2021-08-05 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 82bda99 Fix Google Cloud Operators docs (#17440) add e478999 Quarantine

[GitHub] [airflow] ephraimbuddy merged pull request #17441: Quarantine test_process_sigterm_works_with_retries and test_task_sigkill_works_with_retries in TestLocalTaskJob

2021-08-05 Thread GitBox
ephraimbuddy merged pull request #17441: URL: https://github.com/apache/airflow/pull/17441 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] JavierLopezT opened a new pull request #17448: Aws secrets manager backend

2021-08-05 Thread GitBox
JavierLopezT opened a new pull request #17448: URL: https://github.com/apache/airflow/pull/17448 One of the main advantages of using AWS Secrets Manager is its ability to automatically create secrets of RDS databases and Redshift databases. Those secrets consist of several keys with their

  1   2   3   4   >