[GitHub] [airflow] millin opened a new pull request #21928: Fix incorrect data provided to tries & landing times charts

2022-03-01 Thread GitBox
millin opened a new pull request #21928: URL: https://github.com/apache/airflow/pull/21928 Hello everyone, I found that some time ago tries & landing times charts were broken. So, I fixed them. Affected Airflow versions: 2.2.3, 2.2.4 Ex. landing times before the fix:

[GitHub] [airflow] potiuk commented on pull request #21915: Unpin ``pandas-gbq`` and remove unused code

2022-03-01 Thread GitBox
potiuk commented on pull request #21915: URL: https://github.com/apache/airflow/pull/21915#issuecomment-1056504676 Hell yeah :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[airflow] branch main updated (3052268 -> 84ed747)

2022-03-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 3052268 Chart: move updating note about config removal (#21919) add 84ed747 Unpin ``pandas-gbq`` and remove

[GitHub] [airflow] potiuk merged pull request #21915: Unpin ``pandas-gbq`` and remove unused code

2022-03-01 Thread GitBox
potiuk merged pull request #21915: URL: https://github.com/apache/airflow/pull/21915 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] malthe opened a new pull request #21927: Refactor

2022-03-01 Thread GitBox
malthe opened a new pull request #21927: URL: https://github.com/apache/airflow/pull/21927 We should be able to cast in all dialects. Refactoring query code. Read the **[Pull Request

[GitHub] [airflow] dstandish commented on pull request #19857: Enable json serialization for secrets backend

2022-03-01 Thread GitBox
dstandish commented on pull request #19857: URL: https://github.com/apache/airflow/pull/19857#issuecomment-1056452743 @potiuk > Also we need some updates to documentation with that one - describing it. I'm working on it. But it's ultimately gonna require a pretty substantial

[GitHub] [airflow] talnagar commented on a change in pull request #21851: added an option for run id in the ui trigger screen

2022-03-01 Thread GitBox
talnagar commented on a change in pull request #21851: URL: https://github.com/apache/airflow/pull/21851#discussion_r817392507 ## File path: airflow/www/templates/airflow/trigger.html ## @@ -35,15 +35,20 @@ Trigger DAG: {{ dag_id }} - + Logical

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #21731: Store callbacks in database if standalone_dag_processor config is True.

2022-03-01 Thread GitBox
ephraimbuddy commented on a change in pull request #21731: URL: https://github.com/apache/airflow/pull/21731#discussion_r817383308 ## File path: airflow/migrations/versions/c97c2ab6aa23_add_callback_request_table.py ## @@ -0,0 +1,63 @@ +# +# Licensed to the Apache Software

[GitHub] [airflow] hterik commented on issue #21923: Programmatic customization of run_id for scheduled DagRuns

2022-03-01 Thread GitBox
hterik commented on issue #21923: URL: https://github.com/apache/airflow/issues/21923#issuecomment-1056360644 Agree that navigating the UI based on dagrun-id is very confusing today. But i don't think generating custom `run_id` is necessarily the solution. It would be better if the

[GitHub] [airflow] github-actions[bot] commented on pull request #21731: Store callbacks in database if standalone_dag_processor config is True.

2022-03-01 Thread GitBox
github-actions[bot] commented on pull request #21731: URL: https://github.com/apache/airflow/pull/21731#issuecomment-1056346892 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #21731: Store callbacks in database if standalone_dag_processor config is True.

2022-03-01 Thread GitBox
ephraimbuddy commented on a change in pull request #21731: URL: https://github.com/apache/airflow/pull/21731#discussion_r817380674 ## File path: airflow/dag_processing/manager.py ## @@ -591,6 +594,27 @@ def _run_parsing_loop(self): else:

[GitHub] [airflow] github-actions[bot] commented on pull request #21915: Unpin ``pandas-gbq`` and remove unused code

2022-03-01 Thread GitBox
github-actions[bot] commented on pull request #21915: URL: https://github.com/apache/airflow/pull/21915#issuecomment-1056326977 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] sungpeo opened a new pull request #21926: py files doesn't have to be checked is_zipfiles in refresh_dag

2022-03-01 Thread GitBox
sungpeo opened a new pull request #21926: URL: https://github.com/apache/airflow/pull/21926 Also skip to check is_zipfile for py files in DAGs folder during refresh_dags. As refresh_dags try to access all files in DAGs folder, this helps use much less IO in the repetitive

[GitHub] [airflow] dstandish closed pull request #21917: Rename xcom.dagrun_id to xcom.dag_run_id

2022-03-01 Thread GitBox
dstandish closed pull request #21917: URL: https://github.com/apache/airflow/pull/21917 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #21924: Add `test_connection` method to `AzureDataFactoryHook`

2022-03-01 Thread GitBox
github-actions[bot] commented on pull request #21924: URL: https://github.com/apache/airflow/pull/21924#issuecomment-1056183292 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] josh-fell opened a new pull request #21924: Add `test_connection` method to `AzureDataFactoryHook`

2022-03-01 Thread GitBox
josh-fell opened a new pull request #21924: URL: https://github.com/apache/airflow/pull/21924 Related: #21110 Adding functionality to test an Azure Data Factory connection prior to DAG execution. >**Note**: This enhancement depends on release of #21330 (currently slated for

[GitHub] [airflow] easontm commented on issue #20992: Recorded pid<> does not match the current pid <>

2022-03-01 Thread GitBox
easontm commented on issue #20992: URL: https://github.com/apache/airflow/issues/20992#issuecomment-1056148016 Here's my datapoint. If there are other process logs that matter, please let me know. Airflow version: 2.2.3 Executor: CeleryKubernetes Deployment pattern: Other

[GitHub] [airflow] EricGao888 commented on a change in pull request #21785: Add oss_task_handler into alibaba-provider and enable remote logging to OSS

2022-03-01 Thread GitBox
EricGao888 commented on a change in pull request #21785: URL: https://github.com/apache/airflow/pull/21785#discussion_r817325120 ## File path: airflow/providers/alibaba/cloud/hooks/oss.py ## @@ -269,6 +279,74 @@ def create_bucket( self.log.error(e)

[GitHub] [airflow] EricGao888 commented on a change in pull request #21785: Add oss_task_handler into alibaba-provider and enable remote logging to OSS

2022-03-01 Thread GitBox
EricGao888 commented on a change in pull request #21785: URL: https://github.com/apache/airflow/pull/21785#discussion_r817324462 ## File path: tests/providers/alibaba/cloud/hooks/test_oss.py ## @@ -35,6 +35,7 @@ def setUp(self): try: self.hook =

[GitHub] [airflow] EricGao888 commented on a change in pull request #21785: Add oss_task_handler into alibaba-provider and enable remote logging to OSS

2022-03-01 Thread GitBox
EricGao888 commented on a change in pull request #21785: URL: https://github.com/apache/airflow/pull/21785#discussion_r817324387 ## File path: airflow/providers/alibaba/cloud/hooks/oss.py ## @@ -269,6 +279,74 @@ def create_bucket( self.log.error(e)

[GitHub] [airflow] KevinJiao opened a new issue #21923: Programmatic customization of run_id for scheduled DagRuns

2022-03-01 Thread GitBox
KevinJiao opened a new issue #21923: URL: https://github.com/apache/airflow/issues/21923 ### Description Allow DAG authors to control how `run_id`'s are generated for created DagRuns. Currently the only way to specify a DagRun's `run_id` is through the manual trigger workflow

[GitHub] [airflow] boring-cyborg[bot] commented on issue #21923: Programmatic customization of run_id for scheduled DagRuns

2022-03-01 Thread GitBox
boring-cyborg[bot] commented on issue #21923: URL: https://github.com/apache/airflow/issues/21923#issuecomment-1056057490 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow-client-go] senthilkumarkj commented on issue #18: Add LICENSE file to the repo

2022-03-01 Thread GitBox
senthilkumarkj commented on issue #18: URL: https://github.com/apache/airflow-client-go/issues/18#issuecomment-1056018580 I apologize, as this did not fix the [issue](https://pkg.go.dev/github.com/apache/airflow-client-go/airflow). 1) I apparently can not type LICENSE correctly

[GitHub] [airflow-client-go] senthilkumarkj opened a new pull request #19: Fix typo and add LICENSE to airflow folder as well

2022-03-01 Thread GitBox
senthilkumarkj opened a new pull request #19: URL: https://github.com/apache/airflow-client-go/pull/19 Previous commit failed to publish the documentation at https://pkg.go.dev/github.com/apache/airflow-client-go/airflow due to my typo in the filename. Sigh. Adding the license in

[airflow] 07/08: add tooltip info to details

2022-03-01 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git commit 2192c4a318bec4958599ac79a49744884edb0482 Author: Brent Bovenzi AuthorDate: Tue Mar 1 18:19:27 2022 -0500

[airflow] 08/08: use API

2022-03-01 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git commit 2f8e4446324ecc7ac40ef5427b4638ecc8ea1d36 Author: Brent Bovenzi AuthorDate: Tue Mar 1 19:44:16 2022 -0500

[airflow] 06/08: switch from drawer to details section

2022-03-01 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git commit 5cb4defb5ebbe395f7d912561c2ffdf337f5706a Author: Brent Bovenzi AuthorDate: Tue Mar 1 14:00:11 2022 -0500

[airflow] 04/08: improve rendering and add selected dag run

2022-03-01 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git commit eb961505bac36095c84bd6c2b99e9ce49e6f37bc Author: Brent Bovenzi AuthorDate: Mon Feb 28 12:24:27 2022

[airflow] 05/08: fix hover and extra prop

2022-03-01 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git commit ce953b379925f3fba3ab0f0053b434f943631451 Author: Brent Bovenzi AuthorDate: Mon Feb 28 21:01:53 2022

[airflow] 01/08: make UI and tree work with mapped tasks

2022-03-01 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git commit adfc609476992318a2068dd20ab62f1a0591b806 Author: Brent Bovenzi AuthorDate: Wed Feb 16 11:27:29 2022

[airflow] 03/08: reformat grid background colors

2022-03-01 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git commit ee869372889c0f2739c09b8d48ed0431d96fd3da Author: Brent Bovenzi AuthorDate: Fri Feb 25 11:58:23 2022

[airflow] 02/08: basic slide drawer

2022-03-01 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git commit 780d6a22ebf73f153d58240ba3247ebbf050c163 Author: Brent Bovenzi AuthorDate: Wed Feb 16 13:57:33 2022

[airflow] branch mapped-task-drawer updated (12b8f3e -> 2f8e444)

2022-03-01 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a change to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git. discard 12b8f3e add tooltip info to details discard 319499d switch from drawer to details section discard

[airflow] branch mapped-task-drawer updated: add tooltip info to details

2022-03-01 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/mapped-task-drawer by this push: new 12b8f3e add

[GitHub] [airflow] kaxil commented on a change in pull request #21912: Unpin `google-cloud-memcache`

2022-03-01 Thread GitBox
kaxil commented on a change in pull request #21912: URL: https://github.com/apache/airflow/pull/21912#discussion_r817249493 ## File path: airflow/providers/google/cloud/operators/cloud_memorystore.py ## @@ -1504,8 +1504,8 @@ class

[GitHub] [airflow] kaxil commented on pull request #21915: Unpin ``pandas-gbq`` and remove unused code

2022-03-01 Thread GitBox
kaxil commented on pull request #21915: URL: https://github.com/apache/airflow/pull/21915#issuecomment-1056003315 > Any backcompat concerns? We can bump the major for the provider easy enough, but not as straight forward with the contrib in core. Hardly think so, ancient code that

[GitHub] [airflow] kaxil commented on a change in pull request #21915: Unpin ``pandas-gbq`` and remove unused code

2022-03-01 Thread GitBox
kaxil commented on a change in pull request #21915: URL: https://github.com/apache/airflow/pull/21915#discussion_r817248655 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -24,8 +24,6 @@ BigQueryConnection, BigQueryCursor, BigQueryHook, -

[GitHub] [airflow] github-actions[bot] commented on pull request #21922: Fix single backticks in rst changelogs

2022-03-01 Thread GitBox
github-actions[bot] commented on pull request #21922: URL: https://github.com/apache/airflow/pull/21922#issuecomment-1056000692 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] jedcunningham closed pull request #21922: Fix single backticks in rst changelogs

2022-03-01 Thread GitBox
jedcunningham closed pull request #21922: URL: https://github.com/apache/airflow/pull/21922 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] jedcunningham commented on a change in pull request #21906: Chart: 1.5.0 changelog

2022-03-01 Thread GitBox
jedcunningham commented on a change in pull request #21906: URL: https://github.com/apache/airflow/pull/21906#discussion_r817218620 ## File path: chart/CHANGELOG.txt ## @@ -1,3 +1,36 @@ +Airflow Helm Chart 1.5.0, 2022-03-07 + + +New Features

[GitHub] [airflow] jedcunningham commented on a change in pull request #21915: Unpin ``pandas-gbq`` and remove unused code

2022-03-01 Thread GitBox
jedcunningham commented on a change in pull request #21915: URL: https://github.com/apache/airflow/pull/21915#discussion_r817214541 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -24,8 +24,6 @@ BigQueryConnection, BigQueryCursor, BigQueryHook, -

[GitHub] [airflow] jedcunningham commented on pull request #21915: Unpin ``pandas-gbq`` and remove unused code

2022-03-01 Thread GitBox
jedcunningham commented on pull request #21915: URL: https://github.com/apache/airflow/pull/21915#issuecomment-1055948338 Any backcompat concerns? We can bump the major for the provider easy enough, but not as straight forward with the contrib in core. -- This is an automated message

[airflow] branch main updated: Chart: move updating note about config removal (#21919)

2022-03-01 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 3052268 Chart: move updating note about

[GitHub] [airflow] jedcunningham merged pull request #21919: Chart: move updating note about config removal

2022-03-01 Thread GitBox
jedcunningham merged pull request #21919: URL: https://github.com/apache/airflow/pull/21919 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] jedcunningham commented on pull request #21919: Chart: move updating note about config removal

2022-03-01 Thread GitBox
jedcunningham commented on pull request #21919: URL: https://github.com/apache/airflow/pull/21919#issuecomment-1055944418 The failed k8s test appears like an unlucky 500 for bitnami, not related to this docs change. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] kaxil commented on pull request #21915: Unpin ``pandas-gbq`` and remove unused code

2022-03-01 Thread GitBox
kaxil commented on pull request #21915: URL: https://github.com/apache/airflow/pull/21915#issuecomment-1055938872 Single SQLite failure is unrelated -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] rafidka edited a comment on issue #13824: Cloudwatch Integration: SIGTERM/SIGKILL Sent Following DAG Completion, Causing Errors in Worker Logs

2022-03-01 Thread GitBox
rafidka edited a comment on issue #13824: URL: https://github.com/apache/airflow/issues/13824#issuecomment-1055908220 I just Airflow 2.2.4 and it is working fine for me. On Airflow 2.2.4: ``` [2022-03-01 14:05:19,784: INFO/ForkPoolWorker-16] Executing command in Celery:

[GitHub] [airflow] rafidka edited a comment on issue #13824: Cloudwatch Integration: SIGTERM/SIGKILL Sent Following DAG Completion, Causing Errors in Worker Logs

2022-03-01 Thread GitBox
rafidka edited a comment on issue #13824: URL: https://github.com/apache/airflow/issues/13824#issuecomment-1055926552 I just tried a sleep DAG (similar to yours) and it also succeeded on Airflow 2.2.4: ``` [2022-03-01 14:25:43,323: INFO/MainProcess] Task

[GitHub] [airflow] rafidka commented on issue #13824: Cloudwatch Integration: SIGTERM/SIGKILL Sent Following DAG Completion, Causing Errors in Worker Logs

2022-03-01 Thread GitBox
rafidka commented on issue #13824: URL: https://github.com/apache/airflow/issues/13824#issuecomment-1055926552 I just tried a sleep DAG (similar to yours) and it also succeeded on Airflow 2.2.4: ``` [2022-03-01 14:25:43,323: INFO/MainProcess] Task

[GitHub] [airflow] SamWheating edited a comment on issue #21918: TemplateNotFound error when trying to run the 'touch' command in the BashOperator

2022-03-01 Thread GitBox
SamWheating edited a comment on issue #21918: URL: https://github.com/apache/airflow/issues/21918#issuecomment-1055918128 This is because anything in the `bash_command` argument ending with `.sh` or `.bash` is treated as a file to be loaded and rendered with jinja:

[GitHub] [airflow] SamWheating commented on issue #21918: TemplateNotFound error when trying to run the 'touch' command in the BashOperator

2022-03-01 Thread GitBox
SamWheating commented on issue #21918: URL: https://github.com/apache/airflow/issues/21918#issuecomment-1055918128 This is because anything in the `bash_command` argument ending with `.sh` or `.bash` is treated as a file to be loaded and rendered as a template:

[airflow] branch main updated (7689969 -> 563ecfa)

2022-03-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 7689969 Refactor KubernetesPodOperator tests (#21911) add 563ecfa Add Python 3.9 support to Hive (#21893) No

[GitHub] [airflow] github-actions[bot] commented on pull request #21919: Chart: move updating note about config removal

2022-03-01 Thread GitBox
github-actions[bot] commented on pull request #21919: URL: https://github.com/apache/airflow/pull/21919#issuecomment-1055914663 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] andormarkus commented on issue #13824: Cloudwatch Integration: SIGTERM/SIGKILL Sent Following DAG Completion, Causing Errors in Worker Logs

2022-03-01 Thread GitBox
andormarkus commented on issue #13824: URL: https://github.com/apache/airflow/issues/13824#issuecomment-1055914397 Hi @rafidka, I’m running 5 ‘simple_dag.py’ parallel and I got one error every 5-10 minutes. I will deploy your dag tomorrow. Im running my code on

[GitHub] [airflow] ferruzzi opened a new pull request #21920: Dynamo to S3 Sample DAG and Docs

2022-03-01 Thread GitBox
ferruzzi opened a new pull request #21920: URL: https://github.com/apache/airflow/pull/21920 Adds a sample DAG and docs for the existing Dynamo to S3 Transfer operator. --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] potiuk commented on pull request #21893: Add Python 3.9 support to Hive

2022-03-01 Thread GitBox
potiuk commented on pull request #21893: URL: https://github.com/apache/airflow/pull/21893#issuecomment-1055912947 Just rundom "maybe ? " test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] potiuk closed issue #21891: hive provider support for python 3.9

2022-03-01 Thread GitBox
potiuk closed issue #21891: URL: https://github.com/apache/airflow/issues/21891 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk merged pull request #21893: Add Python 3.9 support to Hive

2022-03-01 Thread GitBox
potiuk merged pull request #21893: URL: https://github.com/apache/airflow/pull/21893 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] jedcunningham opened a new pull request #21919: Chart: move updating note about config removal

2022-03-01 Thread GitBox
jedcunningham opened a new pull request #21919: URL: https://github.com/apache/airflow/pull/21919 This was accidentally placed in the 1.4.0 section, which is already released. Move it to the 1.5.0 section where it should be. -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] rafidka commented on issue #13824: Cloudwatch Integration: SIGTERM/SIGKILL Sent Following DAG Completion, Causing Errors in Worker Logs

2022-03-01 Thread GitBox
rafidka commented on issue #13824: URL: https://github.com/apache/airflow/issues/13824#issuecomment-1055908220 I just Airflow 2.2.4 and it is working fine for me. On Airflow 2.2.4: ``` [2022-03-01 14:05:19,784: INFO/ForkPoolWorker-16] Executing command in Celery: ['airflow',

[GitHub] [airflow] github-actions[bot] commented on pull request #21906: Chart: 1.5.0 changelog

2022-03-01 Thread GitBox
github-actions[bot] commented on pull request #21906: URL: https://github.com/apache/airflow/pull/21906#issuecomment-1055904562 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] jedcunningham commented on a change in pull request #21906: Chart: 1.5.0 changelog

2022-03-01 Thread GitBox
jedcunningham commented on a change in pull request #21906: URL: https://github.com/apache/airflow/pull/21906#discussion_r817178494 ## File path: chart/Chart.yaml ## @@ -64,3 +64,87 @@ annotations: url:

[GitHub] [airflow] github-actions[bot] commented on pull request #21916: Add map_index label to mapped KubernetesPodOperator

2022-03-01 Thread GitBox
github-actions[bot] commented on pull request #21916: URL: https://github.com/apache/airflow/pull/21916#issuecomment-1055903320 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] dstandish commented on pull request #20546: Allow sensors to return XCom values using tuple

2022-03-01 Thread GitBox
dstandish commented on pull request #20546: URL: https://github.com/apache/airflow/pull/20546#issuecomment-1055902913 this pr taken over by @mingshi-wang in https://github.com/apache/airflow/pull/20656 -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] dstandish closed pull request #20546: Allow sensors to return XCom values using tuple

2022-03-01 Thread GitBox
dstandish closed pull request #20546: URL: https://github.com/apache/airflow/pull/20546 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] dstandish commented on pull request #20547: Allow sensors to return XCom values with PokeReturnValue

2022-03-01 Thread GitBox
dstandish commented on pull request #20547: URL: https://github.com/apache/airflow/pull/20547#issuecomment-1055902474 this pr taken over by @mingshi-wang in https://github.com/apache/airflow/pull/20656 -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] dstandish closed pull request #20547: Allow sensors to return XCom values with PokeReturnValue

2022-03-01 Thread GitBox
dstandish closed pull request #20547: URL: https://github.com/apache/airflow/pull/20547 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] rustikk opened a new issue #21918: TemplateNotFound error when trying to run the 'touch' command in the BashOperator

2022-03-01 Thread GitBox
rustikk opened a new issue #21918: URL: https://github.com/apache/airflow/issues/21918 ### Apache Airflow version 2.2.4 (latest released) ### What happened When trying to run the touch command in the bash operator with the template_searchpath dag parameter set to a

[GitHub] [airflow] github-actions[bot] commented on pull request #21879: Add docs re upgrade / downgrade

2022-03-01 Thread GitBox
github-actions[bot] commented on pull request #21879: URL: https://github.com/apache/airflow/pull/21879#issuecomment-1055900577 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] jedcunningham commented on a change in pull request #21879: Add docs re upgrade / downgrade

2022-03-01 Thread GitBox
jedcunningham commented on a change in pull request #21879: URL: https://github.com/apache/airflow/pull/21879#discussion_r817174784 ## File path: docs/apache-airflow/usage-cli.rst ## @@ -199,3 +199,64 @@ Both ``json`` and ``yaml`` formats make it easier to manipulate the data

[GitHub] [airflow] dstandish opened a new pull request #21917: Rename xcom.dagrun_id to xcom.dag_run_id

2022-03-01 Thread GitBox
dstandish opened a new pull request #21917: URL: https://github.com/apache/airflow/pull/21917 In the database layer, we use snake case. And unless there is some collision, we should refer to .id with f"{table}_id". -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] rafidka commented on issue #13824: Cloudwatch Integration: SIGTERM/SIGKILL Sent Following DAG Completion, Causing Errors in Worker Logs

2022-03-01 Thread GitBox
rafidka commented on issue #13824: URL: https://github.com/apache/airflow/issues/13824#issuecomment-1055898977 @andormarkus , what you are reporting above is exactly the symptoms I've seen when there is a problem with logging. Could you please do a `pip freeze` and check the reported

[GitHub] [airflow] ashb commented on pull request #21902: [FEATURE] remove K8S 1.20 support

2022-03-01 Thread GitBox
ashb commented on pull request #21902: URL: https://github.com/apache/airflow/pull/21902#issuecomment-1055897458 End of life from Kube project, but still supported in Amazon EKS https://docs.aws.amazon.com/eks/latest/userguide/kubernetes-versions.html and

[GitHub] [airflow] pingzh commented on pull request #21880: Minor cleanup on Celery config

2022-03-01 Thread GitBox
pingzh commented on pull request #21880: URL: https://github.com/apache/airflow/pull/21880#issuecomment-1055897000 @jedcunningham good catch. thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] ashb opened a new pull request #21916: Add map_index label to mapped KubernetesPodOperator

2022-03-01 Thread GitBox
ashb opened a new pull request #21916: URL: https://github.com/apache/airflow/pull/21916 This seems remarkable simple. Have I missed something? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] ashb commented on a change in pull request #21904: Pause auto-refresh when page is hidden

2022-03-01 Thread GitBox
ashb commented on a change in pull request #21904: URL: https://github.com/apache/airflow/pull/21904#discussion_r817162170 ## File path: airflow/www/static/js/utils.js ## @@ -41,3 +41,23 @@ export const finalStatesMap = () => new Map([ ['skipped', 0], ['no_status', 0],

[GitHub] [airflow] dstandish commented on a change in pull request #21273: Add test to run DB downgrade in the CI

2022-03-01 Thread GitBox
dstandish commented on a change in pull request #21273: URL: https://github.com/apache/airflow/pull/21273#discussion_r817111076 ## File path: airflow/migrations/utils.py ## @@ -0,0 +1,43 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] spatocode closed pull request #21914: Move the database configuration to a new section

2022-03-01 Thread GitBox
spatocode closed pull request #21914: URL: https://github.com/apache/airflow/pull/21914 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] kaxil opened a new pull request #21915: Unpin ``pandas-gbq`` and remove unused code

2022-03-01 Thread GitBox
kaxil opened a new pull request #21915: URL: https://github.com/apache/airflow/pull/21915 `BigQueryPandasConnector` was previously used by `BigqueryHook.get_pandas_df`. This was fixed in https://github.com/apache/airflow/commit/ad308ea441372f2b44b4292c3779eb745f2ed48c . However we forgot

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #21914: Move the database configuration to a new section

2022-03-01 Thread GitBox
boring-cyborg[bot] commented on pull request #21914: URL: https://github.com/apache/airflow/pull/21914#issuecomment-1055880531 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] spatocode opened a new pull request #21914: Move the database configuration to a new section

2022-03-01 Thread GitBox
spatocode opened a new pull request #21914: URL: https://github.com/apache/airflow/pull/21914 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] arezamoosavi commented on a change in pull request #21619: adding dataproc cluster start and stop operators

2022-03-01 Thread GitBox
arezamoosavi commented on a change in pull request #21619: URL: https://github.com/apache/airflow/pull/21619#discussion_r817154816 ## File path: airflow/providers/google/cloud/operators/dataproc.py ## @@ -698,7 +981,8 @@ class DataprocScaleClusterOperator(BaseOperator):

[GitHub] [airflow] arezamoosavi commented on a change in pull request #21619: adding dataproc cluster start and stop operators

2022-03-01 Thread GitBox
arezamoosavi commented on a change in pull request #21619: URL: https://github.com/apache/airflow/pull/21619#discussion_r817154309 ## File path: airflow/providers/google/cloud/operators/dataproc.py ## @@ -659,6 +680,268 @@ def execute(self, context: 'Context') -> dict:

[GitHub] [airflow] arezamoosavi commented on a change in pull request #21619: adding dataproc cluster start and stop operators

2022-03-01 Thread GitBox
arezamoosavi commented on a change in pull request #21619: URL: https://github.com/apache/airflow/pull/21619#discussion_r817154167 ## File path: airflow/providers/google/cloud/operators/dataproc.py ## @@ -659,6 +680,264 @@ def execute(self, context: 'Context') -> dict:

[GitHub] [airflow] arezamoosavi commented on a change in pull request #21619: adding dataproc cluster start and stop operators

2022-03-01 Thread GitBox
arezamoosavi commented on a change in pull request #21619: URL: https://github.com/apache/airflow/pull/21619#discussion_r817145878 ## File path: airflow/providers/google/cloud/operators/dataproc.py ## @@ -659,6 +680,264 @@ def execute(self, context: 'Context') -> dict:

[airflow] branch main updated (62bf127 -> 7689969)

2022-03-01 Thread ash
This is an automated email from the ASF dual-hosted git repository. ash pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 62bf127 Add-showing-runtime-error-feature-to-DatabricksSubmitRunOperator (#21709) add 7689969 Refactor

[GitHub] [airflow] ashb merged pull request #21911: Refactor KubernetesPodOperator tests

2022-03-01 Thread GitBox
ashb merged pull request #21911: URL: https://github.com/apache/airflow/pull/21911 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #21825: Add CI jobs and tooling to aid with tracking backtracking pip issues

2022-03-01 Thread GitBox
potiuk commented on pull request #21825: URL: https://github.com/apache/airflow/pull/21825#issuecomment-1055866334 Would love this one to be merged to catch potential problems early :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] github-actions[bot] commented on pull request #21912: Unpin `google-cloud-memcache`

2022-03-01 Thread GitBox
github-actions[bot] commented on pull request #21912: URL: https://github.com/apache/airflow/pull/21912#issuecomment-1055866030 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] arezamoosavi commented on a change in pull request #21619: adding dataproc cluster start and stop operators

2022-03-01 Thread GitBox
arezamoosavi commented on a change in pull request #21619: URL: https://github.com/apache/airflow/pull/21619#discussion_r817145878 ## File path: airflow/providers/google/cloud/operators/dataproc.py ## @@ -659,6 +680,264 @@ def execute(self, context: 'Context') -> dict:

[GitHub] [airflow] arezamoosavi commented on a change in pull request #21619: adding dataproc cluster start and stop operators

2022-03-01 Thread GitBox
arezamoosavi commented on a change in pull request #21619: URL: https://github.com/apache/airflow/pull/21619#discussion_r817145684 ## File path: airflow/providers/google/cloud/operators/dataproc.py ## @@ -659,6 +680,264 @@ def execute(self, context: 'Context') -> dict:

[GitHub] [airflow] arezamoosavi opened a new pull request #21913: adding dataproc cluster start and stop operators (after updating and rebase)

2022-03-01 Thread GitBox
arezamoosavi opened a new pull request #21913: URL: https://github.com/apache/airflow/pull/21913 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for

[GitHub] [airflow] potiuk closed pull request #21893: Add Python 3.9 support to Hive

2022-03-01 Thread GitBox
potiuk closed pull request #21893: URL: https://github.com/apache/airflow/pull/21893 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] tanelk edited a comment on issue #21892: Tasks are queued deterministically, deadlocking the scheduler when there are many dag-on-dag dependencies

2022-03-01 Thread GitBox
tanelk edited a comment on issue #21892: URL: https://github.com/apache/airflow/issues/21892#issuecomment-1055858365 Would using `mode='reschedule'` on the `ExternalTaskSensor`s solve it for you? You might want to increase the `poke_interval` then. -- This is an automated message from

[GitHub] [airflow] tanelk commented on issue #21892: Tasks are queued deterministically, deadlocking the scheduler when there are many dag-on-dag dependencies

2022-03-01 Thread GitBox
tanelk commented on issue #21892: URL: https://github.com/apache/airflow/issues/21892#issuecomment-1055858365 Would using `mode='reschedule'` on the `ExternalTaskSensor`s solve it for you? -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] kaxil opened a new pull request #21912: Unpin `google-cloud-memcache`

2022-03-01 Thread GitBox
kaxil opened a new pull request #21912: URL: https://github.com/apache/airflow/pull/21912 This was pinned in July 2021 - https://github.com/apache/airflow/pull/16975/files --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] edithturn commented on issue #20741: CI: Reuse Breeze CI image building for CI

2022-03-01 Thread GitBox
edithturn commented on issue #20741: URL: https://github.com/apache/airflow/issues/20741#issuecomment-1055854032 Thanks Jarek, It worked setting it as a string. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[airflow] branch main updated (1691968 -> 62bf127)

2022-03-01 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 1691968 Update list of non-core files/paths (#21907) add 62bf127

[GitHub] [airflow] potiuk merged pull request #21709: Add-showing-runtime-error-feature-to-DatabricksSubmitRunOperator

2022-03-01 Thread GitBox
potiuk merged pull request #21709: URL: https://github.com/apache/airflow/pull/21709 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #21709: Add-showing-runtime-error-feature-to-DatabricksSubmitRunOperator

2022-03-01 Thread GitBox
potiuk commented on pull request #21709: URL: https://github.com/apache/airflow/pull/21709#issuecomment-1055851377 Merged ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

  1   2   3   4   >