[GitHub] [airflow] uranusjr commented on pull request #20743: Serialize mapped tasks and task groups

2022-01-17 Thread GitBox
uranusjr commented on pull request #20743: URL: https://github.com/apache/airflow/pull/20743#issuecomment-1015152810 Seems to be working. If the latest two commits look good to you @ashb this is ready to go in. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] benbenbang edited a comment on issue #9713: Looping issue using Hashicorp Vault

2022-01-17 Thread GitBox
benbenbang edited a comment on issue #9713: URL: https://github.com/apache/airflow/issues/9713#issuecomment-1015142652 Hello @dstandish Sorry for the late reply. In 1.10x, if I remember correctly, I found that changing the backend would also change how airflow got a variable from

[GitHub] [airflow] benbenbang commented on issue #9713: Looping issue using Hashicorp Vault

2022-01-17 Thread GitBox
benbenbang commented on issue #9713: URL: https://github.com/apache/airflow/issues/9713#issuecomment-1015142652 Hello @dstandish Sorry for the late reply. In 1.10x, if I remember correctly, I found that changing the backend would also change how airflow got the meta store.

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #20900: Quelch deprecation warning in tests

2022-01-17 Thread GitBox
ephraimbuddy commented on a change in pull request #20900: URL: https://github.com/apache/airflow/pull/20900#discussion_r786476750 ## File path: airflow/api_connexion/schemas/dag_schema.py ## @@ -79,7 +79,7 @@ class DAGDetailSchema(DAGSchema): timezone = TimezoneField()

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #20900: Quelch deprecation warning in tests

2022-01-17 Thread GitBox
ephraimbuddy commented on a change in pull request #20900: URL: https://github.com/apache/airflow/pull/20900#discussion_r786475358 ## File path: airflow/api_connexion/endpoints/role_and_permission_endpoint.py ## @@ -147,7 +147,7 @@ def post_role() -> APIResponse: if not

[GitHub] [airflow] mashirali opened a new issue #20915: ./breeze not working for me

2022-01-17 Thread GitBox
mashirali opened a new issue #20915: URL: https://github.com/apache/airflow/issues/20915 ### Apache Airflow version 2.2.3 (latest released) ### What happened i have run the ./breeze setup-autocomplete then i ran source ~/.bash_completion.d/breeze-complete

[GitHub] [airflow] boring-cyborg[bot] commented on issue #20915: ./breeze not working for me

2022-01-17 Thread GitBox
boring-cyborg[bot] commented on issue #20915: URL: https://github.com/apache/airflow/issues/20915#issuecomment-1015134815 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] uranusjr commented on a change in pull request #20743: Serialize mapped tasks and task groups

2022-01-17 Thread GitBox
uranusjr commented on a change in pull request #20743: URL: https://github.com/apache/airflow/pull/20743#discussion_r786430565 ## File path: airflow/models/baseoperator.py ## @@ -207,6 +207,7 @@ def apply_defaults(self: "BaseOperator", *args: Any, **kwargs: Any) -> Any:

[GitHub] [airflow] github-actions[bot] commented on pull request #20881: Fix a test case inside tests/models that leaves a trace in the DB

2022-01-17 Thread GitBox
github-actions[bot] commented on pull request #20881: URL: https://github.com/apache/airflow/pull/20881#issuecomment-1015073007 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] uranusjr commented on a change in pull request #20881: Fix a test case inside tests/models that leaves a trace in the DB

2022-01-17 Thread GitBox
uranusjr commented on a change in pull request #20881: URL: https://github.com/apache/airflow/pull/20881#discussion_r786416813 ## File path: tests/models/test_dagbag.py ## @@ -44,19 +44,20 @@ from tests.test_utils import db from tests.test_utils.asserts import

[GitHub] [airflow] mik-laj commented on a change in pull request #20664: Switch to buildx to build airflow images

2022-01-17 Thread GitBox
mik-laj commented on a change in pull request #20664: URL: https://github.com/apache/airflow/pull/20664#discussion_r786415816 ## File path: scripts/ci/libraries/_build_images.sh ## @@ -800,6 +624,12 @@ function build_images::build_prod_images() { echo exit 1

[airflow] branch main updated: Uses CI images built in previous step to prepare PROD image (#20889)

2022-01-17 Thread uranusjr
This is an automated email from the ASF dual-hosted git repository. uranusjr pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new fce46e6 Uses CI images built in previous step

[GitHub] [airflow] uranusjr merged pull request #20889: Uses CI images built in previous step to prepare PROD image

2022-01-17 Thread GitBox
uranusjr merged pull request #20889: URL: https://github.com/apache/airflow/pull/20889 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated (7e29506 -> 66276e6)

2022-01-17 Thread uranusjr
This is an automated email from the ASF dual-hosted git repository. uranusjr pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 7e29506 Switch to new MySQL public key (#20912) add 66276e6 Switch map_index back to use server_default

[GitHub] [airflow] uranusjr merged pull request #20902: Switch map_index back to use server_default

2022-01-17 Thread GitBox
uranusjr merged pull request #20902: URL: https://github.com/apache/airflow/pull/20902 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] uranusjr closed issue #20876: Airflow database upgrade fails with "psycopg2.errors.NotNullViolation: column "map_index" of relation "task_instance" contains null value"s

2022-01-17 Thread GitBox
uranusjr closed issue #20876: URL: https://github.com/apache/airflow/issues/20876 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] uranusjr commented on a change in pull request #20902: Switch map_index back to use server_default

2022-01-17 Thread GitBox
uranusjr commented on a change in pull request #20902: URL: https://github.com/apache/airflow/pull/20902#discussion_r786414827 ## File path: airflow/models/taskinstance.py ## @@ -343,7 +344,7 @@ class TaskInstance(Base, LoggingMixin): task_id = Column(String(ID_LEN,

[GitHub] [airflow] boring-cyborg[bot] commented on issue #20914: Unable to access Airflow MWAA UI

2022-01-17 Thread GitBox
boring-cyborg[bot] commented on issue #20914: URL: https://github.com/apache/airflow/issues/20914#issuecomment-1015069052 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] amansehgal-ccx opened a new issue #20914: Unable to access Airflow MWAA UI

2022-01-17 Thread GitBox
amansehgal-ccx opened a new issue #20914: URL: https://github.com/apache/airflow/issues/20914 ### Apache Airflow version 2.0.2 ### What happened On updating the requirements.txt with jdbc(apache-airflow-providers-jdbc) driver, I restarted the airflow service. The

[GitHub] [airflow] uranusjr commented on a change in pull request #20910: Switch to non-vendored latest connexion library

2022-01-17 Thread GitBox
uranusjr commented on a change in pull request #20910: URL: https://github.com/apache/airflow/pull/20910#discussion_r786406375 ## File path: setup.cfg ## @@ -86,9 +85,8 @@ install_requires = blinker cached_property~=1.5;python_version<="3.7" cattrs~=1.1, !=1.7.*

[GitHub] [airflow] uranusjr commented on issue #16764: TaskGroup dependencies handled inconsistently

2022-01-17 Thread GitBox
uranusjr commented on issue #16764: URL: https://github.com/apache/airflow/issues/16764#issuecomment-1015058864 One way I can think of to get rid of all the complexity is to _prohibit_ the task group from being used before the context manager exits, i.e. ```python with

[GitHub] [airflow] mik-laj commented on a change in pull request #20910: Switch to non-vendored latest connexion library

2022-01-17 Thread GitBox
mik-laj commented on a change in pull request #20910: URL: https://github.com/apache/airflow/pull/20910#discussion_r786401696 ## File path: setup.cfg ## @@ -86,9 +86,8 @@ install_requires = blinker cached_property~=1.5;python_version<="3.7" cattrs~=1.1, !=1.7.*

[GitHub] [airflow] github-actions[bot] commented on pull request #20889: Uses CI images built in previous step to prepare PROD image

2022-01-17 Thread GitBox
github-actions[bot] commented on pull request #20889: URL: https://github.com/apache/airflow/pull/20889#issuecomment-1015051790 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] github-actions[bot] commented on pull request #20910: Switch to non-vendored latest connexion library

2022-01-17 Thread GitBox
github-actions[bot] commented on pull request #20910: URL: https://github.com/apache/airflow/pull/20910#issuecomment-1015049354 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] mik-laj commented on pull request #20910: Switch to non-vendored latest connexion library

2022-01-17 Thread GitBox
mik-laj commented on pull request #20910: URL: https://github.com/apache/airflow/pull/20910#issuecomment-1015049048 > Any other tests/expecrations for the connexion/API ? I think this part of the project has pretty good test coverage and we can rely on it. -- This is an automated

[GitHub] [airflow] mik-laj commented on a change in pull request #20910: Switch to non-vendored latest connexion library

2022-01-17 Thread GitBox
mik-laj commented on a change in pull request #20910: URL: https://github.com/apache/airflow/pull/20910#discussion_r786397877 ## File path: setup.cfg ## @@ -86,9 +85,8 @@ install_requires = blinker cached_property~=1.5;python_version<="3.7" cattrs~=1.1, !=1.7.*

[GitHub] [airflow] edithturn opened a new pull request #20913: [WIP] Rewrite testing examples of images in python

2022-01-17 Thread GitBox
edithturn opened a new pull request #20913: URL: https://github.com/apache/airflow/pull/20913 Rewrite testing examples of images in python * ci_test_examples_of_prod_image_building.py instead of ci_test_examples_of_prod_image_building.sh * Calling it the workflow ci.yml

[GitHub] [airflow] NadimYounes commented on issue #20911: Apt MySQL Client fails to install due to incorrect GPG Key

2022-01-17 Thread GitBox
NadimYounes commented on issue #20911: URL: https://github.com/apache/airflow/issues/20911#issuecomment-1015044192 @potiuk confirming that this now works on `2.0.2`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[airflow] branch main updated: Switch to new MySQL public key (#20912)

2022-01-17 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 7e29506 Switch to new MySQL public key

[GitHub] [airflow] github-actions[bot] commented on pull request #20912: Switch to new MySQL public key

2022-01-17 Thread GitBox
github-actions[bot] commented on pull request #20912: URL: https://github.com/apache/airflow/pull/20912#issuecomment-1015042665 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] mik-laj closed issue #20911: Apt MySQL Client fails to install due to incorrect GPG Key

2022-01-17 Thread GitBox
mik-laj closed issue #20911: URL: https://github.com/apache/airflow/issues/20911 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] mik-laj merged pull request #20912: Switch to new MySQL public key

2022-01-17 Thread GitBox
mik-laj merged pull request #20912: URL: https://github.com/apache/airflow/pull/20912 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] eduardchai commented on issue #18041: Tasks intermittently gets terminated with SIGTERM on kubernetes executor

2022-01-17 Thread GitBox
eduardchai commented on issue #18041: URL: https://github.com/apache/airflow/issues/18041#issuecomment-1015039319 @ephraimbuddy it does reduce the number of errors by a lot! Thank you! There are some errors where the jobs are stuck in `queued` state, but I think it should be solvable by

[GitHub] [airflow] edithturn commented on a change in pull request #20763: [WIP] Verify enough resources for breeze

2022-01-17 Thread GitBox
edithturn commented on a change in pull request #20763: URL: https://github.com/apache/airflow/pull/20763#discussion_r786384657 ## File path: scripts/in_container/run_resource_check.py ## @@ -0,0 +1,116 @@ +#!/usr/bin/env python + + +# Licensed to the Apache Software

[GitHub] [airflow] edithturn commented on a change in pull request #20763: [WIP] Verify enough resources for breeze

2022-01-17 Thread GitBox
edithturn commented on a change in pull request #20763: URL: https://github.com/apache/airflow/pull/20763#discussion_r786384657 ## File path: scripts/in_container/run_resource_check.py ## @@ -0,0 +1,116 @@ +#!/usr/bin/env python + + +# Licensed to the Apache Software

[GitHub] [airflow] edithturn commented on a change in pull request #20763: [WIP] Verify enough resources for breeze

2022-01-17 Thread GitBox
edithturn commented on a change in pull request #20763: URL: https://github.com/apache/airflow/pull/20763#discussion_r786384657 ## File path: scripts/in_container/run_resource_check.py ## @@ -0,0 +1,116 @@ +#!/usr/bin/env python + + +# Licensed to the Apache Software

[GitHub] [airflow] NadimYounes commented on issue #20911: Apt MySQL Client fails to install due to incorrect GPG Key

2022-01-17 Thread GitBox
NadimYounes commented on issue #20911: URL: https://github.com/apache/airflow/issues/20911#issuecomment-1015000693 @potiuk Sure. I will check in a couple hours and let you know. Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] potiuk commented on issue #20911: Apt MySQL Client fails to install due to incorrect GPG Key

2022-01-17 Thread GitBox
potiuk commented on issue #20911: URL: https://github.com/apache/airflow/issues/20911#issuecomment-1014998226 Most of the images 2.1.1+ are refreshed now (I will refresh even older images - down to 2.0.0). Can you please @NadimYounes verify that your image works after refresh (I see that

[GitHub] [airflow] potiuk edited a comment on pull request #20912: Switch to new MySQL public key

2022-01-17 Thread GitBox
potiuk edited a comment on pull request #20912: URL: https://github.com/apache/airflow/pull/20912#issuecomment-1014995400 If any committer approves it - please merge it. This is needed to stop PRs/main builds from failing -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] potiuk commented on pull request #20912: Switch to new MySQL public key

2022-01-17 Thread GitBox
potiuk commented on pull request #20912: URL: https://github.com/apache/airflow/pull/20912#issuecomment-1014995400 If ny committer approves it - please merge it. This is needed to stop PRs/main builds from failing -- This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] potiuk commented on a change in pull request #20763: [WIP] Verify enough resources for breeze

2022-01-17 Thread GitBox
potiuk commented on a change in pull request #20763: URL: https://github.com/apache/airflow/pull/20763#discussion_r786340660 ## File path: scripts/in_container/run_resource_check.py ## @@ -0,0 +1,116 @@ +#!/usr/bin/env python + + +# Licensed to the Apache Software Foundation

[GitHub] [airflow] potiuk commented on a change in pull request #20763: [WIP] Verify enough resources for breeze

2022-01-17 Thread GitBox
potiuk commented on a change in pull request #20763: URL: https://github.com/apache/airflow/pull/20763#discussion_r786340660 ## File path: scripts/in_container/run_resource_check.py ## @@ -0,0 +1,116 @@ +#!/usr/bin/env python + + +# Licensed to the Apache Software Foundation

[GitHub] [airflow] potiuk commented on a change in pull request #20763: [WIP] Verify enough resources for breeze

2022-01-17 Thread GitBox
potiuk commented on a change in pull request #20763: URL: https://github.com/apache/airflow/pull/20763#discussion_r786340660 ## File path: scripts/in_container/run_resource_check.py ## @@ -0,0 +1,116 @@ +#!/usr/bin/env python + + +# Licensed to the Apache Software Foundation

[GitHub] [airflow] github-actions[bot] commented on pull request #20005: Addition of FilePatternSFTPSensor Feature

2022-01-17 Thread GitBox
github-actions[bot] commented on pull request #20005: URL: https://github.com/apache/airflow/pull/20005#issuecomment-1014965109 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank

[GitHub] [airflow] edithturn commented on a change in pull request #20763: [WIP] Verify enough resources for breeze

2022-01-17 Thread GitBox
edithturn commented on a change in pull request #20763: URL: https://github.com/apache/airflow/pull/20763#discussion_r786334446 ## File path: scripts/in_container/run_resource_check.py ## @@ -0,0 +1,116 @@ +#!/usr/bin/env python + + +# Licensed to the Apache Software

[GitHub] [airflow] edithturn commented on a change in pull request #20763: [WIP] Verify enough resources for breeze

2022-01-17 Thread GitBox
edithturn commented on a change in pull request #20763: URL: https://github.com/apache/airflow/pull/20763#discussion_r786334200 ## File path: dev/breeze/doc/BREEZE.md ## @@ -0,0 +1,108 @@

[GitHub] [airflow] potiuk edited a comment on pull request #20912: Switch to new MySQL public key

2022-01-17 Thread GitBox
potiuk edited a comment on pull request #20912: URL: https://github.com/apache/airflow/pull/20912#issuecomment-1014946516 Note. I will also need to (doing it now) rebuild past released docker images to allow people to extend those (apt-get update fails without the key) (only 2.* images as

[GitHub] [airflow] alex-astronomer commented on issue #17686: Xcomms with Taskflow API cause unwanted dependencies in UI

2022-01-17 Thread GitBox
alex-astronomer commented on issue #17686: URL: https://github.com/apache/airflow/issues/17686#issuecomment-1014955770 Yes I am, should have more time this coming week to get in a PR. Thanks for your patience. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] potiuk commented on pull request #20912: Switch to new MySQL public key

2022-01-17 Thread GitBox
potiuk commented on pull request #20912: URL: https://github.com/apache/airflow/pull/20912#issuecomment-1014955521 > Will the DockerHub images be updated with this fix? I'm having issues with `dockerhub.docker.artifactory.viasat.com/apache/airflow:1.10.15-python3.6` due to the key change.

[GitHub] [airflow] potiuk edited a comment on pull request #20912: Switch to new MySQL public key

2022-01-17 Thread GitBox
potiuk edited a comment on pull request #20912: URL: https://github.com/apache/airflow/pull/20912#issuecomment-1014955521 > Will the DockerHub images be updated with this fix? I'm having issues with `dockerhub.docker.artifactory.viasat.com/apache/airflow:1.10.15-python3.6` due to the key

[GitHub] [airflow] potiuk closed pull request #20912: Switch to new MySQL public key

2022-01-17 Thread GitBox
potiuk closed pull request #20912: URL: https://github.com/apache/airflow/pull/20912 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] mhbrown removed a comment on pull request #20912: Switch to new MySQL public key

2022-01-17 Thread GitBox
mhbrown removed a comment on pull request #20912: URL: https://github.com/apache/airflow/pull/20912#issuecomment-1014953406 Will the DockerHub images be updated with this fix? I'm having issues with `dockerhub.docker.artifactory.viasat.com/apache/airflow:1.10.15-python3.6` due to the key

[GitHub] [airflow] mhbrown commented on pull request #20912: Switch to new MySQL public key

2022-01-17 Thread GitBox
mhbrown commented on pull request #20912: URL: https://github.com/apache/airflow/pull/20912#issuecomment-1014953406 Will the DockerHub images be updated with this fix? I'm having issues with `dockerhub.docker.artifactory.viasat.com/apache/airflow:1.10.15-python3.6` due to the key change.

[GitHub] [airflow] potiuk commented on pull request #20912: Switch to new MySQL public key

2022-01-17 Thread GitBox
potiuk commented on pull request #20912: URL: https://github.com/apache/airflow/pull/20912#issuecomment-1014946516 Note. I will also need to (doing it now) rebuild past released docker images to allow people to extend those (apt-get update fails without the key). -- This is an automated

[GitHub] [airflow] potiuk commented on issue #20911: Apt MySQL Client fails to install due to incorrect GPG Key

2022-01-17 Thread GitBox
potiuk commented on issue #20911: URL: https://github.com/apache/airflow/issues/20911#issuecomment-1014940304 I am **just** refreshing all the images down to 2.1.0. We have a "reproducible" Docker prod imge preparation system that allows us to do this. -- This is an automated message

[GitHub] [airflow] alex-astronomer edited a comment on issue #16764: TaskGroup dependencies handled inconsistently

2022-01-17 Thread GitBox
alex-astronomer edited a comment on issue #16764: URL: https://github.com/apache/airflow/issues/16764#issuecomment-1014936179 Did some more research and it leads me to believe that if we consider the TaskGroup to be a "dependable" in the same way that we consider tasks able to depend

[GitHub] [airflow] NadimYounes commented on issue #20911: Apt MySQL Client fails to install due to incorrect GPG Key

2022-01-17 Thread GitBox
NadimYounes commented on issue #20911: URL: https://github.com/apache/airflow/issues/20911#issuecomment-1014938011 @potiuk Will this fix be applied to all Airflow `2*` or will it only go into the latest? -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] alex-astronomer edited a comment on issue #16764: TaskGroup dependencies handled inconsistently

2022-01-17 Thread GitBox
alex-astronomer edited a comment on issue #16764: URL: https://github.com/apache/airflow/issues/16764#issuecomment-1014936179 Did some more research and it leads me to believe that if we consider the TaskGroup to be a "dependable" in the same way that we consider tasks able to depend

[GitHub] [airflow] alex-astronomer edited a comment on issue #16764: TaskGroup dependencies handled inconsistently

2022-01-17 Thread GitBox
alex-astronomer edited a comment on issue #16764: URL: https://github.com/apache/airflow/issues/16764#issuecomment-1014936179 Did some more research and it leads me to believe that if we consider the TaskGroup to be a "dependable" in the same way that we consider tasks able to depend

[GitHub] [airflow] alex-astronomer commented on issue #16764: TaskGroup dependencies handled inconsistently

2022-01-17 Thread GitBox
alex-astronomer commented on issue #16764: URL: https://github.com/apache/airflow/issues/16764#issuecomment-1014936179 Did some more research and it leads me to believe that if we consider the TaskGroup to be a "dependable" in the same way that we consider tasks able to depend on each

[GitHub] [airflow] potiuk opened a new pull request #20912: Switch to new MySQL public key

2022-01-17 Thread GitBox
potiuk opened a new pull request #20912: URL: https://github.com/apache/airflow/pull/20912 MySQL changed key used to sign their apt packages. This caused docker building failing for prod images as MySQL could not be installed. New Public Key is used instead. Fixes:

[GitHub] [airflow] potiuk commented on issue #20911: Apt MySQL Client fails to install due to incorrect GPG Key

2022-01-17 Thread GitBox
potiuk commented on issue #20911: URL: https://github.com/apache/airflow/issues/20911#issuecomment-1014934691 Yep. OUR CI builds started to fail this morning too. Switching to the new mysql public key now. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] edithturn edited a comment on issue #20254: CI: Rewrite testing examples of images in python

2022-01-17 Thread GitBox
edithturn edited a comment on issue #20254: URL: https://github.com/apache/airflow/issues/20254#issuecomment-1012299835 @potiuk I am analyzing this one. When you said: "**docker_tests.py**" do you mean: "**ci_run_docker_tests.py**" . If it is, this script is in:

[GitHub] [airflow] edithturn commented on pull request #20763: [WIP] Verify enough resources for breeze

2022-01-17 Thread GitBox
edithturn commented on pull request #20763: URL: https://github.com/apache/airflow/pull/20763#issuecomment-1014932713 @potiuk I fixed. Now "This branch is 3 commits ahead of apache:main." Thank you for your patience Jarek. -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] potiuk commented on pull request #20889: Uses CI images built in previouse step to prepare PROD image

2022-01-17 Thread GitBox
potiuk commented on pull request #20889: URL: https://github.com/apache/airflow/pull/20889#issuecomment-1014931285 @ashb @uranusjr @ephraimbuddy @mik-laj - this one needs to be merged to fix PROD build in #20910 -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] potiuk commented on pull request #20910: Switch to non-vendored latest connexion library

2022-01-17 Thread GitBox
potiuk commented on pull request #20910: URL: https://github.com/apache/airflow/pull/20910#issuecomment-1014930849 BTW the prod image failure is actually due to this one https://github.com/apache/airflow/pull/20889 - once this is merged, prod image should correctly use CI image with

[GitHub] [airflow] cdabella commented on issue #19313: JdbcOperator should pass handler parameter to JdbcHook.run

2022-01-17 Thread GitBox
cdabella commented on issue #19313: URL: https://github.com/apache/airflow/issues/19313#issuecomment-1014930590 Bit of life got in the way and I have not implemented the fix. Please feel free @nkyuray -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] nkyuray commented on issue #19313: JdbcOperator should pass handler parameter to JdbcHook.run

2022-01-17 Thread GitBox
nkyuray commented on issue #19313: URL: https://github.com/apache/airflow/issues/19313#issuecomment-1014929673 Hi @eladkal, If @cdabella will not take this, I would like to give a try. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] NadimYounes opened a new issue #20911: Apt MySQL Client fails to install due to incorrect GPG Key

2022-01-17 Thread GitBox
NadimYounes opened a new issue #20911: URL: https://github.com/apache/airflow/issues/20911 ### Apache Airflow version 2.0.2 ### What happened When attempting to rebuild an apache airflow image, we are getting failures during our builds when trying to run `apt-get

[GitHub] [airflow] eladkal commented on issue #19511: With large number of DAGS, dag_run state takes long time to update after last task

2022-01-17 Thread GitBox
eladkal commented on issue #19511: URL: https://github.com/apache/airflow/issues/19511#issuecomment-1014924181 @ShakaibKhan any findings you can share? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [airflow] eladkal commented on issue #19578: Custom timetable causes crash using airflow test

2022-01-17 Thread GitBox
eladkal commented on issue #19578: URL: https://github.com/apache/airflow/issues/19578#issuecomment-1014923279 fixed in https://github.com/apache/airflow/pull/19735 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] eladkal closed issue #19578: Custom timetable causes crash using airflow test

2022-01-17 Thread GitBox
eladkal closed issue #19578: URL: https://github.com/apache/airflow/issues/19578 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #20910: Switch to non-vendored latest connexion library

2022-01-17 Thread GitBox
potiuk commented on pull request #20910: URL: https://github.com/apache/airflow/pull/20910#issuecomment-1014923145 Right. Looks like the tests are all green when I replace vendored-in connexion with the latest version from PyPI (the failure was caused by temporary problem with GPG key

[GitHub] [airflow] potiuk commented on a change in pull request #20910: Switch to non-vendored latest connexion library

2022-01-17 Thread GitBox
potiuk commented on a change in pull request #20910: URL: https://github.com/apache/airflow/pull/20910#discussion_r786312723 ## File path: setup.cfg ## @@ -86,9 +85,8 @@ install_requires = blinker cached_property~=1.5;python_version<="3.7" cattrs~=1.1, !=1.7.* -

[GitHub] [airflow] eladkal commented on issue #17686: Xcomms with Taskflow API cause unwanted dependencies in UI

2022-01-17 Thread GitBox
eladkal commented on issue #17686: URL: https://github.com/apache/airflow/issues/17686#issuecomment-1014920662 @alex-astronomer are you still working on this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] potiuk closed pull request #20910: Switch to non-vendored latest connexion library

2022-01-17 Thread GitBox
potiuk closed pull request #20910: URL: https://github.com/apache/airflow/pull/20910 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ashb commented on a change in pull request #20910: Switch to non-vendored latest connexion library

2022-01-17 Thread GitBox
ashb commented on a change in pull request #20910: URL: https://github.com/apache/airflow/pull/20910#discussion_r786308856 ## File path: setup.cfg ## @@ -86,9 +85,8 @@ install_requires = blinker cached_property~=1.5;python_version<="3.7" cattrs~=1.1, !=1.7.* -

[GitHub] [airflow] alex-astronomer commented on issue #16764: TaskGroup dependencies handled inconsistently

2022-01-17 Thread GitBox
alex-astronomer commented on issue #16764: URL: https://github.com/apache/airflow/issues/16764#issuecomment-1014913471 I think in order to really tackle this one, there are two issues here that need to be addressed. 1. Just like the ticket mentions, we do expect that the TaskGroup

[GitHub] [airflow] potiuk commented on a change in pull request #20910: Switch to non-vendored latest connexion library

2022-01-17 Thread GitBox
potiuk commented on a change in pull request #20910: URL: https://github.com/apache/airflow/pull/20910#discussion_r786253180 ## File path: setup.cfg ## @@ -86,9 +86,8 @@ install_requires = blinker cached_property~=1.5;python_version<="3.7" cattrs~=1.1, !=1.7.* -

[GitHub] [airflow] potiuk commented on pull request #20891: Add limit to openapi-schema-validator

2022-01-17 Thread GitBox
potiuk commented on pull request #20891: URL: https://github.com/apache/airflow/pull/20891#issuecomment-1014833871 Let's see - I created #20910 to see if the tests will pass. @uranusjr @mik-laj @ephraimbuddy -> let's see if connexion tests will pass out-of-the-box, if so maybe you can

[GitHub] [airflow] potiuk opened a new pull request #20910: Switch to non-vendored latest connexion library

2022-01-17 Thread GitBox
potiuk opened a new pull request #20910: URL: https://github.com/apache/airflow/pull/20910 The `connexion` library has been vendored in because of requests library that used to have non-optional chardet LGPL dependency, however requests library had since released a version (which we

[GitHub] [airflow] potiuk edited a comment on issue #20901: Bytes cast to String in `airflow.providers.google.cloud.transfers.gcs_to_local.GCSToLocalFilesystemOperator` ~142

2022-01-17 Thread GitBox
potiuk edited a comment on issue #20901: URL: https://github.com/apache/airflow/issues/20901#issuecomment-1014819190 Ah. I see - this actually converts the value of the bytes to "nice string" representation: https://docs.python.org/3/library/stdtypes.html#boolean-operations-and-or-not

[GitHub] [airflow] potiuk commented on issue #20901: Bytes cast to String in `airflow.providers.google.cloud.transfers.gcs_to_local.GCSToLocalFilesystemOperator` ~142

2022-01-17 Thread GitBox
potiuk commented on issue #20901: URL: https://github.com/apache/airflow/issues/20901#issuecomment-1014819190 Ah. I see - this actually converts the value of the bytes to nice "string" representation: https://docs.python.org/3/library/stdtypes.html#boolean-operations-and-or-not >

[GitHub] [airflow] ITJamie opened a new issue #20909: gui feature request - Bump task priority_weight option

2022-01-17 Thread GitBox
ITJamie opened a new issue #20909: URL: https://github.com/apache/airflow/issues/20909 ### Description Being able to "bump up" the priority_weight of a queued task would be useful from the gui. ### Use case/motivation Sometimes a team may be waiting on a queued task.

[GitHub] [airflow] potiuk commented on issue #20906: scheduler logging bug in shouldRollover - "due to non-posix-compliant windows feature"

2022-01-17 Thread GitBox
potiuk commented on issue #20906: URL: https://github.com/apache/airflow/issues/20906#issuecomment-1014808635 > This is running 100% on linux though... The container is running on a linux machine and all volume mounts are on linux hosts... That was my guess - ther are similar to

[GitHub] [airflow] o-nikolas commented on a change in pull request #20858: Move some base_aws logging from info to debug level

2022-01-17 Thread GitBox
o-nikolas commented on a change in pull request #20858: URL: https://github.com/apache/airflow/pull/20858#discussion_r786231758 ## File path: airflow/providers/amazon/aws/hooks/base_aws.py ## @@ -199,8 +199,6 @@ def _read_credentials_from_connection(self) ->

[GitHub] [airflow] kaxil removed a comment on pull request #20838: Add `maintenance cleanup` CLI command for purging old data

2022-01-17 Thread GitBox
kaxil removed a comment on pull request #20838: URL: https://github.com/apache/airflow/pull/20838#issuecomment-1012518905 > We **just** had discussion that we need it yesterday with @mik-laj and @mhenc :) We have got more stuffed planned to make Airflow Upgrades more reliable -

[GitHub] [airflow] ashb commented on a change in pull request #20743: Serialize mapped tasks and task groups

2022-01-17 Thread GitBox
ashb commented on a change in pull request #20743: URL: https://github.com/apache/airflow/pull/20743#discussion_r786222539 ## File path: airflow/models/baseoperator.py ## @@ -1706,25 +1701,49 @@ def _validate_kwarg_names_for_mapping(cls: Type[BaseOperator], func_name: str, v

[GitHub] [airflow] github-actions[bot] commented on pull request #20743: Serialize mapped tasks and task groups

2022-01-17 Thread GitBox
github-actions[bot] commented on pull request #20743: URL: https://github.com/apache/airflow/pull/20743#issuecomment-1014769681 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] uranusjr commented on a change in pull request #20743: Serialize mapped tasks and task groups

2022-01-17 Thread GitBox
uranusjr commented on a change in pull request #20743: URL: https://github.com/apache/airflow/pull/20743#discussion_r786204849 ## File path: airflow/models/baseoperator.py ## @@ -1706,25 +1701,49 @@ def _validate_kwarg_names_for_mapping(cls: Type[BaseOperator], func_name:

[GitHub] [airflow] uranusjr commented on a change in pull request #20743: Serialize mapped tasks and task groups

2022-01-17 Thread GitBox
uranusjr commented on a change in pull request #20743: URL: https://github.com/apache/airflow/pull/20743#discussion_r786202050 ## File path: airflow/models/baseoperator.py ## @@ -136,6 +136,7 @@ def _apply_defaults(cls, func: T) -> T: non_optional_args = {

[GitHub] [airflow] uranusjr commented on a change in pull request #20743: Serialize mapped tasks and task groups

2022-01-17 Thread GitBox
uranusjr commented on a change in pull request #20743: URL: https://github.com/apache/airflow/pull/20743#discussion_r786202050 ## File path: airflow/models/baseoperator.py ## @@ -136,6 +136,7 @@ def _apply_defaults(cls, func: T) -> T: non_optional_args = {

[GitHub] [airflow] ashb commented on a change in pull request #20743: Serialize mapped tasks and task groups

2022-01-17 Thread GitBox
ashb commented on a change in pull request #20743: URL: https://github.com/apache/airflow/pull/20743#discussion_r786200271 ## File path: airflow/serialization/serialized_objects.py ## @@ -653,10 +677,14 @@ def deserialize_operator(cls, encoded_op: Dict[str, Any]) ->

[GitHub] [airflow] ashb commented on a change in pull request #20743: Serialize mapped tasks and task groups

2022-01-17 Thread GitBox
ashb commented on a change in pull request #20743: URL: https://github.com/apache/airflow/pull/20743#discussion_r786199495 ## File path: airflow/serialization/serialized_objects.py ## @@ -658,7 +694,9 @@ def deserialize_operator(cls, encoded_op: Dict[str, Any]) ->

[GitHub] [airflow] ashb commented on a change in pull request #20743: Serialize mapped tasks and task groups

2022-01-17 Thread GitBox
ashb commented on a change in pull request #20743: URL: https://github.com/apache/airflow/pull/20743#discussion_r786197515 ## File path: airflow/serialization/serialized_objects.py ## @@ -658,7 +694,8 @@ def deserialize_operator(cls, encoded_op: Dict[str, Any]) ->

[GitHub] [airflow] ashb commented on a change in pull request #20743: Serialize mapped tasks and task groups

2022-01-17 Thread GitBox
ashb commented on a change in pull request #20743: URL: https://github.com/apache/airflow/pull/20743#discussion_r786197515 ## File path: airflow/serialization/serialized_objects.py ## @@ -658,7 +694,8 @@ def deserialize_operator(cls, encoded_op: Dict[str, Any]) ->

[GitHub] [airflow] ashb commented on a change in pull request #20743: Serialize mapped tasks and task groups

2022-01-17 Thread GitBox
ashb commented on a change in pull request #20743: URL: https://github.com/apache/airflow/pull/20743#discussion_r786183131 ## File path: airflow/models/baseoperator.py ## @@ -207,6 +207,7 @@ def apply_defaults(self: "BaseOperator", *args: Any, **kwargs: Any) -> Any:

[GitHub] [airflow] alexandrebunn commented on issue #10605: Use private docker repository with K8S operator and XCOM sidecar container

2022-01-17 Thread GitBox
alexandrebunn commented on issue #10605: URL: https://github.com/apache/airflow/issues/10605#issuecomment-1014746127 We are facing the same issue, but in our case the error is related the absent of an option to define resources to the sidecar container. Our kubernetes cluster has this

[GitHub] [airflow] uranusjr commented on a change in pull request #20743: Serialize mapped tasks and task groups

2022-01-17 Thread GitBox
uranusjr commented on a change in pull request #20743: URL: https://github.com/apache/airflow/pull/20743#discussion_r786181173 ## File path: airflow/serialization/serialized_objects.py ## @@ -653,10 +677,14 @@ def deserialize_operator(cls, encoded_op: Dict[str, Any]) ->

[GitHub] [airflow] demetthyl opened a new pull request #20609: AIRFLOW-20533: add airflow.cfg as volumeMounts on initContainer wait-…

2022-01-17 Thread GitBox
demetthyl opened a new pull request #20609: URL: https://github.com/apache/airflow/pull/20609 …for-airflow-migrations This allows the init containers to work with secretbackend externalized sql alchemy urls for instance. --- **^ Add meaningful description above**

  1   2   3   >