[GitHub] [airflow] khalidmammadov closed pull request #20694: Code improvement to configuration file load process

2022-02-25 Thread GitBox
khalidmammadov closed pull request #20694: URL: https://github.com/apache/airflow/pull/20694 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commi

[GitHub] [airflow] dstandish commented on pull request #21806: Rename `dagrun_id` to `dag_run_id`

2022-02-25 Thread GitBox
dstandish commented on pull request #21806: URL: https://github.com/apache/airflow/pull/21806#issuecomment-1051703737 side note, question for @uranusjr : this bit here: https://github.com/apache/airflow/pull/21806/files/f3aaa031be561d3e6671dbd734bb427fe283ddf8#diff-3f95f161bd9ef4bb455611

[airflow] branch constraints-main updated: Updating constraints. Build id:1902236460

2022-02-25 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 43bd248 Updating const

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #21829: Raise import error if a task uses a non-existent pool

2022-02-25 Thread GitBox
ephraimbuddy commented on a change in pull request #21829: URL: https://github.com/apache/airflow/pull/21829#discussion_r815274573 ## File path: airflow/models/dag.py ## @@ -2625,6 +2625,18 @@ def validate_schedule_and_params(self): "DAG Schedule must be No

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #21829: Raise import error if a task uses a non-existent pool

2022-02-25 Thread GitBox
ephraimbuddy commented on a change in pull request #21829: URL: https://github.com/apache/airflow/pull/21829#discussion_r815274377 ## File path: tests/dags/test_non_existing_pool.py ## @@ -0,0 +1,30 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[airflow] branch main updated: Add `db clean` CLI command for purging old data (#20838)

2022-02-25 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new c75774d Add `db clean` CLI command for purging

[GitHub] [airflow] dstandish merged pull request #20838: Add `db clean` CLI command for purging old data

2022-02-25 Thread GitBox
dstandish merged pull request #20838: URL: https://github.com/apache/airflow/pull/20838 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-un

[GitHub] [airflow] dstandish edited a comment on pull request #21596: Airflow `db downgrade` cli command

2022-02-25 Thread GitBox
dstandish edited a comment on pull request #21596: URL: https://github.com/apache/airflow/pull/21596#issuecomment-1049605769 > Looks good in general, is this ready for review? yes -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] dstandish commented on a change in pull request #21806: Rename `dagrun_id` to `dag_run_id`

2022-02-25 Thread GitBox
dstandish commented on a change in pull request #21806: URL: https://github.com/apache/airflow/pull/21806#discussion_r815261308 ## File path: airflow/migrations/versions/c306b5b5ae4a_switch_xcom_table_to_use_run_id.py ## @@ -41,7 +41,7 @@ def _get_new_xcom_columns() -> Sequ

[GitHub] [airflow] dstandish commented on a change in pull request #21806: Rename `dagrun_id` to `dag_run_id`

2022-02-25 Thread GitBox
dstandish commented on a change in pull request #21806: URL: https://github.com/apache/airflow/pull/21806#discussion_r815261308 ## File path: airflow/migrations/versions/c306b5b5ae4a_switch_xcom_table_to_use_run_id.py ## @@ -41,7 +41,7 @@ def _get_new_xcom_columns() -> Sequ

[GitHub] [airflow] dstandish commented on a change in pull request #21806: Rename `dagrun_id` to `dag_run_id`

2022-02-25 Thread GitBox
dstandish commented on a change in pull request #21806: URL: https://github.com/apache/airflow/pull/21806#discussion_r815261308 ## File path: airflow/migrations/versions/c306b5b5ae4a_switch_xcom_table_to_use_run_id.py ## @@ -41,7 +41,7 @@ def _get_new_xcom_columns() -> Sequ

[GitHub] [airflow] schirag1993 commented on pull request #21686: Feature: Add invoke lambda function operator

2022-02-25 Thread GitBox
schirag1993 commented on pull request #21686: URL: https://github.com/apache/airflow/pull/21686#issuecomment-1051521174 > Sorry, I submitted those as single comments. Wish I could retroactively roll them into a review to reduce clutter. It's no trouble at all, thank you for the revie

[GitHub] [airflow] schirag1993 commented on a change in pull request #21686: Feature: Add invoke lambda function operator

2022-02-25 Thread GitBox
schirag1993 commented on a change in pull request #21686: URL: https://github.com/apache/airflow/pull/21686#discussion_r815257438 ## File path: docs/apache-airflow-providers-amazon/operators/lambda.rst ## @@ -0,0 +1,54 @@ + .. Licensed to the Apache Software Foundation (ASF) un

[GitHub] [airflow] SamWheating commented on issue #20788: AIrflow Scheduler does not schedule any tasks when >max running tasks queued with non-existant pool

2022-02-25 Thread GitBox
SamWheating commented on issue #20788: URL: https://github.com/apache/airflow/issues/20788#issuecomment-1051449145 Your PR looks good! I think that https://github.com/apache/airflow/pull/19747 also fixes this issue, but I like your approach more as it will prevent this un-runnable D

[GitHub] [airflow] SamWheating commented on a change in pull request #21829: Raise import error if a task uses a non-existent pool

2022-02-25 Thread GitBox
SamWheating commented on a change in pull request #21829: URL: https://github.com/apache/airflow/pull/21829#discussion_r815249494 ## File path: airflow/models/dag.py ## @@ -2625,6 +2625,18 @@ def validate_schedule_and_params(self): "DAG Schedule must be Non

[GitHub] [airflow] SamWheating commented on a change in pull request #21829: Raise import error if a task uses a non-existent pool

2022-02-25 Thread GitBox
SamWheating commented on a change in pull request #21829: URL: https://github.com/apache/airflow/pull/21829#discussion_r815249086 ## File path: tests/dags/test_non_existing_pool.py ## @@ -0,0 +1,30 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more c

[GitHub] [airflow] ephraimbuddy commented on issue #20788: AIrflow Scheduler does not schedule any tasks when >max running tasks queued with non-existant pool

2022-02-25 Thread GitBox
ephraimbuddy commented on issue #20788: URL: https://github.com/apache/airflow/issues/20788#issuecomment-1051411415 @SamWheating @fjmacagno let me know what you think about my PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [airflow] ephraimbuddy opened a new pull request #21829: Raise import error if a task uses a non-existent pool

2022-02-25 Thread GitBox
ephraimbuddy opened a new pull request #21829: URL: https://github.com/apache/airflow/pull/21829 Closes: https://github.com/apache/airflow/issues/20788 This PR proposes to raise import error if a task in a DAG is using a non-existent pool. This will free the scheduler from continuo

[GitHub] [airflow] ferruzzi opened a new pull request #21828: Update ECS sample DAG and Docs to new standards

2022-02-25 Thread GitBox
ferruzzi opened a new pull request #21828: URL: https://github.com/apache/airflow/pull/21828 Part of a project to simplify and standardize AWS sample dags and docs in preparation for adding System Testing. Related: https://github.com/apache/airflow/pull/21523 Related: https://gith

[GitHub] [airflow] jedcunningham commented on a change in pull request #21816: Deprecate non-JSON conn.extra

2022-02-25 Thread GitBox
jedcunningham commented on a change in pull request #21816: URL: https://github.com/apache/airflow/pull/21816#discussion_r815239416 ## File path: airflow/models/connection.py ## @@ -134,10 +134,32 @@ def __init__( self.schema = schema self.port = port

[GitHub] [airflow] github-actions[bot] commented on pull request #20694: Code improvement to configuration file load process

2022-02-25 Thread GitBox
github-actions[bot] commented on pull request #20694: URL: https://github.com/apache/airflow/pull/20694#issuecomment-1051386391 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank

[GitHub] [airflow] github-actions[bot] commented on pull request #20727: Travix : Exception improvement on connection pagination.

2022-02-25 Thread GitBox
github-actions[bot] commented on pull request #20727: URL: https://github.com/apache/airflow/pull/20727#issuecomment-1051386375 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank

[airflow] branch constraints-main updated: Updating constraints. Build id:1901184323

2022-02-25 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 34f4d6f Updating const

[GitHub] [airflow] dstandish commented on a change in pull request #21806: Rename `dagrun_id` to `dag_run_id`

2022-02-25 Thread GitBox
dstandish commented on a change in pull request #21806: URL: https://github.com/apache/airflow/pull/21806#discussion_r815219255 ## File path: airflow/migrations/versions/c306b5b5ae4a_switch_xcom_table_to_use_run_id.py ## @@ -41,7 +41,7 @@ def _get_new_xcom_columns() -> Sequ

[GitHub] [airflow] boring-cyborg[bot] commented on issue #21827: Airflow UI exposing AWS S3 secret credentials in XCOM screen when using BigQuery Data Transfer Service

2022-02-25 Thread GitBox
boring-cyborg[bot] commented on issue #21827: URL: https://github.com/apache/airflow/issues/21827#issuecomment-1051347875 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [airflow] bernyag opened a new issue #21827: Airflow UI exposing AWS S3 secret credentials in XCOM screen when using BigQuery Data Transfer Service

2022-02-25 Thread GitBox
bernyag opened a new issue #21827: URL: https://github.com/apache/airflow/issues/21827 ### Apache Airflow version 2.2.3 ### What happened When using BigQueryDataTransferServiceStartTransferRunsOperator in Airflow to initiate BigQuery Transfer jobs reading data from an A

[airflow] branch main updated (f13f9db -> 0378659)

2022-02-25 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from f13f9db Describe policy about support for OS versions used. (#21697) add 0378659 Added Hook for Amazon RDS. Add

[GitHub] [airflow] potiuk merged pull request #20642: Added Hook for Amazon RDS

2022-02-25 Thread GitBox
potiuk merged pull request #20642: URL: https://github.com/apache/airflow/pull/20642 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [airflow] dstandish commented on pull request #20642: Added Hook for Amazon RDS

2022-02-25 Thread GitBox
dstandish commented on pull request #20642: URL: https://github.com/apache/airflow/pull/20642#issuecomment-1051339622 finally we can merge. thanks again to @potiuk for resolving the pip problem, and thank you @kazanzhy for your persistence and patience. -- This is an automated message f

[GitHub] [airflow] dstandish commented on pull request #21824: Limits GitHub3.py in order to avoid backtracking

2022-02-25 Thread GitBox
dstandish commented on pull request #21824: URL: https://github.com/apache/airflow/pull/21824#issuecomment-1051338598 thank you @potiuk 🙏 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [airflow] potiuk closed pull request #20791: Add example tests for Breeze2

2022-02-25 Thread GitBox
potiuk closed pull request #20791: URL: https://github.com/apache/airflow/pull/20791 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [airflow] potiuk commented on a change in pull request #21546: Allow to switch easily between Bullseye and Buster debian versions

2022-02-25 Thread GitBox
potiuk commented on a change in pull request #21546: URL: https://github.com/apache/airflow/pull/21546#discussion_r815205278 ## File path: tests/jobs/test_scheduler_job.py ## @@ -3902,13 +3902,16 @@ def test_process_dags_queries_count( failures = [] # Collects a

[GitHub] [airflow] ashb commented on a change in pull request #21546: Allow to switch easily between Bullseye and Buster debian versions

2022-02-25 Thread GitBox
ashb commented on a change in pull request #21546: URL: https://github.com/apache/airflow/pull/21546#discussion_r815201542 ## File path: tests/jobs/test_scheduler_job.py ## @@ -3902,13 +3902,16 @@ def test_process_dags_queries_count( failures = [] # Collects ass

[airflow] branch main updated (a159ae8 -> f13f9db)

2022-02-25 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from a159ae8 Remove types from KPO docstring (#21826) add f13f9db Describe policy about support for OS versions used

[GitHub] [airflow] potiuk merged pull request #21697: Describe policy about support for OS versions used.

2022-02-25 Thread GitBox
potiuk merged pull request #21697: URL: https://github.com/apache/airflow/pull/21697 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[airflow] branch constraints-main updated: Updating constraints. Build id:1900950806

2022-02-25 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new e562751 Updating const

[GitHub] [airflow] rustikk commented on pull request #21809: Default args type check

2022-02-25 Thread GitBox
rustikk commented on pull request #21809: URL: https://github.com/apache/airflow/pull/21809#issuecomment-1051320270 hey @uranusjr I've made all the changes you suggested and all of the checks have passed. -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] potiuk commented on pull request #21546: Allow to switch easily between Bullseye and Buster debian versions

2022-02-25 Thread GitBox
potiuk commented on pull request #21546: URL: https://github.com/apache/airflow/pull/21546#issuecomment-1051314514 Anyone :) ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [airflow] potiuk commented on pull request #21697: Describe policy about support for OS versions used.

2022-02-25 Thread GitBox
potiuk commented on pull request #21697: URL: https://github.com/apache/airflow/pull/21697#issuecomment-1051309118 Any more comments? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [airflow] ashb commented on a change in pull request #21798: WIP: Change BaseOperatorLink interface to take a ti_key, not a datetime

2022-02-25 Thread GitBox
ashb commented on a change in pull request #21798: URL: https://github.com/apache/airflow/pull/21798#discussion_r815184495 ## File path: airflow/providers/google/cloud/links/base.py ## @@ -0,0 +1,51 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] ashb commented on a change in pull request #21798: WIP: Change BaseOperatorLink interface to take a ti_key, not a datetime

2022-02-25 Thread GitBox
ashb commented on a change in pull request #21798: URL: https://github.com/apache/airflow/pull/21798#discussion_r815184164 ## File path: tests/serialization/test_dag_serialization.py ## @@ -915,68 +944,6 @@ def execute(self, context: Context): ) assert expecte

[GitHub] [airflow] ashb commented on a change in pull request #21740: Make Grid and and Graph view work with task mapping

2022-02-25 Thread GitBox
ashb commented on a change in pull request #21740: URL: https://github.com/apache/airflow/pull/21740#discussion_r815183036 ## File path: airflow/www/utils.py ## @@ -53,10 +56,82 @@ def datetime_to_string(value: Optional[DateTime]) -> Optional[str]: return value.isoformat(

[GitHub] [airflow] ashb commented on a change in pull request #21740: Make Grid and and Graph view work with task mapping

2022-02-25 Thread GitBox
ashb commented on a change in pull request #21740: URL: https://github.com/apache/airflow/pull/21740#discussion_r815182554 ## File path: airflow/www/utils.py ## @@ -53,10 +56,82 @@ def datetime_to_string(value: Optional[DateTime]) -> Optional[str]: return value.isoformat(

[airflow] branch main updated (e4ead2b -> a159ae8)

2022-02-25 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from e4ead2b extends typing-extensions to be installed with python 3.8+ #21566 (#21567) add a159ae8 Remove t

[GitHub] [airflow] jedcunningham merged pull request #21826: Remove types from KPO docstring

2022-02-25 Thread GitBox
jedcunningham merged pull request #21826: URL: https://github.com/apache/airflow/pull/21826 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commit

[GitHub] [airflow] rustikk commented on a change in pull request #21809: Default args type check

2022-02-25 Thread GitBox
rustikk commented on a change in pull request #21809: URL: https://github.com/apache/airflow/pull/21809#discussion_r815172324 ## File path: airflow/models/baseoperator.py ## @@ -135,7 +135,10 @@ def _get_dag_defaults(dag: Optional["DAG"], task_group: Optional["TaskGroup"]) -

[GitHub] [airflow] o-nikolas commented on pull request #21073: Feature : Implement a AWS Session manager Parameter Store Operators and hooks

2022-02-25 Thread GitBox
o-nikolas commented on pull request #21073: URL: https://github.com/apache/airflow/pull/21073#issuecomment-1051288667 > @potiuk @o-nikolas Can you please review the request Hey folks, Sorry, it's been on my ToDo list to dive into this PR, but I just haven't had the time. But at a

[GitHub] [airflow] github-actions[bot] commented on pull request #21826: Remove types from KPO docstring

2022-02-25 Thread GitBox
github-actions[bot] commented on pull request #21826: URL: https://github.com/apache/airflow/pull/21826#issuecomment-1051284228 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[airflow] branch main updated (9407f11 -> e4ead2b)

2022-02-25 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 9407f11 Switch to GitHub-rendered Mermaid diagrams (#21682) add e4ead2b extends typing-extensions to be install

[GitHub] [airflow] potiuk closed issue #21566: typing_extensions package isn't installed with apache-airflow-providers-amazon causing an issue for SqlToS3Operator

2022-02-25 Thread GitBox
potiuk closed issue #21566: URL: https://github.com/apache/airflow/issues/21566 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[GitHub] [airflow] potiuk merged pull request #21567: FIX: extends typing-extensions to be installed with python 3.8+ #21566

2022-02-25 Thread GitBox
potiuk merged pull request #21567: URL: https://github.com/apache/airflow/pull/21567 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [airflow] frankcash commented on pull request #21567: FIX: extends typing-extensions to be installed with python 3.8+ #21566

2022-02-25 Thread GitBox
frankcash commented on pull request #21567: URL: https://github.com/apache/airflow/pull/21567#issuecomment-1051281925 @potiuk it worked yay -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [airflow] dstandish commented on pull request #20642: Added Hook for Amazon RDS

2022-02-25 Thread GitBox
dstandish commented on pull request #20642: URL: https://github.com/apache/airflow/pull/20642#issuecomment-1051280921 > I would really love if you could upvote and comment here: done > @kazanzhy @dstandish I think I managed to workaround the pip resolver issue with https://git

[GitHub] [airflow] ephraimbuddy commented on issue #21007: Run task - crashed

2022-02-25 Thread GitBox
ephraimbuddy commented on issue #21007: URL: https://github.com/apache/airflow/issues/21007#issuecomment-1051264632 Can you try this on the latest release? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] ferruzzi commented on pull request #21686: Feature: Add invoke lambda function operator

2022-02-25 Thread GitBox
ferruzzi commented on pull request #21686: URL: https://github.com/apache/airflow/pull/21686#issuecomment-1051264107 Sorry, I submitted those as single comments. Wish I could retroactively roll them into a review to reduce clutter. -- This is an automated message from the Apache Git Ser

[GitHub] [airflow] jedcunningham opened a new pull request #21826: Remove types from KPO docstring

2022-02-25 Thread GitBox
jedcunningham opened a new pull request #21826: URL: https://github.com/apache/airflow/pull/21826 These are no longer the right types and now they are inferred correctly anyways. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [airflow] potiuk commented on issue #10504: Add support for Redis in Cluster Mode

2022-02-25 Thread GitBox
potiuk commented on issue #10504: URL: https://github.com/apache/airflow/issues/10504#issuecomment-1051259589 > Any update on this? Is Redis cluster support is added? Feel free to work on it if you want. I think Redis cluster support has little use, but the most certain way to get it

[GitHub] [airflow] ferruzzi commented on a change in pull request #21686: Feature: Add invoke lambda function operator

2022-02-25 Thread GitBox
ferruzzi commented on a change in pull request #21686: URL: https://github.com/apache/airflow/pull/21686#discussion_r815147817 ## File path: airflow/providers/amazon/aws/operators/aws_lambda.py ## @@ -0,0 +1,99 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [airflow] ferruzzi commented on a change in pull request #21686: Feature: Add invoke lambda function operator

2022-02-25 Thread GitBox
ferruzzi commented on a change in pull request #21686: URL: https://github.com/apache/airflow/pull/21686#discussion_r815145185 ## File path: docs/apache-airflow-providers-amazon/operators/lambda.rst ## @@ -0,0 +1,54 @@ + .. Licensed to the Apache Software Foundation (ASF) under

[GitHub] [airflow] ferruzzi commented on a change in pull request #21686: Feature: Add invoke lambda function operator

2022-02-25 Thread GitBox
ferruzzi commented on a change in pull request #21686: URL: https://github.com/apache/airflow/pull/21686#discussion_r815144081 ## File path: airflow/providers/amazon/aws/operators/aws_lambda.py ## @@ -0,0 +1,99 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [airflow] ferruzzi commented on a change in pull request #21686: Feature: Add invoke lambda function operator

2022-02-25 Thread GitBox
ferruzzi commented on a change in pull request #21686: URL: https://github.com/apache/airflow/pull/21686#discussion_r815144081 ## File path: airflow/providers/amazon/aws/operators/aws_lambda.py ## @@ -0,0 +1,99 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [airflow] ferruzzi commented on a change in pull request #21686: Feature: Add invoke lambda function operator

2022-02-25 Thread GitBox
ferruzzi commented on a change in pull request #21686: URL: https://github.com/apache/airflow/pull/21686#discussion_r815143113 ## File path: airflow/providers/amazon/aws/operators/aws_lambda.py ## @@ -0,0 +1,99 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [airflow] arunporwal commented on issue #10504: Add support for Redis in Cluster Mode

2022-02-25 Thread GitBox
arunporwal commented on issue #10504: URL: https://github.com/apache/airflow/issues/10504#issuecomment-1051237935 Any update on this? Is Redis cluster support is added? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] ferruzzi commented on a change in pull request #21686: Feature: Add invoke lambda function operator

2022-02-25 Thread GitBox
ferruzzi commented on a change in pull request #21686: URL: https://github.com/apache/airflow/pull/21686#discussion_r815131369 ## File path: docs/apache-airflow-providers-amazon/operators/lambda.rst ## @@ -0,0 +1,54 @@ + .. Licensed to the Apache Software Foundation (ASF) under

[airflow] branch constraints-main updated: Updating constraints. Build id:1900474025

2022-02-25 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 9f5380b Updating const

[GitHub] [airflow] bbovenzi commented on pull request #21740: Make Grid and and Graph view work with task mapping

2022-02-25 Thread GitBox
bbovenzi commented on pull request #21740: URL: https://github.com/apache/airflow/pull/21740#issuecomment-1051199224 > Are the screenshots in the PR description up-to-date? Yes. I have some more advanced changes in a later PR. -- This is an automated message from the Apache Git Ser

[GitHub] [airflow] frankcash commented on pull request #21567: FIX: extends typing-extensions to be installed with python 3.8+ #21566

2022-02-25 Thread GitBox
frankcash commented on pull request #21567: URL: https://github.com/apache/airflow/pull/21567#issuecomment-1051182254 🤞 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] ashb commented on pull request #21740: Make Grid and and Graph view work with task mapping

2022-02-25 Thread GitBox
ashb commented on pull request #21740: URL: https://github.com/apache/airflow/pull/21740#issuecomment-1051182011 Are the screenshots in the PR description up-to-date? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[GitHub] [airflow] potiuk commented on pull request #21567: FIX: extends typing-extensions to be installed with python 3.8+ #21566

2022-02-25 Thread GitBox
potiuk commented on pull request #21567: URL: https://github.com/apache/airflow/pull/21567#issuecomment-1051178892 @frankcash I think I managed to workaround the pip resolver issue with https://github.com/apache/airflow/pull/21824 - please rebase to latest main. -- This is an automated m

[jira] [Assigned] (AIRFLOW-5017) Cannot Parse Environment Variable Connection for Spark on K8s

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-5017: Assignee: Sajid Sajid > Cannot Parse Environment Variable Connection for Spark on K8s >

[GitHub] [airflow] potiuk commented on pull request #20642: Added Hook for Amazon RDS

2022-02-25 Thread GitBox
potiuk commented on pull request #20642: URL: https://github.com/apache/airflow/pull/20642#issuecomment-1051178689 @kazanzhy @dstandish I think I managed to workaround the pip resolver issue with https://github.com/apache/airflow/pull/21824 - please rebase to latest main. -- This is a

[jira] [Assigned] (AIRFLOW-5181) Connection reset by peer during Dataproc job

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-5181: Assignee: Sajid Sajid > Connection reset by peer during Dataproc job > -

[jira] [Assigned] (AIRFLOW-1253) Jobs are not scheduled

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-1253: Assignee: Sajid Sajid > Jobs are not scheduled > -- > >

[jira] [Assigned] (AIRFLOW-3873) Issue with DAG dependency using ExternalTaskSensor

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-3873: Assignee: Sajid Sajid > Issue with DAG dependency using ExternalTaskSensor > ---

[jira] [Assigned] (AIRFLOW-4126) Graceful restart of Scheduler

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-4126: Assignee: Sajid Sajid > Graceful restart of Scheduler > - >

[jira] [Assigned] (AIRFLOW-3539) Error Importing sub-dag (Webserver module load fail, scheduler works fine)

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-3539: Assignee: Sajid Sajid (was: Alex Lumpov) > Error Importing sub-dag (Webserver module lo

[jira] [Assigned] (AIRFLOW-5633) Apache Airflow Integration with HashiCorp Nomad

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-5633: Assignee: Sajid Sajid > Apache Airflow Integration with HashiCorp Nomad > --

[jira] [Assigned] (AIRFLOW-5214) Airflow leaves too many TIME_WAIT TCP connections

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-5214: Assignee: Sajid Sajid > Airflow leaves too many TIME_WAIT TCP connections >

[jira] [Assigned] (AIRFLOW-5871) Stopping/Clearing a running airflow instance doesnt't terminate the job actually.

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-5871: Assignee: Sajid Sajid > Stopping/Clearing a running airflow instance doesnt't terminate

[jira] [Assigned] (AIRFLOW-6124) tmp folder gets deleted, shell-init: error retrieving current directory

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-6124: Assignee: Sajid Sajid > tmp folder gets deleted, shell-init: error retrieving current di

[jira] [Assigned] (AIRFLOW-4499) scheduler process running (in ps) but not doing anything, not writing to log for 3+hrs and not processing tasks

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-4499: Assignee: Sajid Sajid > scheduler process running (in ps) but not doing anything, not wr

[jira] [Assigned] (AIRFLOW-7020) Jobs running with cron is not working as expected

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-7020: Assignee: Sajid Sajid > Jobs running with cron is not working as expected >

[jira] [Assigned] (AIRFLOW-6779) Schedule stopped scheduling tasks with concurrency limit or depends on past

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-6779: Assignee: Sajid Sajid (was: QP Hou) > Schedule stopped scheduling tasks with concurrenc

[jira] [Assigned] (AIRFLOW-6560) db password leaks to logs

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-6560: Assignee: Sajid Sajid > db password leaks to logs > - > >

[jira] [Assigned] (AIRFLOW-5571) Kubernetes operator's bug that get logs will make pod exit unexpectedly

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-5571: Assignee: Sajid Sajid > Kubernetes operator's bug that get logs will make pod exit unexp

[jira] [Assigned] (AIRFLOW-5686) Deleting DAG can leave scheduled/queued tasks consuming pool slots

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-5686: Assignee: Sajid Sajid > Deleting DAG can leave scheduled/queued tasks consuming pool slo

[jira] [Assigned] (AIRFLOW-6772) {celery_executor.py:224} ERROR - Error sending Celery task:No module named 'MySQLdb'

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-6772: Assignee: Sajid Sajid > {celery_executor.py:224} ERROR - Error sending Celery task:No mo

[jira] [Assigned] (AIRFLOW-3097) Capability for nested SubDags

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-3097: Assignee: Sajid Sajid > Capability for nested SubDags > - >

[jira] [Assigned] (AIRFLOW-5039) xcom_push execution_date setting is broken when core.enable_xcom_pickling=False

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-5039: Assignee: Sajid Sajid (was: Rodrigo Martins de Oliveira) > xcom_push execution_date set

[jira] [Assigned] (AIRFLOW-2946) Connection times out on airflow worker

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-2946: Assignee: Sajid Sajid > Connection times out on airflow worker > ---

[jira] [Assigned] (AIRFLOW-2844) Airflow Logs BrokenPipeException

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-2844: Assignee: Sajid Sajid > Airflow Logs BrokenPipeException > -

[jira] [Assigned] (AIRFLOW-7039) Specific DAG Schedule & DST Results in Skipped DAG Run

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-7039: Assignee: Sajid Sajid > Specific DAG Schedule & DST Results in Skipped DAG Run > ---

[jira] [Assigned] (AIRFLOW-5881) Dag gets stuck in "Scheduled" State when scheduling a large number of tasks

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-5881: Assignee: Sajid Sajid > Dag gets stuck in "Scheduled" State when scheduling a large numb

[jira] [Assigned] (AIRFLOW-2320) Can not run DAGs since upgraded from Airflow 1.7

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-2320: Assignee: Sajid Sajid > Can not run DAGs since upgraded from Airflow 1.7 > -

[jira] [Assigned] (AIRFLOW-5191) SubDag is marked failed

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-5191: Assignee: Sajid Sajid > SubDag is marked failed > > >

[jira] [Assigned] (AIRFLOW-6580) Killing or marking a task as failed does not kill the Pod in the backend

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-6580: Assignee: Sajid Sajid (was: Daniel Imberman) > Killing or marking a task as failed does

[jira] [Assigned] (AIRFLOW-2697) Drop snakebite in favour of pyarrow

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-2697: Assignee: Sajid Sajid (was: Julian de Ruiter) > Drop snakebite in favour of pyarrow > -

[airflow] branch main updated (16f5185 -> 9407f11)

2022-02-25 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 16f5185 Limits GitHub3.py in order to avoid backtracking (#21824) add 9407f11 Switch to GitHub-rendered Mermaid

[jira] [Assigned] (AIRFLOW-4176) [security] webui shows password - admin/log/?flt1_extra_contains=conn_password

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-4176: Assignee: Sajid Sajid (was: Giorgio Zoppi) > [security] webui shows password - admin/lo

[jira] [Assigned] (AIRFLOW-7043) CLONE - The mirrored data folder for BigQuery_operators can't be accessed on manual runs

2022-02-25 Thread Sajid Sajid (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajid Sajid reassigned AIRFLOW-7043: Assignee: Sajid Sajid > CLONE - The mirrored data folder for BigQuery_operators can't be

  1   2   3   >