[GitHub] [airflow] raphaelauv commented on pull request #29106: [FIX] README K8S support 2.5.1

2023-01-23 Thread via GitHub
raphaelauv commented on PR #29106: URL: https://github.com/apache/airflow/pull/29106#issuecomment-1401298662 Thanks @potiuk for the explanation -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] radiant0619 commented on issue #27300: Scheduler encounters database update error, then gets stuck in endless loop, yet still shows as healthy

2023-01-23 Thread via GitHub
radiant0619 commented on issue #27300: URL: https://github.com/apache/airflow/issues/27300#issuecomment-1401369438 I am also facing similar issue in Airlfow 2.5.0. it is happening inconsistently while A dag having Dynamic Task creation . I am using Mysql5.7 as backend. -- This is an

[GitHub] [airflow] sudeepgupta90 commented on issue #28779: Built-in ServiceMonitor for PgBouncer and StatsD

2023-01-23 Thread via GitHub
sudeepgupta90 commented on issue #28779: URL: https://github.com/apache/airflow/issues/28779#issuecomment-1401424056 @potiuk yeah, I have the exact setup as you previously suggested :) Also, a gentle nudge for other members previously mentioned @jedcunningham @dstandish @ephraimbuddy

[airflow-client-python] branch update-release-process updated (be95d90 -> 7c7e643)

2023-01-23 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch update-release-process in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git discard be95d90 Update the release process doc new 7c7e643 Update the release

[airflow-client-python] 01/01: Update the release process doc

2023-01-23 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch update-release-process in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git commit 7c7e643a77fec7ec31a8c0c582f373635399f73c Author: Ephraim Anierobi AuthorDate:

[GitHub] [airflow] MrGeorgeOwl commented on pull request #28406: Add defer mode to GKECreateClusterOperator and GKEDeleteClusterOperator

2023-01-23 Thread via GitHub
MrGeorgeOwl commented on PR #28406: URL: https://github.com/apache/airflow/pull/28406#issuecomment-1401512853 @potiuk Yes, I am also working on KubernetesPodOperator but this PR have different operators -- This is an automated message from the Apache Git Service. To respond to the

[airflow-client-python] branch update-release-process updated (b400cb1 -> 0473645)

2023-01-23 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch update-release-process in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git discard b400cb1 Update the release process doc new 0473645 Update the release

[airflow-client-python] 01/01: Update the release process doc

2023-01-23 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch update-release-process in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git commit 04736455caad625f36fa76786073f303d64cb9aa Author: Ephraim Anierobi AuthorDate:

[GitHub] [airflow] radiant0619 opened a new issue, #29121: Airflow Scheduler is not working when DB connections is lost. It is not reinitiating the connection automatically after certain time.

2023-01-23 Thread via GitHub
radiant0619 opened a new issue, #29121: URL: https://github.com/apache/airflow/issues/29121 ### Apache Airflow version Other Airflow 2 version (please specify below) ### What happened Airflow Scheduler is not working when DB connections is lost. It is not reinitiating

[GitHub] [airflow] boring-cyborg[bot] commented on issue #29121: Airflow Scheduler is not working when DB connections is lost. It is not reinitiating the connection automatically after certain time.

2023-01-23 Thread boring-cyborg
boring-cyborg[bot] commented on issue #29121: URL: https://github.com/apache/airflow/issues/29121#issuecomment-1401372377 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] vchiapaikeo opened a new pull request, #29119: Fix GoogleDriveHook writing files to trashed folders on upload v2

2023-01-23 Thread via GitHub
vchiapaikeo opened a new pull request, #29119: URL: https://github.com/apache/airflow/pull/29119 Fixes a bug introduced in https://github.com/apache/airflow/pull/25675 where file uploads write to trash. I'm unable to test this E2E because I don't have Google Suite. If anyone

[airflow-client-python] branch update-release-process updated (0473645 -> be95d90)

2023-01-23 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch update-release-process in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git discard 0473645 Update the release process doc new be95d90 Update the release

[airflow-client-python] 01/01: Update the release process doc

2023-01-23 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch update-release-process in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git commit be95d90be53b3c614e25b2702a2bc5a8d392f525 Author: Ephraim Anierobi AuthorDate:

[GitHub] [airflow] Taragolis opened a new pull request, #29118: Fix TestSsmHooks which is not compatible with `moto==4.1.1`

2023-01-23 Thread via GitHub
Taragolis opened a new pull request, #29118: URL: https://github.com/apache/airflow/pull/29118 Recent version of `[moto==4.1.1](https://github.com/getmoto/moto/blob/master/CHANGELOG.md#411) broke our main, this PR introduce fixes. The problem that we do not pass all mandatory

[GitHub] [airflow] dstandish commented on a diff in pull request #29058: Optionally export `airflow db clean` data to CSV files

2023-01-23 Thread via GitHub
dstandish commented on code in PR #29058: URL: https://github.com/apache/airflow/pull/29058#discussion_r1084803393 ## airflow/cli/cli_parser.py: ## @@ -468,7 +468,18 @@ def string_lower_type(val): help="Don't preserve purged records in an archive table.",

[GitHub] [airflow] casra-developers commented on pull request #29107: PR: Introduced fix to run tasks on Windows systems

2023-01-23 Thread via GitHub
casra-developers commented on PR #29107: URL: https://github.com/apache/airflow/pull/29107#issuecomment-1401466227 @potiuk Glad to hear it, thank you :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[airflow-client-python] 01/01: Update the release process doc

2023-01-23 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch update-release-process in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git commit b400cb158e8d07c54c6c0abe998493ca8635b2d2 Author: Ephraim Anierobi AuthorDate:

[airflow-client-python] branch update-release-process created (now b400cb1)

2023-01-23 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch update-release-process in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git at b400cb1 Update the release process doc This branch includes the following

[GitHub] [airflow] josh-fell commented on issue #22154: Ambiguity of format for template fields in Airflow Kubernetes Operator (airflow.providers.cncf.kubernetes.operators.kubernetes_pod)

2023-01-23 Thread via GitHub
josh-fell commented on issue #22154: URL: https://github.com/apache/airflow/issues/22154#issuecomment-1401396484 The [fix for the issue @uranusjr opened](https://github.com/readthedocs/sphinx-autoapi/commit/847b6e5626dc3e85ab7e365c1893a8525a2af90a) was finally released on 2023-01-17 with

[GitHub] [airflow] sudeepgupta90 commented on a diff in pull request #29078: enhance production guide with a few Argo specific guidelines [#20999][#28637]

2023-01-23 Thread via GitHub
sudeepgupta90 commented on code in PR #29078: URL: https://github.com/apache/airflow/pull/29078#discussion_r1084825356 ## docs/helm-chart/index.rst: ## @@ -140,3 +140,18 @@ will not start as the migrations will not be run: This is so these CI/CD services can perform updates

[GitHub] [airflow] josh-fell commented on issue #27587: Removal of s3 `conn_type` renders `provide_bucket_name()` useless

2023-01-23 Thread via GitHub
josh-fell commented on issue #27587: URL: https://github.com/apache/airflow/issues/27587#issuecomment-1401353467 This has been addressed as part of #28706. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] josh-fell closed issue #27587: Removal of s3 `conn_type` renders `provide_bucket_name()` useless

2023-01-23 Thread via GitHub
josh-fell closed issue #27587: Removal of s3 `conn_type` renders `provide_bucket_name()` useless URL: https://github.com/apache/airflow/issues/27587 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] josh-fell commented on issue #25922: Develop Mypy plugin to type-check XComArg passed to a template_field

2023-01-23 Thread via GitHub
josh-fell commented on issue #25922: URL: https://github.com/apache/airflow/issues/25922#issuecomment-1401358826 Addressed via #26023. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] josh-fell closed issue #25922: Develop Mypy plugin to type-check XComArg passed to a template_field

2023-01-23 Thread via GitHub
josh-fell closed issue #25922: Develop Mypy plugin to type-check XComArg passed to a template_field URL: https://github.com/apache/airflow/issues/25922 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] josh-fell commented on issue #16655: Can't select version of the hook in hooks docs

2023-01-23 Thread via GitHub
josh-fell commented on issue #16655: URL: https://github.com/apache/airflow/issues/16655#issuecomment-1401416320 After spot checking several providers and assorted Python API docs pages within those providers, I can no longer replicate this issue. Of course this can be reopened if needed.

[GitHub] [airflow] josh-fell closed issue #16655: Can't select version of the hook in hooks docs

2023-01-23 Thread via GitHub
josh-fell closed issue #16655: Can't select version of the hook in hooks docs URL: https://github.com/apache/airflow/issues/16655 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] tirkarthi commented on pull request #28256: Include full path to Python files under zip path while clearing import errors.

2023-01-23 Thread via GitHub
tirkarthi commented on PR #28256: URL: https://github.com/apache/airflow/pull/28256#issuecomment-1401489859 @potiuk The initial issue was that file_paths would give "file.zip" but import error table had "file.zip/file_inside_zip.py". I initially suggested modifying file_paths function to

[GitHub] [airflow] potiuk commented on issue #19627: Providing a metadata secret conflicts with the use of pgbouncer

2023-01-23 Thread via GitHub
potiuk commented on issue #19627: URL: https://github.com/apache/airflow/issues/19627#issuecomment-1400209990 Please do. Assigned you :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[airflow] branch main updated (bea49094be -> 8805f37a7f)

2023-01-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from bea49094be Migrate Models Variable to Internal API (#28795) add 8805f37a7f Update Airflow version to 2.5.1

[GitHub] [airflow] potiuk merged pull request #29074: Update Airflow version to 2.5.1

2023-01-23 Thread via GitHub
potiuk merged PR #29074: URL: https://github.com/apache/airflow/pull/29074 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] auvipy commented on pull request #8545: [AIRFLOW-249] Refactor the SLA mechanism (Continuation from #3584 )

2023-01-23 Thread via GitHub
auvipy commented on PR #8545: URL: https://github.com/apache/airflow/pull/8545#issuecomment-1400340680 to take it over where should some one focus? fixing conflicts first? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[airflow-site] branch add-documentation-2023-01-23 created (now f6b01e2405)

2023-01-23 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch add-documentation-2023-01-23 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at f6b01e2405 Add documentation for packages - 2023-01-23 This branch includes the

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #29104: Update set-up-database.rst

2023-01-23 Thread boring-cyborg
boring-cyborg[bot] commented on PR #29104: URL: https://github.com/apache/airflow/pull/29104#issuecomment-1400425389 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] ashb commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-23 Thread via GitHub
ashb commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1083797766 ## airflow/example_dags/example_params_ui_tutorial.py: ## @@ -0,0 +1,234 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] potiuk merged pull request #29080: Make static checks generated file more stable across the board

2023-01-23 Thread via GitHub
potiuk merged PR #29080: URL: https://github.com/apache/airflow/pull/29080 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on a diff in pull request #29080: Make static checks generated file more stable across the board

2023-01-23 Thread via GitHub
potiuk commented on code in PR #29080: URL: https://github.com/apache/airflow/pull/29080#discussion_r1083960155 ## .pre-commit-config.yaml: ## @@ -146,6 +146,13 @@ repos: - --fuzzy-match-generates-todo files: >

[GitHub] [airflow] ephraimbuddy commented on pull request #27829: Improving the release process

2023-01-23 Thread via GitHub
ephraimbuddy commented on PR #27829: URL: https://github.com/apache/airflow/pull/27829#issuecomment-1400284160 Previously, some of the commands used to check out branches were being executed in the CI. However, because this change was not in the checked-out branch, the codes could not be

[airflow] branch main updated: Prepare ad hoc provider release for Docker, Cassandra, Papermill (#28999)

2023-01-23 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new dd6cef7889 Prepare ad hoc provider release for

[airflow-site] branch add-documentation-2023-01-23 created (now 7a8706e300)

2023-01-23 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch add-documentation-2023-01-23 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at 7a8706e300 Add documentation for packages - 2023-01-23 This branch includes the

[GitHub] [airflow] schwartzpub opened a new pull request, #29104: Update set-up-database.rst

2023-01-23 Thread via GitHub
schwartzpub opened a new pull request, #29104: URL: https://github.com/apache/airflow/pull/29104 Add experimental notation to MSSQL to be consistent with previous documentation. --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] potiuk closed issue #28271: AIP-44 Migrate Variable to Internal API

2023-01-23 Thread via GitHub
potiuk closed issue #28271: AIP-44 Migrate Variable to Internal API URL: https://github.com/apache/airflow/issues/28271 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[airflow] branch main updated: Add deferrable mode to `DbtCloudRunJobOperator` (#29014)

2023-01-23 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 55049c50d5 Add deferrable mode to

[GitHub] [airflow] Taragolis commented on pull request #29086: Remove upper bound limitation for `pytest`

2023-01-23 Thread via GitHub
Taragolis commented on PR #29086: URL: https://github.com/apache/airflow/pull/29086#issuecomment-1400225586 > I think we can handle that in another PR? It definitely for another PR and related only to AIP-44, this flaky error also appear in `pytest` 6 yesterday. -- This is an

[GitHub] [airflow] Taragolis commented on pull request #29087: Unquarantine receive SIGTERM on Task Runner test (second attempt)

2023-01-23 Thread via GitHub
Taragolis commented on PR #29087: URL: https://github.com/apache/airflow/pull/29087#issuecomment-1400282901 Rebase again -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] boring-cyborg[bot] commented on issue #29102: Airflow UI not showing mapped tasks

2023-01-23 Thread boring-cyborg
boring-cyborg[bot] commented on issue #29102: URL: https://github.com/apache/airflow/issues/29102#issuecomment-1400275979 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] anneadb opened a new issue, #29102: Airflow UI not showing mapped tasks

2023-01-23 Thread via GitHub
anneadb opened a new issue, #29102: URL: https://github.com/apache/airflow/issues/29102 ### Apache Airflow version 2.5.1 ### What happened I am using dynamic task mapping to process a list of files in the same way. The tasks are generated but I cannot see them listed

[GitHub] [airflow] Taragolis commented on issue #21171: Airflow schedules tasks in wrong timezone with an MSSQL Metadata DB on a non-UTC server

2023-01-23 Thread via GitHub
Taragolis commented on issue #21171: URL: https://github.com/apache/airflow/issues/21171#issuecomment-1400302771 Yep seems like inconsistent between [README.md](https://github.com/apache/airflow#requirements) and

[GitHub] [airflow-site] eladkal closed pull request #727: Add documentation for packages - 2023-01-23

2023-01-23 Thread via GitHub
eladkal closed pull request #727: Add documentation for packages - 2023-01-23 URL: https://github.com/apache/airflow-site/pull/727 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] potiuk merged pull request #28795: Migrate Models Variable to Internal API

2023-01-23 Thread via GitHub
potiuk merged PR #28795: URL: https://github.com/apache/airflow/pull/28795 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated (9c3cd3803f -> bea49094be)

2023-01-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 9c3cd3803f Fix warning in migrations about old config. (#29092) add bea49094be Migrate Models Variable to

[GitHub] [airflow] potiuk commented on pull request #29099: Trigger Class migration to internal API

2023-01-23 Thread via GitHub
potiuk commented on PR #29099: URL: https://github.com/apache/airflow/pull/29099#issuecomment-1400195705 And again conflict to resolve (BTW. I think maybe we could split the RPC endpoint to be more modular and less conflict-prone, however this is just a temporary problem of having several

[airflow] branch main updated (8805f37a7f -> 129f0820cd)

2023-01-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 8805f37a7f Update Airflow version to 2.5.1 (#29074) add 129f0820cd Make static checks generated file more stable

[GitHub] [airflow] MattiaGallegati commented on issue #16163: Confusing log for long running tasks: "dependency 'Task Instance Not Running' FAILED: Task is in the running state"

2023-01-23 Thread via GitHub
MattiaGallegati commented on issue #16163: URL: https://github.com/apache/airflow/issues/16163#issuecomment-1400214542 In order to help I noticed a similar behaviour in 2.5.0 (with celery, redis, postgres, default configs). I also found related issues to ipothetically close on completion

[GitHub] [airflow] kaxil merged pull request #29014: Add deferrable mode to `DbtCloudRunJobOperator`

2023-01-23 Thread via GitHub
kaxil merged PR #29014: URL: https://github.com/apache/airflow/pull/29014 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] mattinbits commented on issue #21171: Airflow schedules tasks in wrong timezone with an MSSQL Metadata DB on a non-UTC server

2023-01-23 Thread via GitHub
mattinbits commented on issue #21171: URL: https://github.com/apache/airflow/issues/21171#issuecomment-1400287367 > > @potiuk As an initial fix for our internal system, I replaced `func.now()` with `func.GETDATE()` in an internal fork which is enough to fix it for SQL Server. This is not

[airflow] annotated tag providers-papermill/3.1.1rc1 updated (dd6cef7889 -> e5a2bc0b13)

2023-01-23 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to annotated tag providers-papermill/3.1.1rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-papermill/3.1.1rc1 was modified! *** from dd6cef7889 (commit)

[airflow] annotated tag providers-docker/3.5.0rc1 updated (dd6cef7889 -> 8f9d3b9984)

2023-01-23 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to annotated tag providers-docker/3.5.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-docker/3.5.0rc1 was modified! *** from dd6cef7889 (commit)

[airflow] annotated tag providers-apache-cassandra/3.1.1rc1 updated (dd6cef7889 -> ab84fb8d4c)

2023-01-23 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to annotated tag providers-apache-cassandra/3.1.1rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-apache-cassandra/3.1.1rc1 was modified! *** from

[GitHub] [airflow] eladkal opened a new issue, #29103: Status of testing Providers that were prepared on January 23, 2023

2023-01-23 Thread via GitHub
eladkal opened a new issue, #29103: URL: https://github.com/apache/airflow/issues/29103 ### Body I have a kind request for all the contributors to the latest provider packages release. Could you please help us to test the RC versions of the providers? Let us know in the

[GitHub] [airflow] auvipy commented on pull request #29086: Remove upper bound limitation for `pytest`

2023-01-23 Thread via GitHub
auvipy commented on PR #29086: URL: https://github.com/apache/airflow/pull/29086#issuecomment-1400183570 I think we can handle that in another PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] MrGeorgeOwl commented on pull request #25466: Auto ML assets

2023-01-23 Thread via GitHub
MrGeorgeOwl commented on PR #25466: URL: https://github.com/apache/airflow/pull/25466#issuecomment-1400125528 @potiuk I think that PR can be merged. I can't do that because I am not the author of PR and I don't have write access -- This is an automated message from the Apache Git

[GitHub] [airflow] schwartzpub commented on issue #21171: Airflow schedules tasks in wrong timezone with an MSSQL Metadata DB on a non-UTC server

2023-01-23 Thread via GitHub
schwartzpub commented on issue #21171: URL: https://github.com/apache/airflow/issues/21171#issuecomment-1400295104 > As someone who has been running Airflow on MSSQL in production for several years, I tend to agree that explicitly removing support would be better. We're

svn commit: r59539 - /dev/airflow/providers/

2023-01-23 Thread eladkal
Author: eladkal Date: Mon Jan 23 13:00:01 2023 New Revision: 59539 Log: Add artifacts for Airflow Providers 2023-01-23 Added: dev/airflow/providers/apache-airflow-providers-apache-cassandra-3.1.1.tar.gz (with props)

[GitHub] [airflow] eladkal merged pull request #28999: Prepare ad hoc provider release for Docker, Cassandra, Papermill

2023-01-23 Thread via GitHub
eladkal merged PR #28999: URL: https://github.com/apache/airflow/pull/28999 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] BasPH commented on a diff in pull request #29078: enhance production guide with a few Argo specific guidelines [#20999][#28637]

2023-01-23 Thread via GitHub
BasPH commented on code in PR #29078: URL: https://github.com/apache/airflow/pull/29078#discussion_r1083850885 ## docs/helm-chart/index.rst: ## @@ -140,3 +140,18 @@ will not start as the migrations will not be run: This is so these CI/CD services can perform updates without

[GitHub] [airflow] shahar1 commented on pull request #27156: Add documentation for BigQuery transfer operators

2023-01-23 Thread via GitHub
shahar1 commented on PR #27156: URL: https://github.com/apache/airflow/pull/27156#issuecomment-1400154592 @eladkal Please assign me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] tanelk commented on a diff in pull request #29094: Add `max_active_tis_per_dagrun` for Dynamic Task Mapping

2023-01-23 Thread via GitHub
tanelk commented on code in PR #29094: URL: https://github.com/apache/airflow/pull/29094#discussion_r1083763018 ## airflow/jobs/scheduler_job.py: ## @@ -480,13 +490,40 @@ def _executable_task_instances_to_queued(self, max_tis: int, session: Session) -

[GitHub] [airflow] mattinbits commented on issue #21171: Airflow schedules tasks in wrong timezone with an MSSQL Metadata DB on a non-UTC server

2023-01-23 Thread via GitHub
mattinbits commented on issue #21171: URL: https://github.com/apache/airflow/issues/21171#issuecomment-147539 As someone who has been running Airflow on MSSQL in production for several years, I tend to agree that explicitly removing support would be better. We're planning to move away

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #29098: Explicit a few steps in the release process

2023-01-23 Thread via GitHub
ephraimbuddy commented on code in PR #29098: URL: https://github.com/apache/airflow/pull/29098#discussion_r1083817696 ## dev/README_RELEASE_AIRFLOW.md: ## @@ -119,8 +120,24 @@ git log --oneline --decorate apache/v2-2-stable..apache/main -- docs/apache-airf Those changes that

[GitHub] [airflow] ashb merged pull request #29092: Fix warning in migrations about old config.

2023-01-23 Thread via GitHub
ashb merged PR #29092: URL: https://github.com/apache/airflow/pull/29092 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] MrGeorgeOwl commented on a diff in pull request #27776: Add deferrable mode to dataflow operators

2023-01-23 Thread via GitHub
MrGeorgeOwl commented on code in PR #27776: URL: https://github.com/apache/airflow/pull/27776#discussion_r1083736807 ## airflow/providers/google/cloud/links/dataflow.py: ## @@ -48,5 +48,5 @@ def persist( operator_instance.xcom_push( context,

[GitHub] [airflow] snjypl commented on pull request #28394: Fix manual task trigger failing for k8s.

2023-01-23 Thread via GitHub
snjypl commented on PR #28394: URL: https://github.com/apache/airflow/pull/28394#issuecomment-1399944689 > I thikn we need a ot more context in commit - what hapens here. i have added a more descriptive commit message. -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] ashb commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-23 Thread via GitHub
ashb commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1083798621 ## airflow/example_dags/example_params_ui_tutorial.py: ## @@ -0,0 +1,234 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor

[GitHub] [airflow] ashb commented on a diff in pull request #29080: Make static checks generated file more stable across the board

2023-01-23 Thread via GitHub
ashb commented on code in PR #29080: URL: https://github.com/apache/airflow/pull/29080#discussion_r1083806540 ## .pre-commit-config.yaml: ## @@ -146,6 +146,13 @@ repos: - --fuzzy-match-generates-todo files: >

[airflow] branch main updated (736f2e898a -> 9c3cd3803f)

2023-01-23 Thread ash
This is an automated email from the ASF dual-hosted git repository. ash pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 736f2e898a Fix rendering parameters in PapermillOperator (#28979) add 9c3cd3803f Fix warning in migrations about old

[GitHub] [airflow] MrGeorgeOwl commented on a diff in pull request #27776: Add deferrable mode to dataflow operators

2023-01-23 Thread via GitHub
MrGeorgeOwl commented on code in PR #27776: URL: https://github.com/apache/airflow/pull/27776#discussion_r1083733347 ## airflow/providers/google/cloud/hooks/dataflow.py: ## @@ -1037,7 +1050,7 @@ def start_sql_job( def get_job( self, job_id: str, -

[GitHub] [airflow] tanelk commented on a diff in pull request #29094: Add `max_active_tis_per_dagrun` for Dynamic Task Mapping

2023-01-23 Thread via GitHub
tanelk commented on code in PR #29094: URL: https://github.com/apache/airflow/pull/29094#discussion_r1083766525 ## airflow/jobs/scheduler_job.py: ## @@ -336,7 +344,9 @@ def _executable_task_instances_to_queued(self, max_tis: int, session: Session) - query =

[GitHub] [airflow] ashb commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-23 Thread via GitHub
ashb commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1083793113 ## airflow/config_templates/config.yml: ## @@ -1529,6 +1529,19 @@ webserver: type: boolean example: ~ default: "False" +trigger_dag_url:

[GitHub] [airflow] Taragolis commented on pull request #29086: Remove upper bound limitation for `pytest`

2023-01-23 Thread via GitHub
Taragolis commented on PR #29086: URL: https://github.com/apache/airflow/pull/29086#issuecomment-1400130898 Non relevant error in the CI to this PR. Looks like internal_api test flaky ```console if not ignore_running: raise AssertionError( >

[GitHub] [airflow] talnagar opened a new issue, #29105: graph disappears when using branch_task and a dynamic classic operator

2023-01-23 Thread via GitHub
talnagar opened a new issue, #29105: URL: https://github.com/apache/airflow/issues/29105 ### Apache Airflow version 2.5.1 ### What happened when using a dynamically generated task after a branch_task the graph doesn't render. tried with BashOperator and a

[GitHub] [airflow] raphaelauv commented on pull request #29106: [FIX] README K8S support 2.5.1

2023-01-23 Thread via GitHub
raphaelauv commented on PR #29106: URL: https://github.com/apache/airflow/pull/29106#issuecomment-1400514307 @pierrejeambrun could you review , thank you :+1: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] potiuk commented on a diff in pull request #29098: Explicit a few steps in the release process

2023-01-23 Thread via GitHub
potiuk commented on code in PR #29098: URL: https://github.com/apache/airflow/pull/29098#discussion_r1084184091 ## dev/README_RELEASE_AIRFLOW.md: ## @@ -477,8 +496,12 @@ To do this we need to twine upload -r pypitest dist/* ``` -- Verify that the test package looks

[GitHub] [airflow] potiuk commented on a diff in pull request #29098: Explicit a few steps in the release process

2023-01-23 Thread via GitHub
potiuk commented on code in PR #29098: URL: https://github.com/apache/airflow/pull/29098#discussion_r1084184091 ## dev/README_RELEASE_AIRFLOW.md: ## @@ -477,8 +496,12 @@ To do this we need to twine upload -r pypitest dist/* ``` -- Verify that the test package looks

[GitHub] [airflow] nirutgupta opened a new issue, #29108: Unable to login in iframe

2023-01-23 Thread via GitHub
nirutgupta opened a new issue, #29108: URL: https://github.com/apache/airflow/issues/29108 ### Apache Airflow version Other Airflow 2 version (please specify below) ### What happened Airflow Version : 2.3.2 Helmchart Version: 1.3.0 When trying to login with

[GitHub] [airflow] kristopherkane opened a new issue, #29109: [Google Cloud] DataprocCreateBatchOperator returns incorrect results and does not reattach

2023-01-23 Thread via GitHub
kristopherkane opened a new issue, #29109: URL: https://github.com/apache/airflow/issues/29109 ### Apache Airflow version main (development) ### What happened The provider operator and hooks for Google Cloud Dataproc has two bugs: 1. The running

[GitHub] [airflow] MrGeorgeOwl commented on pull request #28406: Add defer mode to GKECreateClusterOperator and GKEDeleteClusterOperator

2023-01-23 Thread via GitHub
MrGeorgeOwl commented on PR #28406: URL: https://github.com/apache/airflow/pull/28406#issuecomment-1400598190 @potiuk, I think PR is good and can be merged -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] bbovenzi commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-23 Thread via GitHub
bbovenzi commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1084254664 ## airflow/www/static/js/trigger.js: ## @@ -19,33 +19,190 @@ /* global document, CodeMirror, window */ -const textArea = document.getElementById('json'); +let

[GitHub] [airflow] potiuk commented on pull request #27156: Add documentation for BigQuery transfer operators

2023-01-23 Thread via GitHub
potiuk commented on PR #27156: URL: https://github.com/apache/airflow/pull/27156#issuecomment-1400616833 > @eladkal Please assign me You can just take the PR and start working on yours (and make reference to this PR). There is no need to assign it. -- This is an automated message

[GitHub] [airflow] potiuk commented on issue #29102: Airflow UI not showing mapped tasks

2023-01-23 Thread via GitHub
potiuk commented on issue #29102: URL: https://github.com/apache/airflow/issues/29102#issuecomment-1400621201 CC: @bbovenzi @pierrejeambrun @ephraimbuddy - if that one is confirmed, we might have a need for 2.5.2 rather quickly -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] sean-rose commented on a diff in pull request #29065: When clearing task instances try to get associated DAGs from database

2023-01-23 Thread via GitHub
sean-rose commented on code in PR #29065: URL: https://github.com/apache/airflow/pull/29065#discussion_r1084283710 ## tests/models/test_cleartasks.py: ## @@ -202,9 +203,9 @@ def test_clear_task_instances_without_task(self, dag_maker): # but it works for our case

[GitHub] [airflow] potiuk commented on pull request #8545: [AIRFLOW-249] Refactor the SLA mechanism (Continuation from #3584 )

2023-01-23 Thread via GitHub
potiuk commented on PR #8545: URL: https://github.com/apache/airflow/pull/8545#issuecomment-1400660574 > to take it over where should some one focus? fixing conflicts first I guess with how far behind this change is and how many conflicts it has, starting from the scratch following

[GitHub] [airflow] potiuk commented on a diff in pull request #29077: add retries to stop_pipeline on conflict

2023-01-23 Thread via GitHub
potiuk commented on code in PR #29077: URL: https://github.com/apache/airflow/pull/29077#discussion_r1084317558 ## airflow/providers/amazon/aws/hooks/sagemaker.py: ## @@ -1154,19 +1154,35 @@ def stop_pipeline( :return: Status of the pipeline execution after the

[GitHub] [airflow] josh-fell closed issue #27107: Dbt cloud download artifact to a path not present fails

2023-01-23 Thread via GitHub
josh-fell closed issue #27107: Dbt cloud download artifact to a path not present fails URL: https://github.com/apache/airflow/issues/27107 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] josh-fell merged pull request #29048: Allow downloading of dbt Cloud artifacts to non-existent paths

2023-01-23 Thread via GitHub
josh-fell merged PR #29048: URL: https://github.com/apache/airflow/pull/29048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated (6190e34388 -> f805b4154a)

2023-01-23 Thread joshfell
This is an automated email from the ASF dual-hosted git repository. joshfell pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 6190e34388 add retries to stop_pipeline on conflict (#29077) add f805b4154a Allow downloading of dbt Cloud

[GitHub] [airflow] eladkal commented on issue #26424: `POST /taskInstances/list` with wildcards returns unhelpful error

2023-01-23 Thread via GitHub
eladkal commented on issue #26424: URL: https://github.com/apache/airflow/issues/26424#issuecomment-1400453634 @maheshsv are you still working on this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] bbovenzi commented on issue #29100: Unnecessary scrollbars in grid view

2023-01-23 Thread via GitHub
bbovenzi commented on issue #29100: URL: https://github.com/apache/airflow/issues/29100#issuecomment-1400508370 I've been back and forth on the best scrolling solution for the grid view because the right or left side could be significantly longer than the other. This was most notable with

[airflow] branch main updated: Auto ML assets (#25466)

2023-01-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 90e6277da6 Auto ML assets (#25466) 90e6277da6 is

[GitHub] [airflow] potiuk merged pull request #25466: Auto ML assets

2023-01-23 Thread via GitHub
potiuk merged PR #25466: URL: https://github.com/apache/airflow/pull/25466 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] kristopherkane commented on issue #29109: [Google Cloud] DataprocCreateBatchOperator returns incorrect results and does not reattach

2023-01-23 Thread via GitHub
kristopherkane commented on issue #29109: URL: https://github.com/apache/airflow/issues/29109#issuecomment-1400609969 That label should probably be 'providers' -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

  1   2   3   >