[GitHub] [airflow] jedcunningham commented on a diff in pull request #29058: Optionally export `airflow db clean` data to CSV files

jedcunningham commented on code in PR #29058: URL: https://github.com/apache/airflow/pull/29058#discussion_r1085538522 ## airflow/cli/cli_parser.py: ## @@ -468,7 +468,18 @@ def string_lower_type(val): help="Don't preserve purged records in an archive table.",

[airflow] branch main updated: Clarify graph view dynamic task labels (#29042)

This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 33ba242d7e Clarify graph view dynamic task

[GitHub] [airflow] bbovenzi merged pull request #29042: Clarify graph view dynamic task labels

bbovenzi merged PR #29042: URL: https://github.com/apache/airflow/pull/29042 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow-client-python] branch master updated: Update the release process doc (#59)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git The following commit(s) were added to refs/heads/master by this push: new d1e7474 Update the release

[GitHub] [airflow-client-python] potiuk merged pull request #59: Update the release process doc

potiuk merged PR #59: URL: https://github.com/apache/airflow-client-python/pull/59 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow-client-python] potiuk merged pull request #60: Require at least 1 approval before merging to master

potiuk merged PR #60: URL: https://github.com/apache/airflow-client-python/pull/60 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow-client-python] branch master updated (1a6f6ee -> 183059c)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git from 1a6f6ee Update Changelog for 2.5.0 release (#58) add 183059c Require at least 1 approval before

[airflow] branch main updated: Fix GoogleDriveHook writing files to trashed folders on upload v2 (#29119)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b2825e1185 Fix GoogleDriveHook writing files to

[GitHub] [airflow] potiuk merged pull request #29119: Fix GoogleDriveHook writing files to trashed folders on upload v2

potiuk merged PR #29119: URL: https://github.com/apache/airflow/pull/29119 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Fix #28391 manual task trigger from UI fails for k8s executor (#28394)

This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 9510043546 Fix #28391 manual task trigger from UI

[GitHub] [airflow] potiuk merged pull request #28394: Fix manual task trigger failing for k8s.

potiuk merged PR #28394: URL: https://github.com/apache/airflow/pull/28394 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk closed issue #28391: Manual task trigger fails for kubernetes executor with psycopg2 InvalidTextRepresentation error

potiuk closed issue #28391: Manual task trigger fails for kubernetes executor with psycopg2 InvalidTextRepresentation error URL: https://github.com/apache/airflow/issues/28391 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow-client-python] potiuk commented on pull request #60: Require at least 1 approval before merging to master

potiuk commented on PR #60: URL: https://github.com/apache/airflow-client-python/pull/60#issuecomment-1402113139 Next step might be changing `master` into `main` :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] tirkarthi commented on pull request #28256: Include full path to Python files under zip path while clearing import errors.

tirkarthi commented on PR #28256: URL: https://github.com/apache/airflow/pull/28256#issuecomment-1402095422 The original issue was due to traversing over dag folder every time and also recursively inside zip files to construct paths like test_dag.zip/test_file.py which is IO expensive. The

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #29058: Optionally export `airflow db clean` data to CSV files

ephraimbuddy commented on code in PR #29058: URL: https://github.com/apache/airflow/pull/29058#discussion_r1085074195 ## airflow/cli/cli_parser.py: ## @@ -468,7 +468,18 @@ def string_lower_type(val): help="Don't preserve purged records in an archive table.",

[GitHub] [airflow] eladkal commented on pull request #28141: Fix GoogleDriveHook writing files to trashed folders on upload

eladkal commented on PR #28141: URL: https://github.com/apache/airflow/pull/28141#issuecomment-1402076678 Will be fixed in https://github.com/apache/airflow/pull/29119 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] eladkal closed pull request #28141: Fix GoogleDriveHook writing files to trashed folders on upload

eladkal closed pull request #28141: Fix GoogleDriveHook writing files to trashed folders on upload URL: https://github.com/apache/airflow/pull/28141 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] potiuk commented on issue #29113: sqlite conn id unclear

potiuk commented on issue #29113: URL: https://github.com/apache/airflow/issues/29113#issuecomment-1402034066 Just make A PR with what you think is needed and we can discuss it there. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] HeshamMeneisi commented on issue #26429: ExternalTaskSensor: An option to use the data_interval variables rather than execution_date

HeshamMeneisi commented on issue #26429: URL: https://github.com/apache/airflow/issues/26429#issuecomment-1401982212 I haven't got to do this specifically yet, but in light of the new Dataset logic, this seems like a more intuitive solution for the use-case above, what do you think? I can

[GitHub] [airflow] potiuk commented on pull request #28256: Include full path to Python files under zip path while clearing import errors.

potiuk commented on PR #28256: URL: https://github.com/apache/airflow/pull/28256#issuecomment-1401979869 > @potiuk The initial issue was that file_paths would give "file.zip" but import error table had "file.zip/file_inside_zip.py". I initially suggested modifying file_paths function to

[GitHub] [airflow] tanuj241088 opened a new issue, #29131: Airflow v2.4.2 - Scheduler fails with BrokenPIP error (Exiting gracefully upon receiving signal 15)

tanuj241088 opened a new issue, #29131: URL: https://github.com/apache/airflow/issues/29131 ### Apache Airflow version Other Airflow 2 version (please specify below) ### What happened I have recently upgraded to Airflow v2.4.2 with python v3.9.15 Previous Airflow v2.1

[GitHub] [airflow] potiuk closed issue #29121: Airflow Scheduler is not working when DB connections is lost. It is not reinitiating the connection automatically after certain time.

potiuk closed issue #29121: Airflow Scheduler is not working when DB connections is lost. It is not reinitiating the connection automatically after certain time. URL: https://github.com/apache/airflow/issues/29121 -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] potiuk commented on issue #27300: Scheduler encounters database update error, then gets stuck in endless loop, yet still shows as healthy

potiuk commented on issue #27300: URL: https://github.com/apache/airflow/issues/27300#issuecomment-1401960184 > I am also facing similar issue in Airlfow 2.5.0. it is happening inconsistently while A dag having Dynamic Task creation . I am using Mysql5.7 as backend. Can you please

[GitHub] [airflow] potiuk commented on pull request #29117: GCSTaskHandler may use remote log conn id

potiuk commented on PR #29117: URL: https://github.com/apache/airflow/pull/29117#issuecomment-1401950195 pending static checks :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] kelechi2020 closed issue #29129: Dag runs for dag with dynamic tasks marked completed with empty task details

kelechi2020 closed issue #29129: Dag runs for dag with dynamic tasks marked completed with empty task details URL: https://github.com/apache/airflow/issues/29129 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] kelechi2020 commented on issue #29129: Dag runs for dag with dynamic tasks marked completed with empty task details

kelechi2020 commented on issue #29129: URL: https://github.com/apache/airflow/issues/29129#issuecomment-1401947228 That was it. Lost track that I made that change before doing an upgrade. It's resolved now. Closing this. Thanks -- This is an automated message from the Apache Git

[GitHub] [airflow] eladkal commented on issue #29103: Status of testing Providers that were prepared on January 23, 2023

eladkal commented on issue #29103: URL: https://github.com/apache/airflow/issues/29103#issuecomment-1401938118 > @eladkal I noticed unsual thing - that we do not have have the "sdist" in PyPI - only .whl ones. I think they are generated (they are present in SVN for verification) but not in

[GitHub] [airflow] ephraimbuddy commented on issue #29129: Dag runs for dag with dynamic tasks marked completed with empty task details

ephraimbuddy commented on issue #29129: URL: https://github.com/apache/airflow/issues/29129#issuecomment-1401929274 Looks like the start date is in the future? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #28998: write to DB a user who triggered a dag via API endpoint request

ephraimbuddy commented on code in PR #28998: URL: https://github.com/apache/airflow/pull/28998#discussion_r1085294409 ## airflow/api_connexion/endpoints/dag_run_endpoint.py: ## @@ -319,6 +330,19 @@ def post_dag_run(*, dag_id: str, session: Session = NEW_SESSION) ->

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #28998: write to DB a user who triggered a dag via API endpoint request

ephraimbuddy commented on code in PR #28998: URL: https://github.com/apache/airflow/pull/28998#discussion_r1085292324 ## airflow/api_connexion/endpoints/dag_run_endpoint.py: ## @@ -280,6 +285,12 @@ def get_dag_runs_batch(*, session: Session = NEW_SESSION) -> APIResponse:

[GitHub] [airflow] kelechi2020 opened a new issue, #29129: Dag runs for dag with dynamic tasks marked completed with empty task details

kelechi2020 opened a new issue, #29129: URL: https://github.com/apache/airflow/issues/29129 ### Apache Airflow version 2.5.1 ### What happened Dag run marked as complete but tasks not run. ### What you think should happen instead Dagrun completes and task

[GitHub] [airflow] boring-cyborg[bot] commented on issue #29129: Dag runs for dag with dynamic tasks marked completed with empty task details

boring-cyborg[bot] commented on issue #29129: URL: https://github.com/apache/airflow/issues/29129#issuecomment-1401912372 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[airflow] branch main updated: fix Google provider CHANGELOG.rst (#29122)

This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new be0e35321f fix Google provider

[GitHub] [airflow] ephraimbuddy merged pull request #29122: fix Google provider CHANGELOG.rst

ephraimbuddy merged PR #29122: URL: https://github.com/apache/airflow/pull/29122 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] feluelle commented on pull request #28721: Use connection URI in SqliteHook

feluelle commented on PR #28721: URL: https://github.com/apache/airflow/pull/28721#issuecomment-140186 I have added [Add missing uri and add file protocol](https://github.com/apache/airflow/pull/28721/commits/e383957ab3e77e1813211ad2bc4f17ae6a65813e) and [Fix sqlite hook

[GitHub] [airflow] boring-cyborg[bot] commented on issue #29128: [Doc] Link to examples how to use FTP provider is incorrect

boring-cyborg[bot] commented on issue #29128: URL: https://github.com/apache/airflow/issues/29128#issuecomment-1401832179 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] Draqun opened a new issue, #29128: [Doc] Link to examples how to use FTP provider is incorrect

Draqun opened a new issue, #29128: URL: https://github.com/apache/airflow/issues/29128 ### What do you see as an issue? HI. I tried to use FTP provider (https://airflow.apache.org/docs/apache-airflow-providers-ftp/stable/connections/ftp.html#howto-connection-ftp) but link to the

[GitHub] [airflow] hamedhsn commented on pull request #22253: Add SparkKubernetesOperator crd implementation

hamedhsn commented on PR #22253: URL: https://github.com/apache/airflow/pull/22253#issuecomment-1401831471 @potiuk all green now @dstandish can you review pls -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] boring-cyborg[bot] commented on issue #29127: user latest azure-mgmt-containerinstance which depricates network_profiles and adds subnet_ids

boring-cyborg[bot] commented on issue #29127: URL: https://github.com/apache/airflow/issues/29127#issuecomment-1401821646 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] binnisb opened a new issue, #29127: user latest azure-mgmt-containerinstance which depricates network_profiles and adds subnet_ids

binnisb opened a new issue, #29127: URL: https://github.com/apache/airflow/issues/29127 ### Description network_profile has been depricated in container instances. azure-mgmt-containerinstance has added subnet_ids. The operator should move to later version of

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #29126: feat: add Dataproc preemptibility to ClusterGenerator class

boring-cyborg[bot] commented on PR #29126: URL: https://github.com/apache/airflow/pull/29126#issuecomment-1401757678 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] tqtensor opened a new pull request, #29126: feat: add Dataproc preemptibility to ClusterGenerator class

tqtensor opened a new pull request, #29126: URL: https://github.com/apache/airflow/pull/29126 motivation: allowing users to specify the type of VM machine in the `secondary_worker_config`, according to the enum definition from Google's [Dataproc Python

[GitHub] [airflow] vdolez-happn commented on issue #9327: Mark a future task instance to success including downstream tasks using CLI

vdolez-happn commented on issue #9327: URL: https://github.com/apache/airflow/issues/9327#issuecomment-1401749941 Here a future DAG_run represents a DAG_run with an execution_date not yet reached by the scheduler (i.e now < execution_date + dag_period) Here's a *Use Case* for this

[GitHub] [airflow-client-python] ephraimbuddy opened a new pull request, #60: Require at least 1 approval before merging to master

ephraimbuddy opened a new pull request, #60: URL: https://github.com/apache/airflow-client-python/pull/60 I think we should require an approval before merging to master -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[airflow-client-python] branch protect-master created (now e5fb826)

This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch protect-master in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git at e5fb826 Require at least 1 approval before merging to master This branch includes

[airflow-client-python] 01/01: Require at least 1 approval before merging to master

This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch protect-master in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git commit e5fb8267573a2d9520bb6d68b69a6b3a39423589 Author: Ephraim Anierobi AuthorDate: Tue Jan

[GitHub] [airflow-client-python] ephraimbuddy opened a new pull request, #59: Update the release process doc

ephraimbuddy opened a new pull request, #59: URL: https://github.com/apache/airflow-client-python/pull/59 The significant change here is copying the packages from svn into the dist folder instead of rebuilding packages for PyPI upload after voting. 2 other essential changes: 1.

[airflow-client-python] 01/01: Update the release process doc

This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch update-release-process in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git commit fb171e118dfb9d1fbd92a0aa70ece79712113c25 Author: Ephraim Anierobi AuthorDate:

[airflow-client-python] branch update-release-process updated (7c7e643 -> fb171e1)

This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch update-release-process in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git discard 7c7e643 Update the release process doc new fb171e1 Update the release

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #29058: Optionally export `airflow db clean` data to CSV files

ephraimbuddy commented on code in PR #29058: URL: https://github.com/apache/airflow/pull/29058#discussion_r1085074195 ## airflow/cli/cli_parser.py: ## @@ -468,7 +468,18 @@ def string_lower_type(val): help="Don't preserve purged records in an archive table.",

[GitHub] [airflow] boring-cyborg[bot] commented on issue #29124: Implement setup and teardown decorators that only work with an explicit dependency declared

boring-cyborg[bot] commented on issue #29124: URL: https://github.com/apache/airflow/issues/29124#issuecomment-1401670129 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #29058: Optionally export `airflow db clean` data to CSV files

ephraimbuddy commented on code in PR #29058: URL: https://github.com/apache/airflow/pull/29058#discussion_r1085055480 ## airflow/utils/db_cleanup.py: ## @@ -159,6 +170,14 @@ def _do_delete(*, query, orm_model, skip_archive, session): logger.debug("delete statement:\n%s",

[GitHub] [airflow] atharvmishra1999 commented on issue #29113: sqlite conn id unclear

atharvmishra1999 commented on issue #29113: URL: https://github.com/apache/airflow/issues/29113#issuecomment-1401616842 I need a few clarifications here please: 1) from what I understand, I need to make changes in airflow/docs/apache-airflow-providers-sqlite/operators.rst file. Basically

[GitHub] [airflow] raphaelauv opened a new pull request, #29122: fix Google provider CHANGELOG.rst

raphaelauv opened a new pull request, #29122: URL: https://github.com/apache/airflow/pull/29122 typo in the name of the operator in the changelog -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[airflow] branch main updated: Fix TestSsmHooks which is not compatible with `moto==4.1.1` (#29118)

This is an automated email from the ASF dual-hosted git repository. taragolis pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 1166d691fc Fix TestSsmHooks which is not

[GitHub] [airflow] Taragolis merged pull request #29118: Fix TestSsmHooks which is not compatible with `moto==4.1.1`

Taragolis merged PR #29118: URL: https://github.com/apache/airflow/pull/29118 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] talnagar closed issue #29105: graph disappears during run time when using branch_task and a dynamic classic operator

talnagar closed issue #29105: graph disappears during run time when using branch_task and a dynamic classic operator URL: https://github.com/apache/airflow/issues/29105 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] talnagar commented on issue #29105: graph disappears during run time when using branch_task and a dynamic classic operator

talnagar commented on issue #29105: URL: https://github.com/apache/airflow/issues/29105#issuecomment-1401561883 so looks like a duplicate and will be resolved with the next release. thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] ephraimbuddy merged pull request #27829: Improving the release process

ephraimbuddy merged PR #27829: URL: https://github.com/apache/airflow/pull/27829 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] kuikeelc commented on pull request #26993: Fix ti._try_number for deferred and up_for_reschedule tasks

kuikeelc commented on PR #26993: URL: https://github.com/apache/airflow/pull/26993#issuecomment-1401528899 Hi, I am running Apache Airflow 2.5.1, but the problem remains. When you want to watch the log (for which remote_logging is enabled), it tries to watch nr 2 (you see attempt=2.log

<    1   2