Re: [PR] Suppress jaydebeapi.Error when setAutoCommit or getAutoCommit is unsupported by JDBC driver [airflow]

2024-04-10 Thread via GitHub
dabla commented on PR #38707: URL: https://github.com/apache/airflow/pull/38707#issuecomment-2048968598 > > Yes I saw that and I have same issue I think with MSGraphOperator but I don't fully understand how I can fix this :( > > Simply - You can't use code from `airfliow` in

Re: [PR] FIX: Applying airflow queue with spark submit operator is ignored [airflow]

2024-04-10 Thread via GitHub
pateash commented on PR #38852: URL: https://github.com/apache/airflow/pull/38852#issuecomment-2048946813 > Tests are failing https://github.com/apache/airflow/actions/runs/8612286825/job/23601405072?pr=38852#step:7:1943 Fixed -- This is an automated message from the Apache Git

Re: [PR] Fix error when setting try_number from TaskInstancePydantic [airflow]

2024-04-10 Thread via GitHub
dstandish commented on code in PR #38907: URL: https://github.com/apache/airflow/pull/38907#discussion_r1560444913 ## airflow/models/taskinstance.py: ## @@ -539,7 +539,11 @@ def _refresh_from_db( task_instance.end_date = ti.end_date task_instance.duration =

Re: [PR] Fix check of correct dag when remote call for _get_ti [airflow]

2024-04-10 Thread via GitHub
dstandish merged PR #38909: URL: https://github.com/apache/airflow/pull/38909 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated (afe8e82531 -> b90fa78e88)

2024-04-10 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from afe8e82531 Don't wait for DagRun lock in mini scheduler (#38914) add b90fa78e88 Fix check of correct dag when

Re: [PR] Remove unused attr _try_number on TaskInstancePydantic [airflow]

2024-04-10 Thread via GitHub
dstandish closed pull request #38908: Remove unused attr _try_number on TaskInstancePydantic URL: https://github.com/apache/airflow/pull/38908 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Remove unused attr _try_number on TaskInstancePydantic [airflow]

2024-04-10 Thread via GitHub
dstandish commented on PR #38908: URL: https://github.com/apache/airflow/pull/38908#issuecomment-2048930761 closing in favor of #38907 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Fix error when setting try_number from TaskInstancePydantic [airflow]

2024-04-10 Thread via GitHub
dstandish commented on code in PR #38907: URL: https://github.com/apache/airflow/pull/38907#discussion_r1560437167 ## airflow/models/taskinstance.py: ## @@ -539,7 +539,11 @@ def _refresh_from_db( task_instance.end_date = ti.end_date task_instance.duration =

Re: [PR] Fix error when setting try_number from TaskInstancePydantic [airflow]

2024-04-10 Thread via GitHub
dstandish commented on code in PR #38907: URL: https://github.com/apache/airflow/pull/38907#discussion_r1560430449 ## airflow/models/taskinstance.py: ## @@ -539,7 +539,11 @@ def _refresh_from_db( task_instance.end_date = ti.end_date task_instance.duration =

Re: [PR] Fix error when setting try_number from TaskInstancePydantic [airflow]

2024-04-10 Thread via GitHub
uranusjr commented on code in PR #38907: URL: https://github.com/apache/airflow/pull/38907#discussion_r1560429399 ## airflow/models/taskinstance.py: ## @@ -539,7 +539,11 @@ def _refresh_from_db( task_instance.end_date = ti.end_date task_instance.duration =

Re: [PR] [AIP-49] OpenTelemetry Traces for Apache Airflow [airflow]

2024-04-10 Thread via GitHub
uranusjr commented on code in PR #37948: URL: https://github.com/apache/airflow/pull/37948#discussion_r1560428293 ## airflow/dag_processing/manager.py: ## @@ -1029,6 +1051,25 @@ def _collect_results_from_processor(self, processor) -> None: )

Re: [PR] [AIP-49] OpenTelemetry Traces for Apache Airflow [airflow]

2024-04-10 Thread via GitHub
uranusjr commented on code in PR #37948: URL: https://github.com/apache/airflow/pull/37948#discussion_r1560427149 ## airflow/traces/tracer.py: ## @@ -0,0 +1,280 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See

Re: [PR] Fix check of correct dag when remote call for _get_ti [airflow]

2024-04-10 Thread via GitHub
uranusjr commented on PR #38909: URL: https://github.com/apache/airflow/pull/38909#issuecomment-2048902078 The new check is not complete since another DAG can have a task with the same name, but as an internal interface this is probably good enough. We could add `dag_id` as an attribute,

Re: [PR] Fix built query with implicit cartessian product in `AirflowSecurityManagerV2` [airflow]

2024-04-10 Thread via GitHub
uranusjr commented on code in PR #38913: URL: https://github.com/apache/airflow/pull/38913#discussion_r1560404962 ## airflow/www/security_manager.py: ## @@ -200,7 +200,7 @@ def get_dag_id_from_task_instance(resource_pk): return None composite_pk =

Re: [PR] Allow sort by on all fields in MappedInstances.tsx [airflow]

2024-04-10 Thread via GitHub
uranusjr commented on code in PR #38090: URL: https://github.com/apache/airflow/pull/38090#discussion_r1560397252 ## airflow/api_connexion/endpoints/task_instance_endpoint.py: ## @@ -239,16 +239,32 @@ def get_mapped_task_instances(

Re: [PR] Bugfix: Move rendering of `map_index_template` so it renders for failed tasks as long as it was defined before the point of failure [airflow]

2024-04-10 Thread via GitHub
uranusjr commented on code in PR #38902: URL: https://github.com/apache/airflow/pull/38902#discussion_r1560385357 ## airflow/models/taskinstance.py: ## @@ -2715,29 +2727,26 @@ def signal_handler(signum, frame): # Execute the task with

(airflow) branch main updated: Don't wait for DagRun lock in mini scheduler (#38914)

2024-04-10 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new afe8e82531 Don't wait for DagRun lock in mini

Re: [PR] Don't wait for lock on DagRun in mini scheduler [airflow]

2024-04-10 Thread via GitHub
dstandish merged PR #38914: URL: https://github.com/apache/airflow/pull/38914 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] FIX bug duplicated add base_folder to oss_remote_log_location in oss_wri… [airflow]

2024-04-10 Thread via GitHub
boring-cyborg[bot] commented on PR #38917: URL: https://github.com/apache/airflow/pull/38917#issuecomment-2048851415 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[PR] FIX bug duplicated add base_folder to oss_remote_log_location in oss_wri… [airflow]

2024-04-10 Thread via GitHub
hh-cn opened a new pull request, #38917: URL: https://github.com/apache/airflow/pull/38917 As title said -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] Don't wait for lock on DagRun in mini scheduler [airflow]

2024-04-10 Thread via GitHub
ashb commented on PR #38914: URL: https://github.com/apache/airflow/pull/38914#issuecomment-2048845639 This might have the inverse effect of putting more load on the scheduler as it might end up doing more task expansion -- This is an automated message from the Apache Git Service. To

(airflow) branch main updated: Add retry logic for RPC calls (#38910)

2024-04-10 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new cdc7f19b57 Add retry logic for RPC calls

Re: [PR] Add retry logic for RPC calls [airflow]

2024-04-10 Thread via GitHub
dstandish merged PR #38910: URL: https://github.com/apache/airflow/pull/38910 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Retry if failed from queued should be separate from try_number [airflow]

2024-04-10 Thread via GitHub
Bowrna commented on issue #38304: URL: https://github.com/apache/airflow/issues/38304#issuecomment-2048824149 The retry logic handled here in taskinstance.py. It is failed and therefore checks if its eligible for retry, if yes its queued again. But having another logic like

[PR] Fix bug in LivyOperator when its trigger times out [airflow]

2024-04-10 Thread via GitHub
mateuslatrova opened a new pull request, #38916: URL: https://github.com/apache/airflow/pull/38916 ### Related issue closes: https://github.com/apache/airflow/issues/37898 ### Explain When a LivyOperator was instantiated with deferrable=True and its batch job ran for more

Re: [PR] Fix bug in LivyOperator when its trigger times out [airflow]

2024-04-10 Thread via GitHub
boring-cyborg[bot] commented on PR #38916: URL: https://github.com/apache/airflow/pull/38916#issuecomment-2048741411 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

Re: [I] 401 UNAUTHORIZED when using AUTH_ROLE_PUBLIC = "Admin" [airflow]

2024-04-10 Thread via GitHub
Lee-W commented on issue #38900: URL: https://github.com/apache/airflow/issues/38900#issuecomment-2048640534 Sure  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Add dataset event dataset dag run queue association [airflow]

2024-04-10 Thread via GitHub
github-actions[bot] closed pull request #37424: Add dataset event dataset dag run queue association URL: https://github.com/apache/airflow/pull/37424 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Updated logic to allow AWS Batch Hook `get_job_description` retries to be more effective [airflow]

2024-04-10 Thread via GitHub
github-actions[bot] closed pull request #37552: Updated logic to allow AWS Batch Hook `get_job_description` retries to be more effective URL: https://github.com/apache/airflow/pull/37552 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] WIP Feature/add bq dataset export operator [airflow]

2024-04-10 Thread via GitHub
github-actions[bot] commented on PR #37695: URL: https://github.com/apache/airflow/pull/37695#issuecomment-2048630173 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

Re: [PR] Add four unit tests for aws/utils [airflow]

2024-04-10 Thread via GitHub
slycyberguy commented on PR #38820: URL: https://github.com/apache/airflow/pull/38820#issuecomment-2048617564 > You will need to remove these lines from the project structure tests: > > https://github.com/apache/airflow/blob/main/tests/always/test_project_structure.py#L85-L86

Re: [PR] add templated field support for extra containers [airflow]

2024-04-10 Thread via GitHub
mg-aik commented on PR #38510: URL: https://github.com/apache/airflow/pull/38510#issuecomment-2048575212 Finally, I have been waiting for this one! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] Status of testing Providers that were prepared on April 10, 2024 [airflow]

2024-04-10 Thread via GitHub
stiak commented on issue #38904: URL: https://github.com/apache/airflow/issues/38904#issuecomment-2048558292 #37736 is good. ![Notification_Center](https://github.com/apache/airflow/assets/345934/9da55450-9541-4beb-a813-c6c70b983830) -- This is an automated message from the Apache

[PR] Fix `update-common-sql-api-stubs` pre-commit check [airflow]

2024-04-10 Thread via GitHub
Taragolis opened a new pull request, #38915: URL: https://github.com/apache/airflow/pull/38915 This pre-commit check doesn't run due to wrong path and seems like it doesn't run for a long time. I'm not sure that do we need this stub files, since provider drop support

Re: [I] Status of testing Providers that were prepared on April 10, 2024 [airflow]

2024-04-10 Thread via GitHub
jliu0812 commented on issue #38904: URL: https://github.com/apache/airflow/issues/38904#issuecomment-2048542154 [#38022](https://github.com/apache/airflow/pull/38022) is good. ✅ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] Fix inital value for _batch_id attribute in livy operator [airflow]

2024-04-10 Thread via GitHub
mateuslatrova commented on PR #38628: URL: https://github.com/apache/airflow/pull/38628#issuecomment-2048507160 Thanks for the idea, @potiuk! That makes much more sense. I will try to implement it. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] Change capture warnings output format to the JSON [airflow]

2024-04-10 Thread via GitHub
Taragolis commented on PR #38905: URL: https://github.com/apache/airflow/pull/38905#issuecomment-2048455211 Also add about configuration into the documentation, so worthwhile to check spelling and grammar -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] Fix built query with implicit cartessian product in `AirflowSecurityManagerV2` [airflow]

2024-04-10 Thread via GitHub
Taragolis closed pull request #38913: Fix built query with implicit cartessian product in `AirflowSecurityManagerV2` URL: https://github.com/apache/airflow/pull/38913 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[PR] Fix built query with implicit cartessian product in `AirflowSecurityManagerV2` [airflow]

2024-04-10 Thread via GitHub
Taragolis opened a new pull request, #38913: URL: https://github.com/apache/airflow/pull/38913 Found during analyse warnings from the https://github.com/apache/airflow/pull/38905 In addition raise an error if this warning detected into the Airflow during tests run, same

Re: [PR] Amazon Bedrock - Model Throughput Provisioning [airflow]

2024-04-10 Thread via GitHub
ferruzzi commented on PR #38850: URL: https://github.com/apache/airflow/pull/38850#issuecomment-2048444921 Gah, static check is just a merge issue, imported the sensor twice. Easy fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[PR] Add logic to handle on_kill for BigQueryInsertJobOperator when deferrable=True [airflow]

2024-04-10 Thread via GitHub
sunank200 opened a new pull request, #38912: URL: https://github.com/apache/airflow/pull/38912 - Add logic to handle on_kill for BigQueryInsertJobOperator when `deferrable=True` --- **^ Add meaningful description above** Read the **[Pull Request

Re: [I] Status of testing Providers that were prepared on April 10, 2024 [airflow]

2024-04-10 Thread via GitHub
eladkal commented on issue #38904: URL: https://github.com/apache/airflow/issues/38904#issuecomment-2048383457 > Just figure out that we accidentally exclude #37458 from the changelog. We could add it after the release, because changes itself presented into the released package. Its

Re: [I] Status of testing Providers that were prepared on April 10, 2024 [airflow]

2024-04-10 Thread via GitHub
ellisms commented on issue #38904: URL: https://github.com/apache/airflow/issues/38904#issuecomment-2048377708 #37886 is good. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

(airflow) branch improve-warning-system updated (47322f1722 -> 35b4fd406b)

2024-04-10 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a change to branch improve-warning-system in repository https://gitbox.apache.org/repos/asf/airflow.git discard 47322f1722 Change capture warnings output format to the JSON add 35b4fd406b Change capture

Re: [PR] Change capture warnings output format to the JSON [airflow]

2024-04-10 Thread via GitHub
Taragolis commented on PR #38905: URL: https://github.com/apache/airflow/pull/38905#issuecomment-2048332619 Test `tests/ti_deps/deps/test_mapped_task_upstream_dep.py::test_step_by_step` is so annoying, it failed into the CI on the regular basis in the different PR and I can't still

Re: [PR] Add support for role arn for aws creds in storage transfer job operators [airflow]

2024-04-10 Thread via GitHub
boring-cyborg[bot] commented on PR #38911: URL: https://github.com/apache/airflow/pull/38911#issuecomment-2048325925 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[PR] Add support for role arn for aws creds in storage transfer job operators [airflow]

2024-04-10 Thread via GitHub
wlinamchurch opened a new pull request, #38911: URL: https://github.com/apache/airflow/pull/38911 closes: https://github.com/apache/airflow/issues/35271 related: Attempt to fix tests and checks from https://github.com/apache/airflow/pull/35292 This PR adds support

Re: [PR] [AIP-49] OpenTelemetry Traces for Apache Airflow [airflow]

2024-04-10 Thread via GitHub
dstandish commented on PR #37948: URL: https://github.com/apache/airflow/pull/37948#issuecomment-2048324458 Yeah @howardyoo I think it's a good practice and will result in fewer errors. Big bang PRs, while sometimes necessary, have a tendency for things to fall between the cracks, bugs

[PR] Add retry logic for RPC calls [airflow]

2024-04-10 Thread via GitHub
dstandish opened a new pull request, #38910: URL: https://github.com/apache/airflow/pull/38910 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] Remove unused attr _try_number on TaskInstancePydantic [airflow]

2024-04-10 Thread via GitHub
dstandish opened a new pull request, #38908: URL: https://github.com/apache/airflow/pull/38908 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] Fix error when setting try_number from TaskInstancePydantic [airflow]

2024-04-10 Thread via GitHub
dstandish opened a new pull request, #38907: URL: https://github.com/apache/airflow/pull/38907 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] Do not log event when using db isolation [airflow]

2024-04-10 Thread via GitHub
dstandish opened a new pull request, #38906: URL: https://github.com/apache/airflow/pull/38906 Eventually we need to fix this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] Status of testing Providers that were prepared on April 10, 2024 [airflow]

2024-04-10 Thread via GitHub
gschuurman commented on issue #38904: URL: https://github.com/apache/airflow/issues/38904#issuecomment-2048281921 #38872 login is working as expected again with both email set and unset -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] Add option for ExternalTaskSensor to automatically infer upstream execution dates [airflow]

2024-04-10 Thread via GitHub
jannisko commented on PR #38542: URL: https://github.com/apache/airflow/pull/38542#issuecomment-2048276970 Fair point. Thank you for the hint. @hussein-awala @uranusjr I see you two have been touching the sensor every once in a while. Do you mind taking a look?  -- This is an

Re: [PR] Change capture warnings output format to the JSON [airflow]

2024-04-10 Thread via GitHub
Taragolis closed pull request #38905: Change capture warnings output format to the JSON URL: https://github.com/apache/airflow/pull/38905 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Change capture warnings output format to the JSON [airflow]

2024-04-10 Thread via GitHub
mergeable[bot] commented on PR #38905: URL: https://github.com/apache/airflow/pull/38905#issuecomment-2048218996 :x: Error Occurred while executing an Action If you believe this is an unexpected error, please report it on our issue tracker:

Re: [PR] Change capture warnings output format to the JSON [airflow]

2024-04-10 Thread via GitHub
mergeable[bot] commented on PR #38905: URL: https://github.com/apache/airflow/pull/38905#issuecomment-2048215410 :x: Error Occurred while executing an Action If you believe this is an unexpected error, please report it on our issue tracker:

Re: [I] Status of testing Providers that were prepared on April 10, 2024 [airflow]

2024-04-10 Thread via GitHub
Taragolis commented on issue #38904: URL: https://github.com/apache/airflow/issues/38904#issuecomment-2048213174 Just figure out that we accidentally exclude https://github.com/apache/airflow/pull/37458 from the changelog. We could add it after the release, because changes itself presented

[PR] Change capture warnings output format to the JSON [airflow]

2024-04-10 Thread via GitHub
Taragolis opened a new pull request, #38905: URL: https://github.com/apache/airflow/pull/38905 This PR is a result of complete rework on warning capture system: - Pass parameters from the pytest configurations - Trim path to the project root or sites - Keep

Re: [I] Status of testing Providers that were prepared on April 10, 2024 [airflow]

2024-04-10 Thread via GitHub
pdebelak commented on issue #38904: URL: https://github.com/apache/airflow/issues/38904#issuecomment-2048195024 I can confirm that my change to cncf.kubernetes is working as expected. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

(airflow) 01/01: Change capture warnings output format to the JSON

2024-04-10 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a commit to branch improve-warning-system in repository https://gitbox.apache.org/repos/asf/airflow.git commit 47322f1722798509ca2ffcadd83ff73dc244cd18 Author: Andrey Anshin AuthorDate: Mon Apr 8 16:18:02 2024

(airflow) branch improve-warning-system created (now 47322f1722)

2024-04-10 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a change to branch improve-warning-system in repository https://gitbox.apache.org/repos/asf/airflow.git at 47322f1722 Change capture warnings output format to the JSON This branch includes the following

Re: [PR] Amazon Bedrock - Model Throughput Provisioning [airflow]

2024-04-10 Thread via GitHub
ferruzzi commented on PR #38850: URL: https://github.com/apache/airflow/pull/38850#issuecomment-2048127209 Dependency merged; I'll get this rebased on top of that one and merge it this afternoon. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] Amazon Bedrock - Fix system test [airflow]

2024-04-10 Thread via GitHub
ferruzzi merged PR #38887: URL: https://github.com/apache/airflow/pull/38887 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Amazon Bedrock - Fix system test (#38887)

2024-04-10 Thread ferruzzi
This is an automated email from the ASF dual-hosted git repository. ferruzzi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b6ff085679 Amazon Bedrock - Fix system test

Re: [PR] Always use the executemany method when inserting rows in DbApiHook as it's way much faster [airflow]

2024-04-10 Thread via GitHub
uranusjr commented on code in PR #38715: URL: https://github.com/apache/airflow/pull/38715#discussion_r1559820105 ## airflow/providers/common/sql/hooks/sql.py: ## @@ -147,14 +147,23 @@ class DbApiHook(BaseHook): default_conn_name = "default_conn_id" # Override if this

Re: [PR] Suppress jaydebeapi.Error when setAutoCommit or getAutoCommit is unsupported by JDBC driver [airflow]

2024-04-10 Thread via GitHub
potiuk commented on PR #38707: URL: https://github.com/apache/airflow/pull/38707#issuecomment-2048066159 > Yes I saw that and I have same issue I think with MSGraphOperator but I don't fully understand how I can fix this :( Simply - You can't use code from `airfliow` in providers

Re: [PR] Suppress jaydebeapi.Error when setAutoCommit or getAutoCommit is unsupported by JDBC driver [airflow]

2024-04-10 Thread via GitHub
dabla commented on PR #38707: URL: https://github.com/apache/airflow/pull/38707#issuecomment-2048041234 > There is a problem with back-compatibility. Our providers work for `Airflow >= 2.6.0` - see the errrors raised in tests - it cannot be imported from Airlfow until we keep 2.10.0

Re: [PR] Update _index.md [airflow-site]

2024-04-10 Thread via GitHub
dabla closed pull request #933: Update _index.md URL: https://github.com/apache/airflow-site/pull/933 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Update _index.md [airflow-site]

2024-04-10 Thread via GitHub
dabla commented on PR #933: URL: https://github.com/apache/airflow-site/pull/933#issuecomment-2048037537 > I think we can close this PR in favor of [apache/airflow#38111](https://github.com/apache/airflow/pull/38111) ? Hey Elad yes this one can be closed. -- This is an automated

Re: [PR] Replace dill package to use cloudpickle [airflow]

2024-04-10 Thread via GitHub
potiuk commented on code in PR #38531: URL: https://github.com/apache/airflow/pull/38531#discussion_r1559780893 ## airflow/models/taskinstance.py: ## @@ -1287,7 +1287,7 @@ class TaskInstance(Base, LoggingMixin): queued_dttm = Column(UtcDateTime) queued_by_job_id =

[I] Status of testing Providers that were prepared on April 10, 2024 [airflow]

2024-04-10 Thread via GitHub
eladkal opened a new issue, #38904: URL: https://github.com/apache/airflow/issues/38904 ### Body I have a kind request for all the contributors to the latest provider packages release. Could you please help us to test the RC versions of the providers? The guidelines on how

[PR] Add documentation for packages - 2024-04-10 [airflow-site]

2024-04-10 Thread via GitHub
eladkal opened a new pull request, #1003: URL: https://github.com/apache/airflow-site/pull/1003 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

(airflow-site) branch add-documentation-2024-04-10 created (now 308355acab)

2024-04-10 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch add-documentation-2024-04-10 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at 308355acab Add documentation for packages - 2024-04-10 No new revisions were added by

Re: [PR] Always use the executemany method when inserting rows in DbApiHook as it's way much faster [airflow]

2024-04-10 Thread via GitHub
potiuk commented on PR #38715: URL: https://github.com/apache/airflow/pull/38715#issuecomment-2047988974 Much nicer now -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

svn commit: r68420 [1/2] - /dev/airflow/providers/

2024-04-10 Thread eladkal
Author: eladkal Date: Wed Apr 10 16:03:40 2024 New Revision: 68420 Log: Add artifacts for Airflow Providers 2024-04-10 Added: dev/airflow/providers/apache_airflow_providers_airbyte-3.7.0-py3-none-any.whl (with props)

svn commit: r68420 [2/2] - /dev/airflow/providers/

2024-04-10 Thread eladkal
Added: dev/airflow/providers/apache_airflow_providers_odbc-4.5.0-py3-none-any.whl.sha512 == --- dev/airflow/providers/apache_airflow_providers_odbc-4.5.0-py3-none-any.whl.sha512 (added) +++

Re: [PR] Fix typo in README [airflow]

2024-04-10 Thread via GitHub
eladkal merged PR #38903: URL: https://github.com/apache/airflow/pull/38903 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Fix typo in README (#38903)

2024-04-10 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 3d804351aa Fix typo in README (#38903) 3d804351aa

Re: [PR] Prepare docs 1st wave (RC1) April 2024 [airflow]

2024-04-10 Thread via GitHub
eladkal merged PR #38863: URL: https://github.com/apache/airflow/pull/38863 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] Fix typo in README [airflow]

2024-04-10 Thread via GitHub
vincbeck opened a new pull request, #38903: URL: https://github.com/apache/airflow/pull/38903 The provider `aws` does not exist, it is `amazon` --- **^ Add meaningful description above** Read the **[Pull Request

Re: [I] 401 UNAUTHORIZED when using AUTH_ROLE_PUBLIC = "Admin" [airflow]

2024-04-10 Thread via GitHub
phanikumv commented on issue #38900: URL: https://github.com/apache/airflow/issues/38900#issuecomment-2047837967 cc @Lee-W could you please look into it tomorrow -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[PR] Bugfix: Move rendering of `map_index_template` so it renders for failed tasks as long as it was defined before the point of failure [airflow]

2024-04-10 Thread via GitHub
TJaniF opened a new pull request, #38902: URL: https://github.com/apache/airflow/pull/38902 In Airflow 2.9 `map_index_template` does not render when the task fails. ![image](https://github.com/apache/airflow/assets/90063506/6c4b0398-7ce1-405b-add8-8c03399f76c8) I moved the

[I] airflow hashicorp vault integration - path with subfolder is not wokring [airflow]

2024-04-10 Thread via GitHub
Gaurang033 opened a new issue, #38901: URL: https://github.com/apache/airflow/issues/38901 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.5.3 ### What happened? I am trying

[I] 401 UNAUTHORIZED when using AUTH_ROLE_PUBLIC = "Admin" [airflow]

2024-04-10 Thread via GitHub
dstandish opened a new issue, #38900: URL: https://github.com/apache/airflow/issues/38900 ### Body When using ``` AUTH_ROLE_PUBLIC = 'Admin' ``` And not logged in... Some webserver endpoints return 401 UNAUTHORIZED E.g.

[PR] Expose count of scheduled tasks in metrics [airflow]

2024-04-10 Thread via GitHub
jonshea opened a new pull request, #38899: URL: https://github.com/apache/airflow/pull/38899 This pull request introduces a new metric that tracks the number of tasks in the SCHEDULED state. This can help with monitoring and debugging situations where tasks are stuck or otherwise

[I] Add multiples repository in gitsync helm charts [airflow]

2024-04-10 Thread via GitHub
theotruvelot opened a new issue, #38898: URL: https://github.com/apache/airflow/issues/38898 ### Description Hello ! Can you add the feature to add multiples repository for gitsync in the helm chart ### Use case/motivation Because I got multiples repository for

Re: [I] Add multiples repository in gitsync helm charts [airflow]

2024-04-10 Thread via GitHub
boring-cyborg[bot] commented on issue #38898: URL: https://github.com/apache/airflow/issues/38898#issuecomment-2047751789 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

(airflow) branch main updated (34878507ef -> 1608231993)

2024-04-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 34878507ef Widen cheat sheet column to avoid wrapping commands (#3) add 1608231993 Add multi-team diagrams

Re: [PR] Add multi-team diagrams [airflow]

2024-04-10 Thread via GitHub
potiuk merged PR #38861: URL: https://github.com/apache/airflow/pull/38861 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch constraints-main updated: Updating constraints. Github run id:8632236281

2024-04-10 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 568037b72b Updating

(airflow-site) branch gh-pages updated (46289ab974 -> d676dd8530)

2024-04-10 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch gh-pages in repository https://gitbox.apache.org/repos/asf/airflow-site.git discard 46289ab974 Rewritten history to remove past gh-pages deployments new d676dd8530 Rewritten history to

Re: [PR] [AIP-49] OpenTelemetry Traces for Apache Airflow [airflow]

2024-04-10 Thread via GitHub
potiuk commented on PR #37948: URL: https://github.com/apache/airflow/pull/37948#issuecomment-2047713345 That works, maybe even split it to smaller pieces. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Validate dbt `trigger_reason` field to be less than 255 characters [airflow]

2024-04-10 Thread via GitHub
boraberke commented on PR #38896: URL: https://github.com/apache/airflow/pull/38896#issuecomment-2047689569 Hey @josh-fell, would greatly appreciate your thoughts and suggestions on this! -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] bump uv to 0.1.31 [airflow]

2024-04-10 Thread via GitHub
potiuk commented on PR #38874: URL: https://github.com/apache/airflow/pull/38874#issuecomment-2047688734 Sure :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] Validate dbt `trigger_reason` field to be less than 255 characters [airflow]

2024-04-10 Thread via GitHub
boraberke opened a new pull request, #38896: URL: https://github.com/apache/airflow/pull/38896 Validate and truncate `trigger_reason` field if it is longer than the limit of 255 characters. closes: #34676 -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] add log for running callback [airflow]

2024-04-10 Thread via GitHub
romsharon98 commented on code in PR #38892: URL: https://github.com/apache/airflow/pull/38892#discussion_r1559532674 ## tests/models/test_taskinstance.py: ## @@ -2856,8 +2856,9 @@ def on_execute_callable(context): ], ) @patch("logging.Logger.exception") +

Re: [PR] Resolve internal warnings for TestLocalTaskJob and TestSigTermOnRunner [airflow]

2024-04-10 Thread via GitHub
Owen-CH-Leung commented on code in PR #38893: URL: https://github.com/apache/airflow/pull/38893#discussion_r1559514632 ## tests/jobs/test_local_task_job.py: ## @@ -886,53 +907,53 @@ def test_process_sigterm_works_with_retries( execution_date = DEFAULT_DATE

Re: [PR] [Landing pages] Replace use case video iframes with links [airflow-site]

2024-04-10 Thread via GitHub
potiuk commented on PR #1002: URL: https://github.com/apache/airflow-site/pull/1002#issuecomment-2047642637 proably best choice -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

(airflow-site) branch main updated: [Landing pages] Replace use case video iframes with links (#1002)

2024-04-10 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new b6ce741de7 [Landing pages] Replace use case

  1   2   >