[GitHub] [airflow] uranusjr commented on a diff in pull request #33242: Index optimized fast path to avoid slower groupby queryplan

2023-08-14 Thread via GitHub
uranusjr commented on code in PR #33242: URL: https://github.com/apache/airflow/pull/33242#discussion_r1293530440 ## airflow/models/dag.py: ## @@ -2925,21 +2925,44 @@ def bulk_write_to_db( # Skip these queries entirely if no DAGs can be scheduled to save time.

[GitHub] [airflow] ellisms commented on pull request #33219: Added Amazon SageMaker Notebook hook and operators

2023-08-14 Thread via GitHub
ellisms commented on PR #33219: URL: https://github.com/apache/airflow/pull/33219#issuecomment-1677545694 Updated the PR with the suggested changes, except the file location for the operator. Open to feedback on whether to integrate into the existing sageMaker file, or leave as-is. --

[GitHub] [airflow] joshowen commented on a diff in pull request #33242: Index optimized fast path to avoid slower groupby queryplan

2023-08-14 Thread via GitHub
joshowen commented on code in PR #33242: URL: https://github.com/apache/airflow/pull/33242#discussion_r1293671824 ## airflow/models/dag.py: ## @@ -2925,21 +2925,44 @@ def bulk_write_to_db( # Skip these queries entirely if no DAGs can be scheduled to save time.

[airflow] branch main updated: Add better instructions to constraint files (#33367)

2023-08-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b8cdd284dd Add better instructions to constraint

[GitHub] [airflow] potiuk merged pull request #33367: Add better instructions to constraint files

2023-08-14 Thread via GitHub
potiuk merged PR #33367: URL: https://github.com/apache/airflow/pull/33367 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] Taragolis commented on a diff in pull request #32919: Fix `link_names` parameter not being passed to hook in `SlackWebhookOperator`

2023-08-14 Thread via GitHub
Taragolis commented on code in PR #32919: URL: https://github.com/apache/airflow/pull/32919#discussion_r1294197241 ## airflow/providers/slack/operators/slack_webhook.py: ## @@ -169,6 +169,6 @@ def execute(self, context: Context) -> None: username=self.username,

[GitHub] [airflow] Owen-CH-Leung commented on a diff in pull request #33306: Add istio test, use curl /quitquitquit to exit sidecar, and some othe…

2023-08-14 Thread via GitHub
Owen-CH-Leung commented on code in PR #33306: URL: https://github.com/apache/airflow/pull/33306#discussion_r1294127625 ## airflow/providers/cncf/kubernetes/utils/pod_manager.py: ## @@ -508,17 +522,21 @@ def await_container_completion(self, pod: V1Pod, container_name: str) ->

[GitHub] [airflow] uranusjr commented on a diff in pull request #33397: Remove `supports_ad_hoc_ti_run` from executor API

2023-08-14 Thread via GitHub
uranusjr commented on code in PR #33397: URL: https://github.com/apache/airflow/pull/33397#discussion_r1294139049 ## airflow/executors/base_executor.py: ## @@ -104,7 +104,6 @@ class BaseExecutor(LoggingMixin): :param parallelism: how many jobs should run at one time. Set

[airflow] branch main updated: Enable D205 Support (#33398)

2023-08-14 Thread ferruzzi
This is an automated email from the ASF dual-hosted git repository. ferruzzi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new a1e42f6626 Enable D205 Support (#33398)

[GitHub] [airflow] ferruzzi merged pull request #33398: Enable D205 Support

2023-08-14 Thread via GitHub
ferruzzi merged PR #33398: URL: https://github.com/apache/airflow/pull/33398 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ferruzzi commented on pull request #33398: Enable D205 Support

2023-08-14 Thread via GitHub
ferruzzi commented on PR #33398: URL: https://github.com/apache/airflow/pull/33398#issuecomment-1678407852 > Yay! I appreciate the reviews and suggestions you gave along the way! -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[airflow] 04/07: Add better instructions to constraint files (#33367)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit f170861c4315846ffcda3a885f5e3dbb737b136b Author: Jarek Potiuk AuthorDate: Mon Aug 14 17:59:26 2023 +0200

[airflow] 07/07: fixup! Update RELEASE_NOTES.rst

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 206699d059264b3c2ed5c7bb67e2960f4e592998 Author: Ephraim Anierobi AuthorDate: Mon Aug 14 12:16:57 2023

[airflow] branch v2-7-test updated (66072ce433 -> 206699d059)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit 66072ce433 fixup! Update RELEASE_NOTES.rst new 21ecb41ff6 Bring back the decision buttons on DAG

[airflow] 01/07: Bring back the decision buttons on DAG trigger (#33394)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 21ecb41ff6a06a4d9fb34a96b5ef1fb469e7b4f0 Author: Ephraim Anierobi AuthorDate: Mon Aug 14 21:58:53 2023

[airflow] 05/07: Restore `--builder` command for cache building (#33387)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit bade0efeb9efa59fe92c35b1f253bb932170d7c0 Author: Jarek Potiuk AuthorDate: Mon Aug 14 11:26:44 2023 +0200

[airflow] 06/07: Fix eager upgrade failures for canary builds (#33395)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 119407d81990e61a1983b287234f5806d70efdf0 Author: Jarek Potiuk AuthorDate: Mon Aug 14 22:09:52 2023 +0200

[airflow] branch main updated: D205 Support - Stragglers (#33301)

2023-08-14 Thread uranusjr
This is an automated email from the ASF dual-hosted git repository. uranusjr pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 9bf68adfa0 D205 Support - Stragglers (#33301)

[GitHub] [airflow] uranusjr merged pull request #33301: D205 Support - Stragglers

2023-08-14 Thread via GitHub
uranusjr merged PR #33301: URL: https://github.com/apache/airflow/pull/33301 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ferruzzi opened a new pull request, #33398: Enable D205 Support

2023-08-14 Thread via GitHub
ferruzzi opened a new pull request, #33398: URL: https://github.com/apache/airflow/pull/33398 Part of https://github.com/apache/airflow/issues/10742 D205 asserts that all docstrings must have a one-line summary ending in a period. If there is more than one sentence then there must be

[GitHub] [airflow] uranusjr commented on pull request #33309: Limit connection resources used in mapped tasks

2023-08-14 Thread via GitHub
uranusjr commented on PR #33309: URL: https://github.com/apache/airflow/pull/33309#issuecomment-1678419127 I’m having second thoughts. If this works, why can’t we just pass the `session` all the way from `_run_raw_task` into `render_template_fields` instead? The fact we could not do this

[GitHub] [airflow] uranusjr commented on pull request #33242: Index optimized fast path to avoid slower groupby queryplan

2023-08-14 Thread via GitHub
uranusjr commented on PR #33242: URL: https://github.com/apache/airflow/pull/33242#issuecomment-1678457291 I think we need a test case to cover the one DAG case. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow-site] eladkal merged pull request #847: Add documentation for packages - 2023-08-11

2023-08-14 Thread via GitHub
eladkal merged PR #847: URL: https://github.com/apache/airflow-site/pull/847 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow-site] branch add-documentation-2023-08-11 deleted (was a3062e832d)

2023-08-14 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch add-documentation-2023-08-11 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was a3062e832d Add documentation for packages - 2023-08-11 The revisions that were on this

[GitHub] [airflow] amoghrajesh opened a new pull request, #33381: Adding typing for KPO SCC objects

2023-08-14 Thread via GitHub
amoghrajesh opened a new pull request, #33381: URL: https://github.com/apache/airflow/pull/33381 Some K8S objects used in airflow code do not use typing as recommended by the client code. Adding typing for SCC objects. Will create future PRs in case I find more of these.

[GitHub] [airflow] eladkal closed issue #33305: Status of testing Providers that were prepared on August 11, 2023

2023-08-14 Thread via GitHub
eladkal closed issue #33305: Status of testing Providers that were prepared on August 11, 2023 URL: https://github.com/apache/airflow/issues/33305 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] eladkal commented on issue #33305: Status of testing Providers that were prepared on August 11, 2023

2023-08-14 Thread via GitHub
eladkal commented on issue #33305: URL: https://github.com/apache/airflow/issues/33305#issuecomment-1676732549 Thank you everyone. Providers are released I invite everyone to help improve providers for the next release, a list of open issues can be found

[GitHub] [airflow] potiuk merged pull request #33380: Adding typing for a KPO test

2023-08-14 Thread via GitHub
potiuk merged PR #33380: URL: https://github.com/apache/airflow/pull/33380 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Adding typing for a KPO test (#33380)

2023-08-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 72c489da5e Adding typing for a KPO test (#33380)

[airflow] branch main updated: Introducing class constant to make worker pod log lines configurable (#33378)

2023-08-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 38aada7b8b Introducing class constant to make

[GitHub] [airflow] potiuk merged pull request #33378: Introducing class constant to make worker pod log lines configurable

2023-08-14 Thread via GitHub
potiuk merged PR #33378: URL: https://github.com/apache/airflow/pull/33378 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on a diff in pull request #33364: Improve handling of CI image timeout when backtracking

2023-08-14 Thread via GitHub
potiuk commented on code in PR #33364: URL: https://github.com/apache/airflow/pull/33364#discussion_r1293025525 ## Dockerfile.ci: ## @@ -1334,7 +1334,7 @@ ARG CASS_DRIVER_NO_CYTHON="1" # Build cassandra driver on multiple CPUs ARG CASS_DRIVER_BUILD_CONCURRENCY="8" -ARG

[GitHub] [airflow] potiuk merged pull request #33160: Refactor: Simplify code in configuration.py

2023-08-14 Thread via GitHub
potiuk merged PR #33160: URL: https://github.com/apache/airflow/pull/33160 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on a diff in pull request #33364: Improve handling of CI image timeout when backtracking

2023-08-14 Thread via GitHub
potiuk commented on code in PR #33364: URL: https://github.com/apache/airflow/pull/33364#discussion_r1293015201 ## Dockerfile.ci: ## @@ -1334,7 +1334,7 @@ ARG CASS_DRIVER_NO_CYTHON="1" # Build cassandra driver on multiple CPUs ARG CASS_DRIVER_BUILD_CONCURRENCY="8" -ARG

[GitHub] [airflow] phanikumv closed issue #33368: Preview feature broken for ./BREEZE.rst

2023-08-14 Thread via GitHub
phanikumv closed issue #33368: Preview feature broken for ./BREEZE.rst URL: https://github.com/apache/airflow/issues/33368 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] phanikumv commented on issue #33368: Preview feature broken for ./BREEZE.rst

2023-08-14 Thread via GitHub
phanikumv commented on issue #33368: URL: https://github.com/apache/airflow/issues/33368#issuecomment-1676742926 Closing as https://github.com/apache/airflow/pull/33369 has been merged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] potiuk commented on pull request #33364: Improve handling of CI image timeout when backtracking

2023-08-14 Thread via GitHub
potiuk commented on PR #33364: URL: https://github.com/apache/airflow/pull/33364#issuecomment-1676759330 Applied comment + rebased. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[airflow] branch main updated: Refactor: Simplify code in configuration.py (#33160)

2023-08-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 21656fcfe8 Refactor: Simplify code in

[GitHub] [airflow] potiuk commented on a diff in pull request #33306: Add istio test, use curl /quitquitquit to exit sidecar, and some othe…

2023-08-14 Thread via GitHub
potiuk commented on code in PR #33306: URL: https://github.com/apache/airflow/pull/33306#discussion_r1293037535 ## airflow/providers/cncf/kubernetes/utils/pod_manager.py: ## @@ -508,17 +522,21 @@ def await_container_completion(self, pod: V1Pod, container_name: str) -> None:

[GitHub] [airflow] potiuk commented on issue #33373: TimeDeltaSensor suggestion

2023-08-14 Thread via GitHub
potiuk commented on issue #33373: URL: https://github.com/apache/airflow/issues/33373#issuecomment-1676784684 I think - if you **really** have problem with calculating your time in JINJA - better approach would be to add an optional `delta` parameter in TimeSensor. TimeDeltaSensor is

[GitHub] [airflow] potiuk opened a new issue, #33382: Flaky TestDatabricksExecutionTrigger.test_sleep_between_retries

2023-08-14 Thread via GitHub
potiuk opened a new issue, #33382: URL: https://github.com/apache/airflow/issues/33382 ### Body Seems that it has been starting happening affter https://github.com/apache/airflow/pull/31703 Worth looking at @aa3pankaj

[GitHub] [airflow] hussein-awala commented on pull request #33142: Allow templating webserver ingress hostnames

2023-08-14 Thread via GitHub
hussein-awala commented on PR #33142: URL: https://github.com/apache/airflow/pull/33142#issuecomment-1676878891 I'm a bit late! I opened #33384 to change the used function. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] VladaZakharova opened a new pull request, #33385: Fix Storage Transfer system tests

2023-08-14 Thread via GitHub
VladaZakharova opened a new pull request, #33385: URL: https://github.com/apache/airflow/pull/33385 --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] VladaZakharova opened a new pull request, #33386: Fix Cloud Worflows system test

2023-08-14 Thread via GitHub
VladaZakharova opened a new pull request, #33386: URL: https://github.com/apache/airflow/pull/33386 - fix path in the link to Cloud Worklow - change type casting for Worflow execution start_time argument: there was an error when calling old type cast on DatetimeWithNanoseconds

[GitHub] [airflow] hussein-awala commented on a diff in pull request #33381: Adding typing for KPO SCC objects

2023-08-14 Thread via GitHub
hussein-awala commented on code in PR #33381: URL: https://github.com/apache/airflow/pull/33381#discussion_r1293186034 ## airflow/providers/cncf/kubernetes/operators/pod.py: ## @@ -296,8 +296,8 @@ def __init__( service_account_name: str | None = None,

[GitHub] [airflow] VladaZakharova commented on a diff in pull request #33315: Merge system tests for CloudSQLExportInstanceOperator into one test

2023-08-14 Thread via GitHub
VladaZakharova commented on code in PR #33315: URL: https://github.com/apache/airflow/pull/33315#discussion_r1293054381 ## tests/system/providers/google/cloud/cloud_sql/example_cloud_sql.py: ## @@ -51,12 +51,14 @@ PROJECT_ID = os.environ.get("SYSTEM_TESTS_GCP_PROJECT") DAG_ID

[GitHub] [airflow] potiuk merged pull request #33142: Allow templating webserver ingress hostnames

2023-08-14 Thread via GitHub
potiuk merged PR #33142: URL: https://github.com/apache/airflow/pull/33142 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Allow templating webserver ingress hostnames (#33142)

2023-08-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 2976a56f85 Allow templating webserver ingress

[GitHub] [airflow] shalberd commented on pull request #30214: Added support for using SHA digest of Docker images.

2023-08-14 Thread via GitHub
shalberd commented on PR #30214: URL: https://github.com/apache/airflow/pull/30214#issuecomment-1676823360 @jedcunningham is there a specific reason to include digest notation for airflow only, not for all the other potential images used? statsd, git-sync, and so on? -- This is an

[GitHub] [airflow] hussein-awala opened a new pull request, #33384: Replace `common.tplvalues.render` by `tpl` in ingress template files

2023-08-14 Thread via GitHub
hussein-awala opened a new pull request, #33384: URL: https://github.com/apache/airflow/pull/33384 related: #33142 This PR replaces the complicated syntax of `common.tplvalues.render` by a simpler one based on `tpl`. --- **^ Add meaningful description

[GitHub] [airflow] potiuk merged pull request #33364: Improve handling of CI image timeout when backtracking

2023-08-14 Thread via GitHub
potiuk merged PR #33364: URL: https://github.com/apache/airflow/pull/33364 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk opened a new pull request, #33387: Restore `--builder` command for cache building

2023-08-14 Thread via GitHub
potiuk opened a new pull request, #33387: URL: https://github.com/apache/airflow/pull/33387 The change #33364 removed accidentally --builder command that has been used in CI to build image cache. This PR restores it and also moves it to the "cache" option group where it belongs.

[GitHub] [airflow] hussein-awala commented on a diff in pull request #32847: Update Error details for Generic Error Code

2023-08-14 Thread via GitHub
hussein-awala commented on code in PR #32847: URL: https://github.com/apache/airflow/pull/32847#discussion_r1293049923 ## airflow/providers/google/cloud/hooks/dataflow.py: ## @@ -1014,8 +1014,12 @@ def start_sql_job( self.log.info("Output: %s", proc.stdout.decode())

[GitHub] [airflow] uranusjr commented on a diff in pull request #33242: Index optimized fast path to avoid slower groupby queryplan

2023-08-14 Thread via GitHub
uranusjr commented on code in PR #33242: URL: https://github.com/apache/airflow/pull/33242#discussion_r1293050158 ## airflow/models/dag.py: ## @@ -2925,21 +2925,44 @@ def bulk_write_to_db( # Skip these queries entirely if no DAGs can be scheduled to save time.

[airflow] 01/09: Enable test connection in UI if explicitly set to `Enabled` (#33342)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit eda4bc4b87deb6095cb009825ace9bf87eead369 Author: Pankaj Koti AuthorDate: Sat Aug 12 18:57:36 2023 +0530

[airflow] 07/09: Clarify UI user types in security model (#33021)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 5ae23ebe1c440103a7f65563933dd258c7f207c8 Author: Jed Cunningham

[airflow] 04/09: Fix clearing behavior for downstream work task with non-collinear setup task (#33358)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 1b0b952bb37384e3318f8bf4d97c47c5ed7cd79c Author: Daniel Standish

[airflow] branch v2-7-test updated (84a5e464dc -> f5d8201ea7)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git from 84a5e464dc Update RELEASE_NOTES.rst new eda4bc4b87 Enable test connection in UI if explicitly set

[airflow] 09/09: Remove user sessions when resetting password (#33347)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit f5d8201ea7935d17cecaf25fc90d4ef0ccdd627b Author: Jarek Potiuk AuthorDate: Sun Aug 13 21:21:43 2023 +0200

[airflow] 05/09: Rename `ExternalBranchPythonOperator` to `BranchExternalPythonOperator` (#33360)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit e690f5c56158ce61f9b9183713529bbb8296d4de Author: Elad Kalif <45845474+elad...@users.noreply.github.com>

[airflow] 03/09: Make skip of trigger form in UI if no params are defined configurable (#33351)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 1cb3e52bb2a128f95f826952344926fbd76eceb1 Author: Jens Scheffler

[airflow] 06/09: Limit aiobotocore for eager upgrade to prevent pip backtracking (#33362)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit cbcf8bc207f161ea1755cc2b1fa9c8a47d2e3477 Author: Jarek Potiuk AuthorDate: Sun Aug 13 11:50:53 2023 +0200

[GitHub] [airflow] potiuk merged pull request #33387: Restore `--builder` command for cache building

2023-08-14 Thread via GitHub
potiuk merged PR #33387: URL: https://github.com/apache/airflow/pull/33387 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] 02/09: Modify pathspec version restriction (#33349)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 9405b081d7e85ef9fe971f8322f56246fe6418a4 Author: Kevin Mills <35641675+mill...@users.noreply.github.com>

[airflow] 08/09: Fix links in security docs (#33329)

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit a817f21fb52d01cbf8dce924801d76f9b23c55b0 Author: Jed Cunningham

[GitHub] [airflow] potiuk commented on a diff in pull request #33309: Save connection resources in mapped tasks

2023-08-14 Thread via GitHub
potiuk commented on code in PR #33309: URL: https://github.com/apache/airflow/pull/33309#discussion_r1293274644 ## airflow/cli/commands/task_command.py: ## @@ -634,6 +635,12 @@ def task_test(args, dag: DAG | None = None) -> None: session.delete(ti.dag_run)

[GitHub] [airflow] potiuk commented on pull request #32867: Sanitize the conn_id to disallow potential script execution

2023-08-14 Thread via GitHub
potiuk commented on PR #32867: URL: https://github.com/apache/airflow/pull/32867#issuecomment-1677078867 BTW. You can easily test it by `breeze start-airflow --load-default-connections` -> this will start airflow and allow you to run airflow from sources. -- This is an automated

[GitHub] [airflow] potiuk commented on a diff in pull request #33371: Migrate the CI workflows to the new runners on EKS cluster

2023-08-14 Thread via GitHub
potiuk commented on code in PR #33371: URL: https://github.com/apache/airflow/pull/33371#discussion_r1293206681 ## .github/workflows/ci.yml: ## @@ -115,6 +115,15 @@ jobs: helm-test-packages: ${{ steps.selective-checks.outputs.helm-test-packages }}

[GitHub] [airflow] potiuk commented on a diff in pull request #33371: Migrate the CI workflows to the new runners on EKS cluster

2023-08-14 Thread via GitHub
potiuk commented on code in PR #33371: URL: https://github.com/apache/airflow/pull/33371#discussion_r1293213695 ## .github/actions/breeze/action.yml: ## @@ -25,12 +25,6 @@ outputs: runs: using: "composite" steps: -- name: "Setup python" Review Comment: I am

[GitHub] [airflow] potiuk commented on a diff in pull request #33371: Migrate the CI workflows to the new runners on EKS cluster

2023-08-14 Thread via GitHub
potiuk commented on code in PR #33371: URL: https://github.com/apache/airflow/pull/33371#discussion_r1293217191 ## .github/workflows/ci.yml: ## @@ -115,6 +115,15 @@ jobs: helm-test-packages: ${{ steps.selective-checks.outputs.helm-test-packages }}

[GitHub] [airflow] potiuk commented on a diff in pull request #33371: Migrate the CI workflows to the new runners on EKS cluster

2023-08-14 Thread via GitHub
potiuk commented on code in PR #33371: URL: https://github.com/apache/airflow/pull/33371#discussion_r1293217191 ## .github/workflows/ci.yml: ## @@ -115,6 +115,15 @@ jobs: helm-test-packages: ${{ steps.selective-checks.outputs.helm-test-packages }}

[GitHub] [airflow] potiuk commented on pull request #33381: Adding typing for KPO SCC objects

2023-08-14 Thread via GitHub
potiuk commented on PR #33381: URL: https://github.com/apache/airflow/pull/33381#issuecomment-1677035453 Nice! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[airflow] branch main updated: respect soft_fail argument when ExternalTaskSensor runs in deferrable mode (#33196)

2023-08-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new a1b5bdb25a respect soft_fail argument when

[GitHub] [airflow] potiuk merged pull request #33196: respect soft_fail argument when ExternalTaskSensor runs in deferrable mode

2023-08-14 Thread via GitHub
potiuk merged PR #33196: URL: https://github.com/apache/airflow/pull/33196 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on a diff in pull request #33309: Save connection resources in mapped tasks

2023-08-14 Thread via GitHub
potiuk commented on code in PR #33309: URL: https://github.com/apache/airflow/pull/33309#discussion_r1293270209 ## airflow/cli/commands/task_command.py: ## @@ -634,6 +635,12 @@ def task_test(args, dag: DAG | None = None) -> None: session.delete(ti.dag_run)

[airflow] branch main updated: Add Service Principal OAuth for Databricks. (#33005)

2023-08-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 8bf53dd554 Add Service Principal OAuth for

[GitHub] [airflow] potiuk merged pull request #33005: Add Service Principal OAuth for Databricks.

2023-08-14 Thread via GitHub
potiuk merged PR #33005: URL: https://github.com/apache/airflow/pull/33005 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #32846: Adding Support for Google Cloud's Data Pipelines Run Operator

2023-08-14 Thread via GitHub
potiuk commented on PR #32846: URL: https://github.com/apache/airflow/pull/32846#issuecomment-1677060486 docs building needs fixing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] potiuk merged pull request #32843: Add Source Code and Testing for Google Cloud's Data Pipelines Create Operator

2023-08-14 Thread via GitHub
potiuk merged PR #32843: URL: https://github.com/apache/airflow/pull/32843 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Order triggers by - TI priority_weight when assign unassigned triggers (#32318)

2023-08-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 04d3f4560f Order triggers by - TI priority_weight

[GitHub] [airflow] potiuk merged pull request #32318: Order triggers by - TI priority_weight when assign unassigned triggers

2023-08-14 Thread via GitHub
potiuk merged PR #32318: URL: https://github.com/apache/airflow/pull/32318 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Update Error details for Generic Error Code (#32847)

2023-08-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b4102ce0b5 Update Error details for Generic Error

[GitHub] [airflow] potiuk merged pull request #32847: Update Error details for Generic Error Code

2023-08-14 Thread via GitHub
potiuk merged PR #32847: URL: https://github.com/apache/airflow/pull/32847 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] pegasas commented on pull request #33117: Enable Airflow DAG processor horizontally scalable

2023-08-14 Thread via GitHub
pegasas commented on PR #33117: URL: https://github.com/apache/airflow/pull/33117#issuecomment-1677102399 Hi, @potiuk , Here's my new proposal. To implement multi DAG processor embedded in the scheduler on different nodes, we should:

[GitHub] [airflow] potiuk merged pull request #32731: [Models] [Postgres] Check if the dynamically-added index is in the table schema before adding

2023-08-14 Thread via GitHub
potiuk merged PR #32731: URL: https://github.com/apache/airflow/pull/32731 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: [Models] [Postgres] Check if the dynamically-added index is in the table schema before adding (#32731)

2023-08-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 2950fd7685 [Models] [Postgres] Check if the

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #32847: Update Error details for Generic Error Code

2023-08-14 Thread via GitHub
boring-cyborg[bot] commented on PR #32847: URL: https://github.com/apache/airflow/pull/32847#issuecomment-1677102928 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional

[GitHub] [airflow] potiuk commented on pull request #30214: Added support for using SHA digest of Docker images.

2023-08-14 Thread via GitHub
potiuk commented on PR #30214: URL: https://github.com/apache/airflow/pull/30214#issuecomment-1677104429 > @jedcunningham is there a specific reason to include digest notation for airflow only, not for all the other potential images used? statsd, git-sync, and so on? No - but feel

[GitHub] [airflow] potiuk merged pull request #33384: Replace `common.tplvalues.render` by `tpl` in ingress template files

2023-08-14 Thread via GitHub
potiuk merged PR #33384: URL: https://github.com/apache/airflow/pull/33384 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #33142: Allow templating webserver ingress hostnames

2023-08-14 Thread via GitHub
potiuk commented on PR #33142: URL: https://github.com/apache/airflow/pull/33142#issuecomment-1677106048 > I'm a bit late! I opened #33384 to change the used function. And merged :) -- This is an automated message from the Apache Git Service. To respond to the message, please log

[airflow] branch main updated: Replace common.tplvalues.render by tpl in ingress template files (#33384)

2023-08-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new a86313ff14 Replace common.tplvalues.render by tpl

[GitHub] [airflow] potiuk merged pull request #33385: Fix Storage Transfer system tests

2023-08-14 Thread via GitHub
potiuk merged PR #33385: URL: https://github.com/apache/airflow/pull/33385 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Fix Storage Transfer system tests (#33385)

2023-08-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new c17140cb37 Fix Storage Transfer system tests

[airflow] branch v2-7-test updated: fixup! Update RELEASE_NOTES.rst

2023-08-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v2-7-test by this push: new adfc7b8424 fixup! Update

[GitHub] [airflow] potiuk commented on pull request #33117: Enable Airflow DAG processor horizontally scalable

2023-08-14 Thread via GitHub
potiuk commented on PR #33117: URL: https://github.com/apache/airflow/pull/33117#issuecomment-1677144580 Can you perform some calculations and realistic simulations showing how this would help to achieve better performance? I think there is a big risks that your idea of horizontal

[GitHub] [airflow] AndreasAlbertQC opened a new pull request, #33388: Fix config description for base_log_folder

2023-08-14 Thread via GitHub
AndreasAlbertQC opened a new pull request, #33388: URL: https://github.com/apache/airflow/pull/33388 This PR fixes a super-minor error in the config documentation, which previously referred to the same setting twice. --- **^ Add meaningful description above**

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #33388: Fix config description for base_log_folder

2023-08-14 Thread via GitHub
boring-cyborg[bot] commented on PR #33388: URL: https://github.com/apache/airflow/pull/33388#issuecomment-1677158920 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[airflow] branch main updated: Adding typing for KPO SCC objects (#33381)

2023-08-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 46ffc25995 Adding typing for KPO SCC objects

[GitHub] [airflow] potiuk merged pull request #33381: Adding typing for KPO SCC objects

2023-08-14 Thread via GitHub
potiuk merged PR #33381: URL: https://github.com/apache/airflow/pull/33381 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] kolfild26 commented on issue #33373: TimeDeltaSensor suggestion

2023-08-14 Thread via GitHub
kolfild26 commented on issue #33373: URL: https://github.com/apache/airflow/issues/33373#issuecomment-1677351121 @potiuk > TimeSensor ... You can do it with JINJA even now if you wish yes, that's what i actually do. Originally I didn't think of the time sensor change, but it

  1   2   >