[GitHub] [airflow] potiuk commented on pull request #28976: Migrate DagFileProcessorManager.clear_nonexistent_import_errors to internal API

2023-01-20 Thread via GitHub
potiuk commented on PR #28976: URL: https://github.com/apache/airflow/pull/28976#issuecomment-1398925508 conflicts to resolve. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[airflow] branch main updated: Add deferrable mode to DataFusionStartPipelineOperator (#28690)

2023-01-20 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e926bb9bb0 Add deferrable mode to

[GitHub] [airflow] potiuk merged pull request #28690: Add deferrable mode to DataFusionStartPipelineOperator

2023-01-20 Thread via GitHub
potiuk merged PR #28690: URL: https://github.com/apache/airflow/pull/28690 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] snjypl opened a new pull request, #29072: Fix minor typo in breeze example command.

2023-01-20 Thread via GitHub
snjypl opened a new pull request, #29072: URL: https://github.com/apache/airflow/pull/29072 Fix: Invalid value for --integration. K should be small for kerberos. ![image](https://user-images.githubusercontent.com/4460062/213803546-35b7aa5c-a0d8-4629-b182-77c6e37da5c5.png)

[GitHub] [airflow] potiuk merged pull request #27833: Add deferrable mode for Big Query Transfer operator

2023-01-20 Thread via GitHub
potiuk merged PR #27833: URL: https://github.com/apache/airflow/pull/27833 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated (4b3a9ca5a3 -> 5fcdd321c5)

2023-01-20 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 4b3a9ca5a3 Minor improvements to serde helpers (#28978) add 5fcdd321c5 Add deferrable mode for Big Query Transfer

[GitHub] [airflow] pierrejeambrun commented on issue #29026: Status of testing of Apache Airflow 2.5.1rc2

2023-01-20 Thread via GitHub
pierrejeambrun commented on issue #29026: URL: https://github.com/apache/airflow/issues/29026#issuecomment-1398921159 Thanks to everyone that helped testing `2.5.1rc1` and `2.5.1rc2`. :pray: Closing as 2.5.1 has been released based on `2.5.1rc2` :tada: -- This is an automated

[GitHub] [airflow] potiuk commented on pull request #28979: Fix rendering parameters in PapermillOperator

2023-01-20 Thread via GitHub
potiuk commented on PR #28979: URL: https://github.com/apache/airflow/pull/28979#issuecomment-1398907022 > I have a look and also found that we have environment variable USE_AIRFLOW_VERSION but we explicit set it to "wheel" (maybe somewhere in the past it make sense). We could use it for

[airflow-site] branch gh-pages updated: Deploying to gh-pages from @ 0c902bd0463ea0d37f83bb48940100fc4fc60b62 

2023-01-20 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/gh-pages by this push: new 024f32f528 Deploying to gh-pages

[airflow] branch main updated (826f3bd380 -> 4b3a9ca5a3)

2023-01-20 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 826f3bd380 Properly test that audit log secrets are masked for connection objects (#29011) add 4b3a9ca5a3 Minor

[GitHub] [airflow] potiuk merged pull request #28978: Minor improvements to serde helpers

2023-01-20 Thread via GitHub
potiuk merged PR #28978: URL: https://github.com/apache/airflow/pull/28978 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] Taragolis commented on pull request #28979: Fix rendering parameters in PapermillOperator

2023-01-20 Thread via GitHub
Taragolis commented on PR #28979: URL: https://github.com/apache/airflow/pull/28979#issuecomment-1398895970 > Not updated when we bumped it :) I have a look and also found that we have environment variable `USE_AIRFLOW_VERSION` but we explicit set it to "wheel" (maybe somewhere in

[GitHub] [airflow] potiuk commented on pull request #29035: Renaming nose compatible methods in flavour of regular pytest naming

2023-01-20 Thread via GitHub
potiuk commented on PR #29035: URL: https://github.com/apache/airflow/pull/29035#issuecomment-1398891137 Ah - isn't that the "airflow.jobs.backfill_job.BackfillJob" generated log ? I thought simply backfill job sends the log entry when reconnecting? Because if not then maybe for some

[airflow-site] branch main updated: Announce Apache Airflow 2.5.1 release (#725)

2023-01-20 Thread pierrejeambrun
This is an automated email from the ASF dual-hosted git repository. pierrejeambrun pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new 0c902bd046 Announce Apache Airflow

[GitHub] [airflow-site] pierrejeambrun merged pull request #725: Announce Apache Airflow 2.5.1 release

2023-01-20 Thread via GitHub
pierrejeambrun merged PR #725: URL: https://github.com/apache/airflow-site/pull/725 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #29071: Upgrade bitnami/postgresql helm depenency from 10.5.3 to 12.1.9

2023-01-20 Thread via GitHub
potiuk commented on PR #29071: URL: https://github.com/apache/airflow/pull/29071#issuecomment-1398887503 https://docs.github.com/en/pull-requests/committing-changes-to-your-project/creating-and-editing-commits/creating-a-commit-with-multiple-authors -- This is an automated message from

[GitHub] [airflow] Taragolis commented on pull request #29035: Renaming nose compatible methods in flavour of regular pytest naming

2023-01-20 Thread via GitHub
Taragolis commented on PR #29035: URL: https://github.com/apache/airflow/pull/29035#issuecomment-1398885650 > No -not skipped - simply a bad timing /flaky test: > > ``` > Failed to reconnect to scheduler after 30.00 seconds, closing client > ``` Technically we should not

[GitHub] [airflow] snjypl commented on pull request #27357: Update bitnami/postgresql dependency chart to latest version

2023-01-20 Thread via GitHub
snjypl commented on PR #27357: URL: https://github.com/apache/airflow/pull/27357#issuecomment-1398884543 @potiuk i have opened a PR with fixes to the failing unittest and also upgraded the chart to lastest version 12.1.9 https://github.com/apache/airflow/pull/29071 i dont

[GitHub] [airflow] potiuk commented on pull request #28979: Fix rendering parameters in PapermillOperator

2023-01-20 Thread via GitHub
potiuk commented on PR #28979: URL: https://github.com/apache/airflow/pull/28979#issuecomment-1398876650 > Well seems like broken compatibility with 2.3.x, I will check later on as well as will change wrong message for error in the CI (point to 2.2.0 but actually we test on 2.3.0)

[GitHub] [airflow] snjypl opened a new pull request, #29071: Upgrade bitnami/postgresql helm depenency from 10.5.3 to 12.1.9

2023-01-20 Thread via GitHub
snjypl opened a new pull request, #29071: URL: https://github.com/apache/airflow/pull/29071 Fixes: https://github.com/apache/airflow/issues/27353 this is a continuation of https://github.com/apache/airflow/pull/27357. i fixed the failing unittests --- **^ Add

[GitHub] [airflow] Taragolis commented on pull request #28979: Fix rendering parameters in PapermillOperator

2023-01-20 Thread via GitHub
Taragolis commented on PR #28979: URL: https://github.com/apache/airflow/pull/28979#issuecomment-1398870960 Well seems like broken compatibility with 2.3.x, I will check later on as well as change wrong message for error in the CI (point to 2.2.0 but actually we test on 2.3.0) -- This

[airflow-site] 01/01: Announce Apache Airflow 2.5.1 release

2023-01-20 Thread pierrejeambrun
This is an automated email from the ASF dual-hosted git repository. pierrejeambrun pushed a commit to branch announce_251 in repository https://gitbox.apache.org/repos/asf/airflow-site.git commit ca678a746d64480d04d519dd41e0d7747a5b580d Author: pierrejeambrun AuthorDate: Fri Jan 20 21:01:54

[airflow-site] branch announce_251 created (now ca678a746d)

2023-01-20 Thread pierrejeambrun
This is an automated email from the ASF dual-hosted git repository. pierrejeambrun pushed a change to branch announce_251 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at ca678a746d Announce Apache Airflow 2.5.1 release This branch includes the following new commits:

[GitHub] [airflow] potiuk commented on a diff in pull request #28926: Upgrade mypy to 0.991

2023-01-20 Thread via GitHub
potiuk commented on code in PR #28926: URL: https://github.com/apache/airflow/pull/28926#discussion_r1082995085 ## tests/www/views/test_views_connection.py: ## @@ -40,11 +41,10 @@ "password": "admin", } -CONNECTION_WITH_EXTRA = CONNECTION.update( Review Comment:

[airflow] branch main updated (481f271706 -> 826f3bd380)

2023-01-20 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 481f271706 fixing import error for dataset (#29007) add 826f3bd380 Properly test that audit log secrets are

[GitHub] [airflow] potiuk merged pull request #29011: Properly test that audit log secrets are masked for connection objects

2023-01-20 Thread via GitHub
potiuk merged PR #29011: URL: https://github.com/apache/airflow/pull/29011 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] schwartzpub commented on issue #29037: Cron schedule and Time Zones leads to incorrect intervals

2023-01-20 Thread via GitHub
schwartzpub commented on issue #29037: URL: https://github.com/apache/airflow/issues/29037#issuecomment-1398867257 ![image](https://user-images.githubusercontent.com/5823949/213794037-a0d5a95b-ffa2-40b2-85a3-f32301ec414c.png) I still don't fully understand the Logical Date, and I

[airflow] branch main updated (bac7b3027d -> 481f271706)

2023-01-20 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from bac7b3027d Fix SFTP operator's template fields processing (#29068) add 481f271706 fixing import error for dataset

[GitHub] [airflow] potiuk merged pull request #29007: Adding dataset to be discovered by static analyzers

2023-01-20 Thread via GitHub
potiuk merged PR #29007: URL: https://github.com/apache/airflow/pull/29007 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #29007: Adding dataset to be discovered by static analyzers

2023-01-20 Thread boring-cyborg
boring-cyborg[bot] commented on PR #29007: URL: https://github.com/apache/airflow/pull/29007#issuecomment-1398865184 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[airflow-client-python] branch master updated: Exclude openapi generator ignore file from Rat (#57)

2023-01-20 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git The following commit(s) were added to refs/heads/master by this push: new da5d34c Exclude openapi

[GitHub] [airflow-client-python] jedcunningham merged pull request #57: Exclude openapi generator ignore file from Rat

2023-01-20 Thread via GitHub
jedcunningham merged PR #57: URL: https://github.com/apache/airflow-client-python/pull/57 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated (10f0f8bc4b -> bac7b3027d)

2023-01-20 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 10f0f8bc4b Capitalize dag to DAG (#29064) add bac7b3027d Fix SFTP operator's template fields processing (#29068)

[GitHub] [airflow] potiuk merged pull request #29068: Fix SFTP operator's template fields processing

2023-01-20 Thread via GitHub
potiuk merged PR #29068: URL: https://github.com/apache/airflow/pull/29068 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk closed issue #27328: SFTPOperator throws object of type 'PlainXComArg' has no len() when using with Taskflow API

2023-01-20 Thread via GitHub
potiuk closed issue #27328: SFTPOperator throws object of type 'PlainXComArg' has no len() when using with Taskflow API URL: https://github.com/apache/airflow/issues/27328 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] potiuk commented on pull request #29068: Fix SFTP operator's template fields processing

2023-01-20 Thread via GitHub
potiuk commented on PR #29068: URL: https://github.com/apache/airflow/pull/29068#issuecomment-1398840425 good first issue created https://github.com/apache/airflow/issues/29070 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] potiuk opened a new issue, #29070: FTP operator has logic in __init__

2023-01-20 Thread via GitHub
potiuk opened a new issue, #29070: URL: https://github.com/apache/airflow/issues/29070 ### Body Similarly to SFTP (fixed in https://github.com/apache/airflow/pull/29068) the logic from __init__ should be moved to execute. The #29068 provides a blueprint for that. ###

[GitHub] [airflow] potiuk commented on pull request #29068: Fix SFTP operator's template fields processing

2023-01-20 Thread via GitHub
potiuk commented on PR #29068: URL: https://github.com/apache/airflow/pull/29068#issuecomment-1398838008 > FTP provider has the same issue if you want to get two birds with one stone. I prefer to provide an example for others to folllow :) -- This is an automated message from the

[GitHub] [airflow] potiuk commented on issue #27328: SFTPOperator throws object of type 'PlainXComArg' has no len() when using with Taskflow API

2023-01-20 Thread via GitHub
potiuk commented on issue #27328: URL: https://github.com/apache/airflow/issues/27328#issuecomment-1398832969 > I like this. Though it will take quite some tmie I am afraid - unless we can do most of it semi-automatically (which I think might be quite possible). Created

[GitHub] [airflow] potiuk opened a new issue, #29069: Prevent templated field logic checks in `__init__` of operators automatically

2023-01-20 Thread via GitHub
potiuk opened a new issue, #29069: URL: https://github.com/apache/airflow/issues/29069 ### Body It happens all-too-often that in our operators we have some initialization logic that checks the content of templated fields or generally parameters passed to the operators. This however

[GitHub] [airflow-site] pierrejeambrun merged pull request #724: Add documentation for Apache Airflow 2.5.1

2023-01-20 Thread via GitHub
pierrejeambrun merged PR #724: URL: https://github.com/apache/airflow-site/pull/724 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated: Capitalize dag to DAG (#29064)

2023-01-20 Thread basph
This is an automated email from the ASF dual-hosted git repository. basph pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 10f0f8bc4b Capitalize dag to DAG (#29064)

[GitHub] [airflow] BasPH merged pull request #29064: Capitalize dag to DAG

2023-01-20 Thread via GitHub
BasPH merged PR #29064: URL: https://github.com/apache/airflow/pull/29064 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow-site] branch 2.5.1-docs created (now 85d7b6cf4b)

2023-01-20 Thread pierrejeambrun
This is an automated email from the ASF dual-hosted git repository. pierrejeambrun pushed a change to branch 2.5.1-docs in repository https://gitbox.apache.org/repos/asf/airflow-site.git at 85d7b6cf4b Add documentation for Apache Airflow 2.5.1 This branch includes the following new

[airflow] branch main updated (ad73819854 -> bab57f1a61)

2023-01-20 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from ad73819854 AIP-44 Migrate DagModel.get_paused_dag_ids to Internal API (#28693) add bab57f1a61 Renaming nose

[GitHub] [airflow] potiuk merged pull request #29035: Renaming nose compatible methods in flavour of regular pytest naming

2023-01-20 Thread via GitHub
potiuk merged PR #29035: URL: https://github.com/apache/airflow/pull/29035 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #29035: Renaming nose compatible methods in flavour of regular pytest naming

2023-01-20 Thread via GitHub
potiuk commented on PR #29035: URL: https://github.com/apache/airflow/pull/29035#issuecomment-1398821920 > Just single non-relevant to this PR failure. Somehow `distributed` could avoid caplog filter: https://github.com/apache/airflow/actions/runs/3970014684/jobs/6805354398#step:6:6520

[airflow-client-python] branch extra_rat_exclude created (now acdf0c2)

2023-01-20 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch extra_rat_exclude in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git at acdf0c2 Exclude openapi generator ignore file from Rat This branch includes the

[airflow-client-python] 01/01: Exclude openapi generator ignore file from Rat

2023-01-20 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch extra_rat_exclude in repository https://gitbox.apache.org/repos/asf/airflow-client-python.git commit acdf0c2e47ef2def21faeb63e609449e1f4522de Author: Jed Cunningham

[GitHub] [airflow] potiuk commented on pull request #28502: Migrate DagFileProcessor.manage_slas to Internal API

2023-01-20 Thread via GitHub
potiuk commented on PR #28502: URL: https://github.com/apache/airflow/pull/28502#issuecomment-1398819090 (Pending tests passing :) ) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[airflow] branch main updated (f114c67c03 -> ad73819854)

2023-01-20 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from f114c67c03 Fix pre-commit warning for exclude in inclusive-language check (#29057) add ad73819854 AIP-44 Migrate

[GitHub] [airflow] potiuk closed issue #28614: AIP-44 Migrate DagModel.get_paused_dag_ids to Internal API

2023-01-20 Thread via GitHub
potiuk closed issue #28614: AIP-44 Migrate DagModel.get_paused_dag_ids to Internal API URL: https://github.com/apache/airflow/issues/28614 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] potiuk merged pull request #28693: AIP-44 Migrate DagModel.get_paused_dag_ids to Internal API

2023-01-20 Thread via GitHub
potiuk merged PR #28693: URL: https://github.com/apache/airflow/pull/28693 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk opened a new pull request, #29068: Fix SFTP operator's template fields processing

2023-01-20 Thread via GitHub
potiuk opened a new pull request, #29068: URL: https://github.com/apache/airflow/pull/29068 The SFTP operator had logic in `__init__` that was running checks on passed arguments, but that means that the operator woudl fail when using TaskFlow. Fixes: #27328 --- **^

[GitHub] [airflow] Taragolis commented on pull request #29035: Renaming nose compatible methods in flavour of regular pytest naming

2023-01-20 Thread via GitHub
Taragolis commented on PR #29035: URL: https://github.com/apache/airflow/pull/29035#issuecomment-1398808949 Just single non-relevant to this PR failure. Somehow `distributed` could avoid caplog filter: https://github.com/apache/airflow/actions/runs/3970014684/jobs/6805354398#step:6:6520

[GitHub] [airflow] mrn-aglic opened a new issue, #29067: TaskGroup dynamic task mapping fails to populate all mapping metadata

2023-01-20 Thread via GitHub
mrn-aglic opened a new issue, #29067: URL: https://github.com/apache/airflow/issues/29067 ### Apache Airflow version 2.5.0 ### What happened I was trying to learn about the feature of using dynamic task group mapping. However, whenever I try to run the DAG, I get the

[GitHub] [airflow] vincbeck commented on pull request #28693: AIP-44 Migrate DagModel.get_paused_dag_ids to Internal API

2023-01-20 Thread via GitHub
vincbeck commented on PR #28693: URL: https://github.com/apache/airflow/pull/28693#issuecomment-1398800466 Done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] vincbeck commented on a diff in pull request #28502: Migrate DagFileProcessor.manage_slas to Internal API

2023-01-20 Thread via GitHub
vincbeck commented on code in PR #28502: URL: https://github.com/apache/airflow/pull/28502#discussion_r1082938326 ## airflow/dag_processing/processor.py: ## @@ -365,8 +365,10 @@ def __init__(self, dag_ids: list[str] | None, dag_directory: str, log: logging.L

[GitHub] [airflow] o-nikolas commented on a diff in pull request #28934: Remove hard-coded executor-database coupling

2023-01-20 Thread via GitHub
o-nikolas commented on code in PR #28934: URL: https://github.com/apache/airflow/pull/28934#discussion_r1082935302 ## airflow/cli/commands/standalone_command.py: ## @@ -159,14 +159,28 @@ def calculate_env(self): # Make sure we're using a local executor flavour

[GitHub] [airflow] dstandish commented on a diff in pull request #28981: Implemented log_containers option to read from all containers in KubernetesPodOperator

2023-01-20 Thread via GitHub
dstandish commented on code in PR #28981: URL: https://github.com/apache/airflow/pull/28981#discussion_r1082925535 ## airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py: ## @@ -168,6 +168,9 @@ class KubernetesPodOperator(BaseOperator): :param labels: labels to

[GitHub] [airflow] Taragolis closed issue #16386: SageMaker operators return non-serializable value

2023-01-20 Thread via GitHub
Taragolis closed issue #16386: SageMaker operators return non-serializable value URL: https://github.com/apache/airflow/issues/16386 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] Taragolis commented on issue #16386: SageMaker operators return non-serializable value

2023-01-20 Thread via GitHub
Taragolis commented on issue #16386: URL: https://github.com/apache/airflow/issues/16386#issuecomment-1398781623 Fixed by: https://github.com/apache/airflow/pull/23628 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[airflow] branch main updated (367e8f135c -> f114c67c03)

2023-01-20 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 367e8f135c AIP-44: Add CLI command for running standalone Internal API (#28425) add f114c67c03 Fix pre-commit

[GitHub] [airflow] potiuk merged pull request #29057: Fix pre-commit warning for exclude in inclusive-language check

2023-01-20 Thread via GitHub
potiuk merged PR #29057: URL: https://github.com/apache/airflow/pull/29057 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on a diff in pull request #28981: Implemented log_containers option to read from all containers in KubernetesPodOperator

2023-01-20 Thread via GitHub
potiuk commented on code in PR #28981: URL: https://github.com/apache/airflow/pull/28981#discussion_r1082919473 ## airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py: ## @@ -168,6 +168,9 @@ class KubernetesPodOperator(BaseOperator): :param labels: labels to

[GitHub] [airflow] potiuk commented on pull request #27763: Merge common code to DbApiHook

2023-01-20 Thread via GitHub
potiuk commented on PR #27763: URL: https://github.com/apache/airflow/pull/27763#issuecomment-1398770894 @kazanzhy ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] potiuk commented on pull request #28783: AIP-44 Don't use Internal API in some components

2023-01-20 Thread via GitHub
potiuk commented on PR #28783: URL: https://github.com/apache/airflow/pull/28783#issuecomment-1398769506 I guess now ew can rebase those :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[airflow] branch main updated (760c52949a -> 367e8f135c)

2023-01-20 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 760c52949a logging poke info when external dag is not none and task_id and task_ids are none (#28097) add

[GitHub] [airflow] potiuk merged pull request #28425: AIP-44: Add CLI command for running standalone Internal API

2023-01-20 Thread via GitHub
potiuk merged PR #28425: URL: https://github.com/apache/airflow/pull/28425 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk closed issue #28266: AIP-44 Implement standalone internal-api component

2023-01-20 Thread via GitHub
potiuk closed issue #28266: AIP-44 Implement standalone internal-api component URL: https://github.com/apache/airflow/issues/28266 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[airflow] branch main updated (863ec46e25 -> 760c52949a)

2023-01-20 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 863ec46e25 Migrate Helm tests to `pytest` (#29063) add 760c52949a logging poke info when external dag is not none

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #28097: logging poke info when external dag is not none and task_id and task_ids are none

2023-01-20 Thread boring-cyborg
boring-cyborg[bot] commented on PR #28097: URL: https://github.com/apache/airflow/pull/28097#issuecomment-1398765025 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] potiuk merged pull request #28097: logging poke info when external dag is not none and task_id and task_ids are none

2023-01-20 Thread via GitHub
potiuk merged PR #28097: URL: https://github.com/apache/airflow/pull/28097 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] dstandish commented on a diff in pull request #28981: Implemented log_containers option to read from all containers in KubernetesPodOperator

2023-01-20 Thread via GitHub
dstandish commented on code in PR #28981: URL: https://github.com/apache/airflow/pull/28981#discussion_r1082906748 ## airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py: ## @@ -168,6 +168,9 @@ class KubernetesPodOperator(BaseOperator): :param labels: labels to

[airflow] annotated tag 2.5.1 updated (49867b660b -> 95f528cb64)

2023-01-20 Thread pierrejeambrun
This is an automated email from the ASF dual-hosted git repository. pierrejeambrun pushed a change to annotated tag 2.5.1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag 2.5.1 was modified! *** from 49867b660b (commit) to 95f528cb64 (tag) tagging

[GitHub] [airflow] dstandish commented on a diff in pull request #28981: Implemented log_containers option to read from all containers in KubernetesPodOperator

2023-01-20 Thread via GitHub
dstandish commented on code in PR #28981: URL: https://github.com/apache/airflow/pull/28981#discussion_r1082903938 ## airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py: ## @@ -168,6 +168,9 @@ class KubernetesPodOperator(BaseOperator): :param labels: labels to

[airflow] annotated tag constraints-latest updated (63df097f00 -> cb8af5da01)

2023-01-20 Thread pierrejeambrun
This is an automated email from the ASF dual-hosted git repository. pierrejeambrun pushed a change to annotated tag constraints-latest in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag constraints-latest was modified! *** from 63df097f00 (tag) to

[GitHub] [airflow] Taragolis commented on pull request #28592: Guard not-yet-expanded ti in trigger rule dep

2023-01-20 Thread via GitHub
Taragolis commented on PR #28592: URL: https://github.com/apache/airflow/pull/28592#issuecomment-1398757976 > Hi all, I'm seeing the same issue on `rc2` when passing an XComArg object to the mapped task. Lists appear to work as expected. Hi @mattppal would you like to create an

[airflow] annotated tag constraints-2.5.1 updated (cacae5b639 -> f6618bfa8e)

2023-01-20 Thread pierrejeambrun
This is an automated email from the ASF dual-hosted git repository. pierrejeambrun pushed a change to annotated tag constraints-2.5.1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag constraints-2.5.1 was modified! *** from cacae5b639 (commit) to

[GitHub] [airflow] potiuk commented on a diff in pull request #28502: Migrate DagFileProcessor.manage_slas to Internal API

2023-01-20 Thread GitBox
potiuk commented on code in PR #28502: URL: https://github.com/apache/airflow/pull/28502#discussion_r1082897117 ## airflow/dag_processing/processor.py: ## @@ -365,8 +365,10 @@ def __init__(self, dag_ids: list[str] | None, dag_directory: str, log: logging.L

[GitHub] [airflow] mattppal commented on pull request #28592: Guard not-yet-expanded ti in trigger rule dep

2023-01-20 Thread GitBox
mattppal commented on PR #28592: URL: https://github.com/apache/airflow/pull/28592#issuecomment-1398744685 Hi all, I'm seeing the same issue on `rc2` when passing an XComArg object to the mapped task. Lists appear to work as expected. -- This is an automated message from the Apache Git

[GitHub] [airflow] vincbeck commented on a diff in pull request #28502: Migrate DagFileProcessor.manage_slas to Internal API

2023-01-20 Thread GitBox
vincbeck commented on code in PR #28502: URL: https://github.com/apache/airflow/pull/28502#discussion_r1082893036 ## airflow/dag_processing/processor.py: ## @@ -365,8 +365,10 @@ def __init__(self, dag_ids: list[str] | None, dag_directory: str, log: logging.L

[GitHub] [airflow] potiuk commented on pull request #29064: Capitalize dag to DAG

2023-01-20 Thread GitBox
potiuk commented on PR #29064: URL: https://github.com/apache/airflow/pull/29064#issuecomment-1398738922 I cannot figure out why 'dag' is not flagged by our spellchecker. It looks like it should, and I tried to experiment a bit but I really cannot find why it has been allowed in the first

svn commit: r59463 - /release/airflow/2.5.0/

2023-01-20 Thread ephraimanierobi
Author: ephraimanierobi Date: Fri Jan 20 17:46:34 2023 New Revision: 59463 Log: Remove old release: 2.5.0 Removed: release/airflow/2.5.0/

svn commit: r59462 - /release/airflow/2.5.1/

2023-01-20 Thread ephraimanierobi
Author: ephraimanierobi Date: Fri Jan 20 17:45:42 2023 New Revision: 59462 Log: Release Airflow 2.5.1 from 2.5.1rc2 Added: release/airflow/2.5.1/ release/airflow/2.5.1/apache-airflow-2.5.1-source.tar.gz - copied unchanged from r59461,

[airflow] branch main updated: Migrate Helm tests to `pytest` (#29063)

2023-01-20 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 863ec46e25 Migrate Helm tests to `pytest`

[GitHub] [airflow] Taragolis merged pull request #29063: Migrate Helm tests to `pytest`

2023-01-20 Thread GitBox
Taragolis merged PR #29063: URL: https://github.com/apache/airflow/pull/29063 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] Taragolis commented on pull request #29035: Renaming nose compatible methods in flavour of regular pytest naming

2023-01-20 Thread GitBox
Taragolis commented on PR #29035: URL: https://github.com/apache/airflow/pull/29035#issuecomment-1398705272 > > @potiuk, is it the right place? > > Yep. But you can also add "full tests needed" label on a PR to run a complete set of tests. And very easy to forget add this

[GitHub] [airflow] jedcunningham commented on pull request #28808: Allow setting the name for the base container within K8s Pod Operator

2023-01-20 Thread GitBox
jedcunningham commented on PR #28808: URL: https://github.com/apache/airflow/pull/28808#issuecomment-1398700496 Looking at this with fresh eyes, this works? ``` kpo_task = KubernetesPodOperator(...) kpo_task.BASE_CONTAINER_NAME = "whatever" ``` Is it worth adding this

[airflow] branch constraints-main updated: Updating constraints. Build id:

2023-01-20 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new fe1af7b2e1 Updating

[GitHub] [airflow] potiuk commented on pull request #29063: Migrate Helm tests to `pytest`

2023-01-20 Thread GitBox
potiuk commented on PR #29063: URL: https://github.com/apache/airflow/pull/29063#issuecomment-1398695049 (pending tess succeed ofc) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] bbovenzi opened a new pull request, #29066: Check for run_id url param when linking to graph/gantt views

2023-01-20 Thread GitBox
bbovenzi opened a new pull request, #29066: URL: https://github.com/apache/airflow/pull/29066 Some parts of the app linked over to the graph and gantt views with a `run_id=` param, but we weren't actually using that param to decide which run to show for a user. Now, we will first check

[GitHub] [airflow] potiuk commented on a diff in pull request #28846: Updated app to support configuring the caching hash method for FIPS

2023-01-20 Thread GitBox
potiuk commented on code in PR #28846: URL: https://github.com/apache/airflow/pull/28846#discussion_r1082853296 ## airflow/models/serialized_dag.py: ## @@ -102,7 +102,7 @@ def __init__(self, dag: DAG, processor_subdir: str | None = None): dag_data =

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #29065: When clearing task instances try to get associated DAGs from database

2023-01-20 Thread GitBox
boring-cyborg[bot] commented on PR #29065: URL: https://github.com/apache/airflow/pull/29065#issuecomment-1398692028 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] sean-rose opened a new pull request, #29065: When clearing task instances try to get associated DAGs from database

2023-01-20 Thread GitBox
sean-rose opened a new pull request, #29065: URL: https://github.com/apache/airflow/pull/29065 This fixes problems when recursively clearing task instances across multiple DAGs: * Task instances in downstream DAGs weren't having their `max_tries` property incremented, which could

[GitHub] [airflow] Taragolis opened a new pull request, #29063: Migrate Helm tests to `pytest`

2023-01-20 Thread GitBox
Taragolis opened a new pull request, #29063: URL: https://github.com/apache/airflow/pull/29063 Migrate `kubernetes_tests` to pytest. Also resolve issue that tests use combination of `unittests`/`nose`/`pytest` which found during this PR: -

[GitHub] [airflow] BasPH opened a new pull request, #29064: Capitalize dag to DAG

2023-01-20 Thread GitBox
BasPH opened a new pull request, #29064: URL: https://github.com/apache/airflow/pull/29064 DAG is an abbreviation (Directed Acyclic Graph) and should therefore be written capitalized. This PR changes "dags" to "DAGs" wherever it's written for humans (i.e. not code, hyperlinks, etc.).

[GitHub] [airflow] shyft-mike commented on a diff in pull request #28846: Updated app to support configuring the caching hash method for FIPS

2023-01-20 Thread GitBox
shyft-mike commented on code in PR #28846: URL: https://github.com/apache/airflow/pull/28846#discussion_r1082843374 ## airflow/models/serialized_dag.py: ## @@ -102,7 +102,7 @@ def __init__(self, dag: DAG, processor_subdir: str | None = None): dag_data =

[GitHub] [airflow] potiuk commented on pull request #28476: Migrate DagFileProcessorManager._deactivate_stale_dags to Internal API

2023-01-20 Thread GitBox
potiuk commented on PR #28476: URL: https://github.com/apache/airflow/pull/28476#issuecomment-1398678859 > > I guess that one should be updated after discussion in #28502 with `@classmethod` ? > > Correct! I rather wait for #28502 to be merged and then I'll update this PR +1

[GitHub] [airflow] potiuk commented on a diff in pull request #28502: Migrate DagFileProcessor.manage_slas to Internal API

2023-01-20 Thread GitBox
potiuk commented on code in PR #28502: URL: https://github.com/apache/airflow/pull/28502#discussion_r1082833504 ## airflow/dag_processing/processor.py: ## @@ -365,8 +365,10 @@ def __init__(self, dag_ids: list[str] | None, dag_directory: str, log: logging.L

<    1   2   3   >