(airflow) branch main updated: Fix typo with DatasetOrTimeSchedule as it was renamed (#38576)

2024-03-27 Thread pankaj
This is an automated email from the ASF dual-hosted git repository. pankaj pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 9a5974af48 Fix typo with DatasetOrTimeSchedule as

Re: [PR] Fix typo with DatasetOrTimeSchedule as it was renamed [airflow]

2024-03-27 Thread via GitHub
pankajastro merged PR #38576: URL: https://github.com/apache/airflow/pull/38576 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] pt012 rule enabled for sftp [airflow]

2024-03-27 Thread via GitHub
Bowrna commented on code in PR #38525: URL: https://github.com/apache/airflow/pull/38525#discussion_r1542338886 ## tests/providers/sftp/triggers/test_sftp.py: ## @@ -176,12 +176,11 @@ async def test_sftp_trigger_run_trigger_failure_state(self, mock_get_files_by_pa

[PR] Fix typo with DatasetOrTimeSchedule as it was renamed [airflow]

2024-03-27 Thread via GitHub
sunank200 opened a new pull request, #38576: URL: https://github.com/apache/airflow/pull/38576 - Fix typo in docs for `DatasetOrTimeSchedule` as it was renamed. --- **^ Add meaningful description above** Read the **[Pull Request

Re: [PR] pt012 rule enabled for sftp [airflow]

2024-03-27 Thread via GitHub
Bowrna commented on code in PR #38525: URL: https://github.com/apache/airflow/pull/38525#discussion_r1542331163 ## tests/providers/sftp/triggers/test_sftp.py: ## @@ -176,12 +176,11 @@ async def test_sftp_trigger_run_trigger_failure_state(self, mock_get_files_by_pa

Re: [PR] Fix dag task scheduled and queued duration metrics [airflow]

2024-03-27 Thread via GitHub
Bowrna commented on PR #37936: URL: https://github.com/apache/airflow/pull/37936#issuecomment-2024405440 > @vandonr You probably didn't read the topic fully or misunderstood. Airflow indeed emits most of metrics (or all of them) in seconds, and those two should also be emitted in seconds

Re: [PR] changing dag_processing.processes from UpDownCounter to guage [airflow]

2024-03-27 Thread via GitHub
Bowrna commented on PR #38400: URL: https://github.com/apache/airflow/pull/38400#issuecomment-2024398539 > when setting the `dag_processing.processes` as gauge instead of the counter, we may need to initialize the value. > > ``` > Gauge works in the following way: >

Re: [PR] Implement context accessor for DatasetEvent extra [airflow]

2024-03-27 Thread via GitHub
uranusjr commented on code in PR #38481: URL: https://github.com/apache/airflow/pull/38481#discussion_r1542280532 ## docs/apache-airflow/authoring-and-scheduling/datasets.rst: ## @@ -224,6 +224,29 @@ If one dataset is updated multiple times before all consumed datasets have

Re: [PR] Implement context accessor for DatasetEvent extra [airflow]

2024-03-27 Thread via GitHub
uranusjr commented on code in PR #38481: URL: https://github.com/apache/airflow/pull/38481#discussion_r1542280532 ## docs/apache-airflow/authoring-and-scheduling/datasets.rst: ## @@ -224,6 +224,29 @@ If one dataset is updated multiple times before all consumed datasets have

Re: [PR] Implement context accessor for DatasetEvent extra [airflow]

2024-03-27 Thread via GitHub
uranusjr commented on code in PR #38481: URL: https://github.com/apache/airflow/pull/38481#discussion_r1542277907 ## airflow/models/taskinstance.py: ## @@ -761,6 +767,7 @@ def get_triggering_events() -> dict[str, list[DatasetEvent | DatasetEventPydanti "dag_run":

Re: [PR] Suppress false warning when TI state is QUEUED and TI doesn't have a start_date [airflow]

2024-03-27 Thread via GitHub
kzosabe commented on code in PR #34771: URL: https://github.com/apache/airflow/pull/34771#discussion_r1542257954 ## airflow/jobs/scheduler_job_runner.py: ## @@ -618,6 +618,11 @@ def _executable_task_instances_to_queued(self, max_tis: int, session: Session) - )

[PR] Introduce Amazon Bedrock service [airflow]

2024-03-27 Thread via GitHub
ferruzzi opened a new pull request, #38575: URL: https://github.com/apache/airflow/pull/38575 Includes the basic doc page, hook, operator, unit tests, and system test. Currently only supports invoking one of the prebuilt "foundation" models. Custom model support is coming next.

(airflow) branch constraints-main updated: Updating constraints. Github run id:8461051170

2024-03-27 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new fb8bf9d704 Updating

Re: [I] emit_state_change_metric produces many warnings even in standard use cases [airflow]

2024-03-27 Thread via GitHub
kzosabe commented on issue #34493: URL: https://github.com/apache/airflow/issues/34493#issuecomment-2024264076 We have successfully set the log level to debug in #38180 and closed it. However, the root cause of the problem, that there is no field like `ti.scheduled_dttm`, has not been

Re: [PR] Suppress false warning when TI state is QUEUED and TI doesn't have a start_date [airflow]

2024-03-27 Thread via GitHub
kzosabe commented on PR #34771: URL: https://github.com/apache/airflow/pull/34771#issuecomment-2024248127 After a long time we were able to successfully merge https://github.com/apache/airflow/pull/38180 and resolve this issue. Thanks especially to @HadarSha and @gil-tober for pushing

Re: [PR] Suppress false warning when TI state is QUEUED and TI doesn't have a start_date [airflow]

2024-03-27 Thread via GitHub
kzosabe closed pull request #34771: Suppress false warning when TI state is QUEUED and TI doesn't have a start_date URL: https://github.com/apache/airflow/pull/34771 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

(airflow) branch main updated: Implement render_templates on TaskInstancePydantic (#38559)

2024-03-27 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new f74d0e0f26 Implement render_templates on

Re: [PR] Implement render_templates on TaskInstancePydantic [airflow]

2024-03-27 Thread via GitHub
dstandish merged PR #38559: URL: https://github.com/apache/airflow/pull/38559 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] Fix typo in helm chart release notes links [airflow-site]

2024-03-27 Thread via GitHub
slmg opened a new pull request, #995: URL: https://github.com/apache/airflow-site/pull/995 Fix #962 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [I] Typo for Helm Chart URL [airflow-site]

2024-03-27 Thread via GitHub
slmg commented on issue #962: URL: https://github.com/apache/airflow-site/issues/962#issuecomment-2024224331 Hi @potiuk , happy to make a PR. I was not sure if fixing the typo in the file I shared was enough or if the typo existed on any template used to render the announcement. -- This

(airflow) branch main updated (4e070ef5d9 -> 5de907504b)

2024-03-27 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 4e070ef5d9 Make DAG.create_dagrun AIP-44-compatible (#38564) add 5de907504b Don't dispose pools when using

Re: [PR] Don't dispose pools when using internal api [airflow]

2024-03-27 Thread via GitHub
dstandish merged PR #38552: URL: https://github.com/apache/airflow/pull/38552 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Handle optional session in _refresh_from_db [airflow]

2024-03-27 Thread via GitHub
dstandish merged PR #38572: URL: https://github.com/apache/airflow/pull/38572 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Make DAG.create_dagrun AIP-44-compatible (#38564)

2024-03-27 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 4e070ef5d9 Make DAG.create_dagrun

Re: [PR] Make DAG.create_dagrun AIP-44-compatible [airflow]

2024-03-27 Thread via GitHub
dstandish merged PR #38564: URL: https://github.com/apache/airflow/pull/38564 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Handle optional session in _refresh_from_db (#38572)

2024-03-27 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 5c7b3e9fa7 Handle optional session in

Re: [PR] Make _run_task_by_local_task_job compatible with internal API [airflow]

2024-03-27 Thread via GitHub
uranusjr commented on code in PR #38563: URL: https://github.com/apache/airflow/pull/38563#discussion_r1542184733 ## airflow/cli/commands/task_command.py: ## @@ -278,7 +279,15 @@ def _run_task_by_local_task_job(args, ti: TaskInstance | TaskInstancePydantic) -

[PR] Add type hints for AWS provider [airflow]

2024-03-27 Thread via GitHub
hussein-awala opened a new pull request, #35966: URL: https://github.com/apache/airflow/pull/35966 closes: #11297 I will split the PR into small PRs, especially the refactoring/fixes changes, but I need to make it work first. -- This is an automated message from the Apache Git

(airflow) branch main updated: Fixe test for PROD images to include >= conditions (#38574)

2024-03-27 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new d6d7264341 Fixe test for PROD images to

Re: [PR] Fix test for PROD images to include >= conditions [airflow]

2024-03-27 Thread via GitHub
ephraimbuddy merged PR #38574: URL: https://github.com/apache/airflow/pull/38574 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Add type hints for AWS provider [airflow]

2024-03-27 Thread via GitHub
github-actions[bot] closed pull request #35966: Add type hints for AWS provider URL: https://github.com/apache/airflow/pull/35966 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Update timetable.rst [airflow]

2024-03-27 Thread via GitHub
github-actions[bot] closed pull request #37171: Update timetable.rst URL: https://github.com/apache/airflow/pull/37171 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Bump min packaging version for both Airflow and providers. [airflow]

2024-03-27 Thread via GitHub
github-actions[bot] commented on PR #37335: URL: https://github.com/apache/airflow/pull/37335#issuecomment-2024182469 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

Re: [PR] [WIP] Mapping tasks from ObjectStoragePath [airflow]

2024-03-27 Thread via GitHub
github-actions[bot] closed pull request #36319: [WIP] Mapping tasks from ObjectStoragePath URL: https://github.com/apache/airflow/pull/36319 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] fix: airflow dag parser logic [airflow]

2024-03-27 Thread via GitHub
github-actions[bot] commented on PR #37343: URL: https://github.com/apache/airflow/pull/37343#issuecomment-2024182454 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

(airflow) branch main updated: Avoid accidentally upgrading airflow in compatibility check (#38545)

2024-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new c855f1f54a Avoid accidentally upgrading airflow in

Re: [PR] Avoid accidentally upgrading airflow in compatibility check [airflow]

2024-03-27 Thread via GitHub
potiuk merged PR #38545: URL: https://github.com/apache/airflow/pull/38545 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Add health endpoint to the RPC server [airflow]

2024-03-27 Thread via GitHub
potiuk merged PR #38551: URL: https://github.com/apache/airflow/pull/38551 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Add health endpoint to the RPC server (#38551)

2024-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 0b6e7ee19e Add health endpoint to the RPC server

(airflow) branch main updated: Ensure that task is set properly when ti is TaskInstancePydantic (#38547)

2024-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 863371d4d6 Ensure that task is set properly when

Re: [PR] Ensure that task is set properly when ti is TaskInstancePydantic [airflow]

2024-03-27 Thread via GitHub
potiuk merged PR #38547: URL: https://github.com/apache/airflow/pull/38547 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Mounting DAGs from a private repo with git-sync: git-sync-init "git-s...@github.com: Permission denied (publickey)." regardless of configuration [airflow]

2024-03-27 Thread via GitHub
Vermyndax commented on issue #32981: URL: https://github.com/apache/airflow/issues/32981#issuecomment-2024160028 I'm also experiencing this issue with helm chart 1.13.1 and airflow 2.8.4. I'm wondering why this issue was closed with no feedback? Did I miss something?  -- This is an

[PR] Fixe test for PROD images to include >= conditions [airflow]

2024-03-27 Thread via GitHub
potiuk opened a new pull request, #38574: URL: https://github.com/apache/airflow/pull/38574 Some of the providers specified in list of packages might have a >= specification, for that case we should avoid treating all of the specification as part of the provider id and strip the part after

(airflow) branch fix-broken-compatibility-check updated (c1e39a2534 -> 3b5cc366e3)

2024-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch fix-broken-compatibility-check in repository https://gitbox.apache.org/repos/asf/airflow.git omit c1e39a2534 Avoid accidentally upgrading airflow in compatibility check add 3b5cc366e3

Re: [PR] Add method to get metadata from GCS blob in GCSHook [airflow]

2024-03-27 Thread via GitHub
jalengg commented on code in PR #38398: URL: https://github.com/apache/airflow/pull/38398#discussion_r1542149732 ## airflow/providers/google/cloud/hooks/gcs.py: ## @@ -1006,6 +1006,27 @@ def get_md5hash(self, bucket_name: str, object_name: str) -> str:

Re: [PR] Adding MSGraphOperator in Microsoft Azure provider [airflow]

2024-03-27 Thread via GitHub
potiuk commented on PR #38111: URL: https://github.com/apache/airflow/pull/38111#issuecomment-2024146526 > > You should **just** rebase. "Always Be Rebased" as the old Chinese proverb says. > > Who would be kind enough to review this PR? I just can't figure out what's wrong the the

Re: [I] [Backfill] Support Partial DAG Backfills while still honoring dependencies [airflow]

2024-03-27 Thread via GitHub
potiuk commented on issue #38407: URL: https://github.com/apache/airflow/issues/38407#issuecomment-2024147683 Assigned you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

(airflow) branch v2-9-test updated: Temporal fix to allow test to pass for prod image

2024-03-27 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v2-9-test by this push: new bfc31cacae Temporal fix to

(airflow-site) branch gh-pages updated (00aee7e8fc -> 2050d0ccd1)

2024-03-27 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch gh-pages in repository https://gitbox.apache.org/repos/asf/airflow-site.git discard 00aee7e8fc Rewritten history to remove past gh-pages deployments new 2050d0ccd1 Rewritten history to

Re: [PR] Avoid accidentally upgrading airflow in compatibility check [airflow]

2024-03-27 Thread via GitHub
potiuk commented on PR #38545: URL: https://github.com/apache/airflow/pull/38545#issuecomment-2024137295 Turned out that the root cause of it was `cohere` provider that was already excluded for 3.8 but - because of limiting it to <5 in #38348 it needs "importlib_metadata" in a version that

(airflow) branch fix-broken-compatibility-check updated (6acd515c0f -> c1e39a2534)

2024-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch fix-broken-compatibility-check in repository https://gitbox.apache.org/repos/asf/airflow.git discard 6acd515c0f Avoid accidentally upgrading airflow in compatibility check add c1e39a2534

Re: [I] [Backfill] Support Partial DAG Backfills while still honoring dependencies [airflow]

2024-03-27 Thread via GitHub
AryaMoghaddam commented on issue #38407: URL: https://github.com/apache/airflow/issues/38407#issuecomment-2024134612 I can take this up as a first issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

(airflow) branch fix-broken-compatibility-check updated (617accfa4d -> 6acd515c0f)

2024-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch fix-broken-compatibility-check in repository https://gitbox.apache.org/repos/asf/airflow.git discard 617accfa4d Avoid accidentally upgrading airflow in compatibility check add 6acd515c0f

Re: [PR] Bring back release airflow command to be run in canary build [airflow]

2024-03-27 Thread via GitHub
potiuk commented on PR #38486: URL: https://github.com/apache/airflow/pull/38486#issuecomment-2024124721 This one will run "fake" release (back). Also cc: @amoghrajesh -> the "issue generation" step is moved to this job from the "provider" job. -- This is an automated message from the

Re: [PR] Update description and use of default-python-version [airflow]

2024-03-27 Thread via GitHub
potiuk merged PR #38546: URL: https://github.com/apache/airflow/pull/38546 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated (e197339548 -> fdd3f93a11)

2024-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from e197339548 Implement _run_execute_callback on TaskInstancePydantic (#38560) add fdd3f93a11 Update description

(airflow-site) branch main updated: Add new meetup groups (#993)

2024-03-27 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new 87ff27abc2 Add new meetup groups (#993)

Re: [PR] Add new meetup groups [airflow-site]

2024-03-27 Thread via GitHub
potiuk merged PR #993: URL: https://github.com/apache/airflow-site/pull/993 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Implement context accessor for DatasetEvent extra [airflow]

2024-03-27 Thread via GitHub
jscheffl commented on code in PR #38481: URL: https://github.com/apache/airflow/pull/38481#discussion_r1542118514 ## docs/apache-airflow/authoring-and-scheduling/datasets.rst: ## @@ -224,6 +224,29 @@ If one dataset is updated multiple times before all consumed datasets have

Re: [PR] Can update RenderedTaskInstanceFields over RPC [airflow]

2024-03-27 Thread via GitHub
dstandish commented on code in PR #38565: URL: https://github.com/apache/airflow/pull/38565#discussion_r1542115819 ## airflow/models/taskinstance.py: ## @@ -2628,10 +2637,8 @@ def signal_handler(signum, frame): task_orig = self.render_templates(context=context,

Re: [PR] Use Task Output as Extra for Dataset Trigger and DAG Run Conf [airflow]

2024-03-27 Thread via GitHub
jscheffl closed pull request #38432: Use Task Output as Extra for Dataset Trigger and DAG Run Conf URL: https://github.com/apache/airflow/pull/38432 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Use Task Output as Extra for Dataset Trigger and DAG Run Conf [airflow]

2024-03-27 Thread via GitHub
jscheffl commented on PR #38432: URL: https://github.com/apache/airflow/pull/38432#issuecomment-2024093337 > I gave this a longer thought and I think I’m not particularly fond of the approach mainly because it mixes `Dataset.extra` and `DatasetEvent.extra`. As described in #37810, the

(airflow) branch main updated (179b963782 -> e197339548)

2024-03-27 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 179b963782 Don't dispose sqlalchemy engine when using internal api (#38562) add e197339548 Implement

Re: [PR] Don't dispose sqlalchemy engine when using internal api (std task runner) [airflow]

2024-03-27 Thread via GitHub
dstandish merged PR #38562: URL: https://github.com/apache/airflow/pull/38562 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Make type annotation less confusing in task_command.py [airflow]

2024-03-27 Thread via GitHub
dstandish merged PR #38561: URL: https://github.com/apache/airflow/pull/38561 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated (31c07ec7e6 -> e364259759)

2024-03-27 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 31c07ec7e6 Don't check migrations when internal API enabled (#38556) add e364259759 Use fetch_dagrun directly

Re: [PR] Don't actually check the db when using internal API [airflow]

2024-03-27 Thread via GitHub
dstandish merged PR #38554: URL: https://github.com/apache/airflow/pull/38554 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Implement _run_execute_callback on TaskInstancePydantic [airflow]

2024-03-27 Thread via GitHub
dstandish merged PR #38560: URL: https://github.com/apache/airflow/pull/38560 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated (07fd17a32e -> 179b963782)

2024-03-27 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 07fd17a32e Make type annotation less confusing in task_command.py (#38561) add 179b963782 Don't dispose

(airflow) branch main updated (e364259759 -> 07fd17a32e)

2024-03-27 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from e364259759 Use fetch_dagrun directly to avoid session creation (#38557) add 07fd17a32e Make type annotation

Re: [PR] Use fetch_dagrun directly to avoid session creation [airflow]

2024-03-27 Thread via GitHub
dstandish merged PR #38557: URL: https://github.com/apache/airflow/pull/38557 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated (00f35e84f8 -> 31c07ec7e6)

2024-03-27 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 00f35e84f8 Don't actually check the db when using internal API (#38554) add 31c07ec7e6 Don't check migrations

Re: [PR] Don't check migrations when internal API enabled [airflow]

2024-03-27 Thread via GitHub
dstandish merged PR #38556: URL: https://github.com/apache/airflow/pull/38556 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated (2ad923a001 -> 00f35e84f8)

2024-03-27 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 2ad923a001 Rerais of AirflowOptionalProviderFeatureException should be direct (#38555) add 00f35e84f8 Don't

Re: [PR] Use Task Output as Extra for Dataset Trigger and DAG Run Conf [airflow]

2024-03-27 Thread via GitHub
jscheffl commented on code in PR #38432: URL: https://github.com/apache/airflow/pull/38432#discussion_r1542109168 ## airflow/models/taskinstance.py: ## @@ -2455,7 +2456,7 @@ def _run_raw_task( try: if not mark_success: -

[PR] Undeprecating `DBApiHookForTests._make_common_data_structure` [airflow]

2024-03-27 Thread via GitHub
Taragolis opened a new pull request, #38573: URL: https://github.com/apache/airflow/pull/38573 https://github.com/apache/airflow/pull/36876 - incorrectly deprecate invalid method `DBApiHookForTests._make_common_data_structure` intends to be overwritten into the subclasses,

Re: [PR] Use Task Output as Extra for Dataset Trigger and DAG Run Conf [airflow]

2024-03-27 Thread via GitHub
jscheffl commented on code in PR #38432: URL: https://github.com/apache/airflow/pull/38432#discussion_r1542107183 ## airflow/models/taskinstance.py: ## @@ -2553,21 +2554,30 @@ def _run_raw_task( return None -def _register_dataset_changes(self, *, session:

Re: [PR] Use Task Output as Extra for Dataset Trigger and DAG Run Conf [airflow]

2024-03-27 Thread via GitHub
jscheffl commented on code in PR #38432: URL: https://github.com/apache/airflow/pull/38432#discussion_r1542106481 ## airflow/models/taskinstance.py: ## @@ -2553,21 +2554,30 @@ def _run_raw_task( return None -def _register_dataset_changes(self, *, session:

Re: [PR] Don't make unnecessary network calls with dag-related commands [airflow]

2024-03-27 Thread via GitHub
potiuk commented on PR #38553: URL: https://github.com/apache/airflow/pull/38553#issuecomment-2024082242 Tests failing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] Typo for Helm Chart URL [airflow-site]

2024-03-27 Thread via GitHub
potiuk commented on issue #962: URL: https://github.com/apache/airflow-site/issues/962#issuecomment-2024079090 Why don't one of you make a PR to fix it @allekai @slmg ? It's as easy as clicking "Suggest a change on this page" (bottom right) and fixing the typo using GitHub UI. Can we

(airflow) branch main updated (2227414489 -> 2ad923a001)

2024-03-27 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 2227414489 Turn common.io xcom exception into OptionalProviderFeatureException (#38543) add 2ad923a001 Rerais

Re: [PR] Add new meetup groups [airflow-site]

2024-03-27 Thread via GitHub
potiuk commented on PR #993: URL: https://github.com/apache/airflow-site/pull/993#issuecomment-2024073842 Fixed `Sao Paulo` and added Warsaw -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Re-raise of AirflowOptionalProviderFeatureException should be direct [airflow]

2024-03-27 Thread via GitHub
dstandish merged PR #38555: URL: https://github.com/apache/airflow/pull/38555 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] Remove select_column option in TaskInstance.get_task_instance [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38571: URL: https://github.com/apache/airflow/pull/38571 This was originally added in #28900 presumably for compatiblity with serialization. Maybe things have changed since then, because it's actually the Row object that does not serialize properly

[PR] INCOMPLETE - add stub method for _run_raw_task to TIPydantic [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38569: URL: https://github.com/apache/airflow/pull/38569 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] Make _get_template_context an RPC call [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38567: URL: https://github.com/apache/airflow/pull/38567 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] Don't create session in _execute_callable if using internal API [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38566: URL: https://github.com/apache/airflow/pull/38566 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] Can update RenderedTaskInstanceFields over RPC [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38565: URL: https://github.com/apache/airflow/pull/38565 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

(airflow-site) branch gh-pages updated (d78e6cd43c -> 00aee7e8fc)

2024-03-27 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch gh-pages in repository https://gitbox.apache.org/repos/asf/airflow-site.git discard d78e6cd43c Rewritten history to remove past gh-pages deployments new 00aee7e8fc Rewritten history to

[PR] Make _run_task_by_local_task_job compatible with internal API [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38563: URL: https://github.com/apache/airflow/pull/38563 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] Implement _run_execute_callback on TaskInstancePydantic [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38560: URL: https://github.com/apache/airflow/pull/38560 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

(airflow) annotated tag 2.9.0b2 updated (d48b910dc1 -> bf8ee2cc55)

2024-03-27 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to annotated tag 2.9.0b2 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag 2.9.0b2 was modified! *** from d48b910dc1 (commit) to bf8ee2cc55 (tag) tagging

[PR] Implement render_templates on TaskInstancePydantic [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38559: URL: https://github.com/apache/airflow/pull/38559 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] Render filename to use internal API [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38558: URL: https://github.com/apache/airflow/pull/38558 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] Don't check migrations when internal API enabled [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38556: URL: https://github.com/apache/airflow/pull/38556 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] Re-raise of AirflowOptionalProviderFeatureException should be direct [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38555: URL: https://github.com/apache/airflow/pull/38555 When re-raising as diff exception, should do `from` i think? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[PR] Don't actually check the db when using internal API [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38554: URL: https://github.com/apache/airflow/pull/38554 There is no need to perform this check, is there? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[PR] Don't make unnecessary network calls with dag-related commands [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38553: URL: https://github.com/apache/airflow/pull/38553 The function DagBag.get_dag has some logic to check if the serialized dag object should be updated. By accessing the dags dict directly we avoid that logic, and this is helpful for running a task

[PR] Don't dispose pools when using internal api [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38552: URL: https://github.com/apache/airflow/pull/38552 We aren't using pools in this context so don't need to dispose them. And doing so will fail anyway. -- This is an automated message from the Apache Git Service. To respond to the message,

[PR] Add health endpoint to the RPC server [airflow]

2024-03-27 Thread via GitHub
dstandish opened a new pull request, #38551: URL: https://github.com/apache/airflow/pull/38551 Will be necessary for helm chart. Right now I just have it returning True, because presumably if it can respond to such a request, it's health. Not sure if there's a more robust indicator

  1   2   3   >