potiuk merged PR #38016:
URL: https://github.com/apache/airflow/pull/38016
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 7e6b7e1667 Fix D105 for mongo provider (#38016)
Taragolis commented on code in PR #38010:
URL: https://github.com/apache/airflow/pull/38010#discussion_r1518871306
##
airflow/providers/amazon/aws/hooks/glue.py:
##
@@ -112,6 +112,7 @@ def __init__(
kwargs["client_type"] = "glue"
super().__init__(*args,
potiuk commented on PR #36755:
URL: https://github.com/apache/airflow/pull/36755#issuecomment-1987302096
OK. this one is likely going to be green. Waiting for a round of reviews!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
potiuk commented on PR #37990:
URL: https://github.com/apache/airflow/pull/37990#issuecomment-1987331170
I am ok with having this in, but .. shouldn't we always ignore and put
lower/upper bound instead? There is very little value in erroring out - maybe
we should log a warning instead and
hussein-awala commented on code in PR #36755:
URL: https://github.com/apache/airflow/pull/36755#discussion_r1518954689
##
dev/breeze/pyproject.toml:
##
@@ -81,7 +81,7 @@ name = "airflow_breeze"
[tool.black]
line-length = 110
-target-version = ['py37', 'py38', 'py39',
potiuk commented on PR #36755:
URL: https://github.com/apache/airflow/pull/36755#issuecomment-1987339852
Updated and addressed all NITS. Thanks @hussein-awala ! I also saw that we
likely run out of disk space when preparing ARM CI images - so I adapted it a
bit to run sequentially rather
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch python3.12
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 0e3b4f03e6 Add Python 3.12 support
add d8f0e3d368 Add Python 3.12 support
This update added new revisions
hainenber commented on issue #34489:
URL: https://github.com/apache/airflow/issues/34489#issuecomment-1987247387
Hi there, the task is free to pick up. Sorry, I'm not skillful for this one
--
This is an automated message from the Apache Git Service.
To respond to the message, please
potiuk commented on code in PR #36755:
URL: https://github.com/apache/airflow/pull/36755#discussion_r1518964022
##
dev/breeze/src/airflow_breeze/utils/run_tests.py:
##
@@ -118,6 +118,23 @@ def get_suspended_provider_args() -> list[str]:
return pytest_args
+def
potiuk commented on PR #38020:
URL: https://github.com/apache/airflow/pull/38020#issuecomment-1987350242
cc: @bolkedebruin -> the reason why we still have universal-pathlib conflict
when rebuilding CI cache.
--
This is an automated message from the Apache Git Service.
To respond to the
jscheffl opened a new pull request, #38021:
URL: https://github.com/apache/airflow/pull/38021
This PR is another "eye candy" for upcoming 2.9.0 release - and I hope I
pass the review and merge if before release cut-off.
Logging is usually a mass of text. Tasks/Operators generate a
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch python3.12
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 3bb6568cbe Add Python 3.12 support
add 6a00111b5e Show custom instance names for a mapped task in UI
Taragolis commented on PR #37718:
URL: https://github.com/apache/airflow/pull/37718#issuecomment-1987254112
Also fix Batch Executor Config
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch python3.12
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard d0d18d1782 Add Python 3.12 support
add 7e6b7e1667 Fix D105 for mongo provider (#38016)
add 5203029715
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 6838072102 Fix bug in validate-operators-init
potiuk merged PR #38014:
URL: https://github.com/apache/airflow/pull/38014
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
kevinalh commented on code in PR #38015:
URL: https://github.com/apache/airflow/pull/38015#discussion_r1518928827
##
airflow/decorators/base.py:
##
@@ -208,11 +208,25 @@ def __init__(
# since values for those will be provided when the task is run. Since
#
kevinalh commented on code in PR #38015:
URL: https://github.com/apache/airflow/pull/38015#discussion_r1518928827
##
airflow/decorators/base.py:
##
@@ -208,11 +208,25 @@ def __init__(
# since values for those will be provided when the task is run. Since
#
potiuk commented on code in PR #36755:
URL: https://github.com/apache/airflow/pull/36755#discussion_r1518964480
##
pyproject.toml:
##
@@ -573,7 +576,7 @@ apache-beam = [ # source:
airflow/providers/apache/beam/provider.yaml
"pyarrow>=14.0.1;python_version != \"3.12\"",
potiuk opened a new pull request, #38020:
URL: https://github.com/apache/airflow/pull/38020
Constraint caching added recently to the image caused some unexpected side
effects when conflicting constraints were added - as old constraints cached in
the image were not replaced even if main has
potiuk opened a new pull request, #38018:
URL: https://github.com/apache/airflow/pull/38018
Packaging has been updated to 24.0 - and since our build dependencies should
be pinned for reproducibilty - we have to manually bumpt them when some of the
few build dependencies got upgraded.
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch python3.12
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard ca29336d5d Add Python 3.12 support
add ffaa17e259 Add Python 3.12 support
This update added new revisions
eladkal commented on PR #37519:
URL: https://github.com/apache/airflow/pull/37519#issuecomment-1987333925
@okirialbert can you rebase and fix conflicts?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
potiuk commented on code in PR #36755:
URL: https://github.com/apache/airflow/pull/36755#discussion_r1518963892
##
dev/breeze/src/airflow_breeze/global_constants.py:
##
@@ -267,6 +267,7 @@ def get_default_platform_machine() -> str:
"2.7.1": ["3.8", "3.9", "3.10", "3.11"],
potiuk commented on code in PR #36755:
URL: https://github.com/apache/airflow/pull/36755#discussion_r1518965649
##
scripts/in_container/run_generate_constraints.py:
##
@@ -363,6 +367,7 @@ def generate_constraints_pypi_providers(config_params:
ConfigParams) -> None:
potiuk commented on PR #37936:
URL: https://github.com/apache/airflow/pull/37936#issuecomment-1987341144
cc: @ferruzzi @Bowrna -> I remember there were discussions about it in the
past . Did we decide to leave it in s for back-compatibility ?
--
This is an automated message from the
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
from 698053784a Upgrade UV to 0.1.17 (#38019)
add 5cafdcee8d Remove constraint caching from image build (#38020)
No
potiuk merged PR #38020:
URL: https://github.com/apache/airflow/pull/38020
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
potiuk commented on PR #38021:
URL: https://github.com/apache/airflow/pull/38021#issuecomment-1987357188
I ❤️ it. Been using it in GitHub for ages.
Folding before/after execute automatically is cool.
--
This is an automated message from the Apache Git Service.
To respond to the
VincentChantreau commented on issue #38003:
URL: https://github.com/apache/airflow/issues/38003#issuecomment-1987238944
When reading the logs in `trigger_reentry` when the trigger return a
"success" status, the operator read the log by calling `self.write_logs`
potiuk commented on issue #34489:
URL: https://github.com/apache/airflow/issues/34489#issuecomment-1987246911
Sure. But check with @hainenber - maybe they still want to work on it :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
Taragolis commented on issue #36897:
URL: https://github.com/apache/airflow/issues/36897#issuecomment-1987250896
Yeah, I will have a look today or tomorrow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch constraints-main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/constraints-main by this push:
new 68944780f8 Updating
potiuk opened a new pull request, #38019:
URL: https://github.com/apache/airflow/pull/38019
The latest UV **just** released should fix the problem introduced in 0.1.16
that disallowed non-approved PEP keys in pyproject.toml
This PR bumps 0.1.17 as the base version for UV
jscheffl commented on code in PR #36755:
URL: https://github.com/apache/airflow/pull/36755#discussion_r1518978720
##
scripts/ci/images/ci_start_arm_instance_and_connect_to_docker.sh:
##
@@ -20,7 +20,7 @@ SCRIPTS_DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd)"
potiuk commented on PR #38021:
URL: https://github.com/apache/airflow/pull/38021#issuecomment-1987357752
Just a warning - there **might** be some non-trivial performance issue
created by it. But I think it's worth risking it.
--
This is an automated message from the Apache Git Service.
potiuk commented on PR #37930:
URL: https://github.com/apache/airflow/pull/37930#issuecomment-1987228311
WOW ! Fantastic!. Let me try Python 3.12 build now :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
potiuk commented on issue #38017:
URL: https://github.com/apache/airflow/issues/38017#issuecomment-1987256300
cc: @hamedhsn ? Can you please take a look? It seems related to your change
As a workaround @gbloisi-openaire -> you can easily downgrade
`cncf.kubernetes` provider to
potiuk merged PR #38018:
URL: https://github.com/apache/airflow/pull/38018
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 5203029715 Update packaging to latest version in
shahar1 commented on PR #38014:
URL: https://github.com/apache/airflow/pull/38014#issuecomment-1987304881
> It looks like more files are failing on the test
Fixed, should be ok now
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch python3.12
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard ffaa17e259 Add Python 3.12 support
add 6838072102 Fix bug in validate-operators-init pre-commit (#38014)
potiuk merged PR #38019:
URL: https://github.com/apache/airflow/pull/38019
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 698053784a Upgrade UV to 0.1.17 (#38019)
bolkedebruin closed pull request #37559: Fix lazy loading of ObjectStoragePath
fs backends
URL: https://github.com/apache/airflow/pull/37559
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
bolkedebruin commented on PR #37559:
URL: https://github.com/apache/airflow/pull/37559#issuecomment-1987193832
closing as this will be solved differently
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
This is an automated email from the ASF dual-hosted git repository.
bolke pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
from 93dfdf0d7f Introduce mechanism to support multiple executor
configuration (#37635)
add 191b5c30e6 Update
bolkedebruin merged PR #37930:
URL: https://github.com/apache/airflow/pull/37930
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
potiuk commented on PR #37855:
URL: https://github.com/apache/airflow/pull/37855#issuecomment-1987142108
> @potiuk initially I was going to write a check that all pydantic models we
define can round trip. However, as yet some pydantic models do not have types
defined (as in DAT.THE_MODEL).
pankajastro commented on issue #38003:
URL: https://github.com/apache/airflow/issues/38003#issuecomment-1987212663
what is apache-airflow-providers-cncf-kubernetes version in your env?
--
This is an automated message from the Apache Git Service.
To respond to the message, please
poorvirohidekar opened a new pull request, #38016:
URL: https://github.com/apache/airflow/pull/38016
related: https://github.com/apache/airflow/issues/37523
Fixing the D105 pre commit hook for mongo provider
---
**^ Add meaningful description above**
Owen-CH-Leung commented on issue #37999:
URL: https://github.com/apache/airflow/issues/37999#issuecomment-1987137773
@nsAstro could you elaborate more on `allowing a user to set a function that
can provide an index pattern for a given task_run_id` ? I'm not so sure how
airflow can be
gbloisi-openaire opened a new issue, #38017:
URL: https://github.com/apache/airflow/issues/38017
### Apache Airflow version
2.8.2
### If "Other Airflow 2 version" selected, which one?
2.8.3rc1
### What happened?
I'm running a spark-pi example using the
boring-cyborg[bot] commented on issue #38017:
URL: https://github.com/apache/airflow/issues/38017#issuecomment-1987185050
Thanks for opening your first issue here! Be sure to follow the issue
template! If you are willing to raise PR to address this issue please do so, no
need to wait for
potiuk commented on issue #36897:
URL: https://github.com/apache/airflow/issues/36897#issuecomment-1987187179
Hey @Taragolis -> will you be taking a look at that :) ? Seems that you were
the closest to get it working
--
This is an automated message from the Apache Git Service.
To
bolkedebruin commented on PR #37930:
URL: https://github.com/apache/airflow/pull/37930#issuecomment-1987192013
@potiuk can we green light this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
michalmodras commented on code in PR #37223:
URL: https://github.com/apache/airflow/pull/37223#discussion_r1518845852
##
tests/system/providers/google/gdc/dataprocgdc/example_dataprocgdc.py:
##
@@ -0,0 +1,77 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+#
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch python3.12
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 2ba2e99bdf Add Python 3.12 support
add 517c201514 Add Python 3.12 support
This update added new revisions
github-actions[bot] commented on PR #36781:
URL: https://github.com/apache/airflow/pull/36781#issuecomment-1987425484
This pull request has been automatically marked as stale because it has not
had recent activity. It will be closed in 5 days if no further activity occurs.
Thank you for
jliu0812 opened a new pull request, #38022:
URL: https://github.com/apache/airflow/pull/38022
This fixes [Issue 38005](https://github.com/apache/airflow/issues/38005).
Result: Now EMRServerlessStartJobOperator is able to utilize partial/expand
functionality of Airflow.
boring-cyborg[bot] commented on PR #38022:
URL: https://github.com/apache/airflow/pull/38022#issuecomment-1987492612
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are unsure about any anything please check
our
jscheffl commented on PR #36755:
URL: https://github.com/apache/airflow/pull/36755#issuecomment-1987362116
don't know if it is/was a local issue but when starting on the PR the first
time (after update of breeze of course) the command `breeze start-airflow
--dev-mode --load-example-dags
jscheffl commented on PR #38021:
URL: https://github.com/apache/airflow/pull/38021#issuecomment-1987367787
> Just a warning - there **might** be some non-trivial performance issue
created by it. But I think it's worth risking it.
Okay, did a test with a DAG and just created ~40.000
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch constraints-main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/constraints-main by this push:
new df16567955 Updating
potiuk commented on PR #36755:
URL: https://github.com/apache/airflow/pull/36755#issuecomment-1987369156
> then the logs where showing (and automatically recovered in a retry
starting with success afterwards):
That's expected. First the image will be built with constraints - but
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch python3.12
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 517c201514 Add Python 3.12 support
add 748f2d2b52 Add Python 3.12 support
This update added new revisions
jscheffl commented on PR #38021:
URL: https://github.com/apache/airflow/pull/38021#issuecomment-1987359216
> Just a warning - there **might** be some non-trivial performance issue
created by it. But I think it's worth risking it.
Yeah, mainly depending on your browser/CPU speed and
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch python3.12
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit d8f0e3d368 Add Python 3.12 support
add 698053784a Upgrade UV to 0.1.17 (#38019)
add 5cafdcee8d Remove
potiuk commented on code in PR #36755:
URL: https://github.com/apache/airflow/pull/36755#discussion_r1518980059
##
Dockerfile.ci:
##
@@ -1054,6 +1054,17 @@ function check_download_pendulum() {
pip check
}
+function uninstall_cassandra_for_python_3_12() {
+if [[
alizademhdi commented on issue #37897:
URL: https://github.com/apache/airflow/issues/37897#issuecomment-1987378856
Hi @potiuk, I'm interested in doing the rest of the tasks. Can you assign it
to me?
--
This is an automated message from the Apache Git Service.
To respond to the message,
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch python3.12
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 748f2d2b52 Add Python 3.12 support
add 14b062406e Add Python 3.12 support
This update added new revisions
hamedhsn commented on issue #38017:
URL: https://github.com/apache/airflow/issues/38017#issuecomment-1987424532
@gbloisi-openaire can you pls post the content of your
`example_spark_kubernetes_operator_pi.yaml` file
I assume the file exists at `/example_spark_kubernetes_operator_pi.yaml`
kentdanas commented on PR #977:
URL: https://github.com/apache/airflow-site/pull/977#issuecomment-1987377755
> One thing I am **slightly** worried about is the weight it adds to our
website to embed those videos in our git. This adds significant weight to it
and we know we already have
jedcunningham commented on issue #37999:
URL: https://github.com/apache/airflow/issues/37999#issuecomment-1987635087
That was my idea. I had 2 that immediately came to mind:
- Allow templating in `index_patterns`, like we do for `log_id_template`
- A callable that deployment
lotrias17 commented on issue #34489:
URL: https://github.com/apache/airflow/issues/34489#issuecomment-1987630087
I'm very sorry I had mistaken the issue for another one. I am also not
skillfull enough for this one. I wanted to take issue #35946. Could you please
unassign me? Once again I
nsAstro commented on issue #37999:
URL: https://github.com/apache/airflow/issues/37999#issuecomment-1987664667
From a responsibilities perspective, if Airflow deems the user responsible
for streaming the tasks to ElasticSearch in any way they see fit, it should
allow equally flexible
77 matches
Mail list logo
