This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 4fa0eec9d47 Help pip to find appropriate boto for aiobotocore (#49166)
4fa0eec9d47 is described below
commit 4fa0eec9d472c76be564422c9d0339246d1b5ace
Author: Jarek Potiuk <ja...@potiuk.com>
AuthorDate: Sat Apr 12 21:25:34 2025 +0200
Help pip to find appropriate boto for aiobotocore (#49166)
Seems that `pip` has troubles with finding the right boto3
for aiobotocore which results in resolution too deep when trying
higher versions of boto3 than aiobotocore supports.
This limit should come from the aibotocore[boto3] extra, but
apparently `pip` does not use it straight away to limit boto3,
instaead it attempts to find resolution for higher versions
of boto3 and discard it later with aiobotocore.
We pin the latest aiobotocore - this way in the future when
we enable dependabot, we will be able to upgrade aiobotocore
together with updating the limits for botocore.
---
providers/amazon/pyproject.toml | 7 +++++--
1 file changed, 5 insertions(+), 2 deletions(-)
diff --git a/providers/amazon/pyproject.toml b/providers/amazon/pyproject.toml
index 1094721a025..3e5ca9ea61d 100644
--- a/providers/amazon/pyproject.toml
+++ b/providers/amazon/pyproject.toml
@@ -95,7 +95,10 @@ dependencies = [
# TODO: We can remove it once boto3 and aiobotocore both have compatible
botocore version or
# boto3 have native async support and we move away from aio aiobotocore
"aiobotocore" = [
- "aiobotocore[boto3]>=2.20.0",
+ "aiobotocore[boto3]>=2.21.1",
+ # boto3 here should be synchronized with latest aiobotocore version
otherwise pip might get
+ # into a backtracking loop and fail to install the package
+ "boto3<1.37.2,>=1.37.0"
]
"cncf.kubernetes" = [
"apache-airflow-providers-cncf-kubernetes>=7.2.0",
@@ -163,7 +166,7 @@ dev = [
"apache-airflow-providers-salesforce",
"apache-airflow-providers-ssh",
# Additional devel dependencies (do not remove this line and add extra
development dependencies)
- "aiobotocore>=2.13.0",
+ "aiobotocore[boto3]>=2.21.1",
"apache-airflow-providers-postgres",
"aws_xray_sdk>=2.12.0",
"moto[cloudformation,glue]>=5.1.2",
