erg opened a new issue, #33241: URL: https://github.com/apache/airflow/issues/33241
### Apache Airflow version Other Airflow 2 version (please specify below) ### What happened I'm trying to upgrade to Airflow 2.5.1 to install in AWS's hosted mwaa airflow instance. It seems that some of the constraints are impossible. I need `snowflake-connector-python[pandas]` which the constraints file locks to `2.9.0` and pulls in `pyarrow<8.1.0 and >=8.0.0` The problem is that the same constraints file also locks `pyarrow==9.0.0` which is impossible because (again) `snowflake-connector-python[pandas]` wants `pyarrow<8.1.0 and >=8.0.0` Here's a constraints file for 2.5.1 and python3.10: https://raw.githubusercontent.com/apache/airflow/constraints-2.5.1/constraints-3.10.txt Here's a file generated 3 days ago: https://github.com/apache/airflow/blob/constraints-2.5.1-fix/constraints-3.10.txt ### What you think should happen instead The contraints file should not have impossible requirements like a package that requires `pyarrow<8.1.0 and >=8.0.0` when the constraint is `pyarrow==9.0` ### How to reproduce easy repro: ```sh # Create a venv, activate it, and install airflow 2.5.1 and snowflake-connector-python[pandas] python3.10 -m venv airflow-2.5.1 source airflow-2.5.1/bin/activate pip install --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-2.5.1/constraints-3.10.txt" "apache-airflow[crypto,celery,statsd]==2.5.1" 'snowflake-connector-python[pandas]' ERROR: Cannot install snowflake-connector-python[pandas]==2.9.0 because these package versions have conflicting dependencies. The conflict is caused by: snowflake-connector-python[pandas] 2.9.0 depends on pyarrow<8.1.0 and >=8.0.0; extra == "pandas" The user requested (constraint) pyarrow==9.0.0 To fix this you could try to: 1. loosen the range of package versions you've specified 2. remove package versions to allow pip attempt to solve the dependency conflict ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts ``` ``` python3.10 --version Python 3.10.10 ``` ### Operating System macbook pro m1 ### Versions of Apache Airflow Providers celery,crypto,snowflake,statsd ### Deployment Amazon (AWS) MWAA ### Deployment details _No response_ ### Anything else _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
