potiuk commented on PR #44640: URL: https://github.com/apache/airflow/pull/44640#issuecomment-2522449434
No. This is not going to work. both pandas and pyarrow are required dependencies of `databricks-sql-connector`. We only have them added to workaround the fact that there are other providers that also need them and we want to keep all the minimum versions in sync - but they will come anyway from the connector. Here are deps of the `databricks-sql-connector` 3.6.0 for example. ``` Requires-Dist: alembic (>=1.0.11,<2.0.0) ; extra == "alembic" Requires-Dist: lz4 (>=4.0.2,<5.0.0) Requires-Dist: numpy (>=1.16.6,<2.0.0) ; python_version >= "3.8" and python_version < "3.11" Requires-Dist: numpy (>=1.23.4,<2.0.0) ; python_version >= "3.11" Requires-Dist: oauthlib (>=3.1.0,<4.0.0) Requires-Dist: openpyxl (>=3.0.10,<4.0.0) Requires-Dist: pandas (>=1.2.5,<2.3.0) ; python_version >= "3.8" Requires-Dist: pyarrow (>=14.0.1,<17) Requires-Dist: requests (>=2.18.1,<3.0.0) Requires-Dist: sqlalchemy (>=2.0.21) ; extra == "sqlalchemy" or extra == "alembic" Requires-Dist: thrift (>=0.16.0,<0.21.0) Requires-Dist: urllib3 (>=1.26) Project-URL: Bug Tracker, https://github.com/databricks/databricks-sql-python/issues Project-URL: Homepage, https://github.com/databricks/databricks-sql-python Description-Content-Type: text/markdown ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
