This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 0050e44 Limit Snowflake connector to< 2.7.2 (#20395)
0050e44 is described below
commit 0050e44f473ad2802c882cf008846a32c83d009d
Author: Jarek Potiuk <[email protected]>
AuthorDate: Sat Dec 18 16:14:42 2021 +0100
Limit Snowflake connector to< 2.7.2 (#20395)
The Snowflake connector 2.7.2 requires pyarrow to be >=6.0.0
(but it has no "install_requires" for it - it checks it
dynamically and prints warning when imported.
We should limit the provider until apache-beam will remove the
pyarrow < 6.0.0 limitation.
---
setup.py | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git a/setup.py b/setup.py
index 90dd4e4..a6ad949 100644
--- a/setup.py
+++ b/setup.py
@@ -468,7 +468,9 @@ slack = [
'slack_sdk>=3.0.0,<4.0.0',
]
snowflake = [
- 'snowflake-connector-python>=2.4.1',
+ # Snowflake connector 2.7.2 requires pyarrow >=6.0.0 but apache-beam
requires < 6.0.0
+ # We should remove the limitation when apache-beam upgrades pyarrow
+ 'snowflake-connector-python>=2.4.1,<2.7.2',
# The snowflake-alchemy 1.2.5 introduces a hard dependency on
sqlalchemy>=1.4.0, but they didn't define
# this requirements in setup.py, so pip cannot figure out the correct set
of dependencies.
# See: https://github.com/snowflakedb/snowflake-sqlalchemy/issues/234