Tagar commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3
URL: https://github.com/apache/airflow/pull/5659#issuecomment-614118092
 
 
   > Just an FYI: pyarrow is a _nightmare_ to try and install on alpline linux. 
I don't think this affects us, as it's an optional dep, and we provide slim 
Debian images.
   
   I had issues with pyarrow dependency issues too. Boost, a popular C++ 
library was most often caused a lot of those issues. Arrow 0.16 release in Jan 
made Boost optional. 
   https://arrow.apache.org/blog/2020/02/12/0.16.0-release/ 
   
   > Notably, Boost is no longer required. We invested effort to vendor some 
small essential dependencies: Flatbuffers, double-conversion, and uriparser. 
Many optional features requiring external libraries, like compression and GLog 
integration, are now disabled by default. Several subcomponents of the C++ 
project like the filesystem API, CSV, compute, dataset and JSON layers, as well 
as command-line utilities, are now disabled by default
   
   So it might be a good idea to try latest pyarrow now. 
   
   On a separate note, I sent a comment above 
   
   > I've published sasl3 package on pypi
   > https://pypi.org/project/sasl3/
   > https://github.com/sparkur/python-sasl3
   > 
   > Please give that a try instead if sasl 
   > 
   > 
   
   That should address the issue described by @elukey in this comment 
   https://github.com/apache/airflow/pull/5659#issuecomment-559814094 
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to