On my local macOS 11.2.3: ```
$ python --version Python 3.7.10 $ pip --version pip 21.0.1 from /usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pip (python 3.7) $ pip list | grep pyarrow pyarrow 3.0.0 $ which python /usr/local/anaconda3/envs/my_model/bin/python $ python >>> import pyarrow as pa >>> print(pa.__file__) / usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py ( http://usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py ) >>> import pyarrow.plasma >>> import pyarrow.gandiva as ga >>> print(ga.__file__) / usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/gandiva.cpython-37m-darwin.so ( http://usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/gandiva.cpython-37m-darwin.so ) ``` On my Ubuntu 14.04 instance: ``` $ python --version Python 3.7.10 $ pip --version pip 21.0.1 from /home/xander/anaconda3/envs/my_model/lib/python3.7/site-packages/pip (python 3.7) $ pip list | grep pyarrow pyarrow 3.0.0 $ which python /home/xander/anaconda3/envs/my_model/bin/python $ python >>> import pyarrow as pa >>> print(pa.__file__) / home/xander/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py ( http://home/xander/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py ) >>> import pyarrow.plasma >>> import pyarrow.gondiva Traceback (most recent call last): File "<stdin>", line 1, in <module> ModuleNotFoundError: No module named 'pyarrow.gondiva' ``` You can see that pyarrow.gondiva is found on mac but not on Ubuntu. Same Python version. Same pyarrow version. I installed both of them with `conda install -c conda-forge pyarrow==3.0.0`. On Mac, I see the expected Cython file and library: ``` $ l /usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/ | grep gandiva -rwxrwxr-x 2 xander staff 221K Apr 1 12:44 gandiva.cpython-37m-darwin.so ( http://gandiva.cpython-37m-darwin.so/ ) -rw-rw-r-- 2 xander staff 17K Jan 18 14:00 gandiva.pyx ``` On Ubuntu, I see only the Cython file: ``` $ l ~/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/ | grep gandiva -rw-rw-r-- 1 xander xander 17K Apr 13 12:28 gandiva.pyx ``` Is this expected? Should I be able to import pyarrow.gandiva on Ubuntu? Everything is run on Ubuntu so if I make use of pyarrow.gandiva I'll need to figure out how to call it. It's mentioned here that it was removed from Python wheels but should still be available in the conda install: https://issues.apache.org/jira/browse/ARROW-10154. I'm not finding it in my Ubuntu conda install. Thanks, Xander
