[
https://issues.apache.org/jira/browse/ARROW-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16111043#comment-16111043
]
Wes McKinney commented on ARROW-1314:
-------------------------------------
I don't think Linux shared libraries (like libhdfs.so, libhdfs3.so) can be
loaded on Mac. So libhdfs needs to be compiled for the macOS architecture. It
looks like some other projects have documented this; we could go through the
exercise and add it to the project documentation:
https://github.com/forward/node-hdfs#mac-osx
> libhdfs installation didn't work - mac
> --------------------------------------
>
> Key: ARROW-1314
> URL: https://issues.apache.org/jira/browse/ARROW-1314
> Project: Apache Arrow
> Issue Type: Improvement
> Environment: mac 10.12.6
> Reporter: Martin Durant
>
> Having set
> HADOOP_HOME /Users/mdurant/Downloads/hadoop-2.8.1 (straight download, does
> contain libhdfs.so in native)
> java openjdk version "1.8.0_121" in anaconda install directory
> and CLASSPATH as in the docs (too long to show)
> ```
> In [3]: pa.hdfs
> ---------------------------------------------------------------------------
> AttributeError Traceback (most recent call last)
> <ipython-input-3-4ceca32a5f9f> in <module>()
> ----> 1 pa.hdfs
> AttributeError: module 'pyarrow' has no attribute 'hdfs'
> In [4]: pa.have_libhdfs()
> Out[4]: False
> In [5]: pa.have_libhdfs3()
> Out[5]: False
> ```
> (I also have libhdfs3.so - not .dylib - but it is not found even if included
> in DYLD_FALLBACK_LIBRARY_PATH)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
