Christopher Aycock created ARROW-350:
----------------------------------------

             Summary: Add Kerberos support to HDFS shim
                 Key: ARROW-350
                 URL: https://issues.apache.org/jira/browse/ARROW-350
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++, Python
            Reporter: Christopher Aycock
            Assignee: Christopher Aycock


Speaking with [~wesmckinn], it would be really helpful to have Kerberos support 
in our HDFS logic. This should be straightforward; I would just need to switch 
to {{hdfsBuilderConnect()}} in the shim.

On a side note, is there a reason we aren't using Pivotal's libhdfs3? It uses 
RPCs natively rather than JNI.

https://github.com/Pivotal-Data-Attic/pivotalrd-libhdfs3

Dask has Python wrappers for this.

https://github.com/dask/hdfs3




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to