[
https://issues.apache.org/jira/browse/ARROW-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17298176#comment-17298176
]
Antoine Pitrou commented on ARROW-11915:
----------------------------------------
AH, ok, thank you :)
> Pyarrow: non-legacy filesystem connection doesn't work while legacy does.
> -------------------------------------------------------------------------
>
> Key: ARROW-11915
> URL: https://issues.apache.org/jira/browse/ARROW-11915
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Affects Versions: 3.0.0
> Reporter: Ira Saktor
> Priority: Minor
>
> I have an issue with the
> pyarrow.fs.HadoopFileSystem() that i did not encounter with the legacy
> version of pa.hdfs.connect()
>
> When i do:
>
> `filesystem = pa.fs.HadoopFileSystem('my_host', port = port, kerb_ticket =
> path_to_my_ticket)`
> It gives me:
> OSError: HDFS connection failed
> But if I use the legacy version with the same parameters:
>
> `filesystem = pa.hdfs.connect('my_host', port = port, kerb_ticket =
> path_to_my_ticket)`
> Then the connection establishes successfully.
> Moreover, if I run
> import pyarrow as pa
> from pyarrow import fs
> filesystem = pa.hdfs.connect(host='my_host', port=0,
> kerb_ticket=path_to_my_ticket)
> filesystem = fs.HadoopFileSystem('my_host',port = 0,kerb_ticket =
> path_to_my_ticket)
> I am able to get the non-legacy filesystem connection to work.
> Is this a known issue? Is there something obvious i might be doing wrong?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
