[
https://issues.apache.org/jira/browse/ARROW-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17442787#comment-17442787
]
Nikolay Markov edited comment on ARROW-12338 at 11/12/21, 3:00 PM:
-------------------------------------------------------------------
Having the same issue on pyarrow==5.0.0. Kerberos ticket and username are
correct, everything works from command line. Trying to dig deeper, but still no
luck. Other operations won't work, either. Any advice on how to debug this?
was (Author: JIRAUSER280132):
Having the same issue on pyarrow==5.0.0. Kerberos ticket and username are
correct, everything works from command line. Trying to dig deeper, but still no
luck.
> [Python] Permission denied while accessing HDFS data
> ----------------------------------------------------
>
> Key: ARROW-12338
> URL: https://issues.apache.org/jira/browse/ARROW-12338
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Affects Versions: 3.0.0
> Reporter: Suhas N M
> Priority: Blocker
> Labels: filesystem, hdfs
>
> Hi, I have been trying to connect to HDFS cluster using pyarrow version
> 3.0.0, connection goes through, but I am unable to perform any operation
> involving HDFS cluster. Here is the error thrown:
> Traceback (most recent call last):
> File "pyarrow_test.py", line 8, in <module>
> hdfs.create_dir('test3')
> File "pyarrow/_fs.pyx", line 450, in pyarrow._fs.FileSystem.create_dir
> File "pyarrow/error.pxi", line 99, in pyarrow.lib.check_status
> OSError: HDFS create directory failed, errno: 13 (Permission denied)
> PS: I have checked access permissions and they are correct. I am able to
> access the files and create directories with the 'hdfs' command.
> Hadoop cluster is Kerberos enabled, I have used the following line to create
> connection:
> hdfs = fs.HadoopFileSystem('<hostname>', 8020, user='<username>',
> kerb_ticket='/tmp/krb5cc_500')
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
