Unable to get listing of files for directory [/]

Hello ! I enabled yesterday the plugin HDFS with Ranger 0.5 on HDP 2.3.4.7. In Ranger UI, in the hdfs repository definition (with all the parameters for the repository), when I click on "test connection", I have an error message saying that the test failed. And in the xa_portal.log, I can see

Re: HDFS Plugin - Unable to get listing of files for directory [/] from Hadoop environment

You should be able to create your own account in Apache JIRA. https://issues.apache.org/jira/login.jsp and sign-in. After that you should be able to create the JIRA. You should use the project “Ranger". You won’t have permission to assign the owner, but it is fine. Thanks Bosco From: Dale

RE: HDFS Plugin - Unable to get listing of files for directory [/] from Hadoop environment

Yes sure, how do I do that without a log in? From: Don Bosco Durai [mailto:bo...@apache.org] Sent: 16 June 2016 19:29 To: user@ranger.incubator.apache.org Subject: Re: HDFS Plugin - Unable to get listing of files for directory [/] from Hadoop environment If you don’t mind, can you create a

Re: HDFS Plugin - Unable to get listing of files for directory [/] from Hadoop environment

If you don’t mind, can you create a JIRA for us to track using local hdfs-site.xml and core-site.xml. Thanks Bosco From: Dale Bradman Reply-To: Date: Thursday, June 16, 2016 at 1:43 AM To: "user@ranger.incubator.apache.org"

RE: HDFS Plugin - Unable to get listing of files for directory [/] from Hadoop environment

Yes definitely works for me. Makes sense as the properties are available on every node. I configured the HDFS plugin with Velmurugan’s suggestions and this has worked. There is one warning on the xa_portal: WARN org.apache.hadoop.hdfs.DFSUtil (DFSUtil.java:689) - Namenode for tatooine

Re: HDFS Plugin - Unable to get listing of files for directory [/] from Hadoop environment

Sorry to hijack the thread… Since it is common practice and sometimes required to have the HDFS properties be available on each node. Should we consider just loading the HDFS related properties directly from the HDFS properties file? In this way, we only need to provide to take the path to the

Re: HDFS Plugin - Unable to get listing of files for directory [/] from Hadoop environment

Having active name node in repo config should work just fine. Only resource lookup is not available during failover cases, until the repo config is updated. For HA configuration to work, need to add the below properties in repo config (I.e. additional entries in the advanced section). They can

RE: HDFS Plugin - Unable to get listing of files for directory [/] from Hadoop environment

That did not work. It works when I set: Hadoop.rpc.protection = - Then in HDFS plugin: Namenode URL = hdfs://hdpmaster01:8020 RPC Protection Type = Authentication The above works. It seems it is the HA configuration that is a problem. Will it work with NameNode HA? Is there any risk for it not

Re: HDFS Plugin - Unable to get listing of files for directory [/] from Hadoop environment

Dale: Could you set hadoop.rpc.protection to authentication and try? Thank you, Vel From: Dale Bradman > Reply-To: "user@ranger.incubator.apache.org"

HDFS Plugin - Unable to get listing of files for directory [/] from Hadoop environment

Trying to configure the HDFS plugin for Keberised, HA, HDP 2.4.2. I have followed this guide http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_Security_Guide/content/hdfs_plugin_kerberos.html I have created a "rangerrepouser" in AD and is visible in the Ranger UI. Advanced