Hi Rajiv, Thanks again for quick reply.
The use case is as follows. Please let me know how can i use HDFS RPC+SOCKS proxy to achieve below. 1. Client connect to HDFS proxy using HDFS driver ( not HTTPFs or WebHDFS).Proxy that sits between client and HDFS server. 2. Client request to access a file from HDFS cluster. 3. Proxy recognizes that the client does not have permission to access the file 4. Proxy replies back to the client with no data or access denied. Please note that policy that drives access control of the files is much more complex then just ACL of the file. thanks Rahul On Mon, Feb 9, 2015 at 3:11 PM, Rajiv Chittajallu < raj...@yahoo-inc.com.invalid> wrote: > Rahul, > > If a client can use HDFS RPC why is a Proxy required? Are the clients not > allowed to reach data nodes directly? > > WebHDFS + Apache Traffic server or HDFS RPC + SOCK Proxy should work. > > If you can share a use case, it would probably help. > > -rajive > > > ----- Original Message ----- > From: Rahul Shrivastava <rhshr...@gmail.com> > To: hdfs-dev@hadoop.apache.org; Rajiv Chittajallu <raj...@yahoo-inc.com> > Cc: > Sent: Monday, February 9, 2015 2:58 PM > Subject: Re: Proxy for HDFS > > Thanks Rajiv. > > I did look into HttpFs before but i wanted a build a proxy at HDFS layer. > This is specific for clients which do not use HTTP ( i.e. HttpFs or > webHDFS) to talk to the HDFS cluster. That includes clients which uses HDFS > driver to talk to HDFS cluster. > > thanks > Rahul > > > > > > On Mon, Feb 9, 2015 at 2:53 PM, Rajiv Chittajallu < > raj...@yahoo-inc.com.invalid> wrote: > > > > > > https://github.com/apache/hadoop/tree/branch-2.6/hadoop-hdfs-project/hadoop-hdfs-httpfs > > > > > > > > > > ----- Original Message ----- > > From: Rahul Shrivastava <rhshr...@gmail.com> > > To: hdfs-dev@hadoop.apache.org > > Cc: > > Sent: Monday, February 9, 2015 2:35 PM > > Subject: Proxy for HDFS > > > > Hi, > > > > I have looking in HDFS code base ( 2.6.0) for the last couple of days for > > any possible proxy that we could utilize to create a proxy for HDFS. > > Is there any hook within HDFS to build a proxy around that. > > > > thanks > > Rahul > > >
