[ https://issues.apache.org/jira/browse/HDFS-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163753#comment-13163753 ]
Eli Collins commented on HDFS-2178: ----------------------------------- bq. Hoop actually depends on the HDFS JAR. HDFS JAR has to go into its WAR. That would be true for other file system implementations as well right? IMO either Hoop is cross hadoop file system and we test/support that use case and should put it in common to prevent it from becoming hdfs specific, or it's hdfs specific in which case it should live in HDFS and proxy to webhdfs. Wrt test coverage if a change is made to Hoop in common that breaks eg HDFS or WebHDFS backends then those jenkins jobs fail as soon as they pull in the new artifact. This is how it works today for other cross-component features. > Contributing Hoop to HDFS, replacement for HDFS proxy with read/write > capabilities > ---------------------------------------------------------------------------------- > > Key: HDFS-2178 > URL: https://issues.apache.org/jira/browse/HDFS-2178 > Project: Hadoop HDFS > Issue Type: Improvement > Affects Versions: 0.23.0 > Reporter: Alejandro Abdelnur > Assignee: Alejandro Abdelnur > Fix For: 0.24.0, 0.23.1 > > Attachments: HDFS-2178.patch, HDFS-2178.patch, HDFS-2178.patch, > HDFS-2178.patch, HDFS-2178.patch, HDFS-2178.patch, HDFS-2178.patch, > HDFSoverHTTP-API.html, HdfsHttpAPI.pdf > > > We'd like to contribute Hoop to Hadoop HDFS as a replacement (an improvement) > for HDFS Proxy. > Hoop provides access to all Hadoop Distributed File System (HDFS) operations > (read and write) over HTTP/S. > The Hoop server component is a REST HTTP gateway to HDFS supporting all file > system operations. It can be accessed using standard HTTP tools (i.e. curl > and wget), HTTP libraries from different programing languages (i.e. Perl, > Java Script) as well as using the Hoop client. The Hoop server component is a > standard Java web-application and it has been implemented using Jersey > (JAX-RS). > The Hoop client component is an implementation of Hadoop FileSystem client > that allows using the familiar Hadoop filesystem API to access HDFS data > through a Hoop server. > Repo: https://github.com/cloudera/hoop > Docs: http://cloudera.github.com/hoop > Blog: http://www.cloudera.com/blog/2011/07/hoop-hadoop-hdfs-over-http/ > Hoop is a Maven based project that depends on Hadoop HDFS and Alfredo (for > Kerberos HTTP SPNEGO authentication). > To make the integration easy, HDFS Mavenization (HDFS-2096) would have to be > done first, as well as the Alfredo contribution (HADOOP-7119). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira