Hey Larry, i got the following error
<title>Error 500 Server Error</title> </head> <body><h2>HTTP ERROR 500</h2> <p>Problem accessing /gateway/cluster1/webhdfs/v1/. And the gateway.log file contains: 2015-07-03 00:09:04,560 ERROR hadoop.gateway (AbstractGatewayFilter.java:doFilter(69)) - Failed to execute filter: java.lang.NullPointerException 2015-07-03 00:09:04,560 ERROR hadoop.gateway (GatewayFilter.java:doFilter(135)) - Gateway processing failed: javax.servlet.ServletException: java.lang.NullPointerException javax.servlet.ServletException: java.lang.NullPointerException at org.apache.hadoop.gateway.filter.AbstractGatewayFilter.doFilter(AbstractGatewayFilter.java:70) at org.apache.hadoop.gateway.GatewayFilter$Holder.doFilter(GatewayFilter.java:315) at org.apache.hadoop.gateway.GatewayFilter$Chain.doFilter(GatewayFilter.java:215) at org.apache.hadoop.gateway.GatewayFilter.doFilter(GatewayFilter.java:129) at org.apache.hadoop.gateway.GatewayServlet.service(GatewayServlet.java:121) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:501) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:428) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:971) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1033) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:644) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) at org.eclipse.jetty.io.nio.SslConnection.handle(SslConnection.java:196) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:667) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.NullPointerException On Fri, Jul 3, 2015 at 12:07 AM, larry mccay <[email protected]> wrote: > Try lower case webhdfs as in: > > 'https://localhost:8443/gateway/cluster1/webhdfs/v1/?op=GETHOMEDIRECTORY' > > > On Thu, Jul 2, 2015 at 2:59 PM, Aneela Saleem <[email protected]> > wrote: > >> Dear larry, >> >> The gateway.log file contains the following logs: >> >> 2015-07-02 23:43:16,391 INFO hadoop.gateway >> (GatewayServer.java:handleCreateDeployment(427)) - Deploying topology >> cluster1 to >> /home/hduser/knox-0.6.0/bin/../data/deployments/cluster1.war.14e501479a0 >> 2015-07-02 23:43:16,392 INFO hadoop.gateway >> (DeploymentFactory.java:createDeployment(82)) - Configured services >> directory is /home/hduser/knox-0.6.0/bin/../data/services >> 2015-07-02 23:43:16,428 INFO hadoop.gateway >> (DefaultGatewayServices.java:initializeContribution(180)) - Credential >> store found for the cluster: cluster1 - no need to create one. >> 2015-07-02 23:44:40,453 WARN hadoop.gateway >> (GatewayFilter.java:doFilter(152)) - Failed to match path >> /WEBHDFS/v1?op=GETHOMEDIRECTORY >> 2015-07-02 23:44:51,722 WARN hadoop.gateway >> (GatewayFilter.java:doFilter(152)) - Failed to match path >> /WEBHDFS/v1?op=GETHOMEDIRECTORY >> 2015-07-02 23:45:30,783 WARN hadoop.gateway >> (GatewayFilter.java:doFilter(152)) - Failed to match path >> /WEBHDFS/v1?op=GETHOMEDIRECTORY >> >> And i'm just a beginner. I'm trying to configure Knox Topology to connect >> to HDFS, using default services provided. And i'm validating connection to >> services. >> >> On Thu, Jul 2, 2015 at 11:50 PM, larry mccay <[email protected]> >> wrote: >> >>> Please check the {GATEWAY_HOME}/logs/gateway.log file for errors during >>> deployment. >>> >>> I notice that you have no providers described in cluster1.xml - this may >>> be the root of your problem. >>> I don't think that I have ever even tried that. >>> >>> What are you expecting the authentication behavior to be there? >>> >>> >>> On Thu, Jul 2, 2015 at 2:27 PM, Aneela Saleem <[email protected]> >>> wrote: >>> >>>> ${KNOX_HOME}/knox/conf/topologies has the following contents: >>>> >>>> admin.xml cluster1.xml README sandbox.xml >>>> >>>> cluster1.xml is the topology descriptor file created by me. >>>> >>>> cluster1.xml has following contents: >>>> >>>> <topology> >>>> <gateway> >>>> </gateway> >>>> <service> >>>> <role>NAMENODE</role> >>>> <url>hdfs:// namenode-host :8020</url> >>>> </service> >>>> >>>> <service> >>>> <role>JOBTRACKER</role> >>>> <url>rpc:// jobtracker-host :8050</url> >>>> </service> >>>> >>>> <service> >>>> <role>RESOURCEMANAGER</role> >>>> <url>http://red3:8088/ws</url> >>>> </service> >>>> >>>> <service> >>>> <role>WEBHDFS</role> >>>> <url>http://localhost:50070/webhdfs</url> >>>> </service> >>>> >>>> <service> >>>> <role>WEBHCAT</role> >>>> <url>http://webcat-host :50111/templeton</url> >>>> </service> >>>> >>>> <service> >>>> <role>OOZIE</role> >>>> <url>http://oozie-host :11000/oozie</url> >>>> </service> >>>> >>>> <service> >>>> <role>WEBHBASE</role> >>>> <url>http://webhbase-host :60080</url> >>>> </service> >>>> </topology> >>>> >>>> >>>> admin.xml has default contents. I did not make any changes. >>>> >>>> >>>> >>>> On Thu, Jul 2, 2015 at 11:15 PM, Steve Howard <[email protected]> >>>> wrote: >>>> >>>>> To be clear, the error isn't hostname not found (that just means it >>>>> wasn't in the DNS cache on your computer), it's that the URL can't be >>>>> found >>>>> by the knox server. >>>>> >>>>> Can you post the contents of your ${KNOX_HOME}/knox/conf/topologies >>>>> directory? >>>>> >>>>> On Thu, Jul 2, 2015 at 1:50 PM, Aneela Saleem <[email protected]> >>>>> wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> I'm trying to connect to HDFS through Knox gateway. I run the >>>>>> following command: >>>>>> >>>>>> curl -vk >>>>>> https://localhost:8443/gateway/cluster1/WEBHDFS/v1?op=GETHOMEDIRECTORY >>>>>> >>>>>> when i run this command i get the following error: >>>>>> >>>>>> * Hostname was NOT found in DNS cache >>>>>> * Trying 127.0.0.1... >>>>>> * Connected to localhost (127.0.0.1) port 8443 (#0) >>>>>> * successfully set certificate verify locations: >>>>>> * CAfile: none >>>>>> CApath: /etc/ssl/certs >>>>>> * SSLv3, TLS handshake, Client hello (1): >>>>>> * SSLv3, TLS handshake, Server hello (2): >>>>>> * SSLv3, TLS handshake, CERT (11): >>>>>> * SSLv3, TLS handshake, Server key exchange (12): >>>>>> * SSLv3, TLS handshake, Server finished (14): >>>>>> * SSLv3, TLS handshake, Client key exchange (16): >>>>>> * SSLv3, TLS change cipher, Client hello (1): >>>>>> * SSLv3, TLS handshake, Finished (20): >>>>>> * SSLv3, TLS change cipher, Client hello (1): >>>>>> * SSLv3, TLS handshake, Finished (20): >>>>>> * SSL connection using ECDHE-RSA-DES-CBC3-SHA >>>>>> * Server certificate: >>>>>> * subject: C=US; ST=Test; L=Test; O=Hadoop; OU=Test; CN=localhost >>>>>> * start date: 2015-06-29 21:39:18 GMT >>>>>> * expire date: 2016-06-28 21:39:18 GMT >>>>>> * issuer: C=US; ST=Test; L=Test; O=Hadoop; OU=Test; CN=localhost >>>>>> * SSL certificate verify result: self signed certificate (18), >>>>>> continuing anyway. >>>>>> > GET /gateway/cluster1/WEBHDFS/v1?op=GETHOMEDIRECTORY HTTP/1.1 >>>>>> > User-Agent: curl/7.35.0 >>>>>> > Host: localhost:8443 >>>>>> > Accept: */* >>>>>> > >>>>>> < HTTP/1.1 404 Not Found >>>>>> < Content-Length: 0 >>>>>> * Server Jetty(8.1.14.v20131031) is not blacklisted >>>>>> < Server: Jetty(8.1.14.v20131031) >>>>>> < >>>>>> * Connection #0 to host localhost left intact >>>>>> >>>>>> >>>>>> >>>>>> Can anyone please help me in tackling this issue? >>>>>> >>>>> >>>>> >>>> >>> >> >
