Hi Mohammad - This issue is really hard to track down. I assume it has actually been broken for quite a while.
I am curious just how important this is for your deployment and usecases. I'd like to get to closing down other issues for the 0.11.0 release rather than have this issue delay the release - if it is something that we can get by with as a known issue for another release. Thoughts? thanks, --larry On Fri, Dec 2, 2016 at 1:08 AM, Mohammad Islam <[email protected]> wrote: > Thanks Larry! > > > On Wednesday, November 30, 2016 3:45 PM, larry mccay < > [email protected]> wrote: > > > I see what's going on.This is going to take some time to debug and get a > fix in place. > Thanks for reporting this Mohammad! > On Tue, Nov 29, 2016 at 10:07 PM, larry mccay <[email protected]> wrote: > > Thanks for the note, Mohammad. > Let me play around with it and see what is going on there.Will probably > get back to you tomorrow about it. > On Tue, Nov 29, 2016 at 8:02 PM, Mohammad Islam <[email protected]> > wrote: > > Hi, > I set "default.app.topology.name" in gateway-site.xml to "uber" (my > default topology name). It worked fine if I gave the full URL. The command > looks like this "curl http://<KNOX_GW_URL>/gateway/ > uber/webhdfs/v1/?op=GETHOMEDIR ECTORY'". However, when I tried with command > "curl http://<KNOX_GW_URL>/webhdfs/ v1/?op=GETHOMEDIRECTORY'". I got the > HTTP error code 500. I looked into gateway.log file and found quite a few > error related to rewrite. The exact error messages are shown below: > Error message > 2016-11-30 00:39:51,565 ERROR hadoop.gateway > (UrlRewriteProcessor.java:rewr ite(169)) - Failed to rewrite URL: > http://<KNOX_GW_URL>/webhdfs/v > 1/?op=GETHOMEDIRECTORY, direction: IN via rule: > WEBHDFS/webhdfs/inbound/nameno de/root, status: FAILURE2016-11-30 > 00:39:51,565 ERROR hadoop.gateway (UrlRewriteProcessor.java:rewr ite(169)) > - Failed to rewrite URL: http://<KNOX_GW_URL>/webhdfs/v > 1/?op=GETHOMEDIRECTORY, direction: IN via rule: > WEBHDFS/webhdfs/inbound/nameno de/root, status: FAILURE > > After that, I modified the webhdfs/2.4.0/rewrite.xml by rewriting the > following pattern and it worked for short URL but long URL faces the same > issue. > Original: > <rule dir="IN" name="WEBHDFS/webhdfs/inbound/ namenode/root" > pattern="*://*:*/**/webhdfs/{v ersion}/?{**}"> <rewrite > template="{$serviceUrl[WEBHDFS ]}/{version}/?{**}"/> </rule> > Modified : > <rule dir="IN" name="WEBHDFS/webhdfs/inbound/ namenode/root" > pattern="*://*:*/webhdfs/{vers ion}/?{**}"> <rewrite > template="{$serviceUrl[WEBHDFS ]}/{version}/?{**}"/> </rule> > > Overall, the rewrite pattern may be the issue. We will need to support for > both short and long URL. May be, we can add multiple rewrite rules for each > route in service.xml.Is there any other cleaner way which may work for > all cases such as webhdfs, yarn, hive, UIs etc? > Regards,Mohammad > > > > > > > > >
