I have tried to use Susam Pal's patch (Nutch-559) NTLM, Basic and Digest Authentication schemes for web/proxy server to be able to crawl Tomcat's http://127.0.0.1:8080/manager/html/ without any success. I see [Fatal Error] :-1:-1: Premature end of file right after it tries fetching. Given that most people on the list seem to have successfully used his patch I am very sure it something I am doing wrong. Starting from the very basics can anybody confirm that just using the latest patch NUTCH-559v0.4.patch versus the latest 1.0 trunk (not the 0.9) is okay or does it have to be patched versus the 0.9 trunk? Is the Tomcat manager a bad example for testing authentication?
Thanks Sully
