Hi, I am getting the error: Failure authenticating with NTLM in the hadoop.logs.
1) Nutch version is 1.4 2) conf/httpclient-auth.xml contains the following: <auth-configuration> <credentials username="xyz" password="abc"> <default/> </credentials> </auth-configuration> 3) hadoop.log shows the following: 2012-02-17 16:40:25,678 INFO httpclient.Http - http.proxy.host = null 2012-02-17 16:40:25,678 INFO httpclient.Http - http.proxy.port = 8080 2012-02-17 16:40:25,678 INFO httpclient.Http - http.timeout = 10000 2012-02-17 16:40:25,678 INFO httpclient.Http - http.content.limit = 2097152 2012-02-17 16:40:25,678 INFO httpclient.Http - http.agent = Spider/Nutch-1.4 2012-02-17 16:40:25,678 INFO httpclient.Http - http.accept.language = en-us,en-gb,en;q=0.7,*;q=0.3 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Supported authentication schemes in the order of preference: [ntlm, digest, basic] 2012-02-17 16:40:26,552 INFO auth.AuthChallengeProcessor - ntlm authentication scheme selected 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Using authentication scheme: ntlm 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Authorization challenge processed 2012-02-17 16:40:27,098 DEBUG auth.AuthChallengeProcessor - Using authentication scheme: ntlm 2012-02-17 16:40:27,098 DEBUG auth.AuthChallengeProcessor - Authorization challenge processed 2012-02-17 16:40:27,692 DEBUG auth.AuthChallengeProcessor - Using authentication scheme: ntlm 2012-02-17 16:40:27,692 DEBUG auth.AuthChallengeProcessor - Authorization challenge processed 2012-02-17 16:40:27,692 INFO httpclient.HttpMethodDirector - Failure authenticating with NTLM <any realm>@xyz.com:80 2012-02-17 16:40:27,832 INFO parse.ParserChecker - parsing: http://xyz.com/Default.aspx 2012-02-17 16:40:27,832 INFO parse.ParserChecker - contentType: text/html I have reffered the http://wiki.apache.org/nutch/HttpAuthenticationSchemes section NeedHelp and seems like I do not have answers for question number 4, 5, 6 Please help me fix this problem. Thanks Gouri
