Hi Gouri, Did you see any HTTP error code in the stdout?
I'm not sure if this will work but you can try this: http://hc.apache.org/httpcomponents-client-ga/ntlm.html Remi On Fri, Feb 17, 2012 at 1:27 PM, Gouri Deshpande <[email protected]>wrote: > Hi, > > I am getting the error: Failure authenticating with NTLM in the > hadoop.logs. > > 1) Nutch version is 1.4 > > 2) conf/httpclient-auth.xml contains the following: > > <auth-configuration> > <credentials username="xyz" password="abc"> > <default/> > </credentials> > </auth-configuration> > > 3) hadoop.log shows the following: > > 2012-02-17 16:40:25,678 INFO httpclient.Http - http.proxy.host = null > 2012-02-17 16:40:25,678 INFO httpclient.Http - http.proxy.port = 8080 > 2012-02-17 16:40:25,678 INFO httpclient.Http - http.timeout = 10000 > 2012-02-17 16:40:25,678 INFO httpclient.Http - http.content.limit = > 2097152 > 2012-02-17 16:40:25,678 INFO httpclient.Http - http.agent = > Spider/Nutch-1.4 > 2012-02-17 16:40:25,678 INFO httpclient.Http - http.accept.language = > en-us,en-gb,en;q=0.7,*;q=0.3 > 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Supported > authentication schemes in the order of preference: [ntlm, digest, basic] > 2012-02-17 16:40:26,552 INFO auth.AuthChallengeProcessor - ntlm > authentication scheme selected > 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Using > authentication scheme: ntlm > 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Authorization > challenge processed > 2012-02-17 16:40:27,098 DEBUG auth.AuthChallengeProcessor - Using > authentication scheme: ntlm > 2012-02-17 16:40:27,098 DEBUG auth.AuthChallengeProcessor - Authorization > challenge processed > 2012-02-17 16:40:27,692 DEBUG auth.AuthChallengeProcessor - Using > authentication scheme: ntlm > 2012-02-17 16:40:27,692 DEBUG auth.AuthChallengeProcessor - Authorization > challenge processed > 2012-02-17 16:40:27,692 INFO httpclient.HttpMethodDirector - Failure > authenticating with NTLM <any realm>@xyz.com:80 <http://xyz.com/> > 2012-02-17 16:40:27,832 INFO parse.ParserChecker - parsing: > http://xyz.com/Default.aspx > 2012-02-17 16:40:27,832 INFO parse.ParserChecker - contentType: text/html > > I have reffered the > http://wiki.apache.org/nutch/HttpAuthenticationSchemes section > NeedHelp and > seems like I do not have answers for question number 4, 5, 6 > > Please help me fix this problem. > > Thanks > Gouri >
