Hi Susam,
When we changed httpclient-auth.xml to most basic configuration
<auth-configuration>
<credentials username="<someuser>" password="<somepass>">
<default />
</credentials>
</auth-configuration>
or just tv.tms.toyota.com
<auth-configuration>
<credentials username="someuser" password="somepass">
<authscope host="tv.tms.toyota.com" port="80" realm="TMS"/>
</credentials>
</auth-configuration>
or tv.tms.toyota.com + ip
<auth-configuration>
<credentials username="someuser" password="somepass">
<authscope host="tv.tms.toyota.com" port="80" realm="TMS"/>
<authscope host="10.52.112.12" port="80" realm="TMS"/>
<authscope host="10.52.21.83" port="80" realm="TMS"/>
</credentials>
</auth-configuration>
We get the same error:
2011-02-25 10:20:01,327 DEBUG auth.AuthChallengeProcessor - Supported
authentication schemes in the order of preference: [ntlm, digest, basic]
2011-02-25 10:20:01,327 INFO auth.AuthChallengeProcessor - ntlm
authentication scheme selected
2011-02-25 10:20:01,328 DEBUG auth.AuthChallengeProcessor - Using
authentication scheme: ntlm
2011-02-25 10:20:01,328 DEBUG auth.AuthChallengeProcessor - Authorization
challenge processed
2011-02-25 10:20:01,390 DEBUG auth.AuthChallengeProcessor - Using
authentication scheme: ntlm
2011-02-25 10:20:01,390 DEBUG auth.AuthChallengeProcessor - Authorization
challenge processed
2011-02-25 10:20:02,071 INFO fetcher.Fetcher - -activeThreads=1,
spinWaiting=0, fetchQueues.totalSize=0
2011-02-25 10:20:02,159 DEBUG auth.AuthChallengeProcessor - Using
authentication scheme: ntlm
2011-02-25 10:20:02,159 DEBUG auth.AuthChallengeProcessor - Authorization
challenge processed
2011-02-25 10:20:02,159 INFO httpclient.HttpMethodDirector - Failure
authenticating with NTLM <any realm>@tv.tms.toyota.com:80
2011-02-25 10:20:02,460 INFO fetcher.Fetcher - -finishing thread
FetcherThread, activeThreads=0
2011-02-25 10:20:03,079 INFO fetcher.Fetcher - -activeThreads=0,
spinWaiting=0, fetchQueues.totalSize=0
2011-02-25 10:20:03,079 INFO fetcher.Fetcher - -activeThreads=0
> content of our httpclient-auth.xml
> >
> > <auth-configuration>
> > <credentials username="148606" password="d1e9n7i6s">
> > <default/>
> > <authscope host="10.52.112.12" port="80" scheme="NTLM"/>
> > <authscope host="10.52.21.83" port="80" scheme="NTLM"/>
> > </credentials>
> > </auth-configuration>
>
> Since, the crawler is trying to fetch pages from "tv.tms.toyota.com",
> could you please try specifying "tv.tms.toyota.com" as the host
> instead of it's IP address?
>
>
