Hi, why are you sure that you didn't get a real 403 (forbidden)? - the answering web server logs a delivery with 200 (ok)? - a network traffic analyzer (wireshark, tcpdump) shows that HTTP response headers have a different status code?
In general, servers may deliver different responses to a crawler and a browser, or even deny to deliver a document. Sebastian On 08/01/2013 10:56 PM, A Laxmi wrote: > For some reason, I am not able to crawl, the fetcher seems to have an > issue. It complains - "*fetch of http://www.someurldomain.com/ failed with: > Http code = 403, url = * > *http://www.someurldomain.com/"; > > * > Please help. I tried to google this issue but could not find anything that > can address this issue >
