On 7 Aug 2001, at 14:25, Huseyin Ozdemir wrote:
> Do you have any idea why it is refused? Is it a kind of security? Is it
> possible to protect a site from a wget?
It is possible for a web-site to check the information supplied to it
in the headers of the request and refuse the connection. This
information includes the referer, the user-agent string and contents
of cookies.
If you upgrade to wget 1.7 you will get options for setting these
things.
The '--referer=URL' option can be used to set the referer to a page
on the web-site that links to the page you want.
The '--user-agent=AGENT-STRING' option can be used to make wget
pretend to be a browser. See
http://rrr.dds.nl/trafficreport/agentsbyOS.html for some possible
user-agent strings to use. This option also works in earlier versions
of wget.
The '--load-cookies FILE' option can be used to load cookies from a
file. To get some cookies in the first place, try using the '--
cookies=on' option and the '--save-cookies FILE' options and use wget
to retrieve a page from the site that links to the page you want.
