On Fri, 2005-03-25 at 19:48 -0800, Peter Gordon wrote: > Joseph wrote: > > How to restrict outsider to use "wget" on my web-page? > > Wget by default sends a User-Agent string of "Wget/<version>" so you could, > for > example, configure Apache to send a "HTTP/1.1 404 Not Found" error (or > something > else) for a specific page if the user agent is Wget. > > Or you could alternatively put a file called "robots.txt" in your document > root > containing something such as the following: > > User-agent: Wget > Disallow: / > > Wget (as far as I know) is very well-behaved in that it will follow any > restirctions imposed by a webserver's robots.txt file. > > Hope that helps!
How about the -U option "--user-agent=" in "wget" to change "wget user agent"; could it be used to defeat this purpose? -- #Joseph -- [email protected] mailing list
