On 22 Nov 2001, at 14:49, Tomas Hjelmberg wrote: > Thanks! > I see, but then, how to exclude from being downloaded per file-basis?
Put the following in the /robots.txt on your website User-agent: * Disallow: /tomas.html See <http://www.robotstxt.org/wc/exclusion-admin.html> for more info.
