Re: [LIH] RE:shell account/robots.txt

[sreangsu acharyya]

> if i can make "robots = off"  in my local m/c and get whatever i wanted
> its not the proper way to protect webserver from the load of

it is about being a good polite net-citizen. Robots.txt is a request
rather than a means, to keep spiders off from certain directories.

-- sreangsu


----------------------------------------------
Find out more about this and other Linux India 
mailing lists at http://lists.linux-india.org/