Date: 28.07.02 Sender: Roger Williams Time: 13:26 > I am no pundit in the field, but every bit of looking I have done on > info sites explaining the robots meta-tags, say everything from "not all > robots support" to "few robots support."
All "good" bots follow the meta-tags. Those who don't aren't "good". > I suspect that the the best solution, if you have your own server, is to > use the robots.txt and if not try the .htaccess file. However, I am not > convinced that these tools will stop all bots, The same principle applies here too. If a robot is a good one, it will "obey" the rules. If it's not, you 've got to stop it with the .htaccess file(*). (*) The .htaccess file operates like a "firewall" in this situation so it can block completely the IP range that a "bad" bot use. -- [ Quote #110 from food collection. ] Man who arrives at party two hours late will find he has been beaten to the punch. ============= PCWorks Mailing List ================= Don't see your post? Check our posting guidelines & make sure you've followed proper posting procedures, http://pcworkers.com/rules.htm Contact list owner <[EMAIL PROTECTED]> Unsubscribing and other changes: http://pcworkers.com =====================================================
