In a message of Thu, 02 Aug 2007 22:38:54 +0200, =?ISO-8859-15?Q?=22Martin_v=2 E_L=F6wis=22?= writes: >Can anybody suggest a more reliable way to prevent crawlers >from hitting the wiki so hard? > >Regards, >Martin
I assume that this particular spider isn't named. But in case I am wrong: http://www.fleiner.com/bots/#banning has an example of how to ban the inktomi spider named Slurp. Laura _______________________________________________ Catalog-SIG mailing list [email protected] http://mail.python.org/mailman/listinfo/catalog-sig
