Hi, On Montag, 3. November 2008, Micha Lenk wrote: [...] > > It has, because especially google was imposing quite a load on the server > > (most hits were on gwenhywfar/ChangeLog). > > You can ban all kind of robots by placing a simple txt file called > robots.txt with the following content in the server's www-root directory > (so it is accessible as https://devel.aqbanking.de/robots.txt). This is > documented here http://www.robotstxt.org/robotstxt.html. And at least > the Google search engine respects restrictions imposed by this file. [...]
Of course I know about the robots file. However, not all robots respect these settings (even if they should). Also, the address which accessed the site the most was only from the google domain, it wasn't necessarily a robot... Regards Martin -- "Things are only impossible until they're not" Martin Preuss - http://www2.aquamaniac.de/ AqBanking - http://www.aqbanking.de/ LibChipcard - http://www.libchipcard.de/ ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Aqbanking-devel mailing list Aqbanking-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aqbanking-devel
