Some of those rogue robots / harvesters are really damaging. I've seen them bring entire sites down. We are using mod_evasive and mod_bw for apache and also permanently ban certain IP ranges. But as you can see, none of this is web2py specific.
Regards, Ales On Thursday, May 9, 2013 8:58:43 PM UTC+2, Alex Glaros wrote: > > What techniques can be used in a Web2py site to prevent data mining by > harvester bots? > > In my day job, if the Oracle database slows down, I go to the Unix OS, see > if the same IP address is doing a-lot-faster-than-a-human-could-type > queries, and then block that IP address in the firewall. > > Are there any ideas that that I could use with a Web2py website? > > Thanks, > > Alex Glaros > > -- --- You received this message because you are subscribed to the Google Groups "web2py-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/groups/opt_out.
