In the past couple of days, I've been having problems with spiders vandalizing the Wiki at http://www.sqlite.org/cvstrac/wiki. The damage (so far) has been relatively minor and easy to fix. But I've been monitoring these spiders for a while and notice that they are becoming increasingly aggressive.
If you have any suggestions on what to do about them, I'd like to hear from you.
I'm guessing that these spiders are coming from spammers looking to harvest email addresses. Last nights attack came from 61.51.123.205. No reverse DNS is available. Can anybody provide any insight into where the attacks are coming from?
I've added some spider detection logic to cvstrac which shuts down large portions of the website to spiders. I used to have problems with spiders pulling out every historical version of every source code file every night. I've solved that now. But I've been leaving the wiki open to spiders because I *want* Google spiders to visit the wiki.
My next defense will be to try to make the wiki read-only to spiders. That will prevent the vandalism I'm been seeing for the past couple of days, assuming my spider detection continues to work. But if the attackers start doing a better job of disguising their spiders, my detection might fail and this defense would become ineffective.
Any other ideas? -- D. Richard Hipp -- [EMAIL PROTECTED] -- 704.948.4565
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
