On Mar 6, 4:56 am, Graham Dumpleton wrote: > Or you could just run web.py under Apache
That is true, however I am striving to move away from Apache as I now see it as huge, clunky and ill-equipped for modern webserving. The force pushing me to better server control is the insane amounts of greedy robots constantly scraping my sites. For dynamic sites with a large number of variables and actions, robots go crazy indexing every permutation of URLs possible. This was not a problem "back in the day", but the recent proliferation of custom searchbots software has changed the picture. Some control over content delivery is needed. My solution is to maintain absolute control over what IP address can run what script, and serve up some harvestable content even to the most frivolous search engine. I hope I am on the right track with Web.py. My plan is to present occasional "Prove you are human" questions to users, and keep an SQLite database of searchbots. If there is already a system for effectively managing what content gets served, please let me know about it. Thank you. -- Gnarlie -- You received this message because you are subscribed to the Google Groups "web.py" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/webpy?hl=en.
