Spidey Agent (cheeseshop sourceforge ) my search engine uses mysqldb because the sql is simple it has a hacked version of threading in it and it should show how I did this. It is not scientific per se but it does work. Also it is weird and spooky that google now has a customizeable search feature that looks much like it except for a search interval variable. As I recall mysqldb was pretty fast and postgres would have been better.
It uses borrowed code for the threading if I recall and the borrowed code was actually not right! But it works I believe and its not too slow really it just needs page rank or something and postgres. I experimented with locking, postgres has this too I think its maybe different and not as safe I'm not sure. Locking truely is a very bad thing I found but was necessary at least at one point. If you use postgres the api might not be as good for threading maybe but it might even be better. Inserts went like lightning make sure to use the simplest sql you can get by with if you want performance this is a complicated subject though. --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "TurboGears" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/turbogears?hl=en -~----------~----~----~----~------~----~------~--~---
