It's quite a frequent phenomenon that someone asks where to find ready-made spiders or source code.
Nick, would it be much bother if you or somebody else sent a weekly message (say every Monday) informing new people where to find spiders? I remember searchtools.com mentioned; maybe some other good sources too. Would save on total amount of "extra" mail... :) It would be nice to have the list more for discussion on spiders, protocols, search results, et cetera. Although it's admittedly been quiet lately... Maybe it's natural? Robots.txt and meta tags are "complete"; the hobbyists have gone commercial -- maybe there isn't that much left to discuss that is outside NDAs? Opinions? -- Tuomas
