> In fact, it's not unlike putting the data behind a passworded web
> page. The difference is that there are a lot of "passwords" (search
> terms) which are likely to yield access. But the problem space is
> also so much larger than traditional password access that there is
> no motivation for the harvesting spiders to try to solve it.
Can I quote "assumption is the mother of all f*** up" ?
Let me go to any old search engine (private or public) and try the query
"mailto".
Oops. Perhaps "email" or "e-mail". Oops again. "contact" is another good
one.
While I wholly agree that the problem / query space is too large to be fully
searched, the 80/20 rule should tell us that a mail address harvesting
engine will be written, perhaps, my someone who may know 20 different
generic terms to put into 20 different typical FORM fields for a POST and
try. The follow all the HREFs off those pages and Roberts is your parent's
sibling.
Peter