"Alfred Vink" <[EMAIL PROTECTED]>

> Michael:
> 
> 4. If I use the archiving of my discussion list the e-mail addresses are
> displayed doing a Google search with the keywords of the name of the person.
> 
> Add a robots.txt file to the root of your site and in this textfile type:
> 
> User-agent: *
> Disallow: /cgi-bin/
> 
> Now your problem is gone, there are a multiple of things you can set in the
> robots.txt file to have control over how searchengines scan your site.
> 
> Alfred

You might want ot check out this URL for further information.

http://www.seoconsultants.com/robots-text-file/

If you create a custom DADA directory under your home directory, those
files would never have been indexed anyway. You should really consider
that option.

-- 
Gerard Seibert
[EMAIL PROTECTED]

_______________________________________________
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"

Reply via email to