* <[EMAIL PROTECTED]> wrote:
| Now I need to add something like this to the file, but I'm not
| sure that the protocol will support it.
|
| user-agent: zeus
| disallow: /
|
| user-agent: *
| disallow: /cgi-bin
| etc...
|
| Will this work?
This should work if the robots conforms to the robots exclusion standard.
--
Bj�rn H�hrmann ^ mailto:[EMAIL PROTECTED] ^ http://www.bjoernsworld.de
am Badedeich 7 � Telefon: +49(0)4667/981ASK � http://bjoern.hoehrmann.de
25899 Dageb�ll # PGP Pub. KeyID: 0xA4357E78 # http://learn.to/quote [!]e
"Everything we see or seem is but a dream within a dream" - E.A. Poe
