> Aside from basic concepts (don't hammer the server; always obey the > robots.txt; don't span hosts unless you are really sure that you want to), > are there any particular bits of wisdom that list members would want me to > pass on to my readers?
Look at http://www.robotstxt.org/wc/guidelines.html you may well have already seen it, it's an old list. But I think some of the suggestions are still relevant, particularly the stuff about identifying yourself, that seems very sensible. Chris. Chris Skepper Computer Science 3rd Year Undergraduate at Warwick University, UK. http://www.skepper.org.uk -- This message was sent by the Internet robots and spiders discussion list ([EMAIL PROTECTED]). For list server commands, send "help" in the body of a message to "[EMAIL PROTECTED]".
