Bert Van Kets: >It even overrides the other disalows. No override... Robots Exclusion Standard on User-agent: "(If the value is '*', the record describes the default access policy for any robot that) has not [yet] matched any of the other records." (http://info.webcrawler.com/mak/projects/robots/norobots.html)
Cheers, Tuomas
