> How would/should a robot interpret this directive? > > User-agent: * > Disallow:
> Does it disallow all content of the document root but not the subfolders, > or will effectively disallow anything (like "Disallow: /"), or is it just an > invalid directive that will be ignored? None of the above. It is a valid instruction that mean "disallow nothing", i.e. allow everything. Alan Perkins CTO, e-Brand Management Ltd. http://www.ebrandmanagement.com/