...
[1] http://www.southwest.msus.edu/robots.txt
[1] No 'Server' command for url... deleted.
[1] http://www.medformation.com/mf/crspa.nsf/pa/menu8525.htm
...

i've noticed that any url with robots.txt in it will get removed
automatically. i have 'DeleteNoServer no' set. with the above all paths
in 'http://www.southwest.msus.edu/%' were indexed though.

__________________________________________________
Do You Yahoo!?
Yahoo! Auctions - Buy the things you want at great prices.
http://auctions.yahoo.com/
___________________________________________
If you want to unsubscribe send "unsubscribe general"
to [EMAIL PROTECTED]

Reply via email to