If a web server does not allow directory browsing, you
don't use a
common name filename, and don't link to it, does it
still get indexed?
Mesdaq, Ali wrote:
> Sorry for not getting back earlier I totally forgot
about this. But I
> have never actually used the robots.txt file but I
looked at their spec
> and you seem to have it correct. I also saw that
html elements are also
> used in some cases.
____________________________________________________________________________________Choose
the right car based on your needs. Check out Yahoo! Autos new Car Finder tool.
http://autos.yahoo.com/carfinder/
