On Tuesday 04 September 2001 21:15, you wrote:
a better description what i mean,

i want to avoid indexing of pages from 4th level and deeper, for example 
http://www.linux.org/pub/dist/debian/ END/ and i think "MaxHops 4" means only 
four mouseclicks. if you have more than four links on your starturl , but the 
are all in 2nd level, they will not be indexed. i have tried it with 
"Disallow http://*/*/*/*/* ,but all pages were disallowed.

greets
Andre

Reply via email to