Andre Pfeiler �����(�):
> On Tuesday 04 September 2001 21:15, you wrote:
> a better description what i mean,
>
> i want to avoid indexing of pages from 4th level and deeper, for example
> http://www.linux.org/pub/dist/debian/ END/ and i think "MaxHops 4" means only
> four mouseclicks. if you have more than four links on your starturl , but the
> are all in 2nd level, they will not be indexed. i have tried it with
> "Disallow http://*/*/*/*/* ,but all pages were disallowed.
>
Try to use "Disallow http://[^/]+/[^/]+/[^/]+/[^/]+/";
>
> greets
> Andre
