[aseek-users] I'd like to have a starting URL indexed one way, and all ofsite URLs indexed in a different way. Is this possible?

[Dr. John Takacs]

I would like to index a very large site with thousands of HTML pages.  This
site also has many offsite links.

I want the server URL and all onsite URLs to have a MaxHops of 6.  I want
all offsite URLs to have a MaxHops of 0 as I only want each single offsite
page indexed and no sub-offsite pages indexed.

I want the server URL and all onsite URLs to be hit only once a second.  All
offsite URLs can be hit as quickly as possible.

Here is what I have so far.  Tell me if I'm wrong.
MinDelay 1s

DeleteBad yes

FollowOutside yes

MaxHops 6

Server http://BigDomainToIndex.com/

MinDelay 0s

MaxHops 0

Server    "Nothing to put here as the list could be tens of thousands of
offsite URLs.  Is this Server command necessary in this case?  Can it be
blank?"



Thanks in advance.