----- Original Message -----
From: "Dr. John Takacs" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Saturday, June 23, 2001 2:50 PM
Subject: [aseek-users] MinDelay, and index -N n, and sites with restrictions
on number of Hits
> If I want to index a site that has a policy of not allowing more than 1
hit
> per second
>
> And
>
> If I set up the following:
>
> MinDelay 1s
> Server http://www.SiteName.com/
>
> Then
>
> If I execute index, I will only hit the above site once every second,
> correct?
>
> However
>
> If I execute index -N 10
>
> Then
>
> I will hit the above site 10 times a second, correct?
>
No. If you want to index only one site, there is no sence to set -N to
more than 1, because particular host can be accessed only by 1 thread at a
time.
Period set by "MinDelay" between acceses to site is guaranteed for any
number of threads.
> This would violate the site policy and possibly result in banning my IP,
> correct?
>
> How can I make it so that all URLs with
>
> http://www.SiteName.com%
>
> are hit once a second
>
> BUT
>
> any referenced links are hit n times a second as I only want to hit the
> first page of the referenced link so there should not be a problem.
>
Unfortunately, "MinDelay" can't be set a fraction of second. You can
only put "MinDelay 0" for other sites.
> Impossible?
>
> Thanks in advance.
>
> John
>
