So does this mean that with 4GB of RAM, you could theoretically do
20,000,000 URL's?? Just curious if RAM is the only limitation that is
keeping it to the 5 million mark?
Thanks,
Paul Stewart
-----Original Message-----
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED]]On Behalf Of Alexander F.
Avdonkin
Sent: March 13, 2001 10:25 PM
To: [EMAIL PROTECTED]
Subject: Re: [aseek-users] Aspseek limit
No, 5M URLs is approximate limit. With this number of URLs, ASPseek requires
about 700M of RAM to calculate ranks of pages.
If number of URLs will grow, then swapping will occur during ranks
calculation.
Alexander.
----- Original Message -----
From: "Massimo Miccoli" <[EMAIL PROTECTED]>
To: "aspseeklist" <[EMAIL PROTECTED]>
Sent: Wednesday, March 14, 2001 3:12 AM
Subject: [aseek-users] Aspseek limit
> 5.000.000 of urls is an hard limit for Aspessek?
> How may page can I index on a Linux box dual Pentium III 900 and one GB
> Ram and 132 GB disk?
> I've see in index statistics (index -S) that indexed page is 5.209.600
> and not index 8.300.334.
> So, i re-run the index again (index -N 16 -f /urlfile -R 8) and at the
> end the page indexed is the same.
> The first time I've run index I never stoped it, the work is finish
> normal at the end urls list and the urls discovered.
>
> Thank for response,
>
> Massimo
>
