2Gb Linux file size limit can also limit number of URLs.
We have files of size 1.4Gb on www.aspseek.com
Alexander.
----- Original Message -----
From: <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Wednesday, March 14, 2001 9:01 PM
Subject: RE: [aseek-users] Aspseek limit
> So does this mean that with 4GB of RAM, you could theoretically do
> 20,000,000 URL's?? Just curious if RAM is the only limitation that is
> keeping it to the 5 million mark?
>
> Thanks,
>
> Paul Stewart
>
>
> -----Original Message-----
> From: [EMAIL PROTECTED]
> [mailto:[EMAIL PROTECTED]]On Behalf Of Alexander F.
> Avdonkin
> Sent: March 13, 2001 10:25 PM
> To: [EMAIL PROTECTED]
> Subject: Re: [aseek-users] Aspseek limit
>
>
> No, 5M URLs is approximate limit. With this number of URLs, ASPseek
requires
> about 700M of RAM to calculate ranks of pages.
> If number of URLs will grow, then swapping will occur during ranks
> calculation.
>
> Alexander.
>
> ----- Original Message -----
> From: "Massimo Miccoli" <[EMAIL PROTECTED]>
> To: "aspseeklist" <[EMAIL PROTECTED]>
> Sent: Wednesday, March 14, 2001 3:12 AM
> Subject: [aseek-users] Aspseek limit
>
>
> > 5.000.000 of urls is an hard limit for Aspessek?
> > How may page can I index on a Linux box dual Pentium III 900 and one GB
> > Ram and 132 GB disk?
> > I've see in index statistics (index -S) that indexed page is 5.209.600
> > and not index 8.300.334.
> > So, i re-run the index again (index -N 16 -f /urlfile -R 8) and at the
> > end the page indexed is the same.
> > The first time I've run index I never stoped it, the work is finish
> > normal at the end urls list and the urls discovered.
> >
> > Thank for response,
> >
> > Massimo
> >
>
