If you have set "FollowOutside no", increasing the number of threads
will not help.
If you have set "FollowOutside yes", increasing the number of threads
will help, of course only if you have enough bandwidth.
Nick Ustinov �����(�):
>
> And also how many instances should I run for indexing? I described 25
> servers and run 25 instances now, would adding 25 more increase indexing
> speed? It's around 40000pg/hr now
>
> Nick
>
> -----Original Message-----
> From: Kir Kolyshkin [mailto:[EMAIL PROTECTED]]
> Sent: Thursday, August 02, 2001 12:04
> To: [EMAIL PROTECTED]
> Subject: Re: [aseek-users] indexing
>
> Nick Ustinov �����(�):
> >
> > Hi there!
> >
> > Could someone please answer several newbie Q's I came across.
> >
> > 1) What could be hardware requirements for indexing 2-3 million pages?
>
> 512M RAM should be enough (even 256 can go, but I'm not sure).
> The more RAM the better speed, although more that 1G will not
> help in your case I believe.
>
> Disk subsystem - the faster the better. Anything from IDE/66 with
> 7200RPM HDDs to hardware SCSI RAID - depends on how much do you
> want to spend on it.
>
> > 2) How to tune Mysql to ensure best performance in that case?
>
> Most relevant value is key_buffer_size. Set it to 1/4...1/3 of
> available RAM.
>
> > 3) How often should be indexer ran?
>
> It depends on what do you want.
>
> One scenario can be such: first time, run index and
> wait it to be finished. Then, you can run it incrementally,
> start it every day from cron, and stop (with index -E)
> after, say, 20 hours, and run index -D to put the things
> just crawled to the main DB. You chould check time needed for
> index -D and change your timings accordingly.
>
> Or, you can do the same, but on weekly basis.
>
> Or, you can wait till index will finish every time (and so,
> don't use index -E, index -D).
>
> > 4) Any other performance issues I should know about?
>
> If you use IDE HDD and don't know what is hdparm, take a look
> at it.
>
> >
> > The system is RH7. Thanks in advance.
> >
> > Nick Ustinov
> > Enterprise Solutions Group Director
> >
> > Vide Infra Grupa SIA
> > 40 Brivibas St, Riga, Latvia, LV 1050
> > phone: +371 7812294
> > fax: +371 7812297
> > gsm: +371 238254
> > http://www.videinfra.com
>
> --
> [EMAIL PROTECTED] ICQ 7551596 Phone +7 903 6722750
> Reality always seems harsher in the early morning.
> --
--
[EMAIL PROTECTED] ICQ 7551596 Phone +7 903 6722750
Reality always seems harsher in the early morning.
--
