Author: fabien
Email: fabien.lahau...@gmail.com
Message:
Hi all,
Is it possible to parallelize the indexing work on multiple machines ?
I mean for example one global data server with the mnogosearch database, and a
few server instances all running the indexer process, pointing to the same db
ser
Author: Alexander Barkov
Email:
Message:
Hi Fabien,
> Hi all,
>
> Is it possible to parallelize the indexing work on multiple machines ?
> I mean for example one global data server with the mnogosearch database, and
> a few server instances all running the indexer process, pointing to the same
Author: Alexander Barkov
Email:
Message:
>
> 1. indexer can run parallel threads for crawling, and starting from 3.4.0 for
> indexing:
>
> # Run 10 crawling threads
> indexer -N10
>
> # Run 10 indexing threads
> indexer -N10 --index
>
A related thing:
3.4.1 will use a modified database stru
Author: Alexander Barkov
Email:
Message:
> >
> > 1. indexer can run parallel threads for crawling, and starting from 3.4.0
> > for indexing:
> >
> > # Run 10 crawling threads
> > indexer -N10
> >
> > # Run 10 indexing threads
> > indexer -N10 --index
> >
>
> A related thing:
>
> 3.4.1 will
Author: fabien
Email: fabien.lahau...@gmail.com
Message:
Thanks a lot for all your good advices.
When do you plan the delivering of the next release ?
> > > 1. indexer can run parallel threads for crawling, and starting from 3.4.0
> > > for indexing:
> > >
> > > # Run 10 crawling threads
> > >
Author: Alexander Barkov
Email:
Message:
> Thanks a lot for all your good advices.
> When do you plan the delivering of the next release ?
>
I hope it should be available within two weeks.
>
> > > > 1. indexer can run parallel threads for crawling, and starting from
> > > > 3.4.0 for indexing
Author: fabien
Email: fabien.lahau...@gmail.com
Message:
Hi,
This new topic is just for your information, Alexander.
As you said that it is now possible to set the number of threads when indexing
data, I did a few tests.
indexer -N10 --index --> works
With 20, 30,... 64 threads --> works
With 65