[General] Webboard: Horizontal scalability

2016-10-20 Thread bar
Author: fabien Email: fabien.lahau...@gmail.com Message: Hi all, Is it possible to parallelize the indexing work on multiple machines ? I mean for example one global data server with the mnogosearch database, and a few server instances all running the indexer process, pointing to the same db ser

[General] Webboard: Horizontal scalability

2016-10-20 Thread bar
Author: Alexander Barkov Email: Message: Hi Fabien, > Hi all, > > Is it possible to parallelize the indexing work on multiple machines ? > I mean for example one global data server with the mnogosearch database, and > a few server instances all running the indexer process, pointing to the same

[General] Webboard: Horizontal scalability

2016-10-20 Thread bar
Author: Alexander Barkov Email: Message: > > 1. indexer can run parallel threads for crawling, and starting from 3.4.0 for > indexing: > > # Run 10 crawling threads > indexer -N10 > > # Run 10 indexing threads > indexer -N10 --index > A related thing: 3.4.1 will use a modified database stru

[General] Webboard: Horizontal scalability

2016-10-20 Thread bar
Author: Alexander Barkov Email: Message: > > > > 1. indexer can run parallel threads for crawling, and starting from 3.4.0 > > for indexing: > > > > # Run 10 crawling threads > > indexer -N10 > > > > # Run 10 indexing threads > > indexer -N10 --index > > > > A related thing: > > 3.4.1 will

[General] Webboard: Horizontal scalability

2016-10-20 Thread bar
Author: fabien Email: fabien.lahau...@gmail.com Message: Thanks a lot for all your good advices. When do you plan the delivering of the next release ? > > > 1. indexer can run parallel threads for crawling, and starting from 3.4.0 > > > for indexing: > > > > > > # Run 10 crawling threads > > >

[General] Webboard: Horizontal scalability

2016-10-20 Thread bar
Author: Alexander Barkov Email: Message: > Thanks a lot for all your good advices. > When do you plan the delivering of the next release ? > I hope it should be available within two weeks. > > > > > 1. indexer can run parallel threads for crawling, and starting from > > > > 3.4.0 for indexing

[General] Webboard: Crash of indexation process

2016-10-20 Thread bar
Author: fabien Email: fabien.lahau...@gmail.com Message: Hi, This new topic is just for your information, Alexander. As you said that it is now possible to set the number of threads when indexing data, I did a few tests. indexer -N10 --index --> works With 20, 30,... 64 threads --> works With 65