[General] Webboard: Search of...Indexing on 2 DB

[bar]

Author: Laurent
Email: 
Message:
Hi Alex,

Thanks for your reply.

Currently, I dont have that many documents.
I am talking about avg 300K in the main DB, and 100K in the other one.
But the robot is currently frozen due to lack of disk space.

During Xmas, I'll update to 2x600 Go and, from that, I'll free the indexer. I 
expect millions of URLs to be indexed at the end, and so I just anticipate this.
I already see the difference when BLOBing. From 1800s to 800s, just because I 
split in 2 logical groups of information..

About parallel search, could it be smart, to avoid using more risky CGI, to 
make (for example) a perl search front-end, able to thread and merge the 
results and, from its actions, just use PHP to get and display the results ??

Maybe a major improvement idea to consider :-)

Thx

Reply: 

___
General mailing list
General@mnogosearch.org
http://lists.mnogosearch.org/listinfo/general

[General] Webboard: Search of...Indexing on 2 DB

[bar]

Author: Alexander Barkov
Email: b...@mnogosearch.org
Message:
Hi,

> Hi Guys,
> 
> To improve performance, I split my index database (reindexing from start) on 
> 2 different platforms.
> 
> Separetely, the search.htm works perfectly, limited in each of the indexes of 
> course.
> 
> I would now like to merge the search so data is taken from the 2 SQL servers. 
> I saw in the doc the brief explanation, but it is a bit confusing to me.
> search.htm is PHP and the explanations are made for a more risky CGI.
> 
> Does someone knows the trick for the PHP version of the search script ?

You can use Udm_Alloc_Agent_Array() to specify multiple databases:
http://www.php.net/manual/en/function.udm-alloc-agent-array.php

However, the PHP module does not support parallel execution.
It queries the database consequently.

Note, the CGI version queries the databases in parallel.
So it should be faster.

Btw, how many documents do you have? 
What is the output from "indexer -S"?

> 
> Thanks in advance

Reply: 

___
General mailing list
General@mnogosearch.org
http://lists.mnogosearch.org/listinfo/general

[General] Webboard: Search of...Indexing on 2 DB

[bar]

Author: Laurent
Email: 
Message:
Hi Guys,

To improve performance, I split my index database (reindexing from start) on 2 
different platforms.

Separetely, the search.htm works perfectly, limited in each of the indexes of 
course.

I would now like to merge the search so data is taken from the 2 SQL servers. I 
saw in the doc the brief explanation, but it is a bit confusing to me.
search.htm is PHP and the explanations are made for a more risky CGI.

Does someone knows the trick for the PHP version of the search script ?

Thanks in advance

Reply: 

___
General mailing list
General@mnogosearch.org
http://lists.mnogosearch.org/listinfo/general