- - - - - - - - - - - - - - - - - - - - - - - - - - - - Name: luca pellegrini Subject: performance issue
I have a question about perfomances. Let's suppose that i'm going to use cache-mode to index my data. I have to index a huge amount of data, let's say ~ k*10^9 urls. can this be really performed or is it an utopia? what about some intelligent criteria/advices to reduce the amount of indexed data? what about performance in this case? would be helpful to distribute word indexes among servers? I need the search engine to handle at least 10 queries per second! is it possible? - - - - - - - - - - - - - - - - - - - - - - - - - - - - Read the full topic here: http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=02;post=
