Re: multicore for 20k users?

2009-05-18 Thread Chris Cornell
2009/5/17 Noble Paul നോബിള്‍ नोब्ळ् noble.p...@corp.aol.com: A few questions, 1) what is the frequency of inserts? A few per day per user at MOST. 2) how many cores need to be up and running at any given point That depends on the people. I would love to be able to tie it to their webapp

Re: multicore for 20k users?

2009-05-18 Thread Ryan McKinley
since there is so little overlap, I would look at a core for each user... However, to manage 20K cores, you will not want to use the off the shelf core management implementation to maintain these cores. Consider overriding SolrDispatchFilter to initialize a CoreContainer that you

multicore for 20k users?

2009-05-17 Thread Chris Cornell
Trying to create a search solution for about 20k users at a company. Each person's documents are private and different (some overlap... it would be nice to not have to store/index copies). Is multicore something that would work or should we auto-insert a facet into each query generated by the

Re: multicore for 20k users?

2009-05-17 Thread Ryan McKinley
how much overlap is there with the 20k user documents? if you create a separate index for each of them will you be indexing 90% of the documents 20K times? How many total documents could an individual user typically see? How many total distinct documents are you talking about? Is the

Re: multicore for 20k users?

2009-05-17 Thread Chris Cornell
Thanks for helping Ryan, On Sun, May 17, 2009 at 7:17 PM, Ryan McKinley ryan...@gmail.com wrote: how much overlap is there with the 20k user documents? There are around 20k users but each one has anywhere from zero to thousands of documents. The final overlap is unknown because there is a

Re: multicore for 20k users?

2009-05-17 Thread Otis Gospodnetic
- Original Message From: Chris Cornell srchn...@gmail.com To: solr-user@lucene.apache.org Sent: Sunday, May 17, 2009 8:37:44 PM Subject: Re: multicore for 20k users? Thanks for helping Ryan, On Sun, May 17, 2009 at 7:17 PM, Ryan McKinley wrote: how much overlap

Re: multicore for 20k users?

2009-05-17 Thread Noble Paul നോബിള്‍ नोब्ळ्
A few questions, 1) what is the frequency of inserts? 2) how many cores need to be up and running at any given point On Mon, May 18, 2009 at 3:23 AM, Chris Cornell srchn...@gmail.com wrote: Trying to create a search solution for about 20k users at a company. Each person's documents are

Re: multicore for 20k users?

2009-05-17 Thread Noble Paul നോബിള്‍ नोब्ळ्
-- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Chris Cornell srchn...@gmail.com To: solr-user@lucene.apache.org Sent: Sunday, May 17, 2009 10:11:10 PM Subject: Re: multicore for 20k users? On Sun, May 17, 2009 at 8:38 PM, Otis Gospodnetic wrote: Chris

Re: multicore for 20k users?

2009-05-17 Thread Chris Cornell
On Sun, May 17, 2009 at 8:38 PM, Otis Gospodnetic otis_gospodne...@yahoo.com wrote: Chris, Yes, disk space is cheap, and with so little overlap you won't gain much by putting everything in a single index.  Plus, when each user has a separate index, it's easy to to split users and

Re: multicore for 20k users?

2009-05-17 Thread Otis Gospodnetic
to do that same for Simpy. :) Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Chris Cornell srchn...@gmail.com To: solr-user@lucene.apache.org Sent: Sunday, May 17, 2009 10:11:10 PM Subject: Re: multicore for 20k users? On Sun, May 17