Re: SOlr 3.5 and sharding

2013-01-17 Thread Erick Erickson
time and contribution to Solr! > > -Original Message- > From: Erick Erickson [mailto:erickerick...@gmail.com] > Sent: January-17-13 8:46 AM > To: solr-user@lucene.apache.org > Subject: Re: SOlr 3.5 and sharding > > You're still confusing shards (or at least mixin

RE: SOlr 3.5 and sharding

2013-01-17 Thread Jean-Sebastien Vachon
Subject: Re: SOlr 3.5 and sharding You're still confusing shards (or at least mixing up the terminology) with simple replication. Shards are when you split up the index into several sub indexes and configure the sub-indexes to "know about each other". Say you have 1M docs in 2

Re: SOlr 3.5 and sharding

2013-01-17 Thread Erick Erickson
istribute the documents to each shard using a simple ID modulo > 4 rule. > > Were my expectations wrong about the number of documents? > > -Original Message- > From: Upayavira [mailto:u...@odoko.co.uk] > Sent: January-15-13 9:21 AM > To: solr-user@lucene.apac

RE: SOlr 3.5 and sharding

2013-01-15 Thread Jean-Sebastien Vachon
ions wrong about the number of documents? -Original Message- From: Upayavira [mailto:u...@odoko.co.uk] Sent: January-15-13 9:21 AM To: solr-user@lucene.apache.org Subject: Re: SOlr 3.5 and sharding He was referring to master/slave setup, where a slave will poll the master periodically

Re: SOlr 3.5 and sharding

2013-01-15 Thread Upayavira
shards. > > Can you elaborate on this "polling interval" thing? I am pretty sure I > never eared about this... > > Regards > > -Original Message- > From: Erick Erickson [mailto:erickerick...@gmail.com] > Sent: January-15-13 8:00 AM > To: solr-u

RE: SOlr 3.5 and sharding

2013-01-15 Thread Jean-Sebastien Vachon
erickerick...@gmail.com] Sent: January-15-13 8:00 AM To: solr-user@lucene.apache.org Subject: Re: SOlr 3.5 and sharding You're confusing shards and slaves here. Shards are splitting a logical index amongst N machines, where each machine contains a portion of the index. In that setup, you have to confi

Re: SOlr 3.5 and sharding

2013-01-15 Thread Erick Erickson
You're confusing shards and slaves here. Shards are splitting a logical index amongst N machines, where each machine contains a portion of the index. In that setup, you have to configure the slaves to know about the other shards, and the incoming query has to be distributed amongst all the shards t

RE: SOlr 3.5 and sharding

2013-01-14 Thread Jean-Sebastien Vachon
Ok that was my first thought... thanks for the confirmation -Original Message- From: Michael Ryan [mailto:mr...@moreover.com] Sent: January-14-13 10:06 AM To: solr-user@lucene.apache.org Subject: RE: SOlr 3.5 and sharding If you have the same documents -- with the same uniqueKey

RE: SOlr 3.5 and sharding

2013-01-14 Thread Michael Ryan
If you have the same documents -- with the same uniqueKey -- across multiple shards, the count will not be what you expect. You'll need to ensure that each document exists only on a single shard. -Michael -Original Message- From: Jean-Sebastien Vachon [mailto:jean-sebastien.vac...@wante