Re: SolrCloud and split-brain

2012-06-18 Thread Sami Siren
On Sat, Jun 16, 2012 at 5:33 AM, Otis Gospodnetic otis_gospodne...@yahoo.com wrote: And here is one more Q. * Imagine a client is adding documents and, for simplicity, imagine SolrCloud routes all these documents to the same shard, call it S. * Imagine that both the 7-node and the 3-node

Re: SolrCloud and split-brain

2012-06-18 Thread Mark Miller
On Jun 15, 2012, at 10:33 PM, Otis Gospodnetic wrote: However, if my half brain understands what split brain is then I think that's not a completely true claim because one can get unlucky and get a SolrCloud cluster partitioned in a way that one or even all partitions reject indexing (and

Re: SolrCloud and split-brain

2012-06-18 Thread Otis Gospodnetic
- From: Mark Miller markrmil...@gmail.com To: solr-user solr-user@lucene.apache.org Cc: Sent: Monday, June 18, 2012 11:05 AM Subject: Re: SolrCloud and split-brain On Jun 15, 2012, at 10:33 PM, Otis Gospodnetic wrote: However, if my half brain understands what split brain is then I think

Re: SolrCloud and split-brain

2012-06-18 Thread Mark Miller
So then the Q becomes: if we have 10 ZK nodes and they split in 5 5 nodes, does that mean neither side will have quorum because having 10 ZKs was a bad number of ZKs to have to begin with? Right - from the ZooKeeper admin guide, under Clustered Setup: Because Zookeeper requires a majority,

SolrCloud and split-brain

2012-06-15 Thread Otis Gospodnetic
Hi, How exactly does SolrCloud handle split brain situations? Imagine a cluster of 10 nodes. Imagine 3 of them being connected to the network by some switch and imagine the out port of this switch dies. When that happens, these 3 nodes will be disconnected from the other 7 nodes and we'll have

Re: SolrCloud and split-brain

2012-06-15 Thread Yury Kats
On 6/15/2012 12:49 PM, Otis Gospodnetic wrote: Hi, How exactly does SolrCloud handle split brain situations? Imagine a cluster of 10 nodes. Imagine 3 of them being connected to the network by some switch and imagine the out port of this switch dies. When that happens, these 3 nodes

Re: SolrCloud and split-brain

2012-06-15 Thread Mark Miller
are no longer accepted, because we may have a stale cluster view and not know it for a long period of time. On Jun 15, 2012, at 12:49 PM, Otis Gospodnetic wrote: Hi, How exactly does SolrCloud handle split brain situations? Imagine a cluster of 10 nodes. Imagine 3 of them being connected

Re: SolrCloud and split-brain

2012-06-15 Thread Otis Gospodnetic
rejection or something else?) because neither sees 2.5 ZK nodes? Thanks, Otis Performance Monitoring for Solr / ElasticSearch / HBase - http://sematext.com/spm  On Jun 15, 2012, at 12:49 PM, Otis Gospodnetic wrote: Hi, How exactly does SolrCloud handle split brain situations

Re: SolrCloud and split-brain

2012-06-15 Thread Mark Miller
On Jun 15, 2012, at 1:44 PM, Otis Gospodnetic wrote: Does this work even when outside clients (apps for indexing or searching) send their requests directly to individual nodes? Let's use the example from my email where we end up with 2 groups of nodes: 7-node group with 2 ZK nodes on the

Re: SolrCloud and split-brain

2012-06-15 Thread Otis Gospodnetic
Ola, Thanks Mark!   Does this work even when outside clients (apps for indexing or searching)  send their requests directly to individual nodes? Let's use the example from my email where we end up with 2 groups of nodes: 7-node group with 2 ZK nodes on the same network and 3-node group

Re: SolrCloud and split-brain

2012-06-15 Thread Mark Miller
On Jun 15, 2012, at 2:12 PM, Otis Gospodnetic wrote: Makes sense. Do responses carry something to alert the client that something is rotten in the state of cluster? No, I don't think so - we should probably add that to the header similar to how I assume partial results will work. Feel

Re: SolrCloud and split-brain

2012-06-15 Thread Otis Gospodnetic
Thanks Mark, will open an issue in a bit. But I think the following is the real meat of the Q about split brain and SolrCloud, especially when it comes to how indexing is handled during split brain:   Does this work even when outside clients (apps for indexing or searching)  send

Re: SolrCloud and split-brain

2012-06-15 Thread Mark Miller
On Jun 15, 2012, at 3:21 PM, Otis Gospodnetic wrote: Thanks Mark, will open an issue in a bit. But I think the following is the real meat of the Q about split brain and SolrCloud, especially when it comes to how indexing is handled during split brain: Does this work even when

Re: SolrCloud and split-brain

2012-06-15 Thread Otis Gospodnetic
: Friday, June 15, 2012 5:07 PM Subject: Re: SolrCloud and split-brain On Jun 15, 2012, at 3:21 PM, Otis Gospodnetic wrote: Thanks Mark, will open an issue in a bit. But I think the following is the real meat of the Q about split brain and SolrCloud, especially when it comes to how