RE: Clarity on Sharding Concepts.

2016-05-31 Thread Garth Grimm
Both.

One shard will have roughly half the documents, and the indices built from 
them; the other shard will have the other half of the documents, and the 
indices built from those.

There won't be one location that contains all the documents, nor all the 
indices.

-Original Message-
From: Siddhartha Singh Sandhu [mailto:sandhus...@gmail.com] 
Sent: Tuesday, May 31, 2016 10:43 AM
To: solr-user@lucene.apache.org; muge...@gmail.com
Subject: Re: Clarity on Sharding Concepts.

Hi Mugeesh,

I was speculating whether sharding is done on:
1. index terms with each shard having the whole document space.
2. document space with each shard have num(documents/no. of shards) of the 
documents divided between them.

Regards,

Sid.

On Tue, May 31, 2016 at 12:19 AM, Mugeesh Husain <muge...@gmail.com> wrote:

> Hi,
>
> To read out this document
>
> https://cwiki.apache.org/confluence/display/solr/Shards+and+Indexing+D
> ata+in+SolrCloud
> for proper understanding.
>
> FYI, you are using implicit router, a document will be divided 
> randomly based on hashing technique.
>
> If you indexed 50 documents, it will be divided into 2 parts, 1 goes 
> to shard1, second one is shard2 and same document will be go their 
> replica respectively .
>
>
> Thanks
> Mugeesh
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Clarity-on-Sharding-Concepts-tp4279
> 842p4279856.html Sent from the Solr - User mailing list archive at 
> Nabble.com.
>


Re: Clarity on Sharding Concepts.

2016-05-31 Thread Siddhartha Singh Sandhu
Hi Mugeesh,

I was speculating whether sharding is done on:
1. index terms with each shard having the whole document space.
2. document space with each shard have num(documents/no. of shards) of the
documents divided between them.

Regards,

Sid.

On Tue, May 31, 2016 at 12:19 AM, Mugeesh Husain <muge...@gmail.com> wrote:

> Hi,
>
> To read out this document
>
> https://cwiki.apache.org/confluence/display/solr/Shards+and+Indexing+Data+in+SolrCloud
> for proper understanding.
>
> FYI, you are using implicit router, a document will be divided randomly
> based on hashing technique.
>
> If you indexed 50 documents, it will be divided into 2 parts, 1 goes to
> shard1, second one is shard2 and same document will be go their replica
> respectively .
>
>
> Thanks
> Mugeesh
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Clarity-on-Sharding-Concepts-tp4279842p4279856.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>


Re: Clarity on Sharding Concepts.

2016-05-31 Thread Siddhartha Singh Sandhu
Thank you Mugeesh.

On Tue, May 31, 2016 at 12:19 AM, Mugeesh Husain <muge...@gmail.com> wrote:

> Hi,
>
> To read out this document
>
> https://cwiki.apache.org/confluence/display/solr/Shards+and+Indexing+Data+in+SolrCloud
> for proper understanding.
>
> FYI, you are using implicit router, a document will be divided randomly
> based on hashing technique.
>
> If you indexed 50 documents, it will be divided into 2 parts, 1 goes to
> shard1, second one is shard2 and same document will be go their replica
> respectively .
>
>
> Thanks
> Mugeesh
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Clarity-on-Sharding-Concepts-tp4279842p4279856.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>


Re: Clarity on Sharding Concepts.

2016-05-30 Thread Mugeesh Husain
Hi,

To read out this document
https://cwiki.apache.org/confluence/display/solr/Shards+and+Indexing+Data+in+SolrCloud
 
for proper understanding.

FYI, you are using implicit router, a document will be divided randomly
based on hashing technique.

If you indexed 50 documents, it will be divided into 2 parts, 1 goes to
shard1, second one is shard2 and same document will be go their replica
respectively .


Thanks
Mugeesh



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Clarity-on-Sharding-Concepts-tp4279842p4279856.html
Sent from the Solr - User mailing list archive at Nabble.com.


Clarity on Sharding Concepts.

2016-05-30 Thread Siddhartha Singh Sandhu
Hi Community,

I need some help understanding some concepts.

I have the config on 2 severs:

2 shards each with 1 replica.

Hence, on each server I have
1.  shard1_replica1
2 . shard2_replica1

Suppose I have 50 documents then,
shard1_replica1 + shard2_replica1 = 50 ?

or shard2_replica1 = 50 && shard1_replica1 = 50 ?

Regards,

Sid.