RE: SolrCloud Indexing question
Thank you so much for the suggestion, Is the same recommended for querying too i found it very slow when i do query using clousolrserver Kalyan Date: Tue, 6 Aug 2013 13:25:37 -0600 From: s...@elyograg.org To: solr-user@lucene.apache.org Subject: Re: SolrCloud Indexing question On 8/6/2013 12:55 PM, Kalyan Kuram wrote: Hi AllI need suggestion on how to send indexing commands to 2 different solr server,Basically i want to mirror my index,here is the scenarioi have 2 cluster, each cluster has one master and 2 slaves with external zookeeper in the fronti need suggestion on what solr api class i should use to send indexing commands to 2 masters,will LBHttpSolrServer do the indexing or is this only used for querying If there is a better approach please suggest Kalyan If you're using zookeeper, then your index is SolrCloud, and you don't have masters and slaves. The traditional master/slave replication model does not apply to SolrCloud. With SolrCloud, there is no need to have two independent clusters. If a server dies, the other servers in the cloud will keep the cluster operational. When you bring the dead server back with the proper config, it will automatically be synchronized with the cluster. For a Java program with SolrJ, use a CloudSolrServer object for each cluster. The constructor for CloudSolrServer accepts the same zkHost parameter that you give to each Solr server when starting in SolrCloud mode. You cannot index to independent clusters at the same time through one object - if they truly are independent SolrCloud installs, you have to manage updates to both of them independently. Thanks, Shawn
SolrCloud Indexing question
Hi AllI need suggestion on how to send indexing commands to 2 different solr server,Basically i want to mirror my index,here is the scenarioi have 2 cluster, each cluster has one master and 2 slaves with external zookeeper in the fronti need suggestion on what solr api class i should use to send indexing commands to 2 masters,will LBHttpSolrServer do the indexing or is this only used for querying If there is a better approach please suggest Kalyan
Re: SolrCloud Indexing question
On 8/6/2013 12:55 PM, Kalyan Kuram wrote: Hi AllI need suggestion on how to send indexing commands to 2 different solr server,Basically i want to mirror my index,here is the scenarioi have 2 cluster, each cluster has one master and 2 slaves with external zookeeper in the fronti need suggestion on what solr api class i should use to send indexing commands to 2 masters,will LBHttpSolrServer do the indexing or is this only used for querying If there is a better approach please suggest Kalyan If you're using zookeeper, then your index is SolrCloud, and you don't have masters and slaves. The traditional master/slave replication model does not apply to SolrCloud. With SolrCloud, there is no need to have two independent clusters. If a server dies, the other servers in the cloud will keep the cluster operational. When you bring the dead server back with the proper config, it will automatically be synchronized with the cluster. For a Java program with SolrJ, use a CloudSolrServer object for each cluster. The constructor for CloudSolrServer accepts the same zkHost parameter that you give to each Solr server when starting in SolrCloud mode. You cannot index to independent clusters at the same time through one object - if they truly are independent SolrCloud installs, you have to manage updates to both of them independently. Thanks, Shawn
SolrCloud indexing question
Hi, I just wanted to make sure I understand how distributed indexing works in solrcloud. Can I index locally at each shard to avoid throttling a central port? Or all the indexing has to go through a single shard leader? thanks
Re: SolrCloud indexing question
my understanding is that you can send your updates/deletes to any shard and they will be forwarded to the leader automatically. That being said your leader will always be the place where the index happens and then distributed to the other replicas. On Fri, Apr 20, 2012 at 7:54 AM, Darren Govoni dar...@ontrenet.com wrote: Hi, I just wanted to make sure I understand how distributed indexing works in solrcloud. Can I index locally at each shard to avoid throttling a central port? Or all the indexing has to go through a single shard leader? thanks
Re: SolrCloud indexing question
Gotcha. Now does that mean if I have 5 threads all writing to a local shard, will that shard piggyhop those index requests onto a SINGLE connection to the leader? Or will they spawn 5 connections from the shard to the leader? I really hope the formerthe latter won't scale well. On Fri, 2012-04-20 at 10:28 -0400, Jamie Johnson wrote: my understanding is that you can send your updates/deletes to any shard and they will be forwarded to the leader automatically. That being said your leader will always be the place where the index happens and then distributed to the other replicas. On Fri, Apr 20, 2012 at 7:54 AM, Darren Govoni dar...@ontrenet.com wrote: Hi, I just wanted to make sure I understand how distributed indexing works in solrcloud. Can I index locally at each shard to avoid throttling a central port? Or all the indexing has to go through a single shard leader? thanks
Re: SolrCloud indexing question
I believe the SolrJ code round robins which server the request is sent to and as such probably wouldn't send to the same server in your case, but if you had an HttpSolrServer for instance and were pointing to only one particular intsance my guess would be that would be 5 separate requests from the server you hit. Especially since in all likelihood those documents wouldn't be destined for the same shard as the others (unless of course you only had 1 shard and you sent these to the replica) On Fri, Apr 20, 2012 at 3:02 PM, Darren Govoni dar...@ontrenet.com wrote: Gotcha. Now does that mean if I have 5 threads all writing to a local shard, will that shard piggyhop those index requests onto a SINGLE connection to the leader? Or will they spawn 5 connections from the shard to the leader? I really hope the formerthe latter won't scale well. On Fri, 2012-04-20 at 10:28 -0400, Jamie Johnson wrote: my understanding is that you can send your updates/deletes to any shard and they will be forwarded to the leader automatically. That being said your leader will always be the place where the index happens and then distributed to the other replicas. On Fri, Apr 20, 2012 at 7:54 AM, Darren Govoni dar...@ontrenet.com wrote: Hi, I just wanted to make sure I understand how distributed indexing works in solrcloud. Can I index locally at each shard to avoid throttling a central port? Or all the indexing has to go through a single shard leader? thanks
