Re: SolrCloud Replication Failure

2018-11-01 Thread Kevin Risden
> From: > Kevin Risden > > Sent: Wednesday, October 31, 2018 10:24:24 PM > To: solr-user@lucene.apache.org > Subject: Re: SolrCloud Replication Failure > > I haven't dug into why this is happening but it definitely reproduces. I > removed the local requireme

Re: SolrCloud Replication Failure

2018-11-01 Thread Jeremy Smith
on. From: Kevin Risden Sent: Wednesday, October 31, 2018 10:24:24 PM To: solr-user@lucene.apache.org Subject: Re: SolrCloud Replication Failure I haven't dug into why this is happening but it definitely reproduces. I removed the local requirements (port mapping

Re: Re: SolrCloud scaling/optimization for high request rate

2018-11-01 Thread Toke Eskildsen
On Wed, 2018-10-31 at 13:42 +0200, Sofiya Strochyk wrote: > q===0= expression>==24=2.2=json Not much to see here, perhaps because you are not allowed to share it? Maybe we can try and isolate the cause? Could you try different runs, where you change different components and tell us roughly how

Re: SolrCloud Replication Failure

2018-10-31 Thread Kevin Risden
day, October 31, 2018 8:20:18 PM > To: solr-user > Subject: Re: SolrCloud Replication Failure > > What version of solr? This code was pretty much rewriten in 7.3 IIRC > > On Wed, Oct 31, 2018, 10:47 Jeremy Smith > > Hi all, > > > > We are currently running

Re: SolrCloud Replication Failure

2018-10-31 Thread Jeremy Smith
Thanks Erick, this is 7.5.0. From: Erick Erickson Sent: Wednesday, October 31, 2018 8:20:18 PM To: solr-user Subject: Re: SolrCloud Replication Failure What version of solr? This code was pretty much rewriten in 7.3 IIRC On Wed, Oct 31, 2018, 10:47 Jeremy Smith

Re: SolrCloud Replication Failure

2018-10-31 Thread Erick Erickson
What version of solr? This code was pretty much rewriten in 7.3 IIRC On Wed, Oct 31, 2018, 10:47 Jeremy Smith Hi all, > > We are currently running a moderately large instance of standalone > solr and are preparing to switch to solr cloud to help us scale up. I have > been running a number

SolrCloud Replication Failure

2018-10-31 Thread Jeremy Smith
Hi all, We are currently running a moderately large instance of standalone solr and are preparing to switch to solr cloud to help us scale up. I have been running a number of tests using docker locally and ran into an issue where replication is consistently failing. I have pared down

Re: Re: SolrCloud scaling/optimization for high request rate

2018-10-31 Thread Sofiya Strochyk
The logfiles on your servers should be verbose enough to indicate what machines are handling which parts of the request. Yes, generally i see the following entries in logs: 1. df=_text_=false=_id=score=4=0=true=fq===24=2==1540984948280=true=javabin 2.

Re: SolrCloud scaling/optimization for high request rate

2018-10-30 Thread Shawn Heisey
st do to produce results. SolrCloud complicates the situation further.  It normally does load balancing of all requests that come in across the cloud.  So the machine handling the request might not be the machine where you SENT the request. Very likely the one with a higher load is the one tha

Re: SolrCloud scaling/optimization for high request rate

2018-10-30 Thread Sofiya Strochyk
Sure, here is IO for bigger machine: https://upload.cc/i1/2018/10/30/tQovyM.png for smaller machine: https://upload.cc/i1/2018/10/30/cP8DxU.png CPU utilization including iowait: https://upload.cc/i1/2018/10/30/eSs1YT.png iowait only: https://upload.cc/i1/2018/10/30/CHgx41.png On 30.10.18

Re: SolrCloud scaling/optimization for high request rate

2018-10-30 Thread Deepak Goel
Please see inline... Deepak "The greatness of a nation can be judged by the way its animals are treated. Please consider stopping the cruelty by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn: www.linkedin.com/in/deicool "Plant a Tree,

Re: SolrCloud scaling/optimization for high request rate

2018-10-30 Thread Shawn Heisey
On 10/29/2018 8:56 PM, Erick Erickson wrote: The interval between when a commit happens and all the autowarm queries are finished if 52 seconds for the filterCache. seen warming that that long unless something's very unusual. I'd actually be very surprised if you're really only firing 64

Re: SolrCloud scaling/optimization for high request rate

2018-10-30 Thread Sofiya Strochyk
My swappiness is set to 10, swap is almost not used (used space is on scale of a few MB) and there is no swap IO. There is disk IO like this, though: https://upload.cc/i1/2018/10/30/43lGfj.png https://upload.cc/i1/2018/10/30/T3u9oY.png However CPU iowait is still zero, so not sure if the disk

Re: SolrCloud scaling/optimization for high request rate

2018-10-30 Thread Deepak Goel
Yes. Swapping from disk to memory & vice versa Deepak "The greatness of a nation can be judged by the way its animals are treated. Please consider stopping the cruelty by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn:

Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Erick Erickson
Sofiya: The interval between when a commit happens and all the autowarm queries are finished if 52 seconds for the filterCache. seen warming that that long unless something's very unusual. I'd actually be very surprised if you're really only firing 64 autowarm queries and it's taking almost 52

Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Sofiya Strochyk
Could you please clarify what is memory disk layer? Do you mean swapping from memory to disk, reading from disk to memory, or something else? On 29.10.18 17:20, Deepak Goel wrote: I would then suspect performance is choking in memory disk layer. can you please check the performance? On Mon,

Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Sofiya Strochyk
Sure, i can test that, will set to zero now :) We never tried a small number for the autowarming parameter but it has been running with zero (default value) for a while before being changed to 64, and the startup after the commit has been a bit slow. But overall, there was rather little

Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Erick Erickson
Speaking of your caches... Either it's a problem with the metrics reporting or your warmup times very, very long. 11 seconds and, er, 52 seconds! My guess is that you have your autowarm counts set to a very high number and are consuming a lot of CPU time every time a commit happens. Which will

Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Deepak Goel
I would then suspect performance is choking in memory disk layer. can you please check the performance? On Mon, 29 Oct 2018, 20:30 Sofiya Strochyk, wrote: > Hi Deepak and thanks for your reply, > > On 27.10.18 10:35, Deepak Goel wrote: > > > Last, what is the nature of your request. Are the

Re: Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Sofiya Strochyk
kirjoitti 26.10.2018 klo 18.55: Hi everyone, We have a SolrCloud setup with the following configuration:   * 4 nodes (3x128GB RAM Intel Xeon E5-1650v2, 1x64GB RAM Intel Xeon     E5-1650v2, 12 cores, with SSDs)   * One collection, 4 shards, each has only a single replica (so 4     replicas in total

Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Sofiya Strochyk
Hi Deepak and thanks for your reply, On 27.10.18 10:35, Deepak Goel wrote: Last, what is the nature of your request. Are the queries the same? Or they are very random? Random queries would need more tuning than if the queries the same. The search term (q) is different for each query, and

Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Sofiya Strochyk
Hi Shalin, these are stats for caches used: *documentCache* class:org.apache.solr.search.LRUCache description:LRU Cache(maxSize=128, initialSize=128) stats: CACHE.searcher.documentCache.cumulative_evictions:234923643 CACHE.searcher.documentCache.cumulative_hitratio:0

Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Toke Eskildsen
On Mon, 2018-10-29 at 10:55 +0200, Sofiya Strochyk wrote: > I think we could try that, but most likely it turns out that at some > point we are receiving 300 requests per second, and are able to > reasonably handle 150 per second, which means everything else is > going to be kept in the growing

Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Ere Maijala
, Ere Sofiya Strochyk kirjoitti 26.10.2018 klo 18.55: Hi everyone, We have a SolrCloud setup with the following configuration: * 4 nodes (3x128GB RAM Intel Xeon E5-1650v2, 1x64GB RAM Intel Xeon E5-1650v2, 12 cores, with SSDs) * One collection, 4 shards, each has only a single replica (so 4

Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Sofiya Strochyk
I think we could try that, but most likely it turns out that at some point we are receiving 300 requests per second, and are able to reasonably handle 150 per second, which means everything else is going to be kept in the growing queue and increase response times even further.. Also, if one

Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Sofiya Strochyk
Erick, thanks, i've been pulling my hair out over this for a long time and gathered a lot of information :) Doesn't there exist a setting for maxIndexingThreads in solrconfig with default value of about 8? It's not clear if my updates are being executed in parallel or not but i would expect

Re: **SPAM** Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Sofiya Strochyk
lso help rather than CMS, but as you're well aware GC tuning "is more art than science" ;). Good luck! Erick On Fri, Oct 26, 2018 at 8:55 AM Sofiya Strochyk <mailto:s...@interlogic.com.ua> wrote: Hi everyone, We have a SolrCloud setup with the following configuration: 4 nodes

Re: SolrCloud scaling/optimization for high request rate

2018-10-29 Thread Shalin Shekhar Mangar
What does your cache statistics look like? What's the hit ratio, size, evictions etc? More comments inline: On Sat, Oct 27, 2018 at 8:23 AM Erick Erickson wrote: > Sofiya: > > I haven't said so before, but it's a great pleasure to work with > someone who's done a lot of homework before pinging

Re: SolrCloud scaling/optimization for high request rate

2018-10-27 Thread Deepak Goel
On Fri, Oct 26, 2018 at 9:25 PM Sofiya Strochyk wrote: > Hi everyone, > > We have a SolrCloud setup with the following configuration: > >- 4 nodes (3x128GB RAM Intel Xeon E5-1650v2, 1x64GB RAM Intel Xeon >E5-1650v2, 12 cores, with SSDs) >- One collection, 4

Re: SolrCloud scaling/optimization for high request rate

2018-10-27 Thread Shawn Heisey
On 10/26/2018 9:55 AM, Sofiya Strochyk wrote: We have a SolrCloud setup with the following configuration: I'm late to this party.  You've gotten some good replies already.  I hope I can add something useful. * 4 nodes (3x128GB RAM Intel Xeon E5-1650v2, 1x64GB RAM Intel Xeon E5

Re: SolrCloud scaling/optimization for high request rate

2018-10-27 Thread Toke Eskildsen
Sofiya Strochyk wrote: > Target query rate is up to 500 qps, maybe 300, and we need > to keep response time at <200ms. But at the moment we only > see very good search performance with up to 100 requests > per second. Whenever it grows to about 200, average response > time abruptly increases to

Re: SolrCloud scaling/optimization for high request rate

2018-10-26 Thread Erick Erickson
Sofiya: I haven't said so before, but it's a great pleasure to work with someone who's done a lot of homework before pinging the list. The only unfortunate bit is that it usually means the simple "Oh, I can fix that without thinking about it much" doesn't work ;) 2. I'll clarify a bit here. Any

Re: SolrCloud scaling/optimization for high request rate

2018-10-26 Thread Toke Eskildsen
David Hastings wrote: > Would adding the docValues in the schema, but not reindexing, cause > errors? IE, only apply the doc values after the next reindex, but in the > meantime keep functioning as there were none until then? As soon as you specify in the schema that a field has docValues=true,

Re: SolrCloud scaling/optimization for high request rate

2018-10-26 Thread David Hastings
Would adding the docValues in the schema, but not reindexing, cause errors? IE, only apply the doc values after the next reindex, but in the meantime keep functioning as there were none until then? On Fri, Oct 26, 2018 at 2:15 PM Toke Eskildsen wrote: > Sofiya Strochyk wrote: > > 5. Yes,

Re: SolrCloud scaling/optimization for high request rate

2018-10-26 Thread Toke Eskildsen
Sofiya Strochyk wrote: > 5. Yes, docValues are enabled for the fields we sort on > (except score which is an internal field); [...] I am currently working on https://issues.apache.org/jira/browse/LUCENE-8374 which speeds up DocValues-operations for indexes with many documents. What "many" means

Re: SolrCloud scaling/optimization for high request rate

2018-10-26 Thread Walter Underwood
you a hint as to whether the >> TLOG/PULL configuration would be helpful. There's been talk of >> separate thread pools for indexing and querying to give queries a >> better shot at the CPU, but that's not in place yet. >> >> 7> G1GC may also help rather than CMS, but a

Re: SolrCloud scaling/optimization for high request rate

2018-10-26 Thread Sofiya Strochyk
nd querying to give queries a better shot at the CPU, but that's not in place yet. 7> G1GC may also help rather than CMS, but as you're well aware GC tuning "is more art than science" ;). Good luck! Erick On Fri, Oct 26, 2018 at 8:55 AM Sofiya Strochyk wrote: Hi everyone, We have a SolrClou

Re: SolrCloud scaling/optimization for high request rate

2018-10-26 Thread Erick Erickson
than science" ;). Good luck! Erick On Fri, Oct 26, 2018 at 8:55 AM Sofiya Strochyk wrote: > > Hi everyone, > > We have a SolrCloud setup with the following configuration: > > 4 nodes (3x128GB RAM Intel Xeon E5-1650v2, 1x64GB RAM Intel Xeon E5-1650v2, > 12 cores,

SolrCloud scaling/optimization for high request rate

2018-10-26 Thread Sofiya Strochyk
Hi everyone, We have a SolrCloud setup with the following configuration: * 4 nodes (3x128GB RAM Intel Xeon E5-1650v2, 1x64GB RAM Intel Xeon E5-1650v2, 12 cores, with SSDs) * One collection, 4 shards, each has only a single replica (so 4 replicas in total), using compositeId router

Re: Does ConcurrentUpdateSolrClient apply for SolrCloud ?

2018-10-25 Thread Jason Gerlowski
tually came out ahead in some setups. Now I'm not trying to say that CUSC performs better than CSC, just that "It Depends" (Erick's TM) on the rest of your ETL code, on the topology of your SolrCloud cluster, etc. Good luck! Jason On Wed, Oct 24, 2018 at 6:49 PM shamik wrote:

Re: How to add two fields (mobile,year) in SolrCloud Collection

2018-10-25 Thread Yogendra Kumar Soni
-z 172.22.9.16:2181]* > > once solrcloud instance started. we have created core with shards (2) and > custom configSet("_test") (schema.xml), Fields : id,name > > We have used dataImportHandler (DIH) post.jar to push data to respective > core. > > Here we have

How to add two fields (mobile,year) in SolrCloud Collection

2018-10-25 Thread kbmanikanta90
and started solr instance (8983) with -z (zookeeper) localhost:2181. *[solr start -cloud -p 8983 -z 172.22.9.16:2181]* once solrcloud instance started. we have created core with shards (2) and custom configSet("_test") (schema.xml), Fields : id,name We have used dataImportHandler (DIH) post.j

Re: Does ConcurrentUpdateSolrClient apply for SolrCloud ?

2018-10-24 Thread shamik
Thanks Erick, appreciate your help -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Does ConcurrentUpdateSolrClient apply for SolrCloud ?

2018-10-24 Thread Erick Erickson
No best practices as such, "whatever works" about covers it. That's not a huge query rate, especially if you have replicas per shard so I wouldn't worry too much about it. If you rack 100 clients all driving Solr as hard as possible and people complain that query responses are bad you'll know

Re: Does ConcurrentUpdateSolrClient apply for SolrCloud ?

2018-10-24 Thread shamik
Thanks Erick, that's extremely insightful. I'm not using batching and that's the reason I was exploring ConcurrentUpdateSolrClient. Currently, N threads are reusing the same CloudSolrClient to send data to Solr. Ofcourse, the single point of failure was my biggest concern with

Re: Does ConcurrentUpdateSolrClient apply for SolrCloud ?

2018-10-24 Thread Erick Erickson
r > indexing a large volume of data instead of CloudSolrClient. Having an > async,batch API seems to be a better fit for us where we tend to index a > lot of data periodically. As I'm looking into the API, I'm wonderign if > this can be used for SolrCloud. >

Does ConcurrentUpdateSolrClient apply for SolrCloud ?

2018-10-24 Thread Shamik Bandopadhyay
if this can be used for SolrCloud. ConcurrentUpdateSolrClientclient = new ConcurrentUpdateSolrClient.Builder(url).withThreadCount(100).withQueueSize(50).build(); The Builder object only takes a single url, not sure what that would be in case of SolrCloud. For e.g. if I've two shards with a couple

Re: Error while indexing Thai core with SolrCloud

2018-10-21 Thread Moshe Recanati | KMS
Thank you. Will check all options and let you know. From: Alexandre Rafalovitch Sent: Sunday, October 21, 2018 8:09:34 PM To: solr-user Subject: Re: Error while indexing Thai core with SolrCloud Ok, That may have been a bit too much :-) However, it was useful

Re: Error while indexing Thai core with SolrCloud

2018-10-21 Thread Alexandre Rafalovitch
Ok, That may have been a bit too much :-) However, it was useful. There seem to have several possible avenues: 1) You are using SolrJ and your SolrJ version is not the same as the version of the Solr server. There was a bunch of things that could trigger, especially in combination with Unicode

Re: Error while indexing Thai core with SolrCloud

2018-10-21 Thread Moshe Recanati | KMS
Hi, Thank you. Full stacktrace below "core_node_name":"172.19.218.201:8082_solr_core_th"}DEBUG - 2018-10-19 02:13:20.343; org.apache.zookeeper.ClientCnxn$SendThread; Reading reply sessionid:0x200b5a04a770005, packet:: clientPath:null serverPath:null finished:false header:: 356,1

Re: Error while indexing Thai core with SolrCloud

2018-10-21 Thread Alexandre Rafalovitch
there (that's as easy as "bin/solr start -e cloud"). Regards, Alex. On Sun, 21 Oct 2018 at 10:20, Moshe Recanati | KMS wrote: > > Hi Alexandre, > > Thank you. > > How this explain the issue exists only with SolrCloud and not standalone? > > > Moshe > &

Re: Error while indexing Thai core with SolrCloud

2018-10-21 Thread Moshe Recanati | KMS
Hi Alexandre, Thank you. How this explain the issue exists only with SolrCloud and not standalone? Moshe From: Alexandre Rafalovitch Sent: Sunday, October 21, 2018 5:18:24 PM To: solr-user Subject: Re: Error while indexing Thai core with SolrCloud I would

Re: Error while indexing Thai core with SolrCloud

2018-10-21 Thread Alexandre Rafalovitch
at 09:55, Moshe Recanati | KMS wrote: > > Hi, > > We've specific exception that happening only on Thai core and only once we're > using SolrCloud. > > Same indexing activity is running successfully while running on EN core with > SolrCloud or with Thai core and standalone co

Error while indexing Thai core with SolrCloud

2018-10-21 Thread Moshe Recanati | KMS
Hi, We've specific exception that happening only on Thai core and only once we're using SolrCloud. Same indexing activity is running successfully while running on EN core with SolrCloud or with Thai core and standalone configuration. We're running on Linux with Solr 4.6

Re: Restoring and upgrading a standalone index to SolrCloud

2018-10-03 Thread Shawn Heisey
On 10/3/2018 10:45 AM, Shawn Heisey wrote: Here's one way to do this: Oh, and when you delete the data directory, delete the tlog directory too.  Don't copy tlog from the non-cloud install.  Solr will re-create it as long as the directory gives it permission to do so. Thanks, Shawn

Re: Restoring and upgrading a standalone index to SolrCloud

2018-10-03 Thread Shawn Heisey
have an index that can be restored to Solr 7. Do you know if it's possible to restore an index like this to a SolrCloud environment if I can get it into a directory that is shared by all the nodes? Each node needs its own copy of the data, they cannot share an index directory.  Lucene works

Restoring and upgrading a standalone index to SolrCloud

2018-10-03 Thread Jack Schlederer
Hello, We currently run Solr 5.4 as our production search backend. We run it in a master/slave replication architecture, and we're starting an upgrade to Solr 7.5 using a SolrCloud architecture. One of our collections is around 20GB and hosts about 200M documents, and it would take around 6

Re: Solrcloud admin not asking for login

2018-09-22 Thread Jan Høydahl
gt; >> I followed the guide over here to setup basic auth for solrcloud >> >> http://lucene.apache.org/solr/guide/7_4/basic-authentication-plugin.html >> >> Our solrcloud version is 7.4. We have a 3 ensemble zookeeper with 3 solr >> nodes. I restarted the zookeep

Re: Solrcloud admin not asking for login

2018-09-22 Thread Sushant Vengurlekar
Any one have any ideas as to what could be going wrong. Thank you On Fri, Sep 21, 2018 at 10:43 PM Sushant Vengurlekar < svengurle...@curvolabs.com> wrote: > I followed the guide over here to setup basic auth for solrcloud > > http://lucene.apache.org/solr/guide/7_4/basic

Enum Types in SolrCloud

2018-09-22 Thread Parag Shah
Hi all, I am a Solr newbie and would like to understand how enum types can be added to solrcloud schema which resides in zookeeper. In the example here < https://lucene.apache.org/solr/guide/7_0/working-with-enum-fields.html#working-with-enum-fields > it relies on an enumsConfig.xm

Solrcloud admin not asking for login

2018-09-21 Thread Sushant Vengurlekar
I followed the guide over here to setup basic auth for solrcloud http://lucene.apache.org/solr/guide/7_4/basic-authentication-plugin.html Our solrcloud version is 7.4. We have a 3 ensemble zookeeper with 3 solr nodes. I restarted the zookeepers and the solr nodes but I still don't get prompted

Re: Corrupted index in SolrCloud

2018-09-21 Thread Matt Pearce
tion issue with their SolrCloud install. They're running Solr 5.3.1, with a collection spread across 12 shards. Each shard has a single replica. They were seeing "Index Corruption" errors when running certain queries. We investigated, and narrowed it down to a single shard. Using the Lucen

Re: Corrupted index in SolrCloud

2018-09-21 Thread Erick Erickson
ecent Solr releases, especially starting with Solr 7.3. (SOLR-11702) Best, Erick On Fri, Sep 21, 2018 at 7:17 AM Matt Pearce wrote: > > Hi, > > We've just been working with a client who had a corruption issue with > their SolrCloud install. They're running Solr 5.3.1, with a coll

Corrupted index in SolrCloud

2018-09-21 Thread Matt Pearce
Hi, We've just been working with a client who had a corruption issue with their SolrCloud install. They're running Solr 5.3.1, with a collection spread across 12 shards. Each shard has a single replica. They were seeing "Index Corruption" errors when running certain queries. We in

Re: solrcloud configuration: solr failed to start with multiple zookeeper servers

2018-09-14 Thread Shawn Heisey
On 9/13/2018 6:47 AM, Gu, Steve (CDC/OD/OADS) (CTR) wrote: After zk servers have started, I got the following error when I tried to start solr: localhost:2182 was unexpected at this time. Where is this error seen?  Was there more to the message?  In addition to knowing that, we will need to

RE: solrcloud configuration: solr failed to start with multiple zookeeper servers

2018-09-14 Thread Gu, Steve (CDC/CDC OD/OADS) (CTR)
8 11:10 PM To: solr-user@lucene.apache.org Subject: Re: solrcloud configuration: solr failed to start with multiple zookeeper servers Which version of Solr and ZooKeeper are you using? What is the command that you used to start Solr? Regards, Edwin On Thu, 13 Sep 2018 at 21:56, Gu, Steve (CDC/OD/

Re: solrcloud configuration: solr failed to start with multiple zookeeper servers

2018-09-13 Thread Zheng Lin Edwin Yeo
-- > From: Pure Host - Wolfgang Freudenberger > Sent: Thursday, September 13, 2018 8:57 AM > To: solr-user@lucene.apache.org > Subject: Re: solrcloud configuration: solr failed to start with multiple > zookeeper servers > > did you configure the zookeeper as a quorum? > &g

RE: how to access solr in solrcloud

2018-09-13 Thread Gu, Steve (CDC/CDC OD/OADS) (CTR)
That makes sense. CloudSolrClient accepts a list of zookeepers. It works beautifully. Thanks Steve -Original Message- From: Walter Underwood Sent: Thursday, September 13, 2018 10:55 AM To: solr-user@lucene.apache.org Subject: Re: how to access solr in solrcloud Use direct

Re: how to access solr in solrcloud

2018-09-13 Thread Walter Underwood
--Original Message- > From: Florian Gleixner > Sent: Wednesday, September 12, 2018 6:27 PM > To: solr-user@lucene.apache.org > Subject: Re: how to access solr in solrcloud > > On 9/12/18 8:21 PM, Shawn Heisey wrote: >> On 9/12/2018 7:38 AM, Gu, Steve (CDC/OD/OADS) (CTR) wro

RE: solrcloud configuration: solr failed to start with multiple zookeeper servers

2018-09-13 Thread Gu, Steve (CDC/OD/OADS) (CTR)
Yes, my zookeeper ensemble have 3 servers and they are all up running. -Original Message- From: Pure Host - Wolfgang Freudenberger Sent: Thursday, September 13, 2018 8:57 AM To: solr-user@lucene.apache.org Subject: Re: solrcloud configuration: solr failed to start with multiple

Re: solrcloud configuration: solr failed to start with multiple zookeeper servers

2018-09-13 Thread Pure Host - Wolfgang Freudenberger
did you configure the zookeeper as a quorum? Am 13.09.2018 um 14:47 schrieb Gu, Steve (CDC/OD/OADS) (CTR): Hi, I am prototyping solrcloud and I have three zookeeper servers (localhost:2181,localhost:2182,localhost:2183). I set the zkHost in solr.in.cmd file as: set ZK_HOST="localhost

solrcloud configuration: solr failed to start with multiple zookeeper servers

2018-09-13 Thread Gu, Steve (CDC/OD/OADS) (CTR)
Hi, I am prototyping solrcloud and I have three zookeeper servers (localhost:2181,localhost:2182,localhost:2183). I set the zkHost in solr.in.cmd file as: set ZK_HOST="localhost:2181,localhost:2182,localhost:2183" After zk servers have started, I got the following error when I trie

Re: how to access solr in solrcloud

2018-09-13 Thread Shawn Heisey
On 9/13/2018 6:23 AM, Gu, Steve (CDC/OD/OADS) (CTR) wrote: Hi, Florian We need to pass zookeeper url to CloudSolrClient. Since there are multiple zk servers, is it the common practice to set a proxy server in front of zookeeper? ZooKeeper should not be behind a load balancer.  Your client

RE: how to access solr in solrcloud

2018-09-13 Thread Gu, Steve (CDC/OD/OADS) (CTR)
PM To: solr-user@lucene.apache.org Subject: Re: how to access solr in solrcloud On 9/12/18 8:21 PM, Shawn Heisey wrote: > On 9/12/2018 7:38 AM, Gu, Steve (CDC/OD/OADS) (CTR) wrote: >> I am upgrading our solr to 7.4 and would like to set up solrcloud for >> failover a

Re: how to access solr in solrcloud

2018-09-12 Thread Florian Gleixner
On 9/12/18 8:21 PM, Shawn Heisey wrote: > On 9/12/2018 7:38 AM, Gu, Steve (CDC/OD/OADS) (CTR) wrote: >> I am upgrading our solr to 7.4 and would like to set up solrcloud for >> failover and load balance.   There are three zookeeper servers >> (zk1:2181, zk1:2182) and two sol

Re: how to access solr in solrcloud

2018-09-12 Thread Shawn Heisey
On 9/12/2018 7:38 AM, Gu, Steve (CDC/OD/OADS) (CTR) wrote: I am upgrading our solr to 7.4 and would like to set up solrcloud for failover and load balance. There are three zookeeper servers (zk1:2181, zk1:2182) and two solr instance solr1:8983, solr2:8983. So what will be the solr url

RE: how to access solr in solrcloud

2018-09-12 Thread Gu, Steve (CDC/OD/OADS) (CTR)
Vadim, That makes perfect sense. Thanks Steve -Original Message- From: Vadim Ivanov Sent: Wednesday, September 12, 2018 10:23 AM To: solr-user@lucene.apache.org Subject: RE: how to access solr in solrcloud Hi, Steve If you are using solr1:8983 to access solr and solr1 is down IMHO

RE: how to access solr in solrcloud

2018-09-12 Thread Gu, Steve (CDC/OD/OADS) (CTR)
Thanks, Walter -Original Message- From: Walter Underwood Sent: Wednesday, September 12, 2018 10:41 AM To: solr-user@lucene.apache.org Subject: Re: how to access solr in solrcloud Use a load balancer. It doesn’t have to be fancy, we use the Amazon ALB because our clusters are in AWS

RE: how to access solr in solrcloud

2018-09-12 Thread Gu, Steve (CDC/OD/OADS) (CTR)
Thanks, David -Original Message- From: David Santamauro Sent: Wednesday, September 12, 2018 10:28 AM To: solr-user@lucene.apache.org Cc: David Santamauro Subject: Re: how to access solr in solrcloud ... or haproxy. On 9/12/18, 10:23 AM, "Vadim Ivanov" wrote:

Re: how to access solr in solrcloud

2018-09-12 Thread Walter Underwood
Sep 12, 2018, at 6:38 AM, Gu, Steve (CDC/OD/OADS) (CTR) > wrote: > > Hi, all > > I am upgrading our solr to 7.4 and would like to set up solrcloud for > failover and load balance. There are three zookeeper servers (zk1:2181, > zk1:2182) and two solr instance solr1:89

Re: how to access solr in solrcloud

2018-09-12 Thread David Santamauro
s frontend to access Solrcloud. -- BR, Vadim -Original Message- From: Gu, Steve (CDC/OD/OADS) (CTR) [mailto:c...@cdc.gov] Sent: Wednesday, September 12, 2018 4:38 PM To: 'solr-user@lucene.apache.org' Subject: how to access solr in

RE: how to access solr in solrcloud

2018-09-12 Thread Vadim Ivanov
Hi, Steve If you are using solr1:8983 to access solr and solr1 is down IMHO nothing helps you to access dead ip. You should switch to any other live node in the cluster or I'd propose to have nginx as frontend to access Solrcloud. -- BR, Vadim -Original Message- From: Gu, Steve

how to access solr in solrcloud

2018-09-12 Thread Gu, Steve (CDC/OD/OADS) (CTR)
Hi, all I am upgrading our solr to 7.4 and would like to set up solrcloud for failover and load balance. There are three zookeeper servers (zk1:2181, zk1:2182) and two solr instance solr1:8983, solr2:8983. So what will be the solr url should the client to use for access? Will it be solr1

Re: SolrCloud CDCR with 3+ DCs

2018-09-07 Thread Amrit Sarkar
Yeah, I am not sure about how the Authentication band aid feature will work, the mentioned stackoverflow link. It is about time we include basic authentication support in CDCR. On Thu, 6 Sep 2018, 8:41 pm cdatta, wrote: > Hi Amrit, Thanks for your response. > > We wiped out our complete

Re: SolrCloud CDCR with 3+ DCs

2018-09-06 Thread cdatta
Hi Amrit, Thanks for your response. We wiped out our complete installation and started a fresh one. Now the multi-direction replication is working but we are seeing errors related to the authentication sporadically. Thanks & Regards, Chandi Datta -- Sent from:

Re: Error with plugin in Solrcloud

2018-09-02 Thread Zahra Aminolroaya
Thanks Shawn. I wrote my own filter. I attached my jar in hear. I found your answer in hear: http://lucene.472066.n3.nabble.com/How-to-load-plugins-with-Solr-4-9-and-SolrCloud-td4312113.html Based on your answer, is it possible that blob Api does not work for my own filter jar? norm.jar

Re: Solrcloud collection file location on zookeeper

2018-08-31 Thread Jan Høydahl
Once Solr 7.5 is released you will have a new "Cloud -> ZK Status" tab that will among other things show the data path on each ZK server. Until then, log in to the ZK server, locate zoo.cfg and check. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 31. aug. 2018 kl.

Re: Solrcloud collection file location on zookeeper

2018-08-31 Thread Erick Erickson
You should have a "zoo.cfg" file in the conf directory (a sibling to the bin directory where you run ZK). Inside there the dataDir property specifies where ZooKeeper stores data. NOTE: the default is somewhere under /tmp and should NOT be used for production since the contents of /tmp can

Re: Solrcloud collection file location on zookeeper

2018-08-31 Thread Shawn Heisey
On 8/31/2018 8:40 AM, Sushant Vengurlekar wrote: Any idea where this database is stored on the file system. I don’t want to read it but just know where it resides. If you followed recommendations, your ZooKeeper ensemble is NOT using the ZK server that's embedded inside Solr.  In that case I

Re: Solrcloud collection file location on zookeeper

2018-08-31 Thread Sushant Vengurlekar
tructure that cannot be easily examined by > anything other than ZooKeeper itself. > > If you want detailed information about how ZK stores data, you will need > to visit a support resource for the ZooKeeper project. It is a > completely separate project from Solr. > > SolrCloud

Re: Solrcloud collection file location on zookeeper

2018-08-31 Thread Shawn Heisey
. It is a completely separate project from Solr. SolrCloud does not store index data in ZooKeeper. Thanks, Shawn

Solrcloud collection file location on zookeeper

2018-08-30 Thread Sushant Vengurlekar
Where does zookeeper store the collection info on local filesystem on zookeeper? Thank you

Re: Local development and SolrCloud

2018-08-23 Thread John Blythe
t; expect and the like. > > That said, I'd never jump straight to SolrCloud implementations > without my QA being on SolrCloud. Not only do subtle differences creep > in, but some things simply aren't supported, e.g. group.func. > > And, as Sameer says, you can set up a SolrCloud environ

Re: Local development and SolrCloud

2018-08-22 Thread Erick Erickson
I do quite a bit of "correctness" testing on a local stand-alone Solr, as Walter says, that's often easier to debug, especially when working through creating the proper analysis chains, do queries do what I expect and the like. That said, I'd never jump straight to SolrCloud imple

Re: Local development and SolrCloud

2018-08-22 Thread Walter Underwood
eveloping applications with solr and are using > solrcloud in production: what are you doing locally? Cloud seems > unnecessary locally besides testing strictly for cloud specific use cases > or configurations. Am I totally off basis there? We are considering keeping > a “standard” (read:

Re: Local development and SolrCloud

2018-08-22 Thread Sameer Maggon
Why not just revert to everything SolrCloud? The advantages you will have is that you or your other team members are using the same APIs, parameters, experience, etc. that they will be using when they go from one environment to another. It would be less confusion to explain to someone why you

Local development and SolrCloud

2018-08-22 Thread John Blythe
For those of you who are developing applications with solr and are using solrcloud in production: what are you doing locally? Cloud seems unnecessary locally besides testing strictly for cloud specific use cases or configurations. Am I totally off basis there? We are considering keeping

Re: Dataimport not working on solrcloud

2018-08-21 Thread Shawn Heisey
On 8/20/2018 10:00 PM, Sushant Vengurlekar wrote: I have a dataimport working on standalone solr instance but the same doesn't work on solrcloud. I keep on hitting this error Full Import failed:java.lang.RuntimeException: java.lang.RuntimeException

Dataimport not working on solrcloud

2018-08-20 Thread Sushant Vengurlekar
I have a dataimport working on standalone solr instance but the same doesn't work on solrcloud. I keep on hitting this error Full Import failed:java.lang.RuntimeException: java.lang.RuntimeException: org.apache.solr.handler.dataimport.DataImportHandlerException: Exception in invoking url

Re: SolrCloud CDCR with 3+ DCs

2018-08-20 Thread Amrit Sarkar
To the concerned, This is certainly unfortunate if 3-way Active CDCR is not happening successfully. At the time of writing the feature I was able to perform N-way Active CDCR approach. How are the logs looking, are the documents are not getting forwarded in sync? Can you attach the source solr

<    1   2   3   4   5   6   7   8   9   10   >