Error when trying to create a collection with SolrCloud and Zookeeper Ensemble

2019-03-05 Thread maimuna ambareen
I received the below error when i tried to create a collection with SolrCloud and zookeepr ensemble. Can someone help me to resolve the error? { "responseHeader":{ "status":500, "QTime":2641}, &quo

Error when trying to create a collection with SolrCloud and Zookeeper Ensemble

2019-03-05 Thread maimuna ambareen
I received the below error when i tried to create a collection with SolrCloud and zookeepr ensemble. Can someone help me to resolve the error? { "responseHeader":{ "status":500, "QTime":2641}, &quo

Re: When solrcloud will support join between two collections

2019-03-05 Thread Erick Erickson
this depends on your exact > use case. > >> Am 05.03.2019 um 18:35 schrieb Jie Luo : >> >> Hi all, >> >> We are developing our search engine using solrcloud with multiple shards. We >> would like to join two collections. As far as I know joining two c

Re: When solrcloud will support join between two collections

2019-03-05 Thread Jörn Franke
t; Hi all, > > We are developing our search engine using solrcloud with multiple shards. We > would like to join two collections. As far as I know joining two collections > only works on standalone indexes, but does not work on distributed indexes > such as solrcloud environment. >

When solrcloud will support join between two collections

2019-03-05 Thread Jie Luo
Hi all, We are developing our search engine using solrcloud with multiple shards. We would like to join two collections. As far as I know joining two collections only works on standalone indexes, but does not work on distributed indexes such as solrcloud environment. I would like to know if

RE: SolrCloud one server with high load

2019-03-05 Thread Gael Jourdan-Weil
___ De : Erick Erickson Envoyé : lundi 4 mars 2019 18:53 À : Gael Jourdan-Weil Objet : Re: SolrCloud one server with high load Yes, Overseer is different than leader. There is one leader is _per shard_, and it’s job is to coordinate updates to the index for that shard. The Overseer coordinat

Re: SolrCloud one server with high load

2019-03-04 Thread Muwonge Ronald
the overseer different from the leader? > In the Solr Admin UI > SolrCloud > Tree > overseer > leader file I can see > the machine being the leader is not the one having issues right now. > > Kind Regards, > Gaël > > > De : Eri

RE: SolrCloud one server with high load

2019-03-04 Thread Gael Jourdan-Weil
Hi Erick, We are running Solr 7.6.0. We recently upgraded from 7.2.1 but we already had theses issues with Solr 7.2.1. Is the overseer different from the leader? In the Solr Admin UI > SolrCloud > Tree > overseer > leader file I can see the machine being the leader is not the one h

Re: SolrCloud one server with high load

2019-03-04 Thread Erick Erickson
What version of Solr? There are some anecdotal reports of abnormal CPU loads on very recent Solr’s. Is the server with the high load the “Overseer”? In the admin UI>>SolrCloud>>tree you can see which node is the Overseer. This is really a shot in the dark, as unless you are do

RE: SolrCloud one server with high load

2019-03-04 Thread Gael Jourdan-Weil
: Furkan KAMACI Envoyé : lundi 4 mars 2019 15:00 À : solr-user@lucene.apache.org Objet : Re: SolrCloud one server with high load Hi Gaël, Does all three servers have same specifications? On the other hand, is your load balancing configuration for Varnish is round-robin? Kind Regards, Furkan KAMACI

Re: SolrCloud one server with high load

2019-03-04 Thread Furkan KAMACI
I come again to the community for some ideas regarding a performance issue > we are having. > > We have a SolrCloud cluster of 3 servers. > Each server hosts 1 replica of 2 collections. > There is no sharding, every server hosts the whole collection. > > Requests are evenly distrib

SolrCloud one server with high load

2019-03-04 Thread Gael Jourdan-Weil
Hello, I come again to the community for some ideas regarding a performance issue we are having. We have a SolrCloud cluster of 3 servers. Each server hosts 1 replica of 2 collections. There is no sharding, every server hosts the whole collection. Requests are evenly distributed by a Varnish

Errors during solrcloud replication (7.7.x)

2019-03-01 Thread Karl Stoney
Hey all, I’m looking for some support with replication errors we’re seeing in SolrCloud 7.7.x (tried both .0 and .1). I’ve created a StackOverflow issue: We have errors in SolrCloud (7.7.1) during replication, which we can't understand. We thought it may be https://issues.apache.org

Re: StreamingSolrClients intermittent Error SolrCloud setup

2019-02-27 Thread Zheng Lin Edwin Yeo
Hi Abhi, Are all your Solr nodes and ZooKeepers in different machine? Regards, Edwin On Wed, 27 Feb 2019 at 02:19, abhishek_itengg wrote: > Hi, > > I am using SolrCloud setup with 3 SolrNodes. Intermittently we see errors > of > streaming solr clients on individual solr node lo

Re: SolrCloud exclusive features

2019-02-26 Thread Arnold Bronley
On Sat, Feb 16, 2019 at 7:07 PM Arnold Bronley wrote: > I am glad to learn that there are others in similar need. A list for > SolrCloud exclusive features will be really awesome. > Can any Solr devs please reply to this thread? > > > On Fri, Feb 15, 2019 at 8:39

StreamingSolrClients intermittent Error SolrCloud setup

2019-02-26 Thread abhishek_itengg
Hi, I am using SolrCloud setup with 3 SolrNodes. Intermittently we see errors of streaming solr clients on individual solr node logs. These error do resolved automatically but it comes back every now and then. We have 3 zookeepers and I verified that they have always maintained quorum. Is there a

Re: SolrCloud fails to restart after rebooting

2019-02-26 Thread abhishek_itengg
Shawn, As you mentioned, it was indeed a problem with my network. The port 2888 was blocked restricting zookeeper communication its peers. Thanks, Abhi -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: SolrCloud fails to restart after rebooting

2019-02-23 Thread Shawn Heisey
On 2/23/2019 2:29 PM, abhishek_itengg wrote: 1) I verified the presence of solr.xml file at SOLR_HOME directory on all the three servers. 2) I am starting the SOLR nodes in the cloud mode. Its configured as NSSM windows service. solr start -cloud -f -p 8983 -z "10.**.**.208:2181,10.**.37.**:2181,

Re: SolrCloud fails to restart after rebooting

2019-02-23 Thread abhishek_itengg
Hi Erick, 1) I verified the presence of solr.xml file at SOLR_HOME directory on all the three servers. 2) I am starting the SOLR nodes in the cloud mode. Its configured as NSSM windows service. solr start -cloud -f -p 8983 -z "10.**.**.208:2181,10.**.37.**:2181,10.**.38.**:2181" Everything was wo

Re: SolrCloud fails to restart after rebooting

2019-02-23 Thread abhishek_itengg
Hi Frankie, Excuse my ignorance here as I am really new to the ZK and SolrCloud world. Could you guide me where can I see the ZK logs, I really do not see any folder for logs in zookeeper directory. Thanks, Abhi -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: SolrCloud fails to restart after rebooting

2019-02-23 Thread abhishek_itengg
Hi Edwin, No, the 3 solr nodes are each of an individual server tied with their own zookeeper instance. So basically 1ZK +1Solr Node instance on each three servers. Thanks, Abhi -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: SolrCloud fails to restart after rebooting

2019-02-23 Thread Zheng Lin Edwin Yeo
@gmail.com>: > > > > Facing an issue where SolrCloud cluster fails to initialize or come back > up > > post restart of the servers. I have a solrcloud setup with 3 solr nodes > with > > embedded zookeeper. Had to restart the servers due to windows patching. > &

Re: SolrCloud fails to restart after rebooting

2019-02-23 Thread Jörn Franke
I would not go for embedded ZooKeeper, but a dedicated zookeeper - ideally on different machines than the solr servers. Check also the ZK logs - maybe the data got corrupted due to improper shutdown. > Am 23.02.2019 um 17:20 schrieb abhishek_itengg : > > Facing an issue where

Re: SolrCloud fails to restart after rebooting

2019-02-23 Thread Erick Erickson
ing to the same ZK ensemble. Lots of this is explained in the reference guide. Best, Erick > On Feb 23, 2019, at 8:20 AM, abhishek_itengg > wrote: > > Facing an issue where SolrCloud cluster fails to initialize or come back up > post restart of the servers. I have a solrcloud se

SolrCloud fails to restart after rebooting

2019-02-23 Thread abhishek_itengg
Facing an issue where SolrCloud cluster fails to initialize or come back up post restart of the servers. I have a solrcloud setup with 3 solr nodes with embedded zookeeper. Had to restart the servers due to windows patching. Below is the error I get:- HTTP ERROR 500 Problem accessing /solr

Re: SolrCloud exclusive features

2019-02-16 Thread Arnold Bronley
I am glad to learn that there are others in similar need. A list for SolrCloud exclusive features will be really awesome. Can any Solr devs please reply to this thread? On Fri, Feb 15, 2019 at 8:39 AM David Hastings wrote: > >streaming expressions are only available in > SolrCloud mod

Re: SolrCloud exclusive features

2019-02-15 Thread David Hastings
>streaming expressions are only available in SolrCloud mode and not in Solr master-slave mode? yes, and its annoying as there are features of solr cloud I do not like. as far as a comprehensive list, that I do not know but would be interested in one as well On Thu, Feb 14, 2019 at 5:07 PM Arn

SolrCloud exclusive features

2019-02-14 Thread Arnold Bronley
Hi, Are there any features that are only exclusive to SolrCloud? e.g. when I am reading Streaming Expressions documentation, first sentence there says 'Streaming Expressions provide a simple yet powerful stream processing language for Solr Cloud.' So, does this mean that streaming e

Re: Help needed with Solrcloud error messages

2019-02-07 Thread Erick Erickson
Your solr logs on the server should have more details than just the bare error in the full stack trace. Those would help figure out what's happening. Best, Erick On Mon, Feb 4, 2019 at 3:14 PM Webster Homer wrote: > > We have a number of collections in a Solrcloud. > > The c

Help needed with Solrcloud error messages

2019-02-04 Thread Webster Homer
We have a number of collections in a Solrcloud. The cloud has 2 shards each with 2 replicas, 4 nodes. On one of the nodes I am seeing a lot of errors in the log like this: 2019-02-04 20:27:11.831 ERROR (qtp1595212853-88527) [c:sial-catalog-product s:shard1 r:core_node4 x:sial-catalog

Re: SolrCloud become unresponsive after huge pivot facet query

2019-01-31 Thread Shawn Heisey
On 1/31/2019 12:11 PM, Ruchir Choudhry wrote: Wanted to start working on Solr bugs, will appreciate if you or some can allocate me with some minor bugs. It doesn't work like that. Issues are not handed out, it's a strictly volunteer system. You'll need to find the issues you want to work on

Re: SolrCloud become unresponsive after huge pivot facet query

2019-01-31 Thread Ruchir Choudhry
en they can be used, but I doubt you can in your case. > BTW, as chance would have it, Joel B. just explained this to me ;). > > Best, > Erick > > On Wed, Jan 30, 2019 at 3:41 AM Matteo Diarena > wrote: > > > > Dear all, > > we have a solrcloud cluster with

R: SolrCloud become unresponsive after huge pivot facet query

2019-01-31 Thread Matteo Diarena
io originale- Da: Erick Erickson Inviato: 30 January 2019 17:44 A: solr-user Oggetto: Re: SolrCloud become unresponsive after huge pivot facet query My suggestion is "don't do that" ;). Ok, seriously. Conceptually what you have is an N-dimnensional matrix. Each "dimension&qu

Re: SolrCloud become unresponsive after huge pivot facet query

2019-01-30 Thread Erick Erickson
d have it, Joel B. just explained this to me ;). Best, Erick On Wed, Jan 30, 2019 at 3:41 AM Matteo Diarena wrote: > > Dear all, > we have a solrcloud cluster with the following features: > - 3 zookeeper nodes > - 4 solr nodes with: >

SolrCloud become unresponsive after huge pivot facet query

2019-01-30 Thread Matteo Diarena
Dear all, we have a solrcloud cluster with the following features: - 3 zookeeper nodes - 4 solr nodes with: - 4 CPU - 16GB RAM Each solr instance is configured as follow: SOLR_JAVA_MEM="-Xms2g -

Re: Solrcloud TimeoutException: Idle timeout expired

2019-01-29 Thread Deepak Goel
Document is not being passed. It has zero content. It could be due to no memory in heap. For this please check GC logs On Tue, 29 Jan 2019, 08:54 Schaum Mallik I am seeing this error in our logs. Our Solr heap is set to more than 10G. > Any clues which anyone can provide will be very helpful. >

Solrcloud TimeoutException: Idle timeout expired

2019-01-29 Thread Schaum Mallik
I am seeing this error in our logs. Our Solr heap is set to more than 10G. Any clues which anyone can provide will be very helpful. Thank you null:java.io.IOException: java.util.concurrent.TimeoutException: Idle timeout expired: 12/12 ms at org.eclipse.jetty.server.HttpInput$Erro

Solrcloud TimeoutException: Idle timeout expired

2019-01-28 Thread Schaum Mallik
I am seeing this error in our logs. Our Solr heap is set to more than 10G. Any clues which anyone can provide will be very helpful. Thank you null:java.io.IOException: java.util.concurrent.TimeoutException: Idle timeout expired: 12/12 ms at org.eclipse.jetty.server.HttpInput$Erro

Re: SolrCloud recovery

2019-01-25 Thread Hendrik Haddorp
Haddorp [mailto:hendrik.hadd...@gmx.net] Sent: Friday, January 25, 2019 11:39 AM To: solr-user@lucene.apache.org Subject: SolrCloud recovery Hi, I have a SolrCloud with many collections. When I restart an instance and the replicas are recovering I noticed that number replicas recovering at one poin

Re: SolrCloud recovery

2019-01-25 Thread Erick Erickson
t; parallel. > > > > https://lucene.apache.org/solr/guide/7_6/format-of-solr-xml.html > > > >>> -Original Message- > >>> From: Hendrik Haddorp [mailto:hendrik.hadd...@gmx.net] > >>> Sent: Friday, January 25, 2019 11:39 AM > >>> T

Re: SolrCloud recovery

2019-01-25 Thread Hendrik Haddorp
.html -Original Message- From: Hendrik Haddorp [mailto:hendrik.hadd...@gmx.net] Sent: Friday, January 25, 2019 11:39 AM To: solr-user@lucene.apache.org Subject: SolrCloud recovery Hi, I have a SolrCloud with many collections. When I restart an instance and the replicas are recovering I no

RE: SolrCloud recovery

2019-01-25 Thread Vadim Ivanov
x.net] > > Sent: Friday, January 25, 2019 11:39 AM > > To: solr-user@lucene.apache.org > > Subject: SolrCloud recovery > > > > Hi, > > > > I have a SolrCloud with many collections. When I restart an instance and > > the replicas are recovering I noti

RE: SolrCloud recovery

2019-01-25 Thread Vadim Ivanov
You can try to tweak solr.xml > -Original Message- > From: Hendrik Haddorp [mailto:hendrik.hadd...@gmx.net] > Sent: Friday, January 25, 2019 11:39 AM > To: solr-user@lucene.apache.org > Subject: SolrCloud recovery > > Hi, > > I have a SolrCloud with many col

SolrCloud recovery

2019-01-25 Thread Hendrik Haddorp
Hi, I have a SolrCloud with many collections. When I restart an instance and the replicas are recovering I noticed that number replicas recovering at one point is usually around 5. This results in the recovery to take rather long. Is there a configuration option that controls how many

Re: Bootstrapping a Collection on SolrCloud

2019-01-14 Thread Frank Greguska
uld still have 2 shards but with replicas. Or I could > > choose no replicas but more shards. This is what I mean by the > > shard/replica decision being partially dependent on available hardware; > > there are some decisions I could make knowing my planned deployment so > that &

Re: Bootstrapping a Collection on SolrCloud

2019-01-09 Thread Erick Erickson
ion being partially dependent on available hardware; > there are some decisions I could make knowing my planned deployment so that > when I start the cluster it can be immediately functional. Rather than > first starting the cluster, then creating the collection, then making it > avail

Re: Bootstrapping a Collection on SolrCloud

2019-01-09 Thread Frank Greguska
mmediately functional. Rather than first starting the cluster, then creating the collection, then making it available. You may be right that it is a small and complicated concern because I really only need to care about it once when I am first deploying my cluster. But everyone who needs to stand up a So

Re: Bootstrapping a Collection on SolrCloud

2019-01-09 Thread Erick Erickson
er just the current setup. And I do think that it would be > > considerable effort. > > > > Net-net is I'd like to see a much stronger justification > > before anyone embarks on something like this. First as > > I mentioned above I think it'd be a lot of effort, secon

Re: Bootstrapping a Collection on SolrCloud

2019-01-09 Thread Frank Greguska
tually guarantee it'd introduce significant bugs. How > would it interact with autoscaling for instance? > > Best, > Erick > > On Wed, Jan 9, 2019 at 9:59 AM Frank Greguska wrote: > > > > Hello, > > > > I am trying to bootstrap a SolrCloud inst

Re: Bootstrapping a Collection on SolrCloud

2019-01-09 Thread Erick Erickson
above I think it'd be a lot of effort, second I virtually guarantee it'd introduce significant bugs. How would it interact with autoscaling for instance? Best, Erick On Wed, Jan 9, 2019 at 9:59 AM Frank Greguska wrote: > > Hello, > > I am trying to bootstrap a SolrCloud inst

Bootstrapping a Collection on SolrCloud

2019-01-09 Thread Frank Greguska
Hello, I am trying to bootstrap a SolrCloud installation and I ran into an issue that seems rather odd. I see it is possible to bootstrap a configuration set from an existing SOLR_HOME using ./server/scripts/cloud-scripts/zkcli.sh -zkhost ${ZK_HOST} -cmd bootstrap -solrhome ${SOLR_HOME} but

Re: SolrCloud 6.5.1 Stability/Recovery Issues

2019-01-08 Thread Shawn Heisey
On 1/8/2019 12:12 PM, Johnston, Charlie wrote: We have been using Solr 6.5.1 leveraging SolrCloud backed by ZooKeeper for a multi-client, multi-node cluster for several months now and have been having a few stability/recovery issues we’d like to confirm if they are fixed in Solr 7 or not. We

SolrCloud 6.5.1 Stability/Recovery Issues

2019-01-08 Thread Johnston, Charlie
Hi, We have been using Solr 6.5.1 leveraging SolrCloud backed by ZooKeeper for a multi-client, multi-node cluster for several months now and have been having a few stability/recovery issues we’d like to confirm if they are fixed in Solr 7 or not. We run 3 large Solr nodes in the cluster (each

RE: [solr-solrcloud] How does DIH work when there are multiple nodes?

2019-01-04 Thread Davis, Daniel (NIH/NLM) [C]
input plugin. It can do some transformation, but you'll need your database view to process the data. > -Original Message- > From: Shawn Heisey > Sent: Friday, January 4, 2019 12:25 PM > To: solr-user@lucene.apache.org > Subject: Re: [solr-solrcloud] How does DIH wor

Re: [solr-solrcloud] How does DIH work when there are multiple nodes?

2019-01-04 Thread Shawn Heisey
w which replica/core actually handles it. This means that an import command may be handled by a different host than a status command.  In that situation, the status command will not know about the import, because it will be running on a different Solr core. When doing DIH on SolrCloud, you s

RE: [solr-solrcloud] How does DIH work when there are multiple nodes?

2019-01-04 Thread 유정인
Hi The reader was looking for a way to do 'DIH' automatically. The reason was for HA configuration. Thank you for answer. If you know how, please reply. -Original Message- From: Doss Sent: Friday, January 04, 2019 3:59 PM To: solr-user@lucene.apache.org Subject: RE: [solr

RE: [solr-solrcloud] How does DIH work when there are multiple nodes?

2019-01-03 Thread Doss
Hi, The data import process will not happen automatically, we have to do it manually through the admin interface or by calling the URL https://lucene.apache.org/solr/guide/7_5/uploading-structured-data-store-data-with-the-data-import-handler.html Full Import: http://node1ip:8983/solr/yourindexn

RE: [solr-solrcloud] How does DIH work when there are multiple nodes?

2019-01-03 Thread 유정인
@lucene.apache.org Subject: Re: [solr-solrcloud] How does DIH work when there are multiple nodes? Hi, I am assuming you are having the same index replicated in all 3 nodes, then doing a full index/ delta index using DIH in one node will replicate the data to other nodes, so no need to do it in all 3 nodes

Re: [solr-solrcloud] How does DIH work when there are multiple nodes?

2019-01-03 Thread Doss
Hi, I am assuming you are having the same index replicated in all 3 nodes, then doing a full index/ delta index using DIH in one node will replicate the data to other nodes, so no need to do it in all 3 nodes. Hope this helps! Best, Doss. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-U

[solr-solrcloud] How does DIH work when there are multiple nodes?

2019-01-03 Thread 유정인
Hi solrcloud Configured on 3 nodes. DIH is used for collecting / indexing, and each node has the same DIH. The DIH is executed at a fixed interval each time. Then there is the question here. Are you running on 3 nodes simultaneously? Or is it only a leader? And how do you know the

Re: Query kills Solrcloud

2019-01-02 Thread Gus Heck
Are you able to re-index a subset into a new collection? For control of timeouts I would suggest Postman or curl, or some other non-browser client. On Wed, Jan 2, 2019 at 2:55 PM Webster Homer < webster.ho...@milliporesigma.com> wrote: > We are still having serious problems with our

RE: Query kills Solrcloud

2019-01-02 Thread Webster Homer
We are still having serious problems with our solrcloud failing due to this problem. The problem is clearly data related. How can I determine what documents are being searched? Is it possible to get Solr/lucene to output the docids being searched? I believe that this is a lucene bug, but I

Query kills Solrcloud

2018-12-20 Thread Webster Homer
We are experiencing almost nightly solr crashes due to Japanese queries. I’ve been able to determine that one of our field types seems to be a culprit. When I run a much reduced version of the query against out DEV solrcloud I see the memory usage jump from less than a gb to 5gb using only a

Re: SolrCloud servers restart

2018-12-16 Thread Erick Erickson
that's not essential either, it'd just avoid a bit of leader election overhead. Best, Erick On Sun, Dec 16, 2018 at 4:58 AM Moshe Recanati | KMS wrote: > > Hi, > > We've SolrCloud servers configuration with the following topology. > > 3 servers in which each server is

SolrCloud servers restart

2018-12-16 Thread Moshe Recanati | KMS
Hi, We've SolrCloud servers configuration with the following topology. 3 servers in which each server is zookeeper and Solr search. We would like to do maintained restart of the servers. Is there any specific guidelines on how to do the restart? Thank you Regards, Moshe Recanati CTO M

is Solr version 6.6.2 supported by SolrCloud on AWS EC2

2018-12-12 Thread abhishek_itengg
Hi, I am reviewing the ref guide for Solr 7.2 for SolrCloud on AWS EC2. href="https://lucene.apache.org/solr/guide/7_2/aws-solrcloud-tutorial.html";>solr guide 7.2 The ask is to implement solr cloud on AWS for the Sitecore 9.0 application, which only supports solr 6.6.2 Questio

Using streaming expressions with a pre-existing schema (aka migrating a standalone instance to SolrCloud)

2018-12-10 Thread Guillaume Rossolini
Hi there, This is about undocumented restrictions about using streaming expressions (in the sense that I haven't found the right documentation). ** Setup I just followed the documentation to start SolrCloud on my local machine, and I made it so it would replace the previous standalone ser

Re: SolrCloud required ports

2018-12-04 Thread Jan Høydahl
ports within the cluster: >> 8983 >> 2181 >> 2888 >> 3888 >> >> >> >> Regards, >> Moshe Recanati >> CTO >> Mobile + 972-52-6194481 >> Skype: recanati >> >> More at: www.kmslh.com | LinkedIn | FB >> >

Re: SolrCloud required ports

2018-12-03 Thread Erick Erickson
> > > Regards, > Moshe Recanati > CTO > Mobile + 972-52-6194481 > Skype: recanati > > More at: www.kmslh.com | LinkedIn | FB > > -Original Message- > From: Jan Høydahl > Sent: Monday, December 3, 2018 12:43 PM > To: solr-user > Subject: Re: SolrClo

RE: SolrCloud required ports

2018-12-03 Thread Moshe Recanati | KMS
12:43 PM To: solr-user Subject: Re: SolrCloud required ports Hi This depends on your exact coniguration, so you should ask the engineers who deployed ZK and Solr, not this list. If default solr port is used, you'd need at least 8983 open between servers and from the app server to the cl

Re: SolrCloud required ports

2018-12-03 Thread Jan Høydahl
need to be open outside the cluster. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 3. des. 2018 kl. 09:22 skrev Moshe Recanati | KMS : > > Hi, > We're currently running SolrCloud with 3 servers: 3 ZK and 3 Search Engines. > Each one on each mach

SolrCloud required ports

2018-12-03 Thread Moshe Recanati | KMS
Hi, We're currently running SolrCloud with 3 servers: 3 ZK and 3 Search Engines. Each one on each machine. Our security team would like to open only the required ports between the servers. Please let me know which ports we need to open between the servers? Thank you Regards, Moshe Recanat

Re: SolrCloud scaling/optimization for high request rate

2018-11-14 Thread Toke Eskildsen
On Mon, 2018-11-12 at 14:19 +0200, Sofiya Strochyk wrote: > I'll check if the filter queries or the main query tokenizers/filters > might have anything to do with this, but I'm afraid query > optimization can only get us so far. Why do you think that? As you tried eliminating sorting and retrieva

Re: **SPAM** Re: SolrCloud scaling/optimization for high request rate

2018-11-12 Thread Ere Maijala
From what I've gathered and what's been my experience docValues should be enabled, but if you can't think of anything else, I'd try turning them off to see if it makes any difference. As far as I can recall turning them off will increase usage of Solr's own caches and that caused noticeable slo

Re: **SPAM** Re: SolrCloud scaling/optimization for high request rate

2018-11-12 Thread Sofiya Strochyk
Thanks for the suggestion Ere. It looks like they are actually enabled; in schema file the field is only marked as stored (field name="_id" type="string" multiValued="false" indexed="true" required="true" stored="true") but the admin UI shows DocValues as enabled, so I guess this is by default.

Re: SolrCloud scaling/optimization for high request rate

2018-11-12 Thread Sofiya Strochyk
Thanks for your suggestions. I'll check if the filter queries or the main query tokenizers/filters might have anything to do with this, but I'm afraid query optimization can only get us so far. Since we will have to add facets later, the queries will only become heavier, and there has to be a w

Re: SolrCloud scaling/optimization for high request rate

2018-11-12 Thread Ere Maijala
Sofiya, Do you have docValues enabled for the id field? Apparently that can make a significant difference. I'm failing to find the relevant references right now, but just something worth checking out. Regards, Ere Sofiya Strochyk kirjoitti 6.11.2018 klo 16.38: Hi Toke, sorry for the late r

Re: SolrCloud scaling/optimization for high request rate

2018-11-08 Thread Toke Eskildsen
On Tue, 2018-11-06 at 16:38 +0200, Sofiya Strochyk wrote: > I have tested all of the suggested changes none of these seem to make > a noticeable difference (usually response time and other metrics > fluctuate over time, and the changes caused by different parameters > are smaller than the fluctuati

Re: SolrCloud Using Solrconfig.xml Instead of Configoverlay.json for RequestHandler QF

2018-11-07 Thread Jan Høydahl
Hi, What is the output of these? http://localhost:8983/solr/foo/config This should give the unified config http://localhost:8983/solr/foo/config/overlay This should give the overlay only http://localhost:8983/solr/foo/config/paramsYou may have some params defined that override

Re: SolrCloud Replication Failure

2018-11-06 Thread Erick Erickson
Erick - those sound like important questions, but I think this issue is > slightly different. In this case, replication is failing even if the leader > never goes down. > > > From: Erick Erickson > Sent: Tuesday, November 6, 2018 2:52:30 PM &g

Re: SolrCloud Replication Failure

2018-11-06 Thread Jeremy Smith
:52:30 PM To: solr-user Subject: Re: SolrCloud Replication Failure Kevin: Well, let's certainly raise it as a JIRA, blocker or not I'm not sure. I _think_ the new LIR work done in Solr 7.3 might make it possible to detect this condition but I'm not totally sure what to do about it

Re: SolrCloud Replication Failure

2018-11-06 Thread Erick Erickson
en though the version number is > > lower. > > > > > >-Jeremy > > > > > > From: Susheel Kumar > > Sent: Thursday, November 1, 2018 2:57:00 PM > > To: solr-user@lucene.apache.org > > Subject: R

Re: SolrCloud Replication Failure

2018-11-06 Thread Kevin Risden
t; From: Susheel Kumar > Sent: Thursday, November 1, 2018 2:57:00 PM > To: solr-user@lucene.apache.org > Subject: Re: SolrCloud Replication Failure > > Are we saying it has to do something with stop and restarting replica's > otherwise I haven't seen/heard any issues with

Re: SolrCloud scaling/optimization for high request rate

2018-11-06 Thread Sofiya Strochyk
Hi Toke, sorry for the late reply. The query i wrote here is edited to hide production details, but I can post additional info if this helps. I have tested all of the suggested changes none of these seem to make a noticeable difference (usually response time and other metrics fluctuate over

Issues with new replicas in solrcloud cluster being created as NRT by autoscaling and not respecting cluster policy

2018-11-05 Thread Matt Goward [Contractor]
I am working on an autoscaling kubernetes cluster for solrcloud running 7.5. I have most of this up and working, but ran into a few issues when I got to the point of testing. The core of it is that when solr replaces a replica it is doing so as NRT rather than TLOG and it is not respecting

SolrCloud Using Solrconfig.xml Instead of Configoverlay.json for RequestHandler QF

2018-11-05 Thread Corey Ellsworth
Hello, I'm using Solr Cloud 6.6. I have a situation where I have a RequestHandler configuration that exists in both the solrconfig.xml file and configoverlay.json file (We inherited this application and are not sure why it is set up like this). From reading the documentation, it seems the conf

Re: Re: SolrCloud scaling/optimization for high request rate

2018-11-05 Thread Toke Eskildsen
So far no answer from Sofiya. That's fair enough: My suggestions might have seemed random. Let me try to qualify them a bit. What we have to work with is the redacted query q=&fl=&start=0&sort=&fq=&rows=24&version=2.2&wt=json and an earlier mention that sorting was complex. My suggestions were t

Re: SolrCloud performance

2018-11-04 Thread Chuming Chen
Hi Shawn, Thank you very much for your analysis. I currently don’t have multiple machines to play with. I will try "one Solr instance and one ZK instance would be more efficient on a single server” you suggested. Thanks again, Chuming On Nov 4, 2018, at 7:56 PM, Shawn Heisey wrote: > On 1

Re: SolrCloud performance

2018-11-04 Thread Shawn Heisey
On 11/4/2018 8:38 AM, Chuming Chen wrote: I have shared a tar ball with you (apa...@elyograg.org) from google drive. The tar ball includes logs directories of 4 nodes, solrconfig.xml, solr.in.sh, and screenshot of TOP command. The log files is about 1 day’s log. However, I restarted the solr c

Re: SolrCloud performance

2018-11-04 Thread Chuming Chen
Hi Shawn, I have shared a tar ball with you (apa...@elyograg.org) from google drive. The tar ball includes logs directories of 4 nodes, solrconfig.xml, solr.in.sh, and screenshot of TOP command. The log files is about 1 day’s log. However, I restarted the solr cloud several times during that pe

Re: SolrCloud performance

2018-11-02 Thread Deepak Goel
Please see inline for my thoughts Deepak "The greatness of a nation can be judged by the way its animals are treated. Please consider stopping the cruelty by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedIn: www.linkedin.com/in/deicool "Pl

Re: SolrCloud performance

2018-11-02 Thread Shawn Heisey
On 11/2/2018 1:38 PM, Chuming Chen wrote: I am running a Solr cloud 7.4 with 4 shards and 4 nodes (JVM "-Xms20g -Xmx40g”), each shard has 32 million documents and 32Gbytes in size. A 40GB heap is probably completely unnecessary for an index of that size.  Does each machine have one replica on

SolrCloud performance

2018-11-02 Thread Chuming Chen
Hi All, I am running a Solr cloud 7.4 with 4 shards and 4 nodes (JVM "-Xms20g -Xmx40g”), each shard has 32 million documents and 32Gbytes in size. For a given query (I use complexphrase query), typically, the first time it took a couple of seconds to return the first 20 docs. However, for the

Re: SolrCloud Replication Failure

2018-11-02 Thread Jeremy Smith
solr-user@lucene.apache.org Subject: Re: SolrCloud Replication Failure Are we saying it has to do something with stop and restarting replica's otherwise I haven't seen/heard any issues with document updates and forwarding to replica's... Thanks, Susheel On Thu, Nov 1, 2018 at 12:58 PM Erick Eri

Re: SolrCloud Replication Failure

2018-11-01 Thread Susheel Kumar
t; > https://github.com/risdenk/test-solr-start-stop-replica-consistency > > >> > > > >> > I don't even see the first update getting applied from num 10 -> 20. > > >> After > > >> > the first update there is no more change. > >

Re: SolrCloud Replication Failure

2018-11-01 Thread Erick Erickson
> the first update there is no more change. > >> > > >> > Kevin Risden > >> > > >> > > >> > On Wed, Oct 31, 2018 at 8:26 PM Jeremy Smith > >> wrote: > >> > > >> > > Thanks Erick, this is 7.5.0. > >&

Re: SolrCloud Replication Failure

2018-11-01 Thread Kevin Risden
rst update there is no more change. >> > >> > Kevin Risden >> > >> > >> > On Wed, Oct 31, 2018 at 8:26 PM Jeremy Smith >> wrote: >> > >> > > Thanks Erick, this is 7.5.0. >> > > >&

Re: SolrCloud Replication Failure

2018-11-01 Thread Kevin Risden
even see the first update getting applied from num 10 -> 20. > After > > the first update there is no more change. > > > > Kevin Risden > > > > > > On Wed, Oct 31, 2018 at 8:26 PM Jeremy Smith > wrote: > > > > > Thanks Erick, this is 7.5.0. >

Re: SolrCloud Replication Failure

2018-11-01 Thread Erick Erickson
___ > > From: Erick Erickson > > Sent: Wednesday, October 31, 2018 8:20:18 PM > > To: solr-user > > Subject: Re: SolrCloud Replication Failure > > > > What version of solr? This code was pretty much rewriten in 7.3 IIRC > &g

Re: SolrCloud Replication Failure

2018-11-01 Thread Kevin Risden
oing on. >> >> >> From: >> Kevin Risden >> >> Sent: Wednesday, October 31, 2018 10:24:24 PM >> To: solr-user@lucene.apache.org >> Subject: Re: SolrCloud Replication Failure >> >> I haven't dug into why this

<    1   2   3   4   5   6   7   8   9   10   >