Re: Solr crashing / slowing down the performance

2017-07-03 Thread Walter Underwood
With 8GB of RAM and 5.5 GB of Java memory, there is zero room for caching indexes. The OS will eat a gigabyte or so, then there are other processes running. So either the index accesses are pounding on the disk or the Java heap is getting swapped out. This machine is too small. The smallest

Re: Allow Join over two sharded collection

2017-07-03 Thread mganeshs
Hi Susheel, To make use of Joins only option is I should go for manual routing. If I go for manual routing based on time, we miss the power of distributing the load while indexing. It will end up with all indexing happens in newly created shard, which we feel this will not be efficient approach

Re: Solr 5.2+ using SSL and non-SSL ports

2017-07-03 Thread Shalin Shekhar Mangar
No, Solr cannot use both SSL and non-SSL at the same time. You must choose one. On Mon, Jul 3, 2017 at 10:29 PM, sputul wrote: > I have SSL enabled in Solr 5 but Zookeeper needs to be started with proper > url scheme. Does this imply Solr Cloud cannot use SSL and non-SSL at

Re: Solr dynamic "on the fly fields"

2017-07-03 Thread Erick Erickson
I don't know how one would do this. But I would ask what the use-case is. Creating such fields at index time just seems like it would be inviting abuse by creating a zillion fields as you have no control over what gets created. I'm assuming your tenants don't talk to each other Have you

Re: Solr crashing / slowing down the performance

2017-07-03 Thread Erick Erickson
The physical memory is something of a red herring, see: http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html The JVM being near the limit is cause for concern. At a glance you are simply running too close to the edge of your JVM. One thing I've seen when running this close is

Solr Prod Issue | KeeperErrorCode = ConnectionLoss for /overseer_elect/leader

2017-07-03 Thread Bhalla, Rahat
Hi Solr Users, I hope this email finds you all in the best of spirits and in a mood where you'd be willing to help a young developer (me :) ) with issues that I'm facing in regards with the Solr Cloud. At my organization, we are running a Solr Cloud with 5 Nodes for Solr Instances with 13

Re: Work-around for "indexed without position data"

2017-07-03 Thread Solr User
Not sure if it helps beyond the steps to reproduce that I supplied above, but I also see that "Omit Term Frequencies & Positions" is still set on the field according to the LukeRequestHandler: ITS--OF-- On Mon, Jun 5, 2017 at 1:18 PM, Solr User wrote: > Sorry for

Re: Solr crashing / slowing down the performance

2017-07-03 Thread Venkateswarlu Bommineni
Hi Eric, Thanks for reply. Please find the image in below url . https://drive.google.com/open?id=0B9BkzwYA2P-VelJIRXhybFhpLUk As per me the physical memory and JVM heap is not proportionate , Please correct me if i am wrong. and in solr logs i am not getting any OOM errors as such. I have

Re: Solr dynamic "on the fly fields"

2017-07-03 Thread Pablo Anzorena
Thanks Erick, For my use case it's not possible any of those solutions. I have a multitenancy scheme in the most basic level, that is I have a single collection with fields (clientId, field1, field2, ..., field50) attending many clients. Clients can create custom fields based on arithmetic

Re: Solr dynamic "on the fly fields"

2017-07-03 Thread Erick Erickson
There are two ways: 1> define a dynamic field pattern, i.e. Now just add any field in the doc you want. If it ends in "_sum" and no other explicit field matches you have a new field. 2> Use the managed schema to add these on the fly. I don't recommend this from what I know of your use case,

Solr dynamic "on the fly fields"

2017-07-03 Thread Pablo Anzorena
Hey, I was wondering if there is some way to add fields "on the fly" based on arithmetic operations on other fields. For example add a new field "custom_field" = log(field1) + field2 -5. Thanks.

Re: Solr crashing / slowing down the performance

2017-07-03 Thread Erick Erickson
Images don't come through, you'll have to put it somewhere and post a link. Have you seen Shawn's page? https://wiki.apache.org/solr/ShawnHeisey And what does your Solr log say happens? OOM? Other? Could you throttle your indexing client to spare some CPU cycles for querying? Best, Erick On

Re: Using ASCIIFoldingFilterFactory

2017-07-03 Thread Erick Erickson
The best thing to do is go to the admin/analysis page and see if you get exactly what you expect. You'll see the transformations that each step in your chain do. I mean your usage looks OK, but al that says is the syntax looks find. Only you can see if the actual chain you've defined does what

Using ASCIIFoldingFilterFactory

2017-07-03 Thread SOLR4189
Hey all, I need to convert alphabetic, numeric and symbollic unicode characters to their ASCII equivalents. The solr.ASCIIFoldingFilterFactory is the solution for my request. I'm wondering if my usage of the filter is correct and if anyone encountered any problems using the specified filter (I'm

Re: Solr 5.2+ using SSL and non-SSL ports

2017-07-03 Thread sputul
I have SSL enabled in Solr 5 but Zookeeper needs to be started with proper url scheme. Does this imply Solr Cloud cannot use SSL and non-SSL at the same time as Zookeeper itself need separate ports? Thanks. -- View this message in context:

Replication - Unable to download tlog

2017-07-03 Thread Rénald Koch
When I activate the replication of a shard via the web interface, the data will replicate well on the new shard, but once all the data has been copied, the data will be erased and the synchronization will start again indefinitely. When I look in the logs, I have this error: 2017-06-29

Solr crashing / slowing down the performance

2017-07-03 Thread Venkateswarlu Bommineni
Hi Team, Background: We have a Solr 6.2 having multiple cores ( Six cores ) in it , We have other system (CMS) that will push the data to Solr. Issue: When ever we are doing full index from other system (installed in different box) , some times Solr JVM is crashing.sometimes even don't crash

RE: Solr 6.4. Can't index MS Visio vsdx files

2017-07-03 Thread Allison, Timothy B.
Sorry. Y, you'll have to update commons-compress to 1.14. -Original Message- From: Gytis Mikuciunas [mailto:gyt...@gmail.com] Sent: Monday, July 3, 2017 9:15 AM To: solr-user@lucene.apache.org Subject: Re: Solr 6.4. Can't index MS Visio vsdx files hi, So I'm back from my long

Re: Automatically Restart Solr

2017-07-03 Thread Susheel Kumar
Got it but unless you know what caused OOM you can run into this again. Restart may not help really. You should try to find out from gc logs if it was sudden increase which caused OOM (some culprit query or heavy ingestion) or it was over the period of time (due to cache util..). Based on that

Re: Solr 6.4. Can't index MS Visio vsdx files

2017-07-03 Thread Gytis Mikuciunas
hi, So I'm back from my long vacations :) I'm trying to bring-up a fresh solr 6.6 standalone instance on windows 2012R2 server. Replaced: poi-*3.15-beta1 ---> poi-*3.16 tika-*1.13 ---> tika-*1.15 Tried to index one txt file and got (with poi and tika files that come out of the box, it

Re: Automatically Restart Solr

2017-07-03 Thread rojerick luna
Thanks Furkan. Hi Susheel - our Solr was running so long until we experienced Solr went system out of memory. we already increased the virtual memory and so far so good. we just want an automated restart to refresh Solr, just another proactive initiative. Best Regards, Jeck > On 3 Jul 2017,

Re: Same score for different length matches

2017-07-03 Thread alessandro.benedetti
In addition to what Chris has correctly suggested, I would like to focus on this sentence : " I am decently certain that at one point in time it worked in a way that a higher match length would rank higher" You mean a match in a longer field would rank higher than a match in a shorter field ?

Re: Automatically Restart Solr

2017-07-03 Thread Susheel Kumar
I am curios why you need to restart solr every week. Our Prod solr instance (6.0) has been running Since Nov,16 with no restart On Sun, Jul 2, 2017 at 12:55 PM, Furkan KAMACI wrote: > Hi Jeck, > > Here is the documentation about how you can run Solr as service: >

Re: Solr 6.5.1 crashing when too many queries with error or high memory usage are queried

2017-07-03 Thread Toke Eskildsen
On Sun, 2017-07-02 at 15:00 +0800, Zheng Lin Edwin Yeo wrote: > I'm currently facing the issue whereby the Solr crashed when I have > issued too many queries with error or those with high memory usage, > like JSON facet or Streaming expressions. > > What could be the issue here? Solr does not