Re: disable auto-commit

2018-12-12 Thread Danilo Tomasoni
Hello I tried setting both autocommit and autosoftcommit to -1, but i still see the documents just seconds after indexing it. These are the actual configurations in /conf/solrconfig.xml ${solr.autoCommit.maxTime:999}   false             ${solr.autoSoftCommit.maxTime:999}    

Increasing Fault Tolerance of SOLR Cloud and Zookeeper

2018-12-12 Thread Stephen Lewis Bianamara
Hello SOLR Community! I have a SOLR cluster which recently hit this error (full error below). ""Cannot talk to ZooKeeper - Updates are disabled."" I'm running solr 6.6.2 and zookeeper 3.4.6. The first time this happened, we replaced a node within our cluster. The second time, we followed the

Not able to perform case insensitive sorting with SortableTextField

2018-12-12 Thread Ritesh Kumar
Hello Team, I am facing a problem with sorting on a field with type as mentioned below The field may contain numerical as well as alphabetical values. My Solr version is 7.5.0. If I sort by "fieldName desc", this field sorts lowercase values

is Solr version 6.6.2 supported by SolrCloud on AWS EC2

2018-12-12 Thread abhishek_itengg
Hi, I am reviewing the ref guide for Solr 7.2 for SolrCloud on AWS EC2. href="https://lucene.apache.org/solr/guide/7_2/aws-solrcloud-tutorial.html;>solr guide 7.2 The ask is to implement solr cloud on AWS for the Sitecore 9.0 application, which only supports solr 6.6.2 Questions:- (I) Does

Re: Solr recovery issue in 7.5

2018-12-12 Thread shamik
Erick, Thanks for your input. All our fields (for facet, group & sort) have docvalues enabled since 6.5. That includes the id field. Here's the field cache entry: CACHE.core.fieldCache.entries_count:0 CACHE.core.fieldCache.total_size: 0 bytes Based on whatever I've seen so far,

Re: Solr recovery issue in 7.5

2018-12-12 Thread Erick Erickson
Whenever I see "memory consumption changed", my first question is are any fields that sort, group or facet set with docValues="false"? I consider this unlikely since one of the changes recently was to default to "true" for primitive types, but it's worth checking. The easiest way to check (and

Solr recovery issue in 7.5

2018-12-12 Thread Shamik Bandopadhyay
Hi, We recently upgraded Solr from 6.5 to 7.5. We are observing some weird issues in terms of recovery and memory usage. We've a cluster of 6 physical nodes with 2 shards having two replica each. 7.5 seemed to have a higher memory consumption where the average heap utilization hovers around 18

Re: Infrastructure required for SOLR 7.5

2018-12-12 Thread Toke Eskildsen
Priya Krishnasamy wrote: > Can anyone help me with the infrastructure needed for SOLR 7.5 ? Your question is very vague. The basic requirement is just Java 8 https://lucene.apache.org/solr/7_5_0//SYSTEM_REQUIREMENTS.html The reference guide has some details on setup

Re: Keyword field with tabs in Solr 7.4

2018-12-12 Thread Erick Erickson
Good to hear. Actually, though, this is a little bit of an XY problem. I think a better solution would be to use PatternReplaceCharFilterFactory on the field to replace all sequences of whitespace characters with a single space at both query and index time. That charfilter replaces whatever you

Re: disable auto-commit

2018-12-12 Thread Erick Erickson
The answer to your question is to set the interval to -1. however, for that's a really bad idea. Why do you think this will help with OOM errors? _Querying_ usually is the place OOMs are generated, especially if you do things like facet on very high-cardinality fields and/or do _not_ have

Help CJK OOM Errors

2018-12-12 Thread Webster Homer
Recently we had a few Japanese queries that killed our production Solrcloud instance. Our schemas support multiple languages, with language specific search fields. This query and similar ones caused OOM errors in Solr: モノクローナル抗ニコチン性アセチルコリンレセプター(??7サブユニット)抗体 マウス宿主抗体 The query doesn’t match

Re: Open file limit warning when starting solr

2018-12-12 Thread Daniel Carrasco
Hello, Strange... Solr user is created during the installation... What user is your Solr running? > cat /etc/init.d/solr |grep -i "RUNAS=" > Have you followed all the info in the link I've sent?, because they talk also about this: You also need to edit /etc/pam.d/common-session* and add the

RE: Open file limit warning when starting solr

2018-12-12 Thread Armon, Rony
Probably not solr: rony@rony-VirtualBox:~$ sudo su - root@rony-VirtualBox:~# su solr - No passwd entry for user 'solr' I tried the solution he suggested placing the following in limits.conf root soft nofile 65000 root hard nofile 65000 And then with the asterix: * soft nofile 65000 * hard

Re: Open file limit warning when starting solr

2018-12-12 Thread Daniel Carrasco
Hello, I mean change to solr user using su as sudo. For your system will be something like: $ sudo su - pasword # su solr - $ ulimit -n ...a file limit number... Your file limit in Ubuntu is fine, so looks like a problem with file limit for that user, that's why I ask you if the user you've

RE: Open file limit warning when starting solr

2018-12-12 Thread Armon, Rony
Tried it as well... rony@rony-VirtualBox:~$ sudo su - [sudo] password for rony: root@rony-VirtualBox:~# sysctl -a|grep -i fs.file-max fs.file-max = 810202 -Original Message- From: Daniel Carrasco [mailto:d.carra...@i2tic.com] Sent: Wednesday, December 12, 2018 4:04 PM To:

Infrastructure required for SOLR 7.5

2018-12-12 Thread Priya Krishnasamy
Hi Team, I'm a new SOLR user. Can anyone help me with the infrastructure needed for SOLR 7.5 ? Kind Regards, Priya Krishnasamy Principal Consultant E priya.krishnas...@aveva.com 2nd Floor, Salarpuria Touchstone, Marathalli Outer Ring Road, Bengaluru -

Re: Metrics

2018-12-12 Thread Jean-Marc Spaggiari
Hi Erick, (Late) thanks for the clarification on that. JMS Le lun. 24 sept. 2018 à 19:06, Erick Erickson a écrit : > The other caches (filterCache, queryResultCache) only have meaning for > the current searcher opened. Whenever a soft or > hard-commit-with-opensearcher-true, those caches are

Re: Open file limit warning when starting solr

2018-12-12 Thread Daniel Carrasco
Hello, The *su solr* command is important, because you change to Solr user before check the limits again, then it shows its limits. Are you running the daemon as solr user? Other command to check is: > # sysctl -a|grep -i fs.file-max > fs.file-max = 6167826 If is low then you may increase it.

RE: Open file limit warning when starting solr

2018-12-12 Thread Armon, Rony
rony@rony-VirtualBox:~$ ulimit -n 1024 rony@rony-VirtualBox:~/solr-7.5.0$ ulimit -n 1024 -Original Message- From: Daniel Carrasco [mailto:d.carra...@i2tic.com] Sent: Wednesday, December 12, 2018 3:31 PM To: solr-user@lucene.apache.org Subject: Re: Open file limit warning when starting

Re: Open file limit warning when starting solr

2018-12-12 Thread Daniel Carrasco
Hello, What output you get with this commands?: > root@solr-temp01:/# ulimit -n > 1024 > root@solr-temp01:/# su solr > solr@solr-temp01:/$ ulimit -n > 65000 Greetings! El mié., 12 dic. 2018 a las 12:53, Armon, Rony () escribió: > Hi Daniel and thanks for the prompt reply. I tried that but

Re: disable auto-commit

2018-12-12 Thread Danilo Tomasoni
I want to disable even that. I saw here https://lucene.apache.org/solr/guide/6_6/updatehandlers-in-solrconfig.html that probably to achieve what I want I just need to comment out the autoCommit tag.. correct? What do you think about disabling autocommit/autosoftcommit? it can lower the

Re: disable auto-commit

2018-12-12 Thread Mikhail Khludnev
What about autoSoftCommit ? On Wed, Dec 12, 2018 at 3:24 PM Danilo Tomasoni wrote: > Hello, I'm experiencing oom while indexing a big amount of documents. > > The main idea to avoid OOM is to avoid commit (just one big commit at > the end). > > Is this a correct idea? > > How can I disable

disable auto-commit

2018-12-12 Thread Danilo Tomasoni
Hello, I'm experiencing oom while indexing a big amount of documents. The main idea to avoid OOM is to avoid commit (just one big commit at the end). Is this a correct idea? How can I disable autocommit? I've set   ${solr.autoCommit.maxTime:-1}   false     in solrconfig.xml but

RE: Open file limit warning when starting solr

2018-12-12 Thread Armon, Rony
Hi Daniel and thanks for the prompt reply. I tried that but I'm still getting the file limit warning. -Original Message- From: Daniel Carrasco [mailto:d.carra...@i2tic.com] Sent: Wednesday, December 12, 2018 12:14 PM To: solr-user@lucene.apache.org Subject: Re: Open file limit warning

Re: Open file limit warning when starting solr

2018-12-12 Thread Daniel Carrasco
Hello, Try creating a file in /etc/security/limits.d/solr.conf with this: solr softnofile 65000 solr hardnofile 65000 solr softnproc 65000 solr hardnproc 65000 This worked for me on Debian 9.

Open file limit warning when starting solr

2018-12-12 Thread Armon, Rony
Hello, When launching solr (Ubuntu 16.04) I'm getting: * [WARN] *** Your open file limit is currently 1024. It should be set to 65000 to avoid operational disruption. If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your

AW: Keyword field with tabs in Solr 7.4

2018-12-12 Thread Michael Aleythe, Sternwald
Hey Erik, thanks a lot for your suggestion. It lead me on the rigth path. What actually did the trick was, sending the tab as unicode: IPTC_2_080_KY:"\u0009bus\u0009bahn" matched perfectly. Best, Michael -Ursprüngliche Nachricht- Von: Erick Erickson Gesendet: Dienstag, 11. Dezember