RE: 7.2.1 cluster dies within minutes after restart

2018-02-02 Thread Markus Jelsma
Hello S.G, see inline. Thanks, Markus -Original message- > From:S G > Sent: Thursday 1st February 2018 17:42 > To: solr-user@lucene.apache.org > Subject: Re: 7.2.1 cluster dies within minutes after restart > > ok, good to know that 7.x shows good performance

RE: 7.2.1 cluster dies within minutes after restart

2018-02-02 Thread Markus Jelsma
Hello Ere, It appears that my initial e-mail [1] got lost in the thread. We don't have GC issues, the cluster that dies occasionally runs, in general, smooth and quick with just 2 GB allocated. Thanks, Markus [1]:

Re: External file fields

2018-02-02 Thread Emir Arnautović
Hi Brian, You should be able to sort on field with only sorted values. Regards, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > On 2 Feb 2018, at 16:53, Brian Yee wrote: > > Hello

Re: Wiki contributor

2018-02-02 Thread Erick Erickson
Done. On Fri, Feb 2, 2018 at 4:08 AM, David Backstein wrote: > Hi there, > > It would be great, if you could add me to the Wiki contributors group. > > My username is: dbackstein > > Thank you very much! > > Best regards, > D > > -- > David Backstein > CEO > >

Re:skip slow tests?

2018-02-02 Thread Diego Ceccarelli (BLOOMBERG/ LONDON)
ant -Dtests.slow=false From: solr-user@lucene.apache.org At: 02/02/18 17:07:14To: solr-user@lucene.apache.org Subject: skip slow tests? Hi *, Some (slow) tests in Solr are annotated with @Slow. Is there a way to run ant test skipping them? thanks, Diego

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Erick Erickson
>From the reference guide: Field names should consist of alphanumeric or underscore characters only and not start with a digit. This is not currently strictly enforced, but other field names will not have first class support from all components and back compatibility is not guaranteed. Best,

9000+ CLOSE_WAIT connections in solr v6.2.2 causing it to "die"

2018-02-02 Thread mmb1234
Hello, In our solr non-cloud env., we are seeing lots of CLOSE_WAIT, causing jvm to stop "working" with 3 mins of solr start. solr [ /opt/solr ]$ netstat -anp | grep 8983 | grep CLOSE_WAIT | grep 10.xxx.xxx.xxx | wc -l 9453 Only option is then`kill -9` because even `jcmd Thread.print` is

RE: External file fields

2018-02-02 Thread Chris Hostetter
: I did look into updatable docValues, but my understanding is that the : field has to be non-indexed (indexed="false"). I need to be able to sort : on these values. External field fields are sortable. YOu can absolutely sort on a field that is docValues="true" indexed="false" ... that is

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Wendy2
Hi Erick, Thank you very much for the clarification. I will keep it in my mind since we are now in the process of migrating MySQL database to mongoDB. Best Regards, Wendy a happy Solr user -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

RE: External file fields

2018-02-02 Thread Brian Yee
Hello Erick, I did look into updatable docValues, but my understanding is that the field has to be non-indexed (indexed="false"). I need to be able to sort on these values. External field fields are sortable.

SolrCloudClient multi-threading

2018-02-02 Thread Steve Pruitt
The 7.2.1 SolrCloudClientBuilder has the method withParallelUpdates(Boolean). It's my understanding the SolrCloudClient does not manage multiple threads like the ConcurrentUpdateSolrClient. Curious what the withParallelUpdates setting on SolrCloudClientBuilder does. It hints at multi-threaded

skip slow tests?

2018-02-02 Thread Diego Ceccarelli (BLOOMBERG/ LONDON)
Hi *, Some (slow) tests in Solr are annotated with @Slow. Is there a way to run ant test skipping them? thanks, Diego

Re: 7.2.1 cluster dies within minutes after restart

2018-02-02 Thread S G
Yeah, definitely check the zookeeper version. 3.4.6 is not a good one I know and you can say the same for all the versions below it too. We have used 3.4.9 with no issues. While Solr 7.x uses 3.4.10 Another dimension could be the use or (dis-use) of p-fields like pint, plong etc. If you are using

Edismax, stopword query and non-existent fields

2018-02-02 Thread Craig Smiles
I've recently had a requirement request from the user to allow a query when searching for stopwords alone. I discovered that edismax will already do this for me, all I had to do was remove our StopFilterFactory on the index analyzer so that the stopwords actually exist in our index. So suppose I

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Wendy2
Good morning, Emir, Thanks for letting me know that. I used dots to add tableName. as a field prefix because several columns from different tables have the same names. In your opinion, what will be the best way to replace dots? Happy Friday! Wendy -- Sent from:

Re: SolrCloudClient multi-threading

2018-02-02 Thread Joel Bernstein
CloudSolrClient determines which shard each document is going to in advance. It then separates the documents based on the route and uses a thread for each group to send the documents. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Feb 2, 2018 at 11:09 AM, Steve Pruitt

RE: 7.2.1 cluster dies within minutes after restart

2018-02-02 Thread Markus Jelsma
Hello S.G. We have relied in Trie* fields every since they became available, i don't think reverting to the old fieldType's will do us any good, we have a very recent problem. Regarding our heap, the cluster ran fine for years with just 1.5 GB, we only recently increased it because or data

Re: 7.2.1 cluster dies within minutes after restart

2018-02-02 Thread Walter Underwood
Zookeeper 3.4.6 is not good? That was the version recommended by Solr docs when I installed 6.2.0. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Feb 2, 2018, at 9:30 AM, Markus Jelsma wrote: > > Hello S.G. > > We

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Erick Erickson
>From the ref guide: "Field names should consist of alphanumeric or underscore characters only and not start with a digit. This is not currently strictly enforced, but other field names will not have first class support from all components and back compatibility is not guaranteed." You need to

Wiki contributor

2018-02-02 Thread David Backstein
Hi there, It would be great, if you could add me to the Wiki contributors group. My username is: dbackstein Thank you very much! Best regards, D -- David Backstein CEO https://pixolution.org Phone: +49(0)30/60984960 | Fax: +49(0)30/60984962 gpg-key: BEB26BF5 Read us :

RE: External file fields

2018-02-02 Thread Chris Hostetter
: Interesting. I will definitely explore this. Just so I'm clear, we can : sort on docValues, but not filter? Is there any situation where external : file fields would work better than docValues? For most field types that support docValues, you can still filter on it even if it's

Re: 7.2.1 cluster dies within minutes after restart

2018-02-02 Thread S G
Our 3.4.6 ZK nodes were unable to join the cluster unless their quorum got broken. So if there was 5 node zookeeper and it lost 2 nodes, they would not rejoin because ZK still had its quorum. To make them join, you had to break the quorum by restarting a node in quorum. Only when quorum broke, did

RE: External file fields

2018-02-02 Thread Brian Yee
Interesting. I will definitely explore this. Just so I'm clear, we can sort on docValues, but not filter? Is there any situation where external file fields would work better than docValues? -Original Message- From: Chris Hostetter [mailto:hossman_luc...@fucit.org] Sent: Friday,

Re: 7.2.1 cluster dies within minutes after restart

2018-02-02 Thread Tomas Fernandez Lobbe
Hi Markus, If the same code that runs OK in 7.1 breaks 7.2.1, it is clear to me that there is some bug in Solr introduced between those releases (maybe an increase in memory utilization? or maybe some decrease in query throughput making threads to pile up?). I’d hate to have this issue lost in

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Wendy2
Hi Erick, Yes. Currently I re-index the database on a weekly basis because we only have weekly release. As part of the Solr weekly re-index, the batch job will delete the /solr/core/data folder, restart Solr server, then re-index. We use Luigi to build/control pipelines of Solr re-index batch

The Expected Suggestions Is Phrase Instead Of Whole Contents From Field

2018-02-02 Thread stiven.z...@swisoft.cn
Hi Dear Solr, I config the Solr to try to get search suggestion but seem not the suggestion that I want. the follow search component and request handler: mySuggester FuzzyLookupFactory DocumentDictionaryFactory title// the contents is from "title" string

Re: Query fields with data of certain length

2018-02-02 Thread Chris Hostetter
: Have you manage to get the regex for this string in Chinese: 预支款管理及账务处理办法 ? ... : > An example of the string in Chinese is 预支款管理及账务处理办法 : > : > The number of characters is 12, but the expected length should be 36. ... : >> > So this would likely be different from what the

Expected response from master when replication is disabled?

2018-02-02 Thread Elizabeth Haubert
What is the intended use case and behavior of disablereplication? My expectation was that it would be to cause the master to not respond to slave requests. Working with a master/slave Solr 7.1 setup; slave is set up to poll every 60s. I would prefer to remain on M/S for immediate future, while

Re: 9000+ CLOSE_WAIT connections in solr v6.2.2 causing it to "die"

2018-02-02 Thread Shawn Heisey
On 2/2/2018 10:00 AM, mmb1234 wrote: In our solr non-cloud env., we are seeing lots of CLOSE_WAIT, causing jvm to stop "working" with 3 mins of solr start. solr [ /opt/solr ]$ netstat -anp | grep 8983 | grep CLOSE_WAIT | grep 10.xxx.xxx.xxx | wc -l 9453 Solr isn't handling network services. 

Re: 9000+ CLOSE_WAIT connections in solr v6.2.2 causing it to "die"

2018-02-02 Thread mmb1234
> You said that you're running Solr 6.2.2, but there is no 6.2.2 version. > but the JVM argument list includes "-Xmx512m" which is a 512MB heap My typos. They're 6.6.2 and -Xmx30g respectively. > many open connections causes is a large number of open file handles, solr [ /opt/solr/server/logs

Re: facet.method=uif not working in solr cloud?

2018-02-02 Thread Wei
I tried to debug a bit and see that when executing on a cloud solr server, although I put facet.field=color=*:*=uif=1 in the request url, at the point it reaches SimpleFacet inside req.params it somehow has been rewritten to f.color.facet.mincount=0, no wonder the method chosen become FC. So one

Re: 9000+ CLOSE_WAIT connections in solr v6.2.2 causing it to "die"

2018-02-02 Thread Arcadius Ahouansou
I have seen a lot of CLOSE_WAIT in the past. In many cases, it was that the client application was not releasing/closing or pooling connections properly. I would suggest you double check the client code first. Arcadius. On 2 February 2018 at 23:52, mmb1234 wrote: > > You said

Re: Searching for an efficient and scalable way to filter query results using non-indexed and dynamic range values

2018-02-02 Thread Alessandro Benedetti
1) Diego's observation about IDF is absolutely correct here, but I don't think he was pointing it to be a negative aspect of your new approach. I think he just wanted to warn you about this. The way BM25 uses the IDF feature of a term is to estimate how important is the term in the context (

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Emir Arnautović
Hi Wendy, A bit off-topic, but forgot to mention in previous mail: dots in field names are not recommended. Even it obviously works for you, I think I’ve seen people reporting some issues caused by dot in field names (I cannot find some reference now). So, if you plan some system upgrade in the

Re: External file fields

2018-02-02 Thread Charlie Hull
On 01/02/2018 18:55, Brian Yee wrote: Hello, I want to use external file field to store frequently changing inventory and price data. I got a proof of concept working with a mock text file and this will suit my needs. What is the best way to keep this file updated in a fast way. Ideally I

Re: External file fields

2018-02-02 Thread Emir Arnautović
Maybe you can try or extend Sematext’s Redis parser: https://github.com/sematext/solr-redis . Downside of this approach is another moving part - Redis. HTH, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch