Re: query logging using query rest api

Hi Matteo, there is a problem in your curl test: as far as I know you cannot use GET HTTP method ( -XGET ) and pass parameters in POST (-d). Try to remove the -XGET parameter. On Thu, Apr 28, 2016 at 11:18 AM, Matteo Grolla wrote: > Hi, > I'm experimenting the

solr sql & streaming

Hi, I installed solr 6 and try to run /sql and /stream request follow to this wiki https://cwiki.apache.org/confluence/display/solr/Parallel+SQL+Interface I saw in changes list that it doesn't need request handler configuration, but when I try to acces I get the following message: Error 404

Set router.field in unit tests

Hi - i'm working on a unit test that requires the cluster's router.field to be set to a field different than ID. But i can't find it?! How can i set router.field with AbstractFullDistribZkTestBase? Thanks! Markus

query logging using query rest api

Hi, I'm experimenting the query rest api with solr 5.4 and I'm noticing that query parameters are not logged in solr.log. Here are query and log line curl -XGET 'localhost:8983/solr/test/query' -d '{"query":"*:*"}' 2016-04-28 09:16:54.008 INFO (qtp668849042-17) [ x:test] o.a.s.c.S.Request

Solr 5.2.1 on Java 8 GC

Hello, We recently upgraded to Solr 5.2.1 with jre1.8.0_74 and are seeing long GC pauses when running jobs that do some hairy faceting. The same jobs worked fine with our previous 4.6 Solr. The JVM is configured with 32GB heap with default GC settings, however I've been tweaking the GC settings

Re: Solr 5.2.1 on Java 8 GC

On Thu, Apr 28, 2016 at 11:29 AM, Nick Vasilyev wrote: > Hello, > > We recently upgraded to Solr 5.2.1 with jre1.8.0_74 and are seeing long GC > pauses when running jobs that do some hairy faceting. The same jobs worked > fine with our previous 4.6 Solr. What does a

Re: Decide on facets from results

On the same lines as Erik suggested but using facet stats instead. you can get stats on your facet fields in the first pass and then include the facets that you need in the second pass. > On Apr 27, 2016, at 1:21 PM, Mark Robinson wrote: > > Thanks Eric! > So that

Re: solr sql & streaming

Hi Shani, Are you running in SolrCloud mode? Here is blog post you can follow: https://sematext.com/blog/2016/04/18/solr-6-solrcloud-sql-support/ Thanks, Emir -- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr & Elasticsearch Support * http://sematext.com/ On

Idle timeout expired: 50000/50000 ms

Hi, I operate several collections (about 7-8) all using the same 5-node ZooKeeper cluster. They've been in production for 3 months, with only 2 previous issues where a Solr node went down. Tonight, during several updates to the various collections, a handful failed due to the below error.

Missed update on replica

I have a three node, one shard SolrCloud cluster. Last week one of the nodes went out of sync with the other two and I'm trying to understand why that happened. After poking through my logs and the solr code here's what I've pieced together: 1. Leader gets an update request for a batch delete

Re: Solr 5.2.1 on Java 8 GC

Hi Yonik, There are a lot of logistics involved with re-indexing and naturally upgrading Solr. I was hoping that there is an easier alternative since this is only a single back end script that is having problems. Is there any room for improvement with tweaking GC params? On Thu, Apr 28, 2016 at

deactivate coord scoring factor in pf2 pf3

Hello all, I am using Solr 4.10.1. I use edismax, with pf2 to boost documents starting with. I use a start with token (b) automatically added at index time, and added in request at query time. I have a problem at this point. request is *q=b saint denis rer* the start with field is

Re: Solr 5.2.1 on Java 8 GC

Hi Yonik, I forgot to mention that the index is approximately 50 million docs split across 4 shards (replication factor 2) on 2 solr replicas. This particular script will filter items based on a category (10-~1,000,000 items in each) and run facets on top X terms for particular fields. Query

Re: Solr 5.2.1 on Java 8 GC

mmfr_exact is a string field. key_phrases is a multivalued string field. On Thu, Apr 28, 2016 at 11:47 AM, Yonik Seeley wrote: > What about the field types though... are they single valued or multi > valued, string, text, numeric? > > -Yonik > > > On Thu, Apr 28, 2016 at

Re: integrate solr 5.3 with casebox

I'd suggest you talk to the casebox folks. BlockJoinFacetComponent is part of the core Solr jar, you'll find a jar named something like solr-core-X.X.X.jar in your distro (or the one provided by casebox). If that jar isn't accessible by Solr, nothing whatsoever would run. So my guess is that you

Re: Solr 5.2.1 on Java 8 GC

On Thu, Apr 28, 2016 at 12:21 PM, Nick Vasilyev wrote: > Hi Yonik, > > There are a lot of logistics involved with re-indexing and naturally > upgrading Solr. I was hoping that there is an easier alternative since this > is only a single back end script that is having

Re: Solr 5.2.1 on Java 8 GC

On Thu, Apr 28, 2016 at 11:50 AM, Nick Vasilyev wrote: > mmfr_exact is a string field. key_phrases is a multivalued string field. One guess is that top-level field caches (and UnInvertedField use) were removed in https://issues.apache.org/jira/browse/LUCENE-5666 While

Re: Solr 5.2.1 on Java 8 GC

What about the field types though... are they single valued or multi valued, string, text, numeric? -Yonik On Thu, Apr 28, 2016 at 11:43 AM, Nick Vasilyev wrote: > Hi Yonik, > > I forgot to mention that the index is approximately 50 million docs split > across 4

Re: Solr 5.2.1 on Java 8 GC

32 GB is a pretty big heap. If the working set is really smaller than that, the extra heap just makes a full GC take longer. How much heap is used after a full GC? Take the largest value you see there, then add a bit more, maybe 25% more or 2 GB more. wunder Walter Underwood

Re: Solr 5.2.1 on Java 8 GC

The working set is larger than the heap. This is our largest collection and all shards combined would probably be around 60GB in total, there are also a few other much smaller collections. During normal operations the JVM memory utilization hangs between 17GB and 22GB if we aren't indexing any

Re: Solr 5.2.1 on Java 8 GC

Correction, the key_phrases is set up as follows: On Thu, Apr 28, 2016 at 12:03 PM, Nick Vasilyev wrote: > The working set is larger than the heap. This is our largest collection > and all shards combined

Re: Solr 5.2.1 on Java 8 GC

Shawn Heisey’s page is the usual reference guide for GC settings: https://wiki.apache.org/solr/ShawnHeisey Most of the learnings from that are in the Solr 5.x startup scripts already, but your heap is bigger, so your mileage may vary. Some tools I’ve used while doing GC tuning: * VisualVM -

Re: deactivate coord scoring factor in pf2 pf3

Glad to see you're using http://splainer.io! I recognize those explains! (let me know if you have any ideas/thoughts/questions/criticisms I created the thing). Some thoughts - You might consider using ps2 or ps3 to add a slop to the two word and three word phrase searches. Slop adds a less strict

Filter Queries with Suggester Search Component

Hello, I have been working on a project to modernize a search suggestion component that currently relies on a spellchecker component to return suggestions to the user. I want to move the suggester from the Spellchecker component over to the Suggester search component but I have ran into a snag

Re: issues doing a spatial query

Hi. This makes sense to me. The point 49.8,-97.1 is in your query box. The box is lower-left to upper-right, so your box is actually an almost world-wrapping one grabbing all longitudes except -93 to -92. Maybe you mean to switch your left & right. On Sun, Apr 24, 2016 at 8:03 PM GW

Re: Solr - index polygons from csv

Hi. To use polygons, you need to add JTS, otherwise you get an unsupported shape error. See https://cwiki.apache.org/confluence/display/solr/Apache+Solr+Reference+Guide it involves not only adding a JTS lib to your classpath (ideal spot is WEB-INF/lib ) but also adding a spatialContextFactory

Re: Decide on facets from results

Maybe you could do this: - MyFacetComponent extends FacetComponent - MyFacetComponent.process(): The results will be available at this point; look at them and decide which facets to fetch and return Best, Georg Alexandre Rafalovitch schrieb am Do., 28. Apr. 2016