Re: Classifier for query intent?

2018-04-04 Thread Georg Sorst
Hi wunder, this sounds like an interesting topic. Can you elaborate a bit on query intent classification? Where does the training data come from? Do you manually assign an intent to a query or can this be done in a (semi-)automatic way? Do you have a fixed list of possible intents (something like

Re: Use of blanks in context filter field with AnalyzingInfixLookupFactory

2017-06-24 Thread Georg Sorst
Alfonso, I've run into similar issues with the context filter query, maybe this is caused by the StandardTokenizer. I've written a patch in SOLR-9968 that makes the analyzer for the context filter query configurable. This has helped me at least. SOLR-7963 also allows you to change the query

Re: Is it possible to support context filtering for FuzzyLookupFactory?

2017-06-22 Thread Georg Sorst
That would indeed be great! Does anyone know if there is a specific reason for this or has it just not been implemented? Jeffery Yuan schrieb am Di., 20. Juni 2017, 22:54: > > FuzzyLookupFactory is great as it can still find matches even if users > mis-spell. > > context

Re: Using function queries for faceting

2017-04-08 Thread Georg Sorst
<m...@apache.org> schrieb am Di., 4. Apr. 2017, 17:05: Exclude users' products, calculate default price facet, then facet only user's products (in a main query) and sum facet counts. It's probably can be done with switching domains in json facets. On Tue, Apr 4, 2017 at 5:43 PM, Georg

DisMax search on field only if it exists otherwise fall-back to another

2017-04-05 Thread Georg Sorst
Hi list! The question was already asked by Neil Prosser sometime in 2015 but apparently never got a reply, so here's to better luck this time: At the moment I'm using a DisMax query which looks something like the following (massively cut-down): ?defType=dismax =some query =field_one^0.5

Re: Using function queries for faceting

2017-04-04 Thread Georg Sorst
y default price across all > empty price groups in index time. > > > On Tue, Apr 4, 2017 at 1:14 PM, Georg Sorst <georg.so...@gmail.com> wrote: > > > Hi list! > > > > My documents are eCommerce items. They may have a special price for a > > certain gro

Getting counts for JSON facet percentiles

2017-04-04 Thread Georg Sorst
Hi list! Is it possible to get counts for the JSON facet percentiles? Of course I could trivially calculate them myself, they are percentiles after all, but there are cases where these may be off by one such as calculating the 50th percentile / median over 3 results. Thanks and best, Georg

Using function queries for faceting

2017-04-04 Thread Georg Sorst
Hi list! My documents are eCommerce items. They may have a special price for a certain group of users, but not for other groups of users; in that case the default price should be used. So the documents look like something like this: item: id: 1 price_default: 11.5 price_group1: 11.2 item:

Use Solr Suggest to autocomplete words and suggest co-occurences

2017-03-05 Thread Georg Sorst
Hi all, is there a way to get the suggester to autocomplete words and suggest co-occurences instead of suggesting complete field values? The behavior I'm looking for is quite similar to Google, only based on index values not actual queries. Let's say there are two items in the index: 1.

Re: Split words with period in between into separate tokens

2016-10-12 Thread Georg Sorst
You could use a PatternReplaceCharFilter before your tokenizer to replace the dot with a space character. Derek Poh schrieb am Mi., 12. Okt. 2016 11:38: > Seems like LetterTokenizerFactory tokenise/discard on numbers as well. The > field does has values with numbers in

Re: solr 5 leaving tomcat, will I be the only one fearing about this?

2016-10-09 Thread Georg Sorst
If you can, switch to Docker (https://hub.docker.com/_/solr/). It's a pain to get everything going the right way, but once it's running you get a lot of stuff for free: * Deployment, scaling etc. is all taken care of by the Docker ecosystem * Testing is a breeze. Need a clean Solr instance to run

How to limit resources in multi-tenant systems

2016-09-20 Thread Georg Sorst
Hi list! I am running a multi-tenant system where the tenants can upload and import their own data into their respective cores. Fortunately, Solr makes it easy to make sure that the search indices don't mix and that clients can only access their "cores". However, isolating the resource

Re: How to enable JMX to monitor Jetty

2016-09-15 Thread Georg Sorst
ty-jmx.xml. > > # > # Jetty HTTP Connector > # > > [depend] > server > > [xml] > etc/jetty-http.xml > etc/jetty-jmx.xml > > > > On 5/21/16 3:59 AM, Georg Sorst wrote: > > Hi list, > > > > how do I correctly enable JMX in Solr 6 so that I can monitor

Re: (Survey/Experiment) Are you interested in a Solr example reading group?

2016-09-14 Thread Georg Sorst
Hi Alexandre, that's a great idea! Count me in (time permitting...). I guess the intended outcome is to create documentation issues and fixes? Best, Georg Alexandre Rafalovitch schrieb am Di., 13. Sep. 2016 18:30: > Is anybody interested in joining an example reading

Re: How to swap two cores and then unload one of them

2016-09-12 Thread Georg Sorst
m using Solr 6. > > I need to use coreContainer because I have created a CoreAdminHandler > extension. > > Thanks, > Fabrizio > > On Sun, Sep 11, 2016 at 6:42 PM, Georg Sorst <georg.so...@gmail.com> > wrote: > > > Hi Fabrizio, > > > > which S

Re: How to swap two cores and then unload one of them

2016-09-11 Thread Georg Sorst
Hi Fabrizio, which Solr version are you using? In more recent versions (starting with 5 I think) you should not use the coreContainer directly but instead go through the HTTP API (which also supports the swap operation) or use SolrJ. Best, Georg Fabrizio Fortino schrieb am

Re: Monitoring Apache Solr

2016-09-11 Thread Georg Sorst
Hi Hardika, you can get pretty far with basic Nagios / Icinga plugins (though Sematext SPM may be a better option if you are operating on large scale). JMX provides almost complete JVM information (Heap usage, GC info). A Nagios Plugin to access JMX can be found here:

Re: How to replicate config files in master-slave replication without commit on master?

2016-09-06 Thread Georg Sorst
c setup. It works, but it's ugly, and I was hoping for a better way Best, Georg > > Best, > Erick > > On Mon, Sep 5, 2016 at 7:49 AM, Georg Sorst <georg.so...@gmail.com> wrote: > > Hi! > > > > According to > > > https://cwiki.apache.org/c

How to replicate config files in master-slave replication without commit on master?

2016-09-05 Thread Georg Sorst
Hi! According to https://cwiki.apache.org/confluence/display/solr/Index+Replication#IndexReplication-ReplicatingConfigurationFiles : > Solr replicates configuration files only when the index itself is replicated. That means even if a configuration file is changed on the master, that file will be

Re: Stemming Help

2016-06-05 Thread Georg Sorst
Without having more context: How do you know that it is not working? What is the output you are getting in the analysis tool? Do the analysis steps in the output match your configuration? Are you sure you selected the right field / field type before running the analysis? Jamal, Sarfaraz

Re: help need example code of solrj to get schema of a given core

2016-05-31 Thread Georg Sorst
Querying the schema can be done with the Schema API ( https://cwiki.apache.org/confluence/display/solr/Schema+API), which is fully supported by SolrJ: http://lucene.apache.org/solr/6_0_0/solr-solrj/org/apache/solr/client/solrj/request/schema/package-summary.html . Liu, Ming (Ming)

Re: Activate Fuzzy Queries for each term by default

2016-05-30 Thread Georg Sorst
AFAIK this is not possible, but it probably doesn't make so much sense either. In my experience fuzzy search should be explicit to the user (Google does a pretty good job at this, eg. "Did you mean" etc.). What are you trying to achieve and what results do you want to return? Sebastian Landwehr

Re: Recommended api/lib to search Solr using PHP

2016-05-30 Thread Georg Sorst
We've had good experiences with Solarium, so it's probably worth spending some time in getting it to run. scott.chu schrieb am Mo., 30. Mai 2016 um 09:30 Uhr: > > We have two legacy in-house applications written in PHP 5.2.6 and 5.5.3. > Our engineers currently just use

How to enable JMX to monitor Jetty

2016-05-21 Thread Georg Sorst
Hi list, how do I correctly enable JMX in Solr 6 so that I can monitor Jetty's thread pool? The first step is to set ENABLE_REMOTE_JMX_OPTS="true" in bin/solr.in.sh. This will give me JMX access to JVM properties (garbage collection, class loading etc.) and works fine. However, this will not

Re: Mockito issues with private SolrTestCaseJ4.beforeClass

2016-05-06 Thread Georg Sorst
Anyway, this is now SOLR-9081. Best, Georg Georg Sorst <g.so...@findologic.com> schrieb am So., 24. Apr. 2016 um 17:34 Uhr: > Hi list, > > I just ran into some issues with Mockito and SolrTestCaseJ4. It looks like > this: > > * Mockito requires all @BeforeClass method

Re: bf calculation

2016-05-02 Thread Georg Sorst
Hi Jan, have you tried Solr's debug output? ie. add "...=true=true" to your query. This should answer your question. Best, Georg Jan Verweij - Reeleez schrieb am Mo., 2. Mai 2016 um 09:47 Uhr: > Hi, > I'm trying to understand the exact calculation that takes place when using

Re: Decide on facets from results

2016-04-28 Thread Georg Sorst
Maybe you could do this: - MyFacetComponent extends FacetComponent - MyFacetComponent.process(): The results will be available at this point; look at them and decide which facets to fetch and return Best, Georg Alexandre Rafalovitch schrieb am Do., 28. Apr. 2016

Re: how to retrieve json facet using solrj

2016-04-25 Thread Georg Sorst
Hi Yangrui, from what I've gathered the JSON Facets are not supported in SolrJ yet, so you need to manually work with the response, ie.: response.getResponse().get("facets") Best, Georg Yangrui Guo schrieb am So., 24. Apr. 2016 um 22:13 Uhr: > Hello > > I use json facet

Re: How can I set the defaultOperator to be AND?

2016-04-25 Thread Georg Sorst
With Solr 6.0 I've had to set mm=100% & q.op=AND for a full AND query (and mm=1 & q.op=OR for a full OR query). Jan Høydahl schrieb am Mo., 25. Apr. 2016 um 16:04 Uhr: > I think a workaround for your specific case could be to set mm=100% & > q.op=OR (although it used to

Mockito issues with private SolrTestCaseJ4.beforeClass

2016-04-24 Thread Georg Sorst
Hi list, I just ran into some issues with Mockito and SolrTestCaseJ4. It looks like this: * Mockito requires all @BeforeClass methods in the class hierarchy to be "public static void" * SolrTestCaseJ4.beforeClass (which is @BeforeClass) is "private static void" * So I cannot use Mockito as a

ManagedSynonymFilterFactory per core instead of config set?

2016-04-17 Thread Georg Sorst
Hi list! Is it possible to set synonyms per core when using the ManagedSynonymFilterFactory, even when using config sets? What makes me think that this is not possible is that the synonyms are stored in $solr_home/configsets/$config_set/conf/_schema_analysis_synonyms_$resource.json. So when I

Re: Set Config API user properties with SolrJ

2016-04-17 Thread Georg Sorst
For further reference: I solved this by using an HTTP-based Solr in the tests. Look at SolrTestCaseJ4.buildJettyConfig for more info Georg Sorst <g.so...@findologic.com> schrieb am Mo., 11. Apr. 2016 um 10:28 Uhr: > The issu

Re: Set Config API user properties with SolrJ

2016-04-11 Thread Georg Sorst
/ testcase / patch if someone can give me a little help. Georg Sorst <g.so...@findologic.com> schrieb am So., 10. Apr. 2016 um 14:36 Uhr: > Addendum: Apparently the code works fine with HttpSolrClient, but not with > EmbeddedSolrServer (used in our tests).The most recent vers

Re: Set Config API user properties with SolrJ

2016-04-10 Thread Georg Sorst
Addendum: Apparently the code works fine with HttpSolrClient, but not with EmbeddedSolrServer (used in our tests).The most recent version I tested this was 5.5.0 Georg Sorst <g.so...@findologic.com> schrieb am So., 10. Apr. 2016 um 01:49 Uhr: > Hi, > > how can you set Config

Set Config API user properties with SolrJ

2016-04-09 Thread Georg Sorst
Hi, how can you set Config API values from SolrJ? Does anyone have an example for this? Here's what I'm currently trying: /* Build the structure for the request */ Map parameters = new HashMap() {{ put("key", "value"); }}; final NamedList requestParameters =

Re: Use default field, if more specific field does not exist

2016-04-03 Thread Georg Sorst
d slow. > I haven't look at it in details, but maybe you could find something > useful in new Json facet API. > > Regards, > Emir > > On 26.03.2016 12:15, Georg Sorst wrote: > > Hi Emir, > > > > that sounds like a great idea and filtering should be just fine! > >

Re: Use default field, if more specific field does not exist

2016-03-26 Thread Georg Sorst
; price_1:[100 TO 200] OR (-price_1:[* TO *] AND price:[100 TO 200]) > > Same query is used for filtering. What you should test is if > performances are acceptable. > > Thanks, > Emir > > On 24.03.2016 22:31, Georg Sorst wrote: > > Hi list, > > > > we use Solr t

Use default field, if more specific field does not exist

2016-03-24 Thread Georg Sorst
Hi list, we use Solr to search ecommerce products. Items have a default price which can be overwritten per user. So when searching we have to return the user price if it is set, otherwise the default price. Same goes for building facets and when filtering by price. What's the best way to

Re: solr & docker in production

2016-03-15 Thread Georg Sorst
Hi, sounds great! Did you run any benchmarks? What's the IO penalty? Best, Georg Jay Potharaju schrieb am Di., 15. Mär. 2016 04:25: > Upayavira, > Thanks for the feedback. I plan to deploy solr on its own instance rather > than on instance running multiple

SolrJ + JSON Facet API

2016-02-24 Thread Georg Sorst
Hi list! Does SolrJ already wrap the new JSON Facet API? I couldn't find any info about this. If not, what's the best way for a Java client to build and send requests when you want to use the JSON Facets? On a side note, since the JSON Facet API uses POST I will not be able to see the requested

Re: User-defined properties and configsets

2016-01-31 Thread Georg Sorst
API is for. So, where do other people put their properties when they use configsets? Best regards, Georg > > The bin/solr script has a -a option for passing additional stuff to the > JVM... > > Best, > Erick > > On Thu, Jan 28, 2016 at 11:50 PM, Georg Sorst <g.so.

Re: User-defined properties and configsets

2016-01-28 Thread Georg Sorst
Any takers? Georg Sorst <g.so...@findologic.com> schrieb am So., 24. Jän. 2016 00:22: > Hi list! > > I've just started playing with Solr 5 (upgrading from Solr 4) and want to > use configsets. I'm currently struggling with how to use user-defined > properties and config

User-defined properties and configsets

2016-01-23 Thread Georg Sorst
Hi list! I've just started playing with Solr 5 (upgrading from Solr 4) and want to use configsets. I'm currently struggling with how to use user-defined properties and configsets together. My solrconfig.xml contains a few properties. Previously these were in a solrcore.properties and thus were