Re: Use case for the Shingle Filter

2017-03-05 Thread Ryan Josal
I thought new versions of solr didn't split on whitespace at the query parser anymore, so this should work? That being said, I think I remember it having a problem coming after a synonym filter. IIRC, if your input is "Foo Bar" and you have a synonym "foo <=> baz" you would get foobaz bazbar

Forking Solr

2015-10-16 Thread Ryan Josal
Hi guys, I'd like to get your tips on how to run a Solr fork at my company. I know Yonik has a "heliosearch" fork, and I'm sure many others have a fork. There have been times where I want to add features to an existing core plugin, and subclassing isn't possible so I end up copying the source

Re: Forking Solr

2015-10-16 Thread Ryan Josal
; I suspect these questions should go the Lucene Dev list instead. This > > one is more for those who build on top of standard Solr. > > > > Regards, > >Alex. > > > > > > Solr Analyzers, Tokenizers, Filters, URPs and even a newsletter: > > http://

Re: Solr cross core join special condition

2015-10-07 Thread Ryan Josal
I developed a join transformer plugin that did that (although it didn't flatten the results like that). The one thing that was painful about it is that the TextResponseWriter has references to both the IndexSchema and SolrReturnFields objects for the primary core. So when you add a SolrDocument

Bug in query elevation transformers SOLR-7953

2015-08-20 Thread Ryan Josal
Hey guys, I just logged this bug and I wanted to raise awareness. If you use the QueryElevationComponent, and ask for fl=[elevated], you'll get only false if solr is using LazyDocuments. This looks even stranger when you request exclusive=true and you only get back elevated documents, and they

Re: rq breaks wildcard search?

2015-04-22 Thread Ryan Josal
, 2015 at 6:23 PM, Ryan Josal rjo...@gmail.com wrote: Using edismax, supplying a rq= param, like {!rerank ...} is causing an UnsupportedOperationException because the Query doesn't implement createWeight. This is for WildcardQuery in particular. From some preliminary debugging it looks like

rq breaks wildcard search?

2015-04-15 Thread Ryan Josal
Using edismax, supplying a rq= param, like {!rerank ...} is causing an UnsupportedOperationException because the Query doesn't implement createWeight. This is for WildcardQuery in particular. From some preliminary debugging it looks like without rq, somehow the qf Queries might turn into

Re: Group by score

2015-04-09 Thread Ryan Josal
You can use Result Grouping by a function using query(), but you'll need a version of Lucene with this bug fixed: https://issues.apache.org/jira/browse/SOLR-7046 Ryan On Thursday, April 9, 2015, Jens Mayer mjen...@yahoo.com.invalid wrote: Hey everybody, I have the following situation in my

Re: omitTermFreqAndPositions issue

2015-04-09 Thread Ryan Josal
:50 PM, Ryan Josal rjo...@gmail.com wrote: Thanks for your thought Shawn, I don't think fq will be helpful here. The field for which I want to turn TF off is title, which is actually one of the primary components of score, so I really need it in qf. I just don't want the TF portion

omitTermFreqAndPositions issue

2015-04-08 Thread Ryan Josal
Hey guys, it seems that omitTermFreqAndPositions is not very usable with edismax, and I'm wondering if this is intended behavior, and how I can get around the problem. The setup: define field foo with omitTermFreqAndPositions=true The query: q=ground coffeeqf=foo bar baz The error:

Re: omitTermFreqAndPositions issue

2015-04-08 Thread Ryan Josal
try to build a phrase query against a no TF no pos field. Ryan On Wednesday, April 8, 2015, Shawn Heisey apa...@elyograg.org wrote: On 4/8/2015 5:06 PM, Ryan Josal wrote: The error: IllegalStateException: field foo indexed without position data; cannot run PhraseQuery. It would actually

Re: sort on facet.index?

2015-04-02 Thread Ryan Josal
Sorting the result set or the facets? For the facets there is facet.sort=index (lexicographically) and facet.sort=count. So maybe you are asking if you can sort by index, but reversed? I don't think this is possible, and it's a good question. I wanted to chime in on this one because I wanted

Re: sort on facet.index?

2015-04-02 Thread Ryan Josal
Awesome, I didn't know this feature was going to add so much power! Looking forward to using it. On Thursday, April 2, 2015, Yonik Seeley ysee...@gmail.com wrote: On Thu, Apr 2, 2015 at 10:25 AM, Ryan Josal rjo...@gmail.com javascript:; wrote: Sorting the result set or the facets

DocTransformer#setContext

2015-03-20 Thread Ryan Josal
Hey guys, I wanted to ask if I'm using the DocTransformer API as intended. There is a setContext( TransformerContext c ) method which is called by the TextResponseWriter before it calls transform on any docs. That context object contains a DocIterator reference. I want to use a DocTransformer to

Re: rankquery usage bug?

2015-02-24 Thread Ryan Josal
Ticket filed, thanks! https://issues.apache.org/jira/browse/SOLR-7152 On Fri, Feb 20, 2015 at 9:29 PM, Joel Bernstein joels...@gmail.com wrote: Ryan, This looks like a good jira ticket to me. Joel Bernstein Search Engineer at Heliosearch On Fri, Feb 20, 2015 at 6:40 PM, Ryan Josal rjo

Re: Solr synonyms logic

2015-02-21 Thread Ryan Josal
What you are describing is hyponymy. Pastry is the hypernym. You can accomplish this by not using expansion, for example: cannelloni = cannelloni, pastry This has the result of adding pastry to the index. Ryan On Saturday, February 21, 2015, Mikhail Khludnev mkhlud...@griddynamics.com wrote:

rankquery usage bug?

2015-02-20 Thread Ryan Josal
Hey guys, I put a rq in defaults but I can't figure out how to override it with no rankquery. Looks like one option might be checking for empty string before trying to use it in QueryComponent? I can work around it in the prep method of an earlier searchcomponent for now. Ryan

Custom facet.sort

2015-02-16 Thread Ryan Josal
Hey guys, I have a desire to order (field) facets by their order of appearance in the search results. When I first thought about it, I figured there would be some way to plug a custom Comparator into FacetComponent and link it to facet.sort=rank or something like that, but not only is there no

Re: An interesting approach to grouping

2015-01-27 Thread Ryan Josal
field grouping command is used as the main result list in the response, using group.format=simple” https://wiki.apache.org/solr/FieldCollapsing Jim On 1/27/15, 9:22 AM, Ryan Josal rjo...@gmail.com javascript:; wrote: Thanks a lot! I'll try this out later this morning. If group.func

Re: An interesting approach to grouping

2015-01-27 Thread Ryan Josal
can¹t find one. Jim Musil On 1/26/15, 6:34 PM, Ryan Josal r...@josal.com javascript:; wrote: I have an index of products, and these products have a category which we can say for now is a good approximation of its location in the store. I'm investigating altering the ordering

An interesting approach to grouping

2015-01-26 Thread Ryan Josal
I have an index of products, and these products have a category which we can say for now is a good approximation of its location in the store. I'm investigating altering the ordering of the results so that the categories aren't interlaced as much... so that the results are a little bit more

Re: Dynamically loaded core.properties file

2014-08-21 Thread Ryan Josal
whatever you need to define to make the prod/dev distinction you need. WARNING: I'm not entirely sure that relative pathing works here, which just means I haven't tried it. Best, Erick On Wed, Aug 20, 2014 at 3:11 PM, Ryan Josal ry...@pointinside.com wrote: Thanks Erick, that mirrors my thoughts

Dynamically loaded core.properties file

2014-08-20 Thread Ryan Josal
Hi all, I have a question about dynamically loading a core properties file with the new core discovery method of defining cores. The concept is that I can have a dev.properties file and a prod.properties file, and specify which one to load with -Dsolr.env=dev. This way I can have one file

Re: Dynamically loaded core.properties file

2014-08-20 Thread Ryan Josal
after evaluating variables. Best, Erick On Wed, Aug 20, 2014 at 11:36 AM, Ryan Josal ry...@pointinside.com wrote: Hi all, I have a question about dynamically loading a core properties file with the new core discovery method of defining cores. The concept is that I can have a dev.properties file

RE: Correct way for getting SolrCore?

2013-02-06 Thread Ryan Josal
? - Mark On Feb 5, 2013, at 5:42 PM, Ryan Josal rjo...@rim.com wrote: By way of the deprecated SolrCore.getSolrCore method, SolrCore.getSolrCore().getCoreDescriptor().getCoreContainer().getCores() Solr starts up in an infinite recursive loop of loading cores. I understand now

Correct way for getting SolrCore?

2013-02-05 Thread Ryan Josal
Hey guys, I am writing an UpdateRequestProcessorFactory plugin which needs to have some initialization code in the init method. I need to build some information about each SolrCore in memory so that when an update comes in for a particular SolrCore, I can use the data for the appropriate

RE: Correct way for getting SolrCore?

2013-02-05 Thread Ryan Josal
to the core container, which knows about all the cores. - Mark On Feb 5, 2013, at 4:09 PM, Ryan Josal rjo...@rim.com wrote: Hey guys, I am writing an UpdateRequestProcessorFactory plugin which needs to have some initialization code in the init method. I need to build some information about each

RE: Correct way for getting SolrCore?

2013-02-05 Thread Ryan Josal
SolrCore.getSearcher().get().getIndexReader() to get the IndexReader, but if that happens after a good point of plugging in this initialization, then I guess SolrCore.getIndexReaderFactory() is the way to go. Thanks, Ryan From: Ryan Josal [rjo...@rim.com

RE: SolrJ DirectXmlRequest

2013-01-23 Thread Ryan Josal
Thanks Hoss, The issue mentioned describes a similar behavior to what I observed, but not quite. Commons-fileupload creates java.io.File objects for the temp files, and when those Files are garbage collected, the temp file is deleted. I've verified this by letting the temp files build up

RE: SolrJ DirectXmlRequest

2013-01-09 Thread Ryan Josal
: SolrJ DirectXmlRequest Hi Ryan, I'm not sure what is creating those upload files something in Solr? Or Tomcat? Why not specify a different temp dir via system property command line parameter? Otis Solr ElasticSearch Support http://sematext.com/ On Jan 8, 2013 12:17 PM, Ryan Josal rjo

RE: SolrJ DirectXmlRequest

2013-01-09 Thread Ryan Josal
/ On Wed, Jan 9, 2013 at 12:03 PM, Ryan Josal rjo...@rim.com wrote: I also don't know what's creating them. Maybe Solr, but also maybe Tomcat, maybe apache commons. I could change java.io.tmpdir to one with more space, but the problem is that many of the temp files end up permanent, so

SolrJ DirectXmlRequest

2013-01-08 Thread Ryan Josal
I have encountered an issue where using DirectXmlRequest to index data on a remote host results in eventually running out have temp disk space in the java.io.tmpdir directory. This occurs when I process a sufficiently large batch of files. About 30% of the temporary files end up permanent.