Re: Custom Solr caches in a FunctionQuery that emulates the ExternalFileField

2015-08-23 Thread Mikhail Khludnev
Hello Upayavira, It's a long month ago! I just described this approach in http://blog.griddynamics.com/2015/08/scoring-join-party-in-solr-53.html Coming back to our discussion I think I miss {!func} which turn fieldname into function query. On Fri, Jul 24, 2015 at 3:41 PM, Upayavira

Re: Custom Solr caches in a FunctionQuery that emulates the ExternalFileField

2015-07-24 Thread Upayavira
Mikhail, I've tried this out, but to be honest I can't work out what the score= parameter is supposed to add. I assume that if I do {!join fromIndex=other from=other_key to=key score=max}somefield:(abc dev) It will calculate the score for each document that has the same key value, and include

Re: Custom Solr caches in a FunctionQuery that emulates the ExternalFileField

2015-07-24 Thread Mikhail Khludnev
I think it's intended for {!join fromIndex=other from=other_key to=key score=max}my_boost_value_field thus it runs functional query, which matches all docs at other core with field value 'my_boost_value_field' as a score. Then, this score is passed through join query for other.other_key=key. Do

Re: Custom Solr caches in a FunctionQuery that emulates the ExternalFileField

2015-07-10 Thread Mikhail Khludnev
I've heard that people use https://issues.apache.org/jira/browse/SOLR-6234 for such purpose - adding scores from fast moving core to the bigger slow moving one On Fri, Jul 10, 2015 at 4:54 PM, Upayavira u...@odoko.co.uk wrote: All, I have knocked up what I think could be a really cool

Re: Custom Solr caches in a FunctionQuery that emulates the ExternalFileField

2015-07-10 Thread Upayavira
Mikhail, Thanks for pointing this out. I'd say that ticket is in distinct need of some examples or use-cases. It is extremely hard to work out what scoring actually means. What is used to score what? It'd be great to see some examples and some explanations as to what effect those examples have

Custom Solr caches in a FunctionQuery that emulates the ExternalFileField

2015-07-10 Thread Upayavira
All, I have knocked up what I think could be a really cool function query - it allows you to retrieve a value from another core (much like a pseudo join) and use that value during scoring (much like an ExternalFileField). Examples: * Selective boosting of documents based upon a category based

Re: Custom Solr caches in a FunctionQuery that emulates the ExternalFileField

2015-07-10 Thread Erick Erickson
Upayavira: bq: retrieve the value of field Y for that doc If this is fetching the stored field it's going to be horrible as it'll probably read/decompress a 16K block each time. Yccck. If you can read the value from a DocValues field (or, indeed, any indexed field which would only really

Re: Custom Solr caches in a FunctionQuery that emulates the ExternalFileField

2015-07-10 Thread Upayavira
Hi Erick, You are right that I could actually be asking for a stored field. That's an exceptionally good point, and yes, would suck. Better would be to retrieve a docValue from document. I'll look into that. Upayavira On Fri, Jul 10, 2015, at 06:28 PM, Erick Erickson wrote: Upayavira: bq: