Hi, Just to give some background. I will have a large-ish corpus of more than 100M documents indexed. The filters that I want to apply will be on a field that is not indexed. I mean, I prefer to not have them indexed in ES/Lucene since they will be frequently changing. So, for that, I will be maintaining them elsewhere, like a DB etc.
Everytime I have a query, I would want to filter the results by those fields that are not indexed in Lucene. And I am guessing that number may well be more than 1M. In that case, I think, since we will maintain some sort of TermsFilter, it may not scale linearly. What I would want to do, preferably, is to have a hook inside the ES query, so that I can, at query time, inject the required filter values. Since the filter values have to be recognized by Lucene, and I will not be indexing them, I will need to do some quick mapping to get those fields and map them quickly to some field in Lucene that I can save in the filter. I am not sure whether we can access and set Lucene DocIDs in the filter or whether they are even exposed in ES. Please assist with this query. Thanks, Thanks, Sandeep On Thursday, 3 July 2014 21:33:45 UTC+5:30, Jörg Prante wrote: > > Maybe I do not fully understand, but in a client, you can fetch the > required filter terms from any external source before a JSON query is > constructed? > > Can you give an example what you want to achieve? > > Jörg > > > On Thu, Jul 3, 2014 at 3:34 PM, 'Sandeep Ramesh Khanzode' via > elasticsearch <[email protected] <javascript:>> wrote: > >> Hi All, >> >> I am new to ES and I have the following requirement: >> I need to specify a list of strings as a filter that applies to a >> specific field in the document. Like what a filter does, but instead of >> sending them on the query, I would like them to be populated from an >> external sources, like a DB or something. Can you please guide me to the >> relevant examples or references to achieve this on v1.1.2? >> >> Thanks, >> Sandeep >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected] <javascript:>. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/0093d97d-0f47-48e9-ba19-85b0850eda89%40googlegroups.com >> >> <https://groups.google.com/d/msgid/elasticsearch/0093d97d-0f47-48e9-ba19-85b0850eda89%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> For more options, visit https://groups.google.com/d/optout. >> > > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/513172cd-9507-4e96-b456-498c98c3b8c9%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
