[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[ https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236007#comment-16236007 ] Michael McCandless commented on LUCENE-8019: bq. So – are you suggesting it would score every sub-query independently? Yeah, I think so? This should ensure that if a child scorer is not on the current hit, that means it did not match the current hit. But hopefully it can compute the same scores that BQ's more advanced scorers do? Or maybe because of order-of-operation differences this is too hard or something? > Add a root failure cause to Explanation > > > Key: LUCENE-8019 > URL: https://issues.apache.org/jira/browse/LUCENE-8019 > Project: Lucene - Core > Issue Type: New Feature >Reporter: Mike Sokolov >Priority: Major > Attachments: LUCENE-8019.patch, LUCENE_8019.patch > > > If you need to analyze the root cause of a query's failure to match some > document, you can use the Weight.explain() API. If you want to do some gross > analysis of a whole batch of queries, say scraped from a log, that once > matched, but no longer do, perhaps after some refactoring or other > large-scale change, the Explanation isn't very good for that. You can try > parsing its textual output, which is pretty regular, but instead I found it > convenient to add some boolean structure to Explanation, and use that to find > failing leaves on the Explanation tree, and report only those. > This patch adds a "condition" to each Explanation, which can be REQUIRED, > OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to > the Boolean Occur, except for NONE, which is used to indicate a node which > can't be further decomposed. It adds new Explanation construction methods for > creating Explanations with conditions (defaulting to NONE with the existing > methods). > Finally Explanation.getFailureCauses() returns a list of Strings that are the > one-line explanations of the failing queries that, if some of them had > succeeded, would have made the original overall query match. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[ https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16235687#comment-16235687 ] Robert Muir commented on LUCENE-8019: - +1 for the DebugBooleanQuery idea. When I looked at the patches here it seems thats really what you want to do. It can be separately useful for tests purposes. > Add a root failure cause to Explanation > > > Key: LUCENE-8019 > URL: https://issues.apache.org/jira/browse/LUCENE-8019 > Project: Lucene - Core > Issue Type: New Feature >Reporter: Mike Sokolov >Priority: Major > Attachments: LUCENE-8019.patch, LUCENE_8019.patch > > > If you need to analyze the root cause of a query's failure to match some > document, you can use the Weight.explain() API. If you want to do some gross > analysis of a whole batch of queries, say scraped from a log, that once > matched, but no longer do, perhaps after some refactoring or other > large-scale change, the Explanation isn't very good for that. You can try > parsing its textual output, which is pretty regular, but instead I found it > convenient to add some boolean structure to Explanation, and use that to find > failing leaves on the Explanation tree, and report only those. > This patch adds a "condition" to each Explanation, which can be REQUIRED, > OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to > the Boolean Occur, except for NONE, which is used to indicate a node which > can't be further decomposed. It adds new Explanation construction methods for > creating Explanations with conditions (defaulting to NONE with the existing > methods). > Finally Explanation.getFailureCauses() returns a list of Strings that are the > one-line explanations of the failing queries that, if some of them had > succeeded, would have made the original overall query match. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[ https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16235685#comment-16235685 ] Mike Sokolov commented on LUCENE-8019: -- bq. slow and stupid inefficient on how it does matching So -- are you suggesting it would score every sub-query independently? > Add a root failure cause to Explanation > > > Key: LUCENE-8019 > URL: https://issues.apache.org/jira/browse/LUCENE-8019 > Project: Lucene - Core > Issue Type: New Feature >Reporter: Mike Sokolov >Priority: Major > Attachments: LUCENE-8019.patch, LUCENE_8019.patch > > > If you need to analyze the root cause of a query's failure to match some > document, you can use the Weight.explain() API. If you want to do some gross > analysis of a whole batch of queries, say scraped from a log, that once > matched, but no longer do, perhaps after some refactoring or other > large-scale change, the Explanation isn't very good for that. You can try > parsing its textual output, which is pretty regular, but instead I found it > convenient to add some boolean structure to Explanation, and use that to find > failing leaves on the Explanation tree, and report only those. > This patch adds a "condition" to each Explanation, which can be REQUIRED, > OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to > the Boolean Occur, except for NONE, which is used to indicate a node which > can't be further decomposed. It adds new Explanation construction methods for > creating Explanations with conditions (defaulting to NONE with the existing > methods). > Finally Explanation.getFailureCauses() returns a list of Strings that are the > one-line explanations of the failing queries that, if some of them had > succeeded, would have made the original overall query match. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[
https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16235514#comment-16235514
]
Michael McCandless commented on LUCENE-8019:
Maybe we should add a {{DebugBooleanQuery}}, somewhere under
{{test-framework}}, that is slow and stupid inefficient on how it does
matching, but makes it easier to see why a query didn't match, get child
scorers that are "on" the current doc if the doc matched, etc.?
> Add a root failure cause to Explanation
>
>
> Key: LUCENE-8019
> URL: https://issues.apache.org/jira/browse/LUCENE-8019
> Project: Lucene - Core
> Issue Type: New Feature
>Reporter: Mike Sokolov
>Priority: Major
> Attachments: LUCENE-8019.patch, LUCENE_8019.patch
>
>
> If you need to analyze the root cause of a query's failure to match some
> document, you can use the Weight.explain() API. If you want to do some gross
> analysis of a whole batch of queries, say scraped from a log, that once
> matched, but no longer do, perhaps after some refactoring or other
> large-scale change, the Explanation isn't very good for that. You can try
> parsing its textual output, which is pretty regular, but instead I found it
> convenient to add some boolean structure to Explanation, and use that to find
> failing leaves on the Explanation tree, and report only those.
> This patch adds a "condition" to each Explanation, which can be REQUIRED,
> OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to
> the Boolean Occur, except for NONE, which is used to indicate a node which
> can't be further decomposed. It adds new Explanation construction methods for
> creating Explanations with conditions (defaulting to NONE with the existing
> methods).
> Finally Explanation.getFailureCauses() returns a list of Strings that are the
> one-line explanations of the failing queries that, if some of them had
> succeeded, would have made the original overall query match.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[ https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227274#comment-16227274 ] Robert Muir commented on LUCENE-8019: - Yes, maybe post the code: i don't think we should give up on doing the right thing just because of the impl of ReqExclScorer, these things could be changed. I don't think we need to cast Weights to anything, it is probably enough to just organize scorers with the Query that generated them (just use .toString and .equals for de-duping and output, no casts needed). It doesn't make sense to me to complicate Explanation with matching stuff, and definitely not to do that and at the same time keep Scorer.getChildren api (which is intended to do this kind of stuff). I'd rather fix the latter api > Add a root failure cause to Explanation > > > Key: LUCENE-8019 > URL: https://issues.apache.org/jira/browse/LUCENE-8019 > Project: Lucene - Core > Issue Type: New Feature >Reporter: Mike Sokolov > Attachments: LUCENE_8019.patch > > > If you need to analyze the root cause of a query's failure to match some > document, you can use the Weight.explain() API. If you want to do some gross > analysis of a whole batch of queries, say scraped from a log, that once > matched, but no longer do, perhaps after some refactoring or other > large-scale change, the Explanation isn't very good for that. You can try > parsing its textual output, which is pretty regular, but instead I found it > convenient to add some boolean structure to Explanation, and use that to find > failing leaves on the Explanation tree, and report only those. > This patch adds a "condition" to each Explanation, which can be REQUIRED, > OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to > the Boolean Occur, except for NONE, which is used to indicate a node which > can't be further decomposed. It adds new Explanation construction methods for > creating Explanations with conditions (defaulting to NONE with the existing > methods). > Finally Explanation.getFailureCauses() returns a list of Strings that are the > one-line explanations of the failing queries that, if some of them had > succeeded, would have made the original overall query match. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[ https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227243#comment-16227243 ] Mike Sokolov commented on LUCENE-8019: -- Sorry I missed your comment there, Robert. Maybe this would be clearer if I posted the code, but the issue with walking the Scorer tree seemed like a blocker to me. ReqExclScorer.getChildren() is incomplete -- it does not include the exclScorer. > Add a root failure cause to Explanation > > > Key: LUCENE-8019 > URL: https://issues.apache.org/jira/browse/LUCENE-8019 > Project: Lucene - Core > Issue Type: New Feature >Reporter: Mike Sokolov > Attachments: LUCENE_8019.patch > > > If you need to analyze the root cause of a query's failure to match some > document, you can use the Weight.explain() API. If you want to do some gross > analysis of a whole batch of queries, say scraped from a log, that once > matched, but no longer do, perhaps after some refactoring or other > large-scale change, the Explanation isn't very good for that. You can try > parsing its textual output, which is pretty regular, but instead I found it > convenient to add some boolean structure to Explanation, and use that to find > failing leaves on the Explanation tree, and report only those. > This patch adds a "condition" to each Explanation, which can be REQUIRED, > OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to > the Boolean Occur, except for NONE, which is used to indicate a node which > can't be further decomposed. It adds new Explanation construction methods for > creating Explanations with conditions (defaulting to NONE with the existing > methods). > Finally Explanation.getFailureCauses() returns a list of Strings that are the > one-line explanations of the failing queries that, if some of them had > succeeded, would have made the original overall query match. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[ https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227237#comment-16227237 ] Mike Sokolov commented on LUCENE-8019: -- I pursued that line of attack a bit further, got something that seemed to work, and then ran into a wall because I have to use a bunch of casts in order to avoid making changes to Weight, and sometimes the casts are wrong. java.lang.ClassCastException: org.apache.lucene.search.LRUQueryCache$CachingWrapperWeight cannot be cast to org.apache.lucene.search.BooleanWeight so I think the only way forward here would be to add a new method to Weight, akin to explain(). In that case, the original idea seems like the least change. > Add a root failure cause to Explanation > > > Key: LUCENE-8019 > URL: https://issues.apache.org/jira/browse/LUCENE-8019 > Project: Lucene - Core > Issue Type: New Feature >Reporter: Mike Sokolov > Attachments: LUCENE_8019.patch > > > If you need to analyze the root cause of a query's failure to match some > document, you can use the Weight.explain() API. If you want to do some gross > analysis of a whole batch of queries, say scraped from a log, that once > matched, but no longer do, perhaps after some refactoring or other > large-scale change, the Explanation isn't very good for that. You can try > parsing its textual output, which is pretty regular, but instead I found it > convenient to add some boolean structure to Explanation, and use that to find > failing leaves on the Explanation tree, and report only those. > This patch adds a "condition" to each Explanation, which can be REQUIRED, > OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to > the Boolean Occur, except for NONE, which is used to indicate a node which > can't be further decomposed. It adds new Explanation construction methods for > creating Explanations with conditions (defaulting to NONE with the existing > methods). > Finally Explanation.getFailureCauses() returns a list of Strings that are the > one-line explanations of the failing queries that, if some of them had > succeeded, would have made the original overall query match. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[ https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227118#comment-16227118 ] Robert Muir commented on LUCENE-8019: - OK, I think thats expected: for such a use case its good to see the low-level scorers? I think it also relates to my comment about "climbing" to organize the output better, if you think of it as a network you can "climb" via scorer.getWeight() to have the weight nodes? And from there you can climb up to weight.getQuery() too if needed. The challenge is probably just organizing the output to be nice. > Add a root failure cause to Explanation > > > Key: LUCENE-8019 > URL: https://issues.apache.org/jira/browse/LUCENE-8019 > Project: Lucene - Core > Issue Type: New Feature >Reporter: Mike Sokolov > Attachments: LUCENE_8019.patch > > > If you need to analyze the root cause of a query's failure to match some > document, you can use the Weight.explain() API. If you want to do some gross > analysis of a whole batch of queries, say scraped from a log, that once > matched, but no longer do, perhaps after some refactoring or other > large-scale change, the Explanation isn't very good for that. You can try > parsing its textual output, which is pretty regular, but instead I found it > convenient to add some boolean structure to Explanation, and use that to find > failing leaves on the Explanation tree, and report only those. > This patch adds a "condition" to each Explanation, which can be REQUIRED, > OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to > the Boolean Occur, except for NONE, which is used to indicate a node which > can't be further decomposed. It adds new Explanation construction methods for > creating Explanations with conditions (defaulting to NONE with the existing > methods). > Finally Explanation.getFailureCauses() returns a list of Strings that are the > one-line explanations of the failing queries that, if some of them had > succeeded, would have made the original overall query match. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[ https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227006#comment-16227006 ] Mike Sokolov commented on LUCENE-8019: -- I have a WIP impl of this that walks the Scorer tree, advancing and checking docID(). The code is definitely cleaner and less intrusive than the previous patch. However, I ran into an issue since the Scorer tree doesn't really mirror the original Query tree. A simple example is a query like *:* -foo:1 This gets scored using a ReqExclScorer which has only a single child corresponding to the MatchAllQuery and can't really be used to discover if a mis-match is due to matching the foo:1 term query. So I think I need to walk the tree of Weights, as explain() does. > Add a root failure cause to Explanation > > > Key: LUCENE-8019 > URL: https://issues.apache.org/jira/browse/LUCENE-8019 > Project: Lucene - Core > Issue Type: New Feature >Reporter: Mike Sokolov > Attachments: LUCENE_8019.patch > > > If you need to analyze the root cause of a query's failure to match some > document, you can use the Weight.explain() API. If you want to do some gross > analysis of a whole batch of queries, say scraped from a log, that once > matched, but no longer do, perhaps after some refactoring or other > large-scale change, the Explanation isn't very good for that. You can try > parsing its textual output, which is pretty regular, but instead I found it > convenient to add some boolean structure to Explanation, and use that to find > failing leaves on the Explanation tree, and report only those. > This patch adds a "condition" to each Explanation, which can be REQUIRED, > OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to > the Boolean Occur, except for NONE, which is used to indicate a node which > can't be further decomposed. It adds new Explanation construction methods for > creating Explanations with conditions (defaulting to NONE with the existing > methods). > Finally Explanation.getFailureCauses() returns a list of Strings that are the > one-line explanations of the failing queries that, if some of them had > succeeded, would have made the original overall query match. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[
https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221439#comment-16221439
]
Robert Muir commented on LUCENE-8019:
-
By the way there exists a very simple example of such stuff in the unit tests:
https://github.com/apache/lucene-solr/blob/master/lucene/core/src/test/org/apache/lucene/search/TestBooleanQueryVisitSubscorers.java#L262
I don't think we need to bring Collector into it as such a debug() would take
docID and only work on one doc, so that would be overkill. but you can see
traversal and the kind of assertions in unit tests such as:
{noformat}
assertEquals(
"ConjunctionScorer\n" +
"MUST ConstantScoreScorer\n" +
"MUST MinShouldMatchSumScorer\n" +
"SHOULD TermScorer body:crawler\n" +
"SHOULD TermScorer body:web\n" +
"SHOULD TermScorer body:nutch",
summary);
{noformat}
Output can use child.docID() == doc to determine if something matched or not,
and maybe it can include stuff such as freq() and score() which may be enough
to help debug issues as to why something matched or didnt match. You can always
climb up Scorer -> Weight -> Query to get additional metadata/toString for
improved output or to re-arrange things differently. I think it could be
generally useful if we invested a little time.
Otherwise its frustrating that we bear the cost of maintaining a scorer tree
api but don't use it for anything.
> Add a root failure cause to Explanation
>
>
> Key: LUCENE-8019
> URL: https://issues.apache.org/jira/browse/LUCENE-8019
> Project: Lucene - Core
> Issue Type: New Feature
>Reporter: Mike Sokolov
> Attachments: LUCENE_8019.patch
>
>
> If you need to analyze the root cause of a query's failure to match some
> document, you can use the Weight.explain() API. If you want to do some gross
> analysis of a whole batch of queries, say scraped from a log, that once
> matched, but no longer do, perhaps after some refactoring or other
> large-scale change, the Explanation isn't very good for that. You can try
> parsing its textual output, which is pretty regular, but instead I found it
> convenient to add some boolean structure to Explanation, and use that to find
> failing leaves on the Explanation tree, and report only those.
> This patch adds a "condition" to each Explanation, which can be REQUIRED,
> OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to
> the Boolean Occur, except for NONE, which is used to indicate a node which
> can't be further decomposed. It adds new Explanation construction methods for
> creating Explanations with conditions (defaulting to NONE with the existing
> methods).
> Finally Explanation.getFailureCauses() returns a list of Strings that are the
> one-line explanations of the failing queries that, if some of them had
> succeeded, would have made the original overall query match.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[ https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221405#comment-16221405 ] Robert Muir commented on LUCENE-8019: - Yes perhaps we could instead add sugar to IndexSearcher to "debug" a query via getChildren? If we are going to keep the getChildren api, why not at least allow it to help us :). Scorer visitors already record the relationship in the graph and similar to explain() you can simply advance() a scorer to a doc and then visit the scorer tree to maybe assist in debugging? Because you can always climb up a Scorer to its Weight via a getter method, it may be possible to incorporate score's explanation in the same output, but I think they may be separate use-cases. In general I think explain should work for end-users and debugging at that low level is more of a developer task. > Add a root failure cause to Explanation > > > Key: LUCENE-8019 > URL: https://issues.apache.org/jira/browse/LUCENE-8019 > Project: Lucene - Core > Issue Type: New Feature >Reporter: Mike Sokolov > Attachments: LUCENE_8019.patch > > > If you need to analyze the root cause of a query's failure to match some > document, you can use the Weight.explain() API. If you want to do some gross > analysis of a whole batch of queries, say scraped from a log, that once > matched, but no longer do, perhaps after some refactoring or other > large-scale change, the Explanation isn't very good for that. You can try > parsing its textual output, which is pretty regular, but instead I found it > convenient to add some boolean structure to Explanation, and use that to find > failing leaves on the Explanation tree, and report only those. > This patch adds a "condition" to each Explanation, which can be REQUIRED, > OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to > the Boolean Occur, except for NONE, which is used to indicate a node which > can't be further decomposed. It adds new Explanation construction methods for > creating Explanations with conditions (defaulting to NONE with the existing > methods). > Finally Explanation.getFailureCauses() returns a list of Strings that are the > one-line explanations of the failing queries that, if some of them had > succeeded, would have made the original overall query match. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[ https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221250#comment-16221250 ] Mike Sokolov commented on LUCENE-8019: -- Ah, OK fair enough. Perhaps it's better to to implement this as a separate Weight visitor. I'll look at that. > Add a root failure cause to Explanation > > > Key: LUCENE-8019 > URL: https://issues.apache.org/jira/browse/LUCENE-8019 > Project: Lucene - Core > Issue Type: New Feature >Reporter: Mike Sokolov > Attachments: LUCENE_8019.patch > > > If you need to analyze the root cause of a query's failure to match some > document, you can use the Weight.explain() API. If you want to do some gross > analysis of a whole batch of queries, say scraped from a log, that once > matched, but no longer do, perhaps after some refactoring or other > large-scale change, the Explanation isn't very good for that. You can try > parsing its textual output, which is pretty regular, but instead I found it > convenient to add some boolean structure to Explanation, and use that to find > failing leaves on the Explanation tree, and report only those. > This patch adds a "condition" to each Explanation, which can be REQUIRED, > OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to > the Boolean Occur, except for NONE, which is used to indicate a node which > can't be further decomposed. It adds new Explanation construction methods for > creating Explanations with conditions (defaulting to NONE with the existing > methods). > Finally Explanation.getFailureCauses() returns a list of Strings that are the > one-line explanations of the failing queries that, if some of them had > succeeded, would have made the original overall query match. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[ https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221134#comment-16221134 ] Robert Muir commented on LUCENE-8019: - Weight already has such a method: Scorer.getChildren > Add a root failure cause to Explanation > > > Key: LUCENE-8019 > URL: https://issues.apache.org/jira/browse/LUCENE-8019 > Project: Lucene - Core > Issue Type: New Feature >Reporter: Mike Sokolov > Attachments: LUCENE_8019.patch > > > If you need to analyze the root cause of a query's failure to match some > document, you can use the Weight.explain() API. If you want to do some gross > analysis of a whole batch of queries, say scraped from a log, that once > matched, but no longer do, perhaps after some refactoring or other > large-scale change, the Explanation isn't very good for that. You can try > parsing its textual output, which is pretty regular, but instead I found it > convenient to add some boolean structure to Explanation, and use that to find > failing leaves on the Explanation tree, and report only those. > This patch adds a "condition" to each Explanation, which can be REQUIRED, > OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to > the Boolean Occur, except for NONE, which is used to indicate a node which > can't be further decomposed. It adds new Explanation construction methods for > creating Explanations with conditions (defaulting to NONE with the existing > methods). > Finally Explanation.getFailureCauses() returns a list of Strings that are the > one-line explanations of the failing queries that, if some of them had > succeeded, would have made the original overall query match. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[ https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221059#comment-16221059 ] Mike Sokolov commented on LUCENE-8019: -- The challenge with doing this by modifying booleanweight is that it really needs to be threaded all up and down the tree to be useful. To go that route, I think we'd have to add methods to weight? > Add a root failure cause to Explanation > > > Key: LUCENE-8019 > URL: https://issues.apache.org/jira/browse/LUCENE-8019 > Project: Lucene - Core > Issue Type: New Feature >Reporter: Mike Sokolov > Attachments: LUCENE_8019.patch > > > If you need to analyze the root cause of a query's failure to match some > document, you can use the Weight.explain() API. If you want to do some gross > analysis of a whole batch of queries, say scraped from a log, that once > matched, but no longer do, perhaps after some refactoring or other > large-scale change, the Explanation isn't very good for that. You can try > parsing its textual output, which is pretty regular, but instead I found it > convenient to add some boolean structure to Explanation, and use that to find > failing leaves on the Explanation tree, and report only those. > This patch adds a "condition" to each Explanation, which can be REQUIRED, > OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to > the Boolean Occur, except for NONE, which is used to indicate a node which > can't be further decomposed. It adds new Explanation construction methods for > creating Explanations with conditions (defaulting to NONE with the existing > methods). > Finally Explanation.getFailureCauses() returns a list of Strings that are the > one-line explanations of the failing queries that, if some of them had > succeeded, would have made the original overall query match. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-8019) Add a root failure cause to Explanation
[
https://issues.apache.org/jira/browse/LUCENE-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220918#comment-16220918
]
Robert Muir commented on LUCENE-8019:
-
I don't like the idea of boolean query's logic being shoved into the
explanation class. This should not be in explanation, it should be generic.
I don't think explanation class should be complicated by matching/non-matching
stuff. If we want to improve the booleanweight impl (such as the strings it
puts in there), that is one thing, but its not the responsibility of
explanation to do this.
explain() is supposed to be about scoring, not matching:
{noformat}
Returns an Explanation that describes how doc scored against query.
{noformat}
We should keep it focused on that, without adding a lot of complexity related
to "matching" which is not its job. it already has enough challenges trying to
explain scores...
> Add a root failure cause to Explanation
>
>
> Key: LUCENE-8019
> URL: https://issues.apache.org/jira/browse/LUCENE-8019
> Project: Lucene - Core
> Issue Type: New Feature
>Reporter: Mike Sokolov
> Attachments: LUCENE_8019.patch
>
>
> If you need to analyze the root cause of a query's failure to match some
> document, you can use the Weight.explain() API. If you want to do some gross
> analysis of a whole batch of queries, say scraped from a log, that once
> matched, but no longer do, perhaps after some refactoring or other
> large-scale change, the Explanation isn't very good for that. You can try
> parsing its textual output, which is pretty regular, but instead I found it
> convenient to add some boolean structure to Explanation, and use that to find
> failing leaves on the Explanation tree, and report only those.
> This patch adds a "condition" to each Explanation, which can be REQUIRED,
> OPTIONAL, PROHIBITED, or NONE. The conditions correspond in obvious ways to
> the Boolean Occur, except for NONE, which is used to indicate a node which
> can't be further decomposed. It adds new Explanation construction methods for
> creating Explanations with conditions (defaulting to NONE with the existing
> methods).
> Finally Explanation.getFailureCauses() returns a list of Strings that are the
> one-line explanations of the failing queries that, if some of them had
> succeeded, would have made the original overall query match.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
