[jira] [Commented] (SOLR-5125) Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException
[ https://issues.apache.org/jira/browse/SOLR-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13800250#comment-13800250 ] ASF subversion and git services commented on SOLR-5125: --- Commit 1533995 from [~elyograg] in branch 'dev/trunk' [ https://svn.apache.org/r1533995 ] SOLR-5042 SOLR-5125 SOLR-5368: mlt.count used incorrectly in MoreLikeThisComponent. Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException -- Key: SOLR-5125 URL: https://issues.apache.org/jira/browse/SOLR-5125 Project: Solr Issue Type: Bug Components: MoreLikeThis Affects Versions: 4.4 Reporter: Shawn Heisey Fix For: 4.6 Attachments: SOLR-5125.patch A distributed MoreLikeThis query that works perfectly on 4.2.1 is failing on 4.4.0. The original query returns a NullPointerException. The Solr log shows that the shard queries are throwing EarlyTerminatingCollectorException. Full details to follow in the comments. -- This message was sent by Atlassian JIRA (v6.1#6144) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5125) Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException
[ https://issues.apache.org/jira/browse/SOLR-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13800275#comment-13800275 ] ASF subversion and git services commented on SOLR-5125: --- Commit 1534005 from [~elyograg] in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1534005 ] SOLR-5042 SOLR-5125 SOLR-5368: mlt.count used incorrectly in MoreLikeThisComponent. (merge trunk r1533995) Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException -- Key: SOLR-5125 URL: https://issues.apache.org/jira/browse/SOLR-5125 Project: Solr Issue Type: Bug Components: MoreLikeThis Affects Versions: 4.4 Reporter: Shawn Heisey Fix For: 4.6 Attachments: SOLR-5125.patch A distributed MoreLikeThis query that works perfectly on 4.2.1 is failing on 4.4.0. The original query returns a NullPointerException. The Solr log shows that the shard queries are throwing EarlyTerminatingCollectorException. Full details to follow in the comments. -- This message was sent by Atlassian JIRA (v6.1#6144) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5125) Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException
[ https://issues.apache.org/jira/browse/SOLR-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13785906#comment-13785906 ] Anshum Gupta commented on SOLR-5125: I've just put up a patch for SOLR-5042 that should fix this issue. mlt.count was basically being used up as the flag value and SolrIndexSearcher.TERMINATE_EARLY = 0x04 perhaps explains why a value of 10 screwed up score, 100 screwed up with EarlyTerminatingCollectorException. Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException -- Key: SOLR-5125 URL: https://issues.apache.org/jira/browse/SOLR-5125 Project: Solr Issue Type: Bug Components: MoreLikeThis Affects Versions: 4.4 Reporter: Shawn Heisey Fix For: 4.5, 5.0 Attachments: SOLR-5125.patch A distributed MoreLikeThis query that works perfectly on 4.2.1 is failing on 4.4.0. The original query returns a NullPointerException. The Solr log shows that the shard queries are throwing EarlyTerminatingCollectorException. Full details to follow in the comments. -- This message was sent by Atlassian JIRA (v6.1#6144) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5125) Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException
[ https://issues.apache.org/jira/browse/SOLR-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13743327#comment-13743327 ] Mark Miller commented on SOLR-5125: --- bq. DistributedMLTComponentTest is currently @Ignored Yeah - for some reason it was faily constantly on freebsd, but passing on other OS's - I've never gotten back to it.. bq. it seems to only be verifying that the control client matches the distrib client Yup - it's about as basic a test as you can get. I'm not sure that it's useless though - there should be tests for non distributed mlt - so if distrib mlt matches it, that seems like it's doing something useful. Basically, I tried to bang out the simplest thing I could that seemed to make distributed mlt possible - I had absolutely no need for it, but its a common user request. I tried to get someone that did have an interest in it to test it out at the time, but since no one responded, I figured it was an improvement over no support at all - if it didn't work in all cases, JIRA's would be filed, things would move forward, blah blah Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException -- Key: SOLR-5125 URL: https://issues.apache.org/jira/browse/SOLR-5125 Project: Solr Issue Type: Bug Components: MoreLikeThis Affects Versions: 4.4 Reporter: Shawn Heisey Fix For: 4.5, 5.0 Attachments: SOLR-5125.patch A distributed MoreLikeThis query that works perfectly on 4.2.1 is failing on 4.4.0. The original query returns a NullPointerException. The Solr log shows that the shard queries are throwing EarlyTerminatingCollectorException. Full details to follow in the comments. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5125) Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException
[ https://issues.apache.org/jira/browse/SOLR-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13743389#comment-13743389 ] Shawn Heisey commented on SOLR-5125: [~markrmil...@gmail.com] Thank you for getting it in. At the time I couldn't make it work at all, so I shelved it. The powers that be are interested in it again, so I dusted it off and gave it another try. I now have things working, after discovering SOLR-5161 ... but there are some severe performance issues. I thought it would be a good idea to explore those deeper before filing a new issue, see if I'm doing something wrong. I'm on IRC most days and have a dev server with all my data if anyone is interested in some interactive digging. Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException -- Key: SOLR-5125 URL: https://issues.apache.org/jira/browse/SOLR-5125 Project: Solr Issue Type: Bug Components: MoreLikeThis Affects Versions: 4.4 Reporter: Shawn Heisey Fix For: 4.5, 5.0 Attachments: SOLR-5125.patch A distributed MoreLikeThis query that works perfectly on 4.2.1 is failing on 4.4.0. The original query returns a NullPointerException. The Solr log shows that the shard queries are throwing EarlyTerminatingCollectorException. Full details to follow in the comments. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5125) Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException
[ https://issues.apache.org/jira/browse/SOLR-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13743097#comment-13743097 ] Shawn Heisey commented on SOLR-5125: The patch seems to work. A query with mlt.count=100 returned results. All Solr tests passed with the patch applied. Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException -- Key: SOLR-5125 URL: https://issues.apache.org/jira/browse/SOLR-5125 Project: Solr Issue Type: Bug Components: MoreLikeThis Affects Versions: 4.4 Reporter: Shawn Heisey Fix For: 4.5, 5.0 Attachments: SOLR-5125.patch A distributed MoreLikeThis query that works perfectly on 4.2.1 is failing on 4.4.0. The original query returns a NullPointerException. The Solr log shows that the shard queries are throwing EarlyTerminatingCollectorException. Full details to follow in the comments. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5125) Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException
[ https://issues.apache.org/jira/browse/SOLR-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13742600#comment-13742600 ] Shawn Heisey commented on SOLR-5125: Does anyone have any ideas here? The same thing happens with a 4x snapshot: 4.5-SNAPSHOT 1514424 - ncindex - 2013-08-15 12:56:50 Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException -- Key: SOLR-5125 URL: https://issues.apache.org/jira/browse/SOLR-5125 Project: Solr Issue Type: Bug Components: MoreLikeThis Affects Versions: 4.4 Reporter: Shawn Heisey Fix For: 4.5, 5.0 A distributed MoreLikeThis query that works perfectly on 4.2.1 is failing on 4.4.0. The original query returns a NullPointerException. The Solr log shows that the shard queries are throwing EarlyTerminatingCollectorException. Full details to follow in the comments. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5125) Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException
[
https://issues.apache.org/jira/browse/SOLR-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13742721#comment-13742721
]
Hoss Man commented on SOLR-5125:
EarlyTerminatingCollector, and EarlyTerminationCollectorException are new in
4.4 -- they are triggered if the flags passed to getDocListNC match the mask
specified by the constant TERMINATE_EARLY (0x04). The only code using that
flag is in he SpellChecker.
Digging through the stack trace [~elyograg] posted however, shows that the
MLTComponent is passing the value of the mlt.count param as if it were a
flags bitset...
{noformat}
// MoreLikeThisComponent.process(MoreLikeThisComponent.java:78)
int mltcount = params.getInt(MoreLikeThisParams.DOC_COUNT, 5);
// MoreLikeThisComponent.process(MoreLikeThisComponent.java:107)
NamedListDocList sim = getMoreLikeThese(rb, rb.req.getSearcher(),
rb.getResults().docList, mltcount);
// MoreLikeThisComponent.getMoreLikeThese(MoreLikeThisComponent.java:339)
NamedListDocList getMoreLikeThese(ResponseBuilder rb,
SolrIndexSearcher searcher, DocList docs, int flags) throws IOException {
// MoreLikeThisComponent.getMoreLikeThese(MoreLikeThisComponent.java:356)
DocListAndSet sim = mltHelper.getMoreLikeThis(id, 0, rows, null, null, flags);
// MoreLikeThisHelper.getMoreLikeThis(MoreLikeThisHandler.java:345)
public DocListAndSet getMoreLikeThis( int id, int start, int rows, ListQuery
filters, ListInterestingTerm terms, int flags ) throws IOException
// MoreLikeThisHelper.getMoreLikeThis(MoreLikeThisHandler.java:365)
results.docList = searcher.getDocList(realMLTQuery, filters, null, start, rows,
flags);
{noformat}
...so a value like 100 matches the mask, but a value like 99 won't.
The question is: what flags *should* be getting passed into these methods, and
is mltCount getting used correctly wherever it should be getting used in
addition to this totally bogus flags usage?
Distributed MoreLikeThis fails with NullPointerException, shard query gives
EarlyTerminatingCollectorException
--
Key: SOLR-5125
URL: https://issues.apache.org/jira/browse/SOLR-5125
Project: Solr
Issue Type: Bug
Components: MoreLikeThis
Affects Versions: 4.4
Reporter: Shawn Heisey
Fix For: 4.5, 5.0
A distributed MoreLikeThis query that works perfectly on 4.2.1 is failing on
4.4.0. The original query returns a NullPointerException. The Solr log
shows that the shard queries are throwing EarlyTerminatingCollectorException.
Full details to follow in the comments.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5125) Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException
[ https://issues.apache.org/jira/browse/SOLR-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13742845#comment-13742845 ] Shawn Heisey commented on SOLR-5125: [~hossman] theorized that even a non-distributed MLT request with mlt.count=100 would fail in the same way. He was right. A value of 99 works in either case. I have a full index rebuild underway that won't be finished for a few more hours. It's bedtime, so I will try the patch out tomorrow. Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException -- Key: SOLR-5125 URL: https://issues.apache.org/jira/browse/SOLR-5125 Project: Solr Issue Type: Bug Components: MoreLikeThis Affects Versions: 4.4 Reporter: Shawn Heisey Fix For: 4.5, 5.0 Attachments: SOLR-5125.patch A distributed MoreLikeThis query that works perfectly on 4.2.1 is failing on 4.4.0. The original query returns a NullPointerException. The Solr log shows that the shard queries are throwing EarlyTerminatingCollectorException. Full details to follow in the comments. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5125) Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException
[
https://issues.apache.org/jira/browse/SOLR-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13733816#comment-13733816
]
Shawn Heisey commented on SOLR-5125:
The query that works fine in 4.2.1 has the following URL:
/solr/ncmain/ncdismax?q=tag_id:ugphotos000996mlt=truemlt.fl=catchallmlt.count=100
The ncmain handler has the shards parameter in solrconfig.xml and is set up for
edismax. The shards.qt parameter is /search, a handler using the default query
parser. On 4.2.1, it had a QTime of 49641, a performance issue that I
mentioned on the mailing list and will be pursuing there. Here's a server log
excerpt, showing a shard request, the shard exception, the original query, and
the final exception.
{noformat}
INFO - 2013-08-08 12:18:20.030; org.apache.solr.core.SolrCore; [s3live]
webapp=/solr path=/search
params={mlt.fl=catchallsort=score+desctie=0.1shards.qt=/searchmlt.dist.id=ugphotos000996mlt=trueq.alt=*:*distrib=falseshards.tolerant=trueversion=2NOW=1375985885078shard.url=bigindy5.REDACTED.com:8982/solr/s3livedf=catchallfl=score,tag_idqs=3qt=/searchlowercaseOperators=falsemm=100%25qf=catchallwt=javabinrows=100defType=edismaxpf=catchall^2mlt.count=100start=0q=%2B(catchall:arabian+catchall:close-up+catchall:horse+catchall:closeup+catchall:close+catchall:white+catchall:up+catchall:sassy+catchall:154+catchall:equestrian+catchall:domestic+catchall:animals+catchall:of)+-tag_id:ugphotos000996shards.info=trueboost=min(recip(abs(ms(NOW/HOUR,pd)),1.92901e-10,1.5,1.5),0.85)isShard=trueps=3}
6815483 status=500 QTime=14639
ERROR - 2013-08-08 12:18:20.030; org.apache.solr.common.SolrException;
null:org.apache.solr.search.EarlyTerminatingCollectorException
at
org.apache.solr.search.EarlyTerminatingCollector.collect(EarlyTerminatingCollector.java:62)
at
org.apache.lucene.search.BooleanScorer2.score(BooleanScorer2.java:289)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:624)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:297)
at
org.apache.solr.search.SolrIndexSearcher.getDocListNC(SolrIndexSearcher.java:1494)
at
org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1363)
at
org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:474)
at
org.apache.solr.search.SolrIndexSearcher.getDocList(SolrIndexSearcher.java:1226)
at
org.apache.solr.handler.MoreLikeThisHandler$MoreLikeThisHelper.getMoreLikeThis(MoreLikeThisHandler.java:365)
at
org.apache.solr.handler.component.MoreLikeThisComponent.getMoreLikeThese(MoreLikeThisComponent.java:356)
at
org.apache.solr.handler.component.MoreLikeThisComponent.process(MoreLikeThisComponent.java:107)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1904)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:659)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:362)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:560)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1072)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:365)
at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
at
org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[jira] [Commented] (SOLR-5125) Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException
[ https://issues.apache.org/jira/browse/SOLR-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13733833#comment-13733833 ] Shawn Heisey commented on SOLR-5125: Here's someone else having the same problem. They don't say whether it's a single index or distributed, though. http://stackoverflow.com/questions/17866313/earlyterminatingcollectorexception-in-mlt-component-of-solr-4-4 Distributed MoreLikeThis fails with NullPointerException, shard query gives EarlyTerminatingCollectorException -- Key: SOLR-5125 URL: https://issues.apache.org/jira/browse/SOLR-5125 Project: Solr Issue Type: Bug Components: MoreLikeThis Affects Versions: 4.4 Reporter: Shawn Heisey Fix For: 4.5, 5.0 A distributed MoreLikeThis query that works perfectly on 4.2.1 is failing on 4.4.0. The original query returns a NullPointerException. The Solr log shows that the shard queries are throwing EarlyTerminatingCollectorException. Full details to follow in the comments. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
