[ 
https://jira.duraspace.org/browse/DS-1601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=28555#comment-28555
 ] 

Andrea Bollini commented on DS-1601:
------------------------------------

The issue is due to the highlighting component that is trying to rewrite the 
range query in a bigger boolean query (all terms in your fulltext field).
Basic query without highlighting works differently because they are rewritten 
as ConstantScoreQuery, see
http://lucene.472066.n3.nabble.com/maxClauseCount-Exception-tp3767435p3811329.html

We should try to "understand" such query and disable at runtime the highlighting
                
> fulltext:[* TO *] discovery query throws exception
> --------------------------------------------------
>
>                 Key: DS-1601
>                 URL: https://jira.duraspace.org/browse/DS-1601
>             Project: DSpace
>          Issue Type: Bug
>          Components: Discovery
>    Affects Versions: 3.0, 3.1
>            Reporter: Ivan Masár
>              Labels: discovery, highlighting, solr
>
> The fulltext:[* TO *] Discovery query can be used to find all items that have 
> a bitstream. This used to work in DSpace 1.8, but is broken in DSpace 3 when 
> search results highlighting is enabled.
> I was able to get it to work by setting maxClauseCount to 4096 (the default 
> is 1024), but the query also took quite long.
> INFO: [search] webapp=/solr path=/select 
> params={f.dc.title_hl.hl.fragsize=0&f.dc.title_hl.hl.snippets=5&sort=score+desc&hl.fl=dc.description.abstract_hl&hl.fl=dc.title_hl&hl.fl=dc.contributor.author_hl&hl.fl=fulltext_hl&f.fulltext_hl.hl.fragsize=250&wt=javabin&hl=true&rows=10&version=2&f.fulltext_hl.hl.snippets=2&f.dc.description.abstract_hl.hl.snippets=2&f.dc.contributor.author_hl.hl.snippets=5&start=0&q=fulltext:[*+TO+*]&f.dc.contributor.author_hl.hl.fragsize=0&hl.usePhraseHighlighter=true&fq=NOT(withdrawn:true)&fq=read:(g0)&f.dc.description.abstract_hl.hl.fragsize=250}
>  hits=15863 status=500 QTime=3118
> Jul 12, 2013 5:03:35 PM org.apache.solr.common.SolrException log
> SEVERE: org.apache.lucene.search.BooleanQuery$TooManyClauses: maxClauseCount 
> is set to 1024
>         at org.apache.lucene.search.BooleanQuery.add(BooleanQuery.java:136)
>         at org.apache.lucene.search.BooleanQuery.add(BooleanQuery.java:127)
>         at 
> org.apache.lucene.search.ScoringRewrite$1.addClause(ScoringRewrite.java:51)
>         at 
> org.apache.lucene.search.ScoringRewrite$1.addClause(ScoringRewrite.java:41)
>         at 
> org.apache.lucene.search.ScoringRewrite$3.collect(ScoringRewrite.java:95)
>         at 
> org.apache.lucene.search.TermCollectingRewrite.collectTerms(TermCollectingRewrite.java:38)
>         at 
> org.apache.lucene.search.ScoringRewrite.rewrite(ScoringRewrite.java:93)
>         at 
> org.apache.lucene.search.MultiTermQuery.rewrite(MultiTermQuery.java:304)
>         at 
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.extract(WeightedSpanTermExtractor.java:158)
>         at 
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.getWeightedSpanTerms(WeightedSpanTermExtractor.java:385)
>         at 
> org.apache.lucene.search.highlight.QueryScorer.initExtractor(QueryScorer.java:217)
>         at 
> org.apache.lucene.search.highlight.QueryScorer.init(QueryScorer.java:185)
>         at 
> org.apache.lucene.search.highlight.Highlighter.getBestTextFragments(Highlighter.java:205)
>         at 
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingByHighlighter(DefaultSolrHighlighter.java:490)
>         at 
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlighting(DefaultSolrHighlighter.java:401)
>         at 
> org.apache.solr.handler.component.HighlightComponent.process(HighlightComponent.java:131)
>         at 
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:194)
>         at 
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1372)
>         at 
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>         at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>         at 
> org.dspace.solr.filters.LocalHostRestrictionFilter.doFilter(LocalHostRestrictionFilter.java:60)
>         at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>         at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>         at 
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
>         at 
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
>         at 
> org.apache.catalina.valves.RequestFilterValve.process(RequestFilterValve.java:316)
>         at 
> org.apache.catalina.valves.RemoteAddrValve.invoke(RemoteAddrValve.java:81)
>         at 
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>         at 
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
>         at 
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
>         at 
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
>         at 
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
>         at 
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
>         at 
> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
>         at java.lang.Thread.run(Thread.java:636)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

------------------------------------------------------------------------------
See everything from the browser to the database with AppDynamics
Get end-to-end visibility with application monitoring from AppDynamics
Isolate bottlenecks and diagnose root cause in seconds.
Start your free trial of AppDynamics Pro today!
http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
_______________________________________________
Dspace-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-devel

Reply via email to