Re: Facet search on a docvalue field in a multi shard collection
Hi Erick Thanks for your input. I have retrieved and build the branch http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_5 Doing the same setup as in my previous post (two shard collection, fieldA af docValue type, index a single document and doing a facet search on fieldA), I now get the below exception. The cause (which is not visible from the stacktrace) is as previous: Cannot use facet.mincount=0 on field fieldA which is not indexed What could be my next steps from here? 620710 [qtp1728933440-15] ERROR org.apache.solr.core.SolrCore ▒ org.apache.solr.common.SolrException: Exception during facet.field: fieldA. at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:569) at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:554) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at org.apache.solr.request.SimpleFacets$1.execute(SimpleFacets.java:508) at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:579) at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:265) at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1859) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:703) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:406) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:195) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:724) Den 22-09-2013 17:09, Erick Erickson skrev: right, I think you're running into a bug I remember going by. I can't find it now, JIRA seems to be not responding. As I remember, where if a shard doesn't have a doc on it, you get an error. Although why facet.limit should figure in here is a mystery to me, maybe a coincidence? Significant work has been done about not requiring values for DocValues fields and stuff. Can you give a try on 4.x or the soon-to-be-released 4.5? Best, Erick On Sun, Sep 22, 2013 at 6:26 AM, Trym R. Møller t...@sigmat.dk wrote: Hi I have a problem doing facet search on a doc value field in a multi shard collection. Any ideas what I may be doing wrong? My Solr schema specifies fieldA as a docvalue type and I have created a two shard collection using Solr 4.4.0. When I do a facet search on fieldA with a large facet.limit then the query fails with the below exception A large facet.limit seems to be when (10 + (facet.limit * 1,5)) * number of shards rows matching my query The exception does not occur when I run with a single shard collection. It can easily be reproduced by indexing a single row and
Re: Facet search on a docvalue field in a multi shard collection
I haven't dived into the code, but it sure looks like a JIRA to me, can you open one? Best, Erick On Mon, Sep 23, 2013 at 1:48 AM, Trym R. Møller t...@sigmat.dk wrote: Hi Erick Thanks for your input. I have retrieved and build the branch http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_5 Doing the same setup as in my previous post (two shard collection, fieldA af docValue type, index a single document and doing a facet search on fieldA), I now get the below exception. The cause (which is not visible from the stacktrace) is as previous: Cannot use facet.mincount=0 on field fieldA which is not indexed What could be my next steps from here? 620710 [qtp1728933440-15] ERROR org.apache.solr.core.SolrCore ▒ org.apache.solr.common.SolrException: Exception during facet.field: fieldA. at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:569) at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:554) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at org.apache.solr.request.SimpleFacets$1.execute(SimpleFacets.java:508) at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:579) at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:265) at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1859) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:703) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:406) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:195) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:724) Den 22-09-2013 17:09, Erick Erickson skrev: right, I think you're running into a bug I remember going by. I can't find it now, JIRA seems to be not responding. As I remember, where if a shard doesn't have a doc on it, you get an error. Although why facet.limit should figure in here is a mystery to me, maybe a coincidence? Significant work has been done about not requiring values for DocValues fields and stuff. Can you give a try on 4.x or the soon-to-be-released 4.5? Best, Erick On Sun, Sep 22, 2013 at 6:26 AM, Trym R. Møller t...@sigmat.dk wrote: Hi I have a problem doing facet search on a doc value field in a multi shard collection. Any ideas what I may be doing wrong? My Solr schema specifies fieldA as a docvalue type and I have created a two shard collection using Solr 4.4.0. When I do a facet search on fieldA with a large facet.limit then the query fails with the below exception A
Re: Facet search on a docvalue field in a multi shard collection
Hi I have created https://issues.apache.org/jira/browse/SOLR-5260 as proposed by Erick. I hope anyone working with doc values can lead me in a direction of how to solve the bug. Best regards Trym Den 23-09-2013 16:01, Erick Erickson skrev: I haven't dived into the code, but it sure looks like a JIRA to me, can you open one? Best, Erick On Mon, Sep 23, 2013 at 1:48 AM, Trym R. Møller t...@sigmat.dk wrote: Hi Erick Thanks for your input. I have retrieved and build the branch http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_5 Doing the same setup as in my previous post (two shard collection, fieldA af docValue type, index a single document and doing a facet search on fieldA), I now get the below exception. The cause (which is not visible from the stacktrace) is as previous: Cannot use facet.mincount=0 on field fieldA which is not indexed What could be my next steps from here? 620710 [qtp1728933440-15] ERROR org.apache.solr.core.SolrCore ▒ org.apache.solr.common.SolrException: Exception during facet.field: fieldA. at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:569) at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:554) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at org.apache.solr.request.SimpleFacets$1.execute(SimpleFacets.java:508) at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:579) at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:265) at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1859) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:703) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:406) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:195) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:724) Den 22-09-2013 17:09, Erick Erickson skrev: right, I think you're running into a bug I remember going by. I can't find it now, JIRA seems to be not responding. As I remember, where if a shard doesn't have a doc on it, you get an error. Although why facet.limit should figure in here is a mystery to me, maybe a coincidence? Significant work has been done about not requiring values for DocValues fields and stuff. Can you give a try on 4.x or the soon-to-be-released 4.5? Best, Erick On Sun, Sep 22, 2013 at 6:26 AM, Trym R. Møller t...@sigmat.dk wrote: Hi I have a problem doing facet search on a doc value field in a multi shard collection. Any ideas what I may be doing wrong? My Solr schema specifies fieldA as a docvalue type and I have created a
Facet search on a docvalue field in a multi shard collection
Hi
I have a problem doing facet search on a doc value field in a multi
shard collection. Any ideas what I may be doing wrong?
My Solr schema specifies fieldA as a docvalue type and I have created a
two shard collection using Solr 4.4.0.
When I do a facet search on fieldA with a large facet.limit then the
query fails with the below exception
A large facet.limit seems to be when (10 + (facet.limit * 1,5)) *
number of shards rows matching my query
The exception does not occur when I run with a single shard collection.
It can easily be reproduced by indexing a single row and querying it, as
the default facet.limit is 100.
The facet query received by Solr looks as follows:
576793 [qtp170860084-18] INFO org.apache.solr.core.SolrCore ¦
[trym_shard2_replica1] webapp=/solr path=/select
params={facet=truestart=0q=*:*distrib=truecollection=trymfacet.field=fieldAwt=javabinversion=2rows=0}
status=500 QTime=20
One of the internal query send by Solr to its shard looks like
576783 [qtp170860084-19] INFO org.apache.solr.core.SolrCore ¦
[trym_shard1_replica1] webapp=/solr path=/select
params={facet=truedistrib=falsecollection=trym
wt=javabinversion=2rows=0NOW=1379855011787shard.url=192.168.56.1:8501/solr/trym_shard1_replica1/df=textfl=id,scoref.fieldA.facet.limit=160start=0q=*:
*facet.field=fieldAisShard=truefsv=true} hits=1 status=500 QTime=2
576784 [qtp170860084-17] ERROR
org.apache.solr.servlet.SolrDispatchFilter ¦
null:java.lang.IllegalStateException: Cannot use facet.mincount=0 on a
field which is not indexed
at
org.apache.solr.request.NumericFacets.getCounts(NumericFacets.java:257)
at
org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:423)
at
org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:530)
at
org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:259)
at
org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1904)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:659)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:362)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at
org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:724)
My schema.xml contains the following lines (among others :-))
dynamicField name=*A type=dlong indexed=false stored=true
Facet search on a docvalue field in a multi shard collection
Hi
I have a problem doing facet search on a doc value field in a multi
shard collection. Any ideas what I may be doing wrong?
My Solr schema specifies fieldA as a docvalue type and I have created a
two shard collection using Solr 4.4.0.
When I do a facet search on fieldA with a large facet.limit then the
query fails with the below exception
A large facet.limit seems to be when (10 + (facet.limit * 1,5)) *
number of shards rows matching my query
The exception does not occur when I run with a single shard collection.
It can easily be reproduced by indexing a single row and querying it, as
the default facet.limit is 100.
The facet query received by Solr looks as follows:
576793 [qtp170860084-18] INFO org.apache.solr.core.SolrCore ¦
[trym_shard2_replica1] webapp=/solr path=/select
params={facet=truestart=0q=*:*distrib=truecollection=trymfacet.field=fieldAwt=javabinversion=2rows=0}
status=500 QTime=20
One of the internal query send by Solr to its shard looks like
576783 [qtp170860084-19] INFO org.apache.solr.core.SolrCore ¦
[trym_shard1_replica1] webapp=/solr path=/select
params={facet=truedistrib=falsecollection=trym
wt=javabinversion=2rows=0NOW=1379855011787shard.url=192.168.56.1:8501/solr/trym_shard1_replica1/df=textfl=id,scoref.fieldA.facet.limit=160start=0q=*:
*facet.field=fieldAisShard=truefsv=true} hits=1 status=500 QTime=2
576784 [qtp170860084-17] ERROR
org.apache.solr.servlet.SolrDispatchFilter ¦
null:java.lang.IllegalStateException: Cannot use facet.mincount=0 on a
field which is not indexed
at
org.apache.solr.request.NumericFacets.getCounts(NumericFacets.java:257)
at
org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:423)
at
org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:530)
at
org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:259)
at
org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1904)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:659)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:362)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at
org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:724)
My schema.xml contains the following lines (among others :-))
dynamicField name=*A type=dlong indexed=false stored=true
Re: Facet search on a docvalue field in a multi shard collection
right, I think you're running into a bug I remember going by. I can't
find it now, JIRA seems to be not responding. As I remember,
where if a shard doesn't have a doc on it, you get an error.
Although why facet.limit should figure in here is a mystery to me,
maybe a coincidence?
Significant work has been done about not requiring values for
DocValues fields and stuff. Can you give a try on 4.x or the
soon-to-be-released 4.5?
Best,
Erick
On Sun, Sep 22, 2013 at 6:26 AM, Trym R. Møller t...@sigmat.dk wrote:
Hi
I have a problem doing facet search on a doc value field in a multi shard
collection. Any ideas what I may be doing wrong?
My Solr schema specifies fieldA as a docvalue type and I have created a two
shard collection using Solr 4.4.0.
When I do a facet search on fieldA with a large facet.limit then the query
fails with the below exception
A large facet.limit seems to be when (10 + (facet.limit * 1,5)) * number
of shards rows matching my query
The exception does not occur when I run with a single shard collection.
It can easily be reproduced by indexing a single row and querying it, as the
default facet.limit is 100.
The facet query received by Solr looks as follows:
576793 [qtp170860084-18] INFO org.apache.solr.core.SolrCore ¦
[trym_shard2_replica1] webapp=/solr path=/select
params={facet=truestart=0q=*:*distrib=truecollection=trymfacet.field=fieldAwt=javabinversion=2rows=0}
status=500 QTime=20
One of the internal query send by Solr to its shard looks like
576783 [qtp170860084-19] INFO org.apache.solr.core.SolrCore ¦
[trym_shard1_replica1] webapp=/solr path=/select
params={facet=truedistrib=falsecollection=trym
wt=javabinversion=2rows=0NOW=1379855011787shard.url=192.168.56.1:8501/solr/trym_shard1_replica1/df=textfl=id,scoref.fieldA.facet.limit=160start=0q=*:
*facet.field=fieldAisShard=truefsv=true} hits=1 status=500 QTime=2
576784 [qtp170860084-17] ERROR org.apache.solr.servlet.SolrDispatchFilter ¦
null:java.lang.IllegalStateException: Cannot use facet.mincount=0 on a field
which is not indexed
at
org.apache.solr.request.NumericFacets.getCounts(NumericFacets.java:257)
at
org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:423)
at
org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:530)
at
org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:259)
at
org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1904)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:659)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:362)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at
org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at
