Hi I might be wrong but it's your responsibility to put unique doc IDs across shards.
read this page http://wiki.apache.org/solr/DistributedSearch#Distributed_Searching_Limitations particualry - Documents must have a unique key and the unique key must be stored (stored="true" in schema.xml) - *The unique key field must be unique across all shards.* If docs with duplicate unique keys are encountered, Solr will make an attempt to return valid results, but the behavior may be non-deterministic. So solr bahaves as it should :) _unexpectidly_ But I agree in that sence that there must be no error especially such as NPE. Best Regards Alexander Aristov On 21 April 2012 03:42, Peter Markey <sudoma...@gmail.com> wrote: > Hello, > > I have been trying out deduplication in solr by following: > http://wiki.apache.org/solr/Deduplication. I have defined a signature > field > to hold the values of the signature created based on few other fields in a > document and the idea seems to work like a charm in a single solr instance. > But, when I have multiple cores and try to do a distributed search ( > > Http://localhost:8080/solr/core0/select?q=*&shards=localhost:8080/solr/dedupe,localhost:8080/solr/dedupe2&facet=true&facet.field=doc_id > ) > I get the error pasted below. While normal search (with just q) works fine, > the facet/stats queries seem to be the culprit. The doc_id contains > duplicate ids since I'm testing the same set of documents indexed in both > the cores(dedupe, dedupe2). Any insights would be highly appreciated. > > Thanks > > > > 20-Apr-2012 11:39:35 PM org.apache.solr.common.SolrException log > SEVERE: java.lang.NullPointerException > at > > org.apache.solr.handler.component.QueryComponent.mergeIds(QueryComponent.java:887) > at > > org.apache.solr.handler.component.QueryComponent.handleRegularResponses(QueryComponent.java:633) > at > > org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:612) > at > > org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:307) > at > > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1540) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:435) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:256) > at > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) > at > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) > at > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224) > at > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169) > at > > org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472) > at > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168) > at > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98) > at > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927) > at > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118) > at > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407) > at > > org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987) > at > > org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579) > at > > org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) >
