Re: Binary content index with multiple cores
Ok i find a way to use it, it was a problem with librairies. In fact i dont want to index PDF or Word directly i just want to get the content to add into my document content so i guess i will have to use tika to get the XML and to get the node that i want. -- View this message in context: http://lucene.472066.n3.nabble.com/Binary-content-index-with-multiple-cores-tp3997221p3997370.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Binary content index with multiple cores
To help finding the solution, with my JUnit test here is the stack trace : org.apache.solr.client.solrj.SolrServerException: Server at http://localhost:8983/solr/document returned non ok status:500, message:Internal Server Error at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:328) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211) And the console error from apache tomcat : [WARNING] [talledLocalContainer] Jul 26, 2012 7:32:20 AM org.apache.solr.common.SolrException log [WARNING] [talledLocalContainer] SEVERE: org.apache.solr.common.SolrException: lazy loading error [WARNING] [talledLocalContainer]at org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.getWrappedHandler(RequestHandlers.java:260) [WARNING] [talledLocalContainer]at org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:242) [WARNING] [talledLocalContainer]at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376) [WARNING] [talledLocalContainer]at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365) [WARNING] [talledLocalContainer]at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260) [WARNING] [talledLocalContainer]at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) [WARNING] [talledLocalContainer]at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) [WARNING] [talledLocalContainer]at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) [WARNING] [talledLocalContainer]at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) [WARNING] [talledLocalContainer]at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) [WARNING] [talledLocalContainer]at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) [WARNING] [talledLocalContainer]at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:615) [WARNING] [talledLocalContainer]at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) [WARNING] [talledLocalContainer]at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) [WARNING] [talledLocalContainer]at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859) [WARNING] [talledLocalContainer]at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602) [WARNING] [talledLocalContainer]at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) [WARNING] [talledLocalContainer]at java.lang.Thread.run(Thread.java:722) [WARNING] [talledLocalContainer] Caused by: *org.apache.solr.common.SolrException: Error Instantiating Request Handler, solr.extraction.ExtractingRequestHandler is not a org.apache.solr.request.SolrRequestHandler* [WARNING] [talledLocalContainer]at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:421) [WARNING] [talledLocalContainer]at org.apache.solr.core.SolrCore.createRequestHandler(SolrCore.java:455) [WARNING] [talledLocalContainer]at org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.getWrappedHandler(RequestHandlers.java:251) [WARNING] [talledLocalContainer]... 17 more [WARNING] [talledLocalContainer] I hope it will help you to find something wrong. -- View this message in context: http://lucene.472066.n3.nabble.com/Binary-content-index-with-multiple-cores-tp3997221p3997368.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Binary content index with multiple cores
Thanks for replying, here is my dependency related to solr-cell : org.apache.solr:solr-cell:jar:3.6.0:compile [INFO] | +- com.ibm.icu:icu4j:jar:4.8.1.1:compile [INFO] | +- *org.apache.tika:tika-parsers:jar:1.0:compile* [INFO] | | +- org.apache.tika:tika-core:jar:1.0:compile [INFO] | | +- edu.ucar:netcdf:jar:4.2-min:compile [INFO] | | +- org.apache.james:apache-mime4j-core:jar:0.7:compile [INFO] | | +- org.apache.james:apache-mime4j-dom:jar:0.7:compile [INFO] | | +- org.apache.commons:commons-compress:jar:1.3:compile [INFO] | | +- org.apache.pdfbox:pdfbox:jar:1.6.0:compile [INFO] | | | +- org.apache.pdfbox:fontbox:jar:1.6.0:compile [INFO] | | | \- org.apache.pdfbox:jempbox:jar:1.6.0:compile [INFO] | | +- org.bouncycastle:bcmail-jdk15:jar:1.45:compile [INFO] | | +- org.bouncycastle:bcprov-jdk15:jar:1.45:compile [INFO] | | +- org.apache.poi:poi:jar:3.8-beta4:compile [INFO] | | +- org.apache.poi:poi-scratchpad:jar:3.8-beta4:compile [INFO] | | +- org.apache.poi:poi-ooxml:jar:3.8-beta4:compile [INFO] | | | \- org.apache.poi:poi-ooxml-schemas:jar:3.8-beta4:compile [INFO] | | | \- org.apache.xmlbeans:xmlbeans:jar:2.3.0:compile [INFO] | | +- org.apache.geronimo.specs:geronimo-stax-api_1.0_spec:jar:1.0.1:compile [INFO] | | +- org.ccil.cowan.tagsoup:tagsoup:jar:1.2.1:compile [INFO] | | +- asm:asm:jar:3.1:compile [INFO] | | +- com.drewnoakes:metadata-extractor:jar:2.4.0-beta-1:compile [INFO] | | +- de.l3s.boilerpipe:boilerpipe:jar:1.1.0:compile [INFO] | | \- rome:rome:jar:0.9:compile [INFO] | | \- jdom:jdom:jar:1.0:compile [INFO] | \- xerces:xercesImpl:jar:2.8.1:compile [INFO] | \- xml-apis:xml-apis:jar:1.3.03:compile As you can see i have the tika-parsers. About the solr.war, when i start my mvn cargo:run i put into the pom.xml the fact that he create the sol.war and for solr-cell tomcat needs some dependencies like solr-cell, solr-core, solr-solrj, tika-core and slf4j-api. Have you any idea about where is my mistake ? -- View this message in context: http://lucene.472066.n3.nabble.com/Binary-content-index-with-multiple-cores-tp3997221p3997367.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Binary content index with multiple cores
Here is my solrconfig.xml for one of the core : lib dir=../../dist/ regex=apache-solr-cell-\d.*\.jar / lib dir=../../contrib/extraction/lib regex=.*\.jar / ... I've added the maven dependencies like this for the solr war : dependencies combine.self=override dependency groupIdorg.apache.solr/groupId artifactIdsolr-cell/artifactId classpathshared/classpath /dependency dependency groupIdorg.apache.solr/groupId artifactIdsolr-core/artifactId classpathshared/classpath /dependency dependency groupIdorg.apache.solr/groupId artifactIdsolr-solrj/artifactId classpathshared/classpath /dependency dependency groupIdorg.apache.tika/groupId artifactIdtika-core/artifactId classpathshared/classpath /dependency dependency groupIdorg.slf4j/groupId artifactIdslf4j-api/artifactId classpathshared/classpath /dependency /dependencies iorixxx wrote I'm using the 3.6.0 version. Are you using the following lib directives (defined solrconfig.xml) lib dir=../../../dist/ regex=apache-solr-cell-\d.*\.jar / lib dir=../../../contrib/extraction/lib regex=.*\.jar / or did you manually copied above jar files into solrHome/coreName/lib directory? iorixxx wrote I'm using the 3.6.0 version. Are you using the following lib directives (defined solrconfig.xml) lib dir=../../../dist/ regex=apache-solr-cell-\d.*\.jar / lib dir=../../../contrib/extraction/lib regex=.*\.jar / or did you manually copied above jar files into solrHome/coreName/lib directory? iorixxx wrote I'm using the 3.6.0 version. Are you using the following lib directives (defined solrconfig.xml) lib dir=../../../dist/ regex=apache-solr-cell-\d.*\.jar / lib dir=../../../contrib/extraction/lib regex=.*\.jar / or did you manually copied above jar files into solrHome/coreName/lib directory? When i do mvn dependency:tree i could find solr-cell.jar with tika. Thanks for answers :) -- View this message in context: http://lucene.472066.n3.nabble.com/Binary-content-index-with-multiple-cores-tp3997221p3997238.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr facet multiple constraint
Ok it's nice a facet query, i will try this feature and will reply you but i think that's the point, thanks a lot for time spent :) -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-facet-multiple-constraint-tp3992974p3996186.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr facet multiple constraint
I have tried and it works ! Thanks again a lot for this dude ! Regards, David. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-facet-multiple-constraint-tp3992974p3996189.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr facet multiple constraint
Ok i'm added the debug, there is the query from the response after executing query : facet=true,sort=publishingdate desc,debugQuery=true,facet.mincount=1,q=service:1 AND publicationstatus:LIVE,facet.field=pillar,wt=javabin,fq=(((pillar:10))),version=2}},response={numFound=2,start=0,docs=[SolrDocument[{uniquenumber=UniqueNumber1, name=Doc 1, publicationstatus=LIVE, service=1, servicename=service_1, pillar=[10], region=EU, regionname=Europe, documenttype=TRACKER, publishingdate=Sun Jul 15 09:03:32 CEST 2012, publishingyear=2012, teasersummary=Seo_Description, content=answer, creator=chandan, version=1, documentinstanceid=1}], SolrDocument[{uniquenumber=UniqueNumber2, name=Doc 2, publicationstatus=LIVE, service=1, servicename=service_1, pillar=[10], region=EU, regionname=Europe, documenttype=TRACKER, publishingdate=Sat Jul 14 09:03:32 CEST 2012, publishingyear=2012, teasersummary=Seo_Description, content=answer, creator=chandan, version=1, documentinstanceid=1}]]},facet_counts={facet_queries={},facet_fields={pillar={10=2}},facet_dates={},facet_ranges={}},debug={rawquerystring=service:1 AND publicationstatus:LIVE,querystring=service:1 AND publicationstatus:LIVE,parsedquery=+service:1 +publicationstatus:LIVE,parsedquery_toString=+service:1 +publicationstatus:LIVE,explain={UniqueNumber1= 1.2917422 = (MATCH) sum of: 0.7741482 = (MATCH) weight(service:1 in 0), product of: 0.7741482 = queryWeight(service:1), product of: 1.0 = idf(docFreq=4, maxDocs=5) 0.7741482 = queryNorm 1.0 = (MATCH) fieldWeight(service:1 in 0), product of: 1.0 = tf(termFreq(service:1)=1) 1.0 = idf(docFreq=4, maxDocs=5) 1.0 = fieldNorm(field=service, doc=0) 0.517594 = (MATCH) weight(publicationstatus:LIVE in 0), product of: 0.6330043 = queryWeight(publicationstatus:LIVE), product of: 0.81767845 = idf(docFreq=5, maxDocs=5) 0.7741482 = queryNorm 0.81767845 = (MATCH) fieldWeight(publicationstatus:LIVE in 0), product of: 1.0 = tf(termFreq(publicationstatus:LIVE)=1) 0.81767845 = idf(docFreq=5, maxDocs=5) 1.0 = fieldNorm(field=publicationstatus, doc=0) ,UniqueNumber2= 1.2917422 = (MATCH) sum of: 0.7741482 = (MATCH) weight(service:1 in 0), product of: 0.7741482 = queryWeight(service:1), product of: 1.0 = idf(docFreq=4, maxDocs=5) 0.7741482 = queryNorm 1.0 = (MATCH) fieldWeight(service:1 in 0), product of: 1.0 = tf(termFreq(service:1)=1) 1.0 = idf(docFreq=4, maxDocs=5) 1.0 = fieldNorm(field=service, doc=0) 0.517594 = (MATCH) weight(publicationstatus:LIVE in 0), product of: 0.6330043 = queryWeight(publicationstatus:LIVE), product of: 0.81767845 = idf(docFreq=5, maxDocs=5) 0.7741482 = queryNorm 0.81767845 = (MATCH) fieldWeight(publicationstatus:LIVE in 0), product of: 1.0 = tf(termFreq(publicationstatus:LIVE)=1) 0.81767845 = idf(docFreq=5, maxDocs=5) 1.0 = fieldNorm(field=publicationstatus, doc=0) },QParser=LuceneQParser,filter_queries=[(((pillar:10))) As you can see in this request i'm talking about pillar not about user. Thanks for all, David. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-facet-multiple-constraint-tp3992974p3995215.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr facet multiple constraint
Ok well i know about the complexity that i can put into fq with AND and OR conditions but at the moment when i put fq=user:10,facet.field=user, the query returns me all the facets not taking into account the fq=user:10 that's the problem. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-facet-multiple-constraint-tp3992974p3994783.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr facet multiple constraint
Ok this is the id but in fact (sorry about this) my wish is the reverse, i want to get just the facet for which a have the right so i want to put fq=user:10 in order to get only facet with user:10. In my fq i can have something like user:10 AND user:3 because it's auto generated by rights of my application. Have you any idea to solve this ? Really thanks to help me, we are waiting a solution for this because instead of this we should make a lot of queries to get the right result. Best regards, David. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-facet-multiple-constraint-tp3992974p3994574.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr facet multiple constraint
Ok sorry to not be clear and thanks again for your answers. q=service%3A1+AND+publicationstatus%3ALIVEsort=publishingdate+descfq=%7B%21ex%3Ddt%7D%28%28%28user%3A10%29%29%29facet.field=%7B%21tag%3Ddt%7Duserfacet=truefacet.mincount=1 Here with this query i want to get all the documents (the elements stored are documents) tagged by user facet with the service=1 but with the constraint that i dont want the user facet user:10. So if i had all the facets users like this : user:1, user:2, user:10, i expect to get documents tagged on user:1 and user:2 only not the facet one with user:10 even if those documents are tagged to service:1. Is it more clear ? Regards, David. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-facet-multiple-constraint-tp3992974p3994109.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr facet multiple constraint
Thanks for answer, Actually when i put 'it's not working' it means that it's not the result expected : the result return me data tagged by all the facets not only the facet that i ask for with the constraint. Hope you will help me. Best regards, David. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-facet-multiple-constraint-tp3992974p3993822.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr facet multiple constraint
Well thanks for your answer, in fact i've written what the QueryResponse return as the solr query here is my real solr query before use the executeQuery : q=service%3A1+AND+publicationstatus%3ALIVEsort=publishingdate+descfq=%7B%21ex%3Ddt%7D%28%28%28user%3A10%29%29%29facet.field=%7B%21tag%3Ddt%7Duserfacet=truefacet.mincount=1 which is the same as my first post without the 'wt=javabin' and instead of commas. Could you please see if there is something wrong for you ? Best regards, David. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-facet-multiple-constraint-tp3992974p3993408.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr facet multiple constraint
Hi, I'm trying to make a facet search on a multiple value field and add a filter query on it and it doesn't work. Could you please help me find my mistake ? Here is my solr query : facet=true,sort=publishingdate desc,facet.mincount=1,q=service:1 AND publicationstatus:LIVE,facet.field={!ex=dt}user,wt=javabin,fq={!tag=dt}user:10,version=2 Thanks in advance for answers, David. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-facet-multiple-constraint-tp3992974.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr facet multiple constraint
Please someone can help me, we are a team waiting for a fix. We try several ways to implement it without success. Thanks for reading anyway, David. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-facet-multiple-constraint-tp3992974p3993119.html Sent from the Solr - User mailing list archive at Nabble.com.