Re: Solr Version Upgrade issue
Thanks. I re-started from scratch at least things have started working now. I upgraded by deploying 3.2 war in my jboss. Also, did conf changes as mentioned in CHANGES.txt It did expected to have a separate libdirectory which was not required in 1.4. New problem is that it's taking very long to build indexes more than an hour. it took only 10 minutes in 1.4. Can u please guide regarding this. Should i attach my solrconfig.xml for reference On Wed, Dec 7, 2011 at 8:22 PM, Erick Erickson erickerick...@gmail.comwrote: How did you upgrade? What steps did you follow? Do you have any custom code? Any additional lib entries in your solrconfig.xml? These details help us diagnose your problem, but it's almost certainly that you have a mixture of jar files lying around your machine in a place you don't expect. Best Erick On Wed, Dec 7, 2011 at 1:28 AM, Pawan Darira pawan.dar...@gmail.com wrote: I checked that. there are only latest jars. I am not able to figure out the issue. On Tue, Dec 6, 2011 at 6:57 PM, Mark Miller markrmil...@gmail.com wrote: Looks like you must have a mix of old and new jars. On Tuesday, December 6, 2011, Pawan Darira pawan.dar...@gmail.com wrote: Hi I am trying to upgrade my SOLR version from 1.4 to 3.2. but it's giving me below exception. I have checked solr home path it is correct.. Please help SEVERE: Could not start Solr. Check solr/home property java.lang.NoSuchMethodError: org.apache.solr.common.SolrException.logOnce(Lorg/slf4j/Logger;Ljava/lang/String;Ljava/lang/Throwable;)V at org.apache.solr.core.CoreContainer.load(CoreContainer.java:321) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:207) at org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:130) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:94) at org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:275) at org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:397) at org.apache.catalina.core.ApplicationFilterConfig.init(ApplicationFilterConfig.java:108) at org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:3720) at org.apache.catalina.core.StandardContext.start(StandardContext.java:4358) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:752) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:732) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:553) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.tomcat.util.modeler.BaseModelMBean.invoke(BaseModelMBean.java:297) at org.jboss.mx.server.RawDynamicInvoker.invoke(RawDynamicInvoker.java:164) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659) at org.apache.catalina.core.StandardContext.init(StandardContext.java:5300) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.tomcat.util.modeler.BaseModelMBean.invoke(BaseModelMBean.java:297) at org.jboss.mx.server.RawDynamicInvoker.invoke(RawDynamicInvoker.java:164) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659) at org.jboss.web.tomcat.service.TomcatDeployer.performDeployInternal(TomcatDeployer.java:301) at org.jboss.web.tomcat.service.TomcatDeployer.performDeploy(TomcatDeployer.java:104) at org.jboss.web.AbstractWebDeployer.start(AbstractWebDeployer.java:375) at org.jboss.web.WebModule.startModule(WebModule.java:83) -- - Mark http://www.lucidimagination.com -- Thanks, Pawan
Re: Solr 3.2 - Results not showing up
Thanks for reply. Please find my comments below. although after all the basic RD, i wrote the issue. On Fri, Dec 9, 2011 at 1:37 AM, Erick Erickson erickerick...@gmail.comwrote: If you look at the admin/stats page, does it show anything for numDocs and maxDocs? i did look at stats. there are around 71 thousand records Have you tried looking at the index with Luke to see what's in there? i did looked at index also with Luke. the data is proper Have you tried just looking at your data/index directory and seeing if there are files there? There are definitely files in data/index directory (mentioned in my mail) Are you sure you commit the changes? I did not explicitly commit the changes. I was using DIH it should auto-commit the changes. I haven't done explicit commit in my previous version of 1.4 also Did you read the CHANGES.txt file to see if it mentions any changes you need to know about? I did read the CHANGES.txt file You might want to review: http://wiki.apache.org/solr/UsingMailingLists as you've given us very little to really go on. Best Erick On Thu, Dec 8, 2011 at 5:03 AM, Pawan Darira pawan.dar...@gmail.com wrote: Hi I newly upgraded to Solr 3.2 from Solr 1.4. I was using DIH in 1.4 also in 3.2. I built my index it doesn't gave me any issues. The index directory it's files are properly in place Now, when i tried to look the data through admin, it is giving me ZERO results. does it due to HTTP Caching or Auto-commit feature or anything else. Please suggest thanks Pawan
Re: Solr Version Upgrade issue
I checked that. there are only latest jars. I am not able to figure out the issue. On Tue, Dec 6, 2011 at 6:57 PM, Mark Miller markrmil...@gmail.com wrote: Looks like you must have a mix of old and new jars. On Tuesday, December 6, 2011, Pawan Darira pawan.dar...@gmail.com wrote: Hi I am trying to upgrade my SOLR version from 1.4 to 3.2. but it's giving me below exception. I have checked solr home path it is correct.. Please help SEVERE: Could not start Solr. Check solr/home property java.lang.NoSuchMethodError: org.apache.solr.common.SolrException.logOnce(Lorg/slf4j/Logger;Ljava/lang/String;Ljava/lang/Throwable;)V at org.apache.solr.core.CoreContainer.load(CoreContainer.java:321) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:207) at org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:130) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:94) at org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:275) at org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:397) at org.apache.catalina.core.ApplicationFilterConfig.init(ApplicationFilterConfig.java:108) at org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:3720) at org.apache.catalina.core.StandardContext.start(StandardContext.java:4358) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:752) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:732) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:553) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.tomcat.util.modeler.BaseModelMBean.invoke(BaseModelMBean.java:297) at org.jboss.mx.server.RawDynamicInvoker.invoke(RawDynamicInvoker.java:164) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659) at org.apache.catalina.core.StandardContext.init(StandardContext.java:5300) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.tomcat.util.modeler.BaseModelMBean.invoke(BaseModelMBean.java:297) at org.jboss.mx.server.RawDynamicInvoker.invoke(RawDynamicInvoker.java:164) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659) at org.jboss.web.tomcat.service.TomcatDeployer.performDeployInternal(TomcatDeployer.java:301) at org.jboss.web.tomcat.service.TomcatDeployer.performDeploy(TomcatDeployer.java:104) at org.jboss.web.AbstractWebDeployer.start(AbstractWebDeployer.java:375) at org.jboss.web.WebModule.startModule(WebModule.java:83) -- - Mark http://www.lucidimagination.com
Solr Version Upgrade issue
Hi I am trying to upgrade my SOLR version from 1.4 to 3.2. but it's giving me below exception. I have checked solr home path it is correct.. Please help SEVERE: Could not start Solr. Check solr/home property java.lang.NoSuchMethodError: org.apache.solr.common.SolrException.logOnce(Lorg/slf4j/Logger;Ljava/lang/String;Ljava/lang/Throwable;)V at org.apache.solr.core.CoreContainer.load(CoreContainer.java:321) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:207) at org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:130) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:94) at org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:275) at org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:397) at org.apache.catalina.core.ApplicationFilterConfig.init(ApplicationFilterConfig.java:108) at org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:3720) at org.apache.catalina.core.StandardContext.start(StandardContext.java:4358) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:752) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:732) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:553) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.tomcat.util.modeler.BaseModelMBean.invoke(BaseModelMBean.java:297) at org.jboss.mx.server.RawDynamicInvoker.invoke(RawDynamicInvoker.java:164) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659) at org.apache.catalina.core.StandardContext.init(StandardContext.java:5300) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.tomcat.util.modeler.BaseModelMBean.invoke(BaseModelMBean.java:297) at org.jboss.mx.server.RawDynamicInvoker.invoke(RawDynamicInvoker.java:164) at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java:659) at org.jboss.web.tomcat.service.TomcatDeployer.performDeployInternal(TomcatDeployer.java:301) at org.jboss.web.tomcat.service.TomcatDeployer.performDeploy(TomcatDeployer.java:104) at org.jboss.web.AbstractWebDeployer.start(AbstractWebDeployer.java:375) at org.jboss.web.WebModule.startModule(WebModule.java:83)
Error in New Solr version
Hi I am migrating from Solr 1.4 to Solr 3.2. I am getting below error in my logs org.apache.solr.common.SolrException: Error loading class 'org.apache.solr.handler.component.CollapseComponent Could not found satisfactory solution on google. please help thanks Pawan
Index not getting refreshed
Hi I am using Solr 3.2 on a live website. i get live user's data of about 2000 per day. I do an incremental index every 8 hours. but my search results always show the same result with same sorting order. when i check the same search from corresponding db, it gives me different results always (as new data regularly gets added) please suggest what might be the issue. is there any cache related problem at SOLR level thanks pawan
Re: Index not getting refreshed
I am commiting but not doing replication now. Mine sort order also includes last login timestamp. the new profiles are being reflected in my SOLR admin db. but its not listed on my website. On Thu, Sep 15, 2011 at 4:25 AM, Chris Hostetter hossman_luc...@fucit.orgwrote: : I am using Solr 3.2 on a live website. i get live user's data of about 2000 : per day. I do an incremental index every 8 hours. but my search results : always show the same result with same sorting order. when i check the same Are you commiting? Are you using replication? Are you using a sort order that might not make it obvious that the new docs are actaully there? (ie: sort=timestamp asc) -Hoss
Re: Index not getting refreshed
I have written simple java code to index my data. i am creating xml documents adding in the index. sorry, but due to company's policy could not share the configuration details here. On Wed, Sep 14, 2011 at 10:42 PM, Rahul Warawdekar rahul.warawde...@gmail.com wrote: Hi Pawan, Can you please share more details on the indexing mechanism ? (DIH, SolrJ or any other) Please let us know the configuration details. On Wed, Sep 14, 2011 at 12:48 PM, Pawan Darira pawan.dar...@gmail.com wrote: Hi I am using Solr 3.2 on a live website. i get live user's data of about 2000 per day. I do an incremental index every 8 hours. but my search results always show the same result with same sorting order. when i check the same search from corresponding db, it gives me different results always (as new data regularly gets added) please suggest what might be the issue. is there any cache related problem at SOLR level thanks pawan -- Thanks and Regards Rahul A. Warawdekar
Optimize concern in Solr 3.2
Hi I have recently upgraded from Solr 1.4 to Solr 3.2. In Solr 1.4 only 3 files (one .cfs two segments) file were made in *index/* directory. (after doing optimize). Now, in Solr 3.2, the optimize seems not be working. My final number of files in *index/* directory are in 7-8 in number. Can anyone suggest what might be the issue. thanks pawan
Re: Optimize concern in Solr 3.2
Thanks for the guidance But it could not work out. Although m reading the link provided by you, but can it be due to write.lock file being created in /index/ directory. Please suggest - pawan On Fri, Sep 2, 2011 at 6:34 PM, Michael Ryan mr...@moreover.com wrote: I have recently upgraded from Solr 1.4 to Solr 3.2. In Solr 1.4 only 3 files (one .cfs two segments) file were made in *index/* directory. (after doing optimize). Now, in Solr 3.2, the optimize seems not be working. My final number of files in *index/* directory are in 7-8 in number. Can anyone suggest what might be the issue. What are the extensions of the files in the index directory - is it stuff like .fdt, .tis, .frq? It sounds like when you used 1.4, you had useCompoundFile set to true in your solrconfig.xml, but now you have it set to false. Or perhaps the default behavior changed between 1.4 and 3.2. You may find this page to be useful - it describes the purpose of each of the file types in the index: http://lucene.apache.org/java/3_2_0/fileformats.html -Michael
Solr Upgrade from 1.4 to 3.1
Hi I want to upgrade my solr version 1.4 to 3.1. Please suggest the steps what challenges might occur. I have started using solr from 1.4 this is my 1st experience to upgrade the version thanks Pawan
Re: Can Master push data to slave
Regarding point b, i mean that when Slave server does a replication from Master, it creates a lock-file in it's index directory. How to avoid that? On Tue, Aug 9, 2011 at 2:56 AM, Markus Jelsma markus.jel...@openindex.iowrote: Hi, Hi I am using Solr 1.4. and doing a replication process where my slave is pulling data from Master. I have 2 questions a. Can Master push data to slave Not in current versions. Not sure about exotic patches for this. b. How to make sure that lock file is not created while replication What do you mean? Please help thanks Pawan
Nutch related issue: URL Ignore
hi i am using nutch 1.2. in my crawl-urlfilter.txt, i am specifying URLs to be skipped. i am giving some patterns that need to be skipped but it is not working e.g. -^http://([a-z0-9]*\.)*domain.com +^http://([a-z0-9]*\.)*domain.com/([0-9-a-z])*.html -^http://([a-z0-9]*\.)*domain.com/([a-z/])* -^http://([a-z0-9]*\.)*domain.com/top-ads.php i want the second URL only to be included while crawling all other patterns to be excluded. but it is crawling all of them. Please suggest where might be the issue thanks Pawan
Can Master push data to slave
Hi I am using Solr 1.4. and doing a replication process where my slave is pulling data from Master. I have 2 questions a. Can Master push data to slave b. How to make sure that lock file is not created while replication Please help thanks Pawan
Re: Copy Fields while Replication
actually, i had limitation that i could not add copyField on Master Index. That master index is provided by 3rd party vendor he is not willing to make changes in that. I need to add field in my own way so want to copy a new field while replication On Fri, Aug 5, 2011 at 1:03 PM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: On Fri, Aug 5, 2011 at 9:39 AM, Pawan Darira pawan.dar...@gmail.com wrote: I would like to know whether i can add new fields while replicating index on Slave. E.g. My Master has index with field F1 which is created with type string. Now, i don't want F1 as a type string also have limitation that i cannot change the field type at schema level. Now, if i replicate that index on Slave, can i use copyField attribute to create a copy of field F1 into field F2. F2 will be my field with type text which i can use as per my requirement No, it will not work. Solr replication works by copying pre-built indexes (or portions of it) from the master to the slaves. Therefore, adding a copy field on the slave will not actually change the index. Why not add the copy field on the master and the slaves? -- Regards, Shalin Shekhar Mangar.
Copy Fields while Replication
Hi I would like to know whether i can add new fields while replicating index on Slave. E.g. My Master has index with field F1 which is created with type string. Now, i don't want F1 as a type string also have limitation that i cannot change the field type at schema level. Now, if i replicate that index on Slave, can i use copyField attribute to create a copy of field F1 into field F2. F2 will be my field with type text which i can use as per my requirement Please suggest Thanks Pawan
Readercycle script issue
Hi my readercycle script is not reloading the searcher. where i may be wrong. please help Thanks Pawan
Re: Multiple Values not getting Indexed
sorry for the inconvenience. actually i was trying the solution suggested in this mail thread. As mentioned in 1st mail, I am trying to index 2 fields with multiple values. BUT, it is only putting 1 value for each ignoring rest of the values after comma(,). I am fetching query through DIH. It works fine if i have only 1 value each of the 2 fields E.g. Field1 - 150,178,461,151,310,306,305,179,137,162 Field2 - Chandigarh,Gurgaon,New Delhi,Ahmedabad,Rajkot,Surat,Mumbai,Nagpur,Pune,India - Others Schema.xml field name=city_type type=text indexed=true stored=true/ field name=city_desc type=text indexed=true stored=true/ -- But in my index, it is showing only 150 in Field1 Gurgaon in Field2. Then, as suggested in mail thread, i tried to use split-by , for field1 field2 in schema.xml. It did not show me the error and results were also the same as it was before using split by. Along with split-by i mentioned the attribute as multivalued=true. On Fri, Jun 10, 2011 at 10:40 AM, Gora Mohanty g...@mimirtech.com wrote: On Fri, Jun 10, 2011 at 10:36 AM, Pawan Darira pawan.dar...@gmail.com wrote: it did not work :( [...] Please provide more details of what you tried, what was the error, and any error messages that you got. Just saying that it did not work makes it pretty much impossible for anyone to help you. You might take a look at http://wiki.apache.org/solr/UsingMailingLists Regards, Gora -- Thanks, Pawan Darira
Re: Multiple Values not getting Indexed
it did not work :( On Thu, Jun 9, 2011 at 12:53 PM, Bill Bell billnb...@gmail.com wrote: You have to take the input and splitBy something like , to get it into an array and reposted back to Solr... I believe others have suggested that? On 6/8/11 10:14 PM, Pawan Darira pawan.dar...@gmail.com wrote: Hi I am trying to index 2 fields with multiple values. BUT, it is only putting 1 value for each ignoring rest of the values after comma(,). I am fetching query through DIH. It works fine if i have only 1 value each of the 2 fields E.g. Field1 - 150,178,461,151,310,306,305,179,137,162 Field2 - Chandigarh,Gurgaon,New Delhi,Ahmedabad,Rajkot,Surat,Mumbai,Nagpur,Pune,India - Others *Schema.xml* field name=city_type type=text indexed=true stored=true/ field name=city_desc type=text indexed=true stored=true/ p.s. i tried multivalued=true but of no help. -- Thanks, Pawan Darira -- Thanks, Pawan Darira
Multiple Values not getting Indexed
Hi I am trying to index 2 fields with multiple values. BUT, it is only putting 1 value for each ignoring rest of the values after comma(,). I am fetching query through DIH. It works fine if i have only 1 value each of the 2 fields E.g. Field1 - 150,178,461,151,310,306,305,179,137,162 Field2 - Chandigarh,Gurgaon,New Delhi,Ahmedabad,Rajkot,Surat,Mumbai,Nagpur,Pune,India - Others *Schema.xml* field name=city_type type=text indexed=true stored=true/ field name=city_desc type=text indexed=true stored=true/ p.s. i tried multivalued=true but of no help. -- Thanks, Pawan Darira
Re: Want to Delete Existing Index create fresh index
It is by default commented in solrconfig.xml On Sat, May 14, 2011 at 10:49 PM, Gabriele Kahlout gabri...@mysimpatico.com wrote: I guess you are having issues with the datadir. Did you set the datadir in solrconfig.xml? On Sat, May 14, 2011 at 4:10 PM, Pawan Darira pawan.dar...@gmail.com wrote: Hi I am using Solr 1.4. had changed schema already. When i created the index for first time, the directory was automatically created index made perfectly fine. Now, i want to create the index from scratch, so I deleted the whole data/index directory ran the script. Now it is only creating empty directories NO index files inside that. Thanks Pawan On Sat, May 14, 2011 at 6:54 PM, Dmitry Kan dmitry@gmail.com wrote: Hi Pawan, Which SOLR version do you have installed? It should be absolutely normal for the data/ sub directory to create when starting up SOLR. So just go ahead and post your data into SOLR, if you have changed the schema already. -- Regards, Dmitry Kan On Sat, May 14, 2011 at 4:01 PM, Pawan Darira pawan.dar...@gmail.com wrote: I did that. Index directory is created but not contents in that 2011/5/14 François Schiettecatte fschietteca...@gmail.com You can also shut down solr/lucene, do: rm -rf /YourIndexName/data/index and restart, the index directory will be automatically recreated. François On May 14, 2011, at 1:53 AM, Gabriele Kahlout wrote: curl --fail $solrIndex/update?commit=true -d 'deletequery*:*/query/delete' #empty index [1 http://wiki.apache.org/nutch/Whole-Web%20Crawling%20incremental%20script ] did u try? On Sat, May 14, 2011 at 7:26 AM, Pawan Darira pawan.dar...@gmail.com wrote: Hi I had an existing index created months back. now my database schema has changed. i wanted to delete the current data/index directory re-create the fresh index but it is saying that segments file not found just create blank data/index directory. Please help -- Thanks, Pawan Darira -- Regards, K. Gabriele --- unchanged since 20/9/10 --- P.S. If the subject contains [LON] or the addressee acknowledges the receipt within 48 hours then I don't resend the email. subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x, this) ∧ time(x) Now + 48h) ⇒ ¬resend(I, this). If an email is sent by a sender that is not a trusted contact or the email does not contain a valid code then the email is not received. A valid code starts with a hyphen and ends with X. ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈ subject(x) ∧ y ∈ L(-[a-z]+[0-9]X)). -- Thanks, Pawan Darira -- Thanks, Pawan Darira -- Regards, K. Gabriele --- unchanged since 20/9/10 --- P.S. If the subject contains [LON] or the addressee acknowledges the receipt within 48 hours then I don't resend the email. subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x, this) ∧ time(x) Now + 48h) ⇒ ¬resend(I, this). If an email is sent by a sender that is not a trusted contact or the email does not contain a valid code then the email is not received. A valid code starts with a hyphen and ends with X. ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈ subject(x) ∧ y ∈ L(-[a-z]+[0-9]X)). -- Thanks, Pawan Darira
Re: Want to Delete Existing Index create fresh index
I set the datadir in solrconfig.xml. actually m using core based structures. is it creating any problem On Sat, May 14, 2011 at 10:49 PM, Gabriele Kahlout gabri...@mysimpatico.com wrote: I guess you are having issues with the datadir. Did you set the datadir in solrconfig.xml? On Sat, May 14, 2011 at 4:10 PM, Pawan Darira pawan.dar...@gmail.com wrote: Hi I am using Solr 1.4. had changed schema already. When i created the index for first time, the directory was automatically created index made perfectly fine. Now, i want to create the index from scratch, so I deleted the whole data/index directory ran the script. Now it is only creating empty directories NO index files inside that. Thanks Pawan On Sat, May 14, 2011 at 6:54 PM, Dmitry Kan dmitry@gmail.com wrote: Hi Pawan, Which SOLR version do you have installed? It should be absolutely normal for the data/ sub directory to create when starting up SOLR. So just go ahead and post your data into SOLR, if you have changed the schema already. -- Regards, Dmitry Kan On Sat, May 14, 2011 at 4:01 PM, Pawan Darira pawan.dar...@gmail.com wrote: I did that. Index directory is created but not contents in that 2011/5/14 François Schiettecatte fschietteca...@gmail.com You can also shut down solr/lucene, do: rm -rf /YourIndexName/data/index and restart, the index directory will be automatically recreated. François On May 14, 2011, at 1:53 AM, Gabriele Kahlout wrote: curl --fail $solrIndex/update?commit=true -d 'deletequery*:*/query/delete' #empty index [1 http://wiki.apache.org/nutch/Whole-Web%20Crawling%20incremental%20script ] did u try? On Sat, May 14, 2011 at 7:26 AM, Pawan Darira pawan.dar...@gmail.com wrote: Hi I had an existing index created months back. now my database schema has changed. i wanted to delete the current data/index directory re-create the fresh index but it is saying that segments file not found just create blank data/index directory. Please help -- Thanks, Pawan Darira -- Regards, K. Gabriele --- unchanged since 20/9/10 --- P.S. If the subject contains [LON] or the addressee acknowledges the receipt within 48 hours then I don't resend the email. subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x, this) ∧ time(x) Now + 48h) ⇒ ¬resend(I, this). If an email is sent by a sender that is not a trusted contact or the email does not contain a valid code then the email is not received. A valid code starts with a hyphen and ends with X. ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈ subject(x) ∧ y ∈ L(-[a-z]+[0-9]X)). -- Thanks, Pawan Darira -- Thanks, Pawan Darira -- Regards, K. Gabriele --- unchanged since 20/9/10 --- P.S. If the subject contains [LON] or the addressee acknowledges the receipt within 48 hours then I don't resend the email. subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x, this) ∧ time(x) Now + 48h) ⇒ ¬resend(I, this). If an email is sent by a sender that is not a trusted contact or the email does not contain a valid code then the email is not received. A valid code starts with a hyphen and ends with X. ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈ subject(x) ∧ y ∈ L(-[a-z]+[0-9]X)). -- Thanks, Pawan Darira
Re: Want to Delete Existing Index create fresh index
I did that. Index directory is created but not contents in that 2011/5/14 François Schiettecatte fschietteca...@gmail.com You can also shut down solr/lucene, do: rm -rf /YourIndexName/data/index and restart, the index directory will be automatically recreated. François On May 14, 2011, at 1:53 AM, Gabriele Kahlout wrote: curl --fail $solrIndex/update?commit=true -d 'deletequery*:*/query/delete' #empty index [1 http://wiki.apache.org/nutch/Whole-Web%20Crawling%20incremental%20script] did u try? On Sat, May 14, 2011 at 7:26 AM, Pawan Darira pawan.dar...@gmail.com wrote: Hi I had an existing index created months back. now my database schema has changed. i wanted to delete the current data/index directory re-create the fresh index but it is saying that segments file not found just create blank data/index directory. Please help -- Thanks, Pawan Darira -- Regards, K. Gabriele --- unchanged since 20/9/10 --- P.S. If the subject contains [LON] or the addressee acknowledges the receipt within 48 hours then I don't resend the email. subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x, this) ∧ time(x) Now + 48h) ⇒ ¬resend(I, this). If an email is sent by a sender that is not a trusted contact or the email does not contain a valid code then the email is not received. A valid code starts with a hyphen and ends with X. ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈ subject(x) ∧ y ∈ L(-[a-z]+[0-9]X)). -- Thanks, Pawan Darira
Re: Want to Delete Existing Index create fresh index
Hi I am using Solr 1.4. had changed schema already. When i created the index for first time, the directory was automatically created index made perfectly fine. Now, i want to create the index from scratch, so I deleted the whole data/index directory ran the script. Now it is only creating empty directories NO index files inside that. Thanks Pawan On Sat, May 14, 2011 at 6:54 PM, Dmitry Kan dmitry@gmail.com wrote: Hi Pawan, Which SOLR version do you have installed? It should be absolutely normal for the data/ sub directory to create when starting up SOLR. So just go ahead and post your data into SOLR, if you have changed the schema already. -- Regards, Dmitry Kan On Sat, May 14, 2011 at 4:01 PM, Pawan Darira pawan.dar...@gmail.com wrote: I did that. Index directory is created but not contents in that 2011/5/14 François Schiettecatte fschietteca...@gmail.com You can also shut down solr/lucene, do: rm -rf /YourIndexName/data/index and restart, the index directory will be automatically recreated. François On May 14, 2011, at 1:53 AM, Gabriele Kahlout wrote: curl --fail $solrIndex/update?commit=true -d 'deletequery*:*/query/delete' #empty index [1 http://wiki.apache.org/nutch/Whole-Web%20Crawling%20incremental%20script ] did u try? On Sat, May 14, 2011 at 7:26 AM, Pawan Darira pawan.dar...@gmail.com wrote: Hi I had an existing index created months back. now my database schema has changed. i wanted to delete the current data/index directory re-create the fresh index but it is saying that segments file not found just create blank data/index directory. Please help -- Thanks, Pawan Darira -- Regards, K. Gabriele --- unchanged since 20/9/10 --- P.S. If the subject contains [LON] or the addressee acknowledges the receipt within 48 hours then I don't resend the email. subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x, this) ∧ time(x) Now + 48h) ⇒ ¬resend(I, this). If an email is sent by a sender that is not a trusted contact or the email does not contain a valid code then the email is not received. A valid code starts with a hyphen and ends with X. ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈ subject(x) ∧ y ∈ L(-[a-z]+[0-9]X)). -- Thanks, Pawan Darira -- Thanks, Pawan Darira
Want to Delete Existing Index create fresh index
Hi I had an existing index created months back. now my database schema has changed. i wanted to delete the current data/index directory re-create the fresh index but it is saying that segments file not found just create blank data/index directory. Please help -- Thanks, Pawan Darira
Different Cluster Results on Different Servers, with same SOLR setup
Hi I have same Solr 1.4 setup on two different servers, One for production One for Staging. My production server gives proper cluster Staging server give wrong cluster. The problem is for date related cluster only I have checked all the configuration setup. everything seems fine. i am creating index through DIH p.s. my application solr setup is similar on staging production please suggest any solution. -- Thanks, Pawan Darira
How to generate tag cloud in SOLR?
Hi Is there a way out in SOLR/lucene to generate a tag cloud? -- Thanks, Pawan Darira
Phrase Search Multiple Keywords with Double quotes
Hi I want to do pharse searching with single/double quotes. Also there are cases that those phrases include special characters like etc. What all i need to do while indexing such special characters while searching them. How to handle phrase search with quotes Please suggest -- Thanks, Pawan Darira
Doubts regarding Multiple Keyword Search
Hi I am searching for keywords: ad testing (without quotes). I want result containing both words on the top. But it is giving me results containing words: ad test. Is it correct or any logic behind that i.e. will it consider the word test also ? Please help -- Thanks, Pawan Darira
Multiple Keyword Search
Hi There is a situation where i search for more than 1 keyword my main 2 fields are ad_title ad_description. I want those results which match all of the keywords in both fields, should come on top. Then sequentially one by one keyword can be dropped in further results. E.g. In a search of 3 keywords, let there are 100 results. If 35 contain all the keywords combined in ad_title ad_description, then they should come first. Then if 50 results contain combination of any 2 keywords, they should come next. Finally results with single keyword should come at last Please suggest -- Thanks, Pawan Darira
Re: How to index on basis of a condition?
Thanks Mr. Ephraim Ofir. I used the SELECT IF() for my requirement. The
query result is correct. But when i see it in my index, the value stored is
something unusual bunch of characters e.g. *...@6628ad5a*
Please suggest as to what went wrong.
- Pawan
On Mon, Oct 25, 2010 at 6:44 PM, Ephraim Ofir ephra...@icq.com wrote:
Assuming you're talking about data that comes from a DB, I find it easiest
to do this kind of logic on the DB's side (mssql example):
SELECT IF(someField = someValue, desiredValue, NULL) AS desiredName from
someTable
If that's not possible, you can use RegexTransformer(
http://wiki.apache.org/solr/DataImportHandler#RegexTransformer) or (worst
case and worst performance) ScriptTransformer(
http://wiki.apache.org/solr/DataImportHandler#ScriptTransformer) and
actually write a JS script to do your logic.
Ephraim Ofir
-Original Message-
From: Jan Høydahl / Cominvent [mailto:jan@cominvent.com]
Sent: Monday, October 25, 2010 10:23 AM
To: solr-user@lucene.apache.org
Subject: Re: How to index on basis of a condition?
Do you want to use a field's content do decide whether the document should
be indexed or not?
You could write an UpdateProcessor for that, simply aborting the chain for
the docs that don't pass your test.
@Override
public void processAdd(AddUpdateCommand cmd) throws IOException {
SolrInputDocument doc = cmd.getSolrInputDocument();
String value = (String) doc.getFieldValue(myfield);
String condition = foobar;
if(value == condition) {
super.processAdd(cmd);
}
}
But if what you meant was to skip only that field if it does not match
condition, you could use doc.removeField(name) instead. Now you can feed
your content using whatever method you like.
--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com
On 25. okt. 2010, at 08.38, Pawan Darira wrote:
Hi
I want to index a particular field on one if() condition. Can i do it
through DIH?
Please suggest.
--
Thanks,
Pawan Darira
--
Thanks,
Pawan Darira
Re: How to index on basis of a condition?
I am using mysql database, and, field type is date On Tue, Oct 26, 2010 at 2:56 PM, Gora Mohanty g...@mimirtech.com wrote: On Tue, Oct 26, 2010 at 2:37 PM, Pawan Darira pawan.dar...@gmail.com wrote: Thanks Mr. Ephraim Ofir. I used the SELECT IF() for my requirement. The query result is correct. But when i see it in my index, the value stored is something unusual bunch of characters e.g. *...@6628ad5a* [...] Which database are you indexing from? The field type is probably a blob in the database. Check that, and look into the ClobTransformer: http://wiki.apache.org/solr/DataImportHandler#ClobTransformer Regards, Gora -- Thanks, Pawan Darira
Re: How to index on basis of a condition?
My Sql is select IF(sub_cat_id=2002, ad_post_date, null) as 'ad_sort_field' from tcuser.ad_details where SOME_CONDiTION +---+ | ad_sort_field | +---+ | 2010-05-30| | 2010-05-02| | 2010-10-07| | NULL| | 2010-10-15| | NULL| ++ Thanks Pawan On Tue, Oct 26, 2010 at 4:36 PM, Gora Mohanty g...@mimirtech.com wrote: On Tue, Oct 26, 2010 at 3:56 PM, Pawan Darira pawan.dar...@gmail.com wrote: I am using mysql database, and, field type is date [...] Could you show us the exact SELECT statement, and some example values returned by running the SELECT directly at a mysql console? Regards, Gora -- Thanks, Pawan Darira
How to index on basis of a condition?
Hi I want to index a particular field on one if() condition. Can i do it through DIH? Please suggest. -- Thanks, Pawan Darira
Can i do relavence and sorting together?
Hi My index have fields named ad_title, ad_description ad_post_date. Let's suppose a user searches for more than one keyword, then i want the documents with maximum occurence of all the keywords together should come on top. The more closer the keywords in ad_title ad_description should be given top priority. Also, i want that these results should be sorted on ad_post_date. Please suggest!!! -- Thanks, Pawan Darira
Re: How to delete documents from SOLR index using DIH
Thanks Erick. Your solution do make sense. Actually i wanted to know, how to use delete via query or unique id through DIH? Is there any specific query to be mentioned in data-config.xml? Also Is there any separate command like full-import ,delta-import for deleting documents from index? On Thu, Aug 26, 2010 at 12:03 AM, Erick Erickson erickerick...@gmail.comwrote: I'm not sure what you mean here. You can delete via query or unique id. But DIH really isn't relevant here. If you've defined a unique key, simply re-adding any changed documents will delete the old one and insert the new document. If this makes no sense, could you explain what the underlying problem you're trying to solve is? HTH Erick On Tue, Aug 24, 2010 at 8:56 PM, Pawan Darira pawan.dar...@gmail.com wrote: Hi I am using data import handler to build index. How can i delete documents from my index using DIH. -- Thanks, Pawan Darira -- Thanks, Pawan Darira
How to delete documents from SOLR index using DIH
Hi I am using data import handler to build index. How can i delete documents from my index using DIH. -- Thanks, Pawan Darira
Re: How to get most indexed keyword from SOLR
Thanks. It worked out fine. On Fri, Aug 20, 2010 at 7:08 PM, Jan Høydahl / Cominvent jan@cominvent.com wrote: Check out the luke request handler: http://localhost:8983/solr/admin/luke?fl=my_ad_fieldnumTerms=100 - you'll find topTerms for the fields specified -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Training in Europe - www.solrtraining.com On 20. aug. 2010, at 11.39, Pawan Darira wrote: Hi I have daily 1000 of classifieds ads posting in my SOLR index. There is an ad description field where details of the respective ad is stored. I want to know the list of keywords which are used maximum no. of times across 1000 ads posted in a day. -- Thanks, Pawan Darira -- Thanks, Pawan Darira
How to get most indexed keyword from SOLR
Hi I have daily 1000 of classifieds ads posting in my SOLR index. There is an ad description field where details of the respective ad is stored. I want to know the list of keywords which are used maximum no. of times across 1000 ads posted in a day. -- Thanks, Pawan Darira
