Re: SpellCheck Help
Downloaded Apache Solr from the URL: http://apache.dattatec.com//lucene/solr/ , extracted it at my windows machine. Then started solr: [solr-path]/example, and typed the following in a terminal: java –jar start.jar. it started and i can see the solr page at http://localhost:8983/solr/admin/ Now copied Magento [magento-instance-root]/lib/Apache/Solr/conf to [Solr-instance-root]/example/solr/conf. then again restared solr lots of activity was going on their. then I run System-index management and at front end search box i tried to search a product with incorrect spelling, in solr console i can see some activity but at magento front end I couldnt get any result, why ? I followed the steps given at this URL: http://www.summasolutions.net/blogposts/magento-apache-solr-set#comment-615 Please look into it and let me know any other information you require. I also want to know how i can implement facet and highlight search with resulted output. -- View this message in context: http://lucene.472066.n3.nabble.com/SpellCheck-Help-tp3648589p3692518.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SpellCheck Help
Hey, I really recommend you contact Magento pre-sales to find out why THEIR stuff doesn't work. The information you have provided is specific to magento... You can't expect people on a Solr mailing list to help you with a Magento problem. I guarantee you the issue is probably something Magento is doing, so try seeking support their first (Try their mailing lists if they have any, or on IRC: irc.freenode.org #magento). I am not trying to be rude, rather to save you time and others effort. Cheers, David On 27/01/2012 5:37 PM, vishal_asc wrote: Downloaded Apache Solr from the URL: http://apache.dattatec.com//lucene/solr/ , extracted it at my windows machine. Then started solr: [solr-path]/example, and typed the following in a terminal: java –jar start.jar. it started and i can see the solr page at http://localhost:8983/solr/admin/ Now copied Magento [magento-instance-root]/lib/Apache/Solr/conf to [Solr-instance-root]/example/solr/conf. then again restared solr lots of activity was going on their. then I run System-index management and at front end search box i tried to search a product with incorrect spelling, in solr console i can see some activity but at magento front end I couldnt get any result, why ? I followed the steps given at this URL: http://www.summasolutions.net/blogposts/magento-apache-solr-set#comment-615 Please look into it and let me know any other information you require. I also want to know how i can implement facet and highlight search with resulted output. -- View this message in context: http://lucene.472066.n3.nabble.com/SpellCheck-Help-tp3648589p3692518.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SpellCheck Help
You have to give us a lot more detail about exactly what you've done and what your results are. Please review: http://wiki.apache.org/solr/UsingMailingLists Best Erick On Tue, Jan 24, 2012 at 7:42 PM, vishal_asc vishal.por...@ascendum.com wrote: I have installed the same solr 3.5 with jetty and integrating it magento 1.11 but it seems to be not working. As my search result is not showing Did you mean string ? when I misspelled any word. I followed all steps necessary for magento solr integration. Please help ASAP. Thanks Vishal -- View this message in context: http://lucene.472066.n3.nabble.com/SpellCheck-Help-tp3648589p3686756.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SpellCheck Help
I have installed the same solr 3.5 with jetty and integrating it magento 1.11 but it seems to be not working. As my search result is not showing Did you mean string ? when I misspelled any word. I followed all steps necessary for magento solr integration. Please help ASAP. Thanks Vishal -- View this message in context: http://lucene.472066.n3.nabble.com/SpellCheck-Help-tp3648589p3686756.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: SpellCheck Help
Three things to check: 1. Use a higher spellcheck.count than 1. Try 10. IndexBasedSpellChecker pre-filters the possibilities in a first pass of a 2-pass process. If spellcheck.count is too low, all the good suggestions might get filtered on the first pass and then it won't find anything on the second. 2. Be sure you're building the dictionary. Try adding spellcheck.build=true to your first query. You need to do do this every time you start the solr core. 3. Try a lower spellcheck.accuracy. Maybe the default .5 instead of the .7 you've got. One other thing to consider: - If the misspelled word exists in your index, the spellchecker won't try to correct it. This is true even if you're omitting words from the dictionary (for intance, by using thresholdTokenFrequency) James Dyer E-Commerce Systems Ingram Content Group (615) 213-4311 -Original Message- From: Donald Organ [mailto:dor...@donaldorgan.com] Sent: Tuesday, January 10, 2012 1:26 PM To: solr-user@lucene.apache.org Subject: SpellCheck Help I am trying to get the IndexBasedSpellChecker to work. I believe I have everything setup properly and the spellcheck component seems to be running but the suggestions list is empty. I am using SOLR 3.5 with Jetty. My solrconfig.xml and schema.xml are as follows: solrconfig.xml: http://pastie.org/private/z7sharm0ajlmm9hpy41v7g schema.xml: http://pastie.org/private/ykim99unbqfhumxxzbs6g
Re: SpellCheck Help
my copyField was defined as copyfield --- notice the lowercase f On Tue, Jan 10, 2012 at 2:50 PM, Dyer, James james.d...@ingrambook.comwrote: Three things to check: 1. Use a higher spellcheck.count than 1. Try 10. IndexBasedSpellChecker pre-filters the possibilities in a first pass of a 2-pass process. If spellcheck.count is too low, all the good suggestions might get filtered on the first pass and then it won't find anything on the second. 2. Be sure you're building the dictionary. Try adding spellcheck.build=true to your first query. You need to do do this every time you start the solr core. 3. Try a lower spellcheck.accuracy. Maybe the default .5 instead of the .7 you've got. One other thing to consider: - If the misspelled word exists in your index, the spellchecker won't try to correct it. This is true even if you're omitting words from the dictionary (for intance, by using thresholdTokenFrequency) James Dyer E-Commerce Systems Ingram Content Group (615) 213-4311 -Original Message- From: Donald Organ [mailto:dor...@donaldorgan.com] Sent: Tuesday, January 10, 2012 1:26 PM To: solr-user@lucene.apache.org Subject: SpellCheck Help I am trying to get the IndexBasedSpellChecker to work. I believe I have everything setup properly and the spellcheck component seems to be running but the suggestions list is empty. I am using SOLR 3.5 with Jetty. My solrconfig.xml and schema.xml are as follows: solrconfig.xml: http://pastie.org/private/z7sharm0ajlmm9hpy41v7g schema.xml: http://pastie.org/private/ykim99unbqfhumxxzbs6g
RE: Spellcheck help
Thanks for the input, i'll check it out! Marc Subject: RE: Spellcheck help Date: Fri, 23 Jul 2010 13:12:04 -0500 From: james.d...@ingrambook.com To: solr-user@lucene.apache.org In org.apache.solr.spelling.SpellingQueryConverter, find the line (#84): final static String PATTERN = (?:(?!( + NMTOKEN + :|\\d+)))[\\p{L}_\\-0-9]+; and remove the |\\d+ to make it: final static String PATTERN = (?:(?! + NMTOKEN + :))[\\p{L}_\\-0-9]+; My testing shows this solves your problem. The caution is to test it against all your use cases because obviously someone thought we should ignore leading digits from keywords. Surely there's a reason why although I can't think of it. James Dyer E-Commerce Systems Ingram Book Company (615) 213-4311 -Original Message- From: dekay...@hotmail.com [mailto:dekay...@hotmail.com] Sent: Saturday, July 17, 2010 12:41 PM To: solr-user@lucene.apache.org Subject: Re: Spellcheck help Can anybody help me with this? :( -Original Message- From: Marc Ghorayeb Sent: Thursday, July 08, 2010 9:46 AM To: solr-user@lucene.apache.org Subject: Spellcheck help Hello,I've been trying to get rid of a bug when using the spellcheck but so far with no success :(When searching for a word that starts with a number, for example 3dsmax, i get the results that i want, BUT the spellcheck says it is not correctly spelled AND the collation gives me 33dsmax. Further investigation shows that the spellcheck is actually only checking dsmax which it considers does not exist and gives me 3dsmax for better results, but since i have spellcheck.collate = true, the collation that i show is 33dsmax with the first 3 being the one discarded by the spellchecker... Otherwise, the spellcheck works correctly for normal words... any ideas? :(My spellcheck field is fairly classic, whitespace tokenizer, with lowercase filter...Any help would be greatly appreciated :)Thanks,Marc _ Messenger arrive enfin sur iPhone ! Venez le télécharger gratuitement ! http://www.messengersurvotremobile.com/?d=iPhone _ Exclu : Téléchargez la nouvelle version de Messenger ! http://clk.atdmt.com/FRM/go/244627952/direct/01/
RE: Spellcheck help
If you could, let me know how your testing goes with this change. I too am interested in having the Collate work as good as it can. It looks like the code would be better with this change but then again I don't know what the original author was thinking when this was put in. James Dyer E-Commerce Systems Ingram Book Company (615) 213-4311 -Original Message- From: Marc Ghorayeb [mailto:dekay...@hotmail.com] Sent: Tuesday, July 27, 2010 8:07 AM To: solr-user@lucene.apache.org Subject: RE: Spellcheck help Thanks for the input, i'll check it out! Marc Subject: RE: Spellcheck help Date: Fri, 23 Jul 2010 13:12:04 -0500 From: james.d...@ingrambook.com To: solr-user@lucene.apache.org In org.apache.solr.spelling.SpellingQueryConverter, find the line (#84): final static String PATTERN = (?:(?!( + NMTOKEN + :|\\d+)))[\\p{L}_\\-0-9]+; and remove the |\\d+ to make it: final static String PATTERN = (?:(?! + NMTOKEN + :))[\\p{L}_\\-0-9]+; My testing shows this solves your problem. The caution is to test it against all your use cases because obviously someone thought we should ignore leading digits from keywords. Surely there's a reason why although I can't think of it. James Dyer E-Commerce Systems Ingram Book Company (615) 213-4311 -Original Message- From: dekay...@hotmail.com [mailto:dekay...@hotmail.com] Sent: Saturday, July 17, 2010 12:41 PM To: solr-user@lucene.apache.org Subject: Re: Spellcheck help Can anybody help me with this? :( -Original Message- From: Marc Ghorayeb Sent: Thursday, July 08, 2010 9:46 AM To: solr-user@lucene.apache.org Subject: Spellcheck help Hello,I've been trying to get rid of a bug when using the spellcheck but so far with no success :(When searching for a word that starts with a number, for example 3dsmax, i get the results that i want, BUT the spellcheck says it is not correctly spelled AND the collation gives me 33dsmax. Further investigation shows that the spellcheck is actually only checking dsmax which it considers does not exist and gives me 3dsmax for better results, but since i have spellcheck.collate = true, the collation that i show is 33dsmax with the first 3 being the one discarded by the spellchecker... Otherwise, the spellcheck works correctly for normal words... any ideas? :(My spellcheck field is fairly classic, whitespace tokenizer, with lowercase filter...Any help would be greatly appreciated :)Thanks,Marc _ Messenger arrive enfin sur iPhone ! Venez le télécharger gratuitement ! http://www.messengersurvotremobile.com/?d=iPhone _ Exclu : Téléchargez la nouvelle version de Messenger ! http://clk.atdmt.com/FRM/go/244627952/direct/01/
RE: Spellcheck help
In org.apache.solr.spelling.SpellingQueryConverter, find the line (#84): final static String PATTERN = (?:(?!( + NMTOKEN + :|\\d+)))[\\p{L}_\\-0-9]+; and remove the |\\d+ to make it: final static String PATTERN = (?:(?! + NMTOKEN + :))[\\p{L}_\\-0-9]+; My testing shows this solves your problem. The caution is to test it against all your use cases because obviously someone thought we should ignore leading digits from keywords. Surely there's a reason why although I can't think of it. James Dyer E-Commerce Systems Ingram Book Company (615) 213-4311 -Original Message- From: dekay...@hotmail.com [mailto:dekay...@hotmail.com] Sent: Saturday, July 17, 2010 12:41 PM To: solr-user@lucene.apache.org Subject: Re: Spellcheck help Can anybody help me with this? :( -Original Message- From: Marc Ghorayeb Sent: Thursday, July 08, 2010 9:46 AM To: solr-user@lucene.apache.org Subject: Spellcheck help Hello,I've been trying to get rid of a bug when using the spellcheck but so far with no success :(When searching for a word that starts with a number, for example 3dsmax, i get the results that i want, BUT the spellcheck says it is not correctly spelled AND the collation gives me 33dsmax. Further investigation shows that the spellcheck is actually only checking dsmax which it considers does not exist and gives me 3dsmax for better results, but since i have spellcheck.collate = true, the collation that i show is 33dsmax with the first 3 being the one discarded by the spellchecker... Otherwise, the spellcheck works correctly for normal words... any ideas? :(My spellcheck field is fairly classic, whitespace tokenizer, with lowercase filter...Any help would be greatly appreciated :)Thanks,Marc _ Messenger arrive enfin sur iPhone ! Venez le télécharger gratuitement ! http://www.messengersurvotremobile.com/?d=iPhone
Re: Spellcheck help
Can i make a dictionnary of only the words that are having problems? There are not that many terms that present this behavior, but it is important for me to get rid of this bug. So can i use the dictionnary AND the list built by the spellchecker? -Original Message- From: Lance Norskog Sent: Sunday, July 18, 2010 1:42 AM To: solr-user@lucene.apache.org Subject: Re: Spellcheck help Spellchecking can also take a dictionary as its database. Is it possible to create a dictionary of the terms you want suggested? On Sat, Jul 17, 2010 at 10:40 AM, dekay...@hotmail.com wrote: Can anybody help me with this? :( -Original Message- From: Marc Ghorayeb Sent: Thursday, July 08, 2010 9:46 AM To: solr-user@lucene.apache.org Subject: Spellcheck help Hello,I've been trying to get rid of a bug when using the spellcheck but so far with no success :(When searching for a word that starts with a number, for example 3dsmax, i get the results that i want, BUT the spellcheck says it is not correctly spelled AND the collation gives me 33dsmax. Further investigation shows that the spellcheck is actually only checking dsmax which it considers does not exist and gives me 3dsmax for better results, but since i have spellcheck.collate = true, the collation that i show is 33dsmax with the first 3 being the one discarded by the spellchecker... Otherwise, the spellcheck works correctly for normal words... any ideas? :(My spellcheck field is fairly classic, whitespace tokenizer, with lowercase filter...Any help would be greatly appreciated :)Thanks,Marc _ Messenger arrive enfin sur iPhone ! Venez le télécharger gratuitement ! http://www.messengersurvotremobile.com/?d=iPhone -- Lance Norskog goks...@gmail.com
Re: Spellcheck help
You can make two spellcheckers and consult both of them. A spelling database made from an existing text index tends to have a lot of confusing junk. On Sun, Jul 18, 2010 at 4:43 AM, dekay...@hotmail.com wrote: Can i make a dictionnary of only the words that are having problems? There are not that many terms that present this behavior, but it is important for me to get rid of this bug. So can i use the dictionnary AND the list built by the spellchecker? -Original Message- From: Lance Norskog Sent: Sunday, July 18, 2010 1:42 AM To: solr-user@lucene.apache.org Subject: Re: Spellcheck help Spellchecking can also take a dictionary as its database. Is it possible to create a dictionary of the terms you want suggested? On Sat, Jul 17, 2010 at 10:40 AM, dekay...@hotmail.com wrote: Can anybody help me with this? :( -Original Message- From: Marc Ghorayeb Sent: Thursday, July 08, 2010 9:46 AM To: solr-user@lucene.apache.org Subject: Spellcheck help Hello,I've been trying to get rid of a bug when using the spellcheck but so far with no success :(When searching for a word that starts with a number, for example 3dsmax, i get the results that i want, BUT the spellcheck says it is not correctly spelled AND the collation gives me 33dsmax. Further investigation shows that the spellcheck is actually only checking dsmax which it considers does not exist and gives me 3dsmax for better results, but since i have spellcheck.collate = true, the collation that i show is 33dsmax with the first 3 being the one discarded by the spellchecker... Otherwise, the spellcheck works correctly for normal words... any ideas? :(My spellcheck field is fairly classic, whitespace tokenizer, with lowercase filter...Any help would be greatly appreciated :)Thanks,Marc _ Messenger arrive enfin sur iPhone ! Venez le télécharger gratuitement ! http://www.messengersurvotremobile.com/?d=iPhone -- Lance Norskog goks...@gmail.com -- Lance Norskog goks...@gmail.com
Re: Spellcheck help
Can anybody help me with this? :( -Original Message- From: Marc Ghorayeb Sent: Thursday, July 08, 2010 9:46 AM To: solr-user@lucene.apache.org Subject: Spellcheck help Hello,I've been trying to get rid of a bug when using the spellcheck but so far with no success :(When searching for a word that starts with a number, for example 3dsmax, i get the results that i want, BUT the spellcheck says it is not correctly spelled AND the collation gives me 33dsmax. Further investigation shows that the spellcheck is actually only checking dsmax which it considers does not exist and gives me 3dsmax for better results, but since i have spellcheck.collate = true, the collation that i show is 33dsmax with the first 3 being the one discarded by the spellchecker... Otherwise, the spellcheck works correctly for normal words... any ideas? :(My spellcheck field is fairly classic, whitespace tokenizer, with lowercase filter...Any help would be greatly appreciated :)Thanks,Marc _ Messenger arrive enfin sur iPhone ! Venez le télécharger gratuitement ! http://www.messengersurvotremobile.com/?d=iPhone
Re: Spellcheck help
Spellchecking can also take a dictionary as its database. Is it possible to create a dictionary of the terms you want suggested? On Sat, Jul 17, 2010 at 10:40 AM, dekay...@hotmail.com wrote: Can anybody help me with this? :( -Original Message- From: Marc Ghorayeb Sent: Thursday, July 08, 2010 9:46 AM To: solr-user@lucene.apache.org Subject: Spellcheck help Hello,I've been trying to get rid of a bug when using the spellcheck but so far with no success :(When searching for a word that starts with a number, for example 3dsmax, i get the results that i want, BUT the spellcheck says it is not correctly spelled AND the collation gives me 33dsmax. Further investigation shows that the spellcheck is actually only checking dsmax which it considers does not exist and gives me 3dsmax for better results, but since i have spellcheck.collate = true, the collation that i show is 33dsmax with the first 3 being the one discarded by the spellchecker... Otherwise, the spellcheck works correctly for normal words... any ideas? :(My spellcheck field is fairly classic, whitespace tokenizer, with lowercase filter...Any help would be greatly appreciated :)Thanks,Marc _ Messenger arrive enfin sur iPhone ! Venez le télécharger gratuitement ! http://www.messengersurvotremobile.com/?d=iPhone -- Lance Norskog goks...@gmail.com