Re: Slaves always replicate entire index Index versions
Interesting, that there is no such a bug if I disable index compression, discussed here: https://issues.apache.org/jira/browse/SOLR-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566364#comment-13566364 -- View this message in context: http://lucene.472066.n3.nabble.com/Slaves-always-replicate-entire-index-Index-versions-tp4041256p4042967.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Slaves always replicate entire index Index versions
I have the same problem. This bug appeared in 4.0 rarely, but 4.1 downloads the full index every time. -- View this message in context: http://lucene.472066.n3.nabble.com/Slaves-always-replicate-entire-index-Index-versions-tp4041256p4042209.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Issue with spellcheck and autosuggest
you can of course check suggestions, but then you should remove str name=spellcheck.dictionarywordbreak/str from your handler, because its purpose is to find cases, when user types spaces wrongly (e.g., solrrocks, sol rrocks, so lr) -- View this message in context: http://lucene.472066.n3.nabble.com/Issue-with-spellcheck-and-autosuggest-tp4036208p4037631.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Issue with spellcheck and autosuggest
you should check not suggestions, but collations in the response xml -- View this message in context: http://lucene.472066.n3.nabble.com/Issue-with-spellcheck-and-autosuggest-tp4036208p4036977.html Sent from the Solr - User mailing list archive at Nabble.com.
How to disable compression on stored fields in Solr 4.1?
I tried Solr 4.1, reindexed data using DIH (full-import) and compared response time with version 4.0. Response time increased 1.5-2 times. How to disable compression on stored fields in Solr 4.1? I tried to change codec version in solrconfig: luceneMatchVersionLUCENE_40/luceneMatchVersion and reindexed data using DIH (full-import) but it doesn't help, the index is still compressed and response time is still high... -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-disable-compression-on-stored-fields-in-Solr-4-1-tp4037001.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to disable compression on stored fields in Solr 4.1?
I guess, I have to write a new codec that uses a stored fields format which does not compress stored fields such as Lucene40StoredFieldsFormat http://blog.jpountz.net/post/35667727458/stored-fields-compression-in-lucene-4-1 What is the purpose of luceneMatchVersion tag then, does it affect anything at all or LUCENE_40 and LUCENE_41 are just the same in Solr 4.1? -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-disable-compression-on-stored-fields-in-Solr-4-1-tp4037001p4037005.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: why search time increases without term vectors?
Yes, I guess, full index replication is a general bug of 4.x. I tried the same routine with termVectors and got the same result: 1. stopped all Solr instances 2. cleared data folders of all instances 3. ran master, made full-import with optimize option using DIH 4. after import ran slave and did replication 5. ran solrmeter to send updates to the master and gets from the slave the full index was replicated every 20 seconds (not only modified segments). To fix this: 1) I stopped solrmeter 2) stopped the slave and cleared its data directory 3) clicked Optimize in the control panel of the master 4) ran slave and did replication 5) ran solrmeter to send updates to the master and gets from the slave But this replication bug didn't affect increased response time. There is still a strong relation between absense of termVectors and increased response time. I have no idea why... -- View this message in context: http://lucene.472066.n3.nabble.com/why-search-time-increases-without-term-vectors-tp4035900p4037010.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: why search time increases without term vectors?
I guess, response time increased, because I use master-slave configuration in Solr 4.0 and Solr 4.1: if there are no termVectors, the full index is replicated; if there are termVectors, only modified segments of the index are transferred from the master to slaves. Am I right? -- View this message in context: http://lucene.472066.n3.nabble.com/why-search-time-increases-without-term-vectors-tp4035900p4036962.html Sent from the Solr - User mailing list archive at Nabble.com.
SolrCloud with Near Realtime Search: buildOnOptimize in IndexBasedSpellChecker
When an optimization event occurs in this case? Should I reindex this spellchecker on every shard manually? Or does this even occurs every hard or soft commit? -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-with-Near-Realtime-Search-buildOnOptimize-in-IndexBasedSpellChecker-tp4027499.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrCloud with Near Realtime Search: buildOnOptimize in IndexBasedSpellChecker
Thank you, Tomás. This wiki http://wiki.apache.org/solr/UpdateXmlMessages#A.22commit.22_and_.22optimize.22 says *Segments are normally merged over time anyway (as determined by the merge policy), and optimize just forces these merges to occur immediately.* Doesn't the merge policy affects buildOnOptimize setting and trigger spellcheck index rebuilding? -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-with-Near-Realtime-Search-buildOnOptimize-in-IndexBasedSpellChecker-tp4027499p4027510.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrCloud with Near Realtime Search: buildOnOptimize in IndexBasedSpellChecker
Thank you, Upayavira, I know about the DirectSpellChecker. But I want to know how IndexBasedSpellChecker is handled in SolrCloud. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-with-Near-Realtime-Search-buildOnOptimize-in-IndexBasedSpellChecker-tp4027499p4027514.html Sent from the Solr - User mailing list archive at Nabble.com.
Re[4]: Cannot run Solr4 from Intellij Idea
Thank you. I will read about these commands. I don't copy anything anywhere. I just edit the code and click Run, IDEA does everything for me. I guess, IDEA's artifacts are exactly for these routines. Anyway, there are no such instructions, you described, anywhere in the solr wiki, so it's hard to start developing Solr for novices like me. Четверг, 6 декабря 2012, 16:06 от Erick Erickson [via Lucene] ml-node+s472066n4024970...@n3.nabble.com: Why do this? It's trivial to attach IntelliJ to a running solr, just create remote configuration. When you do, it'll give you parameters you'll be able to start Solr with and attach from IntelliJ, set breakpoints, etc. Something like: java -Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=y,address=5900 -jar start.jar You'll get the parameters to start Solr with when you create the remote configuration in IntelliJ. Then, I do an ant example from solrhome/solr, go into the example dir and I'm off to the races. The suspend=y means that solr just sits there until you attach IntelliJ. I suspect that if you've copied things around, if you change Solr you'll have a world of problems getting the changed jars to the right places. It's a bit of a pain that when you do make changes to solr code, you have to do another ant example but if your goal is to simply step through Solr code, it's much easier to do a remote debugging session. Best Erick On Wed, Dec 5, 2012 at 11:55 PM, Artyom [hidden email] wrote: See the screenshots: solr_idea1: adding an IDEA tomcat artifact solr_idea2: adding an IDEA facet solr_idea3: placing modules into the artifact (drag modules from the Available Elements to output root) and the created facet Среда, 5 декабря 2012, 7:28 от sarowe [via Lucene] [hidden email]: Hi Artyom, I don't use IntelliJ artifacts - I just edit/compile/test. I can include this stuff in the IntelliJ configuration if you'll help me. Can you share screenshots of what you're talking about, and/or IntelliJ config files? Steve On Dec 5, 2012, at 8:24 AM, Artyom [hidden email] wrote: InelliJ IDEA is not so intelligent with Solr: to fix this problem I've dragged these modules into the IDEA's artifact (parent module is wrong): analysis-common analysis-extras analysis-uima clustering codecs codecs-resources dataimporthandler dataimporthandler-extras lucene-core lucene-core-resources solr-core -- View this message in context: http://lucene.472066.n3.nabble.com/Cannot-run-Solr4-from-Intellij-Idea-tp4024233p4024452.html Sent from the Solr - User mailing list archive at Nabble.com. -- If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Cannot-run-Solr4-from-Intellij-Idea-tp4024233p4024484.html To unsubscribe from Cannot run Solr4 from Intellij Idea, click here. NAML =?UTF-8?B?c29scl9pZGVhMS5wbmc=?= (102K) http://lucene.472066.n3.nabble.com/attachment/4024723/0/%3D%3FUTF-8%3FB%3Fc29scl9pZGVhMS5wbmc%3D%3F%3D =?UTF-8?B?c29scl9pZGVhMi5wbmc=?= (117K) http://lucene.472066.n3.nabble.com/attachment/4024723/1/%3D%3FUTF-8%3FB%3Fc29scl9pZGVhMi5wbmc%3D%3F%3D =?UTF-8?B?c29scl9pZGVhMy5wbmc=?= (148K) http://lucene.472066.n3.nabble.com/attachment/4024723/2/%3D%3FUTF-8%3FB%3Fc29scl9pZGVhMy5wbmc%3D%3F%3D -- View this message in context: http://lucene.472066.n3.nabble.com/Cannot-run-Solr4-from-Intellij-Idea-tp4024233p4024723.html Sent from the Solr - User mailing list archive at Nabble.com. -- If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Cannot-run-Solr4-from-Intellij-Idea-tp4024233p4024970.html To unsubscribe from Cannot run Solr4 from Intellij Idea, click here. NAML -- View this message in context: http://lucene.472066.n3.nabble.com/Cannot-run-Solr4-from-Intellij-Idea-tp4024233p4025020.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr 4 in IntelliJ IDEA: make project errors
I have followed this instruction: http://wiki.apache.org/lucene-java/HowtoConfigureIntelliJ 1. Downloaded lucene_solr_4_0 branch 2. ant idea 3. opened this project in IDEA 4. clicked Build/Make project menu I got message: Compilation completed with 111 errors and 9 warnings C:\solr\lucene\benchmark\src\java\org\apache\lucene\benchmark\byTask\utils\StreamUtils.java Error: (32, 47) package org.apache.commons.compress.compressors does not exist Error: (33, 47) package org.apache.commons.compress.compressors does not exist ... what should I do to make the project without errors? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-in-IntelliJ-IDEA-make-project-errors-tp4024439.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Cannot run Solr4 from Intellij Idea
InelliJ IDEA is not so intelligent with Solr: to fix this problem I've dragged these modules into the IDEA's artifact (parent module is wrong): analysis-common analysis-extras analysis-uima clustering codecs codecs-resources dataimporthandler dataimporthandler-extras lucene-core lucene-core-resources solr-core -- View this message in context: http://lucene.472066.n3.nabble.com/Cannot-run-Solr4-from-Intellij-Idea-tp4024233p4024452.html Sent from the Solr - User mailing list archive at Nabble.com.
Re[2]: Cannot run Solr4 from Intellij Idea
See the screenshots: solr_idea1: adding an IDEA tomcat artifact solr_idea2: adding an IDEA facet solr_idea3: placing modules into the artifact (drag modules from the Available Elements to output root) and the created facet Среда, 5 декабря 2012, 7:28 от sarowe [via Lucene] ml-node+s472066n402448...@n3.nabble.com: Hi Artyom, I don't use IntelliJ artifacts - I just edit/compile/test. I can include this stuff in the IntelliJ configuration if you'll help me. Can you share screenshots of what you're talking about, and/or IntelliJ config files? Steve On Dec 5, 2012, at 8:24 AM, Artyom [hidden email] wrote: InelliJ IDEA is not so intelligent with Solr: to fix this problem I've dragged these modules into the IDEA's artifact (parent module is wrong): analysis-common analysis-extras analysis-uima clustering codecs codecs-resources dataimporthandler dataimporthandler-extras lucene-core lucene-core-resources solr-core -- View this message in context: http://lucene.472066.n3.nabble.com/Cannot-run-Solr4-from-Intellij-Idea-tp4024233p4024452.html Sent from the Solr - User mailing list archive at Nabble.com. -- If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Cannot-run-Solr4-from-Intellij-Idea-tp4024233p4024484.html To unsubscribe from Cannot run Solr4 from Intellij Idea, click here. NAML =?UTF-8?B?c29scl9pZGVhMS5wbmc=?= (102K) http://lucene.472066.n3.nabble.com/attachment/4024723/0/%3D%3FUTF-8%3FB%3Fc29scl9pZGVhMS5wbmc%3D%3F%3D =?UTF-8?B?c29scl9pZGVhMi5wbmc=?= (117K) http://lucene.472066.n3.nabble.com/attachment/4024723/1/%3D%3FUTF-8%3FB%3Fc29scl9pZGVhMi5wbmc%3D%3F%3D =?UTF-8?B?c29scl9pZGVhMy5wbmc=?= (148K) http://lucene.472066.n3.nabble.com/attachment/4024723/2/%3D%3FUTF-8%3FB%3Fc29scl9pZGVhMy5wbmc%3D%3F%3D -- View this message in context: http://lucene.472066.n3.nabble.com/Cannot-run-Solr4-from-Intellij-Idea-tp4024233p4024723.html Sent from the Solr - User mailing list archive at Nabble.com.
Cannot run Solr4 from Intellij Idea
After 2 days I have figured out how to open Solr 4 in IntelliJ IDEA 11.1.4 on Tomcat 7. IntelliJ IDEA finds webapp/web/WEB-INF/web.xml and offers to make a facet from it and adds this facet to the parent module, from which an artifact can be created. The problem is that Solr cannot run properly. I get this message: SEVERE: Unable to create core: mycore org.apache.solr.common.SolrException: Plugin init failure for [schema.xml] fieldType text: Plugin init failure for [schema.xml] analyzer/tokenizer: Error loading class 'solr.StandardTokenizerFactory' at org.apache.solr.util.plugin.AbstractPluginLoader.load(AbstractPluginLoader.java:177) at org.apache.solr.schema.IndexSchema.readSchema(IndexSchema.java:369) at org.apache.solr.schema.IndexSchema.init(IndexSchema.java:113) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:846) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:534) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:356) at org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:308) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:107) at org.apache.catalina.core.ApplicationFilterConfig.initFilter(ApplicationFilterConfig.java:277) at org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:258) at org.apache.catalina.core.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java:382) at org.apache.catalina.core.ApplicationFilterConfig.init(ApplicationFilterConfig.java:103) at org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:4650) at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5306) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:618) at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:650) at org.apache.catalina.startup.HostConfig$DeployDescriptor.run(HostConfig.java:1582) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.solr.common.SolrException: Plugin init failure for [schema.xml] analyzer/tokenizer: Error loading class 'solr.StandardTokenizerFactory' at org.apache.solr.util.plugin.AbstractPluginLoader.load(AbstractPluginLoader.java:177) at org.apache.solr.schema.FieldTypePluginLoader.readAnalyzer(FieldTypePluginLoader.java:344) at org.apache.solr.schema.FieldTypePluginLoader.create(FieldTypePluginLoader.java:95) at org.apache.solr.schema.FieldTypePluginLoader.create(FieldTypePluginLoader.java:43) at org.apache.solr.util.plugin.AbstractPluginLoader.load(AbstractPluginLoader.java:151) ... 25 more Caused by: org.apache.solr.common.SolrException: Error loading class 'solr.StandardTokenizerFactory' at org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:436) at org.apache.solr.core.SolrResourceLoader.newInstance(SolrResourceLoader.java:457) at org.apache.solr.util.plugin.AbstractPluginLoader.create(AbstractPluginLoader.java:89) at org.apache.solr.util.plugin.AbstractPluginLoader.load(AbstractPluginLoader.java:151) ... 29 more Caused by: java.lang.ClassNotFoundException: solr.StandardTokenizerFactory at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:627) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:247) at org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:420) ... 32 more I tried to debug it and found it cannot resolve 'solr.StandardTokenizerFactory' because it searches this class inside solr, when it is inside lucene. I can update my schema.xml and replace all solr shorname with full class names, but I don't think it is correct, because Solr runs properly with this schema on Tomcat 7 if run not from Intellij
