Re: Sort by payload field desc fails
I was seeing the issue with payload sort on SOLR 6.6.0 version. This issue resolved when we started using 7.4.0 version. On Tue, Jul 3, 2018 at 5:34 PM, Anurag Nilesh wrote: > Hi, > I was trying out extracting the payload field value for a payload field > type and then doing a sort based on that value. > > For some reason, the sort works with ascending order but fails with > descending order. > > { > "responseHeader":{ > "status":500, > "QTime":1, > "params":{ > "p":"payload(price_dpf, b)", > "q":"*:*", > "indent":"on", > "fl":"${p},item", > "sort":"${p} desc", > "rows":"10", > "wt":"json"}}, > "error":{ > "msg":"-64", > "trace":"java.lang.ArrayIndexOutOfBoundsException: -64\n\tat > org.apache.lucene.codecs.lucene50.ForUtil.readBlock(ForUtil.java:196)\n\tat > org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$EverythingEnum.refillPositions(Lucene50PostingsReader.java:1024)\n\tat > > org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$EverythingEnum.nextPosition(Lucene50PostingsReader.java:1226)\n\tat > > org.apache.solr.search.FloatPayloadValueSource$1.floatVal(FloatPayloadValueSource.java:163)\n\tat > > org.apache.lucene.queries.function.docvalues.FloatDocValues.doubleVal(FloatDocValues.java:60)\n\tat > > org.apache.lucene.queries.function.ValueSource$ValueSourceComparator.compareBottom(ValueSource.java:259)\n\tat > > org.apache.lucene.search.TopFieldCollector$SimpleFieldCollector$1.collect(TopFieldCollector.java:117)\n\tat > > org.apache.lucene.search.MatchAllDocsQuery$1$1.score(MatchAllDocsQuery.java:56)\n\tat > org.apache.lucene.search.BulkScorer.score(BulkScorer.java:39)\n\tat > org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:668)\n\tat > org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:472)\n\tat > org.apache.solr.search.SolrIndexSearcher.buildAndRunCollectorChain(SolrIndexSearcher.java:217)\n\tat > > org.apache.solr.search.SolrIndexSearcher.getDocListNC(SolrIndexSearcher.java:1582)\n\tat > > org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1399)\n\tat > > org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:566)\n\tat > > org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:545)\n\tat > > org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:296)\n\tat > > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)\n\tat > org.apache.solr.core.SolrCore.execute(SolrCore.java:2477)\n\tat > org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:723)\n\tat > org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:529)\n\tat > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:361)\n\tat > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:305)\n\tat > > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1691)\n\tat > > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)\n\tat > > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat > > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat > > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat > > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\n\tat > > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)\n\tat > > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat > > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\n\tat > > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat > > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)\n\tat > > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)\n\tat > > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat > > org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)\n\tat > > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat > org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat > org.eclipse.jetty.server.HttpChannel.handle(HttpChannel
Sort by payload field desc fails
readPool.runJob(QueuedThreadPool.java:671)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\n\tat java.lang.Thread.run(Thread.java:748)\n", "code":500}} Do you guys have any pointers on how to resolve this? Thanks, Anurag
ant compile = not able to resolve dependencies
Hi, I am facing issue in resolving the dependency while doing 'ant compile' on trunk, seeing following error: [ivy:retrieve] :: UNRESOLVED DEPENDENCIES :: [ivy:retrieve] :: [ivy:retrieve] :: org.restlet.jee#org.restlet.ext.servlet;2.3.0: configuration not found in org.restlet.jee#org.restlet.ext.servlet;2.3.0: 'master'. It was required from org.apache.solr#core;working@pc compile Please suggest if anyone faced this issue. Thanks Anurag
Re: ant compile = not able to resolve dependencies
Any directions to resolve it is also helpful. On Sat, Jan 10, 2015 at 2:48 PM, Anurag Sharma anura...@gmail.com wrote: Hi, I am facing issue in resolving the dependency while doing 'ant compile' on trunk, seeing following error: [ivy:retrieve] :: UNRESOLVED DEPENDENCIES :: [ivy:retrieve] :: [ivy:retrieve] :: org.restlet.jee#org.restlet.ext.servlet;2.3.0: configuration not found in org.restlet.jee#org.restlet.ext.servlet;2.3.0: 'master'. It was required from org.apache.solr#core;working@pc compile Please suggest if anyone faced this issue. Thanks Anurag
Re: Solr HTTP client authentication
I think Solr encourage SSL than authentication On Mon, Nov 17, 2014 at 6:08 PM, Bai Shen baishen.li...@gmail.com wrote: I am using solrj to connect to my solr server. However I need to authenticate against the server and can not find out how to do so using solrj. Is this possible or do I need to drop solrj? I can manually create an httpclient and set up authentication but then I can't use solrj. Thanks.
Eclipse junit run issue after run in Cloud mode
Am facing issue in running junit after 'svn up', junit works well without any issue with a fresh trunk checkout. Only difference between fresh and updated is that the earlier was once launched solr in cloud mode. There is no issue in running through ant test -Dtestcase. Following are the log when running in the svn updated env. Does anyone faced the same issue? Eclipse console log: SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/C:/work/trunk/solr/core/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/C:/work/trunk/solr/solrj/test-lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout. NOTE: test params are: codec=null, sim=null, locale=null, timezone=(null) NOTE: Windows 8 6.2 amd64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=4,threads=1,free=61030064,total=77594624 NOTE: All tests run in this JVM: [AtomicUpdatesTest] NOTE: reproduce with: ant test -Dtestcase=AtomicUpdatesTest -Dtests.seed=7DDB6D72ED561A31 -Dtests.asserts=true -Dtests.file.encoding=UTF-8 JUnit error in Eclipse java.lang.VerifyError: class org.apache.lucene.codecs.lucene40.Lucene40CompoundReader overrides final method makeLock.(Ljava/lang/String;)Lorg/apache/lucene/store/Lock; at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(Unknown Source) at java.security.SecureClassLoader.defineClass(Unknown Source) at java.net.URLClassLoader.defineClass(Unknown Source) at java.net.URLClassLoader.access$100(Unknown Source) at java.net.URLClassLoader$1.run(Unknown Source) at java.net.URLClassLoader$1.run(Unknown Source) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) at org.apache.lucene.codecs.lucene40.Lucene40Codec.init(Lucene40Codec.java:43) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) at java.lang.Class.newInstance(Unknown Source) at org.apache.lucene.util.NamedSPILoader.reload(NamedSPILoader.java:67) at org.apache.lucene.util.NamedSPILoader.init(NamedSPILoader.java:47) at org.apache.lucene.util.NamedSPILoader.init(NamedSPILoader.java:37) at org.apache.lucene.codecs.Codec.clinit(Codec.java:42) at org.apache.lucene.util.TestRuleSetupAndRestoreClassEnv.before(TestRuleSetupAndRestoreClassEnv.java:152) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at java.lang.Thread.run(Unknown Source) java.lang.NoClassDefFoundError: Could not initialize class org.apache.lucene.codecs.Codec at org.apache.lucene.util.TestRuleSetupAndRestoreClassEnv.after(TestRuleSetupAndRestoreClassEnv.java:296) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:52) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at
Re: solr IRC
Thanks a lot Shawn for the detailed explanation. The wiki is also very helpful. Any recommended client like pidgin, adium etc. especially for windows. On Sat, Nov 15, 2014 at 11:26 PM, Shawn Heisey apa...@elyograg.org wrote: On 11/14/2014 10:32 PM, Anurag Sharma wrote: Also like know, is this the only IRC or there are other's as well like solr dev, lucene dev etc The freenode channels #solr and #solr-dev exist specifically for Solr. End users should keep their questions in #solr, because #solr-dev is for discussions around development of Solr itself. As a specific example: Initial discussion of a possible bug should begin in #solr. If you want to be part of the conversation for FIXING that bug, then #solr-dev would be appropriate. For the wider lucene ecosystem, there are #lucene and #lucene-dev, but Solr questions should only be asked there as a last resort, because it's off-topic for those channels and many residents probably don't know anything about Solr. It can take quite a while for someone to notice your question after you have asked it. The person that notices your question first may not know the answer, though. I've created a wiki page about the IRC channels, and I've pinged our admin UI expert about using that wiki page as the landing point for the IRC Channel link in the Solr admin UI. https://wiki.apache.org/solr/IRCChannels Thanks, Shawn
Re: DIH Blob data
bq: We routinely store images and pdfs in Solr. There *is* a benefit, since you don't need to manage another storage system, you don't have to worry about Solr getting out of sync with the other system, you can use Solr replication for all your assets, etc. Do the same holds good for large Blobs like image, audio, video as well? Tika supports multiple file formats (http://tika.apache.org/1.5/formats.html) but not sure how good is the Solr/Tika combination. Storing pdf and other docs could be useful in Solr, tika can extract metadata from the docs and make them discoverable. Considering all the above cases there should also be a support for File field type in Solr like other types Date, Float, Int, Long, String etc. but looks like there are only two file types ( http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/core/src/java/org/apache/solr/schema/) and both re external file storage. - ExternalFileField.java http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/core/src/java/org/apache/solr/schema/ExternalFileField.java - ExternalFileFieldReloader.java http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/core/src/java/org/apache/solr/schema/ExternalFileFieldReloader.java What type can be used in schema when storing the files internally? On Thu, Nov 13, 2014 at 3:48 AM, Jeon Woosung jeonwoos...@gmail.com wrote: How about this? First, define a field for filter query. It should be multivalued. Second, implements transformer to extract json dynamic fields, and put the dynamic fields into the solr field. For example, fieldType name=terms class=string multivalued=true/ Data : {a:1,b:2,c:3} You can split the data to a:1, b:2, c:3, and put them into terms. And then you can use filter query like fq=terms:a:1 2014. 11. 13. 오전 3:59에 Michael Sokolov msoko...@safaribooksonline.com 님이 작성: We routinely store images and pdfs in Solr. There *is* a benefit, since you don't need to manage another storage system, you don't have to worry about Solr getting out of sync with the other system, you can use Solr replication for all your assets, etc. I don't use DIH, so personally I don't care whether it handles blobs, but it does seem like a natural extension for a system that indexes data from SQL in Solr. -Mike On 11/12/2014 01:31 PM, Anurag Sharma wrote: BLOB is non-searchable field so there is no benefit of storing it into Solr. Any external key-value store can be used to store the blob and reference of this blob can be stored as a string field in Solr. On Wed, Nov 12, 2014 at 5:56 PM, stockii stock.jo...@googlemail.com wrote: I had a similar problem and didnt find any solution to use the fields in JSON Blob for a filter ... Not with DIH. -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-Blob-data-tp4168896p4168925.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Restrict search to subset (a list of aprrox 40,000 ids from an external service) of corpus
Is it possible to add another integer dyanmicField to the selected doc ids? If yes, further can add update incremental/same values to these docs now search can be done to this subset using range/filter query. On Fri, Nov 14, 2014 at 10:21 PM, henry cleland hnoclel...@gmail.com wrote: Hi guys, How do I search only a subset of my corpus based on a large list of non consecutive unique key ids (cannot do a range query). Is there a way around doing this q=id:(id1 OR id2 OR id3 OR id4 ... OR id4 ) AND name:* Also what is the limit of ORs i can apply on the query if that is the only way out, i don't suppose it is infinity. Thanks
Re: DIH Blob data
Thanks Michael Eric for the succinct response. On Sat, Nov 15, 2014 at 12:13 AM, Michael Sokolov msoko...@safaribooksonline.com wrote: There is a binary type -Mike On 11/14/2014 12:21 PM, Anurag Sharma wrote: bq: We routinely store images and pdfs in Solr. There *is* a benefit, since you don't need to manage another storage system, you don't have to worry about Solr getting out of sync with the other system, you can use Solr replication for all your assets, etc. Do the same holds good for large Blobs like image, audio, video as well? Tika supports multiple file formats (http://tika.apache.org/1.5/ formats.html) but not sure how good is the Solr/Tika combination. Storing pdf and other docs could be useful in Solr, tika can extract metadata from the docs and make them discoverable. Considering all the above cases there should also be a support for File field type in Solr like other types Date, Float, Int, Long, String etc. but looks like there are only two file types ( http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/ core/src/java/org/apache/solr/schema/) and both re external file storage. - ExternalFileField.java http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/ core/src/java/org/apache/solr/schema/ExternalFileField.java - ExternalFileFieldReloader.java http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/ core/src/java/org/apache/solr/schema/ExternalFileFieldReloader.java What type can be used in schema when storing the files internally? On Thu, Nov 13, 2014 at 3:48 AM, Jeon Woosung jeonwoos...@gmail.com wrote: How about this? First, define a field for filter query. It should be multivalued. Second, implements transformer to extract json dynamic fields, and put the dynamic fields into the solr field. For example, fieldType name=terms class=string multivalued=true/ Data : {a:1,b:2,c:3} You can split the data to a:1, b:2, c:3, and put them into terms. And then you can use filter query like fq=terms:a:1 2014. 11. 13. 오전 3:59에 Michael Sokolov msoko...@safaribooksonline.com 님이 작성: We routinely store images and pdfs in Solr. There *is* a benefit, since you don't need to manage another storage system, you don't have to worry about Solr getting out of sync with the other system, you can use Solr replication for all your assets, etc. I don't use DIH, so personally I don't care whether it handles blobs, but it does seem like a natural extension for a system that indexes data from SQL in Solr. -Mike On 11/12/2014 01:31 PM, Anurag Sharma wrote: BLOB is non-searchable field so there is no benefit of storing it into Solr. Any external key-value store can be used to store the blob and reference of this blob can be stored as a string field in Solr. On Wed, Nov 12, 2014 at 5:56 PM, stockii stock.jo...@googlemail.com wrote: I had a similar problem and didnt find any solution to use the fields in JSON Blob for a filter ... Not with DIH. -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-Blob-data- tp4168896p4168925.html Sent from the Solr - User mailing list archive at Nabble.com.
solr IRC
Is this correct link to Solr IRC - http://webchat.freenode.net/?channels=#solr I tried couple of times using the IRC, the list of online users are always good but never get any response on the query and also don't see any communication/discussion.
Re: solr IRC
I tried couple of weeks earlier as well. As suggested, will try again after mid next week. On Sat, Nov 15, 2014 at 10:53 AM, Alexandre Rafalovitch arafa...@gmail.com wrote: If you tried this week it is because everybody was at the conference. Try again mid next week. Regards, Alex On 14/11/2014 11:35 pm, Anurag Sharma anura...@gmail.com wrote: Is this correct link to Solr IRC - http://webchat.freenode.net/?channels=#solr I tried couple of times using the IRC, the list of online users are always good but never get any response on the query and also don't see any communication/discussion.
Re: solr IRC
Also like know, is this the only IRC or there are other's as well like solr dev, lucene dev etc On Sat, Nov 15, 2014 at 10:59 AM, Anurag Sharma anura...@gmail.com wrote: I tried couple of weeks earlier as well. As suggested, will try again after mid next week. On Sat, Nov 15, 2014 at 10:53 AM, Alexandre Rafalovitch arafa...@gmail.com wrote: If you tried this week it is because everybody was at the conference. Try again mid next week. Regards, Alex On 14/11/2014 11:35 pm, Anurag Sharma anura...@gmail.com wrote: Is this correct link to Solr IRC - http://webchat.freenode.net/?channels=#solr I tried couple of times using the IRC, the list of online users are always good but never get any response on the query and also don't see any communication/discussion.
Re: SOLRJ Atomic updates of String field
I understood the query now. Atomic Update and Optimistic Concurrency are independent in Solr version 5. Not sure about version 4.2, if they are combined in this version a _version_ field is needed to pass in every update. The atomic/partial update will succeed if version in the request and indexed doc matches otherwise response will have HTTP error code 409. You can try by passing the _version_ of indexed doc during update. It's also good to add a unit test in Solr for partial update which currently I see missing. On Wed, Nov 12, 2014 at 1:00 PM, Ahmet Arslan iori...@yahoo.com.invalid wrote: Hi Bbarani, Partial update solrJ example can be found in : http://find.searchhub.org/document/5b1187abfcfad33f Ahmet On Tuesday, November 11, 2014 8:51 PM, bbarani bbar...@gmail.com wrote: I am using the below code to do partial update (in SOLR 4.2) partialUpdate = new HashMapString, Object(); partialUpdate.put(set,Object); doc.setField(description, partialUpdate); server.add(docs); server.commit(); I am seeing the below description value with {set =...}, Any idea why this is getting added? str name=description {set=The iPhone 6 Plus features a 5.5-inch retina HD display, the A8 chip for faster processing and longer battery life, the M8 motion coprocessor to track speed, distance and elevation, and with an 8MP iSight camera, you can record 1080p HD Video at 60 FPS!} /str -- View this message in context: http://lucene.472066.n3.nabble.com/SOLRJ-Atomic-updates-of-String-field-tp4168809.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: DIH Blob data
BLOB is non-searchable field so there is no benefit of storing it into Solr. Any external key-value store can be used to store the blob and reference of this blob can be stored as a string field in Solr. On Wed, Nov 12, 2014 at 5:56 PM, stockii stock.jo...@googlemail.com wrote: I had a similar problem and didnt find any solution to use the fields in JSON Blob for a filter ... Not with DIH. -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-Blob-data-tp4168896p4168925.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Analytics result for each Result Group
Probably sum and division can be applied to get the median. If you are using ver above 5, http://svn.apache.org/repos/asf/lucene/dev//trunk/solr/contrib/analytics/src/java/org/apache/solr/analytics/statistics/MedianStatsCollector.java can be used directly On Tue, Nov 11, 2014 at 5:49 PM, Talat Uyarer ta...@uyarer.com wrote: Hi Anurag, How can I find median function ? I use a lot that. 2014-11-09 20:39 GMT+02:00 Anurag Sharma anura...@gmail.com: Can a function query(http://wiki.apache.org/solr/FunctionQuery) serves your use case On Wed, Nov 5, 2014 at 3:36 PM, Talat Uyarer ta...@uyarer.com wrote: I searched wiki pages about that. I do not find any documentation. If you help me I will be glad. Thanks 2014-11-04 11:34 GMT+02:00 Talat Uyarer ta...@uyarer.com: Hi folks, We use Analytics Component for median, max etc. I wonder if I use group.field parameter with analytics component, How to calculate analytics for each result group ? Thanks -- Talat UYARER Websitesi: http://talat.uyarer.com Twitter: http://twitter.com/talatuyarer Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304 -- Talat UYARER Websitesi: http://talat.uyarer.com Twitter: http://twitter.com/talatuyarer Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304 -- Talat UYARER Websitesi: http://talat.uyarer.com Twitter: http://twitter.com/talatuyarer Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
Re: SOLRJ Atomic updates of String field
Sorry didn't get what you are trying to achieve and the issue. On Wed, Nov 12, 2014 at 12:20 AM, bbarani bbar...@gmail.com wrote: I am using the below code to do partial update (in SOLR 4.2) partialUpdate = new HashMapString, Object(); partialUpdate.put(set,Object); doc.setField(description, partialUpdate); server.add(docs); server.commit(); I am seeing the below description value with {set =...}, Any idea why this is getting added? str name=description {set=The iPhone 6 Plus features a 5.5-inch retina HD display, the A8 chip for faster processing and longer battery life, the M8 motion coprocessor to track speed, distance and elevation, and with an 8MP iSight camera, you can record 1080p HD Video at 60 FPS!} /str -- View this message in context: http://lucene.472066.n3.nabble.com/SOLRJ-Atomic-updates-of-String-field-tp4168809.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Best way to map holidays to corresponding date
Not sure this is the correct way but can we use synonyms here On Wed, Nov 5, 2014 at 6:14 PM, Jack Krupansky j...@basetechnology.com wrote: Unfortunately, a date is a non-analyzed field, so you can't do something like a synonym. Further, Holidays are repeating - every year - and the dates can vary, so they won't match exactly. Use an update request processor to examine the date field at values index time and look up and store the holiday name in a text field so that you can do a query such as holiday:easter. It could be a string field, but they case would have to match exactly You could code this in a JavaScript script that has the logic or hard dates for various holidays using the stateless script update processor. -- Jack Krupansky -Original Message- From: Patrick Kirsch Sent: Wednesday, November 5, 2014 6:12 AM To: solr-user@lucene.apache.org Subject: Best way to map holidays to corresponding date Hey, maybe someone already faced the situation and could give me a hint. Given one query includes Easter or Sylvester I search for the best place to translate the string to the corresponding date. Is there any solr.Mapping*Factory for that? Do I need to implement it in a custom Solr Query Parser etc.? Regards, Patrick
Re: indexing errors when storeOffsetsWithPositions=true in solr 4.9.1
Is it possible to share the sequence of steps with data causing this issue On Wed, Nov 5, 2014 at 4:51 PM, Alan Woodward a...@flax.co.uk wrote: Hi Min, Do you have the specific bit of text that caused this exception to be thrown? Alan Woodward www.flax.co.uk On 4 Nov 2014, at 23:15, Min L wrote: Hi All: I am using solr 4.9.1. and trying to use PostingsSolrHighlighter. But I got errors during indexing. I thought LUCENE-5111 has fixed issues with WordDelimitedFilter. The error is as below: Caused by: java.lang.IllegalArgumentException: startOffset must be non-negative, and endOffset must be = startOffset, and offsets must not go backwards startOffset=31,endOffset=44,lastStartOffset=37 for field 'description_texts' at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:630) at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:342) at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:301) at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:241) at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:451) at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1539) at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:240) at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:164) My schema.xml looks like below: dynamicField name=*_texts stored=true type=text multiValued=true indexed=true storeOffsetsWithPositions=true/ fieldType name=text class=solr.TextField omitNorms=false analyzer type=index charFilter class=solr.HTMLStripCharFilterFactory/ tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.StemmerOverrideFilterFactory dictionary= stemdict_en.txt / filter class=solr.PatternReplaceFilterFactory pattern= ^(\p{Punct}*)(.*?)(\p{Punct}*)$ replacement=$2/ filter class=solr.KStemFilterFactory/ filter class=solr.StopFilterFactory words=stopwords_english.txt ignoreCase=true enablePositionIncrements=true / filter class=solr.WordDelimiterFilterFactory preserveOriginal=1 splitOnNumerics=0 catenateWords=1 / /analyzer analyzer type=query tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.StopFilterFactory words=stopwords_english.txt ignoreCase=true enablePositionIncrements=true / filter class=solr.WordDelimiterFilterFactory preserveOriginal=1 splitOnNumerics=0 catenateWords=1 / filter class=solr.StemmerOverrideFilterFactory dictionary= stemdict_en.txt / filter class=solr.KStemFilterFactory/ /analyzer /fieldType Any help is appreciated. Thanks. Min
Re: Analytics result for each Result Group
Can a function query(http://wiki.apache.org/solr/FunctionQuery) serves your use case On Wed, Nov 5, 2014 at 3:36 PM, Talat Uyarer ta...@uyarer.com wrote: I searched wiki pages about that. I do not find any documentation. If you help me I will be glad. Thanks 2014-11-04 11:34 GMT+02:00 Talat Uyarer ta...@uyarer.com: Hi folks, We use Analytics Component for median, max etc. I wonder if I use group.field parameter with analytics component, How to calculate analytics for each result group ? Thanks -- Talat UYARER Websitesi: http://talat.uyarer.com Twitter: http://twitter.com/talatuyarer Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304 -- Talat UYARER Websitesi: http://talat.uyarer.com Twitter: http://twitter.com/talatuyarer Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
Re: Solr exceptions during batch indexing
Just trying to understand what's the challenge in returning the bad doc id(s)? Solr already know which doc(s) failed on update and can return their id(s) in response or callback. Can we have JIRA ticket on it if it doesn't exist? This looks like a common use case and every solr consumer might be writing their own versions to handle this issue. On Sat, Nov 8, 2014 at 1:17 AM, Walter Underwood wun...@wunderwood.org wrote: Right, that is why we batch. When a batch of 1000 fails, drop to a batch size of 1 and start the batch over. Then it can report the exact document with problems. If you want to continue, go back to the bigger batch size. I usually fail the whole batch on one error. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ On Nov 7, 2014, at 11:44 AM, Peter Keegan peterlkee...@gmail.com wrote: I'm seeing 9X throughput with 1000 docs/batch vs 1 doc/batch, with a single thread, so it's certainly worth it. Thanks, Peter On Fri, Nov 7, 2014 at 2:18 PM, Erick Erickson erickerick...@gmail.com wrote: And Walter has also been around for a _long_ time ;) (sorry, couldn't resist) Erick On Fri, Nov 7, 2014 at 11:12 AM, Walter Underwood wun...@wunderwood.org wrote: Yes, I implemented exactly that fallback for Solr 1.2 at Netflix. It isn’t to hard if the code is structured for it; retry with a batch size of 1. wunder On Nov 7, 2014, at 11:01 AM, Erick Erickson erickerick...@gmail.com wrote: Yeah, this has been an ongoing issue for a _long_ time. Basically, you can't. So far, people have essentially written fallback logic to index the docs of a failing packet one at a time and report it. I'd really like better reporting back, but we haven't gotten there yet. Best, Erick On Fri, Nov 7, 2014 at 8:25 AM, Peter Keegan peterlkee...@gmail.com wrote: How are folks handling Solr exceptions that occur during batch indexing? Solr stops parsing the docs stream when an error occurs (e.g. a doc with a missing mandatory field), and stops indexing the batch. The bad document is not identified, so it would be hard for the client to recover by skipping over it. Peter
Re: Synonymn for Numbers
If you are searching for single document can a real time get on doc id mentioned below serve your use case? http://localhost:8983/solr/get?id=mydoc Real time get for multiple docs: http://localhost:8983/solr/get?id=mydocid=mydoc On Sat, Nov 8, 2014 at 12:52 AM, EXTERNAL Taminidi Ravi (ETI, Automotive-Service-Solutions) external.ravi.tamin...@us.bosch.com wrote: Hi Group, I am working on implementing synonym for number like 10,2010 14,2014 2 digit number to get documents with four digit, I added the above lines in synonym and everything works. But now I have to get for one direction, I tried 10=2010 but it is still gets the record belongs to 10 , if I search 2010. I want to get only 2010 documents if I search 2010 not 10. I have expand=true in the synonym filter. filter class=solr.SynonymFilterFactory synonyms=synonyms.txt ignoreCase=true expand=true/ If any help really appreciated. Thanks Ravi
Re: Delete data from stored documents
Since the data already existing and need is to remove unwanted fields using a custom update processor looks less useful here. Erick's recommendation on re-indexing into a new collection if at all possible looks simple and safe. On Sat, Nov 8, 2014 at 12:44 AM, Erick Erickson erickerick...@gmail.com wrote: bq: My question is if I can delete the field definition from the schema.xml and do an optimize and the fields “magically” disappears no. schema.xml is really just about regularizing how Lucene indexes things. Lucene (where this would have to take place) doesn't have any understanding of schema.xml, so changing it then optimizing (and optimizing is also a Lucene function) won't have any effect. If you 1 change the schema and 2 update documents the data will be purged as background merges happen. But really, I'd recommend re-indexing into a new collection if at all possible. Best, Erick On Fri, Nov 7, 2014 at 4:26 AM, Yago Riveiro yago.rive...@gmail.com wrote: Jack, I have some data indexed that I don’t need any more. My question is if I can delete the field definition from the schema.xml and do an optimize and the fields “magically” disappears (and free space from disk). Re-index data to delete fields is to expensive in collections with hundreds of millions of documents. Optimize operation seems to be a good place to shrink to documents ... — /Yago Riveiro On Fri, Nov 7, 2014 at 12:19 PM, Jack Krupansky j...@basetechnology.com wrote: Could you clarify exactly what you are trying to do, like with an example? I mean, how exactly are you determining what fields are unwanted? Are you simply asking whether fields can be deleted from the index (and schema)? -- Jack Krupansky -Original Message- From: yriveiro Sent: Thursday, November 6, 2014 9:19 AM To: solr-user@lucene.apache.org Subject: Delete data from stored documents Hi, It's possible remove store data of an index deleting the unwanted fields from schema.xml and after do an optimize over the index? Thanks, /yago - Best regards -- View this message in context: http://lucene.472066.n3.nabble.com/Delete-data-from-stored-documents-tp4167990.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to dynamically create Solr cores with schema
For more advanced dynamic fields refer dynamicField elements convention patterns for fields from the below schema.xml http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/server/solr/configsets/basic_configs/conf/schema.xml solr create core api can be referred to create a core dynamically. e.g. curl http://localhost:8080/solr/admin/cores?action=CREATEname=$nameinstanceDir=/etc/solr/conf/$name On Fri, Nov 7, 2014 at 10:29 PM, Alexandre Rafalovitch arafa...@gmail.com wrote: The usual solution to that is to have dynamic fields with suffixes indicating the types. So, your int fields are mapped to *_i, your date fields to *_d. Solr has schemaless support, but it is auto-detect for now. Creating fields of particular types via API I think is in JIRA on the trunk for 5.0. Regards, Alex. Personal: http://www.outerthoughts.com/ and @arafalov Solr resources and newsletter: http://www.solr-start.com/ and @solrstart Solr popularizers community: https://www.linkedin.com/groups?gid=6713853 On 6 November 2014 10:04, Andreas Hubold andreas.hub...@coremedia.com wrote: Hi, I have a use-case where Java applications need to create Solr indexes dynamically. Schema fields of these indexes differ and should be defined by the Java application upon creation. So I'm trying to use the Core Admin API [1] to create new cores and the Schema API [2] to define fields. When creating a core, I have to specify solrconfig.xml (with enabled ManagedIndexSchemaFactory) and the schema to start with. I thought it would be a good idea to use a named config sets [3] for this purpose: curl ' http://localhost:8082/solr/admin/cores?action=CREATEname=m1instanceDir=cores/m1configSet=myconfigdataDir=data ' But when I add a field to the core m1, the field actually gets added to the config set. Is this a bug of feature? curl http://localhost:8082/solr/m1/schema/fields -X POST -H 'Content-type:application/json' --data-binary '[{ name:foo, type:tdate, stored:true }]' All cores created from the config set myconfig will get the new field foo in their schema. So this obviously does not work to create cores with different schema. I also tried to use the config/schema parameters of the CREATE core command (instead of config sets) to specify some existing solrconfig.xml/schema.xml. I tried relative paths here (e.g. some level upwards) but I could not get it to work. The documentation [1] tells me that relative paths are allowed. Should this work? Next thing that would come to my mind is to use dynamic fields instead of a correct managed schema, but that does not sound as nice. Or maybe I should implement a custom CoreAdminHandler which takes list of field definitions, if that's possible somehow...? I don't know. What's your recommended approach? We're using Solr 4.10.1 non-SolrCloud. Would this be simpler or different with SolrCloud? Thank you, Andreas [1] https://cwiki.apache.org/confluence/display/solr/CoreAdmin+API#CoreAdminAPI-CREATE [2] https://cwiki.apache.org/confluence/display/solr/Schema+API#SchemaAPI-Modifytheschema [3] https://cwiki.apache.org/confluence/display/solr/Config+Sets
Re: Sort documents by exist(multivalued field)
Is it possible to describe the exact use case here. On Fri, Nov 7, 2014 at 10:26 PM, Alexandre Rafalovitch arafa...@gmail.com wrote: You encode that knowledge by using UpdateRequestProcessor. Clone the field, replace it with true, map it to boolean. That way, you will pay the price once per document indexed not (documentCount*) times per request. Regards, Alex. Personal: http://www.outerthoughts.com/ and @arafalov Solr resources and newsletter: http://www.solr-start.com/ and @solrstart Solr popularizers community: https://www.linkedin.com/groups?gid=6713853 On 7 November 2014 06:43, Nickolay41189 klin892...@yandex.ru wrote: I want to sort by multivalued field like boolean values. Something like that: *sort exist(multivalued field name) desc* Is it possible? P.S. I know that sorting doesn't work for multivalued fields, but it work for single boolean field... -- View this message in context: http://lucene.472066.n3.nabble.com/Sort-documents-by-exist-multivalued-field-tp4168141.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Minimum Term Matching in More Like This Queries
There is no direct way of retrieving doc based on minimum term match in Solr. mlm params 'mlt.mintf' and 'mlt.match.offset' can be explored if they meets the criteria. Refer below links for more details: http://wiki.apache.org/solr/MoreLikeThisHandler https://wiki.apache.org/solr/MoreLikeThis In case you are using lucene library directly,setPercentTermsToMatch() function can be used from MoreLikeThisQuery class. Refer code: https://svn.apache.org/repos/asf/lucene/dev/trunk/lucene/queries/src/java/org/apache/lucene/queries/mlt/MoreLikeThisQuery.java On Fri, Nov 7, 2014 at 9:45 PM, Tim Hearn timseman...@gmail.com wrote: Hi! I'm fairly new to Solr. Is there a feature which enforces minimum term matching for MLT Queries? More precisely, that is, a document will match the MLT query if and only if at least x terms in the query are found in the document, with x defined by the user. I could not find such a feature in the documentation, and switching to the edismax query parser and using the 'mm' parameter does not work for me. Thanks!
Re: Term count in multivalue fields
Since 'omitTermFremFreqAndPositions' is enabled what does a function query 'totaltermfreq(field,term)' return? Another way, not sure this is the correct approach, while indexing add a field containing the number. Filter and sum(function query) on the field while querying. Range query can also be done on this field. On Fri, Nov 7, 2014 at 7:23 PM, Nickolay41189 klin892...@yandex.ru wrote: Andrey, thank you for reply. Can you explain what do you mean faceting query with prefix? I'm newer in the wolrd of Solr, can you give me example of this query? -- View this message in context: http://lucene.472066.n3.nabble.com/Term-count-in-multivalue-fields-tp4168138p4168167.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Sort documents by first value in multivalued field
What is 'first value' here, any example? On Fri, Nov 7, 2014 at 5:04 PM, Nickolay41189 klin892...@yandex.ru wrote: How can I sort documents by first value in multivalued field? (without adding copyField and without some changes in schema.xml)? -- View this message in context: http://lucene.472066.n3.nabble.com/Sort-documents-by-first-value-in-multivalued-field-tp4168140.html Sent from the Solr - User mailing list archive at Nabble.com.
issue in launching SolrCloud windows/cygwin
Here is the issue am facing issue in using the 'solr' script on Windows with cygwin terminal: $ bin/solr -e cloud bin/solr: line 16: $'\r': command not found bin/solr: line 17: $'\r': command not found bin/solr: line 46: $'\r': command not found which: no lsof in (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program Files/TortoiseSVN/bin:/cygdrive/c/Program Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts) bin/solr: line 52: $'\r': command not found bin/solr: line 87: syntax error near unexpected token `$HOME/.solr.in.sh' 'in/solr: line 87: ` $HOME/.solr.in.sh \ further $ bin/solr start -cloud -d node1 -p 8983 bin/solr: line 16: $'\r': command not found bin/solr: line 17: $'\r': command not found bin/solr: line 46: $'\r': command not found which: no lsof in (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program Files/TortoiseSVN/bin:/cygdrive/c/Program Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts) bin/solr: line 52: $'\r': command not found bin/solr: line 87: syntax error near unexpected token `$HOME/.solr.in.sh' 'in/solr: line 87: ` $HOME/.solr.in.sh \ Is there any other way I can run the SolrCloud using java -jar start.jar options?
Re: issue in launching SolrCloud windows/cygwin
Hello Jurgen, Thanks a lot for yoru prompt response. It solved the CRLF problem but the script is not supported on cygwin due to severe limitations and lack of adherence to BASH standards, such as lack of lsof, curl, and ps options. I found there is a native solr.cmd script for windows which works without any issue on windows shell. This solves the problem for now. Regards, Anurag On Sun, Oct 19, 2014 at 12:39 PM, Jürgen Wagner (DVT) juergen.wag...@devoteam.com wrote: Hello Anurag, the CRLF problem with Cygwin can be cured by running the scripts all through this filter: tr -d '\r' $script $script.new ; mv $script.new $script with $script holding the path of the script to be massaged. Generally, however, I would advise to use the standard scripts only for testing or demonstration purposes as you're very likely to have to change parameters or settings for your production environment, anyway. Using the latest Jetty is one such example. Best regards, --Jürgen On 19.10.2014 08:51, Anurag Sharma wrote: Here is the issue am facing issue in using the 'solr' script on Windows with cygwin terminal: $ bin/solr -e cloud bin/solr: line 16: $'\r': command not found bin/solr: line 17: $'\r': command not found bin/solr: line 46: $'\r': command not found which: no lsof in (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program Files/TortoiseSVN/bin:/cygdrive/c/Program Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts) bin/solr: line 52: $'\r': command not found bin/solr: line 87: syntax error near unexpected token `$HOME/.solr.in.sh' 'in/solr: line 87: ` $HOME/.solr.in.sh \ further $ bin/solr start -cloud -d node1 -p 8983 bin/solr: line 16: $'\r': command not found bin/solr: line 17: $'\r': command not found bin/solr: line 46: $'\r': command not found which: no lsof in (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program Files/TortoiseSVN/bin:/cygdrive/c/Program Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts) bin/solr: line 52: $'\r': command not found bin/solr: line 87: syntax error near unexpected token `$HOME/.solr.in.sh' 'in/solr: line 87: ` $HOME/.solr.in.sh \ Is there any other way I can run the SolrCloud using java -jar start.jar options? -- Mit freundlichen Grüßen/Kind regards/Cordialement vôtre/Atentamente/С уважением *i.A. Jürgen Wagner* Head of Competence Center Intelligence Senior Cloud Consultant Devoteam GmbH, Industriestr. 3, 70565 Stuttgart, Germany Phone: +49 6151 868-8725, Fax: +49 711 13353-53, Mobile: +49 171 864 1543 E-Mail: juergen.wag...@devoteam.com, URL: www.devoteam.de -- Managing Board: Jürgen Hatzipantelis (CEO) Address of Record: 64331 Weiterstadt, Germany; Commercial Register: Amtsgericht Darmstadt HRB 6450; Tax Number: DE 172 993 071
Re: issue in launching SolrCloud windows/cygwin
Hi Nazik, Thanks for the response. The link mentioned by you is very useful. I used the windows cmd and started the cloud using solr.cmd script. The script is very rich in taking multiple options. Anurag On Sun, Oct 19, 2014 at 5:01 PM, Nazik Huq nazik...@gmail.com wrote: Run Solr straight from the Windows cmd if CygWin isn't a requirement. For example, running java -jar start.jar from the example directory will start single instance Solr. To run SolrCloud follow the instructions in Simple Two-Shard Cluster on the Same Machine from this link http://bit.ly/1rlmYvF . @nazik_huq On Sun, Oct 19, 2014 at 2:51 AM, Anurag Sharma anura...@gmail.com wrote: Here is the issue am facing issue in using the 'solr' script on Windows with cygwin terminal: $ bin/solr -e cloud bin/solr: line 16: $'\r': command not found bin/solr: line 17: $'\r': command not found bin/solr: line 46: $'\r': command not found which: no lsof in (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program Files/TortoiseSVN/bin:/cygdrive/c/Program Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts) bin/solr: line 52: $'\r': command not found bin/solr: line 87: syntax error near unexpected token `$HOME/. solr.in.sh ' 'in/solr: line 87: ` $HOME/.solr.in.sh \ further $ bin/solr start -cloud -d node1 -p 8983 bin/solr: line 16: $'\r': command not found bin/solr: line 17: $'\r': command not found bin/solr: line 46: $'\r': command not found which: no lsof in (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program Files/TortoiseSVN/bin:/cygdrive/c/Program Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts) bin/solr: line 52: $'\r': command not found bin/solr: line 87: syntax error near unexpected token `$HOME/. solr.in.sh ' 'in/solr: line 87: ` $HOME/.solr.in.sh \ Is there any other way I can run the SolrCloud using java -jar start.jar options?
Re: import solr source to eclipse
Another alternative is launch the jetty server from outside and attach it remotely from eclipse. java -Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=y,address=7666 -jar start.jar The above command waits until the application attach succeed. On Tue, Oct 14, 2014 at 12:56 PM, Rajani Maski rajinima...@gmail.com wrote: Configure eclipse with Jetty plugin. Create a Solr folder under your Solr-Java-Project and Run the project [Run as] on Jetty Server. This blog[1] may help you to configure Solr within eclipse. [1] http://hokiesuns.blogspot.in/2010/01/setting-up-apache-solr-in-eclipse.html On Tue, Oct 14, 2014 at 12:06 PM, Ali Nazemian alinazem...@gmail.com wrote: Thank you very much for your guides but how can I run solr server inside eclipse? Best regards. On Mon, Oct 13, 2014 at 8:02 PM, Rajani Maski rajinima...@gmail.com wrote: Hi, The best tutorial for setting up Solr[solr 4.7] in eclipse/intellij is documented in Solr In Action book, Apendix A, *Working with the Solr codebase* On Mon, Oct 13, 2014 at 6:45 AM, Tomás Fernández Löbbe tomasflo...@gmail.com wrote: The way I do this: From a terminal: svn checkout https://svn.apache.org/repos/asf/lucene/dev/trunk/ lucene-solr-trunk cd lucene-solr-trunk ant eclipse ... And then, from your Eclipse import existing java project, and select the directory where you placed lucene-solr-trunk On Sun, Oct 12, 2014 at 7:09 AM, Ali Nazemian alinazem...@gmail.com wrote: Hi, I am going to import solr source code to eclipse for some development purpose. Unfortunately every tutorial that I found for this purpose is outdated and did not work. So would you please give me some hint about how can I import solr source code to eclipse? Thank you very much. -- A.Nazemian -- A.Nazemian
solr trunk update.. build issues
Just wanted to check if anyone faced below issues and how they fixed: Solr launch issue --- From command line ant compile, ant dist gives BUILD SUCCESSFUL generating \solr\dist\solr-6.0.0-SNAPSHOT.war. After copying and renaming the same file to example/start.jar on run shows below error $ java –jar start.jar Error: Could not find or load main class ▒jar Problems with eclipse project --- Also shows below problems in eclipse project: Description Resource Path Location Type Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/protobuf-java-2.5.0.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-core-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet.ext.servlet-2.1.1.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet-2.1.1.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/wstx-asl-3.2.7.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/zookeeper-3.4.6.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-solrj-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/spatial4j-0.4.1.jar' trunk Build path Build Path Problem The project cannot be built until build path errors are resolved trunk Unknown Java Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-phonetic-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-kuromoji-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-codecs-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-backward-codecs-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-expressions-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-core-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-highlighter-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-grouping-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-memory-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-join-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-queries-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-misc-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-spatial-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-queryparser-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/noggit-0.6.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-suggest-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/commons-fileupload-1.2.1.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/commons-io-2.3.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/commons-lang-2.6.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library:
Re: solr trunk update.. build issues
Hi Shalin, Sorry about the typo, actually it's renaming the war file( \solr\dist\solr-6.0.0-SNAPSHOT.war) placed to \trunk\solr\example\webapps\solr.war as referred in last point of step7 in http://wiki.apache.org/solr/HowToCompileSolr I'll also refer and try https://cwiki.apache.org/confluence/display/solr/Running+Solr Regarding problem#2, on running ant eclipse at /trunk (top level directory for lucene solr) and closing/opening the project removes all the problems in the project but eclipse is not able to show the modified file though it still exist. I need to explore more to find the root cause. Thanks for the quick response. Anurag On Wed, Oct 15, 2014 at 12:51 AM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: On Wed, Oct 15, 2014 at 12:38 AM, Anurag Sharma anura...@gmail.com wrote: Just wanted to check if anyone faced below issues and how they fixed: Solr launch issue --- From command line ant compile, ant dist gives BUILD SUCCESSFUL generating \solr\dist\solr-6.0.0-SNAPSHOT.war. After copying and renaming the same file to example/start.jar on run shows below error $ java –jar start.jar Error: Could not find or load main class ▒jar The start.jar contains the jetty bootstrap code. It is different from the war file and you shouldn't rename it to start.jar. You can use ant example from inside the solr directory to create a runnable example. You can also run ant example followed by the using the bin scripts to start Solr. See https://cwiki.apache.org/confluence/display/solr/Running+Solr Problems with eclipse project --- Also shows below problems in eclipse project: Description Resource Path Location Type Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/protobuf-java-2.5.0.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-core-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet.ext.servlet-2.1.1.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet-2.1.1.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/wstx-asl-3.2.7.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/zookeeper-3.4.6.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-solrj-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/spatial4j-0.4.1.jar' trunk Build path Build Path Problem The project cannot be built until build path errors are resolved trunk Unknown Java Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-phonetic-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-kuromoji-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-codecs-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-backward-codecs-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-expressions-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-core-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-highlighter-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-grouping-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-memory-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-join-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-queries-5.0.0-SNAPSHOT.jar' trunk Build path
Re: solr trunk update.. build issues
I am able to launch solr example start.jar using: java –jar start.jar The eclipse issue is also resolved now, looks like eclipse was taking time to process all the files and was an intermittent issue. Now am able to run the selected JUnits as well. On Wed, Oct 15, 2014 at 1:06 AM, Anurag Sharma anura...@gmail.com wrote: Hi Shalin, Sorry about the typo, actually it's renaming the war file( \solr\dist\solr-6.0.0-SNAPSHOT.war) placed to \trunk\solr\example\webapps\solr.war as referred in last point of step7 in http://wiki.apache.org/solr/HowToCompileSolr I'll also refer and try https://cwiki.apache.org/confluence/display/solr/Running+Solr Regarding problem#2, on running ant eclipse at /trunk (top level directory for lucene solr) and closing/opening the project removes all the problems in the project but eclipse is not able to show the modified file though it still exist. I need to explore more to find the root cause. Thanks for the quick response. Anurag On Wed, Oct 15, 2014 at 12:51 AM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: On Wed, Oct 15, 2014 at 12:38 AM, Anurag Sharma anura...@gmail.com wrote: Just wanted to check if anyone faced below issues and how they fixed: Solr launch issue --- From command line ant compile, ant dist gives BUILD SUCCESSFUL generating \solr\dist\solr-6.0.0-SNAPSHOT.war. After copying and renaming the same file to example/start.jar on run shows below error $ java –jar start.jar Error: Could not find or load main class ▒jar The start.jar contains the jetty bootstrap code. It is different from the war file and you shouldn't rename it to start.jar. You can use ant example from inside the solr directory to create a runnable example. You can also run ant example followed by the using the bin scripts to start Solr. See https://cwiki.apache.org/confluence/display/solr/Running+Solr Problems with eclipse project --- Also shows below problems in eclipse project: Description Resource Path Location Type Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/protobuf-java-2.5.0.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-core-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet.ext.servlet-2.1.1.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet-2.1.1.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/wstx-asl-3.2.7.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/zookeeper-3.4.6.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-solrj-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/spatial4j-0.4.1.jar' trunk Build path Build Path Problem The project cannot be built until build path errors are resolved trunk Unknown Java Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-phonetic-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-kuromoji-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-codecs-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-backward-codecs-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-expressions-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-core-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-highlighter-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-grouping-5.0.0-SNAPSHOT.jar' trunk Build path Build Path Problem Project 'trunk' is missing required library: 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-memory-5.0.0-SNAPSHOT.jar' trunk Build
Re: Using relative path for indexing in SOLR
You can always give the relative path from your current working directory like below: ~/solr/example/exampledocs$ java -jar post.jar ./../sourcepdf/*.pdf This solves your issue? On Mon, Oct 13, 2014 at 3:58 PM, bharath Raghavendran bharat...@gmail.com wrote: Hi , I am currently using solr-4.9.0 to index my PDF's using the default post.jar , start.jar provided in the examples directory. However i would like to modify the indexed path from absolute location to relative path from the base folder. Example : Absolute Path : E:\myFolder\level1\level11\myfile.PDF Relative Path : level11/myfile.PDF Let me know if this is possible to implement. Thanks, Bharath
Re: import solr source to eclipse
I recently tried to run eclipse in debug mode and followed http://wiki.apache.org/solr/HowToConfigureEclipse. It worked for me. On Sun, Oct 12, 2014 at 7:39 PM, Ali Nazemian alinazem...@gmail.com wrote: Hi, I am going to import solr source code to eclipse for some development purpose. Unfortunately every tutorial that I found for this purpose is outdated and did not work. So would you please give me some hint about how can I import solr source code to eclipse? Thank you very much. -- A.Nazemian
Re: [ANN] Lucidworks Fusion 1.0.0
Ok. Thanks for the clarification. On Mon, Oct 6, 2014 at 12:54 AM, Garth Grimm garthgr...@averyranchconsulting.com wrote: Well, the current release is only supported on Linux. A Windows compatible release is planned for later this year. -Original Message- From: Anurag Sharma [mailto:anura...@gmail.com] Sent: Sunday, October 05, 2014 12:23 PM To: solr-user@lucene.apache.org Subject: Re: [ANN] Lucidworks Fusion 1.0.0 I downloaded fusion and tried to run it on windows 8 using cygwin. It's giving Error: Unable to access jarfile /home/user1/fusion/jetty/home/start.jar. Also tried changing the permission of jar, .sh and all folder/subfolders in fusion to 777 but still getting the same error. Please share your experience if tried running fusion on windows 8 or facing the above issue on other port. Thanks Anurag On Mon, Sep 29, 2014 at 6:05 AM, Aman Tandon amantandon...@gmail.com wrote: Hi, How we can see the demo for NLP? On Sep 24, 2014 4:43 PM, Grant Ingersoll gsing...@apache.org wrote: Hi Thomas, Thanks for the question, yes, I give a brief demo of it in action during my talk and we will have demos at our booth. I will also give a demo during the Webinar, which will be recorded. As others have said as well, you can simply download it and try yourself. Cheers, Grant On Sep 23, 2014, at 2:00 AM, Thomas Egense thomas.ege...@gmail.com wrote: Hi Grant. Will there be a Fusion demostration/presentation at Lucene/Solr Revolution DC? (Not listed in the program yet). Thomas Egense On Mon, Sep 22, 2014 at 3:45 PM, Grant Ingersoll gsing...@apache.org wrote: Hi All, We at Lucidworks are pleased to announce the release of Lucidworks Fusion 1.0. Fusion is built to overlay on top of Solr (in fact, you can manage multiple Solr clusters -- think QA, staging and production -- all from our Admin).In other words, if you already have Solr, simply point Fusion at your instance and get all kinds of goodies like Banana ( https://github.com/LucidWorks/Banana -- our port of Kibana to Solr + a number of extensions that Kibana doesn't have), collaborative filtering style recommendations (without the need for Hadoop or Mahout!), a modern signal capture framework, analytics, NLP integration, Boosting/Blocking and other relevance tools, flexible index and query time pipelines as well as a myriad of connectors ranging from Twitter to web crawling to Sharepoint. The best part of all this? It all leverages the infrastructure that you know and love: Solr. Want recommendations? Deploy more Solr. Want log analytics? Deploy more Solr. Want to track important system metrics? Deploy more Solr. Fusion represents our commitment as a company to continue to contribute a large quantity of enhancements to the core of Solr while complementing and extending those capabilities with value adds that integrate a number of 3rd party (e.g connectors) and home grown capabilities like an all new, responsive UI built in AngularJS. Fusion is not a fork of Solr. We do not hide Solr in any way. In fact, our goal is that your existing applications will work out of the box with Fusion, allowing you to take advantage of new capabilities w/o overhauling your existing application. If you want to learn more, please feel free to join our technical webinar on October 2: http://lucidworks.com/blog/say-hello-to-lucidworks-fusion/. If you'd like to download: http://lucidworks.com/product/fusion/. Cheers, Grant Ingersoll Grant Ingersoll | CTO gr...@lucidworks.com | @gsingers http://www.lucidworks.com Grant Ingersoll | @gsingers http://www.lucidworks.com
Re: [ANN] Lucidworks Fusion 1.0.0
I downloaded fusion and tried to run it on windows 8 using cygwin. It's giving Error: Unable to access jarfile /home/user1/fusion/jetty/home/start.jar. Also tried changing the permission of jar, .sh and all folder/subfolders in fusion to 777 but still getting the same error. Please share your experience if tried running fusion on windows 8 or facing the above issue on other port. Thanks Anurag On Mon, Sep 29, 2014 at 6:05 AM, Aman Tandon amantandon...@gmail.com wrote: Hi, How we can see the demo for NLP? On Sep 24, 2014 4:43 PM, Grant Ingersoll gsing...@apache.org wrote: Hi Thomas, Thanks for the question, yes, I give a brief demo of it in action during my talk and we will have demos at our booth. I will also give a demo during the Webinar, which will be recorded. As others have said as well, you can simply download it and try yourself. Cheers, Grant On Sep 23, 2014, at 2:00 AM, Thomas Egense thomas.ege...@gmail.com wrote: Hi Grant. Will there be a Fusion demostration/presentation at Lucene/Solr Revolution DC? (Not listed in the program yet). Thomas Egense On Mon, Sep 22, 2014 at 3:45 PM, Grant Ingersoll gsing...@apache.org wrote: Hi All, We at Lucidworks are pleased to announce the release of Lucidworks Fusion 1.0. Fusion is built to overlay on top of Solr (in fact, you can manage multiple Solr clusters -- think QA, staging and production -- all from our Admin).In other words, if you already have Solr, simply point Fusion at your instance and get all kinds of goodies like Banana ( https://github.com/LucidWorks/Banana -- our port of Kibana to Solr + a number of extensions that Kibana doesn't have), collaborative filtering style recommendations (without the need for Hadoop or Mahout!), a modern signal capture framework, analytics, NLP integration, Boosting/Blocking and other relevance tools, flexible index and query time pipelines as well as a myriad of connectors ranging from Twitter to web crawling to Sharepoint. The best part of all this? It all leverages the infrastructure that you know and love: Solr. Want recommendations? Deploy more Solr. Want log analytics? Deploy more Solr. Want to track important system metrics? Deploy more Solr. Fusion represents our commitment as a company to continue to contribute a large quantity of enhancements to the core of Solr while complementing and extending those capabilities with value adds that integrate a number of 3rd party (e.g connectors) and home grown capabilities like an all new, responsive UI built in AngularJS. Fusion is not a fork of Solr. We do not hide Solr in any way. In fact, our goal is that your existing applications will work out of the box with Fusion, allowing you to take advantage of new capabilities w/o overhauling your existing application. If you want to learn more, please feel free to join our technical webinar on October 2: http://lucidworks.com/blog/say-hello-to-lucidworks-fusion/. If you'd like to download: http://lucidworks.com/product/fusion/. Cheers, Grant Ingersoll Grant Ingersoll | CTO gr...@lucidworks.com | @gsingers http://www.lucidworks.com Grant Ingersoll | @gsingers http://www.lucidworks.com
applicability of schema on document
I am trying to understand how the schema and it's field types gets applied to a document. Is it based on a document Id e.g. how to specify solr to store fields like age as integer, dateofbirth as date but not as a string or vice versa. Also, is it possible to change the field type at runtime? Direct update using below command adds the values even when the id doesn't exist: curl http://localhost:8983/solr/update\?commit\=true -H 'Content-type:application/json' -d '[{dob: {add: [2014-02-12T12:00:00Z, 2014-07-16T12:00:00Z]}, id: }]' My doubts in the above scenario are: - Is it taking some default types based on parsed values? - Is it also possible to store multiple types in a single field? - What are the rules for schema less doc Above scenario is tried using solr.war in example/webapps Following are multiple schema files in example directory ./example/example-DIH/solr/db/conf/schema.xml ./example/example-DIH/solr/mail/conf/schema.xml ./example/example-DIH/solr/rss/conf/schema.xml ./example/example-DIH/solr/solr/conf/schema.xml ./example/example-DIH/solr/tika/conf/schema.xml ./example/example-schemaless/solr/collection1/conf/schema.xml ./example/multicore/core0/conf/schema.xml ./example/multicore/core1/conf/schema.xml ./example/solr/collection1/conf/schema.xml Any documentation or unit tests describing the flow, creating and using the schema will be helpful. Thanks Anurag
demo app explaining solr features
I am wondering if there is any demo app that can demonstrate all the features/capabilities of solr. My intention is to understand, use and play around all the features supported by solr. Also looking to explore how solr fits with NLP (like open-nlp), different datastores (like cassandra, mongodb, arangoDB, couchDB), ML engines(mahout, prediction.io etc) and caching servers (redis, memcache). Thanks Anurag
Re: running solr in debug through eclipse
Hi All, Thanks a lot for your suggestions. Shalin, your direction quickly took me to the issue, it was very insightful and helpful. Finally am able to understand the issue I was working on and run particular unit test class AtomicUpdatesTest around it. On running the Solr in debug mode, I am still not able to start solr in debug mode using: java -Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=y,address=7666 -jar start.jar (Ref: http://wiki.apache.org/solr/HowToConfigureEclipse) The command wait for hours and the server never comes up on windows without giving any error/info message. Please suggest if someone faced this issue. I tried restarting windows, ensured no process running on 7666 port. In previous trials to start, I used to get msg Debugger failed to attach: handshake failed - received GET /solr/ HTT - expect but it stopped coming now. Thanks Anurag On Fri, Sep 19, 2014 at 8:21 PM, Erick Erickson erickerick...@gmail.com wrote: Yeah, it's usually pretty daunting to know where to start, the codebase is kinda big. Even start from junit test is often daunting, there are a lot of them too. Others have given you good places to start, good luck! Erick On Fri, Sep 19, 2014 at 12:23 AM, Bernd Fehling bernd.fehl...@uni-bielefeld.de wrote: Just start at the UpdateHandler and follow it down the line. I would start at org/apache/solr/update/UpdateHandler.java If you already know if it is add, delete or update then start with AddUpdateCommand.java, DeleteUpdateCommand.java or UpdateCommand.java. Just follow the red line :-) Regards Bernd Am 19.09.2014 um 08:47 schrieb Anurag Sharma: Thanks Bernd for your insight. As of now, I am focussing to fix the issue in the updater but not able to localize which code to look in for it. Regards, Anurag On Fri, Sep 19, 2014 at 12:09 PM, Bernd Fehling bernd.fehl...@uni-bielefeld.de wrote: It depends on what you are going to do. If you are adding/modifying code and Junit tests use Junit test cases. If you are debugging runtime problems under load use remote debugging. If you are going for in deep debugging (even into Jetty and Java) use RunJettyRun for Eclipse. Regards Bernd Am 18.09.2014 um 20:50 schrieb Anurag Sharma: Dear Solr users, I am new to Solr dev community and trying to setup eclipse to debug a running solr server. Please suggest if anyone of you have tried doing the same. Once above is done. Also suggest the entry point in code where breakpoint can be placed. Thanks Anurag
Re: running solr in debug through eclipse
Thanks Bernd for your insight. As of now, I am focussing to fix the issue in the updater but not able to localize which code to look in for it. Regards, Anurag On Fri, Sep 19, 2014 at 12:09 PM, Bernd Fehling bernd.fehl...@uni-bielefeld.de wrote: It depends on what you are going to do. If you are adding/modifying code and Junit tests use Junit test cases. If you are debugging runtime problems under load use remote debugging. If you are going for in deep debugging (even into Jetty and Java) use RunJettyRun for Eclipse. Regards Bernd Am 18.09.2014 um 20:50 schrieb Anurag Sharma: Dear Solr users, I am new to Solr dev community and trying to setup eclipse to debug a running solr server. Please suggest if anyone of you have tried doing the same. Once above is done. Also suggest the entry point in code where breakpoint can be placed. Thanks Anurag
running solr in debug through eclipse
Dear Solr users, I am new to Solr dev community and trying to setup eclipse to debug a running solr server. Please suggest if anyone of you have tried doing the same. Once above is done. Also suggest the entry point in code where breakpoint can be placed. Thanks Anurag
Re: running solr in debug through eclipse
Hi Erick, Thanks a lot for your response. I am trying to fix the issue: https://issues.apache.org/jira/browse/SOLR-6307. I guess this require change in the 'update' component. Am not able to locate the code for 'update' component nor the testcases. To understand the code base I think I may need to go through both the #1 #2 approaches. Regards, Anurag On Fri, Sep 19, 2014 at 8:38 AM, Erick Erickson erickerick...@gmail.com wrote: There are two approaches that work: 1 (preferred IMO) is to debug through the Junit test cases. It's far easier than remote debugging usually, with quicker turnaround times. 2 Set up remote debugging, see: http://wiki.apache.org/solr/HowToConfigureEclipse which is linked from the how to contribute page here: http://wiki.apache.org/solr/HowToContribute#Eclipse As to where to set your first breakpoint, I have no clue. You haven't told us a thing about what you're trying to accomplish, so somewhere in the code is about the best I can say ;). Best Erick On Thu, Sep 18, 2014 at 11:50 AM, Anurag Sharma anura...@gmail.com wrote: Dear Solr users, I am new to Solr dev community and trying to setup eclipse to debug a running solr server. Please suggest if anyone of you have tried doing the same. Once above is done. Also suggest the entry point in code where breakpoint can be placed. Thanks Anurag
Solr-Distributed search
Hi, Can you please help me solr distribued search in multicore? i would be very happy as i am stuck here. In java code how do i implement distributed search? -- Thanks Regards Anurag Verma
Solr Composite Unique key from existing fields in schema
Hi, I am developing a search application using SOLR. I don't have primary key in any table. Composite key is being used in my application. How do i implement composite key as unique key in this case. please help. i am struggling. -- Thanks Regards Anurag Verma Arise! Awake! And stop not till the goal is reached!
How Whatsapp applies search techniques for conversation?
I was just wondering how Whatsapp uses to implement search in the conversations history. Is it the same thing used for all kinds of android app supporting search on chat/conversations? Has anyone implemented on similar lines? Thanks Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/How-Whatsapp-applies-search-techniques-for-conversation-tp4104366.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr returns the document conatining the links of the required document as top result?
I have integrated solr and nutch.That is , crawling has been performed by nutch and indexed to solr. I have been using this solr server for querying for a long time. But some day back , i observed a strange thing. Rather than giving the asked or best fitted document as top result , it shows the document containing the links of the required(best) document as the top search result. For example Query=Jamia History in my local index of this domain(http://www.jmi.ac.in) results obtained were Top-http://www.jmi.ac.in/abouttheuniversity.htm Lower-http://www.jmi.ac.in/HistoryofJamia.htm The output should have been reverse because the link http://www.jmi.ac.in/HistoryofJamia.htm is the actual document containig the history of Jamia. And the link http://www.jmi.ac.in/abouttheuniversity.htm just contains the link for the above mentioned documents. I am not able to find as to why this is happening? Please suggest some clue.. Thanks - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-returns-the-document-conatining-the-links-of-the-required-document-as-top-result-tp2954340p2954340.html Sent from the Solr - User mailing list archive at Nabble.com.
search by url in Solr?
Hello everyone, My Query q=google.com should give the ouput as http://www.googe.com In my search engine when i put q=google.com, it does not give the above output, rather it shows no result. but putting q=url:google.com gives the correct output as http://www.google.com Now my question how can i make this feature deafult. That's is when user queries as google.com he gets the ouput as www.google.com , Also i want to maintain Normal search features for the content search. That is , i dont want to loose the existing features normal terms or say content search. Please guide me - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/search-by-url-in-Solr-tp2924632p2924632.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: search by url in Solr?
thanks! , it worked. Can i mention defaultSearchFieldurl,content/ defaultSearchField to inlcude two default fields.? On Wed, May 11, 2011 at 3:02 AM, Rakudten [via Lucene] ml-node+2924686-576776982-146...@n3.nabble.com wrote: Hello. One option is to specify a default search field in your schema.xml. If your query doesn´t include an specific field the query parser will use the default one to launch the query. You should include in your schema.xml something like this: !-- field for the QueryParser to use when an explicit fieldname is absent -- defaultSearchFieldurl/defaultSearchField -- If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/search-by-url-in-Solr-tp2924632p2924686.html To unsubscribe from search by url in Solr?, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=2924632code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwyOTI0NjMyfC0yMDk4MzQ0MTk2. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/search-by-url-in-Solr-tp2924632p2926107.html Sent from the Solr - User mailing list archive at Nabble.com.
How can i use Solr based Search Engine for My University?
I am a student at http://jmi.ac.in/index.htm Jamia Millia Islamia , a central univeristy in India. I want to use my search engine for the benefit of students. The university has course like undergraduate,graduate,phd etc inlcuding Engineering . Earlier one of my teacher suggested developing Intranet Search ( for Lan) , but i am not able to figure it out as to how to implement it. My university uses Google as its own site search tool. I am in Engg department and i see students( including me ) using Xerox, Previous year papers , Notes etc during exam time. People use internet or say google to learn if any topics is not inlucded in book. Please give some valuable suggestions. Thanks - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2907168.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How can i use Solr based Search Engine for My University?
In my search engine Nutch and Solr have been integrated both. Also i am impplemented autocraling process. Whenever any one puts a http link in a given box and then submit it, the http site address gets automatically crawled and Indexes to solr... On Fri, May 6, 2011 at 2:02 PM, Grijesh [via Lucene] ml-node+2907200-1529372386-146...@n3.nabble.com wrote: Use Nutch for your Intranet crawling.For more detail http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/ Thanx: Grijesh www.gettinhahead.co.in http://www.gettingahead.co.in -- If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2907200.html To unsubscribe from How can i use Solr based Search Engine for My University?, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=2907168code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwyOTA3MTY4fC0yMDk4MzQ0MTk2. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2907483.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How can i use Solr based Search Engine for My University?
Thanks Aditya, i appreciate your suggestion.i will implemet your suggestions. Besides these is there any other useful aspect that i may be not taking into account? Thanks a lot.. On Fri, May 6, 2011 at 4:57 PM, findbestopensource [via Lucene] ml-node+2907727-211212-146...@n3.nabble.com wrote: Hello Anurag Google is always there to do internet search. You need to support search for your university. My opinion would be don't crawl the sites. You require only Solr and not Nutch. 1. Provide an interface to upload the documents by the university students. The documents could be previous year question paper, Notes, E-books etc. Scan the documents and convert it to PDF and upload them. Providing search on these things would be more valuable than crawling the sites. Regards Aditya www.findbestopensource.com On Fri, May 6, 2011 at 1:31 PM, Anurag [hidden email]http://user/SendEmail.jtp?type=nodenode=2907727i=0by-user=t wrote: I am a student at http://jmi.ac.in/index.htm Jamia Millia Islamia , a central univeristy in India. I want to use my search engine for the benefit of students. The university has course like undergraduate,graduate,phd etc inlcuding Engineering . Earlier one of my teacher suggested developing Intranet Search ( for Lan) , but i am not able to figure it out as to how to implement it. My university uses Google as its own site search tool. I am in Engg department and i see students( including me ) using Xerox, Previous year papers , Notes etc during exam time. People use internet or say google to learn if any topics is not inlucded in book. Please give some valuable suggestions. Thanks - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2907168.htmlhttp://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2907168.html?by-user=t Sent from the Solr - User mailing list archive at Nabble.com. -- If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2907727.html To unsubscribe from How can i use Solr based Search Engine for My University?, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=2907168code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwyOTA3MTY4fC0yMDk4MzQ0MTk2. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2908076.html Sent from the Solr - User mailing list archive at Nabble.com.
debugQuery doesnot work with Solr-1.3.0 , is it true?
i am trying to put this query on Solr-1.3.0 server which is integrated with Nutch-1.0. http://localhost:8983/solr/select/?q=solrversion=2.2start=0rows=10indent=ondebugQuery=on But the results, i am getting doesnot have explaination for the score as it should include tf, idf etc Should i use the new version (i checked it worked with 1.4.1) or the solr-1.3.0 can be made to work for solving my purpose. If later, then how it is possible. Please guide Thanks - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/debugQuery-doesnot-work-with-Solr-1-3-0-is-it-true-tp2711873p2711873.html Sent from the Solr - User mailing list archive at Nabble.com.
How to create patch to implement my own advance search mentioned below
Details Query will be like most{t2,t3,t5,t6,t7} where most is linguistic quantifier having some weights varying b/w a=0.3 and b=0.8 The relevancy matrix with corresponding tf*idf values for the above query is R(relevancy Matrix) t2t3 t5 t6 t7 d1 0.6 0.00.4 0.2 0.4 d2 0.4 0.10.7 0.6 0.0 d3 0.2 0.50.0 0.3 0.6 d4 0.5 0.30.5 0.4 0.1 Difficulty 1- How to get the above tf*idf score for all the terms in relevant document Using a formulae we can calculate the 5 weights as w1=0.0,w2=0.2,w3=0.4,w4=0.4,w5=0.0 After calcualting the weights , we can multiply the terms score of each document with weights in decreasing order( eg. for 1st document- 0.6, then 0.4, 0.4 , 0.2 , then 0.0) This multiplication of matrix is like (m*n)*(n*1) --- n*1 signifies single column matrix of 5 weights defined above After multiplication we get result in matrix with single row called as Query -relevancy matrix QR= d1 0.0*0.6+0.2*0.4+0.4*0.4+0.4*0.2+0.0*0.0 d2 0.0*0.7+0.2*0.6+0.4*0.4+0.4*0.1+0.0*0.0 d3 0.0*0.6+0.2*0.5+0.4*0.3+0.4*0.2+0.0*0.0 d4 0.0*0.5+0.2*0.5+0.4*0.4+0.4*0.3+0.0*0.1 = d1 0.32 d2 0.32 d3 0.30 d4 0.38 difficulty 2 - where should i multiply this matrix and add to the solr? Hence final order of documents on the basis of final score is 0.380.32=0.320.30 d4d1=d2d3 Please guide me . - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-create-patch-to-implement-my-own-advance-search-mentioned-below-tp2701873p2701873.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Implementing Fuzzy Search using OWA operator and Fuzzy Linguistic Quantifier
]); System.out.println(t); } catch(Exception e){} }//for */ }//for }//for //sort the relevancy matrix and multiply with weights for(int i=0;ilt;TOTAL_DOC;i++) { Arrays.sort(R[i]); reverse(R[i]); for(int j=0;jlt;1;j++) { QR[i][j]=0.0f; for(int k=0;klt;queryExpression.length;k++) { QR[i][j]+=(R[i][k]*Weight[k]); } } } //print the scores of the final documents System.out.println(quot;Final Scores of Documentsquot;); IndexReader reader = IndexReader.open(directory); float max=0.0f,min=0.f; int num1=0,num2=0; String ds=quot;quot;,ds2=quot;quot;; for(int i=0;ilt;TOTAL_DOC;i++) { try{ Document d = reader.document( i); System.out.println(quot;Document quot;+d.get(quot;titlequot;).toString()+quot;score= quot;+QR[i][0]); if(QR[i][0]gt;max) {num1=i;max=QR[i][0];ds=d.get(title).toString();} if(QR[i][0]lt;minamp;amp;QR[i][0]gt;=0.1f) {num2=i;min=QR[i][0];ds2=d.get(title).toString();} }catch(Exception e){} //Thread.sleep(100); System.out.println(i); } System.out.println(num1+ +ds+ +max); System.out.println(num2+ +ds2+ +min); }//main }//class - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Implementing-Fuzzy-Search-using-OWA-operator-and-Fuzzy-Linguistic-Quantifier-tp2261469p2699065.html Sent from the Solr - User mailing list archive at Nabble.com.
Please reply how to embed code to solr
http://lucene.472066.n3.nabble.com/Implementing-Fuzzy-Search-using-OWA-operator-and-Fuzzy-Linguistic-Quantifier-td2261469.html Link - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Please-reply-how-to-embed-code-to-solr-tp2699218p2699218.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: background merge hit exception
Do you mean that earlier it was doing indexing well then all of sudden you started getting this exception? - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/background-merge-hit-exception-tp2680625p2680979.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Location of Main Class in Solr?
Thanks. On Sat, Mar 5, 2011 at 7:58 PM, Koji Sekiguchi [via Lucene] ml-node+2638122-740990375-146...@n3.nabble.com wrote: (11/03/04 3:30), Anurag wrote: I searched SolrIndexSearcher.java file but there is no main class. I wanted to know as to where this class resides. Can i call this main class (if it exists) using command line options in terminal , rather than through war file? Kumar, I think you may want to use EmbeddedSolrServer from your mail method. Please see: http://wiki.apache.org/solr/Solrj#EmbeddedSolrServer Koji -- http://www.rondhuit.com/en/ -- If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Location-of-Main-Class-in-Solr-tp2627576p2638122.html To unsubscribe from Location of Main Class in Solr?, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=2627576code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwyNjI3NTc2fC0yMDk4MzQ0MTk2. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Location-of-Main-Class-in-Solr-tp2627576p2638658.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Location of Main Class in Solr?
Do you mean that a .class(DOT class) file is responsible for executing the solr server, hence no Public Static void main is present anywhere.? Actually i want to play with the Searcher.java file , but i am finding difficulty as the Searcher file is very big and any changes will lead to incompatibility with other files. On Sat, Mar 5, 2011 at 11:00 PM, kumar anurag anurag.it.jo...@gmail.comwrote: Thanks. On Sat, Mar 5, 2011 at 7:58 PM, Koji Sekiguchi [via Lucene] ml-node+2638122-740990375-146...@n3.nabble.com wrote: (11/03/04 3:30), Anurag wrote: I searched SolrIndexSearcher.java file but there is no main class. I wanted to know as to where this class resides. Can i call this main class (if it exists) using command line options in terminal , rather than through war file? Kumar, I think you may want to use EmbeddedSolrServer from your mail method. Please see: http://wiki.apache.org/solr/Solrj#EmbeddedSolrServer Koji -- http://www.rondhuit.com/en/ -- If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Location-of-Main-Class-in-Solr-tp2627576p2638122.html To unsubscribe from Location of Main Class in Solr?, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=2627576code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwyNjI3NTc2fC0yMDk4MzQ0MTk2. -- Kumar Anurag -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Location-of-Main-Class-in-Solr-tp2627576p2638667.html Sent from the Solr - User mailing list archive at Nabble.com.
Location of Main Class in Solr?
I searched SolrIndexSearcher.java file but there is no main class. I wanted to know as to where this class resides. Can i call this main class (if it exists) using command line options in terminal , rather than through war file? - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Location-of-Main-Class-in-Solr-tp2627576p2627576.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Problem with Solr and Nutch integration
i have nutch-1.0 and Apache-solr-1.3.0 (integrated these two). On 3/1/11, Paul Rogers [via Lucene] ml-node+2601915-1461428819-146...@n3.nabble.com wrote: Hi Anurag The request handler has been added the solrconfig file. I'll try your attached requesthandler and see if that helps. Interestingly enough the whole setup when I was using nutch 1.2/solr 1.4.1. It is only since moving to nutch trunk/solr branch_3x that the problem has occurred. I assume that something has changed inbetween and the tutorial's request handler is incorrect for the later solr version. Which versions of solr/nutch are you using? Assuming the catalina.out file is the correct log file the output I get is shown below. This output occurs on restarting the solr-example after adding the new requesthandler. When I access the solr admin page no additional logging occurs. Can any one see the problem? Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: Using JNDI solr.home: /opt/solr/example/solr Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader init INFO: Solr home set to '/opt/solr/example/solr/' Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader addToClassLoader SEVERE: Can't find (or read) file to add to classloader: /opt/solr/example/solr/./lib Feb 28, 2011 6:28:59 PM org.apache.solr.servlet.SolrDispatchFilter init INFO: SolrDispatchFilter.init() Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: Using JNDI solr.home: /opt/solr/example/solr Feb 28, 2011 6:28:59 PM org.apache.solr.core.CoreContainer$Initializer initialize INFO: looking for solr.xml: /opt/solr/example/solr/solr.xml Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader locateSolrHome INFO: Using JNDI solr.home: /opt/solr/example/solr Feb 28, 2011 6:28:59 PM org.apache.solr.core.CoreContainer init INFO: New CoreContainer: solrHome=/opt/solr/example/solr/ instance=6794958 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader init INFO: Solr home set to '/opt/solr/example/solr/' Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader addToClassLoader SEVERE: Can't find (or read) file to add to classloader: /opt/solr/example/solr/./lib Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader init INFO: Solr home set to '/opt/solr/example/solr/./' Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader addToClassLoader SEVERE: Can't find (or read) file to add to classloader: /opt/solr/example/solr/././lib Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrConfig initLibs INFO: Adding specified lib dirs to ClassLoader Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/opt/solr/contrib/extraction/lib/commons-compress-1.1.jar' to classloader Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/opt/solr/contrib/extraction/lib/log4j-1.2.14.jar' to classloader Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/opt/solr/contrib/extraction/lib/commons-logging-1.1.1.jar' to classloader Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/opt/solr/contrib/extraction/lib/tika-parsers-0.8.jar' to classloader Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/opt/solr/contrib/extraction/lib/asm-3.1.jar' to classloader Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/opt/solr/contrib/extraction/lib/icu4j-4_6.jar' to classloader Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/opt/solr/contrib/extraction/lib/xercesImpl-2.8.1.jar' to classloader Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/opt/solr/contrib/extraction/lib/bcmail-jdk15-1.45.jar' to classloader Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/opt/solr/contrib/extraction/lib/fontbox-1.3.1.jar' to classloader Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/opt/solr/contrib/extraction/lib/poi-3.7.jar' to classloader Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/opt/solr/contrib/extraction/lib/dom4j-1.6.1.jar' to classloader Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/opt/solr/contrib/extraction/lib/geronimo-stax-api_1.0_spec-1.0.1.jar' to classloader Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader replaceClassLoader INFO: Adding 'file:/opt/solr/contrib/extraction/lib/poi-ooxml-3.7.jar' to classloader
Re: Problem with Solr and Nutch integration
Solr uses jetty server default, do u know that? you can run solr server without using Tomcat (using jetty server). Please describe the steps that led to the error. Which command u executed? On Mon, Feb 28, 2011 at 1:39 AM, Paul Rogers [via Lucene] ml-node+2590334-620834624-146...@n3.nabble.com wrote: Hi Guys I'm trying to integrate solr and nutch as per http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/, using the branch_3x from svn on Tomcat 6. After adding the nutch requestHandler to solrconfig.xml while the solr-example will start on accessing the admin page I get the following error message: HTTP Status 404 - missing core name in path -- *type* Status report *message* *missing core name in path* *description* *The requested resource (missing core name in path) is not available.* After googling I found the following: I think you are seeing the effects of SOLR-1743 masking another error ... have you checked your log for other errors/exceptions being logged when you startup solr with that solrconfig.xml? Chris Hostetter My initial question is this, am I right in thinking that solr should be using the Tomcat 6 logging and that logs should be found at $CATALINA_HOME/logs/catalina.out? Thanks Paul -- If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Problem-with-Solr-and-Nutch-integration-tp2590334p2590334.html To start a new topic under Solr - User, email ml-node+472068-1941297125-146...@n3.nabble.com To unsubscribe from Solr - User, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Problem-with-Solr-and-Nutch-integration-tp2590334p2594293.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Problem with Solr and Nutch integration
The above mentioned requesthandler lies in schema file or solrconfig file of Solr? I integrated solr and nutch and requesthandler lies in SolrConfig.xml. This is my some content of my solrconfig.xml. As far as Jetty server is concerned its working, don't know about solrtomcat. requestHandler name=/nutch class=solr.SearchHandler lst name=defaults str name=defTypedismax/str str name=echoParamsexplicit/str float name=tie0.01/float str name=qf content^0.5 anchor^1.0 title^1.2 /str str name=pf content^0.5 anchor^1.5 title^1.2 site^1.5 /str str name=fl url /str str name=mm 2lt;-1 5lt;-2 6lt;90% /str int name=ps100/int bool hl=true/ str name=q.alt*:*/str str name=hl.fltitle url content/str str name=f.title.hl.fragsize0/str str name=f.title.hl.alternateFieldtitle/str str name=f.url.hl.fragsize0/str str name=f.url.hl.alternateFieldurl/str str name=f.content.hl.fragmenterregex/str /lst /requestHandler requestHandler name=/nutch class=solr.SearchHandler lst name=defaults str name=defTypedismax/str str name=echoParamsexplicit/str float name=tie0.01/float str name=qf content^0.5 anchor^1.0 title^1.2 /str str name=pf content^0.5 anchor^1.5 title^1.2 site^1.5 /str str name=fl url /str str name=mm 2lt;-1 5lt;-2 6lt;90% /str int name=ps100/int bool hl=true/ str name=q.alt*:*/str str name=hl.fltitle url content/str str name=f.title.hl.fragsize0/str str name=f.title.hl.alternateFieldtitle/str str name=f.url.hl.fragsize0/str str name=f.url.hl.alternateFieldurl/str str name=f.content.hl.fragmenterregex/str /lst /requestHandler But yeah deploying solr.war file in tomcat 6 on my system works. On Tue, Mar 1, 2011 at 1:56 AM, Paul Rogers [via Lucene] ml-node+2598137-98595181-146...@n3.nabble.com wrote: Hi Anurag Thanks for the prompt reply. I'm following the tutorial at http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/ I have built solr and the example and added it to Tomcat as per http://wiki.apache.org/solr/SolrTomcat and this (solr-example) all appears to work fine (I can access the solr admin page at http://localhost:8080/solr-example/admin/ http://sol001:8080/solr-example/admin/ and search using the same). I have copied the nutch schema.xml across and replaced the example one. Again everything seems to work fine. However when I add the request handler: requestHandler name=/nutch class=solr.SearchHandler lst name=defaults str name=defTypedismax/str str name=echoParamsexplicit/str float name=tie0.01/float str name=qf content^0.5 anchor^1.0 title^1.2 /str str name=pf content^0.5 anchor^1.5 title^1.2 site^1.5 /str str name=fl url /str str name=mm 2-1 5-2 690% /str int name=ps100/int bool hl=true/ str name=q.alt*:*/str str name=hl.fltitle url content/str str name=f.title.hl.fragsize0/str str name=f.title.hl.alternateFieldtitle/str str name=f.url.hl.fragsize0/str str name=f.url.hl.alternateFieldurl/str str name=f.content.hl.fragmenterregex/str /lst /requestHandler and restart the solr-example app under tomcat I get the following error: HTTP Status 404 - missing core name in path -- *type* Status report *message* *missing core name in path* *description* *The requested resource (missing core name in path) is not available.* * * As soon as I comment out the request handler the example appears to work again. From the previous mentioned post I understand that this error is masking the actual error and I need to check the logs. However I'm unsure exactly where these are located. I was hoping if I could post them It'd allow you guys to suggest a solution. Many thanks Paul On 28 February 2011 11:37, Anurag [hidden email]http://user/SendEmail.jtp?type=nodenode=2598137i=0 wrote: Solr uses jetty server default, do u know that? you can run solr server without using Tomcat (using jetty server). Please describe the steps that led to the error. Which command u executed? -- If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Problem-with-Solr-and-Nutch-integration-tp2590334p2598137.html To start a new topic under Solr - User, email ml-node+472068-1941297125-146...@n3.nabble.com To unsubscribe from Solr - User, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Problem-with-Solr-and-Nutch-integration-tp2590334p2598526.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Problem with Solr and Nutch integration
Which os u are using? On Mon, Feb 28, 2011 at 1:39 AM, Paul Rogers [via Lucene] ml-node+2590334-620834624-146...@n3.nabble.com wrote: Hi Guys I'm trying to integrate solr and nutch as per http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/, using the branch_3x from svn on Tomcat 6. After adding the nutch requestHandler to solrconfig.xml while the solr-example will start on accessing the admin page I get the following error message: HTTP Status 404 - missing core name in path -- *type* Status report *message* *missing core name in path* *description* *The requested resource (missing core name in path) is not available.* After googling I found the following: I think you are seeing the effects of SOLR-1743 masking another error ... have you checked your log for other errors/exceptions being logged when you startup solr with that solrconfig.xml? Chris Hostetter My initial question is this, am I right in thinking that solr should be using the Tomcat 6 logging and that logs should be found at $CATALINA_HOME/logs/catalina.out? Thanks Paul -- If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Problem-with-Solr-and-Nutch-integration-tp2590334p2590334.html To start a new topic under Solr - User, email ml-node+472068-1941297125-146...@n3.nabble.com To unsubscribe from Solr - User, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Problem-with-Solr-and-Nutch-integration-tp2590334p2593100.html Sent from the Solr - User mailing list archive at Nabble.com.
Studying all files of Solr SRC
Is there any place where a detailed tutorial about all the Java files of Apache Solr(under Src folder) is available.? I want to study them as my purpose is to either write codes for my implementation or modify the existing files to fulfill my purpose. Actually i want to add Advance Search in my Solr based search engine. This advance search will include options like ...at least half , as many as possible , most etc which are linguistic operators. We can say that these options will help the user in finding fuzziness in their search results. The user wants show me all the documents which contains at least half of terms like t1,t2,t3 or show me all the documents which contains most of the terms like t1,t5,t7 etc...These at least half and most have been given some weight . These advance search is different from normal boolean search. Thanks - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Studying-all-files-of-Solr-SRC-tp2581715p2581715.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Spellcheck in solr-nutch integration
First go thru the schema.xml file . Look at the different components. On Sat, Feb 5, 2011 at 1:01 PM, 666 [via Lucene] ml-node+2429702-1399813783-146...@n3.nabble.comml-node%2b2429702-1399813783-146...@n3.nabble.com wrote: Hello Anurag, I'm facing the same problem. Will u please elaborate on how u solved the problem? It would be great if u give me a step by step description as I'm new in Solr. -- If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Spellcheck-in-solr-nutch-integration-tp1953232p2429702.html To unsubscribe from Spellcheck in solr-nutch integration, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=1953232code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwxOTUzMjMyfC0yMDk4MzQ0MTk2. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Spellcheck-in-solr-nutch-integration-tp1953232p2429782.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to edit / compile the SOLR source code
Actually i also want to edit Source Files of Solr.Does that mean i will have to go in Src directory of Solr and then rebuild using ant? I need not compile them or Ant will do the whole compiling as well as updating the jar files? i have the following files in Solr-1.3.0 directory /home/anurag/apache-solr-1.3.0/build /home/anurag/apache-solr-1.3.0/client /home/anurag/apache-solr-1.3.0/contrib /home/anurag/apache-solr-1.3.0/dist /home/anurag/apache-solr-1.3.0/docs /home/anurag/apache-solr-1.3.0/example /home/anurag/apache-solr-1.3.0/lib /home/anurag/apache-solr-1.3.0/src /home/anurag/apache-solr-1.3.0/build.xml /home/anurag/apache-solr-1.3.0/CHANGES.txt /home/anurag/apache-solr-1.3.0/common-build.xml /home/anurag/apache-solr-1.3.0/KEYS.txt /home/anurag/apache-solr-1.3.0/LICENSE.txt /home/anurag/apache-solr-1.3.0/NOTICE.txt /home/anurag/apache-solr-1.3.0/README.txt and i want to edit the source code to implement my things. How should i proceed? - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-edit-compile-the-SOLR-source-code-tp477584p2355270.html Sent from the Solr - User mailing list archive at Nabble.com.
Implementing Fuzzy Search using OWA operator and Fuzzy Linguistic Quantifier
I am solr-1.3.0 user , where we have integrated Nutch. I want my query types to be like eg. at least some query, or most of some query This is to be done through Fuzzy Search techniques. I know there is fuzzy search in solr using ~(tilde ) sign like e.g.somequery~0.8 But we want query to be of above types because its convenient to user to ask for what he/she really mean. It happens that using AND, OR , NOT for a user is difficult as user doesnot know where to use AND and where to use OR in the terms. The logical operators become difficult to use in search query. Any one have any idea on how to proceed to implement this? Thanks - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Implementing-Fuzzy-Search-using-OWA-operator-and-Fuzzy-Linguistic-Quantifier-tp2261469p2261469.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Implementing Fuzzy Search using OWA operator and Fuzzy Linguistic Quantifier
Please reply...I need help from you all... - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Implementing-Fuzzy-Search-using-OWA-operator-and-Fuzzy-Linguistic-Quantifier-tp2261469p2262917.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Implementing Fuzzy Search using OWA operator and Fuzzy Linguistic Quantifier
The query will be like 1. at least (lucene) 2. mostly (solr) 3. Q(query)=most(t1,t2,t3,t7) where t1,t2,t3,t7 are terms 4. Q=(t1,0.9) and {(t2,0.5) or (t3,0.7)} Actually the purpose to expand the query types enterd by user. On Sun, Jan 16, 2011 at 12:55 AM, iorixxx [via Lucene] ml-node+2263070-1851340758-146...@n3.nabble.comml-node%2b2263070-1851340758-146...@n3.nabble.com wrote: want my query types to be like eg. at least some query, or most of some query Can you elaborate more? It is not so visible what you want. -- View message @ http://lucene.472066.n3.nabble.com/Implementing-Fuzzy-Search-using-OWA-operator-and-Fuzzy-Linguistic-Quantifier-tp2261469p2263070.html To unsubscribe from Implementing Fuzzy Search using OWA operator and Fuzzy Linguistic Quantifier, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=2261469code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwyMjYxNDY5fC0yMDk4MzQ0MTk2. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Implementing-Fuzzy-Search-using-OWA-operator-and-Fuzzy-Linguistic-Quantifier-tp2261469p2263161.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: MoreLikeThis search component
You can go through page 182 of this book http://books.google.co.in/books?id=m2q3PwAACAAJdq=download+solr+search+server+1.4hl=enei=inIlTaudLcHrrQfB4pmaDAsa=Xoi=book_resultct=book-thumbnailresnum=1ved=0CDEQ6wEwAA . On Thu, Jan 6, 2011 at 12:53 PM, Isha Garg [via Lucene] ml-node+2204185-699553121-146...@n3.nabble.comml-node%2b2204185-699553121-146...@n3.nabble.com wrote: Hi , I am new solr user. Can anyone tell me the detailed approach that works behind the MoreLikeThis solr search component and how to use this? Thanks! Isha Garg -- View message @ http://lucene.472066.n3.nabble.com/MoreLikeThis-search-component-tp2204185p2204185.html To start a new topic under Solr - User, email ml-node+472068-1941297125-146...@n3.nabble.comml-node%2b472068-1941297125-146...@n3.nabble.com To unsubscribe from Solr - User, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/MoreLikeThis-search-component-tp2204185p2204265.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Problem of results ordering
Try boosting 94305 as guitar center 94305^10 On Fri, Dec 24, 2010 at 9:23 AM, Erick Erickson [via Lucene] ml-node+2139685-1248268645-146...@n3.nabble.comml-node%2b2139685-1248268645-146...@n3.nabble.com wrote: What does your query look like? Especially what is the output when you append debugQuery=on? You can examine the scoring at the end of the response to gain more insight. Best Erick On Thu, Dec 23, 2010 at 8:34 PM, Ruixiang Zhang [hidden email]http://user/SendEmail.jtp?type=nodenode=2139685i=0 wrote: When I search guitar center 94305, it gives the results: guitar center guitar center Hollywood guitar center 94305 guitar center 94305 location But I want results to be like this: guitar center 94305 guitar center 94305 location guitar center guitar center Hollywood How can I make the results that match all keywords come first? Or how can I reduce the weight of the word that appears the second or more time? Thanks Ruixiang -- View message @ http://lucene.472066.n3.nabble.com/Problem-of-results-ordering-tp2139314p2139685.html To start a new topic under Solr - User, email ml-node+472068-1941297125-146...@n3.nabble.comml-node%2b472068-1941297125-146...@n3.nabble.com To unsubscribe from Solr - User, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Problem-of-results-ordering-tp2139314p2139978.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr index directory '/solr/data/index' doesn't exist. Creating new index... on Geronimo
/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Dismax-score-maximu-of-any-one-field-tp2119563p2131762.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr index directory '/solr/data/index' doesn't exist. Creating new index... on Geronimo
So problem may be that index folder was not able to create. So try to check the conf folder where solconfig.xml schema.xml resides. Also u may try to index using $java -jar post.jar *.xml files. You may try different version like 1.3.0 or 1.4.0 to test what is wrong. It sometimes happens that the downloaded solr may have something missing. On Wed, Dec 22, 2010 at 9:18 PM, Bac Hoang [via Lucene] ml-node+2131930-846132511-146...@n3.nabble.comml-node%2b2131930-846132511-146...@n3.nabble.com wrote: Hello Anurag, The specific problem I faced when started solr in Geronimo (http://{server}:{port}/solr) is /solr/data/index could not be found, then solr tried to create that folder but failed, even permission is granted. More detail got from the log: Solr index directory '/solr/data/index' doesn't exist. Creating new index... 2010-12-22 15:13:19,599 ERROR [SolrDispatchFilter] Could not start SOLR. Check solr/home property java.lang.RuntimeException: java.io.IOException: Cannot create directory: /solr/data/index You're right, I'm using solr is 1.4.1 Thanks indeed Bac Hoang -Ursprüngliche Nachricht- Von: Anurag [mailto:[hidden email]http://user/SendEmail.jtp?type=nodenode=2131930i=0] Gesendet: tư 12/22/2010 10:17 CH An: [hidden email] http://user/SendEmail.jtp?type=nodenode=2131930i=1 Betreff: Re: Solr index directory '/solr/data/index' doesn't exist. Creating new index... on Geronimo What you want to ask? When this problem arises.? Is it when you try to index to solr? What are the commands that you are running? Which version of solr( 1.4.1?). On Wed, Dec 22, 2010 at 5:49 PM, Bac Hoang [via Lucene] [hidden email] http://user/SendEmail.jtp?type=nodenode=2131930i=2[hidden email] http://user/SendEmail.jtp?type=nodenode=2131930i=3 wrote: Hello Erick, Could you kindly give a hand on my problem. Any ideas, hints, suggestions are highly appreciated. Many thanks 1. The problem: Solr index directory '/solr/data/index' doesn't exist. Creating new index... 2. Some other info.: - use the solr example 1.4.1 - Geronimo 2.1.6 - solr home: /opt/dev/config/solr - dataDir: /opt/dev/config/solr/data/index. I set the read, write right to every and each folder, from opt, dev...to the last one, index (just for sure ;) ) - lockType: - single/ simple: Cannot create directory: /solr/data/index at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:397) - native: Cannot create directory: /solr/data/index at org.apache.lucene.store.NativeFSLockFactory.acquireTestLock - the Geronimo log: === 2010-12-22 15:13:03,001 INFO [SupportedModesServiceImpl] Portlet mode 'edit' not found for portletId: '/console-base.WARModules!874780194|0' 2010-12-22 15:13:03,001 INFO [SupportedModesServiceImpl] Portlet mode 'help' not found for portletId: '/console-base.WARModules!874780194|0' 2010-12-22 15:13:07,941 INFO [DirectoryMonitor] Hot deployer notified that an artifact was removed: default/solr2/1293005281314/war 2010-12-22 15:13:09,148 INFO [SupportedModesServiceImpl] Portlet mode 'edit' not found for portletId: '/console-base.WARModules!874780194|0' 2010-12-22 15:13:09,148 INFO [SupportedModesServiceImpl] Portlet mode 'help' not found for portletId: '/console-base.WARModules!874780194|0' 2010-12-22 15:13:14,139 INFO [SupportedModesServiceImpl] Portlet mode 'edit' not found for portletId: '/plugin.Deployment!227983155|0' 2010-12-22 15:13:18,795 WARN [TomcatModuleBuilder] Web application . does not contain a WEB-INF/geronimo-web.xml deployment plan. This may or may not be a problem, depending on whether you have things like resource references that need to be resolved. You can also give the deployer a separate deployment plan file on the command line. 2010-12-22 15:13:19,040 INFO [SolrResourceLoader] Using JNDI solr.home: /opt/dev/config/solr 2010-12-22 15:13:19,040 INFO [SolrResourceLoader] Solr home set to '/opt/dev/config/solr/' 2010-12-22 15:13:19,051 INFO [SolrDispatchFilter] SolrDispatchFilter.init() 2010-12-22 15:13:19,462 INFO [IndexSchema] default search field is text 2010-12-22 15:13:19,463 INFO [IndexSchema] query parser default operator is OR 2010-12-22 15:13:19,464 INFO [IndexSchema] unique key field: id 2010-12-22 15:13:19,490 INFO [JmxMonitoredMap] JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.jmxmbeanser...@144752d 2010-12-22 15:13:19,525 INFO [SolrCore] Added SolrEventListener: org.apache.solr.core.QuerySenderListener{queries=[]} 2010-12-22 15:13:19,525 INFO [SolrCore] Added SolrEventListener: org.apache.solr.core.QuerySenderListener{queries=[{q=solr rocks,start=0,rows=10}, {q=static firstSearcher warming query from solrconfig.xml}]} 2010-12-22 15:13:19,533 WARN [SolrCore] Solr index directory '/solr/data/index' doesn't exist. Creating new index... 2010-12-22 15:13:19,599
Re: improving search response time
I am using spellchecker in the query part. Now my search time has become more. say initiallly it was 1000ms now its 3000ms.I have data index of size 9GB. My query http://localhost:8983/solr/spellCheckCompRH/?q= http://localhost:8983/solr/spellCheckCompRH/?q=+search+spellcheck=truefl=spellcheck,title,url,hlhl=truestart=0rows=10indent=on How can i improve the search time. i have 1) Fedora 11 as OS 2) Solr run on Jetty Server 3) Front page (search page) is on Tomcat 6 4)Index size is 9GB 5)RAM is 1GB - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/improving-search-response-time-tp1204491p2125220.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: improving search response time
Thanks a lot! you mean i have to increase the resources. 1.Can the distributed search improve the speed.? 2.I have read from some thread that spellchecker takes time.Is spellchecker is one of the curlprit for more response time? On Tue, Dec 21, 2010 at 10:20 PM, Shawn Heisey-4 [via Lucene] ml-node+2126869-977261384-146...@n3.nabble.comml-node%2b2126869-977261384-146...@n3.nabble.com wrote: On 12/21/2010 3:02 AM, Anurag wrote: I am using spellchecker in the query part. Now my search time has become more. say initiallly it was 1000ms now its 3000ms.I have data index of size 9GB. My query http://localhost:8983/solr/spellCheckCompRH/?q= http://localhost:8983/solr/spellCheckCompRH/?q=+search+spellcheck=truefl=spellcheck,title,url,hlhl=truestart=0rows=10indent=on How can i improve the search time. i have 1) Fedora 11 as OS 2) Solr run on Jetty Server 3) Front page (search page) is on Tomcat 6 4)Index size is 9GB 5)RAM is 1GB Install more memory. 8GB would be a good place to be, more would let you fit your entire index into RAM for incredible speed. Once you get above 4GB RAM, it's best if you run a 64-bit OS and Java, which requires 64-bit processors. If your index is growing, you might want to have more memory than that. Shawn -- View message @ http://lucene.472066.n3.nabble.com/improving-search-response-time-tp1204491p2126869.html To unsubscribe from improving search response time, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=1204491code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwxMjA0NDkxfC0yMDk4MzQ0MTk2. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/improving-search-response-time-tp1204491p2127198.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: [Nutch] and Solr integration
why are using solrindex in the argument.? It is used when we need to index the crawled data in Solr For more read http://wiki.apache.org/nutch/NutchTutorial . Also for nutch-solr integration this is very useful blog http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/ I integrated nutch and solr and it works well. Thanks On Tue, Dec 21, 2010 at 1:57 AM, Adam Estrada-2 [via Lucene] ml-node+2122347-622655030-146...@n3.nabble.comml-node%2b2122347-622655030-146...@n3.nabble.com wrote: All, I have a couple websites that I need to crawl and the following command line used to work I think. Solr is up and running and everything is fine there and I can go through and index the site but I really need the results added to Solr after the crawl. Does anyone have any idea on how to make that happen or what I'm doing wrong? These errors are being thrown fro Hadoop which I am not using at all. $ bin/nutch crawl urls -dir crawl -threads 10 -depth 100 -topN 50 -solrindex ht tp://localhost:8983/solr crawl started in: crawl rootUrlDir = http://localhost:8983/solr threads = 10 depth = 100 indexer=lucene topN = 50 Injector: starting at 2010-12-20 15:23:25 Injector: crawlDb: crawl/crawldb Injector: urlDir: http://localhost:8983/solr Injector: Converting injected urls to crawl db entries. Exception in thread main java.io.IOException: No FileSystem for scheme: http at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1375 ) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175) at org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.j ava:169) at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.ja va:201) at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:810) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:7 81) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730) at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1249) at org.apache.nutch.crawl.Injector.inject(Injector.java:217) at org.apache.nutch.crawl.Crawl.main(Crawl.java:124) -- View message @ http://lucene.472066.n3.nabble.com/Nutch-and-Solr-integration-tp2122347p2122347.html To start a new topic under Solr - User, email ml-node+472068-1941297125-146...@n3.nabble.comml-node%2b472068-1941297125-146...@n3.nabble.com To unsubscribe from Solr - User, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=. -- Kumar Anurag - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Nutch-and-Solr-integration-tp2122347p2122623.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Jquery Autocomplete Json formatting ?
Installed Firebug Now getting the following error 4139 matches.call( document.documentElement, [test!='']:sizzle ); Though my solr server is running on port8983, I am not using any server to run this jquery, its just an html file in my home folder that i am opening in my firefox browser. - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Jquery-Autocomplete-Json-formatting-tp2101346p2101593.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Jquery Autocomplete Json formatting ?
Installed Firebug Now getting the following error 4139 matches.call( document.documentElement, [test!='']:sizzle ); Though my solr server is running on port8983, I am not using any server to run this jquery, its just an html file in my home folder that i am opening in my firefox browser. - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Jquery-Autocomplete-Json-formatting-tp2101346p2101595.html Sent from the Solr - User mailing list archive at Nabble.com.
Autosuggest terms which GOOGLE uses?
How Google selects the autosuggest terms? Is that Google uses Userrs Queries from Log files to suggest only those terms? - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Autosuggest-terms-which-GOOGLE-uses-tp2039078p2039078.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Autosuggest terms which GOOGLE uses?
Thanks a lot!! If I want to index query terms from lof files ? Is it possible . And then want to do autosuggest query on all those terms using termsComponentTill now my autosuggest options are like q.prefix= or q.suffix= which matches the terms available in the documents. - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Autosuggest-terms-which-GOOGLE-uses-tp2039078p2039307.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to update solr index.
Can you clarify ur question? - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-update-solr-index-tp2038480p2038580.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to make a client in JSP which will take output from Solr Server
Ok, I solved it by just opening the connection and then parsing the output from xml to front page. Though It has some security isuue... - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-make-a-client-in-JSP-which-will-take-output-from-Solr-Server-tp1519527p2019632.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Spellcheck in solr-nutch integration
i solved the problemAll we need to modify schema file. Also the spellcheck index is created first when spellcheck.build=true - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Spellcheck-in-solr-nutch-integration-tp1953232p1988252.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Spell-Check Component Functionality
a different analyzer/tokenizer and is used if present * do not do spellcheck.build=true for every request (creating the spellcheck index can be very expensive) * if you got spellcheck working embed the spellcheck component into your normal query component. otherwise you need to query 2 times ... Regards, Peter. All, I am trying apply the Solr spell check component functionality to our data. The configuration set up I needed to make for it by updating config.xml and schema.xml is done as follows.. Please let me know if any errors in it. I am not getting any suggestions in suggestion tags of solr output xml. I indexed word Crust to the field textSpell that is enabled for spell check and then I searched for Curst The queries i tried were : http://localhost:8909/solr/spell?q=Curstspellcheck=truespellcheck.collate=truespellcheck.build=truespellcheck.q=true http://localhost:8909/solr/spell?q=Crustespellcheck=truespellcheck.collate=truespellcheck.build=truespellcheck.q=truespellcheck.dictionary=default The CONFIG.XML : searchComponent name=spellcheck class=solr.SpellCheckComponent lst name=spellchecker str name=namedefault/str str name=fieldspell/str str name=spellcheckIndexDir./spellchecker/str /lst !-- a spellchecker that uses a different distance measure -- lst name=spellchecker str name=namejarowinkler/str str name=fieldlowerfilt/str str name=distanceMeasureorg.apache.lucene.search.spell.JaroWinklerDistance/str str name=spellcheckIndexDir./spellchecker2/str /lst str name=queryAnalyzerFieldTypetextSpell/str /searchComponent requestHandler name=/spell class=solr.SearchHandler lazy=true lst name=defaults str name=spellcheck.dictionarydefault/str !-- omp = Only More Popular -- str name=spellcheck.onlyMorePopularfalse/str !-- exr = Extended Results -- str name=spellcheck.extendedResultsfalse/str !-- The number of suggestions to return -- str name=spellcheck.count1/str /lst arr name=last-components strspellcheck/str /arr /requestHandler SCHEMA: fieldType name=textSpell class=solr.TextField positionIncrementGap=100 analyzer type=index tokenizer class=solr.StandardTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.StandardFilterFactory/ filter class=solr.RemoveDuplicatesTokenFilterFactory/ /analyzer analyzer type=query tokenizer class=solr.StandardTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.StandardFilterFactory/ filter class=solr.RemoveDuplicatesTokenFilterFactory/ /analyzer /fieldType field name=spell type=textSpell indexed=true stored=true / If any error in above that is not enabling spell check please let me know. The output I am getting is like null suggetions lst Suggesstions/ /lst Regards, Rajani Maski -- http://jetwick.com http://jetwick.com?by-user=t twitter search prototype -- View message @ http://lucene.472066.n3.nabble.com/Spell-Check-Component-Functionality-tp1923954p1939841.html To start a new topic under Solr - User, email ml-node+472068-1941297125-146...@n3.nabble.comml-node%2b472068-1941297125-146...@n3.nabble.com To unsubscribe from Solr - User, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=. -- Kumar Anurag ?xml version=1.0 encoding=UTF-8 ? !-- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to You under the Apache License, Version 2.0 (the License); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an AS IS BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -- config !-- Set this to 'false' if you want solr to continue working after it has encountered an severe configuration error. In a production environment, you may want solr to keep working even if one handler is mis-configured. You may also set this to false using by setting the system property: -Dsolr.abortOnConfigurationError=false -- abortOnConfigurationError${solr.abortOnConfigurationError:false}/abortOnConfigurationError !-- Used to specify an alternate
Spellcheck in solr-nutch integration
I have integrated solr and nutch using http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/ this As the tutorial says, the Schema.xml SolrConfig.xml of Solr has to be modified. I also did the same. I am using Solr-1.3. But my problem is that i am not able to implement Spellcheck in this Solr-nutch integration. I have got a separate Solr-1.4 where there are options available for Spellcheck. What i want to ask is... 1.Indexing for spellcheck is to be done as the same time of indexing the contents.?What are the steps to follow? 2.How can i implement spellcheck in solr-nutch integration? please help. - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Spellcheck-in-solr-nutch-integration-tp1953232p1953232.html Sent from the Solr - User mailing list archive at Nabble.com.
Java -cp . FileName.java Not Working
Here i hv two compiled files i am using Solr-1.4 1. SolrJExample.class executing $java -cp . SolrJExample.class gives following error [anu...@localhost ~]$ java -cp . SolrJExample Exception in thread main java.lang.NoClassDefFoundError: org/apache/solr/common/params/SolrParams Caused by: java.lang.ClassNotFoundException: org.apache.solr.common.params.SolrParams at java.net.URLClassLoader$1.run(URLClassLoader.java:217) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205) at java.lang.ClassLoader.loadClass(ClassLoader.java:321) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:334) Could not find the main class: SolrJExample. Program will exit. 2.SimplePostTool.class executing $java -cp .SimplePostTool.class gives the following error [anu...@localhost ~]$ java -cp . SimplePostTool Exception in thread main java.lang.NoClassDefFoundError: SimplePostTool (wrong name: org/apache/solr/util/SimplePostTool) at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:634) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:277) at java.net.URLClassLoader.access$000(URLClassLoader.java:73) at java.net.URLClassLoader$1.run(URLClassLoader.java:212) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205) at java.lang.ClassLoader.loadClass(ClassLoader.java:321) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:334) Could not find the main class: SimplePostTool. Program will exit. U can find the class files http://code.google.com/p/intranetsearchengine/downloads/list here Please Help in executing these programs , i am trying to make a search client which will send the query to solr index and get the result back to the client. Thanks - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/Java-cp-FileName-java-Not-Working-tp1519501p1519501.html Sent from the Solr - User mailing list archive at Nabble.com.
How to make a client in JSP which will take output from Solr Server
Actually i have Crwaled the data using Nutch-1.0 and Indexxed it to Solr -1.3 (using this http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/ tutorial ) Now i want to create a page in JSP that will be a Simple Search Form where i need to ask Query From Users. This JSP page will be accessible via TOMCAT server or APACHE Web Server. Now After entering the Query the page should http request http://localhost:8983/solr/select?q=SomeQuery; Then the result obtained from that Solr Server Should Come back to Search form in JSP and The results should be displayed like in XML or XSL or JSON format. Please Suggest some tutorials, or Some Examples i am thankful to u all - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-make-a-client-in-JSP-which-will-take-output-from-Solr-Server-tp1519527p1519527.html Sent from the Solr - User mailing list archive at Nabble.com.
lucene + solr: corrupt index
Hi, I am using lucene 3.0 jars and built a lucene index with 200 documents. The index files were then copied over to my solr 1.4.1 installation. I get the following error every time I start SOLR: What could I be doing wrong? SEVERE: Could not start SOLR. Check solr/home property java.lang.RuntimeException: org.apache.lucene.index.CorruptIndexException: Incompatible format version: 2 expected 1 or lower at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1068) at org.apache.solr.core.SolrCore.init(SolrCore.java:579) at org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:137) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:83) at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:99) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40) at org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:594) at org.mortbay.jetty.servlet.Context.startContext(Context.java:139) at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1218) at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:500) at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:448) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:147) at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:161) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40) at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:147) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40) at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:117) at org.mortbay.jetty.Server.doStart(Server.java:210) at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40) at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:929) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.mortbay.start.Main.invokeMain(Main.java:183) at org.mortbay.start.Main.start(Main.java:497) at org.mortbay.start.Main.main(Main.java:115) Caused by: org.apache.lucene.index.CorruptIndexException: Incompatible format version: 2 expected 1 or lower at org.apache.lucene.index.FieldsReader.init(FieldsReader.java:117) at org.apache.lucene.index.SegmentReader$CoreReaders.openDocStores(SegmentReader.java:291) at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:654) at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:613) at org.apache.lucene.index.DirectoryReader.init(DirectoryReader.java:104) at org.apache.lucene.index.ReadOnlyDirectoryReader.init(ReadOnlyDirectoryReader.java:27) at org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java:74) at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:683) at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:69) at org.apache.lucene.index.IndexReader.open(IndexReader.java:476) at org.apache.lucene.index.IndexReader.open(IndexReader.java:403) at org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:38) at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1057) ... 27 more
Re: lucene + solr: corrupt index
Thx Koji, I tried 2.9.3 and it works :-) On Mon, Aug 23, 2010 at 6:15 PM, Koji Sekiguchi k...@r.email.ne.jp wrote: (10/08/24 10:02), ANurag wrote: Hi, I am using lucene 3.0 jars and built a lucene index with 200 documents. The index files were then copied over to my solr 1.4.1 installation. I get the following error every time I start SOLR: What could I be doing wrong? Solr 1.4 can read Lucene 2.9 index or older. Koji -- http://www.rondhuit.com/en/