expert question about SolrReplication

2013-02-01 Thread Bernd Fehling
A question to the experts, why is the replicated index copied from its temporary location (index.x) to the real index directory and NOT moved? Copying over 100s of gigs takes some time, moving is just changing the file system link. Also, instead of first deleting the old index, why not

Re: Thoughts on production deployment?

2013-02-01 Thread Scott Stults
Thanks for jumping in guys. I agree the SolrJetty page needs just a little updating -- I commented at the bottom of SOLR-3159 about that. Michael and Paul, are your chef and ant recipes generic enough to share? My next install is going to be on RHEL 6, so I can take a crack at an install script

Indexing nouns only with UIMA works - performance issue?

2013-02-01 Thread Kai Gülzau
I now use the stupid way to use the german corpus for UIMA: copy + paste :-) I modified the Tagger-2.3.1.jar/HmmTagger.xml to use the german corpus ... fileResourceSpecifier fileUrlfile:german/TuebaModel.dat/fileUrl /fileResourceSpecifier ... and saved it as Tagger-2.3.1.jar/HmmTaggerDE.xml

RE: Indexing nouns only - UIMA vs. OpenNLP

2013-02-01 Thread Kai Gülzau
Hi Lance, About removing non-nouns: the OpenNLP patch includes two simple TokenFilters for manipulating terms with payloads. The FilterPayloadFilter lets you keep or remove terms with given payloads. yes, I used this already in the schema.xml filter class=solr.FilterPayloadsFilterFactory

Re: Thoughts on production deployment?

2013-02-01 Thread Michael Della Bitta
When I was referring to the different version of Jetty, I meant Jetty Plus, which the wiki mentions. Is this no longer true? My Chef recipe makes assumptions about the OS and EBS volumes being available, which can easily be fixed. Michael Thanks for jumping in guys. I agree the SolrJetty page

Re: Is Solr Cloud will be helpful in case of Load balancing

2013-02-01 Thread Tomás Fernández Löbbe
Yes and no. SolrCloud won't do it automatically. But it will make it easier for you to add/remove nodes from a collection. And if you use CloudSolrServer for queries, the new nodes will automatically be used for queries once they are ready to respond. Tomás On Fri, Feb 1, 2013 at 7:35 AM,

Re: help with getting error with mysql driver connection in solr 4.1

2013-02-01 Thread Arcadius Ahouansou
Hi Rohan. * * Solr 4.1 uses Jetty 8. You need to put your JDBC driver under SOLR_HOME/lib/ext SOLR_HOME/lib/ being where all jetty *jar sit. You may need to create ext if it does not exists. HTH. Arcadius. On 1 February 2013 13:25, Rohan Thakur rohan.i...@gmail.com wrote: hi everyone I

Image retrieval

2013-02-01 Thread J Mohamed Zahoor
Hi Iam trying to integrate a image retrieval system (Lire - http://www.semanticmetadata.net/lire/) in to Solr. Images are stored as its descriptors or features. But when searching for a image match, I need to pick images whose features are close (by calculating the distance) to the given

RE: Is Solr Cloud will be helpful in case of Load balancing

2013-02-01 Thread Jay Parashar
Do you just have one instance of Solr then? Because with Solr Cloud, replication is automatic and the zk will handle which node (leader) the data is retrieved from. For Load Balancing, Solr Cloud has a basic Round Robin LB Server which is wrapped by the CloudSolrServer. So if you use the

Re: How to use SolrCloud in multi-threaded indexing

2013-02-01 Thread Mikhail Khludnev
Andy, I think this thread will be informant for you http://find.searchhub.org/document/69465af821f3f055#31752f52cea05da6 Some time ago I scaffolded https://issues.apache.org/jira/browse/SOLR-3585presumably if you put that UpdateProcessor on-top of the chain, and DistributedUpdateProcessor under

Re: Possible issue in edismax?

2013-02-01 Thread Sandeep Mestry
Hi.. Could you tell me if changing default similarity to custom implementation will require me to rebuild the index? Or will it be used only query time? thanks, Sandeep On 31 Jan 2013 13:55, Felipe Lahti fla...@thoughtworks.com wrote: So, it depends of your business requirement, right? If a

Re: Possible issue in edismax?

2013-02-01 Thread Felipe Lahti
It's not necessary. It's only query time. On Fri, Feb 1, 2013 at 5:00 PM, Sandeep Mestry sanmes...@gmail.com wrote: Hi.. Could you tell me if changing default similarity to custom implementation will require me to rebuild the index? Or will it be used only query time? thanks, Sandeep

Re: Join across cores on same shard.

2013-02-01 Thread Marcin Rzewucki
Check below if that's better for you: http://pastebin.com/ardqNcC7 On 1 February 2013 21:25, Marcin Rzewucki mrzewu...@gmail.com wrote: Hi, I was trying to join documents across cores on same shard in SolrCloud4.1 and I got this error: java.lang.NullPointerException at

Re: Join across cores on same shard.

2013-02-01 Thread Yonik Seeley
You're missing the query to do the join on: fq={!join from=parent_id to=child_id fromIndex=core2}*:* We should have a better error message rather than a NPE of course... -Yonik http://lucidworks.com On Fri, Feb 1, 2013 at 3:45 PM, Marcin Rzewucki mrzewu...@gmail.com wrote: Check below if

Nested function query must use ....

2013-02-01 Thread Uwe Reh
Hi, should be easy, but I'm to blind to find the correct syntax (Solr4.1) Problem: I' have some documents in the index, because of their structure they tend to get too high scores. This documents are easy to identify and I want to boost the others to get a fair ranking. Could anyone give my

Re: Anyone else see this error when running unit tests?

2013-02-01 Thread Jan Morlock
Hi Amit, I experienced the same problem. According to http://maven.apache.org/surefire/maven-surefire-plugin/examples/configuring-classpath.html there is a certain classpath ordering for unittests favoring project dependencies. Therefore by explicitly specifying the lucene-test-framework as

Re: Join across cores on same shard.

2013-02-01 Thread Marcin Rzewucki
Thanks Yonik. I see no errors now. Is it possible to get fields from both cores for returned results ? On 1 February 2013 21:53, Yonik Seeley yo...@lucidworks.com wrote: You're missing the query to do the join on: fq={!join from=parent_id to=child_id fromIndex=core2}*:* We should have a

Solr 4.1.0 index leaving write.lock file

2013-02-01 Thread dm_tim
Howdy, I've been using Solr 4.1.0 for a little while now and I just noticed that when I index any core I have the write.lock file doesn't go away until I stop the server where solr is running. The data I'm indexing is fairly small (16k rows in a db) so it shouldn't take much time at all though I

Re: Possible issue in edismax?

2013-02-01 Thread Sandeep Mestry
Brilliant! Thanks very much for your response. . On 1 Feb 2013 20:37, Felipe Lahti fla...@thoughtworks.com wrote: It's not necessary. It's only query time. On Fri, Feb 1, 2013 at 5:00 PM, Sandeep Mestry sanmes...@gmail.com wrote: Hi.. Could you tell me if changing default similarity

Re: Solr 4.1.0 index leaving write.lock file

2013-02-01 Thread Yonik Seeley
On Fri, Feb 1, 2013 at 5:41 PM, dm_tim dm_...@yahoo.com wrote: I've been using Solr 4.1.0 for a little while now and I just noticed that when I index any core I have the write.lock file doesn't go away until I stop the server where solr is running. Sounds like it's working as it should. The

Re: Nested function query must use ....

2013-02-01 Thread Jack Krupansky
You have to do exactly what the error message tells you: rewrite: query(id:3) as: query({!=v'id:3'}) I've updated the example on the Function Query wiki that you may have copied: http://wiki.apache.org/solr/FunctionQuery#exists -- Jack Krupansky -Original Message- From:

Re: Solr 4.1.0 index leaving write.lock file

2013-02-01 Thread dm_tim
Well that makes sense. The problem is that I am working in both Solr and Lucene directly. I have some indexes that work great in Solr and now I want to do the same thing in Java using the Lucene libs. So I'm writing to the same index dir. I do testing by creating an index in Solr, look at it, and

Re: Solr 4.1.0 index leaving write.lock file

2013-02-01 Thread Mark Miller
You can use 'none' for the lock type in solrconfig.xml. You risk corruption if two IW's try to modify the index at once though. - Mark On Feb 1, 2013, at 6:56 PM, dm_tim dm_...@yahoo.com wrote: Well that makes sense. The problem is that I am working in both Solr and Lucene directly. I have

Re: Solr 4.1.0 index leaving write.lock file

2013-02-01 Thread dm_tim
Cool. I can use that setting while testing then set it back when I'm just running Lucene. Many thanks folks! Regards, Tim -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-1-0-index-leaving-write-lock-file-tp4038046p4038060.html Sent from the Solr - User mailing list

Re: expert question about SolrReplication

2013-02-01 Thread Yonik Seeley
On Fri, Feb 1, 2013 at 4:13 AM, Bernd Fehling bernd.fehl...@uni-bielefeld.de wrote: A question to the experts, why is the replicated index copied from its temporary location (index.x) to the real index directory and NOT moved? The intent is certainly to move and not copy (provided