Backup of a Solr index

2008-01-02 Thread Jörg Kiegeland
Is there a standard way to dump the Solr index to a file or to a directory as backup, and to import a such saved index to another Solr index later? Another question I have, is whether one is allowed to copy the /data/index folder while the Solr server is still running, as easy alternative

How to configure Solr on Tomcat 6.0 as windows Service

2008-01-02 Thread Laxmilal Menaria
Hello everyone, I have tried Solr using jetty, its run on command prompt, but now I want to comfigure solr on tomcat-6, so nay one know how to configure it as windows service using tomcat. Please let me know how its is possible. -- Thanks in advance, Laxmilal menaria http://www.chambal.com/

No search results when configure solr on tomcat as service

2008-01-02 Thread Laxmilal Menaria
Hello, I have configured solr as Multiple Solr appshttp://wiki.apache.org/solr/SolrTomcat#head-ef0d6d9640b6f25a242a915d57e0709630915040with tomcat 5.5, using http://wiki.apache.org/solr/SolrTomcat for configuration. After configuration and search with admin panel it doesn't show any results, but

Re: big perf-difference between solr-server vs. SOlrJ req.process(solrserver)

2008-01-02 Thread Andrzej Bialecki
Otis Gospodnetic wrote: Maybe I'm not following your situation 100%, but it sounded like pulling the values of purely stored fields is the slow part. *Perhaps* using a non-Lucene data store just for the saved fields would be faster. For this purpose Nutch uses external files in Hadoop MapFile

Re: How to configure Solr on Tomcat 6.0 as windows Service

2008-01-02 Thread Ryan McKinley
For tomcat configuration notes, check: http://wiki.apache.org/solr/SolrTomcat I don't use tomcat, (their user list may be more useful if something goes wrong) - but this may help: http://tomcat.apache.org/tomcat-5.5-doc/windows-service-howto.html ryan Laxmilal Menaria wrote: Hello

Re: No search results when configure solr on tomcat as service

2008-01-02 Thread Ryan McKinley
Are you indexing files while tomcat is running? If so, are you sending the commit/ message? If so, can you see what is happening in the logs? The jetty example and your tomcat setup probably put their indexes in different places, so they will not have the same results. ryan Laxmilal

RE: a problem with SimplePostTool

2008-01-02 Thread Heba Farouk
Actually it was not a problem with the xml, I ran all the xmls using one thread and I found no problem at all. But when I changed the solr version (I was using nightly) with version 1.2, all the threads run safely. -Original Message- From: Ryan McKinley [mailto:[EMAIL PROTECTED] Sent:

How to perform a double query in one

2008-01-02 Thread Rishabh Joshi
Hi, Is there a way to perform 2 search queries in one search request, and then return their combined results? Currently I am performing the following: I have a document which consists of id field which is the unique identifier, the info field, and an xid field which contains the ids of other

RE: Backup of a Solr index

2008-01-02 Thread Charlie Jackson
Solr indexes are file-based, so there's no need to dump the index to a file. In terms of how to create backups and move those backups to other servers, check out this page http://wiki.apache.org/solr/CollectionDistribution. Hope that helps. -Original Message- From: Jörg Kiegeland

Re: Create new core on the fly

2008-01-02 Thread Ryan McKinley
The LOAD method will load a core from a schema/config file -- it will not need to be in multicore.xml (the persist=true option should serialize this change into multicore.xml) Henri's latest patch implements LOAD, but it needs some clean up to apply cleanly to the current trunk. ryan

Re: How to perform a double query in one

2008-01-02 Thread Otis Gospodnetic
Custom request handler approach seems the most straight forward and the only one I can think of quickly. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Rishabh Joshi [EMAIL PROTECTED] To: solr-user@lucene.apache.org Sent: Wednesday, January

Re: How to perform a double query in one

2008-01-02 Thread Ryan McKinley
If I understand the question... you essentially want a JOIN function. Find the set of docs linked to by an initial query. Right now, you either need to do two queries (in the client or custom RequestHandler) OR, if possible, flatten the data into each doc. For your specific example, can you

Re: Backup of a Solr index

2008-01-02 Thread Mike Klaas
If you're writing to disk, you can minimize the chance of an inconsistent index by hardlinking the files first (cp -l) -Mike On 2-Jan-08, at 8:10 AM, Charlie Jackson wrote: Solr indexes are file-based, so there's no need to dump the index to a file. In terms of how to create backups and

Re: How to configure Solr on Tomcat 6.0 as windows Service

2008-01-02 Thread Norberto Meijome
On Wed, 2 Jan 2008 16:25:58 +0530 Laxmilal Menaria [EMAIL PROTECTED] wrote: I have tried Solr using jetty, its run on command prompt, but now I want to comfigure solr on tomcat-6, so nay one know how to configure it as windows service using tomcat. Any particular reason you don't use Jetty as

Performance stats for indeces with over 10MM documents

2008-01-02 Thread Alex Benjamen
Hi, I'm very interested in sharing performance stats with those who have indeces that contain more than 10MM documents. It seems that the response times and QPS drops drastically with the number of documents in the index. This overall makes sense, but it would be good to know what kind of QPS

Re: Performance stats for indeces with over 10MM documents

2008-01-02 Thread John Stewart
Alex, That's too slow. Can you provide more details about your schema, queries etc? jds On Jan 2, 2008 7:28 PM, Alex Benjamen [EMAIL PROTECTED] wrote: Hi, I'm very interested in sharing performance stats with those who have indeces that contain more than 10MM documents. It seems that the

Re: Solr RPS is painfully low

2008-01-02 Thread Sean Fox
Are you (or have you tried) breaking these queries up as a set of filter queries? fq=gender:ffq=( friends:y )fq= country:usfq= age:(18 || 19 || 20 || 21)fq=photos:y (mod correct syntax) Should get you the same result but each fq is cached separately as a bitset and future queries that

RE: Performance stats for indeces with over 10MM documents

2008-01-02 Thread Alex Benjamen
JDS: That's too slow. Can you provide more details about your schema, queries etc? Ofcourse - I'm using the standard config which comes with solr, and I've added the following fields : field name=id type=integer indexed=true stored=true required=true / field name=status type=text

Re: No search results when configure solr on tomcat as service

2008-01-02 Thread Laxmilal Menaria
I have created index using jetty and after that have created multiple webapp with tomcat, data index folder is copied to webapps. On 1/2/08, Ryan McKinley [EMAIL PROTECTED] wrote: Are you indexing files while tomcat is running? If so, are you sending the commit/ message? If so, can you see

Re: How to configure Solr on Tomcat 6.0 as windows Service

2008-01-02 Thread Laxmilal Menaria
I have already running tomcat on server. On 1/3/08, Norberto Meijome [EMAIL PROTECTED] wrote: On Wed, 2 Jan 2008 16:25:58 +0530 Laxmilal Menaria [EMAIL PROTECTED] wrote: I have tried Solr using jetty, its run on command prompt, but now I want to comfigure solr on tomcat-6, so nay one

Re: Performance stats for indeces with over 10MM documents

2008-01-02 Thread Mike Klaas
On 2-Jan-08, at 5:47 PM, Alex Benjamen wrote: gender:m AND status:(2 || 8 || 6 || 3) AND age:(26 || 27 || 28 || 29) AND orientation:3 gender:f AND age:(27 || 28 || 29 || 30 || 31 || 32 || 33 || 34 || 35 || 36 ) AND orientation:2 AND photos:y gender:f AND (activity:y) AND age:(28 || 29 ||

Re: Filter Query and query score

2008-01-02 Thread Mike Klaas
On 1-Jan-08, at 11:54 PM, climbingrose wrote: Doc1: [Title=Java; Location=Parramatta, NSW; latitude=x1; longitude=x2] Doc2: [Title=Java; Location=North Ryde, NSW; latitude=x3; longitude=x4] Doc3: [Title=Java; Location=Parramatta] My filter query looks like this: fq= (+latitude[lat1 TO

RE: Performance stats for indeces with over 10MM documents

2008-01-02 Thread Alex Benjamen
Mike, Thanks for the input, it's really valueable. Several forum users have suggested using fq to separate the caching of filters, and I can immediately see how this would help. I'm changing the code right now and going to run some benchmarks, hopefully see a big gain just from that - use

Re: Performance stats for indeces with over 10MM documents

2008-01-02 Thread John Stewart
Alex, Not to be a pain, but the response I had when looking at the query was, why not do this in a SQL database, which is designed precisely to process this sort of request at speed? I've noticed that people sometimes try to get Solr to act as a generalized information store -- I'm not sure

Re: No search results when configure solr on tomcat as service

2008-01-02 Thread Laxmilal Menaria
Have configured successfully and getting search results. Now I want to configure solr on different Indexes with tomcat, Please let me how it is possible. On 1/3/08, Laxmilal Menaria [EMAIL PROTECTED] wrote: I have created index using jetty and after that have created multiple webapp with

Re: Performance stats for indeces with over 10MM documents

2008-01-02 Thread Mike Klaas
On 2-Jan-08, at 9:52 PM, Alex Benjamen wrote: Thanks for the input, it's really valueable. Several forum users have suggested using fq to separate the caching of filters, and I can immediately see how this would help. I'm changing the code right now and going to run some benchmarks,