RE: *Very* slow Commit after upgrading to solr 1.3

2008-10-08 Thread Ben Shlomo, Yatir
: Tuesday, October 07, 2008 1:10 PM To: solr-user@lucene.apache.org Subject: Re: *Very* slow Commit after upgrading to solr 1.3 On Tue, Oct 7, 2008 at 6:32 AM, Ben Shlomo, Yatir [EMAIL PROTECTED] wrote: The problem is solved, see below. Since the performance is so sensitive to configuration - do you

RE: *Very* slow Commit after upgrading to solr 1.3

2008-10-07 Thread Ben Shlomo, Yatir
to be sync'd It may help to try the IndexWriter settings from the 1.3 example setup... the important changes being: mergeFactor10/mergeFactor !--maxBufferedDocs1000/maxBufferedDocs-- ramBufferSizeMB32/ramBufferSizeMB -Yonik On Mon, Sep 29, 2008 at 5:33 AM, Ben Shlomo, Yatir [EMAIL

*Very* slow Commit after upgrading to solr 1.3

2008-09-29 Thread Ben Shlomo, Yatir
Hi! I am running on widows 64 bit ... I have upgraded to solr 1.3 in order to use the distributed search. I haven't changed the solrConfig and the schema xml files during the upgrade. I am indexing ~ 350K documents (each one is about 0.5 KB in size) The indexing takes a reasonable amount of

help required: how to design a large scale solr system

2008-09-24 Thread Ben Shlomo, Yatir
Hi! I am already using solr 1.2 and happy with it. In a new project with very tight dead line (10 development days from today) I need to setup a more ambitious system in terms of scale Here is the spec: * I need to index about 60,000,000 documents *

RE: help required: how to design a large scale solr system

2008-09-24 Thread Ben Shlomo, Yatir
will be missing 1 doc. 10 mil each on 3 machines, a *:* search will be missing 30. Not a big deal, but could be a concern for some with picky, look at everything customers. - Mark Ben Shlomo, Yatir wrote: Hi! I am already using solr 1.2 and happy with it. In a new project with very tight dead

RE: solr not finding all results

2007-10-15 Thread Ben Shlomo, Yatir
Did you try to add a backslash to escape the - in Geckoplp4-M (Geckoplp4\-M) -Original Message- From: Kevin Lewandowski [mailto:[EMAIL PROTECTED] Sent: Friday, October 12, 2007 9:40 PM To: solr-user@lucene.apache.org Subject: solr not finding all results I've found an odd situation

I can't delete, why?

2007-09-25 Thread Ben Shlomo, Yatir
Hi! I know I can delete multiple docs with the following: deletequerymediaId:(6720 OR 6721 OR )/query/delete My question is can I do something like this? deletequerylanguageId:123 AND manufacturer:456 /query/delete (It does not work for me and I didn't forget to commit) How can I do it

problem with quering solr after indexing UTF-8 encoded CSV files

2007-08-20 Thread Ben Shlomo, Yatir
Hi! I have utf-8 encoded data inside a csv file (actually it’s a tab separated file - attached) I can index it with no apparent errors I did not forget to set this in my tomcat configuration Server ... Service ... Connector ... URIEncoding=UTF-8/ When I query a document

question: how to divide the indexing into sperate domains

2007-08-09 Thread Ben Shlomo, Yatir
Hi! say I have 300 csv files that I need to index. Each one holds millions of lines (each line is a few fields separated by commas) Each csv file represents a different domain of data (e,g, file1 is computers, file2 is flowers, etc) There is no indication of the domain ID in the data