AW: Solr indexing slows down

2013-06-10 Thread Sebastian Steinfeld
nothing. Thanks, Sebastian -Ursprüngliche Nachricht- Von: Michael Della Bitta [mailto:michael.della.bi...@appinions.com] Gesendet: Donnerstag, 6. Juni 2013 18:29 An: solr-user@lucene.apache.org Betreff: Re: Solr indexing slows down Hi Sebastian, What database are you using? How much

AW: Solr indexing slows down

2013-06-10 Thread Sebastian Steinfeld
of the import and so autocommit won't work. I am using Solr 4.3 Thank you, Sebastian -Ursprüngliche Nachricht- Von: Shawn Heisey [mailto:s...@elyograg.org] Gesendet: Donnerstag, 6. Juni 2013 19:06 An: solr-user@lucene.apache.org Betreff: Re: Solr indexing slows down On 6/6/2013 4:13

Re: AW: Solr indexing slows down

2013-06-10 Thread Shawn Heisey
On 6/10/2013 2:32 AM, Sebastian Steinfeld wrote: Hi Shawn, thank you for your answer. I am using Oracle. This is the configuration I am using: - dataSource name=local driver=oracle.jdbc.driver.OracleDriver url=jdbc:oracle:thin:@localhost:1521:XE user= password=

Re: Solr indexing slows down

2013-06-10 Thread Walter Underwood
8 million documents in two hours is over 1000/sec. That is a pretty fast indexing rate. It may be hard to go faster than that. wunder On Jun 10, 2013, at 7:12 AM, Shawn Heisey wrote: On 6/10/2013 2:32 AM, Sebastian Steinfeld wrote: Hi Shawn, thank you for your answer. I am using

Re: Solr indexing slows down

2013-06-10 Thread Michael Della Bitta
2013 18:29 An: solr-user@lucene.apache.org Betreff: Re: Solr indexing slows down Hi Sebastian, What database are you using? How much RAM is available on your machine? It looks like you're selecting from a view... Have you tried paging through the view outside of Solr? Does that slow down

Solr indexing slows down

2013-06-06 Thread Sebastian Steinfeld
Hi, I am new to solr and we want to use Solr to speed up our product search. And it is working really nice, but I think I have a problem with the indexing. It slows down after a few minutes. I am using the DataImportHandler to import the products from the database. And I start the import by

Re: Solr indexing slows down

2013-06-06 Thread Michael Della Bitta
Hi Sebastian, What database are you using? How much RAM is available on your machine? It looks like you're selecting from a view... Have you tried paging through the view outside of Solr? Does that slow down as well? Do you notice any increased load on the Solr box or the database server?

Re: Solr indexing slows down

2013-06-06 Thread Shawn Heisey
On 6/6/2013 4:13 AM, Sebastian Steinfeld wrote: The amout of documents I want to index is 8 million, the first 1,6 million are indexed in 2min, but to complete the Import it takes nearly 2 hours. The size of the index on the hard drive is 610MB. I started the solr server with 2GB memory. I

Re: solr indexing slows down after few minutes

2012-09-06 Thread amit
threads? Also try experimenting with various available MergePolicies introduced from SOLR 3.4 onwards Thanx Pravesh -- If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/solr-indexing-slows-down-after

solr indexing slows down after few minutes

2012-08-30 Thread amit
am using a win 7 machine dual core and 4 GB ram. Thanks Amit -- View this message in context: http://lucene.472066.n3.nabble.com/solr-indexing-slows-down-after-few-minutes-tp4004337.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: solr indexing slows down after few minutes

2012-08-30 Thread pravesh
Pravesh -- View this message in context: http://lucene.472066.n3.nabble.com/solr-indexing-slows-down-after-few-minutes-tp4004337p4004421.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Indexing slows down

2010-08-02 Thread Peter Karich
:03 PM Subject: Re: Solr Indexing slows down Hi Otis, does it mean that a new searcher is opened after I commit? I thought only on startup...(?) Regards, Peter. Peter, there are events in solrconfig where you define warm up queries when a new searcher

Re: Solr Indexing slows down

2010-07-30 Thread Erick Erickson
See the subject about 1500 threads. The first place I'd look is how often you're committing. If you're committing before the warmup queries from the previous commit have done their magic, you might be getting into a death spiral. HTH Erick On Thu, Jul 29, 2010 at 7:02 AM, Peter Karich

Re: Solr Indexing slows down

2010-07-30 Thread Peter Karich
Hi Erick! thanks for the response! I will answer your questions ;-) How often are you making changes to your index? Every 30-60 seconds. Too heavy? Do you have autocommit on? No. Do you commit when updating each document? No. I commit after a batch update of 200 documents Committing

Re: Solr Indexing slows down

2010-07-30 Thread Otis Gospodnetic
:: http://search-lucene.com/ - Original Message From: Peter Karich peat...@yahoo.de To: solr-user@lucene.apache.org Sent: Fri, July 30, 2010 4:06:48 PM Subject: Re: Solr Indexing slows down Hi Erick! thanks for the response! I will answer your questions ;-) How often are you

Re: Solr Indexing slows down

2010-07-30 Thread Peter Karich
Subject: Re: Solr Indexing slows down Hi Erick! thanks for the response! I will answer your questions ;-) How often are you making changes to your index? Every 30-60 seconds. Too heavy? Do you have autocommit on? No. Do you commit when updating each

Re: Solr Indexing slows down

2010-07-30 Thread Otis Gospodnetic
:: http://search-lucene.com/ - Original Message From: Peter Karich peat...@yahoo.de To: solr-user@lucene.apache.org Sent: Fri, July 30, 2010 6:19:03 PM Subject: Re: Solr Indexing slows down Hi Otis, does it mean that a new searcher is opened after I commit? I thought only

Solr Indexing slows down

2010-07-29 Thread Peter Karich
Hi, I am indexing a solr 1.4.0 core and commiting gets slower and slower. Starting from 3-5 seconds for ~200 documents and ending with over 60 seconds after 800 commits. Then, if I reloaded the index, it is as fast as before! And today I have read a similar thread [1] and indeed: if I set