We've seen around a 10-15% decrease in performance on average in a
virtualized environment as a first approximation, which doesn't explain
your results but might give you a place to start.
I'm pretty sure Solr isn't an issue, but my question is how much RAM is
on your underlying hardware? And how
From: "Husain, Yavar"
>To: "solr-user@lucene.apache.org"
>Sent: Thursday, November 10, 2011 3:43 AM
>Subject: Solr Indexing Time
>
>However while using Solr on a VM, with 4 GB RAM it took 50 minutes to index at
>the first time. Note that there is no Networ
Solr 1.4 is doing great with respect to Indexing on a dedicated physical server
(Windows Server 2008). For Indexing around 1 million full text documents
(around 4 GB size) it takes around 20 minutes with Heap Size = 512M - 1G & 4GB
RAM.
However while using Solr on a VM, with 4 GB RAM it took
Solr 1.4 is doing great with respect to Indexing on a dedicated physical server
(Windows Server 2008). For Indexing around 1 million full text documents
(around 4 GB size) it takes around 20 minutes with Heap Size = 512M - 1G & 4GB
RAM.
However while using Solr on a VM, with 4 GB RAM it took 50
16276
...
> so I am doing a delta import of around 500,000 rows at a
> time.
http://wiki.apache.org/solr/DataImportHandlerDeltaQueryViaFullImport
Sent: Sun, 5 June, 2011 10:05:22 AM
Subject: Re: URGENT HELP: Improving Solr indexing time
Hi Rohit,
I am currently working on https://issues.apache.org/jira/browse/SOLR-2233
which fixes multithreading issues
How complex is your dataimport schema? SOLR-2233 (multithreading, better
connectio
er
>now. Are there any more tweeking i can do?
>
>Also, planning to move to master-salve model, but am failing to
>understand where
>to start exactly.
>
>Regards,
>Rohit
>
>
>
>
>From: lee carroll
>To: solr-user@lucene.apach
t: Re: URGENT HELP: Improving Solr indexing time
Rohit - you have double posted maybe - did Otis's answer not help with
your issue or at least need a response to clarify ?
On 4 June 2011 22:53, Chris Cowan wrote:
> How long does the query against the DB take (outside of Solr)? If that&
Rohit - you have double posted maybe - did Otis's answer not help with
your issue or at least need a response to clarify ?
On 4 June 2011 22:53, Chris Cowan wrote:
> How long does the query against the DB take (outside of Solr)? If that's slow
> then it's going to take a while to update the inde
How long does the query against the DB take (outside of Solr)? If that's slow
then it's going to take a while to update the index. You might need to figure a
way to break things up a bit, maybe use a delta import instead of a full import.
Chris
On Jun 4, 2011, at 6:23 AM, Rohit Gupta wrote:
>
My Solr server takes very long to update index. The table it hits to index is
huge with 10Million + records , but even in that case I feel this is very long
time to index. Below is the snapshot of the /dataimport page
busy
A command is still running...
1:53:39.664
16276
24237
16273
0
2011-06-04
11 matches
Mail list logo
