errors.
Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
- Original Message
From: vivek sar vivex...@gmail.com
To: solr-user@lucene.apache.org
Sent: Wednesday, April 15, 2009 7:28:57 PM
Subject: Re: Question on StreamingUpdateSolrServer
Thanks Otis.
I did
On Wed, Apr 15, 2009 at 7:28 PM, vivek sar vivex...@gmail.com wrote:
lsof at
this point usually shows at 1400, but my ulimit is much higher than
that.
Could you be hitting a kernel limit?
cat /proc/sys/fs/file-max
cat /proc/sys/fs/file-nr
http://www.netadmintools.com/art295.html
-Yonik
Message
From: vivek sar vivex...@gmail.com
To: solr-user@lucene.apache.org
Sent: Tuesday, April 14, 2009 3:12:41 AM
Subject: Re: Question on StreamingUpdateSolrServer
The machine's ulimit is set to 9000 and the OS has upper limit of
12000 on files. What would explain this? Has anyone tried
...@gmail.com
To: solr-user@lucene.apache.org
Sent: Friday, April 10, 2009 5:59:37 PM
Subject: Re: Question on StreamingUpdateSolrServer
I also noticed that the Solr app has over 6000 file handles open -
lsof | grep solr | wc -l - shows 6455
I've 10 cores (using multi-core) managed
.
Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
- Original Message
From: vivek sar vivex...@gmail.com
To: solr-user@lucene.apache.org
Sent: Friday, April 10, 2009 5:59:37 PM
Subject: Re: Question on StreamingUpdateSolrServer
I also noticed that the Solr app has
The machine's ulimit is set to 9000 and the OS has upper limit of
12000 on files. What would explain this? Has anyone tried Solr with 25
cores on the same Solr instance?
Thanks,
-vivek
2009/4/13 Noble Paul നോബിള് नोब्ळ् noble.p...@gmail.com:
On Tue, Apr 14, 2009 at 7:14 AM, vivek sar
I index in 10K batches and commit after 5 index cyles (after 50K). Is
there any limitation that I can't search during commit or
auto-warming? I got 8 CPU cores and only 2 were showing busy (using
top) - so it's unlikely that the CPU was pegged.
2009/4/12 Noble Paul നോബിള് नोब्ळ्
On Mon, Apr 13, 2009 at 12:36 PM, vivek sar vivex...@gmail.com wrote:
I index in 10K batches and commit after 5 index cyles (after 50K). Is
there any limitation that I can't search during commit or
auto-warming? I got 8 CPU cores and only 2 were showing busy (using
top) - so it's unlikely
Here is some more information about my setup,
Solr - v1.4 (nightly build 03/29/09)
Servlet Container - Tomcat 6.0.18
JVM - 1.6.0 (64 bit)
OS - Mac OS X Server 10.5.6
Hardware Overview:
Processor Name: Quad-Core Intel Xeon
Processor Speed: 3 GHz
Number Of Processors: 2
Total Number Of Cores: 8
Some more update. As I mentioned earlier we are using multi-core Solr
(up to 65 cores in one Solr instance with each core 10G). This was
opening around 3000 file descriptors (lsof). I removed some cores and
after some trial and error I found at 25 cores system seems to work
fine (around 1400 file
On Tue, Apr 14, 2009 at 7:14 AM, vivek sar vivex...@gmail.com wrote:
Some more update. As I mentioned earlier we are using multi-core Solr
(up to 65 cores in one Solr instance with each core 10G). This was
opening around 3000 file descriptors (lsof). I removed some cores and
after some trial
Thanks Shalin.
I noticed couple more things. As I index around 100 million records a
day, my Indexer is running pretty much at all times throughout the
day. Whenever I run a search query I usually get connection reset
when the commit is happening and get blank page when the
auto-warming of
If you use StreamingUpdateSolrServer it POSTs all the docs in a single
request. 10 million docs may be a bit too much for a single request. I
guess you should batch it in multiple requests of smaller chunks,
It is likely that the CPU is really hot when the autowarming is hapening.
getting a
On Sat, Apr 11, 2009 at 3:29 AM, vivek sar vivex...@gmail.com wrote:
I also noticed that the Solr app has over 6000 file handles open -
lsof | grep solr | wc -l - shows 6455
I've 10 cores (using multi-core) managed by the same Solr instance. As
soon as start up the Tomcat the open file
Thanks Shalin.
The problem is I don't see any error message in the catalina.out. I
don't even see the request coming in - I simply get blank page on
browser. If I keep trying the request goes through and I get respond
from Solr, but then it become unresponsive again or sometimes throws
connection
On Sun, Apr 12, 2009 at 2:15 AM, vivek sar vivex...@gmail.com wrote:
The problem is I don't see any error message in the catalina.out. I
don't even see the request coming in - I simply get blank page on
browser. If I keep trying the request goes through and I get respond
from Solr, but then
Hi,
I was using CommonsHttpSolrServer for indexing, but having two
threads writing (10K batches) at the same time was throwing,
ProtocolException: Unbuffered entity enclosing request can not be repeated.
I switched to StreamingUpdateSolrServer (using addBeans) and I don't
see the problem
I also noticed that the Solr app has over 6000 file handles open -
lsof | grep solr | wc -l - shows 6455
I've 10 cores (using multi-core) managed by the same Solr instance. As
soon as start up the Tomcat the open file count goes up to 6400. Few
questions,
1) Why is Solr holding on to all
18 matches
Mail list logo
