RE: How to setup SimpleFSDirectoryFactory

2012-07-23 Thread Uwe Schindler
to setup SimpleFSDirectoryFactory Hu Uwe, Thanks Wwe, Have you checked the Bug in JRE for mmapDirectory?. I was mentioning this, This is posted in Oracle site, and the API doc. They accept this as a bug, have you seen this?. MMapDirectoryhttp://lucene.apache.org/java/3_0_2/api/core/org

Re: How to setup SimpleFSDirectoryFactory

2012-07-23 Thread geetha anjali
...@thetaphi.de -Original Message- From: geetha anjali [mailto:anjaliprabh...@gmail.com] Sent: Monday, July 23, 2012 4:28 AM Subject: Re: How to setup SimpleFSDirectoryFactory Hu Uwe, Thanks Wwe, Have you checked the Bug in JRE for mmapDirectory?. I was mentioning this, This is posted

Re: RE: How to setup SimpleFSDirectoryFactory

2012-07-22 Thread geetha anjali
It happens in 3.6, for this reasons I thought of moving to solandra. If I do a commit, the all documents are persisted with out any issues. There is no issues in terms of any functionality, but only this happens is increase in physical RAM, goes higher and higher and stop at maximum and it never

RE: RE: How to setup SimpleFSDirectoryFactory

2012-07-22 Thread Uwe Schindler
Hi, It seems that both of you simply don't understand what's happening in your operating system kernel. Please read the blog post again! It happens in 3.6, for this reasons I thought of moving to solandra. If I do a commit, the all documents are persisted with out any issues. There is no

Re: How to setup SimpleFSDirectoryFactory

2012-07-22 Thread Bill Bell
I get a similar situation using Windows 2008 and Solr 3.6. Memory using mmap is never released. Even if I turn off traffic and commit and do a manual gc. If the size of the index is 3gb then memory used will be heap + 3gb of shared used. If I use a 6gb index I get heap + 6gb. If I turn off

RE: How to setup SimpleFSDirectoryFactory

2012-07-22 Thread Uwe Schindler
It is hopeless to talk to both of you, you don't understand virtual memory: I get a similar situation using Windows 2008 and Solr 3.6. Memory using mmap=is never released. Even if I turn off traffic and commit and do a manual gc= If the size of the index is 3gb then memory used will be heap +

Re: How to setup SimpleFSDirectoryFactory

2012-07-22 Thread geetha anjali
Hu Uwe, Thanks Wwe, Have you checked the Bug in JRE for mmapDirectory?. I was mentioning this, This is posted in Oracle site, and the API doc. They accept this as a bug, have you seen this?. “MMapDirectoryhttp://lucene.apache.org/java/3_0_2/api/core/org/apache/lucene/store/MMapDirectory.htmluses

Re: RE: How to setup SimpleFSDirectoryFactory

2012-07-21 Thread geetha anjali
Hi uwe, Great to know. We have files indexing 1/min. After 30 mins I see all my physical memory say its 100 percentage used(windows). On deep investigation found that mmap is not releasing os files handles. Do you find this behaviour? Thanks On 20 Jul 2012 14:04, Uwe Schindler

Re: RE: How to setup SimpleFSDirectoryFactory

2012-07-21 Thread Lance Norskog
Interesting. Which version of Solr is this? What happens if you do a commit? On Sat, Jul 21, 2012 at 8:01 AM, geetha anjali anjaliprabh...@gmail.com wrote: Hi uwe, Great to know. We have files indexing 1/min. After 30 mins I see all my physical memory say its 100 percentage used(windows).

RE: How to setup SimpleFSDirectoryFactory

2012-07-20 Thread Uwe Schindler
[mailto:billnb...@gmail.com] Sent: Friday, July 20, 2012 5:17 AM Subject: Re: How to setup SimpleFSDirectoryFactory Thanks. Are you saying that if we run low on memory, the MMapDirectory will s=op using it? The least used memory will be removed from the OS automaticall=? Isee some paging

RE: How to setup SimpleFSDirectoryFactory

2012-07-19 Thread Uwe Schindler
-Original Message- From: William Bell [mailto:billnb...@gmail.com] Sent: Tuesday, July 17, 2012 6:05 AM Subject: How to setup SimpleFSDirectoryFactory We all know that MMapDirectory is fastest. However we cannot always use it since you might run out of memory on large indexes right? Here

Re: How to setup SimpleFSDirectoryFactory

2012-07-19 Thread Bill Bell
, July 17, 2012 6:05 AM Subject: How to setup SimpleFSDirectoryFactory We all know that MMapDirectory is fastest. However we cannot always use it since you might run out of memory on large indexes right? Here is how I got iSimpleFSDirectoryFactory to work. Just set - Dsolr.directoryFactory

How to setup SimpleFSDirectoryFactory

2012-07-16 Thread William Bell
We all know that MMapDirectory is fastest. However we cannot always use it since you might run out of memory on large indexes right? Here is how I got iSimpleFSDirectoryFactory to work. Just set -Dsolr.directoryFactory=solr.SimpleFSDirectoryFactory. Your solrconfig.xml: directoryFactory