Well, I read all of those links and none gave me the answer I was looking for :) MMap is slower than FSDirectory, and just that issue makes me avoid it.
Regarding the windows problem, I think I found the answer. On http://www.microsoft.com/whdc/system/platform/server/PAE/PAEmem.mspx it says: "The virtual address space of processes and applications is still limited to 2 GB unless the */3GB* switch is used in the Boot.ini file" Then there are these links: http://dev2dev.bea.com/blog/hstahl/archive/2005/12/how_to_get_almo.html http://www.unixville.com/~moazam/2004/06/03.html The latter says: "It is a known fact that 32bit architectures limit the amount of memory any single process can allocate to 4GB. So why does the JVM limit the maximum heap size (-Xmx) to *under* 2GB? When you try to run your JVM with a -Xmx2gb flag, you'll get the following error: * Error occurred during initialization of VM Could not reserve enough space for object heap * This is a limitation of the Windows 32bit OS. 32bit processes can only use a max of 4GB memory address space. Windows further splits that into half by allocating 2GB to the kernel and 2GB to the application." Which is exactly what happens to me. So, I'm really at a dead-end :) I've tried that /3GB stuff but it was to no use. However, despite being able to pass a large java -Xmxvalue in the command line, trying to do just a lucene.initVM(lucene.CLASSPATH, maxheap='1800m') fails. 1500 fails as well and the only improvement is that I can now set it to 1g. I'm gonna try my script at a windows server 4GB RAM machine and if it fails, I'll just have to rethink my strategy. Best regards!
_______________________________________________ pylucene-dev mailing list [email protected] http://lists.osafoundation.org/mailman/listinfo/pylucene-dev
