Hi Yizhuang,
By coincidence I am just writing up some recent improvements to Jalview's memory usage (in Jalview 2.10.1). However these were for the alignment consensus calculation, not the PCA calculation. If you are able to share your data (by private email) I could investigate whether there is scope for any improvements to Jalview that could help. I can't promise there will be, or if so how soon! At some point large enough data sets will exceed the available memory for the JVM. I'll also see if my colleagues have any suggestions for you to compute PCA, perhaps with alternative tools. Regards, Mungo Mungo Carstairs Jalview Computational Scientist The Barton Group Division of Computational Biology School of Life Sciences University of Dundee, Dundee, Scotland, UK. www.jalview.org<http://www.jalview.org/> www.compbio.dundee.ac.uk<http://www.compbio.dundee.ac.uk/> ________________________________ From: Yizhuang Zhou <[email protected]> Sent: 06 January 2017 09:43:26 To: Mungo Carstairs (Staff); jalview-discuss Subject: Re: Re: [Jalview-discuss] out of memory Thanks, Mungo. Yes, I can successfully perform PCA for some small data when I changed it accourding to your suggestion. But I faced the same problem for larger data. It still did not work even when I set them to 5000m or 8000m. So is 1000m upper limit? If yes, how can I perform PCA for my large data? Thanks in advance! Best wishes, Yizhuang Zhou 2017-01-06 ________________________________ Yizhuang Zhou ________________________________ ???: Mungo Carstairs (Staff) ????: 2017-01-06 16:40:09 ???: Yizhuang Zhou; jalview-discuss ??: ??: Re: [Jalview-discuss] out of memory Hi Yizhuang, I think your default setting of max=268400000 is about 260MB, so less than the suggested 1000m. Can you try commenting out the original defaults thus: ##lax.nl.java.option.java.heap.size.initial=33554432 ##lax.nl.java.option.java.heap.size.max=268400000 and including the suggested lax.nl.java.option.java.heap.size.max=1000m lax.nl.java.option.java.heap.size.initial=500m and let us know if this helps. Thanks, Mungo Mungo Carstairs Jalview Computational Scientist The Barton Group Division of Computational Biology School of Life Sciences University of Dundee, Dundee, Scotland, UK. www.jalview.org<http://www.jalview.org/> www.compbio.dundee.ac.uk<http://www.compbio.dundee.ac.uk/> ________________________________ From: [email protected] <[email protected]> on behalf of Yizhuang Zhou <[email protected]> Sent: 06 January 2017 07:20:58 To: jalview-discuss Subject: [Jalview-discuss] out of memory Hi, I used Jalview to perform principle component analysis, but it said "Out of memory when calculating PCA!! See help files for increasing Java Virtual Machine memory". Then I see help files (http://www.jalview.org/jvmmemoryparams.html). It told me to add two lines into Jalview.lax: lax.nl.java.option.java.heap.size.max=1000m lax.nl.java.option.java.heap.size.initial=500m When I opened the file Jalview.lax. I found that there were already two lines which showed: lax.nl.java.option.java.heap.size.initial=33554432 lax.nl.java.option.java.heap.size.max=268400000 So my question is whether we should add two lines to the end of this file? The default memory is larger than your suggested memory, if we change or add these two lines, can we fix this probelm? Even we added these two lines, the problem was not fixed, it still said "Out of memory when calcu lating PCA!! See help files for increasing Java Virtual Machine memory".So what is the problem and how to fix it? Thanks in advance! Best wishes! Yizhuang Zhou 2017-01-06 ________________________________ Yizhuang Zhou The University of Dundee is a registered Scottish Charity, No: SC015096 The University of Dundee is a registered Scottish Charity, No: SC015096
_______________________________________________ Jalview-discuss mailing list [email protected] http://www.compbio.dundee.ac.uk/mailman/listinfo/jalview-discuss
