[R] gc() and memory efficiency

2008-02-04 Thread Doran, Harold
I have a program which reads in a very large data set, performs some analyses, and then repeats this process with another data set. As soon as the first set of analyses are complete, I remove the very large object and clean up to try and make memory available in order to run the second set of

Re: [R] gc() and memory efficiency

2008-02-04 Thread Dirk Eddelbuettel
On 4 February 2008 at 20:45, Doran, Harold wrote: | I have a program which reads in a very large data set, performs some analyses, and then repeats this process with another data set. As soon as the first set of analyses are complete, I remove the very large object and clean up to try and make

Re: [R] gc() and memory efficiency

2008-02-04 Thread Prof Brian Ripley
1) See ?Memory-limits: it is almost certainly memory fragmentation. You don't need to give the memory back to the OS (and few OSes actually do so). 2) I've never seen this running a 64-bit version of R. 3) You can easily write a script to do this. Indeed, you could write an R script to run