[R] how many records can R handle

2011-01-24 Thread Richard White
How many records can the R recursive partitioning software handle? We are analyzing 5,000,000 medical records looking at 100 risk factors for the outcome of interest Richard H. White, MD Hibbard E. Williams Endowed Professor of Medicine Chief, Division of General Medicine DIrector,

Re: [R] how many records can R handle

2011-01-24 Thread jim holtman
Exactly what do you want to do with the data? It is 5M rows with 100 columns of data? Do you want to read it all in at once? If so, and if they are numeric, you will need 4GB to hold one copy, and be running on a 64-bit version of R. If you want to do any processing with everything in memory,