Hi,
I have two further comments/questions about large datasets in R.
1. Does R's ability to handle large datasets depend on the operating
system's use of virtual memory? In theory, at least, VM should make the
difference between installed RAM and virtual memory on a hard drive
primarily a
In my experience, the OS's use of virtual memory is only relevant in the rough
sense that the OS can store *other* running applications in virtual memory so
that R can use as much of the physical memory as possible. Once R itself
overflows into virtual memory it quickly becomes unusable.
I'm
On Tue, 18 Jul 2006, Marshall Feldman wrote:
Hi,
I have two further comments/questions about large datasets in R.
1. Does R's ability to handle large datasets depend on the operating
system's use of virtual memory? In theory, at least, VM should make the
difference between installed RAM
Hi,
I have a related question. How differently do other statistical
softwares handle large data?
The original post claims that 350 MB is fine on Stata. Some one
suggested S-Plus. I have heard people say that SAS can handle large
data sets. Why can others do it and R seem to have a problem? Don't
S-Plus stores objects as files whereas R stores them in memory.
SAS was developed many years ago when optimizing computer
resources was more important than it is now.
On 7/18/06, Ritwik Sinha [EMAIL PROTECTED] wrote:
Hi,
I have a related question. How differently do other statistical
On Tue, 18 Jul 2006, Ritwik Sinha wrote:
Hi,
I have a related question. How differently do other statistical
softwares handle large data?
The original post claims that 350 MB is fine on Stata. Some one
suggested S-Plus. I have heard people say that SAS can handle large
data sets. Why can
]
Sent: Tuesday, July 18, 2006 10:54 AM
To: Prof Brian Ripley
Cc: Marshall Feldman; r-help@stat.math.ethz.ch
Subject: Re: [R] FW: Large datasets in R
Hi,
I have a related question. How differently do other statistical
softwares handle large data?
The original post claims that 350 MB is fine on Stata
[Thomas Lumley]
People have used R in this way, storing data in a database and reading it
as required. There are also some efforts to provide facilities to support
this sort of programming (such as the current project funded by Google
Summer of Code:
Of François Pinard
Sent: Tuesday, July 18, 2006 3:56 PM
To: Thomas Lumley
Cc: r-help@stat.math.ethz.ch
Subject: Re: [R] FW: Large datasets in R
[Thomas Lumley]
People have used R in this way, storing data in a database
and reading it
as required. There are also some efforts to provide
