Is R file IO slow in general or am I missing
something? It takes me 5 minutes to do a load(MYFILE)
where MYFILE is a 27 MB Rdata file. Is there any way
to speed this up?
The one idea I have is having R call a C or Perl
routine, reading the file in that language, converting
the data in to R
Just an idea: Two things that can slow down save()/load() is if you
save() in ASCII format or a compressed binary format. If this is your
case for MYFILE, try to resave in a non-compressed binary format. See
?save for details.
/HB
On 3/1/07, ramzi abboud [EMAIL PROTECTED] wrote:
Is R file IO
A 27MB .RData file is relatively big, in may experience. What do you think is
slow? Maybe it's your computer that is slow?
-roger
ramzi abboud wrote:
Is R file IO slow in general or am I missing
something? It takes me 5 minutes to do a load(MYFILE)
where MYFILE is a 27 MB Rdata file. Is
]
To: r-help@stat.math.ethz.ch
Sent: Thursday, March 1, 2007 12:22:22 PM
Subject: [R] R File IO Slow?
Is R file IO slow in general or am I missing
something? It takes me 5 minutes to do a load(MYFILE)
where MYFILE is a 27 MB Rdata file. Is there any way
to speed this up?
The one idea I have
On Thu, 2007-03-01 at 09:22 -0800, ramzi abboud wrote:
Is R file IO slow in general or am I missing
something? It takes me 5 minutes to do a load(MYFILE)
where MYFILE is a 27 MB Rdata file. Is there any way
to speed this up?
The one idea I have is having R call a C or Perl
routine,
I decided to run an experiment: just reading in a file which is 78MB in binary
format (of ints). It takes less than 30s using a laptop with 512 MB RAM, 2.3
GHz Intel-4 single processor. At that point, I did not notice that Ramzi was
talking about a .RData file.
For huge files, I usually do not
