You could also have a look at the LaF package which is written to
handle large text files:
http://cran.r-project.org/web/packages/LaF/index.html
Under the vignettes you'll find a manual.
Note: LaF does not help you to fit 9GB of data in 4GB of memory, but
it could help you reading your
My opinion is that you should be spending your effort on setting up a SQL
engine and importing it there. If you have 32GB of RAM your current direction
might work, but working with sampled data rather than population data seems
pretty typical for statistical analysis.
Hi,
On Thu, Mar 8, 2012 at 1:19 PM, RHelpPlease rrum...@trghcsolutions.com wrote:
Hi there,
I wish to read a 9.6GB .DAT file into R (64-bit R on 64-bit Windows machine)
- to then delete a substantial number of rows then convert to a .csv file.
Upon the first attempt the computer crashed (at
On Thu, Mar 8, 2012 at 6:19 PM, RHelpPlease rrum...@trghcsolutions.com wrote:
Hi there,
I wish to read a 9.6GB .DAT file into R (64-bit R on 64-bit Windows machine)
- to then delete a substantial number of rows then convert to a .csv file.
Upon the first attempt the computer crashed (at some
Hi Jeff Steve,
Thanks for your responses. After seven hours R/machine ran out of memory
(and thus ended). Currently the machine has 4GB RAM. I'm looking to
install more RAM tomorrow.
I will look into SQLLite3; thanks!
I've read that SQL would be a great program for data of this size
Hi,
On Thu, Mar 8, 2012 at 6:45 PM, RHelpPlease rrum...@trghcsolutions.com wrote:
Hi Jeff Steve,
Thanks for your responses. After seven hours R/machine ran out of memory
(and thus ended). Currently the machine has 4GB RAM. I'm looking to
install more RAM tomorrow.
You can't load a 9.6GB
Hi Barry,
You could do a similar thing in R by opening a text connection to
your file and reading one line at a time, writing the modified or
selected lines to a new file.
Great! I'm aware of this existing, but don't know the commands for R. I
have a variable [560,1] to use to pare down the
Hi Sarah,
Thanks for the SQL info! I'll look into these straightaway, along with the
notion of opening a text connection.
Thanks again!
--
View this message in context:
http://r.789695.n4.nabble.com/Reading-in-9-6GB-DAT-File-OK-with-64-bit-R-tp4457220p4458083.html
Sent from the R help
On Thu, Mar 8, 2012 at 1:19 PM, RHelpPlease rrum...@trghcsolutions.com wrote:
Hi there,
I wish to read a 9.6GB .DAT file into R (64-bit R on 64-bit Windows machine)
- to then delete a substantial number of rows then convert to a .csv file.
Upon the first attempt the computer crashed (at some
9 matches
Mail list logo
