Re: [Rcpp-devel] Read csv and export object in R

2015-04-21 Thread Dirk Eddelbuettel
On 21 April 2015 at 11:01, ogami musashi wrote: | Benchmarks against fread shows the code i use returns a lighter object | (a simple matrix) and thus processes faster. | | reading 400 16,2Mb files with a 6 cores took 177,949 seconds with the | cpp function and 228.231 seconds with fread. | | N

Re: [Rcpp-devel] Read csv and export object in R

2015-04-21 Thread ogami musashi
Hello Dirk, Got it sorted, the basic problem was that the output matrix's dimensions has to be defined precisely. I had some problems with first line (col names) and first columns (row names). But it works now. Benchmarks against fread shows the code i use returns a lighter object (a simpl

Re: [Rcpp-devel] Read csv and export object in R

2015-04-20 Thread Dirk Eddelbuettel
On 20 April 2015 at 12:01, ogami musashi wrote: | Problem is..i have 400 object of 16,5 Mb each. and it take about 6 hours | to reimport in R! I use the readr package as this is the fastest base | function in R. a) readr != base R b) fread in package data.table is considered the fastest reader

[Rcpp-devel] Read csv and export object in R

2015-04-20 Thread ogami musashi
Hello all, Recently i've been forced to output results from a Wavelet transform to files because storing of objects in R took too much memory. The exported objects are lighter than the objects produced by the Wavelet package in R so i can re-import them in R. Problem is..i have 400 object o