Re: [R] best option for big 3D arrays?

2012-02-27 Thread Djordje Bajic
Steven, sorry for the delay in responding, I have been investigating this also and here is the way I do it (though probably not the best way): # .. define a 3D array ngen = 904 gratios - ff(NA, dim=rep(ngen,3), vmode=double) # .. fill the array with standard R functions ffsave (gratios,

Re: [R] best option for big 3D arrays?

2012-02-27 Thread steven mosher
Thanks, That helped. Maybe when I get a chance I will do some blog posts on the basics of ff I think some tutorials would be a good idea Steve On Mon, Feb 27, 2012 at 3:47 AM, Djordje Bajic je.li@gmail.com wrote: Steven, sorry for the delay in responding, I have been investigating

Re: [R] best option for big 3D arrays?

2012-02-23 Thread steven mosher
Did you have to use a particular filename? or extension. I created a similar file but then could not read it back in Steve On Mon, Feb 13, 2012 at 6:45 AM, Djordje Bajic je.li@gmail.com wrote: I've been investigating and I partially respond myself. I tried the packages 'bigmemory' and

Re: [R] best option for big 3D arrays?

2012-02-13 Thread Djordje Bajic
I've been investigating and I partially respond myself. I tried the packages 'bigmemory' and 'ff' and for me the latter did the work I need pretty straightforward. I create the array in filebacked form with the function ff, and it seems that the usual R indexing works well. I have yet to see the

Re: [R] best option for big 3D arrays?

2012-02-11 Thread Duncan Murdoch
On 12-02-10 9:12 AM, Djordje Bajic wrote: Hi all, I am trying to fill a 904x904x904 array, but at some point of the loop R states that the 5.5Gb sized vector is too big to allocate. I have looked at packages such as bigmemory, but I need help to decide which is the best way to store such an

[R] best option for big 3D arrays?

2012-02-10 Thread Djordje Bajic
Hi all, I am trying to fill a 904x904x904 array, but at some point of the loop R states that the 5.5Gb sized vector is too big to allocate. I have looked at packages such as bigmemory, but I need help to decide which is the best way to store such an object. It would be perfect to store it in this