Re: [R] Faster Printing Alternatives to 'cat'

Dear Jim and all, Allow me to ask your expert opinion. Using the data (16Mb) downloadable from here: http://drop.io/gundalav/asset/test-data-zip It took this long under 1994.070Mhz Cpu Linux, using write.table proc.time() - ptm1 usersystem elapsed 16581.833 5787.228 21386.064

Re: [R] Faster Printing Alternatives to 'cat'

On Sat, Jan 17, 2009 at 7:59 AM, gundalav gunda...@gmail.com wrote: Dear Jim and all, Allow me to ask your expert opinion. Using the data (16Mb) downloadable from here: http://drop.io/gundalav/asset/test-data-zip It took this long under 1994.070Mhz Cpu Linux, using write.table

Re: [R] Faster Printing Alternatives to 'cat'

Hi Hadley, I had to do it by line. Because, in practice, I will manipulate the figures and string before printing it. And I can't bind these results into one new object, because there are literally millions of this lines, and R object can't handle that in my 4GB Ram memory. I tried your

Re: [R] Faster Printing Alternatives to 'cat'

Do it in chunks of rows. /H On Sat, Jan 17, 2009 at 6:55 AM, Gundala Viswanath gunda...@gmail.com wrote: Hi Hadley, I had to do it by line. Because, in practice, I will manipulate the figures and string before printing it. And I can't bind these results into one new object, because there

Re: [R] Faster Printing Alternatives to 'cat'

How do you do that Henrik? Write.table doesn't have that option. Usage: write.table(x, file = , append = FALSE, quote = TRUE, sep = , eol = \n, na = NA, dec = ., row.names = TRUE, col.names = TRUE, qmethod = c(escape, double)) - Gundala Viswanath Jakarta

Re: [R] Faster Printing Alternatives to 'cat'

Hint: You already know how to write all rows at once and row by row - now write a set of rows each time. /H On Sat, Jan 17, 2009 at 7:21 AM, Gundala Viswanath gunda...@gmail.com wrote: How do you do that Henrik? Write.table doesn't have that option. Usage: write.table(x, file = , append =

[R] Faster Printing Alternatives to 'cat'

Dear all, I found that printing with 'cat' is very slow. For example in my machine this snippet __BEGIN__ # I need to resolve to use this type of loop. # because using write(), I need to create a matrix which # consumes so much memory. Note that foo, bar, qux object # is already very large

Re: [R] Faster Printing Alternatives to 'cat'

On Thu, Jan 8, 2009 at 3:12 AM, Gundala Viswanath gunda...@gmail.com wrote: Dear all, I found that printing with 'cat' is very slow. For example in my machine this snippet __BEGIN__ # I need to resolve to use this type of loop. # because using write(), I need to create a matrix which #

Re: [R] Faster Printing Alternatives to 'cat'

What exactly is the problem you are trying to solve. What is going to be done with the data? Is it going to be read by some other program? How much physical memory do you have on your machine? Is there paging occuring due to the size of the objects? Have you consider creating a structure with

Re: [R] Faster Printing Alternatives to 'cat'

Dear Jim and Henrik, What exactly is the problem you are trying to solve. Is it going to be read by some other program? I simply want to print the data out. Surely, this data will be manipulated (with Excel or other programming languages) by other people suit to their purpose. Typically the

Re: [R] Faster Printing Alternatives to 'cat'

Hi r-help-boun...@r-project.org napsal dne 08.01.2009 14:26:32: Dear Jim and Henrik, What exactly is the problem you are trying to solve. Is it going to be read by some other program? I simply want to print the data out. Surely, this data will be manipulated (with Excel or other

Re: [R] Faster Printing Alternatives to 'cat'

Here is one way of doing it. To write out 1 million rows on my system took 21 seconds. # create some data dataSize - 1e6 foo - runif(dataSize) bar - runif(dataSize) n - 1000 # number of items to write out each time output - file('/output.txt', 'w') # now split the indices into groups of