On Thu, 5 May 2005, Christoph Lehmann wrote:
importing huge datasets in a data.frame with e.g. a subsequent step of conversion of some columns into factors may lead into memory troubles (probably due to memory overhead when building out factors). But we currentlyI heard that 'R' does not do a very good job at handling large datasets, is this true?
Note that R's scan() does this very much more efficiently. It is not fair to R to generalize from the method of a contributed package.
succeeded in importing 12 millions of data records stored in a MySQL database, using RMySQL package.
-- Brian D. Ripley, [EMAIL PROTECTED] Professor of Applied Statistics, http://www.stats.ox.ac.uk/~ripley/ University of Oxford, Tel: +44 1865 272861 (self) 1 South Parks Road, +44 1865 272866 (PA) Oxford OX1 3TG, UK Fax: +44 1865 272595
______________________________________________ R-help@stat.math.ethz.ch mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html
