Re: [R] Advantages of using SQLite for data import in comparison to csv files

2010-01-15 Thread Juliet Jacobson
Thanks for your answer. I've thought of the possibility of an index when using a SQLite database, but as you mentioned, I don't really benefit from it in regard of rather small data sets. What I am considering as a problem when using csv files is the occurrence of data redundancy: When I wan't

Re: [R] Advantages of using SQLite for data import in comparison to csv files

2010-01-15 Thread Matthew Dowle
Just to comment on this bit : For one thing, you cannot index a csv file or a data.frame. If you have to repeatedly select subsets of your large data set, creating an index on the relevant column in the sqlite table is an absolute life saver. This is one reason the data.table package was

Re: [R] Advantages of using SQLite for data import in comparison to csv files

2010-01-14 Thread Gabor Grothendieck
sqldf is layered on top of RSQLite. Its not a separate facility. On Thu, Jan 14, 2010 at 2:12 AM, Juliet Jacobson julietjacob...@aim.com wrote: Thanks for your answer. I hadn't found this possibility by web search. Since sqldf also allows the import of tables from csv files, complex SELECT

Re: [R] Advantages of using SQLite for data import in comparison to csv files

2010-01-14 Thread Magnus Torfason
RSQLite is actually much more than a driver for data import. It basically allows any manipulation of SQLite databases, including reading, writing, or updating and munging data within the database. Regarding the original question of data import: I use csv and sqlite files interchangeably to

[R] Advantages of using SQLite for data import in comparison to csv files

2010-01-13 Thread Juliet Jacobson
Hello everybody out there using R, I'm using R for the analysis of biological data and write the results down using LaTeX, both on a notebook with linux installed. I've already tried two options for the import of my data: 1. Import from a SQLite database 2. Import from individual csv files edited

Re: [R] Advantages of using SQLite for data import in comparison to csv files

2010-01-13 Thread Gabor Grothendieck
You could look at read.csv.sql in sqldf (http://sqldf.googlecode.com) as well. On Wed, Jan 13, 2010 at 2:00 PM, Juliet Jacobson julietjacob...@aim.com wrote: Hello everybody out there using R, I'm using R for the analysis of biological data and write the results down using LaTeX, both on a

Re: [R] Advantages of using SQLite for data import in comparison to csv files

2010-01-13 Thread Juliet Jacobson
Thanks for your answer. I hadn't found this possibility by web search. Since sqldf also allows the import of tables from csv files, complex SELECT queries and even joins on tables, I have the impression that there aren't any reasons for using a SQLite database to organise the data for R. But then