Re: [R] How to Read a Large CSV into a Database with R

2010-11-16 Thread Seth Falcon
Hi Abhijit, [I've cc'd R-help to keep the discussion on the list] On Tue, Nov 16, 2010 at 8:06 AM, Abhijit Dasgupta adasgu...@araastat.com wrote: Seth, I was looking for something like this too. I've a question. If you're reading the data from a connection, does R start reading the next

Re: [R] How to Read a Large CSV into a Database with R

2010-11-16 Thread Abhijit Dasgupta
Thanks On 11/16/2010 12:41 PM, Seth Falcon wrote: Hi Abhijit, [I've cc'd R-help to keep the discussion on the list] On Tue, Nov 16, 2010 at 8:06 AM, Abhijit Dasgupta adasgu...@araastat.com wrote: Seth, I was looking for something like this too. I've a question. If you're reading

[R] How to Read a Large CSV into a Database with R

2010-11-15 Thread Anthony Damico
Hi, I'm working in R 2.11.1 x64 on Windows x86_64-pc-mingw32. I'm trying to insert a very large CSV file into a SQLite database. I'm pretty new to working with databases in R, so I apologize if I'm overlooking something obvious here. I'm trying to work with the American Community Survey data,

Re: [R] How to Read a Large CSV into a Database with R

2010-11-15 Thread Dieter Menne
Anthony-107 wrote: Hi, I'm working in R 2.11.1 x64 on Windows x86_64-pc-mingw32. I'm trying to insert a very large CSV file into a SQLite database. Better use an external utility if this is a one-time import for this job: http://sqlitebrowser.sourceforge.net/ Dieter -- View this

Re: [R] How to Read a Large CSV into a Database with R

2010-11-15 Thread Gabor Grothendieck
On Mon, Nov 15, 2010 at 10:07 AM, Anthony Damico ajdam...@gmail.com wrote: Hi, I'm working in R 2.11.1 x64 on Windows x86_64-pc-mingw32.  I'm trying to insert a very large CSV file into a SQLite database.  I'm pretty new to working with databases in R, so I apologize if I'm overlooking

Re: [R] How to Read a Large CSV into a Database with R

2010-11-15 Thread Anthony Damico
Hi Gabor, Thank you for the prompt reply. I definitely looked over all of the examples on the code.google.com sqldf page before sending, which is why I wrote the code read.csv.sql(ss09pusa.csv , sql=create table ss09pusa as select * from file , dbname=sqlite) directly pulled from their code --

Re: [R] How to Read a Large CSV into a Database with R

2010-11-15 Thread Gabor Grothendieck
On Mon, Nov 15, 2010 at 11:46 AM, Anthony Damico ajdam...@gmail.com wrote: Hi Gabor, Thank you for the prompt reply.  I definitely looked over all of the examples on the code.google.com sqldf page before sending, which is why I wrote the code read.csv.sql(ss09pusa.csv , sql=create table

Re: [R] How to Read a Large CSV into a Database with R

2010-11-15 Thread Anthony Damico
Hi Gabor, Thank you for your willingness to help me through this. The code you sent works on my machine exactly the same way as it does on yours. Unfortunately, when I run the same code on the 1.3GB file, it creates the table structure but doesn't read in a single line [confirmed with

Re: [R] How to Read a Large CSV into a Database with R

2010-11-15 Thread Mike Marchywka
From: ajdam...@gmail.com Date: Mon, 15 Nov 2010 13:28:40 -0500 To: ggrothendi...@gmail.com; r-help@r-project.org Subject: Re: [R] How to Read a Large CSV into a Database with R Hi Gabor, Thank you for your willingness to help me through

Re: [R] How to Read a Large CSV into a Database with R

2010-11-15 Thread Lee Hachadoorian
On Mon, 15 Nov 2010 13:28:40 -0500, Anthony Damico wrote: Do you have any other ideas as to how I might diagnose what's going on here? Or, alternatively, is there some workaround that would get this giant CSV into a database? If you think there's a reasonable way to use the IMPORT command

Re: [R] How to Read a Large CSV into a Database with R

2010-11-15 Thread Gabor Grothendieck
On Mon, Nov 15, 2010 at 1:28 PM, Anthony Damico ajdam...@gmail.com wrote: Hi Gabor, Thank you for your willingness to help me through this.  The code you sent works on my machine exactly the same way as it does on yours. Unfortunately, when I run the same code on the 1.3GB file, it creates

Re: [R] How to Read a Large CSV into a Database with R

2010-11-15 Thread Seth Falcon
Hi Anthony, On Mon, Nov 15, 2010 at 7:07 AM, Anthony Damico ajdam...@gmail.com wrote: Hi, I'm working in R 2.11.1 x64 on Windows x86_64-pc-mingw32.  I'm trying to insert a very large CSV file into a SQLite database.  I'm pretty new to working with databases in R, so I apologize if I'm