As said Oliver, I don't think the real issue is have to choose one software: or SQLite or R.
I've used SQLite with data around 10GB under Windows 7 with 4GB of RAM and it worked perfectly. Yes, it size is less than yours but I learned that the use of every GUI was a problem. Since that, I always work simply with sqlite3.exe and other tools such as SCITE to write queries. Cheers. On Thu, May 3, 2012 at 1:29 PM, peter korinis <kori...@earthlink.net> wrote: > I have R but really haven't used it much. I know it's a great stats package > and great for data reduction ... but I want to perform queries against my > 44GB of data, filtering records by a variety of attributes, comparing those > subsets in a variety of ad hoc ways, perhaps summing/counting other fields, > etc. > This is the kind of job excel is good at ... but the data is too bit! > Seems like a database plus a good query GUI or some BI app would work. is R > a good query tool? > > Thanks, > peter > > > -----Original Message----- > From: sqlite-users-boun...@sqlite.org > [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Warren Young > Sent: Thursday, May 03, 2012 9:36 AM > To: General Discussion of SQLite Database > Subject: Re: [sqlite] is SQLite the right tool to analyze a 44GB file > > On 5/1/2012 2:06 PM, peter korinis wrote: > > Is SQLite the wrong tool for this project? > > Probably. > > SQLite is a data storage tool. With enough SQL cleverness, you can turn it > into a data *reduction* tool. But a data analysis tool? No, not without > marrying it to a real programming language. > > Granted, that's what almost everyone does do with SQLite, but if you're > going to learn a programming language, I'd recommend you learn R, a > language > and environment made for the sort of problem you find yourself stuck with. > http://r-project.org/ > > There are several R GUIs out there. I like R Studio best: > http://www.rstudio.org/ > > You'll still find R Studio a sharp shock compared to Excel. And yes, it > will require some programming, and yes, I know you said you aren't a > programmer. But in the rest of the thread, it looks like people have > convinced you to use SQLite from the command line, typing in raw SQL > commands; guess what, that's programming. Not on the level of R code, but > R > isn't far down the same slippery slope. > > It may help you to know that R is most popular in the statistics community, > which of course is populated by statisticians, not programmers. > > R isn't the easiest programming language to pick up, but it's far from the > hardest. It's very similar to JavaScript, though a bit tougher to learn, > mostly due to having accumulated some strange syntax over its 36 years. > (That's counting R's predecessor, S.) > _______________________________________________ > sqlite-users mailing list > sqlite-users@sqlite.org > http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users > > _______________________________________________ > sqlite-users mailing list > sqlite-users@sqlite.org > http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users > -- «But Gwindor answered: 'The doom lies in yourself, not in your name.'» JRR Tolkien _______________________________________________ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
