[CODE4LIB] ProQuest publication agreement update for Vireo

2015-08-06 Thread Larrison, Stephanie A
Hello Code4Lib, I am new to the list and a co-Chair of the Vireo Users Group. We have an update to share with all of our Vireo users so I am posting to this list to reach as many people as possible. For those of you who have not yet been introduced, Vireo is a turnkey Electronic Thesis and Di

Re: [CODE4LIB] Processing Circ data

2015-08-06 Thread Dunham, Denise
You can use sqlite within R using the sqldf package. It allows you to perform sql select statements on your data in memory. I've used it with datasets in this size range and it was fairly fast. Denise Dunham Information Discovery Services Team River Campus Libraries University of Rochester

Re: [CODE4LIB] Processing Circ data

2015-08-06 Thread Cornel Darden Jr.
Hello, I'd go with a full database solution over sqlite. No limitations. Thanks, Sent from my iPhone > On Aug 6, 2015, at 11:49 AM, Harper, Cynthia wrote: > > I did just bring in my own laptop to see if my problem is unique to my work > computer. I actually have used Amazon AWS, and yes, t

Re: [CODE4LIB] Processing Circ data

2015-08-06 Thread Harper, Cynthia
I did just bring in my own laptop to see if my problem is unique to my work computer. I actually have used Amazon AWS, and yes, that might be the best option. I've been looking into why my MSAccess job is limited to 25% of my CPU time - Maybe Access just can't use multiprocessors. I'm going t

Re: [CODE4LIB] Processing Circ data

2015-08-06 Thread Kyle Banerjee
On Wed, Aug 5, 2015 at 1:07 PM, Harper, Cynthia wrote: > Hi all. What are you using to process circ data for ad-hoc queries. I > usually extract csv or tab-delimited files - one row per item record, with > identifying bib record data, then total checkouts over the given time > period(s). I have

Re: [CODE4LIB] Processing Circ data

2015-08-06 Thread Harrison G. Dekker
Hi Cynthia, R would be ideal for the types data manipulation you describe and would allow to automate the entire process. If you can share a sample of your data and examples of the types of queries you're running, I'd be glad to help you get started. If you'd like to keep a relational database in

Re: [CODE4LIB] Processing Circ data

2015-08-06 Thread Harper, Cynthia
I have compacted the database, and I'm using the Group By SQL query. I think I actually am hitting the 2GB limit, because of all the data I have for each row. I'm wondering if having added a field for reserves history notes, that that's treated as a fixed-length field for every record, rather th