On Friday 23 May 2008 05:04:40 am Joshua Griffith wrote: > Matt, > > Have you tried using an in-memory SQLite3 database rather than working > from disk? Also, are you pre-compiling and caching your statements? > Both of these will dramatically speed things up.
I have pre-compiled/cached the statements (by which I assume you mean sqlite:prepare) and I have turned synchronous access off. This made a huge difference (over a day to hours). I didn't think to try in-memory but since I need to write the data back out I suspect the overall speed up may not be great. It is worth a try though. Thanks. Matt -=- > -Josh > > On May 22, 2008, at 11:41 PM, Matthew Welland wrote: > > Has anyone tried using datadraw (http://datadraw.sourceforge.net/) > > with > > Chicken? If so did any of the claimed performance benefits transfer to > > Chicken code? It almost seems like a scheme compiler or interpreter > > could > > be built on top of datadraw or coupled extremely close to it rather > > than > > moving data in and out of it but in any case an interface to chicken > > seems > > like it'd be really cool. > > > > I have some large chunks of data to munge and Chicken + sqlite3 is > > proving a > > bit slow (8-20 hour run times) and I'm considering rethinking my > > approach. > > > > Thanks in advance for any comments and insight. > > > > Matt > > -=- > > > > > > _______________________________________________ > > Chicken-users mailing list > > [email protected] > > http://lists.nongnu.org/mailman/listinfo/chicken-users -- http://www.kiatoa.com, fight for a better world. _______________________________________________ Chicken-users mailing list [email protected] http://lists.nongnu.org/mailman/listinfo/chicken-users
