> Re: [Pytables-users] pytables interface to sqlite? > From: Francesc Alted <fal...@py...> - 2009-05-07 10:44 > Hi Timmie,
<snip> > * Is there a interface between pytables and SQLite? > > I am thinking of something like > > mypytables.convert_to_sql > mypytables.cat.table.insert_into_sqltable > > This is very rough.... > > Well, I've got the idea, and I suppose that a handful of people had it > before too :) I'm sorry, but I don't think that a full SQL bridge for > PyTables would be feasible (without too much work at least). In fact, > exposing a SQL-like interface has never been (nor likely is going to > be) a goal for PyTables. As the pytables.org home page says, PyTables > is more designed to be a companion of a full-fledged SQL, relational > database -- a combination that can have many advantages indeed. > > In this sense, I've always thought that a powerful database abstraction > layer could be done around PyTables *and* a relational database. In > such an abstraction, one could create special entities that are meant > for performance (or to use compression or other PyTables strenghts), > and these would be implemented with PyTables as backend. Also, these > entities could be linked with the traditional relational database so as > to provide a relatively seemless integration between both. > > While the above approach is definitely much less work than providing a > full SQL interface to PyTables, to my knowledge nobody has stepped in > yet. But it is definitely an interesting venue, IMO. > > Cheers, > > Francesc Alted I too have thought about writing an SQL->pytables bridge, either by parsing a simplified SQL-like language, or hacking a PyTables backend onto the parser-query engine in SQLite or Gadfly, or python-sqlparse (http://code.google.com/p/python-sqlparse). Last week I stumbled across Pig, a query language developed by Yahoo for map-reduce like tasks in Hadoop clusters. This looks much simpler than SQL to bolt onto a PyTables (or numpy recarry) backend. More details of Pig are here: - http://www.cs.cmu.edu/~olston/publications/sigmod08.pdf - http://hadoop.apache.org/pig/ If only I had the time to pursue this further.... Stephen ------------------------------------------------------------------------------ The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com _______________________________________________ Pytables-users mailing list Pytables-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/pytables-users
