A Thursday 07 May 2009, Stephen Simmons escrigué:
> I too have thought about writing an SQL->pytables bridge, either by
> parsing a simplified SQL-like language, or hacking a PyTables backend
> onto the parser-query engine in SQLite or Gadfly, or python-sqlparse
> (http://code.google.com/p/python-sqlparse).

Yes. Specially python-sqlparse seems pretty cool for the simplified 
SQL-like language.

> Last week I stumbled across Pig, a query language developed by Yahoo
> for map-reduce like tasks in Hadoop clusters. This looks much simpler
> than SQL to bolt onto a PyTables (or numpy recarry) backend. More
> details of Pig are here:
>  - http://www.cs.cmu.edu/~olston/publications/sigmod08.pdf
>  - http://hadoop.apache.org/pig/

I wasn't aware of the "Pig Latin" language thing, although being a latin 
guy myself, I wouldn't like to know what they wanted to express exactly 
with this name (just in case ;-)

Seriously, things like Pig or BigTable are more meant to running 
databases in parallel in large COWs (Cluster of Workstations).  
However, I rather see PyTables heading more to exploit advanced 
capabilities of modern CPUs in short term instead, like SIMD 
capabilities (SSx instruction set) or the efficent use of multicores.  
So, parallel PyTables should wait a bit still (unless there are some 
volunteers wanting to change this :).

Cheers,

-- 
Francesc Alted

"One would expect people to feel threatened by the 'giant
brains or machines that think'.  In fact, the frightening
computer becomes less frightening if it is used only to
simulate a familiar noncomputer."

-- Edsger W. Dykstra
   "On the cruelty of really teaching computer science"

------------------------------------------------------------------------------
The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your
production scanning environment may not be a perfect world - but thanks to
Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700
Series Scanner you'll get full speed at 300 dpi even with all image 
processing features enabled. http://p.sf.net/sfu/kodak-com
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users

Reply via email to