Vincent Nijs (el 2007-07-22 a les 10:21:18 -0500) va dir::
[...]
I would assume the NULL's could be treated as missing values (?) Don't know
about the different types in one column however.
Maybe a masked array would do the trick, with NULL values masked out.
::
Ivan Vilata i
FYI
I asked a question about the load and save speed of recarray's using pickle
vs pysqlite on the pysqlite list and got the response linked below. Doesn't
look like sqlite can do much better than what I found.
http://lists.initd.org/pipermail/pysqlite/2007-July/001085.html
I also passed on
On Thu, Jul 19, 2007 at 09:42:42PM -0500, Vincent Nijs wrote:
I'd luv to hear from people using sqlite, pytables, and cPickle about
their experiences.
I was about to point you to this discussion:
http://projects.scipy.org/pipermail/scipy-user/2007-April/011724.html
but I see that you
Gael Varoquaux wrote:
On Thu, Jul 19, 2007 at 09:42:42PM -0500, Vincent Nijs wrote:
I'd luv to hear from people using sqlite, pytables, and cPickle about
their experiences.
I was about to point you to this discussion:
On Fri, Jul 20, 2007 at 01:59:13AM -0700, Andrew Straw wrote:
I want that Matlab script!
I new I really should put these things on line, I have just been wanting
to iron them a bit, but it has been almost two year since I have touched
these, so ...
http://scipy.org/Cookbook/hdf5_in_Matlab
Gael Varoquaux (el 2007-07-20 a les 11:24:34 +0200) va dir::
I new I really should put these things on line, I have just been wanting
to iron them a bit, but it has been almost two year since I have touched
these, so ...
http://scipy.org/Cookbook/hdf5_in_Matlab
Wow, that looks really sweet
A Divendres 20 Juliol 2007 04:42, Vincent Nijs escrigué:
I am interesting in using sqlite (or pytables) to store data for scientific
research. I wrote the attached test program to save and load a simulated
11x500,000 recarray. Average save and load times are given below (timeit
with 20
Gael,
Sounds very interesting! Would you mind sharing an example (with code if
possible) of how you organize your experimental data in pytables. I have
been thinking about how I might organize my data in pytables and would luv
to hear how an experienced user does that.
Given the speed
On 7/20/07, Vincent Nijs [EMAIL PROTECTED] wrote:
Gael,
Sounds very interesting! Would you mind sharing an example (with code if
possible) of how you organize your experimental data in pytables. I have
been thinking about how I might organize my data in pytables and would luv
to hear how an
Thanks Francesc!
That does work much better:
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
PyTables version: 2.0
HDF5 version: 1.6.5
NumPy version: 1.0.4.dev3852
Zlib version: 1.2.3
BZIP2 version: 1.0.2 (30-Dec-2001)
Python version:2.5.1
On Fri, Jul 20, 2007 at 08:35:51AM -0500, Vincent Nijs wrote:
Sounds very interesting! Would you mind sharing an example (with code if
possible) of how you organize your experimental data in pytables. I have
been thinking about how I might organize my data in pytables and would luv
to hear how
Vincent,
A Divendres 20 Juliol 2007 15:35, Vincent Nijs escrigué:
Still curious however ... does no one on this list use (and like) sqlite?
First of all, while I'm not a heavy user of relational databases, I've used
them as references for benchmarking purposes. Hence, based on my own
Another small note:
I'm pretty sure sqlite stores everything as strings. This just plain has
to be slower than storing the raw binary representation (and may mean
for slight differences in fp values on the round-trip). HDF is designed
for this sort of thing, sqlite is not.
-Chris
--
A Divendres 20 Juliol 2007 20:16, Christopher Barker escrigué:
Another small note:
I'm pretty sure sqlite stores everything as strings. This just plain has
to be slower than storing the raw binary representation (and may mean
for slight differences in fp values on the round-trip). HDF is
I am interesting in using sqlite (or pytables) to store data for scientific
research. I wrote the attached test program to save and load a simulated
11x500,000 recarray. Average save and load times are given below (timeit
with 20 repetitions). The save time for sqlite is not really fair because I
15 matches
Mail list logo
