2011/3/15 Dhananjaya <dhanush...@yahoo.com>
>
> hi Anthony,
>
> thanks for you reply. My comparison is straight forward. Right now we are
> using C code and native C HDF5 (ver 1.6.5) routines to create datasets,
> groups
> and organize our sampling data in HDF5 file. In this aspect we tend to
> create
> numerous tables and datasets ( single dimensions ) in the HDF5 file. After
> going
> through the documentation of PyTables i wrote a simple python script to
> create 3
> groups and around 10,000 datasets in each group.
> I am not expecting pytables to be as fast as C. But what i am seeing is
> a
> huge difference on the performance front. here you go with script.
>
[clip]
Yes, I'd say this is expected. PyTables is not meant to shine in
performance with dealing with lots of small datasets, but rather with small
amounts of large datasets. If your use case is the former, then you should
stick with the C approach. But if you need something like the later, then
PyTables might make more sense.
Cheers,
--
Francesc Alted
------------------------------------------------------------------------------
Colocation vs. Managed Hosting
A question and answer guide to determining the best fit
for your organization - today and in the future.
http://p.sf.net/sfu/internap-sfd2d
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
