A Sunday 03 August 2008, escriguéreu:
> Hi Francesc,
>
> Sorry I think I might have been unclear in my first email ( probably
> too  late at night to write well )...
>
> My situation is that I used the PyTables python interface to modify
> my hdf files (i.e. moved datasets between groups, deleted datasets)
> and now am faced with the problem of excessively large file sizes.  I
> wanted to compact the files using ptrepack to get rid of the holes I
> have created.

Well, I think that I understood you well, yes.

> I played around with ptrepack a bit and had some success in doing the
> following:
>
> ptrepack hdf-file-with-holes.h5 new-hdf.h5
>
> Is there a better way to do this? or any settings I should be aware
> of?

I'm not sure about what you mean here (the above command is enough to 
get rid of holes, if this is what you are after).  What kind of 
settings are you referring to? compresion maybe?  If it is compression, 
then yes, you can change the compressor library and see if some of the 
(zlib, lzo or bzip2) triad can do a better job for you.  Just type 
``ptrepack`` with no parameters to see the flags required to use 
compression.

> My data is basically a series of numpy arrays which I've put into the
> hdf file using the h5file.createArray(...) method if this is
> important.

Well, the outcome of the '.createArray()' method are plain Array 
objects, and these are not compressible.  Maybe you want to use CArrays 
or EArrays so that you can get compressible datasets.  Check the 
PyTables User's Guide for directions on how to use them.

HTH,

-- 
Francesc Alted
Freelance developer
Tel +34-964-282-249

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users

Reply via email to