I compiled pytables pro version 2.1rc2 with hdf5 1.8.4 (1.6 API enabled) and 
LZO 2.02. I am running on Linux (RHEL5 64 bit). 

I'm trying using the LZO compression as follows: 

lzo_filter = Filters(complib='lzo', complevel=9, shuffle=True) 

trade_file_name = '%s/%s/%s.trades.hf5' % (opt.out_dir, date[0:4], date) 
trade_file = openFile(trade_file_name, 'w') 
trade_group = trade_file.createGroup(trade_file.root, "trades") 
trade_table = trade_file.createTable(trade_group, 'trades_table', trade_class, 
"A trades table", lzo_filter) 
... other code to insert into the table and create indexes ... 
trade_file.close() 


It seems that no matter what I set the 'complevel' parameter to, the file size 
is the same and I do not see any significant difference in query time. I do get 
a non-fatal error message at the beginning: 

HDF5-DIAG: Error detected in HDF5 (1.8.4) thread 0: 
#000: H5Z.c line 273 in H5Zregister(): unable to modify predefined filters 
major: Invalid arguments to routine 
minor: Bad value 

I suspect that the LZO setting is somehow not working and it is skipping 
compression altogether. Why am I getting this error message? How can I verify 
if compression is working correctly nor not? 

Thanks, 

Ben 


---------------------------------------------------
This message is confidential. It may also be privileged or otherwise
protected by work product immunity or other legal rules. If you have
received it by mistake, please let us know by e-mail reply and delete it
from your system. You may not copy this message or disclose its contents to
anyone. Quantbot Technologies reserves the right to monitor and review the
content of all messages sent to or from this e-mail address.

------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev 
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users

Reply via email to