Hello PyTables Users,

I am very new to pytables and if you all could help me out, that would be
splendid.

I'm currently having trouble with writing to two separate HDF5 files using
pytables. Each file itself is only accessible by a single thread, so there
really shouldn't be any threading issues. When I run my python script
however, it just seems to crash at random time intervals without any error
messages received or exceptions thrown.

I write data to the HDF5 files as follows. I have two HDF5 files that
represent book snapshots and trade snapshots. The data of these snapshots
come in the form of python dictionaries whose values are the data itself in
an array. Two threads run on each file. One thread controls when to create
new files and close others based upon the time of day while the other
thread iterates over each key value pair in the dictionary and loads data
to the file. When a thread has access to the file, the file is locked.

I have my two datawrappers attached to the email. Please take a look at
them. One thread runs acceptDict in a loop while the other runs changeFile
in a loop. This is really frustrating when I don't get any errors and
python just crashes unexpectedly.

Thanks,
Jacob

-- 
Jacob Bennett
Massachusetts Institute of Technology
Department of Electrical Engineering and Computer Science
Class of 2014| benne...@mit.edu

Attachment: BookDataWrapper.py
Description: Binary data

Attachment: TradeDataWrapper.py
Description: Binary data

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users

Reply via email to