Re: [Pytables-users] pytables for financial data.

2011-04-22 Thread Robert Ferrell
I add an array of dates to the PyTables file. That array just keeps track of which dates are stored. When I append a new date of data I just check whether that date is already in the file or not. For me that is simpler than involving SQL. BTW, what I found handy was to put the downloaded

Re: [Pytables-users] pytables for financial data.

2011-04-22 Thread Robert Ferrell
On Apr 22, 2011, at 11:57 AM, Abhijit Gadgil wrote: Thanks for the quick reply, please see below. On Fri, Apr 22, 2011 at 10:32 PM, Robert Ferrell ferr...@diablotech.com wrote: I add an array of dates to the PyTables file. That array just keeps track of which dates are stored. When

[Pytables-users] Errors with tables.test(heavy=True)

2010-06-04 Thread Robert Ferrell
I just updated some software and found lots of errors with tables.test(heavy=True) This is just the last error message - it looks like most of the errors are similar to this one. This is on OS X 10.5. I found the same errors with HDF 1.8.4/Numpy 1.4.0/Python 2.6.1 on OS X 10.6 on a

Re: [Pytables-users] Error on OS X 10.6

2009-12-02 Thread Robert Ferrell
On Dec 2, 2009, at 12:17 PM, Francesc Alted wrote: A Wednesday 02 December 2009 19:46:42 Robert Ferrell escrigué: I just built PyTables on OS X 10.6 (Snow Leopard). (Thanks to all for help from many quarters.) tables.test() ran fine. But tables.test(heavy=True) gave many errors, all

[Pytables-users] Compound Data Types question

2009-06-01 Thread Robert Ferrell
I'm trying to write a table of numpy records, but failing. I have a numpy dtype dtp = np.dtype([('x',np.float64), ('y', np.float64)]) I was hoping I could make columns with this: class DoesNotWork(tables.IsDescription): XY = tables.Col.from_atom(tables.Atom.from_dtype(dtype=dtp)) but

Re: [Pytables-users] Basic question

2009-05-21 Thread Robert Ferrell
Okay, I'm completely confused. I've gone through the docs and there are many examples, but I can't find anything as simple as I want. Maybe I'm not using the right tool? In it's simplest form, I have a large number of (name, np array) tuples. (I happen to store them in a dict, and the np

[Pytables-users] Basic question

2009-05-17 Thread Robert Ferrell
I have an elementary question. I have a dictionary with about 10,000 keys. The keys are (shortish) strings. Each value is a time series of structured arrays (record arrays) with 5 fields. Each value totals about 100,000 bytes, so the total data size isn't huge, about 1GB. What would be