Hi all
I've just discovered pytables and I realize that it is precisely what I
need. I would like to thank the authors for this great module. I have a
very simple question, and I am sure that someone of you can enlighten me
:)
Although I have taken a look on the User Guide, I can't still figure out
how to organize my data. I got stuck right at the beginning.
I have a huge amount of data obtained from computer simulations. The
system I am simulating is stochastic, and I want to study the
dependencies on the parameters of some statistical properties of the
system. Due to the randomness of the system, for some fixed values of
the parameters, I need to run many different trials (i.e., different
realizations of the stochastic process) to have good estimates of the
statistical properties. Each trial has a fixed duration. There are 3
parameters the system depends on (let's call the p1, p2, and p3). My
data consists more or less on this:
Parameter setting
p1=0, p2=0, p3=0: a bunch of trials (around 500)
p1=1, p2=0, p3=0: another bunch of trials,
...
...
p1=1, p2=1, p3=1: another bunch of trials.
I simulate the system for all the possible combinations of parameters
(in my case, there are 2^3=8 possible combinations). Each combination
has its corresponding collection of trials.
As for the individual trials, a single trial consists of the readout of
different variables of the system along time.
time var_1 var_2 var_3 var_4
0 1 1 1 2
1 0.9 1.1 1.2 1.8
.... ... ... ... ...
.... ... ... ... ...
10000 0 10 3.2 2.1
Rather than posing a question, I am asking for advice. What do you think
is the best way to structure the data (in terms of groups, and tables,
and such)?
Just in case it is relevant, I use NumPy to perform all the
calculations. Until now, I used an N-dimensional NumPy array to store
and manage the data, but there were so many problems with it that I
decided to give PyTables a try.
Thanks a lot for your patience and attention, and I apologize for this
low-profile type of question.
all the best,
Daniel
-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Pytables-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/pytables-users
