Re: [OT] Simulation Results Managment
moo...@yahoo.co.uk writes: ... Does pickle have any advantages over json/yaml? It can store and retrieve almost any Python object with almost no effort. Up to you whether you see it as an advantage to be able to store objects rather than (almost) pure data with a rather limited type set. Of course, pickle is a proprietary Python format. Not so easy to decode it with something else than Python. In addition, when you store objects, the retrieving application must know the classes of those objects -- and its knowledge should not be too different from how those classes looked when the objects have been stored. I like very much to work with objects (rather than with pure data). Therefore, I use pickle when I know that the storing and retrieving applications all use Python. I use pure (and restricted) data formats when non Python applications come into play. -- http://mail.python.org/mailman/listinfo/python-list
Re: [OT] Simulation Results Managment
Dieter Maurer wrote: moo...@yahoo.co.uk writes: ... Does pickle have any advantages over json/yaml? It can store and retrieve almost any Python object with almost no effort. Up to you whether you see it as an advantage to be able to store objects rather than (almost) pure data with a rather limited type set. Of course, pickle is a proprietary Python format. Not so easy to decode it with something else than Python. In addition, when you store objects, the retrieving application must know the classes of those objects -- and its knowledge should not be too different from how those classes looked when the objects have been stored. I like very much to work with objects (rather than with pure data). Therefore, I use pickle when I know that the storing and retrieving applications all use Python. I use pure (and restricted) data formats when non Python applications come into play. Typically what I want to do is post-process (e.g. plot) results using python scripts, so using pickle is great for that. -- http://mail.python.org/mailman/listinfo/python-list
Re: [OT] Simulation Results Managment
moo...@yahoo.co.uk wrote: Hi, This is a general question, loosely related to python since it will be the implementation language. I would like some suggestions as to manage simulation results data from my ASIC design. For my design, - I have a number of simulations testcases (TEST_XX_YY_ZZ), and within each of these test cases we have: - a number of properties (P_AA_BB_CC) - For each property, the following information is given - Property name (P_NAME) - Number of times it was checked (within the testcase) N_CHECKED - Number of times if failed (within the testcase) N_FAILED - A simulation runs a testcase with a set of parameters. - Simple example, SLOW_CLOCK, FAST_CLOCK, etc - For the design, I will run regression every night (at least), so I will have results from multiple timestamps We have 1000 TESTCASES, and 1000 PROPERTIES. At the moment, I have a script that extracts property information from simulation logfile, and provides single PASS/FAIL and all logfiles stored in a directory structure with timestamps/testnames and other parameters embedded in paths I would like to be easily look at (visualize) the data and answer the questions - When did this property last fail, and how many times was it checked - Is this property checked in this test case. Initial question: How to organize the data within python? For a single testcase, I could use a dict. Key P_NAME, data in N_CHECKED, N_FAILED I then have to store multiple instances of testcase based on date (and simulation parameters. Any comments, suggestions? Thanks, Steven One small suggestion, I used to store test conditions and results in log files, and then write parsers to read the results. The formats kept changing (add more conditions/results!) and maintenance was a pain. Now, in addition to a text log file, I write a file in pickle format containing a dict of all test conditions and results. Much more convenient. -- http://mail.python.org/mailman/listinfo/python-list
Re: [OT] Simulation Results Managment
On Sunday, July 15, 2012 2:42:39 AM UTC+2, Neal Becker wrote: me wrote: gt; Hi, gt; This is a general question, loosely related to python since it will be the gt; implementation language. I would like some suggestions as to manage simulation gt; results data from my ASIC design. gt; gt; For my design, gt; - I have a number of simulations testcases (TEST_XX_YY_ZZ), and within each of gt; these test cases we have: gt; - a number of properties (P_AA_BB_CC) gt; - For each property, the following information is given gt; - Property name (P_NAME) gt; - Number of times it was checked (within the testcase) N_CHECKED gt; - Number of times if failed (within the testcase) N_FAILED gt; - A simulation runs a testcase with a set of parameters. gt; - Simple example, SLOW_CLOCK, FAST_CLOCK, etc gt; - For the design, I will run regression every night (at least), so I will have gt; results from multiple timestamps We have lt; 1000 TESTCASES, and lt; 1000 gt; PROPERTIES. gt; gt; At the moment, I have a script that extracts property information from gt; simulation logfile, and provides single PASS/FAIL and all logfiles stored in a gt; directory structure with timestamps/testnames and other parameters embedded in gt; paths gt; gt; I would like to be easily look at (visualize) the data and answer the gt; questions - When did this property last fail, and how many times was it gt; checked - Is this property checked in this test case. gt; gt; Initial question: How to organize the data within python? gt; For a single testcase, I could use a dict. Key P_NAME, data in N_CHECKED, gt; N_FAILED I then have to store multiple instances of testcase based on date gt; (and simulation parameters. gt; gt; Any comments, suggestions? gt; Thanks, gt; Steven One small suggestion, I used to store test conditions and results in log files, and then write parsers to read the results. The formats kept changing (add more conditions/results!) and maintenance was a pain. Now, in addition to a text log file, I write a file in pickle format containing a dict of all test conditions and results. Much more convenient. Hi Neal, We already store the original log files. Does pickle have any advantages over json/yaml? Thanks, Steven -- http://mail.python.org/mailman/listinfo/python-list
[OT] Simulation Results Managment
Hi, This is a general question, loosely related to python since it will be the implementation language. I would like some suggestions as to manage simulation results data from my ASIC design. For my design, - I have a number of simulations testcases (TEST_XX_YY_ZZ), and within each of these test cases we have: - a number of properties (P_AA_BB_CC) - For each property, the following information is given - Property name (P_NAME) - Number of times it was checked (within the testcase) N_CHECKED - Number of times if failed (within the testcase) N_FAILED - A simulation runs a testcase with a set of parameters. - Simple example, SLOW_CLOCK, FAST_CLOCK, etc - For the design, I will run regression every night (at least), so I will have results from multiple timestamps We have 1000 TESTCASES, and 1000 PROPERTIES. At the moment, I have a script that extracts property information from simulation logfile, and provides single PASS/FAIL and all logfiles stored in a directory structure with timestamps/testnames and other parameters embedded in paths I would like to be easily look at (visualize) the data and answer the questions - When did this property last fail, and how many times was it checked - Is this property checked in this test case. Initial question: How to organize the data within python? For a single testcase, I could use a dict. Key P_NAME, data in N_CHECKED, N_FAILED I then have to store multiple instances of testcase based on date (and simulation parameters. Any comments, suggestions? Thanks, Steven -- http://mail.python.org/mailman/listinfo/python-list
