On Thu, Sep 15, 2011 at 5:16 PM, Emmanuel Mayssat <emays...@gmail.com>wrote:
> I use a control system (50K+ parameters).
> i would like to take a snapshot/backup of a running configuration and
> save all the 50K+ parameters in one file.
> A feature I need is to compare snapshot with each others.
>
> For example: how does the current configuration compare to the
> snapshot taken 3 weeks ago.
> 1/ list of parameters to save are in a table of a h5 (50K+ parameters)
> 2/ take a snapshot (for each row extend with value of parameter)
> 3/ compare new snapshot to old snapshot where parameter names are the
> same ( with a tolerance on the parameter let's say of 1% up to 3%
> function of parameter)
>
I guess I am unclear on how you are storing these parameters. They can't be
columns in a table due to a hard HDF5 limitation. Thus the parameters are
either row entries in a table or they are stored as an array. How you are
storing them is going to determine how you might what to perform the
comparison. Also, any comparison where you want to build in a tolerance is
going to have to (at some point) hit Python. That is to say, you'll have to
read into memory the parts of the file(s) that you want to do the comparison
on (also true no matter what interface you use).
If you could describe your actual storage layout, we could help you more.
>
> Also is there a way to easily edit h5 files (not sure vitables can do
> that based on its old documentation) and add a parameter in a table
> for future backup.
>
Currently, sadly no. ViTables does not let you edit. I have toyed with the
idea of writing a Traits-based application to do just that. I have some
parts of it written, if you or anyone else is interested.... It actually
wouldn't be *that* much work. I don't know of an HDF5 editor, only viewers.
>
> I am interested in h5 because my parameters can be classified in
> /machine_id/systems/subsystems all of which could be groups. would be
> nice for browsing and selective restore.
>
Groups are a common feature to all HDF5 libraries (indeed they are the 'H')!
Be Well
Anthony
> Any info on vitables and editable entries/row in tables?
> At this point, I am not yet convinced I should use h5/pytables yet...
> just exploring....
>
>
> On Thu, Sep 15, 2011 at 11:58 AM, Anthony Scopatz
> <ascop...@enthought.com> wrote:
> > Hello Emmanuel,
> > Could you please be more specific? You can always take data from where
> ever
> > your want (including independent tables) and run the comparison in Python
> > (or NumPy). What are you trying to accomplish?
> > Be Well
> > Anthony
> >
> > On Thu, Sep 15, 2011 at 1:26 PM, Emmanuel Mayssat <emays...@gmail.com>
> > wrote:
> >>
> >> Are queries limited to 1 table only?
> >> Is it possible to compare rows of 2 tables in same database?
> >> Is it possible to compare rows of 2 tables located in different
> >> database/files?
> >>
> >> Regards,
> >> --
> >> Emmanuel
> >>
> >>
> >>
> ------------------------------------------------------------------------------
> >> Doing More with Less: The Next Generation Virtual Desktop
> >> What are the key obstacles that have prevented many mid-market
> businesses
> >> from deploying virtual desktops? How do next-generation virtual
> desktops
> >> provide companies an easier-to-deploy, easier-to-manage and more
> >> affordable
> >> virtual desktop model.http://www.accelacomm.com/jaw/sfnl/114/51426474/
> >> _______________________________________________
> >> Pytables-users mailing list
> >> Pytables-users@lists.sourceforge.net
> >> https://lists.sourceforge.net/lists/listinfo/pytables-users
> >
> >
> >
> ------------------------------------------------------------------------------
> > Doing More with Less: The Next Generation Virtual Desktop
> > What are the key obstacles that have prevented many mid-market businesses
> > from deploying virtual desktops? How do next-generation virtual
> desktops
> > provide companies an easier-to-deploy, easier-to-manage and more
> affordable
> > virtual desktop model.http://www.accelacomm.com/jaw/sfnl/114/51426474/
> > _______________________________________________
> > Pytables-users mailing list
> > Pytables-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/pytables-users
> >
> >
>
>
> ------------------------------------------------------------------------------
> Doing More with Less: The Next Generation Virtual Desktop
> What are the key obstacles that have prevented many mid-market businesses
> from deploying virtual desktops? How do next-generation virtual desktops
> provide companies an easier-to-deploy, easier-to-manage and more affordable
> virtual desktop model.http://www.accelacomm.com/jaw/sfnl/114/51426474/
> _______________________________________________
> Pytables-users mailing list
> Pytables-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/pytables-users
>
------------------------------------------------------------------------------
BlackBerry® DevCon Americas, Oct. 18-20, San Francisco, CA
http://p.sf.net/sfu/rim-devcon-copy2
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
