Hi Wayne,
I am fairly certain that the maximum number of fields is defined as a
variable on the C-level
http://www.hdfgroup.org/training/HDFtraining/UsersGuide/Fundmtls.fm3.html#2412
If
you were willing to change the hfdf5 source and recompile, you could adjust
this.
However, I have often found that by thinking about the problem a little
differently you can generally get around this limitation without the above
mess. For example, you can nest tables as a way of giving yourself "more"
columns.
Also, often I find that not all of my data needs to be in one table. If I
create an index table, I am able to make more natural splits elsewhere.
I hope this helps.
Be Well
Anthony
On Tue, Mar 8, 2011 at 7:06 PM, Hajas, Wayne <wayne.ha...@dfo-mpo.gc.ca>wrote:
> I am using pyTables 2.1.1, python 2.5, Windows XP.
>
> I am not using pyTables directly, it is called from another python
> package.
>
> As long as my output is small enough, pyTables appears to work fine.
> However, if pyTables is asked to create a table with many columns(numerial)
> -567 in my current case - it crashes. I will copy the error-messages at the
> bottom of this message.
>
> I am hoping that maximum table-width is controlled by a simple
> pyTables-variable which I can adjust. Since I am using pyTables through
> another package, I can't restructure my data.
>
> Does anybody have any suggestions or ideas about what I should do? Thanks
> in advance.
>
> Wayne Hajas
>
> HDF5-DIAG: Error detected in HDF5 library version: 1.6.7-rc2 thread 0.
> Back trace follows.
> #000: \hdf\hdf5-16\vnet\release-testing\std\src\H5D.c line 1114 in
> H5Dcreate(): unable to create dataset
> major(15): Dataset interface
> minor(29): Unable to initialize object
> #001: \hdf\hdf5-16\vnet\release-testing\std\src\H5D.c line 2257 in
> H5D_create(): can't update the metadata cache
> major(15): Dataset interface
> minor(29): Unable to initialize object
> #002: \hdf\hdf5-16\vnet\release-testing\std\src\H5D.c line 1879 in
> H5D_update_entry_info(): unable to update type or
> pace header messages
> major(15): Dataset interface
> minor(29): Unable to initialize object
> #003: \hdf\hdf5-16\vnet\release-testing\std\src\H5O.c line 1540 in
> H5O_append(): unable to append to object header
> major(12): Object header layer
> minor(25): Write failed
> #004: \hdf\hdf5-16\vnet\release-testing\std\src\H5O.c line 1583 in
> H5O_append_real(): unable to create new message
> major(12): Object header layer
> minor(29): Unable to initialize object
> #005: \hdf\hdf5-16\vnet\release-testing\std\src\H5O.c line 1658 in
> H5O_new_mesg(): object header message is too larg
> major(12): Object header layer
> minor(29): Unable to initialize object
> ERROR: An unexpected error occurred while tokenizing input
> The following traceback may be corrupted or invalid
> The error message is: ('EOF in multi-line statement', (100, 0))
>
>
>
>
> Wayne Hajas
> Pacific Biological Station
> Nanaimo, British Columbia
> V9T 6N7
> (250)753-7367
> wayne.ha...@dfo-mpo.gc.ca
>
>
> ------------------------------------------------------------------------------
> What You Don't Know About Data Connectivity CAN Hurt You
> This paper provides an overview of data connectivity, details
> its effect on application quality, and explores various alternative
> solutions. http://p.sf.net/sfu/progress-d2d
> _______________________________________________
> Pytables-users mailing list
> Pytables-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/pytables-users
>
>
------------------------------------------------------------------------------
What You Don't Know About Data Connectivity CAN Hurt You
This paper provides an overview of data connectivity, details
its effect on application quality, and explores various alternative
solutions. http://p.sf.net/sfu/progress-d2d
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
