A Monday 04 February 2008, James Philbin escrigué:
> Hi,
>
> > Are you experiencing some catastrophic resource
> > consumption with 4096?
>
> OK, to try and roughly characterize the performance for large numbers
> of datasets, I ran the following stress test in c:
>
> --- hdf5_stress_test.c ---
> #
As a follow up, I tried manually iterating through the dataset:
--- hdf5_iterate.c ---
#include "hdf5.h"
herr_t file_info(hid_t loc_id, const char *name, void *opdata);
int
main(void)
{
hid_t file;
hid_t dataset;
hid_t group;
file = H5Fopen("hdf5_stress_test.h5", H5F_ACC_RDONLY, H5P_DEF
Hi,
> Are you experiencing some catastrophic resource
> consumption with 4096?
OK, to try and roughly characterize the performance for large numbers
of datasets, I ran the following stress test in c:
--- hdf5_stress_test.c ---
#include
#include
#include "H5LT.h"
int
main(void)
{
hid_t file_
A Monday 04 February 2008, Michael Hoffman escrigué:
> I also have this experience. And it's not just PyTables--the native
> utilities that come with HDF5 can have a lot of trouble dealing with
> large numbers of datasets.
>
> I found that for many uses I could speed things up by using a tree
> top
Francesc Altet wrote:
> Hi James,
>
> A Monday 04 February 2008, James Philbin escrigué:
>> Hi,
>>
>> I'm planning on using pytables for storing data on large image
>> datasets (1M+) and while playing around with some code, came across a
>> warning saying I had exceeded the maximum number of child
Hi James,
A Monday 04 February 2008, James Philbin escrigué:
> Hi,
>
> I'm planning on using pytables for storing data on large image
> datasets (1M+) and while playing around with some code, came across a
> warning saying I had exceeded the maximum number of children (4096).
> My aim is to eventu
Hi,
I'm planning on using pytables for storing data on large image
datasets (1M+) and while playing around with some code, came across a
warning saying I had exceeded the maximum number of children (4096).
My aim is to eventually have one child per image (ie millions of
children), so i'm wondering
Hi,
I'm planning on using pytables for storing data on large image
datasets (1M+) and while playing around with some code, came across a
warning saying I had exceeded the maximum number of children (4096).
My aim is to eventually have one child per image (ie millions of
children), so i'm wondering
