Hi Dat Chu, I missed your message :-) A Friday 15 October 2010 18:22:54 dattan...@gmail.com escrigué: > Hello, > > I have ~100 512x512x3 numpy arrays that I currently save on disks as > png images. If I were to put all these data into one single hdf5 > file, will reading only 1-3 of these arrays incur a full read of the > entire hdf5 from disk?
No, only the disk space taken by 1-3 arrays will be read. > > My problem is that the file server has problems serving up many small > files. If I pack all these small files into a single hdf5, the > overhead of reading will be reduced. However, if reading a single > array makes the entire dataset be read then what I am doing is > counter-productive. Hope this helps, -- Francesc Alted ------------------------------------------------------------------------------ Nokia and AT&T present the 2010 Calling All Innovators-North America contest Create new apps & games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev _______________________________________________ Pytables-users mailing list Pytables-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/pytables-users
