What is the I/O block size that PyTables uses? I ask because on my Lustre system, reading blocks of less than 2 MB results in degraded performance.
Is there a way to change the I/O block size? From the HP StorageWorks Scalable File Share Client Installation and User Guide: > I/O chunk size > In HP SFS Version 2.1, the MTU of the I/O subsystem is 1MB per operation. > This parameter is defined by > the Portals subsystem. To give optimum performance, all I/O chunks should be > at least this size. An I/O > chunk size that is based on the following formula ensures that a client can > perform I/O operations in parallel > to all available Object Storage Servers: > > chunk_size = stripe_size * ost_count > > where stripe_size is the default stripe size of the file system and ost_count > is the number of OST > services that the file system is striped across. Many thanks, -- Michael Hoffman ------------------------------------------------------------------------- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ _______________________________________________ Pytables-users mailing list Pytables-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/pytables-users
