Good afternoon, Michael Oberg and I are attempting to get PVFS2 working on NCAR's 1-rack BlueGene/L system using ZeptoOS. We ran into a snag at over 8 BG/L I/O nodes (>256 compute nodes).
We've been using the mpi-io-test program shipped with PVFS2 to test the system. For cases up to and including 8 I/O nodes (256 coprocessor or 512 virtual node mode tasks), everything works fine. Larger jobs fail with file not found error messages, such as: MPI_File_open: File does not exist, error stack: ADIOI_BGL_OPEN(54): File /pvfs2/mattheww/_file_0512_co does not exist The file is created on the PVFS2 filesystem and has a zero-byte size. We've run the tests with 512 tasks on 256 nodes, and it successfully created a 8589934592-byte file. Going to 257 nodes fails. Has anyone seen this behavior before? Are there any PVFS2 server or client configuration options that you would recommend for a BG/L installation like this? Thanks for your time, Matthew _______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
