Dear all, I am now using Rocks+PVFS2 for a cluster with myrinet-gm. After I run an program (MEEP) it shows an error that it fails to write hdf5 files to /mnt/pvfs2.
The error messages: ------------------------------------------------------------------- error on line 450 of h5file.cpp: error opening HDF5 output file #000: H5F.c line 1992 in H5Fcreate(): unable to create file major(04): File interface minor(17): Unable to open file #001: H5F.c line 1749 in H5F_open(): unable to open file major(04): File interface minor(17): Unable to open file #002: H5FD.c line 1033 in H5FD_open(): open failed major(22): Virtual File Layer minor(29): Unable to initialize object #003: H5FDmpio.c line 802 in H5FD_mpio_open(): MPI_File_open failed major(03): Internal HDF5 error minor(78): Some MPI function failed #004: H5FDmpio.c line 802 in H5FD_mpio_open(): MPI_ERR_IO: input/output error major(03): Internal HDF5 error minor(79): MPI Error String meep: error on line 450 of h5file.cpp: error opening HDF5 output file #000: H5F.c line 1992 in H5Fcreate(): unable to create file ----------------------------------------------------------------------- The configuration of PVFS2 on rocks is by using "rocks sync pvfs" after installation of every node. By using "./pvfs2-ping -m /mnt/pvfs2", it shows: ----------------------------------------------------------------------- io_nodes: ['pvfs2-io-0-2', 'pvfs2-io-0-1'] metadata_nodes: ['nanohv'] Stopping PVFS2 server: [S 04/26 15:04] PVFS2 Server on node pvfs2-io-0-2 version 2.8.1 starting... [D 04/26 15:04] PVFS2 Server: storage space removed. Exiting. [S 04/26 15:04] PVFS2 Server on node pvfs2-io-0-2 version 2.8.1 starting... [D 04/26 15:04] PVFS2 Server: storage space created. Exiting. Starting PVFS2 server: [S 04/26 15:04] PVFS2 Server on node pvfs2-io-0-2 version 2.8.1 starting... [ OK ] Stopping PVFS2 server: [S 04/26 15:04] PVFS2 Server on node pvfs2-io-0-1 version 2.8.1 starting... [D 04/26 15:04] PVFS2 Server: storage space removed. Exiting. [S 04/26 15:04] PVFS2 Server on node pvfs2-io-0-1 version 2.8.1 starting... [D 04/26 15:04] PVFS2 Server: storage space created. Exiting. Starting PVFS2 server: [S 04/26 15:04] PVFS2 Server on node pvfs2-io-0-1 version 2.8.1 starting... [ OK ] Stopping PVFS2 server: cat: /var/run/pvfs2.pid: No such file or directory kill: usage: kill [-s sigspec | -n signum | -sigspec] pid | jobspec ... or kill -l [sigspec] [S 04/26 15:04] PVFS2 Server on node nanohv version 2.8.1 starting... [D 04/26 15:04] PVFS2 Server: storage space removed. Exiting. [S 04/26 15:04] PVFS2 Server on node nanohv version 2.8.1 starting... [D 04/26 15:04] PVFS2 Server: storage space created. Exiting. Starting PVFS2 server: [S 04/26 15:04] PVFS2 Server on node nanohv version 2.8.1 starting... [ OK ] variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 variables 100% 77 0.1KB/s 00:00 scp: /opt/pvfs2/conf/variables: Read-only file system variables 100% 77 0.1KB/s 00:00 Unmounting PVFS2 Filesystem: Mounting PVFS2 Filesystem: ----------------------------------------------------------------------------- what does the "Read-only file system" mean? I can copy files to the /mnt/pvfs2 folder from both the compute nodes and the server node freely. Any suggestion is appreciated. Thanks in advance. Best, Jiangjun
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
