Mikhail,
I think your mount command should be:
sudo mount -t pvfs2 ib://opt04:3335/pvfs2-fs /mnt/pvfs2
Or, if you have an entry in /etc/fstab, you can just do:
sudo mount -t pvfs2 /mnt/pvfs2
I'm not sure why some of your commands were trying to address the
server using tcp:// -- it looks like you have everything in /etc/pvfs2-
fs.conf configured to use ib only, and the first part of the server
path specifies which protocol to connect with (e.g "tcp://", "mx://",
"ib://", etc.)
Also, when running pvfs2-ping, I think you can do either:
orangefs-bin/bin/pvfs2-ping -m /mnt/pvfs2
Which will look up the address of the server based on /etc/pvfs2tab
Or you can do:
orangefs-bin/bin/pvfs2-ping -m ib://opt04:3335/pvfs2-fs
Which will specify the path to the server directly.
However, since the pvfs2-ping program doesn't look at your /etc/pvfs2-
fs.conf file, it would have no way of knowing what server to contact
to find "pvfs2-fs" as you tried with:
[mix@opt08 ~]$ orangefs-bin/bin/pvfs2-ping -m pvfs2-fs
Try mounting with the first mount command given above (giving the full
ib:// path to the server as well as the mount point).
Josh.
On 27 May 2011, at 19:26, Михаил Гильмендинов wrote:
Hi!
I have a problem with mounting orangefs.
I load kernel modules on all server and client nodes and
successfully create storage spaces on
servers(opt02-opt04) and run servers.
on client nodes(opt06, opt08) I run pvfs2-clients, but i can't mount
orangefs:
[mix@opt08 ~]$ sudo mount -t pvfs2 tcp://opt04:3335/pvfs-fs /mnt/pvfs2
mount: Resource temporarily unavailable
[mix@opt08 ~]$ sudo mount -t pvfs2 tcp://opt04:3335/pvfs-fs /mnt/pvfs2
mount: Broken pipe
i got "Resource temporarily unavailable" when i try to mount first
time
and "Broken pipe" when rtying to mount more times. server outputs
nothing
when "Resource temporarily unavailable" and outputs that otherwise:
[S 05/27/2011 15:31:28] PVFS2 Server on node opt04 version 2.8.4-
orangefs
starting...
[S 05/27/2011 15:31:28] PVFS2 Server ready.
[E 05/27/2011 16:05:31] Warning: exchange_data: write: Connection
reset by
peer.
[E 05/27/2011 16:05:33] Warning: exchange_data: write: Connection
reset by
peer.
[E 05/27/2011 16:05:35] Warning: exchange_data: write: Connection
reset by
peer.
[E 05/27/2011 16:05:37] Warning: exchange_data: write: Connection
reset by
peer.
[E 05/27/2011 16:05:39] Warning: exchange_data: write: Connection
reset by
peer.
when i run pvfs2-ping with -m /mnt/pvfs2 it work without errors:
[mix@opt08 ~]$ orangefs-bin/bin/pvfs2-ping -m /mnt/pvfs2
(1) Parsing tab file...
(2) Initializing system interface...
(3) Initializing each file system found in tab file: /etc/pvfs2tab...
PVFS2 servers: ib://opt02:3335
Storage name: pvfs2-fs
Local mount point: /mnt/pvfs2
/mnt/pvfs2: Ok
(4) Searching for /mnt/pvfs2 in pvfstab...
PVFS2 servers: ib://opt02:3335
Storage name: pvfs2-fs
Local mount point: /mnt/pvfs2
meta servers:
ib://opt02:3335
ib://opt03:3335
ib://opt04:3335
data servers:
ib://opt02:3335
ib://opt03:3335
ib://opt04:3335
(5) Verifying that all servers are responding...
meta servers:
ib://opt02:3335 Ok
ib://opt03:3335 Ok
ib://opt04:3335 Ok
data servers:
ib://opt02:3335 Ok
ib://opt03:3335 Ok
ib://opt04:3335 Ok
(6) Verifying that fsid 1317030806 is acceptable to all servers...
Ok; all servers understand fs_id 1317030806
(7) Verifying that root handle is owned by one server...
Root handle: 1048576
Ok; root handle is owned by exactly one server.
=============================================================
The PVFS2 filesystem at /mnt/pvfs2 appears to be correctly configured.
but:
[mix@opt08 ~]$ orangefs-bin/bin/pvfs2-ping -m pvfs2-fs
(1) Parsing tab file...
(2) Initializing system interface...
(3) Initializing each file system found in tab file: /etc/pvfs2tab...
PVFS2 servers: ib://opt02:3335
Storage name: pvfs2-fs
Local mount point: /mnt/pvfs2
/mnt/pvfs2: Ok
(4) Searching for pvfs2-fs in pvfstab...
Failure: could not find filesystem for pvfs2-fs in pvfs2tab /etc/
pvfs2tab
Entry 0: /mnt/pvfs2
and that is right because i cant mount fs.
and there is client log file:
[E 16:32:05.713905] PVFS Client Daemon Started. Version 2.8.4-orangefs
[D 16:32:05.759078] [INFO]: Mapping pointer 0x2aaaaaabc000 for I/O.
[D 16:32:05.762098] [INFO]: Mapping pointer 0x6ca000 for I/O.
[E 16:32:20.511299] Warning: msgpair failed to tcp://opt04:3335, will
retry: Resource temporarily unavailable
[E 16:32:22.515312] Warning: msgpair failed to tcp://opt04:3335, will
retry: Resource temporarily unavailable
[E 16:32:24.518362] Warning: msgpair failed to tcp://opt04:3335, will
retry: Resource temporarily unavailable
[E 16:32:26.526413] Warning: msgpair failed to tcp://opt04:3335, will
retry: Resource temporarily unavailable
[E 16:32:28.529464] Warning: msgpair failed to tcp://opt04:3335, will
retry: Resource temporarily unavailable
[E 16:32:30.532515] Warning: msgpair failed to tcp://opt04:3335, will
retry: Resource temporarily unavailable
[E 16:32:30.532549] *** msgpairarray_completion_fn: msgpair to server
[UNKNOWN] failed: Resource temporarily unavailable
[E 16:32:30.532574] *** Out of retries.
[E 16:32:30.532629] Failed to mount via host tcp://opt04:3335
[E 16:32:30.532662] Mount failed: Resource temporarily unavailable
[E 16:32:33.247302] Error: incomplete BMI TCP header after 10 seconds,
closing connection.
[E 16:32:33.248594] Warning: msgpair failed to tcp://opt04:3335, will
retry: Broken pipe
[E 16:32:35.249386] Error: incomplete BMI TCP header after 10 seconds,
closing connection.
[E 16:32:35.250634] Warning: msgpair failed to tcp://opt04:3335, will
retry: Broken pipe
[E 16:32:37.251180] Error: incomplete BMI TCP header after 10 seconds,
closing connection.
[E 16:32:37.252684] Warning: msgpair failed to tcp://opt04:3335, will
retry: Broken pipe
[E 16:32:39.259260] Error: incomplete BMI TCP header after 10 seconds,
closing connection.
[E 16:32:39.259738] Warning: msgpair failed to tcp://opt04:3335, will
retry: Broken pipe
[E 16:32:41.270296] Error: incomplete BMI TCP header after 10 seconds,
closing connection.
[E 16:32:41.271787] Warning: msgpair failed to tcp://opt04:3335, will
retry: Broken pipe
[E 16:32:43.278358] Error: incomplete BMI TCP header after 10 seconds,
closing connection.
[E 16:32:43.278840] Warning: msgpair failed to tcp://opt04:3335, will
retry: Broken pipe
[E 16:32:43.278868] *** msgpairarray_completion_fn: msgpair to server
[UNKNOWN] failed: Broken pipe
[E 16:32:43.278893] *** Out of retries.
[E 16:32:43.278934] Failed to mount via host tcp://opt04:3335
[E 16:32:43.278959] Mount failed: Broken pipe
and there is nothing in server log on any server node.
centos 5.5 with 2.6.18 kernel installed on cluster .
What can be a problem?
Thanks,
Mikhail Gilmendinov.
_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
