Small correction, just recovered the machine which stopped accepting
files yesterday night, the average load was 90!!!
Am 11.12.2012 10:10, schrieb Gunnar:
Whit,
after testing for a while (after copying several 100000 files) it
seems that either glusterfs or glusternfs is crashing under load.
The the average load on the machine goes up to 8 or 9, before it was
max around 1, but there is no according process
I found a post which describes this behaviour:
http://serverfault.com/questions/365061/high-load-average-low-cpu-usage-why
So it could be that the load goes up after gluster nfs has crashed.
There is not much information in the nfs.log
[2012-12-05 21:02:18.035575] W
[socket.c:1512:__socket_proto_state_machine] 0-gv01-client-1: reading
from socket failed. Error (Transport endpoint is not connected), peer
(10.12.96.27:24009)
[2012-12-05 21:02:18.036141] I [client.c:2090:client_rpc_notify]
0-gv01-client-1: disconnected
[2012-12-05 21:02:28.780956] E [socket.c:1715:socket_connect_finish]
0-gv01-client-1: connection to 10.XXX.XXX.XXX:24009 failed (Connection
refused)
[2012-12-05 21:19:41.217198] I [glusterfsd.c:1666:main]
0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.3.1
[2012-12-05 21:19:42.389196] I [nfs.c:821:init] 0-nfs: NFS service
started
[2012-12-05 21:19:42.393121] W [graph.c:316:_log_if_unknown_option]
0-nfs-server: option 'rpc-auth.auth-glusterfs' is not recognized
[2012-12-05 21:19:42.393180] W [graph.c:316:_log_if_unknown_option]
0-nfs-server: option 'rpc-auth-allow-insecure' is not recognized
[2012-12-05 21:19:42.393212] W [graph.c:316:_log_if_unknown_option]
0-nfs-server: option 'transport-type' is not recognized
[2012-12-05 21:19:42.393269] I [client.c:2142:notify] 0-gv01-client-0:
parent translators are ready, attempting connect on transport
[2012-12-05 21:19:42.400269] I [client.c:2142:notify] 0-gv01-client-1:
parent translators are ready, attempting connect on transport
Given volfile:
+------------------------------------------------------------------------------+
Just for anybody else, this is on Centos 6.3, Samba 3.6.10
I still don't know what causes this behaviour. If anybody has an idea
how to fix it...
Thanks,
Gunnar
Am 05.12.2012 14:33, schrieb Whit Blauvelt:
Gunnar,
Second fastest is #1, nfs mount shared by Samba 4000 files in
around 6 min
Slowest is #2 where I need more than 12 min for 4000 files.
Thanks for running that test. That's a significant difference.
I wonder in the Samba > Gluster client > Gluster server scenario
whether the
slowness is the Gluster client transacting with both servers rather than
just the local one.
You've at least confirmed my suspicion that Samba > NFS > Gluster is
not at
any speed disadvantage. And in many months of running that way, as I
said,
there have been no performance complaints - although with this an
unsupported configuration it could turn out we've just been lucky and
that
there's something yet that can go wrong.
Whit
_______________________________________________
Gluster-users mailing list
[email protected]
http://supercolony.gluster.org/mailman/listinfo/gluster-users
_______________________________________________
Gluster-users mailing list
[email protected]
http://supercolony.gluster.org/mailman/listinfo/gluster-users