Re: [Gluster-users] Write operations failing on clients

2015-05-06 Thread Alex
Ben Turner bturner@... writes: Are all writes failing or just writes to certain places? When problem occur I've done basic testing such as creating directory and successfully copied small file to it. Looks like writes only to some places caused problem. To me it sounds like rebalance was run,

Re: [Gluster-users] Write operations failing on clients

2015-05-06 Thread Ben Turner
- Original Message - From: Alex ale...@icecat.biz To: gluster-users@gluster.org Sent: Wednesday, May 6, 2015 3:55:15 AM Subject: Re: [Gluster-users] Write operations failing on clients Ben Turner bturner@... writes: Are all writes failing or just writes to certain places

Re: [Gluster-users] Write operations failing on clients

2015-05-06 Thread Susant Palai
, 2015 11:09:08 PM Subject: Re: [Gluster-users] Write operations failing on clients - Original Message - From: Alex ale...@icecat.biz To: gluster-users@gluster.org Sent: Wednesday, May 6, 2015 3:55:15 AM Subject: Re: [Gluster-users] Write operations failing on clients Ben Turner

Re: [Gluster-users] Write operations failing on clients

2015-05-01 Thread Ben Turner
- Original Message - From: Alex ale...@icecat.biz To: gluster-users@gluster.org Sent: Friday, May 1, 2015 5:47:29 AM Subject: Re: [Gluster-users] Write operations failing on clients Are your files split brained: gluster v heal img info split-brain I see alot of problem with your

Re: [Gluster-users] Write operations failing on clients

2015-05-01 Thread Alex
Are your files split brained: gluster v heal img info split-brain I see alot of problem with your self heal daemon connecting: As far as I can see nodes are not split brained: # gluster v heal img info split-brain Gathering list of split brain entries on

Re: [Gluster-users] Write operations failing on clients

2015-04-30 Thread Alex
Okay, I did some digging. On the client there was many errors such as: [2015-04-29 15:47:08.700174] W [client-rpc-fops.c:2774:client3_3_lookup_cbk] 0-img-client-0: remote operation failed: Transport endpoint is not connected. Path: /www/img/gallery/9722926_4130.jpg

Re: [Gluster-users] Write operations failing on clients

2015-04-30 Thread Alex
Ben Turner bturner@... writes: - Original Message - From: Alex alex.m@... To: gluster-users@... Sent: Thursday, April 30, 2015 6:52:58 AM Subject: Re: [Gluster-users] Write operations failing on clients Okay, I did some digging. On the client there was many errors

Re: [Gluster-users] Write operations failing on clients

2015-04-30 Thread Ben Turner
- Original Message - From: Alex ale...@icecat.biz To: gluster-users@gluster.org Sent: Thursday, April 30, 2015 6:52:58 AM Subject: Re: [Gluster-users] Write operations failing on clients Okay, I did some digging. On the client there was many errors such as: [2015-04-29 15:47

Re: [Gluster-users] Write operations failing on clients

2015-04-30 Thread Alex
Oh and this is output of some status commands: http://termbin.com/bvzz Mount\umount worked just fine. Alex ___ Gluster-users mailing list Gluster-users@gluster.org http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Write operations failing on clients

2015-04-30 Thread Ben Turner
- Original Message - From: Alex ale...@icecat.biz To: gluster-users@gluster.org Sent: Thursday, April 30, 2015 6:52:58 AM Subject: Re: [Gluster-users] Write operations failing on clients Okay, I did some digging. On the client there was many errors such as: [2015-04-29 15:47

[Gluster-users] Write operations failing on clients

2015-04-30 Thread Alex
Hello. We've been using glusterfs for five months without any problems until yesterday: suddenly all clients who tried to write something began to hang with D status (waiting for disk). Also at the same time gluster nodes began to consume very high CPU which never happened before. htop command

Re: [Gluster-users] Write operations failing on clients

2015-04-30 Thread Ben Turner
if you see any split brained files. -b - Original Message - From: Alex ale...@icecat.biz To: gluster-users@gluster.org Sent: Thursday, April 30, 2015 9:26:04 AM Subject: Re: [Gluster-users] Write operations failing on clients Oh and this is output of some status commands: http

Re: [Gluster-users] Write operations failing on clients

2015-04-30 Thread Ben Turner
:10:39 PM Subject: Re: [Gluster-users] Write operations failing on clients Are your files split brained: gluster v heal img info split-brain I see alot of problem with your self heal daemon connecting: [2015-04-29 16:15:37.137215] E [socket.c:2161:socket_connect_finish] 0-img-client-4