Re: [Gluster-users] gluster connection interrupted during transfer

Hi Vijay, this is an update to the 8 tests I've run so far. In short all is well. I followed your advice and created state dumps every 3 hours. 4 tests ran with the default volume options. The last 4 tests ran with all performance optimizations I could find to increase small file performance. Du

Re: [Gluster-users] gluster connection interrupted during transfer

Hi Vijay, sorry it took so long. I've upgraded the gluster server and client to the latest packages 3.12.14-1.el7.x86_64 available in CentOS. Incredibly my first test after the update worked perfectly! I'll do another couple of rsyncs, maybe apply the performance improvements again and do statedu

Re: [Gluster-users] gluster connection interrupted during transfer

Hello Richard, Thank you for the logs. I am wondering if this could be a different memory leak than the one addressed in the bug. Would it be possible for you to obtain a statedump of the client so that we can understand the memory allocation pattern better? Details about gathering a statedump ca

Re: [Gluster-users] gluster connection interrupted during transfer

Hi again, in my limited - non full time programmer - understanding it's a memory leak in the gluster fuse client. Should I reopen the mentioned bugreport or open a new one? Or would the community prefer an entirely different approach? Thanks Richard On 13.09.18 10:07, Richard Neuboeck wrote: >

Re: [Gluster-users] gluster connection interrupted during transfer

Hi, I've created excerpts from the brick and client logs +/- 1 minute to the kill event. Still the logs are ~400-500MB so will put them somewhere to download since I have no idea what I should be looking for and skimming them didn't reveal obvious problems to me. http://www.tbi.univie.ac.at/~hawk

Re: [Gluster-users] gluster connection interrupted during transfer

Hi, since I feared that the logs would fill up the partition (again) I checked the systems daily and finally found the reason. The glusterfs process on the client runs out of memory and get's killed by OOM after about four days. Since rsync runs for a couple of days longer till it ends I never che

Re: [Gluster-users] gluster connection interrupted during transfer

On Fri, Aug 31, 2018 at 11:11 AM, Richard Neuboeck wrote: > On 08/31/2018 03:50 AM, Raghavendra Gowdappa wrote: > > +Mohit. +Milind > > > > @Mohit/Milind, > > > > Can you check logs and see whether you can find anything relevant? > > From glances at the system logs nothing out of the ordinary > o

Re: [Gluster-users] gluster connection interrupted during transfer

On 08/31/2018 03:50 AM, Raghavendra Gowdappa wrote: > +Mohit. +Milind > > @Mohit/Milind, > > Can you check logs and see whether you can find anything relevant? From glances at the system logs nothing out of the ordinary occurred. However I'll start another rsync and take a closer look. It will t

Re: [Gluster-users] gluster connection interrupted during transfer

+Mohit. +Milind @Mohit/Milind, Can you check logs and see whether you can find anything relevant? On Thu, Aug 30, 2018 at 7:04 PM, Richard Neuboeck wrote: > Hi, > > I'm attaching a shortened version since the whole is about 5.8GB of > the client mount log. It includes the initial mount message

Re: [Gluster-users] gluster connection interrupted during transfer

Normally client logs will give a clue on why the disconnections are happening (ping-timeout, wrong port etc). Can you look into client logs to figure out what's happening? If you can't find anything, can you send across client logs? On Wed, Aug 29, 2018 at 6:11 PM, Richard Neuboeck wrote: > Hi G

Re: [Gluster-users] gluster connection interrupted during transfer

Hi Nithya, On 08/30/2018 09:45 AM, Nithya Balachandran wrote: > Hi Richard, > > > > On 29 August 2018 at 18:11, Richard Neuboeck > wrote: > > Hi Gluster Community, > > I have problems with a glusterfs 'Transport endpoint not connected' > connection

Re: [Gluster-users] gluster connection interrupted during transfer

Hi Richard, On 29 August 2018 at 18:11, Richard Neuboeck wrote: > Hi Gluster Community, > > I have problems with a glusterfs 'Transport endpoint not connected' > connection abort during file transfers that I can replicate (all the > time now) but not pinpoint as to why this is happening. > > T