Re: [Gluster-users] [External] Re: file metadata operations performance - gluster 4.1

2018-08-30 Thread Raghavendra Gowdappa
On Thu, Aug 30, 2018 at 8:38 PM, Davide Obbi wrote: > yes "performance.parallel-readdir on and 1x3 replica > That's surprising. I thought performance.parallel-readdir will help only when distribute count is fairly high. This is something worth investigating further. > On Thu, Aug 30, 2018 at

Re: [Gluster-users] [External] Re: file metadata operations performance - gluster 4.1

2018-08-30 Thread Davide Obbi
yes "performance.parallel-readdir on and 1x3 replica On Thu, Aug 30, 2018 at 5:00 PM Raghavendra Gowdappa wrote: > > > On Thu, Aug 30, 2018 at 8:08 PM, Davide Obbi > wrote: > >> Thanks Amar, >> >> i have enabled the negative lookups cache on the volume: >> >> To deflate a tar archive (not

Re: [Gluster-users] [External] Re: file metadata operations performance - gluster 4.1

2018-08-30 Thread Poornima Gurusiddaiah
To enable nl-cache please use group option instead of single volume set: #gluster vol set VOLNAME group nl-cache This sets few other things including time out, invalidation etc. For enabling the option Raghavendra mentioned, you ll have to execute it explicitly, as it's not part of group option

Re: [Gluster-users] gluster 3.12.8 fuse consume huge memory

2018-08-30 Thread Nithya Balachandran
Hi, Please take statedumps of the 3.12.13 client process at intervals when the memory is increasing and send those across. We will also need the gluster volume info for the volume int question. Thanks, Nithya On 31 August 2018 at 08:32, huting3 wrote: > Thanks for your reply, I also test

Re: [Gluster-users] Upgrade to 4.1.2 geo-replication does not work

2018-08-30 Thread Kotresh Hiremath Ravishankar
On Thu, Aug 30, 2018 at 3:51 PM, Krishna Verma wrote: > Hi Kotresh, > > > > Yes, this include the time take to write 1GB file to master. geo-rep was > not stopped while the data was copying to master. > This way, you can't really measure how much time geo-rep took. > > But now I am trouble,

Re: [Gluster-users] Upgrade to 4.1.2 geo-replication does not work

2018-08-30 Thread Kotresh Hiremath Ravishankar
On Thu, Aug 30, 2018 at 4:55 PM, Krishna Verma wrote: > Hi Kotresh, > > > > 1. Time to write 1GB to master: 27 minutes and 29 seconds > > 2. Time for geo-rep to transfer 1GB to slave. 8 minutes > This is hard to believe, considering there is no distribution and there is

Re: [Gluster-users] gluster connection interrupted during transfer

2018-08-30 Thread Raghavendra Gowdappa
+Mohit. +Milind @Mohit/Milind, Can you check logs and see whether you can find anything relevant? On Thu, Aug 30, 2018 at 7:04 PM, Richard Neuboeck wrote: > Hi, > > I'm attaching a shortened version since the whole is about 5.8GB of > the client mount log. It includes the initial mount

Re: [Gluster-users] gluster connection interrupted during transfer

2018-08-30 Thread Richard Neuboeck
On 08/31/2018 03:50 AM, Raghavendra Gowdappa wrote: > +Mohit. +Milind > > @Mohit/Milind, > > Can you check logs and see whether you can find anything relevant? From glances at the system logs nothing out of the ordinary occurred. However I'll start another rsync and take a closer look. It will

Re: [Gluster-users] gluster 3.12.8 fuse consume huge memory

2018-08-30 Thread huting3
Thanks for your reply, I also test gluster 3.12.13 and found the client also consumes huge memory:PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND180095 root      20   0 4752256 4.091g   4084 S  43.5  1.6  17:54.70 glusterfsI read and write some

[Gluster-users] gluster 3.12.8 fuse consume huge memory

2018-08-30 Thread huting3
The version of glusterfs I installed is 3.12.8, and I find it`s client also consume huge memory.I dumped the statedump file, and I found the size of a variable is extreamly huge like below:[mount/fuse.fuse - usage-type gf_fuse_mt_iov_base memusage]   49805 size=4250821416  

Re: [Gluster-users] Upgrade to 4.1.2 geo-replication does not work

2018-08-30 Thread Kotresh Hiremath Ravishankar
On Thu, Aug 30, 2018 at 1:52 PM, Krishna Verma wrote: > Hi Kotresh, > > > > After fix the library link on node "noi-poc-gluster ", the status of one > mater node is “Active” and another is “Passive”. Can I setup both the > master as “Active” ? > Nope, since it's replica, it's redundant to sync

Re: [Gluster-users] gluster connection interrupted during transfer

2018-08-30 Thread Nithya Balachandran
Hi Richard, On 29 August 2018 at 18:11, Richard Neuboeck wrote: > Hi Gluster Community, > > I have problems with a glusterfs 'Transport endpoint not connected' > connection abort during file transfers that I can replicate (all the > time now) but not pinpoint as to why this is happening. > >

Re: [Gluster-users] Upgrade to 4.1.2 geo-replication does not work

2018-08-30 Thread Krishna Verma
Hi Kotresh, Yes, this include the time take to write 1GB file to master. geo-rep was not stopped while the data was copying to master. But now I am trouble, My putty session was timed out while copying data to master and geo replication was active. After I restart putty session My Master

Re: [Gluster-users] Upgrade to 4.1.2 geo-replication does not work

2018-08-30 Thread Krishna Verma
Hi Kotresh, Just to update for sync issue. I erased the indexing by doing gluster volume set indexing off, after stopping the geo-rep session and then start the session. Now its syncing. For your query: Yes, this include the time take to write 1GB file to master. geo-rep was not stopped

Re: [Gluster-users] Upgrade to 4.1.2 geo-replication does not work

2018-08-30 Thread Krishna Verma
Hi Kotresh, 1. Time to write 1GB to master: 27 minutes and 29 seconds 2. Time for geo-rep to transfer 1GB to slave. 8 minutes /Krishna From: Kotresh Hiremath Ravishankar Sent: Thursday, August 30, 2018 3:20 PM To: Krishna Verma Cc: Sunny Kumar ; Gluster Users Subject: Re:

Re: [Gluster-users] gluster connection interrupted during transfer

2018-08-30 Thread Richard Neuboeck
Hi Nithya, On 08/30/2018 09:45 AM, Nithya Balachandran wrote: > Hi Richard, > > > > On 29 August 2018 at 18:11, Richard Neuboeck > wrote: > > Hi Gluster Community, > > I have problems with a glusterfs 'Transport endpoint not connected' > connection

Re: [Gluster-users] gluster 3.12.8 fuse consume huge memory

2018-08-30 Thread Darrell Budic
It’s probably https://bugzilla.redhat.com/show_bug.cgi?id=1593826 , although I did not encounter it in 3.12.8, only 3.12.9 - 12. It’s fixed in 3.12.13. > From: huting3 > Subject: [Gluster-users] gluster 3.12.8 fuse consume huge memory >

Re: [Gluster-users] gluster connection interrupted during transfer

2018-08-30 Thread Raghavendra Gowdappa
Normally client logs will give a clue on why the disconnections are happening (ping-timeout, wrong port etc). Can you look into client logs to figure out what's happening? If you can't find anything, can you send across client logs? On Wed, Aug 29, 2018 at 6:11 PM, Richard Neuboeck wrote: > Hi

Re: [Gluster-users] Upgrade to 4.1.2 geo-replication does not work

2018-08-30 Thread Krishna Verma
Hi Kotresh, After fix the library link on node "noi-poc-gluster ", the status of one mater node is “Active” and another is “Passive”. Can I setup both the master as “Active” ? Also, when I copy a 1GB size of file from gluster client to master gluster volume which is replicated with the slave

Re: [Gluster-users] [External] Re: file metadata operations performance - gluster 4.1

2018-08-30 Thread Raghavendra Gowdappa
On Thu, Aug 30, 2018 at 8:08 PM, Davide Obbi wrote: > Thanks Amar, > > i have enabled the negative lookups cache on the volume: > > To deflate a tar archive (not compressed) of 1.3GB it takes aprox 9mins > which can be considered a slight improvement from the previous 12-15 > however still not