Re: [gpfsug-discuss] Ganesha daemon has 400'000 open files - is this unusual?

2019-09-25 Thread Malahal R Naineni
ussion list Cc:Subject: [EXTERNAL] Re: [gpfsug-discuss] Ganesha daemon has 400'000 open files - is this unusual?Date: Wed, Sep 25, 2019 2:11 AM  On Tue, 24 Sep 2019 08:52:34 -, "Billich Heinrich Rainer (ID SD)" said:> Just some addition, maybe its of interest to someone:  The number of m

Re: [gpfsug-discuss] Ganesha daemon has 400'000 open files - is this unusual?

2019-09-24 Thread Valdis Klētnieks
On Tue, 24 Sep 2019 08:52:34 -, "Billich Heinrich Rainer (ID SD)" said: > Just some addition, maybe its of interest to someone: The number of max open > files for Ganesha is based on maxFilesToCache. Its. 80%of maxFilesToCache up > to > an upper and lower limits of 2000/1M. The active

Re: [gpfsug-discuss] Ganesha daemon has 400'000 open files - is this unusual?

2019-09-24 Thread Billich Heinrich Rainer (ID SD)
Hello Frederik, Just some addition, maybe its of interest to someone: The number of max open files for Ganesha is based on maxFilesToCache. Its. 80%of maxFilesToCache up to an upper and lower limits of 2000/1M. The active setting is visible in /etc/sysconfig/ganesha. Cheers, Heiner On

Re: [gpfsug-discuss] Ganesha daemon has 400'000 open files - is this unusual?

2019-09-23 Thread Billich Heinrich Rainer (ID SD)
;gpfsug-discuss@spectrumscale.org" Subject: Re: [gpfsug-discuss] Ganesha daemon has 400'000 open files - is this unusual? NFSv3 doesn't have open/close requests, so nfs-ganesha opens a file for read/write when there is an NFSv3 read/write request. It does cache file descriptors, so its open count can b

Re: [gpfsug-discuss] Ganesha daemon has 400'000 open files - is this unusual?

2019-09-23 Thread Billich Heinrich Rainer (ID SD)
Hello Frederik, Thank you. I now see a similar behavior: Ganesha has 500k open files while the node is suspended since 2+hours. I would expect that some cleanup job does remove most of the open FD after a much shorter while. Our systems have an upper limit of 1M open files per process and

Re: [gpfsug-discuss] Ganesha daemon has 400'000 open files - is this unusual?

2019-09-19 Thread Malahal R Naineni
list Cc:Subject: [EXTERNAL] [gpfsug-discuss] Ganesha daemon has 400'000 open files - is this unusual?Date: Thu, Sep 19, 2019 7:51 PM    Hello,   Is it usual to see 200’000-400’000 open files for a single ganesha process? Or does this indicate that something ist wrong?   We have some issues with ganesha (on

[gpfsug-discuss] Ganesha daemon has 400'000 open files - is this unusual?

2019-09-19 Thread Billich Heinrich Rainer (ID SD)
Hello, Is it usual to see 200’000-400’000 open files for a single ganesha process? Or does this indicate that something ist wrong? We have some issues with ganesha (on spectrum scale protocol nodes) reporting NFS3ERR_IO in the log. I noticed that the affected nodes have a large number of

Re: [gpfsug-discuss] Ganesha daemon has 400'000 open files - is this unusual?

2019-09-19 Thread Frederik Ferner
Heiner, we are seeing similar issues with CES/ganesha NFS, in our case it exclusively with NFSv3 clients. What is maxFilesToCache set to on your ganesha node(s)? In our case ganesha was running into the limit of open file descriptors because maxFilesToCache was set at a low default and for