Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-11 Thread Markus Shorty Uckelmann
Am 04.06.2015 um 22:18 schrieb Markus Shorty Uckelmann: Hi all, Thanks for all your help! I just found a few additional things one can or should do when investigating swap-related issues: * dmesg - always do that! * Look for a RAM-disk. These things are kernel memory. So they don't show

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-08 Thread Kwan Lowe
On Thu, Jun 4, 2015 at 4:18 PM, Markus Shorty Uckelmann sho...@koeln.de wrote: I have lots of C6 C7 machines in use and all of them have the default swappiness of 60. The problem now is that a lot of those machines do swap although there is no memory pressure. I'm now thinking about lowering

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-08 Thread Jonathan Billings
On Fri, Jun 05, 2015 at 08:40:27AM -0700, Greg Lindahl wrote: Linux does not treat various kinds of memory pages differently. If you want a daemon to be fully in core, call mlockall(). Here's one way to do that without changing the daemon's source: Another way to do this is to put the services

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-06 Thread Markus Shorty Uckelmann
Am 05.06.2015 um 23:32 schrieb Gordon Messmer: Those two things can't really both be true. If the pages swapped out are unused, then the application won't suffer as a result. Why not? If you have an application which sees action only every 12 to 24 hours,I think this can happen. Well,

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-06 Thread Markus Shorty Uckelmann
Am 06.06.2015 um 05:06 schrieb Dennis Jacobfeuerborn: That's true but it also means that if you lock that page so it cannot be swapped out then this page is not available for the page cache so you incur the i/o hit either way and it's probably going to be worse because the system has no longer

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-06 Thread Gordon Messmer
On 06/06/2015 02:23 AM, Markus Shorty Uckelmann wrote: When we start a job the first time after several hours we get a lot of timeouts. A second run mostly helps. In addition to capturing swap use before and after a run that times out, I'd cold boot all of the systems involved and see if

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-05 Thread Markus Shorty Uckelmann
Am 05.06.2015 um 00:23 schrieb Dennis Jacobfeuerborn: If I'd have to venture a guess then I'd say there are memory pages that are never touched by any processes and as a result the algorithm has decided that it's more effective to swap out these pages to disk and use the freed ram for the

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-05 Thread Greg Lindahl
On Fri, Jun 05, 2015 at 12:29:04PM +0200, Markus Shorty Uckelmann wrote: How can I further debug this problem and find out what's the culprit? It's working as designed. Linux does not treat various kinds of memory pages differently. If you want a daemon to be fully in core, call mlockall().

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-05 Thread Greg Lindahl
On Fri, Jun 05, 2015 at 09:33:11AM -0700, Gordon Messmer wrote: On 06/05/2015 03:29 AM, Markus Shorty Uckelmann wrote: some (probably unused) parts are swapped out. But, some of those parts are the salt-minion, php-fpm or mysqld. All services which are important for us and which suffer badly

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-05 Thread Markus Shorty Uckelmann
Am 05.06.2015 um 18:33 schrieb Gordon Messmer: On 06/05/2015 03:29 AM, Markus Shorty Uckelmann wrote: some (probably unused) parts are swapped out. But, some of those parts are the salt-minion, php-fpm or mysqld. All services which are important for us and which suffer badly from being swapped

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-05 Thread Gordon Messmer
On 06/05/2015 03:29 AM, Markus Shorty Uckelmann wrote: some (probably unused) parts are swapped out. But, some of those parts are the salt-minion, php-fpm or mysqld. All services which are important for us and which suffer badly from being swapped out. Those two things can't really both be

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-05 Thread Greg Lindahl
On Fri, Jun 05, 2015 at 09:21:43PM +0200, Markus Shorty Uckelmann wrote: If you don't explicitly lock things into memory, file I/O can and will cause idle pages to get pushed out. It happens less often if you manipulate swappines. So, is a swappiness value of 60 not recommended for servers?

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-05 Thread Markus Shorty Uckelmann
Am 05.06.2015 um 17:40 schrieb Greg Lindahl: On Fri, Jun 05, 2015 at 12:29:04PM +0200, Markus Shorty Uckelmann wrote: How can I further debug this problem and find out what's the culprit? It's working as designed. Sadly. It is just my first time I see this behaviour to this extent/on so

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-05 Thread Gordon Messmer
On 06/05/2015 12:09 PM, Markus Shorty Uckelmann wrote: Am 05.06.2015 um 18:33 schrieb Gordon Messmer: On 06/05/2015 03:29 AM, Markus Shorty Uckelmann wrote: some (probably unused) parts are swapped out. But, some of those parts are the salt-minion, php-fpm or mysqld. All services which are

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-05 Thread Dennis Jacobfeuerborn
On 05.06.2015 19:47, Greg Lindahl wrote: On Fri, Jun 05, 2015 at 09:33:11AM -0700, Gordon Messmer wrote: On 06/05/2015 03:29 AM, Markus Shorty Uckelmann wrote: some (probably unused) parts are swapped out. But, some of those parts are the salt-minion, php-fpm or mysqld. All services which are

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-05 Thread Dennis Jacobfeuerborn
On 06.06.2015 04:48, Dennis Jacobfeuerborn wrote: On 05.06.2015 19:47, Greg Lindahl wrote: On Fri, Jun 05, 2015 at 09:33:11AM -0700, Gordon Messmer wrote: On 06/05/2015 03:29 AM, Markus Shorty Uckelmann wrote: some (probably unused) parts are swapped out. But, some of those parts are the

Re: [CentOS] Effectiveness of CentOS vm.swappiness

2015-06-04 Thread Dennis Jacobfeuerborn
On 04.06.2015 22:18, Markus Shorty Uckelmann wrote: Hi all, This might not be CentOS related at all. Sorry about that. I have lots of C6 C7 machines in use and all of them have the default swappiness of 60. The problem now is that a lot of those machines do swap although there is no

[CentOS] Effectiveness of CentOS vm.swappiness

2015-06-04 Thread Markus Shorty Uckelmann
Hi all, This might not be CentOS related at all. Sorry about that. I have lots of C6 C7 machines in use and all of them have the default swappiness of 60. The problem now is that a lot of those machines do swap although there is no memory pressure. I'm now thinking about lowering swappiness to