Swap requirements

2015-03-25 Thread Abdul I Mohammed
Hello all, I am trying to figure out what are the swap requirements for name node and data nodes? Some vendor docs that I read says to set vm.swappiness to 0 which is telling kernel to not to use swap? What is the default settings the community is using for there clusters? Also does

RE: Swap requirements

2015-03-25 Thread Mich Talebzadeh
is virus free, therefore neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility. -Original Message- From: Abdul I Mohammed [mailto:oracle.bl...@gmail.com] Sent: 25 March 2015 20:45 To: HDP mailing list Subject: Swap requirements Hello all, I am trying

RE: Swap requirements

2015-03-25 Thread Mich Talebzadeh
accept any responsibility. From: max scalf [mailto:oracle.bl...@gmail.com] Sent: 25 March 2015 23:05 To: user@hadoop.apache.org Subject: Re: Swap requirements Thank you harsh. Can you please explain what you mean when u said Just simple virtual memory used by the process ? Doesn't

Re: Swap requirements

2015-03-25 Thread Harsh J
The suggestion (regarding swappiness) is not for disabling swap as much as it is to 'not using swap (until really necessary)'. When you run a constant memory-consuming service such as HBase you'd ideally want the RAM to serve up as much as it can, which setting that swappiness value helps do (the

Re: Swap requirements

2015-03-25 Thread max scalf
Thank you harsh. Can you please explain what you mean when u said Just simple virtual memory used by the process ? Doesn't virtual memory means swap? On Wednesday, March 25, 2015, Harsh J ha...@cloudera.com wrote: The suggestion (regarding swappiness) is not for disabling swap as much as it

Re: Swap requirements

2015-03-25 Thread daemeon reiydelle
] *Sent:* 25 March 2015 23:05 *To:* user@hadoop.apache.org *Subject:* Re: Swap requirements Thank you harsh. Can you please explain what you mean when u said Just simple virtual memory used by the process ? Doesn't virtual memory means swap? On Wednesday, March 25, 2015, Harsh J ha

Re: Swap requirements

2015-03-25 Thread Abdul I Mohammed
Thanks Mith...any idea about Yarn.nodemanager.Vmem-pmem-ratio parameter... If data nodes does not require swap then what about the above parameter? What is that used for in yarn?