Hi,

>>> I am running hadoop-0.20.1.
>>> conf/hadoop-env.sh have default setting, excluding one "JAVA_HOME".

>>> Failed with 2 such nodes:
>>> 1) VPS, 64bit, 3.5GB RAM
>>> 2) VPS, 64bit, 2.5GB RAM
>>> (all - gentoo linux, hardware - 1 server, 16 Xeons, 16GB)
>>
>> Which VPS mechanism do you use? OpenVZ? Xen? kvm? What exactly to they
>> limit (when you write "3.5GB RAM" and "2.5GB RAM" - what kind of
>
> OpenVZ,
> "What kind of memory is it" -> http://savepic.ru/926211.jpg (don't
> understand question)

OpenVZ allows you to limit 6 different "kinds" of memory:

            lockedpages
            privvmpages
            shmpages
            physpages
            vmguarpages
            oomguarpages

What exactly to do limit? "privvmpages"? Have you checked OpenVZ bean
counters for processes hitting the limit in your VPSes?

Generally, if we won't go into the details, OpenVZ "privvmpages" and
having X megabytes of physical RAM in physical system is two very
different things. If you use "privvmpages", you effectively limit the
available address space of all processes inside VPS that they can
_allocate_. Java applications are fairly sensitive to this - if, for
example, you will run Java machines with -Xmx1024M in your "2.5GB RAM"
VPS, and it's really "2.5GB worth of privvmpages", you'd likely would
be able to run only 2 jvms: third one would fail mysteriously by
hitting the limit.

-- 
WBR, Mikhail Yakshin

Reply via email to