Depending the size of the memory you are having, you ccould allocate 60-80%
of the memory for the spark worker process. Datanode doesn't require too
much memory.
On 23 Jun 2015 21:26, maxdml max...@cs.duke.edu wrote:
I'm wondering if there is a real benefit for splitting my memory in two for
I'm wondering if there is a real benefit for splitting my memory in two for
the datanode/workers.
Datanodes and OS needs memory to perform their business. I suppose there
could be loss of performance if they came to compete for memory with the
worker(s).
Any opinion? :-)
--
View this message
