Hello, I keep on getting a memory error, these are my configuration and their respective errors: Few questions: why is physical memory set to 1.0GB when I actually have 47G on these machines. virtual memory is also limited to 2.1, even when I define the heap to be higher?
Trying to get some clarity, these are the experiments I made: scenario 1: HADOOP_HEAPSIZE=2000 and mapred.child.java.opts is set to 2048 Error: Current usage: 585.0mb of 1.0gb physical memory used; 2.4gb of 2.1gb virtual memory used. Killing container. scenario 2: HADOOP_HEAPSIZE=3000 and mapred.child.java.opts is set to 1536 Error: Current usage: 1.1gb of 1.0gb physical memory used; 1.9gb of 2.1gb virtual memory used. Killing container. Few questions, if you have a clue about the memory settings above, and can advise for best configuration that would be very helpful. Thanks!! Thanks, Keren -- Keren Ouaknine Web: www.kereno.com
