Hello,

I have mappers that do not need much ram but combiners and reducers need a lot.
Is it possible to set different VM parameters for mappers and reducers?



PS Often I face interesting problem, on same set of data I
recieve I have java.lang.OutOfMemoryError: Java heap space in combiner
but it happens not all the time.
What could be cause of such behavior?
My personal opinion is that I have

mapred.job.reuse.jvm.num.tasks=-1 and jvm GC doesn't always start when
it should.

Thanks in Advance,
Vitaliy S

Reply via email to