hadoop map reduce: additional heap space?

Fri, 27 Jun 2008 16:26:47 -0700 

hey all,
i was wondering if theres a way to allocate more heap space for each mapper and reducer process that hadoop spawns. i'm getting this error: 

java.lang.OutOfMemoryError: Java heap space
        at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:95)
        at java.io.DataOutputStream.write(DataOutputStream.java:90)
        at java.io.DataOutputStream.writeUTF(DataOutputStream.java:384)
        at java.io.DataOutputStream.writeUTF(DataOutputStream.java:306)
...

(i've written a custom class to use as the key/value pairs)

does anybody know how to allocate more heap space?? thanks!






















					Reply via email to