If your input size is big, there's no way to avoid the OOM. If your size is small and you use local mode, Please check your program.
On Wed, May 14, 2014 at 7:57 AM, Attila Dóró <[email protected]> wrote: > Hi, > > I did it, but I get the same exception. > > > 2014-05-11 5:41 GMT+02:00 Edward J. Yoon <[email protected]>: > >> Hi, >> >> Please try to add following code into the hams-site.xml. >> >> <property> >> <name>bsp.child.java.opts</name> >> <value>-Xmx2024m</value> >> </property> >> >> >> On Sat, May 10, 2014 at 8:42 AM, Attila Dóró <[email protected]> wrote: >> > Hi Edward, >> > >> > It works, thanks a lot! Can you give me a short explanation what was >> wrong >> > with my code? I actually used the example from >> > this< >> http://hadoop.apache.org/docs/r2.3.0/api/org/apache/hadoop/io/Writable.html >> >page >> > as a pattern. >> > >> > Unfortunately now I get ExecutionException. I get this: >> > *java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: >> Java >> > heap space* >> > I have 8GB memory, but I can adjust just ~5GB for my virtual machine, so >> I >> > increased the HAMA_HEAPSIZE to 5000 in hama-env.sh as you suggested >> > here<https://issues.apache.org/jira/browse/HAMA-581>, >> > but I still get this exception. Does anyone have any other idea? >> > >> > >> > 2014-05-07 1:48 GMT+02:00 Edward J. Yoon <[email protected]>: >> > >> >> Hi Attila, >> >> >> >> Please try to change like below and see if it works for you: >> >> >> >> @Override >> >> public void readFields(DataInput in) throws IOException { >> >> sourceVertexID.readFields(in); >> >> edgeValue.readFields(in); >> >> destinationVertexID.readFields(in); >> >> } >> >> >> >> @Override >> >> public void write(DataOutput out) throws IOException { >> >> sourceVertexID.write(out); >> >> edgeValue.write(out); >> >> destinationVertexID.write(out); >> >> } >> >> >> >> On Sun, May 4, 2014 at 7:13 PM, Attila Dóró <[email protected]> >> wrote: >> >> > Thanks for your response, but how do you mean I can't use object >> >> > references? The SSSP example uses a lot of object references too and >> it >> >> > works. I mean for example the START_VERTEX and startVertex are both >> >> object >> >> > references, or the this is a reference too. Can't I use any of them? >> >> > >> >> > Here <http://pastebin.com/3Qetuz0Q> is the MyWritableClass. I don't >> find >> >> > any mistakes in this class. >> >> > >> >> > >> >> > 2014-05-04 8:32 GMT+02:00 Edward J. Yoon <[email protected]>: >> >> > >> >> >> I roughly read your code, and there's a bug, like >> >> >> https://issues.apache.org/jira/browse/HAMA-868. >> >> >> >> >> >> Modify you code to not use object references, and check your message >> >> >> writable class. >> >> >> >> >> >> On Sun, May 4, 2014 at 3:13 PM, Edward J. Yoon < >> [email protected]> >> >> >> wrote: >> >> >> > Hi, >> >> >> > >> >> >> > Please check whether your MyWritableClass is implemented correctly. >> >> >> > >> >> >> > On Sat, May 3, 2014 at 7:26 AM, Attila Dóró <[email protected]> >> >> >> wrote: >> >> >> >> Hi, >> >> >> >> >> >> >> >> I try to write a graph algorithm, but I get EOFException and I >> can't >> >> >> find >> >> >> >> where is the mistake. >> >> >> >> I use the SSSP< >> >> >> >> >> >> https://github.com/apache/hama/blob/trunk/examples/src/main/java/org/apache/hama/examples/SSSP.java >> >> >> > >> >> >> >> example >> >> >> >> as a base. I tried this example and it worked well. I modified the >> >> >> compute >> >> >> >> function and some other lines in the SSSP, but I didn't modify the >> >> >> >> SSSPTextReader class, which extends the VertexInputReader. I know >> >> that >> >> >> the >> >> >> >> EOFException "signals that an end of file or end of stream has >> been >> >> >> reached >> >> >> >> unexpectedly during input", but I didn't modify any reader or >> input >> >> >> method, >> >> >> >> so I don't understand how can I get this exception. >> >> >> >> >> >> >> >> In the first superstep I get the proper output, but after the >> first >> >> >> >> superstep I get this exception: >> >> >> >> >> >> >> >> java.io.EOFException >> >> >> >> at java.io.DataInputStream.readFully(DataInputStream.java:180) >> >> >> >> at java.io.DataInputStream.readFully(DataInputStream.java:152) >> >> >> >> at >> >> >> >> >> >> org.apache.hama.bsp.BSPMessageBundle$1.next(BSPMessageBundle.java:157) >> >> >> >> at >> >> >> >> >> >> org.apache.hama.bsp.BSPMessageBundle$1.next(BSPMessageBundle.java:118) >> >> >> >> at >> >> >> >> >> >> >> >> >> >> org.apache.hama.bsp.LocalBSPRunner$LocalMessageManager.transfer(LocalBSPRunner.java:361) >> >> >> >> at org.apache.hama.bsp.BSPPeerImpl.sync(BSPPeerImpl.java:381) >> >> >> >> at >> >> org.apache.hama.graph.GraphJobRunner.bsp(GraphJobRunner.java:133) >> >> >> >> at >> >> >> >> >> >> >> >> >> >> org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:258) >> >> >> >> at >> >> >> >> >> >> >> >> >> >> org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:288) >> >> >> >> at >> >> >> >> >> >> >> >> >> >> org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:212) >> >> >> >> at >> >> >> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) >> >> >> >> at java.util.concurrent.FutureTask.run(FutureTask.java:138) >> >> >> >> at >> >> >> >> >> >> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) >> >> >> >> at >> >> >> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) >> >> >> >> at java.util.concurrent.FutureTask.run(FutureTask.java:138) >> >> >> >> at >> >> >> >> >> >> >> >> >> >> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) >> >> >> >> at >> >> >> >> >> >> >> >> >> >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) >> >> >> >> at java.lang.Thread.run(Thread.java:662) >> >> >> >> >> >> >> >> I have no idea what is the problem, so if somebody could help me, >> I >> >> >> would >> >> >> >> really appreciate that. >> >> >> >> >> >> >> >> (Anyway, here <http://pastebin.com/3AHu8FnC> is my code, but I >> >> haven't >> >> >> used >> >> >> >> comment so I think it's totally incomprehensible for you) >> >> >> >> >> >> >> >> Thank you in advance for your help, >> >> >> >> Attila >> >> >> > >> >> >> > >> >> >> > >> >> >> > -- >> >> >> > Best Regards, Edward J. Yoon >> >> >> > CEO at DataSayer Co., Ltd. >> >> >> >> >> >> >> >> >> >> >> >> -- >> >> >> Best Regards, Edward J. Yoon >> >> >> CEO at DataSayer Co., Ltd. >> >> >> >> >> >> >> >> >> >> >> -- >> >> Best Regards, Edward J. Yoon >> >> CEO at DataSayer Co., Ltd. >> >> >> >> >> >> -- >> Best Regards, Edward J. Yoon >> CEO at DataSayer Co., Ltd. >> -- Best Regards, Edward J. Yoon CEO at DataSayer Co., Ltd.
