Hi, I'm trying to run a Giraph Job having 60,000 nodes and 20,000,000 edges [highly connected].
Cluster consists of 4 nodes each with 17 GB RAM. I'm running only one worker per node and a master [so that'll be 1 Master & 3 Workers] I keep getting the java.lang.StackOverflowError in one of the workers. Here is the log:- 2013-12-02 12:14:48,698 WARN org.apache.hadoop.mapred.Child: Error running child java.lang.IllegalStateException: run: Caught an unrecoverable exception waitFor: ExecutionException occurred while waiting for org.apache.giraph.utils.ProgressableUtils$FutureWaitable@928dc74 at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:102) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: java.lang.IllegalStateException: waitFor: ExecutionException occurred while waiting for org.apache.giraph.utils.ProgressableUtils$FutureWaitable@928dc74 at org.apache.giraph.utils.ProgressableUtils.waitFor(ProgressableUtils.java:151) at org.apache.giraph.utils.ProgressableUtils.waitForever(ProgressableUtils.java:111) at org.apache.giraph.utils.ProgressableUtils.getFutureResult(ProgressableUtils.java:73) at org.apache.giraph.utils.ProgressableUtils.getResultsWithNCallables(ProgressableUtils.java:192) at org.apache.giraph.graph.GraphTaskManager.processGraphPartitions(GraphTaskManager.java:753) at org.apache.giraph.graph.GraphTaskManager.execute(GraphTaskManager.java:273) at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:92) ... 7 more Caused by: java.util.concurrent.ExecutionException: java.lang.StackOverflowError at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:262) at java.util.concurrent.FutureTask.get(FutureTask.java:119) at org.apache.giraph.utils.ProgressableUtils$FutureWaitable.waitFor(ProgressableUtils.java:271) at org.apache.giraph.utils.ProgressableUtils.waitFor(ProgressableUtils.java:143) ... 13 more Caused by: java.lang.StackOverflowError at com.google.common.collect.Iterables$3.hasNext(Iterables.java:504) at com.google.common.collect.Iterators$5.hasNext(Iterators.java:543) at com.google.common.collect.Iterators$5.hasNext(Iterators.java:543) at com.google.common.collect.Iterators$5.hasNext(Iterators.java:543) <goes on for about 1000 times> at com.google.common.collect.Iterators$5.hasNext(Iterators.java:543) 2013-12-02 12:14:48,740 INFO org.apache.hadoop.mapred.Task: Runnning cleanup for the task Any help appreciated. -- Thanks, Sundar
