Hi, see here (from your stack trace): 14/05/07 23:45:42 INFO yarn.GiraphYarnClient: Defaulting per-task heap size to 1024MB. Exception in thread "main" java.lang.IllegalStateException: Giraph's estimated cluster heap 2048MB ask is greater than the current available cluster heap of 0MB. Aborting Job.
You'll need to adjust the min/max heap allocations allowed on your YARN cluster if possible. Alternately you can alter the defaults set up in the Giraph-Yarn client code and rebuild Giraph with those set differently. On Thu, May 15, 2014 at 7:56 PM, Kiru Pakkirisamy <[email protected] > wrote: > I have the same issue running giraph built with -Phadoop_yarn > -Dhadoop.version=2.2.0 on Hortonworks. > I get classnotfoundexceptions, looks like the GiraphRunner may not be able > to load the classes correctly while running on Yarn. > So if anybody has had success please share your experience, wondering what > I have been doing wrong. > > Exception in thread "main" java.lang.ClassNotFoundException: > org.apache.giraph.examples.SimpleShortestPathsComputation > > > Regards, > - kiru > > ------------------------------ > *From:* yeshwanth kumar <[email protected]> > *To:* "[email protected]" <[email protected]> > *Sent:* Thursday, May 8, 2014 4:47 AM > *Subject:* issues while running giraph on Hadoop 2.2 > > hi i am running Hortonworks hadoop 2.2 > trying to run giraph shortest path example. > i am getting this exception > > > > $ hadoop jar > giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar > org.apache.giraph.GiraphRunner > org.apache.giraph.examples.SimpleShortestPathsComputation -vif > org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat > -vip /user/hdfs/input/tiny.txt -vof > org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op > /user/hdfs/output/shortestpaths -w 1 > 14/05/07 23:45:42 INFO utils.ConfigurationUtils: No edge input format > specified. Ensure your InputFormat does not require one. > 14/05/07 23:45:42 INFO utils.ConfigurationUtils: No edge output format > specified. Ensure your OutputFormat does not require one. > 14/05/07 23:45:42 INFO yarn.GiraphYarnClient: Final output path is: > hdfs://server02.infnet:8020/user/hdfs/output/shortestpaths > 14/05/07 23:45:42 INFO yarn.GiraphYarnClient: Running Client > 14/05/07 23:45:42 INFO client.RMProxy: Connecting to ResourceManager at > server02.infnet/192.168.1.85:8050 > 14/05/07 23:45:42 INFO yarn.GiraphYarnClient: Defaulting per-task heap > size to 1024MB. > Exception in thread "main" java.lang.IllegalStateException: Giraph's > estimated cluster heap 2048MB ask is greater than the current available > cluster heap of 0MB. Aborting Job. > at > org.apache.giraph.yarn.GiraphYarnClient.checkPerNodeResourcesAvailable(GiraphYarnClient.java:230) > at org.apache.giraph.yarn.GiraphYarnClient.run(GiraphYarnClient.java:124) > at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:96) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:126) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.main(RunJar.java:212) > > > > i am missing some configuration, can someone point me in the right > direction. > > thanks, > Yeshwanth > > >
