Hi, Update on this one. I was able to resolve this error with the patch here: https://issues.apache.org/jira/browse/GIRAPH-391
Thanks, Tripti. From: "Yahoo! Inc." <[email protected]<mailto:[email protected]>> Reply-To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Date: Monday, October 22, 2012 5:19 PM To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Subject: Re: _zkServer does not Exist Hi, I am trying to build Giraph with Hadoop_0.23 profile. When I try to run the PageRankBenchmark, I get the following error: Cmd> hadoop jar giraph-0.71-SNAPSHOT-for-hadoop-0.23.4.1210022201-jar-with-dependencies.jar org.apache.giraph.benchmark.PageRankBenchmark -Dmapred.job.tracker=<host:port> -Dgiraph.zkManagerDirectory='/tmp/giraph/cc/_bsp/_defaultZkManagerDir' -c 1 -e 2 -s 2 -V 10 -w 1 2012-10-22 10:53:33,446 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: yarn.app.mapreduce.am.job.client.port-range; Ignoring. 2012-10-22 10:53:33,446 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.admin.reduce.child.java.opts; Ignoring. 2012-10-22 10:53:33,447 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: hadoop.tmp.dir; Ignoring. 2012-10-22 10:53:33,561 INFO [main] org.apache.giraph.graph.GraphMapper: setup: Set log level to info 2012-10-22 10:53:33,561 INFO [main] org.apache.giraph.graph.GraphMapper: Distributed cache is empty. Assuming fatjar. 2012-10-22 10:53:33,561 INFO [main] org.apache.giraph.graph.GraphMapper: setup: classpath @ {path}/job.jar for job org.apache.giraph.benchmark.PageRankBenchmark 2012-10-22 10:53:33,564 WARN [main] org.apache.hadoop.conf.Configuration: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 2012-10-22 10:53:33,564 WARN [main] org.apache.hadoop.conf.Configuration: mapred.job.id is deprecated. Instead, use mapreduce.job.id 2012-10-22 10:53:33,564 WARN [main] org.apache.hadoop.conf.Configuration: job.local.dir is deprecated. Instead, use mapreduce.job.local.dir 2012-10-22 10:53:33,565 INFO [main] org.apache.giraph.zk.ZooKeeperManager: createCandidateStamp: Made the directory /tmp/giraph/cc/_bsp/_defaultZkManagerDir 2012-10-22 10:53:33,568 INFO [main] org.apache.giraph.zk.ZooKeeperManager: createCandidateStamp: Creating my filestamp /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_task/gsrd215n08.red.ygrid.yahoo.com 1 2012-10-22 10:53:33,601 INFO [main] org.apache.giraph.zk.ZooKeeperManager: getZooKeeperServerList: For task 1, got file 'zkServerList_gsrd208n08.red.ygrid.yahoo.com 0 ' (polling period is 3000) 2012-10-22 10:53:33,601 INFO [main] org.apache.giraph.zk.ZooKeeperManager: getZooKeeperServerList: Found [gsrd208n08.red.ygrid.yahoo.com, 0] 2 hosts in filename 'zkServerList_gsrd208n08.red.ygrid.yahoo.com 0 ' 2012-10-22 10:53:33,603 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.IllegalStateException: run: Caught an unrecoverable exception java.io.FileNotFoundException: File /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer does not exist. at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:595) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:725) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:157) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1212) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:152) Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: File /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer does not exist. at org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:796) at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:328) at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:573) ... 7 more Caused by: java.io.FileNotFoundException: File /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer does not exist. at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:362) at org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:755) ... 9 more 2012-10-22 10:53:33,607 INFO [main] org.apache.hadoop.mapred.Task: Runnning cleanup for the task 2012-10-22 10:53:33,609 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping MapTask metrics system... 2012-10-22 10:53:33,610 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system stopped. 2012-10-22 10:53:33,610 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system shutdown complete. How can I resolve this. Thanks, Tripti.
