Hi,
I am trying to build Giraph with Hadoop_0.23 profile.
When I try to run the PageRankBenchmark, I get the following error:
Cmd> hadoop jar
giraph-0.71-SNAPSHOT-for-hadoop-0.23.4.1210022201-jar-with-dependencies.jar
org.apache.giraph.benchmark.PageRankBenchmark
-Dmapred.job.tracker=<host:port>
-Dgiraph.zkManagerDirectory='/tmp/giraph/cc/_bsp/_defaultZkManagerDir' -c 1 -e
2 -s 2 -V 10 -w 1
2012-10-22 10:53:33,446 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
yarn.app.mapreduce.am.job.client.port-range; Ignoring.
2012-10-22 10:53:33,446 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.admin.reduce.child.java.opts; Ignoring.
2012-10-22 10:53:33,447 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter: hadoop.tmp.dir; Ignoring.
2012-10-22 10:53:33,561 INFO [main] org.apache.giraph.graph.GraphMapper: setup:
Set log level to info
2012-10-22 10:53:33,561 INFO [main] org.apache.giraph.graph.GraphMapper:
Distributed cache is empty. Assuming fatjar.
2012-10-22 10:53:33,561 INFO [main] org.apache.giraph.graph.GraphMapper: setup:
classpath @ {path}/job.jar for job org.apache.giraph.benchmark.PageRankBenchmark
2012-10-22 10:53:33,564 WARN [main] org.apache.hadoop.conf.Configuration:
mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2012-10-22 10:53:33,564 WARN [main] org.apache.hadoop.conf.Configuration:
mapred.job.id is deprecated. Instead, use mapreduce.job.id
2012-10-22 10:53:33,564 WARN [main] org.apache.hadoop.conf.Configuration:
job.local.dir is deprecated. Instead, use mapreduce.job.local.dir
2012-10-22 10:53:33,565 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
createCandidateStamp: Made the directory
/tmp/giraph/cc/_bsp/_defaultZkManagerDir
2012-10-22 10:53:33,568 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
createCandidateStamp: Creating my filestamp
/tmp/giraph/cc/_bsp/_defaultZkManagerDir/_task/gsrd215n08.red.ygrid.yahoo.com 1
2012-10-22 10:53:33,601 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
getZooKeeperServerList: For task 1, got file
'zkServerList_gsrd208n08.red.ygrid.yahoo.com 0 ' (polling period is 3000)
2012-10-22 10:53:33,601 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
getZooKeeperServerList: Found [gsrd208n08.red.ygrid.yahoo.com, 0] 2 hosts in
filename 'zkServerList_gsrd208n08.red.ygrid.yahoo.com 0 '
2012-10-22 10:53:33,603 WARN [main] org.apache.hadoop.mapred.YarnChild:
Exception running child : java.lang.IllegalStateException: run: Caught an
unrecoverable exception java.io.FileNotFoundException: File
/tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer does not exist.
at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:595)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:725)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:157)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1212)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:152)
Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: File
/tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer does not exist.
at
org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:796)
at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:328)
at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:573)
... 7 more
Caused by: java.io.FileNotFoundException: File
/tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer does not exist.
at
org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:362)
at
org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:755)
... 9 more
2012-10-22 10:53:33,607 INFO [main] org.apache.hadoop.mapred.Task: Runnning
cleanup for the task
2012-10-22 10:53:33,609 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping MapTask metrics
system...
2012-10-22 10:53:33,610 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system
stopped.
2012-10-22 10:53:33,610 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system
shutdown complete.
How can I resolve this.
Thanks,
Tripti.
