On Hadoop 1.2.1, and Giraph 1.1.0 I tried following command
hadoop jar
$GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-for-hadoop-1.2.1-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.SimpleShortestPathsComputation -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip
/user/puneet/input/tiny_graph.txt -vof
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/puneet/output/shortestpaths -w 1
It fails with following log messages.
Please help.
Logs in the Worker Thread ( last three lines)
================================2014-11-25 20:55:13,583 INFO
org.apache.giraph.comm.netty.NettyClient: waitAllRequests: Finished all
requests. MBytes/sec received = 0, MBytesReceived = 0, ave received req MBytes
= 0, secs waited = 1.41692902E9
MBytes/sec sent = 0, MBytesSent = 0, ave sent req MBytes = 0, secs waited =
1.41692902E9
2014-11-25 20:55:13,583 INFO org.apache.giraph.worker.BspServiceWorker: setup:
Finally loaded a total of (v=5, e=12)
Logs in the Master
==============
2014-11-25 20:55:13,445 INFO org.apache.giraph.comm.netty.NettyClient: Using
Netty without authentication.
2014-11-25 20:55:13,452 INFO org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Successfully added 1 connections, (1 total connected) 0
failed, 0 failures total.
2014-11-25 20:55:13,454 INFO org.apache.giraph.partition.PartitionUtils:
computePartitionCount: Creating 1, default would have been 1 partitions.
2014-11-25 20:55:13,491 INFO org.apache.giraph.master.BspServiceMaster:
barrierOnWorkerList: 0 out of 1 workers finished on superstep -1 on path
/_hadoopBsp/job_201411251752_0003/_vertexInputSplitDoneDir
2014-11-25 20:55:13,493 INFO org.apache.giraph.master.BspServiceMaster:
barrierOnWorkerList: Waiting on [01hw789772_1]
2014-11-25 20:55:13,503 INFO org.apache.giraph.comm.netty.NettyServer: start:
Using Netty without authentication.
2014-11-25 20:55:13,590 ERROR org.apache.giraph.master.BspServiceMaster:
barrierOnWorkerList: Missing chosen workers [Worker(hostname=01hw789772,
MRtaskID=1, port=30001)] on superstep -1
2014-11-25 20:55:13,590 ERROR org.apache.giraph.master.MasterThread:
masterThread: Master algorithm failed with IllegalStateException
java.lang.IllegalStateException: coordinateVertexInputSplits: Worker failed
during input split (currently not supported)
at
org.apache.giraph.master.BspServiceMaster.coordinateInputSplits(BspServiceMaster.java:1483)
at
org.apache.giraph.master.BspServiceMaster.coordinateSuperstep(BspServiceMaster.java:1650)
at org.apache.giraph.master.MasterThread.run(MasterThread.java:124)
2014-11-25 20:55:13,591 FATAL org.apache.giraph.graph.GraphTaskManager:
uncaughtException: OverrideExceptionHandler on thread
org.apache.giraph.master.MasterThread, msg = java.lang.IllegalStateException:
coordinateVertexInputSplits: Worker failed during input split (currently not
supported), exiting...
java.lang.IllegalStateException: java.lang.IllegalStateException:
coordinateVertexInputSplits: Worker failed during input split (currently not
supported)
at org.apache.giraph.master.MasterThread.run(MasterThread.java:194)
Caused by: java.lang.IllegalStateException: coordinateVertexInputSplits: Worker
failed during input split (currently not supported)
at
org.apache.giraph.master.BspServiceMaster.coordinateInputSplits(BspServiceMaster.java:1483)
at
org.apache.giraph.master.BspServiceMaster.coordinateSuperstep(BspServiceMaster.java:1650)
at org.apache.giraph.master.MasterThread.run(MasterThread.java:124)
2014-11-25 20:55:13,591 WARN org.apache.giraph.zk.ZooKeeperManager:
logZooKeeperOutput: Dumping up to last 100 lines of the ZooKeeper process
STDOUT and STDERR.
-Puneet
