Hi there!
I'm guessing you're working in a pseudo-distributed mode, since you
applied the argument -w 1
Have you taken a look into the tasklog? Sounds like you might have some
excpetion and/or connection loss.
Also I am wondering why your computation launched 2 map tasks.
What is your configuration in mapred-site.xml?
Greetings!
Sonja
Am 15.07.2015 um 10:15 schrieb Panagiotis Liakos:
Hello,
I have successfully set up hadoop 1.2.1 and giraph 1.1.0 and tested
the SimpleShortestPathsComputation as shown in the quick start guide.
However, I am more interested in the SimplePageRankComputation and I
fail to execute it.
In particular, I issue the following command:
$HADOOP_HOME/bin/hadoop jar
$GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-for-hadoop-1.2.1-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.SimplePageRankComputation -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /user/hduser/input/tiny_graph.txt -vof
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/hduser/output/pagerank -w 1
I use the same graph and format as with the
SimpleShortestPathsComputation task. The job is successfully submitted
but fails after 10 minutes with the following task error:
Task attempt_201507131607_0013_m_000000_0 failed to report status for
600 seconds. Killing!
Am I doing something wrong? Should I provide more arguments when I
submit the task?
Thank you,
Panagiotis
The output is the following:
15/07/15 10:43:11 INFO utils.ConfigurationUtils: No edge input format
specified. Ensure your InputFormat does not require one.
15/07/15 10:43:11 INFO utils.ConfigurationUtils: No edge output format
specified. Ensure your OutputFormat does not require one.
15/07/15 10:43:12 INFO job.GiraphJob: run: Since checkpointing is
disabled (default), do not allow any task retries (setting
mapred.map.max.attempts = 0, old value = 4)
15/07/15 10:43:13 INFO job.GiraphJob: Tracking URL:
http://hdnode01:50030/jobdetails.jsp?jobid=job_201507131607_0013
15/07/15 10:43:13 INFO job.GiraphJob: Waiting for resources... Job
will start only when it gets all 2 mappers
15/07/15 10:44:24 INFO
job.HaltApplicationUtils$DefaultHaltInstructionsWriter:
writeHaltInstructions: To halt after next superstep execute:
'bin/halt-application --zkServer giraph01:22181 --zkNode
/_hadoopBsp/job_201507131607_0013/_haltComputation'
15/07/15 10:44:24 INFO mapred.JobClient: Running job: job_201507131607_0013
15/07/15 10:44:25 INFO mapred.JobClient: map 100% reduce 0%
15/07/15 10:53:32 INFO mapred.JobClient: map 0% reduce 0%
15/07/15 10:53:33 INFO mapred.JobClient: Job complete: job_201507131607_0013
15/07/15 10:53:33 INFO mapred.JobClient: Counters: 6
15/07/15 10:53:33 INFO mapred.JobClient: Job Counters
15/07/15 10:53:33 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=616166
15/07/15 10:53:33 INFO mapred.JobClient: Total time spent by all
reduces waiting after reserving slots (ms)=0
15/07/15 10:53:33 INFO mapred.JobClient: Total time spent by all
maps waiting after reserving slots (ms)=0
15/07/15 10:53:33 INFO mapred.JobClient: Launched map tasks=2
15/07/15 10:53:33 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0
15/07/15 10:53:33 INFO mapred.JobClient: Failed map tasks=1
