On Wed, Feb 5, 2014 at 5:49 PM, Alexander Frolov <[email protected]>wrote:
> Hello, > > I have deployed Giraph on the 8-node cluster (Giraph: > release-1.0.0-RC2-152-g585511f, Hadoop:0.20.203.0rc1). As I do not have > Internet on the cluster I have copied Giraph from my local computer where > it worked well. > > Now I am trying to test it on the cluster and have following issues: > > 1) When I running Giraph (with -h, just to test) it starts very slowly > comparing to my local machine. > 2) When I running a simple test it hangs like this: > > frolo@A11:~> $HADOOP_HOME/bin/hadoop jar > $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar > org.apache.giraph.GiraphRunner > org.apache.giraph.examples.SimpleShortestPathsComputation -vif > org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat > -vip /user/frolo/input/tiny_graph.txt -vof > org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op > /user/frolo/output/shortestpaths -w 1 > 14/02/05 17:29:33 INFO utils.ConfigurationUtils: No edge input format > specified. Ensure your InputFormat does not require one. > 14/02/05 17:29:33 INFO utils.ConfigurationUtils: No edge output format > specified. Ensure your OutputFormat does not require one. > 14/02/05 17:29:33 INFO job.GiraphJob: run: Since checkpointing is disabled > (default), do not allow any task retries (setting mapred.map.max.attempts = > 0, old value = 4) > 14/02/05 17:29:35 INFO job.GiraphJob: run: Tracking URL: > http://A11:50030/jobdetails.jsp?jobid=job_201402051720_0002 > > and nothing happens. > > frolo@A11:~> $HADOOP_HOME/bin/hadoop job -list > 1 jobs currently running > JobId State StartTime UserName Priority SchedulingInfo > job_201402051720_0002 1 1391606975417 frolo NORMAL NA > frolo@A11:~> $HADOOP_HOME/bin/hadoop job -status job_201402051720_0002 > > Job: job_201402051720_0002 > file: > hdfs://A11:54310/home/frolo/hadoop/tmp/mapred/staging/frolo/.staging/job_201402051720_0002/job.xml > tracking URL: http://A11:50030/jobdetails.jsp?jobid=job_201402051720_0002 > map() completion: 0.0 > reduce() completion: 0.0 > Counters: 2 > Job Counters > SLOTS_MILLIS_MAPS=4613 > Launched map tasks=2 > > I would appreciate any help in tracking down this issue. Thank you. > Just forgot to add that $HADOOP_HOME/bin/hadoop job -kill job_201402051720_0002 does not kill the job actually. Best, > Alex >
