PageRankBenchmrk fails due to IllegalStateException

2011-12-01 Thread Inci Cetindil
Hi, I'm running PageRank benchmark example on a cluster with 1 master + 5 slave nodes. I have tried it with a large number of vertices; when I failed I decided to make it run with 500 vertices and 5 workers first. However, it doesn't work even for 500 vertices. I am using the latest version o

Re: PageRankBenchmrk fails due to IllegalStateException

2011-12-01 Thread Avery Ching
Hi Inci, I am not sure what's wrong. I ran the exact same command on a freshly checked version of Graph without any trouble. Here's my output: hadoop jar target/giraph-0.70-jar-with-dependencies.jar org.apache.giraph.benchmark.PageRankBenchmark -e 1 -s 3 -v -V 500 -w 5 Using org.apache.gir

Re: PageRankBenchmrk fails due to IllegalStateException

2011-12-01 Thread Avery Ching
Thanks for the logs. I see a lot of issues like the following: 2011-12-01 00:04:46,241 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: rainbow-01/192.168.100.1:30004. Already tried 0 time(s). 2011-12-01 00:04:47,243 INFO org.apache.hadoop.ipc.Client: Retrying connect to server:

Re: PageRankBenchmrk fails due to IllegalStateException

2011-12-01 Thread Inci Cetindil
I am sure the machines can communicate to each other and the ports are not blocked. I can run word count hadoop job without any problem on these machines. My hadoop version is 0.20.203.0. Thanks, Inci On Dec 1, 2011, at 3:57 PM, Avery Ching wrote: > Thanks for the logs. I see a lot of issues

Re: PageRankBenchmrk fails due to IllegalStateException

2011-12-01 Thread Avery Ching
Hmmm...this is unusual. I wonder if it is tired to the weird number of tasks you are getting. Can you try it with various numbers of workers (i.e. 1, 2) and see if it works? To me, the connection refused error indicates that perhaps the server failed to bind to its port (are you running mult

Re: PageRankBenchmrk fails due to IllegalStateException

2011-12-01 Thread Inci Cetindil
I have tried it with various numbers of workers and it only worked with 1 worker. I am not running multiple Giraph jobs at the same time, does it always use the ports 3 and up? I checked the used ports using "netstat" command and didn't see any of the ports 3-30005. Inci On Dec 1, 201