My Giraph job gets stuck at this point and will not go any further, that
log is what is continually printed out every 5 seconds. This log is coming
from the CombinedWorkerProgress class:
else if (isComputeSuperstep()) {
sb.append("Compute superstep ").append(currentSuperstep).append(": ");
sb.append(verticesComputed).append(" out of ").append(
verticesToCompute).append(" vertices computed; ");
sb.append(partitionsComputed).append(" out of ").append(
partitionsToCompute).append(" partitions computed");
So the data is loaded in fine and then the Giraph job gets stuck in
superstep 0 for some reason?
public void compute(Vertex<IntWritable, IntWritable, NullWritable> vertex,
Iterable<IntWritable> messages) throws IOException
{
//check if its the first superstep
if (getSuperstep() == 0)
{
if(isStart(vertex))
{
vertex.setValue(new IntWritable((int) getSuperstep()));
for (Edge<IntWritable, NullWritable> edge : vertex.getEdges())
{
idQueue.addInt(edge.getTargetVertexId().get());
sendMessage(edge.getTargetVertexId(), new IntWritable(1));
}
Collections.sort(idQueue.getArrayList());
aggregate(ID_AGG, idQueue);
}
else
{
vertex.setValue(new IntWritable(Integer.MAX_VALUE));
}
}
Thats the code I wrote for the first superstep. I ran this code before
without the aggregate and it worked, so I think my problem is related the
the aggregator/master.
Kind regards,
Ghufran
On Thu, Apr 3, 2014 at 4:40 PM, Rob Vesse <[email protected]> wrote:
> How is that an error?
>
> That's just some informational log statements from Giraph, you'll need to
> provide the actual error message/describe the issue to get help with your
> problem
>
> Rob
>
> From: ghufran malik <[email protected]>
> Reply-To: <[email protected]>
> Date: Thursday, 3 April 2014 16:09
> To: <[email protected]>
> Subject: Master/Agreggators
>
> Hi,
>
> I received the error:
>
> 14/04/03 16:01:07 INFO mapred.JobClient: map 100% reduce 0%
> 14/04/03 16:01:11 INFO job.JobProgressTracker: Data from 1 workers -
> Compute superstep 0: 0 out of 4 vertices computed; 0 out of 1 partitions
> computed; min free memory on worker 1 - 106.6MB, average 106.6MB
> 14/04/03 16:01:16 INFO job.JobProgressTracker: Data from 1 workers -
> Compute superstep 0: 0 out of 4 vertices computed; 0 out of 1 partitions
> computed; min free memory on worker 1 - 106.6MB, average 106.6MB
> 14/04/03 16:01:21 INFO job.JobProgressTracker: Data from 1 workers -
> Compute superstep 0: 0 out of 4 vertices computed; 0 out of 1 partitions
> computed; min free memory on worker 1 - 106.6MB, average 106.6MB
> 14/04/03 16:01:26 INFO job.JobProgressTracker: Data from 1 workers -
> Compute superstep 0: 0 out of 4 vertices computed; 0 out of 1 partitions
> computed; min free memory on worker 1 - 106.59MB, average 106.59MB
>
>
> After trying to run a computation class I made that makes use of an
> agreggator and master. I remember getting a similar error when I tried
> SimplePageRank which also makes uses of a master and a agreggator.
>
> Does anyone know why I receive this error and how to fix it?
>
> Kind regards,
>
> Ghufran
>
>
