I get a similar problem running my own algorithm. It works on a small set of data and around 10 workers, but scaling it up, I get lots of logs like above, and the job sits infinitely. It is happening on the input read for me, usually around half of the workers finish, and half have those logs.
On Wed, Dec 4, 2013 at 9:41 AM, Rafal Wojdyla <[email protected]> wrote: > Hi! > > I use Giraph trunk (1.1.0) with java 1.6 and hadoop 2.2.0.x and I try to > run the example from http://giraph.apache.org/quick_start.html on the > example data from the page - I have the same problem. So I started this > issue: https://issues.apache.org/jira/browse/GIRAPH-806 > > Cheers - Rafal > > > On Tue, Dec 3, 2013 at 8:46 PM, Manuel Lagang <[email protected]>wrote: > >> If you expected your job to take a while and you just want to make sure >> the job doesn't fail due to timeouts, you can set the hadoop parameter " >> mapreduce.task.timeout" to a higher value or to 0 for no timeouts at all. >> >> If you didn't expect your job to take a while on a single worker, it's >> hard to figure out what went wrong without more context on your code or >> what stage the job is failing (during input loading? which superstep?). >> >> >> On Tue, Dec 3, 2013 at 11:19 AM, Sundara Raghavan Sankaran < >> [email protected]> wrote: >> >>> Hi, >>> >>> In my giraph job, one of the workers just outputs the same log >>> repeatedly and ultimately the job fails because of it not reporting its >>> status. >>> >>> Here is the log:- >>> >>> 2013-12-03 19:01:01,159 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Future result not ready yet >>> java.util.concurrent.FutureTask@4281de5c >>> 2013-12-03 19:01:01,159 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Waiting for >>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>> 2013-12-03 19:02:01,159 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Future result not ready yet >>> java.util.concurrent.FutureTask@4281de5c >>> 2013-12-03 19:02:01,159 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Waiting for >>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>> 2013-12-03 19:03:01,159 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Future result not ready yet >>> java.util.concurrent.FutureTask@4281de5c >>> 2013-12-03 19:03:01,160 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Waiting for >>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>> 2013-12-03 19:04:01,160 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Future result not ready yet >>> java.util.concurrent.FutureTask@4281de5c >>> 2013-12-03 19:04:01,160 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Waiting for >>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>> 2013-12-03 19:05:01,160 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Future result not ready yet >>> java.util.concurrent.FutureTask@4281de5c >>> 2013-12-03 19:05:01,160 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Waiting for >>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>> 2013-12-03 19:06:01,161 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Future result not ready yet >>> java.util.concurrent.FutureTask@4281de5c >>> 2013-12-03 19:06:01,161 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Waiting for >>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>> 2013-12-03 19:07:01,161 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Future result not ready yet >>> java.util.concurrent.FutureTask@4281de5c >>> 2013-12-03 19:07:01,161 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Waiting for >>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>> 2013-12-03 19:08:01,161 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Future result not ready yet >>> java.util.concurrent.FutureTask@4281de5c >>> 2013-12-03 19:08:01,162 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Waiting for >>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>> 2013-12-03 19:09:01,162 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Future result not ready yet >>> java.util.concurrent.FutureTask@4281de5c >>> 2013-12-03 19:09:01,162 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Waiting for >>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>> 2013-12-03 19:10:01,162 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Future result not ready yet >>> java.util.concurrent.FutureTask@4281de5c >>> 2013-12-03 19:10:01,162 INFO org.apache.giraph.utils.ProgressableUtils: >>> waitFor: Waiting for >>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>> >>> What is going on? Is there something I can do so that it doesn't happen. >>> >>> >>> -- >>> >>> Thanks, >>> >>> Sundar >>> >> >> >
