These are the last entries of the JobTracker log related to the job: 2012-02-15 00:21:51,604 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_201201101557_0094_r_000001_1' has completed task_201201101557_0094_r_000001 successfully. 2012-02-15 00:23:12,457 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_201201101557_0094_r_000013_0' has completed task_201201101557_0094_r_000013 successfully. 2012-02-15 00:23:34,425 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_201201101557_0094_r_000010_0' has completed task_201201101557_0094_r_000010 successfully. 2012-02-15 00:25:18,362 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_201201101557_0094_r_000006_0' has completed task_201201101557_0094_r_000006 successfully. 2012-02-15 00:28:26,108 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_201201101557_0094_r_000003_1' has completed task_201201101557_0094_r_000003 successfully. 2012-02-15 00:52:07,182 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_201201101557_0094_r_000008_2' has completed task_201201101557_0094_r_000008 successfully. 2012-02-15 00:52:07,704 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201201101557_0094_r_000008_1' 2012-02-15 00:52:07,704 INFO org.apache.hadoop.mapred.JobTracker: Adding task (TASK_CLEANUP) 'attempt_201201101557_0094_r_000008_1' to tip task_201201101557_0094_r_000008, for tracker 'tracker_suchetest05.zonen.ef.unister.lan:localhost/ 2012-02-15 00:52:11,031 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201201101557_0094_r_000008_1' 2012-02-15 00:54:41,965 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_201201101557_0094_r_000002_1' has completed task_201201101557_0094_r_000002 successfully. 2012-02-15 00:54:42,415 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201201101557_0094_r_000002_2' 2012-02-15 00:54:42,416 INFO org.apache.hadoop.mapred.JobTracker: Adding task (TASK_CLEANUP) 'attempt_201201101557_0094_r_000002_2' to tip task_201201101557_0094_r_000002, for tracker 'tracker_suchetest06.zonen.ef.unister.lan:localhost/ 2012-02-15 00:54:47,304 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201201101557_0094_r_000002_2' 2012-02-15 00:57:14,135 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_201201101557_0094_r_000000_2' has completed task_201201101557_0094_r_000000 successfully. 2012-02-15 00:57:14,542 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201201101557_0094_r_000000_1' 2012-02-15 00:57:14,575 INFO org.apache.hadoop.mapred.JobTracker: Adding task (TASK_CLEANUP) 'attempt_201201101557_0094_r_000000_1' to tip task_201201101557_0094_r_000000, for tracker 'tracker_suchetest03.zonen.ef.unister.lan:localhost. 2012-02-15 00:57:28,756 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201201101557_0094_r_000000_1' 2012-02-15 00:58:25,451 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_201201101557_0094_r_000004_2' has completed task_201201101557_0094_r_000004 successfully. 2012-02-15 00:58:26,003 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201201101557_0094_r_000004_1' 2012-02-15 00:58:26,003 INFO org.apache.hadoop.mapred.JobTracker: Adding task (TASK_CLEANUP) 'attempt_201201101557_0094_r_000004_1' to tip task_201201101557_0094_r_000004, for tracker 'tracker_suchetest03.zonen.ef.unister.lan:localhost. 2012-02-15 00:58:27,513 INFO org.apache.hadoop.mapred.JobTracker: Removing task 'attempt_201201101557_0094_r_000004_1'
Hope this is what you want... If not, tell me please. 2012/2/16 Harsh J <[email protected]> > Matthias, > > Could you paste-bin a grep of the job ID (If job ID is > job_<Num>_<Num>, grep just for <Num>_<Num>) from your JobTracker log > and send the link across? > > That error you point out to is > https://issues.apache.org/jira/browse/MAPREDUCE-5 and should be > harmless/not-the-real-issue-here. > > On Thu, Feb 16, 2012 at 4:20 PM, Matthias Zengler > <[email protected]> wrote: > > Hello Community, > > > > I'm using hadoop in version 0.20.2-cdh3u2. I do some hard graph analysis > on > > graphs with a few 100 millions of nodes. Unfortunately the map/reduce > > freezes at map -> 100% and red -> 100%. > > Sometimes in first M/R step, sometimes in the second one. I'm quiet sure > > that isn't an issue with the software, so I'm searching the logs of > hadoop. > > I repeatedly found the following error and want to know what to do to > > prevent this and whether this might be the problem. Sample: > > > > 2012-02-14 18:35:08,250 ERROR org.mortbay.log: /mapOutput > > java.lang.IllegalStateException: Committed > > at org.mortbay.jetty.Response.resetBuffer(Response.java:1023) > > at org.mortbay.jetty.Response.sendError(Response.java:240) > > at > > > org.apache.hadoop.mapred.TaskTracker$MapOutputServlet.doGet(TaskTracker.java:3815) > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) > > at > > org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) > > at > > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221) > > at > > > org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:829) > > at > > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > > at > > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > > at > > > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > > at > > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > > at > > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > > at > > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > > at > > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > > at > > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > > at org.mortbay.jetty.Server.handle(Server.java:326) > > at > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > > at > > > org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928) > > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549) > > at > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > > at > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > > at > > > org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410) > > at > > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > > > > Would be glad if you could help me, > > Greetings, > > Mat > > > > -- > Harsh J > Customer Ops. Engineer > Cloudera | http://tiny.cloudera.com/about >
