[ http://issues.apache.org/jira/browse/HADOOP-513?page=all ]
Owen O'Malley updated HADOOP-513:
---------------------------------
Attachment: map-out-servlet.patch
This patch replaces the getMapOutput.jsp with a Servlet.
The problem was that the getMapOutput.jsp was closing the output stream and the
wrapper code was trying to close it again, which would sometimes generate the
IllegalStateException.
The new servlet is more careful to handle errors including setting an error
response if something goes wrong. It also sets the content-length with the
length of the file.
> IllegalStateException is thrown by TaskTracker
> ----------------------------------------------
>
> Key: HADOOP-513
> URL: http://issues.apache.org/jira/browse/HADOOP-513
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.5.0
> Reporter: Konstantin Shvachko
> Assigned To: Owen O'Malley
> Fix For: 0.7.0
>
> Attachments: map-out-servlet.patch
>
>
> I am running TestDFSIO on a one node cluster and getting
> IllegalStateException for each map task run as listed below.
> The same exceptions are flooding logs for TestMiniMRWithDFS on my nightly
> build for quite a while now.
> Does anybody know what that is?
> My understanding is that if it is "illegal", then tests should fail.
> If not then it should be caught and ignored INTERNALLY.
> 06/09/06 14:54:50 INFO mapred.TaskTracker: task_0002_r_000000_0 0.25% reduce
> > copy (3 of 4 at 0.00 MB/s) >
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Need 1 map
> output(s)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Got 1 known
> map output location(s); scheduling...
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Scheduled 1 of
> 1 known outputs (0 slow hosts and 0 dup hosts)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Copying
> task_0002_m_000003_0 output from ENO.
> 06/09/06 14:54:50 WARN /: /getMapOutput.jsp?map=task_0002_m_000003_0&reduce=0:
> java.lang.IllegalStateException
> at
> org.mortbay.jetty.servlet.ServletHttpResponse.getWriter(ServletHttpResponse.java:561)
> at org.apache.jasper.runtime.JspWriterImpl.initOut(JspWriterImpl.java:122)
> at
> org.apache.jasper.runtime.JspWriterImpl.flushBuffer(JspWriterImpl.java:115)
> at
> org.apache.jasper.runtime.PageContextImpl.release(PageContextImpl.java:190)
> at
> org.apache.jasper.runtime.JspFactoryImpl.internalReleasePageContext(JspFactoryImpl.java:115)
> at
> org.apache.jasper.runtime.JspFactoryImpl.releasePageContext(JspFactoryImpl.java:75)
> at
> org.apache.hadoop.mapred.getMapOutput_jsp._jspService(getMapOutput_jsp.java:100)
> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
> at
> org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
> at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
> at
> org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
> at org.mortbay.http.HttpServer.service(HttpServer.java:954)
> at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
> at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
> at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
> at
> org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
> at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
> at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 done copying
> task_0002_m_000003_0 output from ENO.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
