SpillThread throws ArrayIndexOutOfBoundsException, which is ignored by MapTask
------------------------------------------------------------------------------
Key: HADOOP-3166
URL: https://issues.apache.org/jira/browse/HADOOP-3166
Project: Hadoop Core
Issue Type: Bug
Reporter: Chris Douglas
Assignee: Chris Douglas
Priority: Blocker
Fix For: 0.17.0
Attachments: 3166-0.patch
There is a flaw in the value bounds checking introduced by HADOOP-2919. When
the index table determines the end offset of the value, it fails to detect that
the next entry falls off the end of the array. This remains undetected by
MapTask, which only notes IOExceptions from the spill thread. Both the boundary
checking and the exception handling must be fixed.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.