Setting spill threshold to 100% fails to detect spill for records
-----------------------------------------------------------------
Key: HADOOP-3603
URL: https://issues.apache.org/jira/browse/HADOOP-3603
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.17.0
Reporter: Chris Douglas
Assignee: Chris Douglas
Fix For: 0.18.0
If io.sort.record.percent is set to 1.0, the simultaneous collection and spill
is disabled. However, if one exhausts the offset allocation before the
serialization allocation, the limit will not be detected and the write will
block forever.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.