[
https://issues.apache.org/jira/browse/HADOOP-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602449#action_12602449
]
Chris Douglas commented on HADOOP-3442:
---------------------------------------
bq. The jobs it's failing on are running on data I can't release.
Would it be possible to apply the patch, validate the spills with the checker,
and post some debugging information? In particular, patching QuickSort to catch
StackOverflowError and print out its left and right indices as it unwinds would
be the first thing I'd try with a reproducible test. If you can't include the
kvbuffer data, the kvindices data would be modestly helpful and would reveal
only lengths and partitions. Also, even if the checker doesn't reproduce the
error, the "STACK OVERFLOW" log message from the failed mapper should include
the buffer and accounting indices. Those would also be valuable and reveal
nothing about your data.
> QuickSort may get into unbounded recursion
> ------------------------------------------
>
> Key: HADOOP-3442
> URL: https://issues.apache.org/jira/browse/HADOOP-3442
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.17.0
> Reporter: Runping Qi
> Assignee: Chris Douglas
> Attachments: 3442-0.patch, CheckSortBuffer.java, HADOOP-3442.patch,
> spillbuffers.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
