[
https://issues.apache.org/jira/browse/TEZ-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284691#comment-14284691
]
Gopal V commented on TEZ-1803:
------------------------------
+1 - looks good.
Only one detail, there's a perItem size reset when moving from 1 block to the
next, which is not necessary. We want to inherit as much of the stats collected
over the previous sort buffer into the next one.
> Support > 2gb sort buffer in pipelinedsorter
> --------------------------------------------
>
> Key: TEZ-1803
> URL: https://issues.apache.org/jira/browse/TEZ-1803
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Labels: performance
> Attachments: TEZ-1803.1.patch, TEZ-1803.2.patch, TEZ-1803.3.patch,
> TEZ-1803.4.patch, TEZ-1803.WIP.1.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
