[
https://issues.apache.org/jira/browse/TEZ-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15988977#comment-15988977
]
Rajesh Balamohan commented on TEZ-3698:
---------------------------------------
Thanks for the review [~aplusplus]. Will upload revised patch soon.
PipelinedShuffle has some corner cases to be addressed w.r.t to exception
handling. While it would eventually be addressed in subsequent jiras, it would
be beneficial to turn off final merge which is independent of pipelining.
> UnorderedKV writer should be able to honor
> tez.runtime.enable.final-merge.in.output without pipelinedshuffle
> ------------------------------------------------------------------------------------------------------------
>
> Key: TEZ-3698
> URL: https://issues.apache.org/jira/browse/TEZ-3698
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Attachments: TEZ-3698.1.patch
>
>
> Final merge can be disabled with "tez.runtime.enable.final-merge.in.output"
> setting. Currently this works with UnorderedKV writer only with pipelined
> shuffle. It should be able to honor this parameter, without pipelined shuffle
> as well to avoid final merge.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
