[
https://issues.apache.org/jira/browse/TEZ-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated TEZ-2001:
----------------------------------
Attachment: TEZ-2001.3.patch
- Created TEZ-2132 to support speculative execution scenario
- Patch addresses the base scenario where we can have
"tez.runtime.disable.final-merge.in.sorter=true" to disable final merge
completely. Also "tez.runtime.pipelined-shuffle.enabled=true" to enable
sending pipelined events for ordered cases.
- Speculative and failure cases need to be taken up in the follow up JIRAs.
- Tested with couple of hive queries (query_17 in tpcds, ETL query) etc at 10
TB scale.
- review.apache.org is broken/down today. Attaching the patch here for review.
> Support pipelined data transfer for ordered output
> --------------------------------------------------
>
> Key: TEZ-2001
> URL: https://issues.apache.org/jira/browse/TEZ-2001
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Attachments: TEZ-2001.1.patch, TEZ-2001.2.patch, TEZ-2001.3.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
