[
https://issues.apache.org/jira/browse/PIG-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Dai updated PIG-4064:
----------------------------
Attachment: PIG-4064-2.patch
Attach patch with comment changes [~rohini] suggested.
Created PIG-4072 for secondary sort optimizer with multiple predecessors.
bq. TestEvalPipeline2.testLimitAutoReducer - Why for the same reducer bytes,
the parallelism produced by MR and Tez is very different? What is the
differentiating behavior?
MR use the bytes on disk and TEZ use bytes in memory. The difference is
exaggerated when the data size is tiny.
> Fix tez auto parallelism test failures
> --------------------------------------
>
> Key: PIG-4064
> URL: https://issues.apache.org/jira/browse/PIG-4064
> Project: Pig
> Issue Type: Sub-task
> Components: tez
> Reporter: Rohini Palaniswamy
> Assignee: Daniel Dai
> Fix For: 0.14.0
>
> Attachments: PIG-4064-1.patch, PIG-4064-2.patch
>
>
> Tests that hang:
> - TestLimitVariable.testLimitVariable2
> - TestEvalPipeline2.testLocalRearrangeInReducer
> - TestEvalPipeline2.testLimitAutoReducer
> - TestEvalPipeline2.testForEachSameOriginColumn1
> Tests that fail:
> - TestEvalPipeline2.testEmptySort (Divide by zero error)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
