[
https://issues.apache.org/jira/browse/PIG-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14054212#comment-14054212
]
Siddharth Seth commented on PIG-4049:
-------------------------------------
[~rohini] - could you please open a Tez jira for the requested changes, and the
discussion can continue there for the Tez changes. I'm guessing you can
generally hit such cases whenever a limit operation is hit. +
[~rajesh.balamohan], who was doing some work on limit processing for Hive which
would make use of events.
> Improve performance of Limit following an Orderby on Tez
> --------------------------------------------------------
>
> Key: PIG-4049
> URL: https://issues.apache.org/jira/browse/PIG-4049
> Project: Pig
> Issue Type: Sub-task
> Components: tez
> Reporter: Rohini Palaniswamy
> Fix For: 0.14.0
>
>
> Better algorithms can be applied to improve performance for limit following
> an order by.
> For eg:
> {code}
> A = LOAD '/tmp/data' ...;
> B = ORDER A by $0 parallel 100;
> C = LIMIT B 100;
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)