[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12777589#action_12777589 ] Daniel Dai commented on PIG-1038: - Continue with the last comment. 4. Strip secondary keys

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12777318#action_12777318 ] Daniel Dai commented on PIG-1038: - Couple of limitations for the currently implementation and

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12776729#action_12776729 ] Pradeep Kamath commented on PIG-1038: - In JobControlCompiler: ==

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12776821#action_12776821 ] Hadoop QA commented on PIG-1038: -1 overall. Here are the results of testing the latest

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12776853#action_12776853 ] Pradeep Kamath commented on PIG-1038: - Changes look good. One observation is in

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12775969#action_12775969 ] Ashutosh Chauhan commented on PIG-1038: --- Another place where Hadoop's secondary sort is

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12775982#action_12775982 ] Ashutosh Chauhan commented on PIG-1038: --- Note that in the use-case I mentioned of

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12776175#action_12776175 ] Daniel Dai commented on PIG-1038: - Hi, Ashutosh, Good point. However, it is hard to get in

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12774926#action_12774926 ] Hadoop QA commented on PIG-1038: -1 overall. Here are the results of testing the latest

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12774753#action_12774753 ] Hadoop QA commented on PIG-1038: -1 overall. Here are the results of testing the latest

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12772562#action_12772562 ] Daniel Dai commented on PIG-1038: - Hi, Ashutosh, I will look into POForeach and find the

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12772774#action_12772774 ] Alan Gates commented on PIG-1038: - I agree that we need a framework for optimizations in the

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12772404#action_12772404 ] Ashutosh Chauhan commented on PIG-1038: --- I think its a useful optimization. I presume

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12772085#action_12772085 ] Daniel Dai commented on PIG-1038: - Here is the design for this optimization: 1. Add