[jira] Commented: (PIG-1429) Add Boolean Data Type to Pig

2010-06-21 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12880731#action_12880731 ] Russell Jurney commented on PIG-1429: - I'll be able to wrap this up next weekend. Add

[jira] Updated: (PIG-1034) Pig does not support ORDER ... BY group alias

2010-06-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1034: Status: Patch Available (was: Open) Affects Version/s: 0.8.0 Fix Version/s: 0.8.0

[jira] Updated: (PIG-1034) Pig does not support ORDER ... BY group alias

2010-06-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1034: Attachment: PIG_1034.patch Attach the patch Pig does not support ORDER ... BY group alias

[jira] Commented: (PIG-1034) Pig does not support ORDER ... BY group alias

2010-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12880808#action_12880808 ] Hadoop QA commented on PIG-1034: -1 overall. Here are the results of testing the latest

Re: skew join in pig

2010-06-21 Thread Gang Luo
OK. I konw how many reducers to allocate for one hot key. But how will the reducers allocated for key1 overlap the reducers for key2? Say key1 needs 3 reducers and is allocated reducer 0, 1, 2. Key2 needs 4 reducers, can we allocate reducers 0, 1, 2, 3 for key2? Or 3, 4, 5, 6? What is the ideas

[jira] Commented: (PIG-1427) Monitor and kill runaway UDFs

2010-06-21 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12880881#action_12880881 ] Ashutosh Chauhan commented on PIG-1427: --- It seems you missed out ivy.xml bits in the

Re: skew join in pig

2010-06-21 Thread Dmitriy Ryaboy
It's just whatever the hash function happens to do. By the time the hot keys are slotted to be spread among multiple reducers, they are no longer hot, so it doesn't matter if you put a few of the partitions in the same reducer. Remember, we mostly care about things we have to keep in memory. Since

[jira] Updated: (PIG-1405) Need to move many standard functions from piggybank into Pig

2010-06-21 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-1405: Status: Open (was: Patch Available) Need to move many standard functions from piggybank into Pig

[jira] Updated: (PIG-1405) Need to move many standard functions from piggybank into Pig

2010-06-21 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-1405: Attachment: StandardUDFtoPigFinale.patch Reviewed all comments for all the files. Made required

[jira] Updated: (PIG-1451) [zebra] change the build.test property in build to test.build.dir to be in consistent with PIG

2010-06-21 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Zhou updated PIG-1451: -- Status: Resolved (was: Patch Available) Resolution: Fixed The contrib test failure is due to the commit

[jira] Commented: (PIG-1334) Make pig artifacts available through maven

2010-06-21 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12880938#action_12880938 ] Olga Natkovich commented on PIG-1334: - We need to look at how this is done by hadoop.

[jira] Assigned: (PIG-1334) Make pig artifacts available through maven

2010-06-21 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1334: --- Assignee: niraj rai Make pig artifacts available through maven

[jira] Updated: (PIG-1453) [zebra] Intermittent failure for TestOrderPreserveUnionHDFS

2010-06-21 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Zhou updated PIG-1453: -- Status: Patch Available (was: Open) [zebra] Intermittent failure for TestOrderPreserveUnionHDFS

[jira] Updated: (PIG-1453) [zebra] Intermittent failure for TestOrderPreserveUnionHDFS

2010-06-21 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Zhou updated PIG-1453: -- Status: Open (was: Patch Available) [zebra] Intermittent failure for TestOrderPreserveUnionHDFS

Re: skew join in pig

2010-06-21 Thread Gang Luo
Thanks Dmitriy. I didn't see any performance issue yet. I ask this for a comparison of skew joins strategies. I would like to share something after I get more ideas. Thanks, -Gang - 原始邮件 发件人: Dmitriy Ryaboy dvrya...@gmail.com 收件人: pig-dev@hadoop.apache.org 发送日期: 2010/6/21 (周一)

[jira] Assigned: (PIG-1399) Logical Optimizer: Expression optimizor rule

2010-06-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-1399: --- Assignee: Yan Zhou Logical Optimizer: Expression optimizor rule

[jira] Commented: (PIG-1405) Need to move many standard functions from piggybank into Pig

2010-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12880965#action_12880965 ] Hadoop QA commented on PIG-1405: -1 overall. Here are the results of testing the latest

[jira] Assigned: (PIG-1321) Logical Optimizer: Merge cascading foreach

2010-06-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-1321: --- Assignee: Xuefu Zhang (was: Daniel Dai) Logical Optimizer: Merge cascading foreach