[jira] Commented: (PIG-747) Logical to Physical Plan Translation fails when temporary alias are created within foreach

2009-10-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771209#action_12771209 ] Daniel Dai commented on PIG-747: Please hold on this patch. Seems the calculation is not good.

[jira] Commented: (PIG-859) Optimizer throw error on self-joins

2009-10-28 Thread Jing Huang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771220#action_12771220 ] Jing Huang commented on PIG-859: if we do joina = join rec1 by (a), rec1 by (a) using "merge"

[jira] Commented: (PIG-859) Optimizer throw error on self-joins

2009-10-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771223#action_12771223 ] Daniel Dai commented on PIG-859: I was wondering whether Pig Latin should allow self-join. In

[jira] Updated: (PIG-1057) [Zebra] Zebra does not support concurrent deletions of column groups now.

2009-10-28 Thread Chao Wang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Wang updated PIG-1057: --- Attachment: patch_1057 > [Zebra] Zebra does not support concurrent deletions of column groups now. > --

[jira] Commented: (PIG-1048) inner join using 'skewed' produces multiple rows for keys with single row in both input relations

2009-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771249#action_12771249 ] Hadoop QA commented on PIG-1048: +1 overall. Here are the results of testing the latest atta

[jira] Commented: (PIG-1016) Reading in map data seems broken

2009-10-28 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771287#action_12771287 ] Santhosh Srinivasan commented on PIG-1016: -- I am summarizing my understanding of the

[jira] Updated: (PIG-953) Enable merge join in pig to work with loaders and store functions which can internally index sorted data

2009-10-28 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-953: --- Attachment: PIG-953-9.patch - New patch addresses all javadoc, unit test and findbugs issues. - The rele

[jira] Commented: (PIG-1016) Reading in map data seems broken

2009-10-28 Thread hc busy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771308#action_12771308 ] hc busy commented on PIG-1016: -- Well, I'd like to start by thanking everyone for the attention a

[jira] Commented: (PIG-1022) optimizer pushes filter before the foreach that generates column used by filter

2009-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770831#action_12770831 ] Hadoop QA commented on PIG-1022: -1 overall. Here are the results of testing the latest atta

RE: Custom Loadfunc problem!

2009-10-28 Thread RichardGUO Fei
It seems that the real problem is JobControlCompiler.getJob, because this method removes POLoad and sets PigInputFormat as the input format but the path passed to my storage is actually a table name rather than a file path! I think that the LoadFunc should be more flexible. I am trying to fix t

[jira] Commented: (PIG-970) Support of HBase 0.20.0

2009-10-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770866#action_12770866 ] Jeff Zhang commented on PIG-970: Any progress on this issue ? It looks like it's still opened

[jira] Commented: (PIG-1029) HBaseStorage is way too slow to be usable

2009-10-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770875#action_12770875 ] Jeff Zhang commented on PIG-1029: - Vincent, what environment do you use to get the performanc

[jira] Commented: (PIG-747) Logical to Physical Plan Translation fails when temporary alias are created within foreach

2009-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770901#action_12770901 ] Hadoop QA commented on PIG-747: --- -1 overall. Here are the results of testing the latest attachm

[jira] Commented: (PIG-790) Error message should indicate in which line number in the Pig script the error occured (debugging BinCond)

2009-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770959#action_12770959 ] Hadoop QA commented on PIG-790: --- -1 overall. Here are the results of testing the latest attachm

Re: Custom Loadfunc problem!

2009-10-28 Thread Dmitriy Ryaboy
Richard, I would strongly advise you against trying to mess with PigInputFormat and JobControlCompiler. We know that slicers work (after all, people manage to write hbase loaders and such). Plus the whole input/output/slice/slicer thing is being revised right now, there is a proposal in PIG-966 yo

[jira] Commented: (PIG-970) Support of HBase 0.20.0

2009-10-28 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770974#action_12770974 ] Alan Gates commented on PIG-970: I haven't been able to get the unit test to pass in my enviro

[jira] Updated: (PIG-1037) better memory layout and spill for sorted and distinct bags

2009-10-28 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1037: Resolution: Fixed Fix Version/s: 0.6.0 Status: Resolved (was: Patch Available) Patch check

RE: Custom Loadfunc problem!

2009-10-28 Thread RichardGUO Fei
I think that you are right. But the most weird thing is that there is no LOG outputed. I can see that the last method invoked was getLocations. And anything after that was not recorded anywhere. Even in the pseudo-distributed mode of Hadoop, if I use System.out.println, the stdout under userlo

[jira] Updated: (PIG-598) Parameter substitution ($PARAMETER) should not be performed in comments

2009-10-28 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated PIG-598: -- Status: Patch Available (was: Open) > Parameter substitution ($PARAMETER) should not be performed in comm

[jira] Updated: (PIG-1030) explain and dump not working with two UDFs inside inner plan of foreach

2009-10-28 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding updated PIG-1030: -- Attachment: PIG-1030.patch The problem is that the code assums to combine only in the case where there is

[jira] Updated: (PIG-1030) explain and dump not working with two UDFs inside inner plan of foreach

2009-10-28 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding updated PIG-1030: -- Status: Patch Available (was: Open) > explain and dump not working with two UDFs inside inner plan of fo

[jira] Commented: (PIG-1052) FINDBUGS: remaining performance warnings

2009-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771040#action_12771040 ] Hadoop QA commented on PIG-1052: -1 overall. Here are the results of testing the latest atta

[jira] Created: (PIG-1057) [Zebra] Zebra does not support concurrent deletions of column groups now.

2009-10-28 Thread Chao Wang (JIRA)
[Zebra] Zebra does not support concurrent deletions of column groups now. - Key: PIG-1057 URL: https://issues.apache.org/jira/browse/PIG-1057 Project: Pig Issue Type: Bu

[jira] Updated: (PIG-746) Works in --exectype local, fails on grid - ERROR 2113: SingleTupleBag should never be serialized

2009-10-28 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding updated PIG-746: - Attachment: PIG-746.patch As Pradeep suggested, the combiner optimizer code in this patch identifies projec

[jira] Updated: (PIG-746) Works in --exectype local, fails on grid - ERROR 2113: SingleTupleBag should never be serialized

2009-10-28 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding updated PIG-746: - Status: Patch Available (was: Open) > Works in --exectype local, fails on grid - ERROR 2113: SingleTupleBag

[jira] Commented: (PIG-1001) Generate more meaningful error message when one input file does not exist

2009-10-28 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771072#action_12771072 ] Alan Gates commented on PIG-1001: - I have a question on this code in JobControlCompiler.updat

[jira] Updated: (PIG-1055) FINDBUGS: remaining "Dodgy Warnings"

2009-10-28 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1055: Attachment: PIG-1055.patch > FINDBUGS: remaining "Dodgy Warnings" > -

[jira] Updated: (PIG-1055) FINDBUGS: remaining "Dodgy Warnings"

2009-10-28 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1055: Status: Patch Available (was: Open) > FINDBUGS: remaining "Dodgy Warnings" > ---

[jira] Assigned: (PIG-1051) FINFBUGS: NP_NULL_ON_SOME_PATH_FROM_RETURN_VALUE: Possible null pointer dereference due to return value of called method

2009-10-28 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1051: --- Assignee: Olga Natkovich > FINFBUGS: NP_NULL_ON_SOME_PATH_FROM_RETURN_VALUE: Possible null poin

[jira] Created: (PIG-1058) FINDBUGS: remaining "Correctness Warnings"

2009-10-28 Thread Olga Natkovich (JIRA)
FINDBUGS: remaining "Correctness Warnings" -- Key: PIG-1058 URL: https://issues.apache.org/jira/browse/PIG-1058 Project: Pig Issue Type: Improvement Reporter: Olga Natkovich Ass

[jira] Assigned: (PIG-1055) FINDBUGS: remaining "Dodgy Warnings"

2009-10-28 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1055: --- Assignee: Olga Natkovich > FINDBUGS: remaining "Dodgy Warnings" > -

[jira] Assigned: (PIG-1052) FINDBUGS: remaining performance warnings

2009-10-28 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1052: --- Assignee: Olga Natkovich > FINDBUGS: remaining performance warnings > -

[jira] Created: (PIG-1059) FINDBUGS: remaining Bad practice + Multithreaded correctness Warning

2009-10-28 Thread Olga Natkovich (JIRA)
FINDBUGS: remaining Bad practice + Multithreaded correctness Warning Key: PIG-1059 URL: https://issues.apache.org/jira/browse/PIG-1059 Project: Pig Issue Type: Improvement

[jira] Assigned: (PIG-1059) FINDBUGS: remaining Bad practice + Multithreaded correctness Warning

2009-10-28 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1059: --- Assignee: Olga Natkovich > FINDBUGS: remaining Bad practice + Multithreaded correctness Warning

[jira] Commented: (PIG-1052) FINDBUGS: remaining performance warnings

2009-10-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771102#action_12771102 ] Daniel Dai commented on PIG-1052: - +1 > FINDBUGS: remaining performance warnings > -

[jira] Updated: (PIG-790) Error message should indicate in which line number in the Pig script the error occured (debugging BinCond)

2009-10-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-790: --- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch commit

[jira] Updated: (PIG-1052) FINDBUGS: remaining performance warnings

2009-10-28 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1052: Resolution: Fixed Status: Resolved (was: Patch Available) patch committed > FINDBUGS: remai

[jira] Commented: (PIG-953) Enable merge join in pig to work with loaders and store functions which can internally index sorted data

2009-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771136#action_12771136 ] Hadoop QA commented on PIG-953: --- -1 overall. Here are the results of testing the latest attachm

[jira] Commented: (PIG-1001) Generate more meaningful error message when one input file does not exist

2009-10-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771152#action_12771152 ] Daniel Dai commented on PIG-1001: - Hi, Alan, The code do remove B and C. It uses fifo to achi

[jira] Commented: (PIG-1022) optimizer pushes filter before the foreach that generates column used by filter

2009-10-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771157#action_12771157 ] Daniel Dai commented on PIG-1022: - The core test failure is temporal due to "port conflict"

[jira] Commented: (PIG-1055) FINDBUGS: remaining "Dodgy Warnings"

2009-10-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771165#action_12771165 ] Daniel Dai commented on PIG-1055: - +1 > FINDBUGS: remaining "Dodgy Warnings" > -

[jira] Updated: (PIG-1016) Reading in map data seems broken

2009-10-28 Thread hc busy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hc busy updated PIG-1016: - Fix Version/s: 0.4.0 Status: Open (was: Patch Available) > Reading in map data seems broken > -

[jira] Assigned: (PIG-1036) Fragment-replicate left outer join

2009-10-28 Thread Ankit Modi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Modi reassigned PIG-1036: --- Assignee: Ankit Modi > Fragment-replicate left outer join > -- > >

[jira] Updated: (PIG-1016) Reading in map data seems broken

2009-10-28 Thread hc busy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hc busy updated PIG-1016: - Fix Version/s: (was: 0.4.0) 0.5.0 Status: Patch Available (was: Open) > Reading

[jira] Updated: (PIG-1036) Fragment-replicate left outer join

2009-10-28 Thread Ankit Modi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Modi updated PIG-1036: Attachment: LeftOuterFRJoin.patch This patch fails in findBugs as I had modified the line that contained find

[jira] Commented: (PIG-1016) Reading in map data seems broken

2009-10-28 Thread hc busy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771170#action_12771170 ] hc busy commented on PIG-1016: -- Okay, trying to get this into a release of pig... I noticed 0.4

[jira] Updated: (PIG-1036) Fragment-replicate left outer join

2009-10-28 Thread Ankit Modi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Modi updated PIG-1036: Status: Patch Available (was: Open) > Fragment-replicate left outer join > -

[jira] Commented: (PIG-1036) Fragment-replicate left outer join

2009-10-28 Thread Ankit Modi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771175#action_12771175 ] Ankit Modi commented on PIG-1036: - This patch fails in findBugs as I had modified ***lines (4

[jira] Commented: (PIG-1036) Fragment-replicate left outer join

2009-10-28 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771184#action_12771184 ] Olga Natkovich commented on PIG-1036: - Any findbug warnings that can't be fixed, must go

[jira] Commented: (PIG-953) Enable merge join in pig to work with loaders and store functions which can internally index sorted data

2009-10-28 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771188#action_12771188 ] Olga Natkovich commented on PIG-953: +1 on the patch assuming that the all the failures an

[jira] Commented: (PIG-1036) Fragment-replicate left outer join

2009-10-28 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771192#action_12771192 ] Dmitriy V. Ryaboy commented on PIG-1036: This is in the old POFRJoin too, but looking

[jira] Commented: (PIG-1036) Fragment-replicate left outer join

2009-10-28 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771195#action_12771195 ] Olga Natkovich commented on PIG-1036: - Actually, in a separate findbugs patch, I am remov

[jira] Updated: (PIG-1001) Generate more meaningful error message when one input file does not exist

2009-10-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1001: Status: Patch Available (was: Open) > Generate more meaningful error message when one input file does not ex

[jira] Updated: (PIG-1001) Generate more meaningful error message when one input file does not exist

2009-10-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1001: Attachment: PIG-1001-2.patch Reattach the patch per Alan's comment. > Generate more meaningful error message

[jira] Updated: (PIG-1001) Generate more meaningful error message when one input file does not exist

2009-10-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1001: Status: Open (was: Patch Available) > Generate more meaningful error message when one input file does not ex

[jira] Commented: (PIG-1016) Reading in map data seems broken

2009-10-28 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771200#action_12771200 ] Alan Gates commented on PIG-1016: - I am keeping an eye on this ticket. But at this point I'd

[jira] Commented: (PIG-1048) inner join using 'skewed' produces multiple rows for keys with single row in both input relations

2009-10-28 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771203#action_12771203 ] Alan Gates commented on PIG-1048: - Could you describe briefly the cause of the problem and ho