Multiple successors

2010-07-20 Thread Swati Jain
I noticed a number of places in the code where the successors of a LogicalRelationalOperator is accessed as op.successors.get(0). Is it always the case that logical relational operators (in the new logical optimizer framework) have only 1 successor? Why dont the rules iterate over the successors

[jira] Commented: (PIG-1379) Jars registered from command line should override the ones present in the script

2010-07-20 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12890316#action_12890316 ] Alan Gates commented on PIG-1379: - Won't this cause a backward compatibility issue? Have we

[jira] Updated: (PIG-1379) Jars registered from command line should override the ones present in the script

2010-07-20 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1379: Hadoop Flags: [Incompatible change] Jars registered from command line should override the ones present in

Announcing Howl development list

2010-07-20 Thread Alan Gates
On Jul 14, 2010, at 2:11 AM, Jeff Hammerbacher wrote: Hey, Thanks for writing up these notes, they're very useful. Pradeep Kamath gave a short presentation on Howl, the work he is leading to create a shared metadata system between Pig, Hive, and Map Reduce. Dmitriy noted that we need

[jira] Created: (PIG-1507) Full outer join fails while doing a filter on joined data

2010-07-20 Thread Daniel Dai (JIRA)
Full outer join fails while doing a filter on joined data - Key: PIG-1507 URL: https://issues.apache.org/jira/browse/PIG-1507 Project: Pig Issue Type: Bug Components: impl

[jira] Assigned: (PIG-602) Pass global configurations to UDF

2010-07-20 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-602: -- Assignee: (was: Alan Gates) Pass global configurations to UDF

[jira] Updated: (PIG-1434) Allow casting relations to scalars

2010-07-20 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-1434: Attachment: (was: ScalarImpl1.patch) Allow casting relations to scalars

[jira] Updated: (PIG-1434) Allow casting relations to scalars

2010-07-20 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-1434: Attachment: ScalarImpl1.patch Allow casting relations to scalars

[jira] Assigned: (PIG-480) PERFORMANCE: Use identity mapper in a chain of M-R jobs

2010-07-20 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-480: -- Assignee: (was: Ying He) PERFORMANCE: Use identity mapper in a chain of M-R jobs

[jira] Commented: (PIG-1295) Binary comparator for secondary sort

2010-07-20 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12890384#action_12890384 ] Daniel Dai commented on PIG-1295: - Patch looks pretty good. Thanks Gianmarco! Couple of

Re: Multiple successors

2010-07-20 Thread Daniel Dai
Hi, Swati, The only logical operator can have multiple output is LOSplit. So until now, it is safe to assume logical operator only have 1 output except for LOSplit. Daniel Swati Jain wrote: I noticed a number of places in the code where the successors of a LogicalRelationalOperator is

[jira] Updated: (PIG-1507) Full outer join fails while doing a filter on joined data

2010-07-20 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1507: Attachment: PIG-1507-1.patch Full outer join fails while doing a filter on joined data

[jira] Updated: (PIG-1507) Full outer join fails while doing a filter on joined data

2010-07-20 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1507: Status: Patch Available (was: Open) Full outer join fails while doing a filter on joined data

Re: explicitly close a mr job

2010-07-20 Thread Daniel Dai
You can refer to MrCompiler.startNew. You need to add store to close current MapReduceOper, create a new MapReduceOper, add load, then add MapReduceOper to MRPlan. Daniel Gang Luo wrote: Hi all, when compile a physical plan into MR plan, the current rule is to put as many operator as

[jira] Updated: (PIG-1434) Allow casting relations to scalars

2010-07-20 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-1434: Attachment: ScalarImpl1.patch Allow casting relations to scalars

[jira] Updated: (PIG-1434) Allow casting relations to scalars

2010-07-20 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-1434: Attachment: (was: ScalarImpl1.patch) Allow casting relations to scalars

Re: Announcing Howl development list

2010-07-20 Thread Jeff Hammerbacher
A wiki page outlining Howl is at http://wiki.apache.org/pig/Howl A howldev mailing list has been set up on Yahoo! groups for discussions on Howl. You can subscribe by sending mail to howldev-subscr...@yahoogroups.com. We plan on putting the code on github in a read only repository. It

[jira] Created: (PIG-1508) Make 'docs' target (forrest) work with Java 1.6

2010-07-20 Thread Carl Steinbach (JIRA)
Make 'docs' target (forrest) work with Java 1.6 --- Key: PIG-1508 URL: https://issues.apache.org/jira/browse/PIG-1508 Project: Pig Issue Type: Bug Components: documentation Affects

[jira] Created: (PIG-1509) Add .gitignore file

2010-07-20 Thread Carl Steinbach (JIRA)
Add .gitignore file --- Key: PIG-1509 URL: https://issues.apache.org/jira/browse/PIG-1509 Project: Pig Issue Type: Improvement Components: build Reporter: Carl Steinbach Add a .gitignore file

[jira] Updated: (PIG-1508) Make 'docs' target (forrest) work with Java 1.6

2010-07-20 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated PIG-1508: Status: Patch Available (was: Open) Make 'docs' target (forrest) work with Java 1.6

[jira] Updated: (PIG-1508) Make 'docs' target (forrest) work with Java 1.6

2010-07-20 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated PIG-1508: Attachment: PIG-1508.patch.txt PIG-1508.patch.txt: * set forrest.validate.sitemap=false in

[jira] Updated: (PIG-1509) Add .gitignore file

2010-07-20 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated PIG-1509: Status: Patch Available (was: Open) Add .gitignore file ---

[jira] Updated: (PIG-1509) Add .gitignore file

2010-07-20 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated PIG-1509: Attachment: PIG-1509.patch.txt Add .gitignore file --- Key:

[jira] Updated: (PIG-1309) Map-side Cogroup

2010-07-20 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1309: Fix Version/s: 0.7.0 Map-side Cogroup Key: PIG-1309

[jira] Commented: (PIG-1507) Full outer join fails while doing a filter on joined data

2010-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12890521#action_12890521 ] Hadoop QA commented on PIG-1507: -1 overall. Here are the results of testing the latest