Re: [Pig Wiki] Update of "ProposedProjects" by AlanGates

2009-04-16 Thread nitesh bhatia
Hi Can you briefly explain what is required in the first project? After reading the description my impression is, currently when we are executing commands on Pig Shell, Pig is first converting to map-reduce jobs and then feeding it to hadoop. In this project are we proposing that, the execution pla

Re: Ajax library for Pig

2009-04-16 Thread Tom White
Sounds like an interesting project. This ticket I opened some while back about running multiple Pig sessions on one JVM may be relevant: https://issues.apache.org/jira/browse/PIG-240 Tom On Tue, Apr 14, 2009 at 11:14 PM, Ted Dunning wrote: > Each pig program submission should involve a separate

Re: [Pig Wiki] Update of "HowToContribute" by AlanGates

2009-04-16 Thread Alan Gates
At this point these are all proposed, none are yet realized. So there is no code for any of them. The place to track these proposals are in the referenced JIRAs. Alan. On Apr 15, 2009, at 6:44 PM, zhang jianfeng wrote: Hi Alan, Thank you for your guideline. So where's code of these Pr

Re: [Pig Wiki] Update of "ProposedProjects" by AlanGates

2009-04-16 Thread Alan Gates
Your understanding of the proposal is correct. The goal would be to produce Java code rather than a pipeline configuration. But the reasoning is not so that users can then take that and modify themselves. There's nothing preventing them from doing it, but it has a couple of major drawbac

Re: [Pig Wiki] Update of "ProposedProjects" by AlanGates

2009-04-16 Thread Thejas Nair
This paper seems very relevant to the proposal - "Compiled Query Execution Engine using JVM" http://www2.computer.org/portal/web/csdl/doi/10.1109/ICDE.2006.40 >From the abstract - "Our experimental results on the TPC-H data set show that, despite both engines benefiting from JIT, the compiled engi

[jira] Resolved: (PIG-739) Filter in foreach seems to drop records resulting in decreased count of records

2009-04-16 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath resolved PIG-739. Resolution: Duplicate Assignee: Pradeep Kamath This issue has the same root cause of PIG-514 - h

[jira] Commented: (PIG-626) Statistics (records read by each mapper and reducer)

2009-04-16 Thread Shubham Chopra (JIRA)
[ https://issues.apache.org/jira/browse/PIG-626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12699798#action_12699798 ] Shubham Chopra commented on PIG-626: Tested the patch with the latest trunk. > Statistics

[jira] Resolved: (PIG-710) Filtering bag in nested foreach does not produce expected results

2009-04-16 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath resolved PIG-710. Resolution: Duplicate Fix Version/s: 0.3.0 Assignee: Pradeep Kamath This issue has the

[jira] Commented: (PIG-514) COUNT returns no results as a result of two filter statements in FOREACH

2009-04-16 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12699801#action_12699801 ] Pradeep Kamath commented on PIG-514: I am currently working on implementing the above prop

[jira] Commented: (PIG-767) Schema reported from DESCRIBE and actual schema of inner bags are different.

2009-04-16 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12699810#action_12699810 ] Santhosh Srinivasan commented on PIG-767: - Firstly, the describe output is broken for

[jira] Commented: (PIG-767) Schema reported from DESCRIBE and actual schema of inner bags are different.

2009-04-16 Thread George Mavromatis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12699832#action_12699832 ] George Mavromatis commented on PIG-767: --- Santosh: You are saying the exact same thing I

[jira] Commented: (PIG-767) Schema reported from DESCRIBE and actual schema of inner bags are different.

2009-04-16 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12699842#action_12699842 ] Santhosh Srinivasan commented on PIG-767: - As a reference, please look at PIG-449 The

[jira] Commented: (PIG-766) ava.lang.OutOfMemoryError: Java heap space

2009-04-16 Thread Vadim Zaliva (JIRA)
[ https://issues.apache.org/jira/browse/PIG-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12699915#action_12699915 ] Vadim Zaliva commented on PIG-766: -- I have 1Gb now, could not go any higher. > ava.lang.Out

[jira] Commented: (PIG-764) pig patch tests are failing

2009-04-16 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12699926#action_12699926 ] Olga Natkovich commented on PIG-764: Looks like this is an issue with some test cases not

[jira] Updated: (PIG-627) PERFORMANCE: multi-query optimization

2009-04-16 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/PIG-627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated PIG-627: --- Attachment: error_handling_0416.patch Fixed some issues with the error handling patch (0415):