Re: Pig Error Java_home not set

2013-03-15 Thread Prashant Kommireddi
export JAVA_HOME=path/to/java on your local machine. Even better if you can add it to your .bashrc or .profile or their equivalents. On Mar 15, 2013, at 7:59 AM, oualid ait wafli oualid.aitwa...@gmail.com wrote: Hi I am beginner at Pig I want start it but I dont know how to fix fix the

Re: Error 4010 Cannot find hadoop configurations in classpath

2013-03-15 Thread Prashant Kommireddi
Take a look at http://pig.apache.org/docs/r0.11.0/start.html#Running+the+Pig+Scripts+in+Mapreduce+Mode Additionally, you can try pig -x local if you wish to run it in local mode http://pig.apache.org/docs/r0.11.0/start.html#Running+the+Pig+Scripts+in+Local+Mode Please follow the instructions on

[jira] [Commented] (PIG-3249) Pig startup script prints out a wrong version of hadoop when using fat jar

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13603540#comment-13603540 ] Daniel Dai commented on PIG-3249: - We can change to use java -cp pig.jar

[jira] [Commented] (PIG-3205) Passing arguments to python script does not work with -f option

2013-03-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13603560#comment-13603560 ] Cheolsoo Park commented on PIG-3205: +1. Do you mind deleting the following line if

[jira] [Commented] (PIG-3205) Passing arguments to python script does not work with -f option

2013-03-15 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13603563#comment-13603563 ] Rohini Palaniswamy commented on PIG-3205: - Ah. Sure. Thanks for catching it. Left

[jira] [Commented] (PIG-2597) Move grunt from javacc to ANTRL

2013-03-15 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13603583#comment-13603583 ] Koji Noguchi commented on PIG-2597: --- bq. Jonathan, any update on this? I'm interested in

Re: LoadFunc and LoadMetadata

2013-03-15 Thread Daniel Dai
getPartitionKeys should be called by default. Did you use AS clause in load statement? That could add a foreach between Load and Filter, and getPartitionKeys will only be invoked if filter is right after load. Do an explain to check for it. Thanks, Daniel On Thu, Mar 14, 2013 at 8:37 PM, Jeff

[jira] [Commented] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-03-15 Thread Michael Kramer (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13603652#comment-13603652 ] Michael Kramer commented on PIG-3223: - [~cheolsoo], thanks for getting back to me so

Re: LoadFunc and LoadMetadata

2013-03-15 Thread Jeff Yuan
Yes, I do use AS in the load statement. I thought Filters are always pushed as close to the Load operators as possible? What kind of Foreach is added? Thanks, Jeff On Fri, Mar 15, 2013 at 10:57 AM, Daniel Dai da...@hortonworks.com wrote: getPartitionKeys should be called by default. Did you use

[jira] [Assigned] (PIG-2630) Issue with setting b = a;

2013-03-15 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang reassigned PIG-2630: - Assignee: (was: Johnny Zhang) Issue with setting b = a; ---

Re: Contribute to PIG-3225

2013-03-15 Thread Russell Jurney
Can we have a GsoC entry to antlrize grunt? Who can mentor it? Russell Jurney http://datasyndrome.com On Mar 15, 2013, at 11:34 AM, Daniel Dai da...@hortonworks.com wrote: GSoC 2013 wiki is not up yet. You can find some information from last year's wiki:

[jira] [Updated] (PIG-3194) Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2

2013-03-15 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Kommireddi updated PIG-3194: - Attachment: PIG-3194_2.patch Uploading a new patch with Dmitriy's feedback incorporated.

[jira] [Updated] (PIG-3244) Make PIG_HOME configurable

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3244: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Looks

[jira] [Updated] (PIG-3244) Make PIG_HOME configurable

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3244: Assignee: Robert Schooley Make PIG_HOME configurable -- Key:

Re: LoadFunc and LoadMetadata

2013-03-15 Thread Daniel Dai
Yes, in theory filter should pushed above foreach. I don't know what happen, the easiest way is do an explain and let's check the plan. Daniel On Fri, Mar 15, 2013 at 11:32 AM, Jeff Yuan quaintena...@gmail.com wrote: Yes, I do use AS in the load statement. I thought Filters are always pushed

[jira] [Commented] (PIG-3249) Pig startup script prints out a wrong version of hadoop when using fat jar

2013-03-15 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13603946#comment-13603946 ] Prashant Kommireddi commented on PIG-3249: -- Thanks Daniel, that's a nice approach.

[jira] [Commented] (PIG-3194) Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2

2013-03-15 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13603984#comment-13603984 ] Dmitriy V. Ryaboy commented on PIG-3194: +1 Changes to

[jira] [Assigned] (PIG-3249) Pig startup script prints out a wrong version of hadoop when using fat jar

2013-03-15 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Kommireddi reassigned PIG-3249: Assignee: Prashant Kommireddi Pig startup script prints out a wrong version of

[jira] [Updated] (PIG-3249) Pig startup script prints out a wrong version of hadoop when using fat jar

2013-03-15 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Kommireddi updated PIG-3249: - Attachment: PIG-3249.patch Pig startup script prints out a wrong version of hadoop

Are we ready for 0.11.1 release?

2013-03-15 Thread Dmitriy Ryaboy
I think all the critical patches we discussed as required for 0.11.1 have gone in -- is there anything else people want to finish up, or can we roll this? Current change log: Release 0.11.1 (unreleased) INCOMPATIBLE CHANGES IMPROVEMENTS PIG-2988: start deploying pigunit maven artifact part of

Re: pig 0.11 candidate 2 feedback: Several problems

2013-03-15 Thread Prashant Kommireddi
Looks like all outstanding 0.11.1 critical bugs are fixed. Time for an RC? Please let me know if I can help. On Fri, Mar 8, 2013 at 3:51 PM, Dmitriy Ryaboy dvrya...@gmail.com wrote: Looks like Lohit found a critical bug we should fix for 11.1:

[jira] [Commented] (PIG-3194) Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2

2013-03-15 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13604023#comment-13604023 ] Prashant Kommireddi commented on PIG-3194: -- Thanks for review/commit, Dmitriy.

[jira] [Commented] (PIG-3194) Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2

2013-03-15 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13604037#comment-13604037 ] Prashant Kommireddi commented on PIG-3194: -- Kai, can you confirm 11.1 works for

Re: Contribute to PIG-3225

2013-03-15 Thread Daniel Dai
That's PIG-2597. I am not sure about the status of it, if it is not done, we can continue it this year. Daniel On Fri, Mar 15, 2013 at 11:52 AM, Russell Jurney russell.jur...@gmail.com wrote: Can we have a GsoC entry to antlrize grunt? Who can mentor it? Russell Jurney http://datasyndrome.com

Re: Are we ready for 0.11.1 release?

2013-03-15 Thread Daniel Dai
Can I put PIG-3132 in? Thanks, Daniel On Fri, Mar 15, 2013 at 5:55 PM, Julien Le Dem jul...@twitter.com wrote: +1 for a new release On Friday, March 15, 2013, Dmitriy Ryaboy wrote: I think all the critical patches we discussed as required for 0.11.1 have gone in -- is there anything else

[jira] [Commented] (PIG-3181) MultiStorage - java.lang.OutOfMemoryError: Java heap space

2013-03-15 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13604062#comment-13604062 ] Johnny Zhang commented on PIG-3181: --- Hi, do you mean below right? {noformat} a = load

Re: Are we ready for 0.11.1 release?

2013-03-15 Thread Julien Le Dem
+1 for a new release Julien On Mar 15, 2013, at 17:08, Dmitriy Ryaboy dvrya...@gmail.com wrote: I think all the critical patches we discussed as required for 0.11.1 have gone in -- is there anything else people want to finish up, or can we roll this? Current change log: Release 0.11.1

Re: Welcome our new PMC chair, Julien Le Dem

2013-03-15 Thread Julien Le Dem
Thank you all ! Julien On Mar 10, 2013, at 21:31, Xuefu Zhang xzh...@inadco.com wrote: Congrats!!! --Xuefu On Sun, Mar 10, 2013 at 9:00 PM, Jarek Jarcec Cecho jar...@apache.orgwrote: Congratulations sir! Jarcec On Sun, Mar 10, 2013 at 08:55:55PM -0700, Aniket Mokashi wrote:

[jira] Subscription: PIG patch available

2013-03-15 Thread jira
Issue Subscription Filter: PIG patch available (33 issues) Subscriber: pigdaily Key Summary PIG-3247Piggybank functions to mimic OVER clause in SQL https://issues.apache.org/jira/browse/PIG-3247 PIG-3238Pig current releases lack a UDF Stuff(). This UDF deletes

[jira] [Commented] (PIG-3249) Pig startup script prints out a wrong version of hadoop when using fat jar

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13604064#comment-13604064 ] Daniel Dai commented on PIG-3249: - Sure, can't agree more. Pig startup

[jira] [Commented] (PIG-3243) Documentation error

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13604066#comment-13604066 ] Daniel Dai commented on PIG-3243: - Would you like to create a patch? Change the

[jira] [Commented] (PIG-3238) Pig current releases lack a UDF Stuff(). This UDF deletes a specified length of characters and inserts another set of characters at a specified starting point.

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13604071#comment-13604071 ] Daniel Dai commented on PIG-3238: - Thanks for the patch. However, we need example in javadoc

[jira] [Commented] (PIG-3235) Enable DEBUG log messages in unit tests by default

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13604076#comment-13604076 ] Daniel Dai commented on PIG-3235: - Make sense, but would like set the default to warning.

[jira] [Updated] (PIG-3236) parametrize snapshot and staging repo id

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3236: Attachment: PIG-3236-0.12.patch Attach patch for trunk. parametrize snapshot and staging

[jira] [Resolved] (PIG-3236) parametrize snapshot and staging repo id

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-3236. - Resolution: Fixed Fix Version/s: 0.12 Hadoop Flags: Reviewed Committed to trunk.

[jira] [Updated] (PIG-3235) Add log4j.properties for unit tests

2013-03-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3235: --- Summary: Add log4j.properties for unit tests (was: Enable DEBUG log messages in unit tests by

[jira] [Updated] (PIG-3235) Enable DEBUG log messages in unit tests by default

2013-03-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3235: --- Attachment: PIG-3235-2.patch Sure. I lowered the logging level to INFO, which is the current default

[jira] [Commented] (PIG-3235) Add log4j.properties for unit tests

2013-03-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13604127#comment-13604127 ] Daniel Dai commented on PIG-3235: - +1 Add log4j.properties for unit tests

[jira] [Updated] (PIG-3235) Add log4j.properties for unit tests

2013-03-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3235: --- Resolution: Fixed Fix Version/s: 0.12 Status: Resolved (was: Patch Available) Thank