[VOTE] Release Pig 0.11.0 (candidate 1)

2013-02-11 Thread Bill Graham
Hi, I have created a candidate build for Pig 0.11.0. Keys used to sign the release are available at: http://svn.apache.org/viewvc/pig/trunk/KEYS?view=markup Please download, test, and try it out: http://people.apache.org/~billgraham/pig-0.11.0-candidate-1/

[jira] [Updated] (PIG-3108) HBaseStorage returns empty maps when mixing wildcard- with other columns

2013-02-11 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-3108: - Resolution: Fixed Release Note: Tested and committed. Thanks for the patch Christoph and sorry for th

Re: [VOTE] Release Pig 0.11.0 (candidate 0)

2013-02-11 Thread Bill Graham
Ugh. I had updated the release notes file with a note about that along with notes about what's contained in the release. My updates made it here, but not into the artifacts: http://people.apache.org/~billgraham/pig-0.11.0-candidate-0/RELEASE_NOTES.txt Let me roll another RC. We should have the pr

Re: Injecting plans

2013-02-11 Thread Bill Graham
You can do it dynamically in the StoreFunc/LoadFunc, but not before the LP is built (since the LP really isn't yet involved with the physical location). Why would you need to change the location that early in the process? On Mon, Feb 11, 2013 at 6:30 PM, Julien Le Dem wrote: > Is it for testing

Re: Injecting plans

2013-02-11 Thread Julien Le Dem
Is it for testing or something totally different? you can also look at o.a.p.builtin.mock.Storage for injecting data Julien On Mon, Feb 11, 2013 at 6:17 PM, Prashant Kommireddi wrote: > That would work in the case when it's a static path? The problem here is my > base path will vary entirely for

Re: Injecting plans

2013-02-11 Thread Prashant Kommireddi
That would work in the case when it's a static path? The problem here is my base path will vary entirely for each different Pig job, and I would not like the client to set that. Rather my framework plugs-in the base path and I am guessing that can happen only after parsing/buildLP? On Mon, Feb 11,

Re: Injecting plans

2013-02-11 Thread Bill Graham
We've done this before by overriding relativeToAbsolutePath and setLocation in the LoadFunc, or the correspoding methods in StoreFunc. On Mon, Feb 11, 2013 at 2:10 PM, Prashant Kommireddi wrote: > Hey, > > I wanted to run an idea by you guys. I have a use-case where I try > injecting load/store

[jira] [Resolved] (PIG-3176) Pig can't use $HOME

2013-02-11 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Kommireddi resolved PIG-3176. -- Resolution: Not A Problem This currently works, marking it "Not A Problem". {code} %defa

[jira] Subscription: PIG patch available

2013-02-11 Thread jira
Issue Subscription Filter: PIG patch available (27 issues) Subscriber: pigdaily Key Summary PIG-3174Remove rpm and deb artifacts from build.xml https://issues.apache.org/jira/browse/PIG-3174 PIG-3169Remove temporary files that are not needed https:/

[jira] [Updated] (PIG-3181) MultiStorage - java.lang.OutOfMemoryError: Java heap space

2013-02-11 Thread Fabian Alenius (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Alenius updated PIG-3181: Description: Hi, I have a script that looks like this: a = load '/input' as (f1, f2);

[jira] [Updated] (PIG-3181) MultiStorage - java.lang.OutOfMemoryError: Java heap space

2013-02-11 Thread Fabian Alenius (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Alenius updated PIG-3181: Description: Hi, I have a script that looks like this: a = load '/input' as (f1, f2);

[jira] [Created] (PIG-3181) MultiStorage - java.lang.OutOfMemoryError: Java heap space

2013-02-11 Thread Fabian Alenius (JIRA)
Fabian Alenius created PIG-3181: --- Summary: MultiStorage - java.lang.OutOfMemoryError: Java heap space Key: PIG-3181 URL: https://issues.apache.org/jira/browse/PIG-3181 Project: Pig Issue Type:

Re: [VOTE] Release Pig 0.11.0 (candidate 0)

2013-02-11 Thread Alan Gates
+1 Ran a few smoke tests in both local and cluster modes, compiled and ran the unit tests on the source, tested piggybank and the tutorial, looked over the NOTICE, LICENSE, and RELEASE_NOTES files. We should update the RELEASE_NOTES to say we've tested this version with Hadoop 1.0 (instead of

[jira] [Updated] (PIG-3179) Task Information Header only prints out the first split for each task

2013-02-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3179: -- Attachment: pig-3179-v03.patch bq. Hi Koji Noguchi, minor thing - calling toString on Path might be redun

[jira] [Commented] (PIG-3179) Task Information Header only prints out the first split for each task

2013-02-11 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13576068#comment-13576068 ] Prashant Kommireddi commented on PIG-3179: -- Hi [~knoguchi], minor thing - calling t

[jira] [Updated] (PIG-3015) Rewrite of AvroStorage

2013-02-11 Thread Joseph Adler (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph Adler updated PIG-3015: -- Attachment: PIG-3015-8.patch Added description of AvroStorage and TrevniStorage to documentation. (Not f

[jira] [Commented] (PIG-3179) Task Information Header only prints out the first split for each task

2013-02-11 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13576006#comment-13576006 ] Rohini Palaniswamy commented on PIG-3179: - Thanks Koji. Its a log message and people

[jira] [Updated] (PIG-3179) Task Information Header only prints out the first split for each task

2013-02-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3179: -- Attachment: pig-3179-v02.patch Changed based on Rohini's suggestion. Added extra line printing out the nu

[jira] [Commented] (PIG-3179) Task Information Header only prints out the first split for each task

2013-02-11 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13575972#comment-13575972 ] Rohini Palaniswamy commented on PIG-3179: - I meant something like this. Input-split

Re: $HOME

2013-02-11 Thread Prashant Kommireddi
Done https://issues.apache.org/jira/browse/PIG-3180 On Mon, Feb 11, 2013 at 9:44 AM, Jonathan Coveney wrote: > Prashant: not sure. It probably isn't. We should make a ticket for that if > it isn't. > Russell: can you close the ticket you made, with the answer? > > > 2013/2/11 Russell Jurney > >

[jira] [Created] (PIG-3180) Document using shell commands in Pig scripts

2013-02-11 Thread Prashant Kommireddi (JIRA)
Prashant Kommireddi created PIG-3180: Summary: Document using shell commands in Pig scripts Key: PIG-3180 URL: https://issues.apache.org/jira/browse/PIG-3180 Project: Pig Issue Type: Impr

[jira] [Updated] (PIG-2553) Pig shouldn't allow attempts to write multiple relations into same directory

2013-02-11 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Kommireddi updated PIG-2553: - Patch Info: Patch Available > Pig shouldn't allow attempts to write multiple relations

[jira] [Commented] (PIG-3179) Task Information Header only prints out the first split for each task

2013-02-11 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13575923#comment-13575923 ] Rohini Palaniswamy commented on PIG-3179: - Input-split file: hdfs://gridx.yahoo.com

[jira] [Updated] (PIG-3178) Print a stacktrace when ExecutableManager hits an OOM

2013-02-11 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3178: Resolution: Fixed Fix Version/s: 0.12 Status: Resolved (was: Patch Availabl

[jira] [Updated] (PIG-3179) Task Information Header only prints out the first split for each task

2013-02-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3179: -- Attachment: pig-3179-v01.patch Added for-loop to print all the splits. > Task Informatio

[jira] [Created] (PIG-3179) Task Information Header only prints out the first split for each task

2013-02-11 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-3179: - Summary: Task Information Header only prints out the first split for each task Key: PIG-3179 URL: https://issues.apache.org/jira/browse/PIG-3179 Project: Pig Issu

[jira] [Updated] (PIG-3178) Print a stacktrace when ExecutableManager hits an OOM

2013-02-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3178: -- Attachment: pig-3178-trunk-v03.patch Sorry for the spam. Rohini pointed out that last patch was based fro

[jira] [Updated] (PIG-3178) Print a stacktrace when ExecutableManager hits an OOM

2013-02-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3178: -- Status: Patch Available (was: Open) > Print a stacktrace when ExecutableManager hits an OOM > --

[jira] [Updated] (PIG-3178) Print a stacktrace when ExecutableManager hits an OOM

2013-02-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3178: -- Attachment: pig-3178-trunk-v02.patch bq. Can you just add a message - LOG.error("Error running blah blah"

[jira] [Updated] (PIG-3178) Print a stacktrace when ExecutableManager hits an OOM

2013-02-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3178: -- Status: Open (was: Patch Available) > Print a stacktrace when ExecutableManager hits an OOM > --

[jira] [Commented] (PIG-3178) Print a stacktrace when ExecutableManager hits an OOM

2013-02-11 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13575871#comment-13575871 ] Rohini Palaniswamy commented on PIG-3178: - public void error(Object message); public

[jira] [Commented] (PIG-3178) Print a stacktrace when ExecutableManager hits an OOM

2013-02-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13575869#comment-13575869 ] Koji Noguchi commented on PIG-3178: --- bq. Doesn't LOG.error(t); log the stacktrace? I thou

[jira] [Commented] (PIG-3178) Print a stacktrace when ExecutableManager hits an OOM

2013-02-11 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13575840#comment-13575840 ] Rohini Palaniswamy commented on PIG-3178: - Doesn't LOG.error(t); log the stacktrace?

[jira] [Updated] (PIG-3178) Print a stacktrace when ExecutableManager hits an OOM

2013-02-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3178: -- Attachment: pig-3178-trunk-v01.patch Adding printStackTrace call. Since it's only a logging change, no t

[jira] [Updated] (PIG-3178) Print a stacktrace when ExecutableManager hits an OOM

2013-02-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3178: -- Status: Patch Available (was: Open) > Print a stacktrace when ExecutableManager hits an OOM > --

[jira] [Created] (PIG-3178) Print a stacktrace when ExecutableManager hits an OOM

2013-02-11 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-3178: - Summary: Print a stacktrace when ExecutableManager hits an OOM Key: PIG-3178 URL: https://issues.apache.org/jira/browse/PIG-3178 Project: Pig Issue Type: Improveme

[jira] [Created] (PIG-3177) Fix Pig project SEO so latest, 0.11 docs show when you google things

2013-02-11 Thread Russell Jurney (JIRA)
Russell Jurney created PIG-3177: --- Summary: Fix Pig project SEO so latest, 0.11 docs show when you google things Key: PIG-3177 URL: https://issues.apache.org/jira/browse/PIG-3177 Project: Pig I

[jira] [Created] (PIG-3176) Pig can't use $HOME

2013-02-11 Thread Russell Jurney (JIRA)
Russell Jurney created PIG-3176: --- Summary: Pig can't use $HOME Key: PIG-3176 URL: https://issues.apache.org/jira/browse/PIG-3176 Project: Pig Issue Type: Bug Components: grunt, parser