[jira] [Commented] (PIG-2614) AvroStorage crashes on LOADING a single bad error

2012-12-06 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13526129#comment-13526129 ] Russell Jurney commented on PIG-2614: - See PIG-3059 > AvroStorage crash

[jira] [Commented] (PIG-3015) Rewrite of AvroStorage

2012-12-06 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13526132#comment-13526132 ] Russell Jurney commented on PIG-3015: - See PIG-3059 > Rewrite of AvroSt

[jira] [Updated] (PIG-3015) Rewrite of AvroStorage

2012-12-06 Thread Joseph Adler (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph Adler updated PIG-3015: -- Attachment: PIG-3015.patch Added test cases for TrevniStorage (and made sure the test cases all pass)

[jira] [Updated] (PIG-3015) Rewrite of AvroStorage

2012-12-06 Thread Joseph Adler (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph Adler updated PIG-3015: -- Description: The current AvroStorage implementation has a lot of issues: it requires old versions of Avr

[jira] [Updated] (PIG-3015) Rewrite of AvroStorage

2012-12-06 Thread Joseph Adler (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph Adler updated PIG-3015: -- Attachment: (was: PIG-3015.patch) > Rewrite of AvroStorage > -- > >

[jira] Subscription: PIG patch available

2012-12-06 Thread jira
Issue Subscription Filter: PIG patch available (33 issues) Subscriber: pigdaily Key Summary PIG-3075Allow AvroStorage STORE Operations To Use Schema Specified By URI https://issues.apache.org/jira/browse/PIG-3075 PIG-3073POUserFunc creating log spam for large s

[jira] [Resolved] (PIG-3044) Trigger POPartialAgg compaction under GC pressure

2012-12-06 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy resolved PIG-3044. Resolution: Fixed Fix Version/s: 0.11 Release Note: When pig.exec.mapPartAgg, prev

[jira] [Updated] (PIG-3044) Trigger POPartialAgg compaction under GC pressure

2012-12-06 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3044: --- Attachment: PIG-3044.2.diff attached a version with Julien's comments incorporated. Will commit

[jira] [Resolved] (PIG-2815) class loader management in PigContext

2012-12-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-2815. Resolution: Fixed Closed. > class loader management in PigContext >

[jira] [Commented] (PIG-3076) make TestScalarAliases more reliable

2012-12-06 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13525893#comment-13525893 ] Jonathan Coveney commented on PIG-3076: --- Good stuff. You know I am all about making th

[jira] [Created] (PIG-3082) outputSchema of a UDF allows two usages when describing a Tuple schema

2012-12-06 Thread Julien Le Dem (JIRA)
Julien Le Dem created PIG-3082: -- Summary: outputSchema of a UDF allows two usages when describing a Tuple schema Key: PIG-3082 URL: https://issues.apache.org/jira/browse/PIG-3082 Project: Pig I

[jira] [Commented] (PIG-2204) Allow passing arguments to custom Partitioners

2012-12-06 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13525819#comment-13525819 ] Julien Le Dem commented on PIG-2204: maybe just updating the doc to mention this?

[jira] [Commented] (PIG-3043) Modify the UrlClassloader in PigContext so that classes from the same classloader are used first instead of the parent

2012-12-06 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13525813#comment-13525813 ] Julien Le Dem commented on PIG-3043: It looks like we could borrow: hadoop-yarn-project

[jira] [Commented] (PIG-2815) class loader management in PigContext

2012-12-06 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13525809#comment-13525809 ] Julien Le Dem commented on PIG-2815: 0.11/trunk sounds good to me > cl

[jira] [Commented] (PIG-3047) Check the size of a relation before adding it to distributed cache in Replicated join

2012-12-06 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13525807#comment-13525807 ] Julien Le Dem commented on PIG-3047: sounds good to me > Check the size

[jira] [Updated] (PIG-2599) Mavenize Pig

2012-12-06 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2599: --- Description: Switch Pig build system from ant to maven. was: Switch Pig build system from ant to

[jira] [Commented] (PIG-2599) Mavenize Pig

2012-12-06 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13525797#comment-13525797 ] Julien Le Dem commented on PIG-2599: Hey, that sounds like a great start. Usually attach

Re: Reducer estimation

2012-12-06 Thread Prashant Kommireddi
You could store stats for the last X runs and take an average for the next run. Sent from my iPhone On Dec 6, 2012, at 8:09 PM, Dmitriy Ryaboy wrote: > How would flat files work? The data needs to be updated by every pig run. > > On Dec 3, 2012, at 11:10 PM, Prashant Kommireddi wrote: > >> Awe

Re: Reducer estimation

2012-12-06 Thread Dmitriy Ryaboy
How would flat files work? The data needs to be updated by every pig run. On Dec 3, 2012, at 11:10 PM, Prashant Kommireddi wrote: > Awesome! It would be good to have a flat-file based impl as there will > probably a lot of pig users not having an hbase instance setup for > stats persistence. Le

Jenkins build is back to normal : Pig-trunk #1371

2012-12-06 Thread Apache Jenkins Server
See