Re: pig 0.11 candidate 2 feedback: Several problems

2013-03-01 Thread Dmitriy Ryaboy
I'd like to get the gc fix in as well, but looks like Rohini is about to commit it so we are good there. On Mar 1, 2013, at 11:33 AM, Bill Graham wrote: > +1 to releasing Pig 0.11.1 when this is addressed. I should be able to help > with the release again. > > > > On Fri, Mar 1, 2013 at 11:

[jira] [Commented] (PIG-3194) Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2

2013-03-01 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13591233#comment-13591233 ] Prashant Kommireddi commented on PIG-3194: -- Base64 seems to have been refactored a

[jira] [Updated] (PIG-3229) SearchEngineExtractor and SearchTermExtractor should use PigCounterHelper to log exceptions

2013-03-01 Thread Danny Antonetti (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Antonetti updated PIG-3229: - Description: SearchEngineExtractor and SearchTermExtractor catch MalformedURLException and return

[jira] [Updated] (PIG-3229) SearchEngineExtractor and SearchTermExtractor should use PigCounterHelper to log exceptions

2013-03-01 Thread Danny Antonetti (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Antonetti updated PIG-3229: - Attachment: SearchEngineExtractor_Counter.patch Adding a PigCounterHelper to SearchEngineExtractor

[jira] [Updated] (PIG-3229) SearchEngineExtractor and SearchTermExtractor should use PigCounterHelper to log exceptions

2013-03-01 Thread Danny Antonetti (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Antonetti updated PIG-3229: - Attachment: SearchTermExtractor_Counter.patch Adding PigCounterHelper logging to SearchTermExtracto

[jira] [Created] (PIG-3229) SearchEngineExtractor and SearchTermExtractor should use PigCounterHelper to log exceptions

2013-03-01 Thread Danny Antonetti (JIRA)
Danny Antonetti created PIG-3229: Summary: SearchEngineExtractor and SearchTermExtractor should use PigCounterHelper to log exceptions Key: PIG-3229 URL: https://issues.apache.org/jira/browse/PIG-3229

[jira] [Updated] (PIG-3228) SearchEngineExtractor throws an exception on a malformed URL

2013-03-01 Thread Danny Antonetti (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Antonetti updated PIG-3228: - Attachment: SearchEngineExtractor_Malformed.patch Catching a MalformedURLException and returning nu

[jira] [Updated] (PIG-3228) SearchEngineExtractor throws an exception on a malformed URL

2013-03-01 Thread Danny Antonetti (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Antonetti updated PIG-3228: - Patch Info: Patch Available > SearchEngineExtractor throws an exception on a malformed URL > --

[jira] [Updated] (PIG-3228) SearchEngineExtractor throws an exception on a malformed URL

2013-03-01 Thread Danny Antonetti (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Antonetti updated PIG-3228: - Attachment: (was: SearchEngineExtractor_Malformed.patch) > SearchEngineExtractor throws an

[jira] [Updated] (PIG-3228) SearchEngineExtractor throws an exception on a malformed URL

2013-03-01 Thread Danny Antonetti (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Antonetti updated PIG-3228: - Attachment: SearchEngineExtractor_Malformed.patch Patch for catching a MalformedURLException in Sea

[jira] [Created] (PIG-3228) SearchEngineExtractor throws an exception on a malformed URL

2013-03-01 Thread Danny Antonetti (JIRA)
Danny Antonetti created PIG-3228: Summary: SearchEngineExtractor throws an exception on a malformed URL Key: PIG-3228 URL: https://issues.apache.org/jira/browse/PIG-3228 Project: Pig Issue T

[jira] [Updated] (PIG-3227) SearchEngineExtractor does not work for bing

2013-03-01 Thread Danny Antonetti (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Antonetti updated PIG-3227: - Attachment: SearchEngineExtractor_Bing.patch Patch for supporting bing in the SearchEngineExtractor

[jira] [Created] (PIG-3227) SearchEngineExtractor does not work for bing

2013-03-01 Thread Danny Antonetti (JIRA)
Danny Antonetti created PIG-3227: Summary: SearchEngineExtractor does not work for bing Key: PIG-3227 URL: https://issues.apache.org/jira/browse/PIG-3227 Project: Pig Issue Type: Bug

[jira] [Commented] (PIG-3148) OutOfMemory exception while spilling stale DefaultDataBag. Extra option to gc() before spilling large bag.

2013-03-01 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13591179#comment-13591179 ] Dmitriy V. Ryaboy commented on PIG-3148: Looks good. Other calculations use biggest

[jira] Subscription: PIG patch available

2013-03-01 Thread jira
Issue Subscription Filter: PIG patch available (32 issues) Subscriber: pigdaily Key Summary PIG-3215[piggybank] Add LTSVLoader to load LTSV (Labeled Tab-separated Values) files https://issues.apache.org/jira/browse/PIG-3215 PIG-3211Allow default Load/Store fun

[jira] [Updated] (PIG-3172) Partition filter push down does not happen when there is a non partition key map column filter

2013-03-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3172: Fix Version/s: 0.12 Status: Patch Available (was: Open) > Partition filter pu

[jira] [Updated] (PIG-3172) Partition filter push down does not happen when there is a non partition key map column filter

2013-03-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3172: Attachment: PIG-3172-1.patch Fixed for cases where non partition column is a map or tuple

[jira] [Updated] (PIG-3142) Fixed-width load and store functions for the Piggybank

2013-03-01 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3142: --- Resolution: Fixed Assignee: Jonathan Packer Status: Resolved (was: Patch Available) Comm

[jira] [Commented] (PIG-3142) Fixed-width load and store functions for the Piggybank

2013-03-01 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13591095#comment-13591095 ] Cheolsoo Park commented on PIG-3142: +1. I will commit it after running tests.

Re: pig 0.11 candidate 2 feedback: Several problems

2013-03-01 Thread Julien Le Dem
sounds good to me too Julien On Mar 1, 2013, at 11:33 AM, Bill Graham wrote: > +1 to releasing Pig 0.11.1 when this is addressed. I should be able to help > with the release again. > > > > On Fri, Mar 1, 2013 at 11:25 AM, Prashant Kommireddi > wrote: > >> Hey Guys, >> >> I wanted to start a

[jira] [Commented] (PIG-3136) Introduce a syntax making declared aliases optional

2013-03-01 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13591076#comment-13591076 ] Cheolsoo Park commented on PIG-3136: I tested the new patch. Everything works. :-) I ma

Re: pig 0.11 candidate 2 feedback: Several problems

2013-03-01 Thread Julien Le Dem
sounds good to me too. On Fri, Mar 1, 2013 at 11:33 AM, Bill Graham wrote: > +1 to releasing Pig 0.11.1 when this is addressed. I should be able to help > with the release again. > > > > On Fri, Mar 1, 2013 at 11:25 AM, Prashant Kommireddi >wrote: > > > Hey Guys, > > > > I wanted to start a co

Re: Review Request: Introduce a syntax making declared aliases optional

2013-03-01 Thread Cheolsoo Park
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/9496/#review17244 --- Hi Jonathan, Overall looks good. My only concern is lack of unit te

[jira] [Updated] (PIG-3142) Fixed-width load and store functions for the Piggybank

2013-03-01 Thread Jonathan Packer (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Packer updated PIG-3142: - Attachment: PIG-3142_update_2.diff Hi Cheolsoo, I made the changes you requested and put them in th

[jira] [Commented] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-03-01 Thread Michael Kramer (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13590952#comment-13590952 ] Michael Kramer commented on PIG-3223: - [~dreambird]That's great Johnny. I'm attaching t

[jira] [Updated] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-03-01 Thread Michael Kramer (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Kramer updated PIG-3223: Attachment: AvroStorageUtils.patch AvroStorage.patch > AvroStorage does not handl

[jira] [Commented] (PIG-3148) OutOfMemory exception while spilling stale DefaultDataBag. Extra option to gc() before spilling large bag.

2013-03-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13590945#comment-13590945 ] Rohini Palaniswamy commented on PIG-3148: - +1. Will wait a day to see if Dmitriy has

[jira] [Updated] (PIG-3148) OutOfMemory exception while spilling stale DefaultDataBag. Extra option to gc() before spilling large bag.

2013-03-01 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3148: -- Attachment: pig-3148-v02.patch Sorry for the delay. Attaching a patch with suggested change.

Re: pig 0.11 candidate 2 feedback: Several problems

2013-03-01 Thread Bill Graham
+1 to releasing Pig 0.11.1 when this is addressed. I should be able to help with the release again. On Fri, Mar 1, 2013 at 11:25 AM, Prashant Kommireddi wrote: > Hey Guys, > > I wanted to start a conversation on this again. If Kai is not looking at > PIG-3194 I can start working on it to get 0.

Re: pig 0.11 candidate 2 feedback: Several problems

2013-03-01 Thread Prashant Kommireddi
Hey Guys, I wanted to start a conversation on this again. If Kai is not looking at PIG-3194 I can start working on it to get 0.11 compatible with 20.2. If everyone agrees, we should roll out 0.11.1 sooner than usual and I volunteer to help with it in anyway possible. Any objections to getting 0.1

[jira] [Updated] (PIG-3162) PigTest.assertOutput doesn't allow non-default delimiter

2013-03-01 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3162: --- Issue Type: Improvement (was: Bug) > PigTest.assertOutput doesn't allow non-default delimiter > --

[jira] [Updated] (PIG-3162) PigTest.assertOutput doesn't allow non-default delimiter

2013-03-01 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3162: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thanks Johnny!

[jira] [Assigned] (PIG-3223) AvroStorage does not handle comma separated input paths

2013-03-01 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang reassigned PIG-3223: - Assignee: Johnny Zhang > AvroStorage does not handle comma separated input paths >

[jira] [Updated] (PIG-3172) Partition filter push down does not happen when there is a non partition key map column filter

2013-03-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3172: Description: A = LOAD 'job_confs' USING org.apache.hcatalog.pig.HCatLoader(); B = FILTER A by

[jira] [Commented] (PIG-3215) [piggybank] Add LTSVLoader to load LTSV (Labeled Tab-separated Values) files

2013-03-01 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13590597#comment-13590597 ] Jonathan Coveney commented on PIG-3215: --- Made some comments on the RB

[jira] [Updated] (PIG-3141) Giving CSVExcelStorage an option to handle header rows

2013-03-01 Thread Jonathan Packer (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Packer updated PIG-3141: - Attachment: PIG-3141_update_3.diff fixed diff so it's from trunk instead of branch-0.11

[jira] [Commented] (PIG-3141) Giving CSVExcelStorage an option to handle header rows

2013-03-01 Thread Jonathan Packer (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13590592#comment-13590592 ] Jonathan Packer commented on PIG-3141: -- Hi, I put it on reviewboard here: https://revie

Re: Review Request: PIG-3215 [piggybank] Add LTSVLoader to load LTSV files

2013-03-01 Thread Jonathan Coveney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/9685/#review17239 --- contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storag

Re: Review Request: PIG-3141 [piggybank] Giving CSVExcelStorage an option to handle header rows

2013-03-01 Thread Jonathan Packer
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/9697/ --- (Updated March 1, 2013, 2:52 p.m.) Review request for pig. Description ---

Review Request: PIG-3141 [piggybank] Giving CSVExcelStorage an option to handle header rows

2013-03-01 Thread Jonathan Packer
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/9697/ --- Review request for pig. Description --- Reviewboard for https://issues.apac

[jira] [Updated] (PIG-3226) Groovy UDF support may fail to load script under some circumstances

2013-03-01 Thread Mathias Herberts (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathias Herberts updated PIG-3226: -- Description: When running in M/R mode, scripts may fail to load, this is due to the GroovyScript

[jira] [Updated] (PIG-3226) Groovy UDF support may fail to load script under some circumstances

2013-03-01 Thread Mathias Herberts (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathias Herberts updated PIG-3226: -- Attachment: PIG-3226.patch > Groovy UDF support may fail to load script under some circumstan

[jira] [Updated] (PIG-3216) Groovy UDFs documentation has minor typos

2013-03-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3216: Resolution: Fixed Fix Version/s: 0.11.1 0.12 Status: Reso

[jira] [Created] (PIG-3226) Groovy UDF support may fail to load script under some circumstances

2013-03-01 Thread Mathias Herberts (JIRA)
Mathias Herberts created PIG-3226: - Summary: Groovy UDF support may fail to load script under some circumstances Key: PIG-3226 URL: https://issues.apache.org/jira/browse/PIG-3226 Project: Pig

[jira] [Commented] (PIG-2417) Streaming UDFs - allow users to easily write UDFs in scripting languages with no JVM implementation.

2013-03-01 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13590420#comment-13590420 ] Jonathan Coveney commented on PIG-2417: --- Russell, If you want to take first stab at c

[jira] [Updated] (PIG-3136) Introduce a syntax making declared aliases optional

2013-03-01 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-3136: -- Attachment: PIG-3136-2.patch Patch updated to support those commands. Would love a +1, Cheolsoo :

Re: Review Request: Introduce a syntax making declared aliases optional

2013-03-01 Thread Jonathan Coveney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/9496/ --- (Updated March 1, 2013, 10:32 a.m.) Review request for pig, Daniel Dai and Alan

[jira] [Commented] (PIG-3136) Introduce a syntax making declared aliases optional

2013-03-01 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13590384#comment-13590384 ] Jonathan Coveney commented on PIG-3136: --- Cheolsoo, thanks for testing it. It absolutel