[jira] Commented: (PIG-1518) multi file input format for loaders

2010-08-17 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899445#action_12899445 ] Yan Zhou commented on PIG-1518: --- Another approach is to mark splits as uncombinable only when

[jira] Commented: (PIG-1466) Improve log messages for memory usage

2010-08-17 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899489#action_12899489 ] Olga Natkovich commented on PIG-1466: - Thejas, your proposal looks good Improve log

Re: Restarting discussion on Pig as a TLP

2010-08-17 Thread Jeff Hammerbacher
Would love to see Pig as a TLP. +1. On Mon, Aug 16, 2010 at 6:04 PM, Jeff Zhang zjf...@gmail.com wrote: Great, +1 On Tue, Aug 17, 2010 at 8:04 AM, Olga Natkovich ol...@yahoo-inc.com wrote: +1 -Original Message- From: Dmitriy Ryaboy [mailto:dvrya...@gmail.com] Sent: Monday,

[jira] Commented: (PIG-1510) Add `deepCopy` for LogicalExpressions

2010-08-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899498#action_12899498 ] Daniel Dai commented on PIG-1510: - You are right about fieldSchema and uidOnlyFieldSchema.

Re: Restarting discussion on Pig as a TLP

2010-08-17 Thread Daniel Dai
+1 Jeff Hammerbacher wrote: Would love to see Pig as a TLP. +1. On Mon, Aug 16, 2010 at 6:04 PM, Jeff Zhang zjf...@gmail.com wrote: Great, +1 On Tue, Aug 17, 2010 at 8:04 AM, Olga Natkovich ol...@yahoo-inc.com wrote: +1 -Original Message- From: Dmitriy Ryaboy

RE: Restarting discussion on Pig as a TLP

2010-08-17 Thread Santhosh Srinivasan
+1 Very nice! I see that opinion has changed within a couple of quarters :) I am pasting references to my responses to Alan's initial proposal to make Pig a TLP. I am all for making Pig a TLP. References: 1.

[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use hadoop from the apache maven repo.

2010-08-17 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding updated PIG-1452: -- Attachment: PIG-1452V4.PATCH New patch fixing the contrib projects. to remove hadoop20.jar from lib

[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use hadoop from the apache maven repo.

2010-08-17 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding updated PIG-1452: -- Status: Open (was: Patch Available) to remove hadoop20.jar from lib and use hadoop from the apache

[jira] Updated: (PIG-1452) to remove hadoop20.jar from lib and use hadoop from the apache maven repo.

2010-08-17 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding updated PIG-1452: -- Status: Patch Available (was: Open) to remove hadoop20.jar from lib and use hadoop from the apache

[jira] Updated: (PIG-1404) PigUnit - Pig script testing simplified.

2010-08-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1404: Attachment: PIG-1404-5.patch A rework of the patch that moves the code from pigunit to test. To answer

[jira] Updated: (PIG-1404) PigUnit - Pig script testing simplified.

2010-08-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1404: Attachment: (was: PIG-1404-5.patch) PigUnit - Pig script testing simplified.

[jira] Updated: (PIG-1404) PigUnit - Pig script testing simplified.

2010-08-17 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1404: Status: Patch Available (was: Open) PigUnit - Pig script testing simplified.

[jira] Commented: (PIG-1544) proactive-spill bags should share the memory alloted for it

2010-08-17 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899526#action_12899526 ] Thejas M Nair commented on PIG-1544: bq. We should not be using these bags for the cases

[jira] Commented: (PIG-1544) proactive-spill bags should share the memory alloted for it

2010-08-17 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899529#action_12899529 ] Olga Natkovich commented on PIG-1544: - So we should not use them in this case either. We

[jira] Commented: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-08-17 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899537#action_12899537 ] Olga Natkovich commented on PIG-1420: - I could not figure out how to re-open this issue.

[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and use hadoop from the apache maven repo.

2010-08-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899560#action_12899560 ] Daniel Dai commented on PIG-1452: - Shall we do the same thing to the target

[jira] Commented: (PIG-1546) Incorrect assert statements in operator evaluation

2010-08-17 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899566#action_12899566 ] Pradeep Kamath commented on PIG-1546: - Results from running the test-patch ant target

[jira] Commented: (PIG-1546) Incorrect assert statements in operator evaluation

2010-08-17 Thread Ajay Kidave (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899569#action_12899569 ] Ajay Kidave commented on PIG-1546: -- All the units tests were run and passed. Incorrect

[jira] Updated: (PIG-1546) Incorrect assert statements in operator evaluation

2010-08-17 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-1546: Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Resolution: Fixed

[jira] Updated: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-08-17 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-1420: --- Attachment: PIG-1420.2.patch This should fix the problem :). LMK if you'd like me to commit

[jira] Commented: (PIG-1447) Tune memory usage of InternalCachedBag

2010-08-17 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899576#action_12899576 ] Thejas M Nair commented on PIG-1447: I ran L15_modified after applying patch in PIG-1524,

[jira] Commented: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-08-17 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899580#action_12899580 ] Olga Natkovich commented on PIG-1420: - This will make it work with bytearrays but not

[jira] Commented: (PIG-1447) Tune memory usage of InternalCachedBag

2010-08-17 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899581#action_12899581 ] Olga Natkovich commented on PIG-1447: - Did you see any perf improvement? Tune memory

[jira] Commented: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-08-17 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899587#action_12899587 ] Dmitriy V. Ryaboy commented on PIG-1420: Right.. i forgot people don't call

[jira] Commented: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-08-17 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899592#action_12899592 ] Olga Natkovich commented on PIG-1420: - The only way I know is to actually make the code

[jira] Commented: (PIG-1334) Make pig artifacts available through maven

2010-08-17 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899593#action_12899593 ] Scott Carey commented on PIG-1334: -- Sure, pig-version-core.jar can be deployed to address

[jira] Commented: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-08-17 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899597#action_12899597 ] Dmitriy V. Ryaboy commented on PIG-1420: Yeah, let's plan to add a way to specify a

[jira] Commented: (PIG-1518) multi file input format for loaders

2010-08-17 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899605#action_12899605 ] Yan Zhou commented on PIG-1518: --- One experimental result on a 15-node cluster of 2 x Xeon L5420

[jira] Commented: (PIG-1518) multi file input format for loaders

2010-08-17 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899609#action_12899609 ] Yan Zhou commented on PIG-1518: --- The formatting of the table of the last comment is a bit off:

[jira] Commented: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-08-17 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899608#action_12899608 ] Olga Natkovich commented on PIG-1420: - 2 and 3 are backward incompatible with 0.7 and we

Re: [jira] Commented: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-08-17 Thread Russell Jurney
I can hack on this this weekend. Sorry for the absence on the JIRAs, been slammed on work stuff. Russ On Tue, Aug 17, 2010 at 2:46 PM, Olga Natkovich (JIRA) j...@apache.orgwrote: [

[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and use hadoop from the apache maven repo.

2010-08-17 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899631#action_12899631 ] Richard Ding commented on PIG-1452: --- The target buildJar-withouthadoop doesn't depend on

[jira] Commented: (PIG-1452) to remove hadoop20.jar from lib and use hadoop from the apache maven repo.

2010-08-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899639#action_12899639 ] Daniel Dai commented on PIG-1452: - Richard is right. +1 for the patch once test pass. to

August Pig contributor workshop

2010-08-17 Thread Alan Gates
All, We will be holding the next Pig contributor workshop at Twitter on Wednesday, August 25 from 4-6. The tentative agenda is to discuss: Making Piggybank better Pig and Azkaban integration Plans for features in 0.9 An update on the Howl project Anyone contributing to or interested in

RE: [jira] Commented: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-08-17 Thread Olga Natkovich
I think we agreed not to do it for this release. SO I think you are off the hook for now :) Olga -Original Message- From: Russell Jurney [mailto:russell.jur...@gmail.com] Sent: Tuesday, August 17, 2010 3:28 PM To: pig-dev@hadoop.apache.org Subject: Re: [jira] Commented: (PIG-1420) Make

[jira] Created: (PIG-1547) Piggybank MultiStorage does not scale when processing around 7k records per bucket

2010-08-17 Thread Viraj Bhat (JIRA)
Piggybank MultiStorage does not scale when processing around 7k records per bucket -- Key: PIG-1547 URL: https://issues.apache.org/jira/browse/PIG-1547 Project: Pig

[jira] Created: (PIG-1548) Optimize scalar to use distributed cache

2010-08-17 Thread Daniel Dai (JIRA)
Optimize scalar to use distributed cache - Key: PIG-1548 URL: https://issues.apache.org/jira/browse/PIG-1548 Project: Pig Issue Type: Improvement Components: impl Reporter:

[jira] Updated: (PIG-1548) Optimize scalar to consolidate the part file

2010-08-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1548: Summary: Optimize scalar to consolidate the part file (was: Optimize scalar to use distributed cache )

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899691#action_12899691 ] Jeff Zhang commented on PIG-1205: - I am reviewing this patch. Enhance HBaseStorage-- Make

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899718#action_12899718 ] Jeff Zhang commented on PIG-1205: - Several comments: 1. Is it possible to specify

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-17 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899722#action_12899722 ] Dmitriy V. Ryaboy commented on PIG-1205: bq. 1. Is it possible to specify min_row_key