[jira] Assigned: (PIG-832) Make import list configurable

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-832: -- Assignee: Daniel Dai (was: Olga Natkovich) Make import list configurable

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721353#action_12721353 ] Olga Natkovich commented on PIG-832: As part of this fix we should also expand the default

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721361#action_12721361 ] Milind Bhandarkar commented on PIG-832: --- If we include the piggybank functions in the

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721371#action_12721371 ] Daniel Dai commented on PIG-832: How about this syntax: Add a new java property:

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721373#action_12721373 ] Olga Natkovich commented on PIG-832: In response to Milind. I don't think we are

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721387#action_12721387 ] Olga Natkovich commented on PIG-832: Milind, Not quite sure what you are saying. We

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721396#action_12721396 ] Milind Bhandarkar commented on PIG-832: --- Olga, what I am saying is to have a default

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721413#action_12721413 ] Milind Bhandarkar commented on PIG-832: --- Instead of a list, if you make it a map (i.e.

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721414#action_12721414 ] Olga Natkovich commented on PIG-832: Milind, Couple of comments and clarifications: (1)

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721423#action_12721423 ] Olga Natkovich commented on PIG-832: Also think you are suggesting UDF aliasing on command

[VOTE] Release Pig 0.3.0 (candidate 0)

2009-06-18 Thread Olga Natkovich
Hi, I created a candidate build for Pig 0.3.0 release. The main feature of this release is support for multiquery which allows to share computation across multiple queries within the same script. We see significant performance improvements (up to order of magnitude) as the result of this

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721428#action_12721428 ] Milind Bhandarkar commented on PIG-832: --- Hardwiring names that are not reserved words is

[jira] Created: (PIG-857) Pig should implement Tool interface from Hadoop

2009-06-18 Thread Milind Bhandarkar (JIRA)
Pig should implement Tool interface from Hadoop --- Key: PIG-857 URL: https://issues.apache.org/jira/browse/PIG-857 Project: Pig Issue Type: Improvement Components: impl Affects

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721456#action_12721456 ] Daniel Dai commented on PIG-832: Hi, Milind, in the use case you mentioned, he/she can write

[jira] Updated: (PIG-734) Non-string keys in maps

2009-06-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-734: --- Status: Open (was: Patch Available) Non-string keys in maps --- Key:

[jira] Updated: (PIG-734) Non-string keys in maps

2009-06-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-734: --- Attachment: PIG-734_2.patch New version of the patch, brought up to date with current trunk. Non-string keys

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721481#action_12721481 ] Olga Natkovich commented on PIG-832: Milind, we have parameter substitution for what you

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721490#action_12721490 ] Milind Bhandarkar commented on PIG-832: --- Daniel: For that to work, user's class will

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721503#action_12721503 ] Daniel Dai commented on PIG-832: Hi, Milind, For your first comment, yes, user's class have to

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721506#action_12721506 ] Olga Natkovich commented on PIG-832: Milind, Issue is not the complexity of

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721514#action_12721514 ] Milind Bhandarkar commented on PIG-832: --- Olga, specifying a list of packages as a path

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721519#action_12721519 ] Daniel Dai commented on PIG-832: Hi, Milind, If a user wrote 10 UDFs, I guess he/she does not

[jira] Updated: (PIG-852) pig -version or pig -help returns exit code of 1

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-852: --- Fix Version/s: 0.3.0 pig -version or pig -help returns exit code of 1

[jira] Updated: (PIG-819) run -param -param; is a valid grunt command

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-819: --- Fix Version/s: 0.3.0 run -param -param; is a valid grunt command

[jira] Updated: (PIG-818) Explain doesn't handle PODemux properly

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-818: --- Fix Version/s: 0.3.0 Explain doesn't handle PODemux properly ---

[jira] Updated: (PIG-564) Parameter Substitution using -param option does not seem to work when parameters contain special characters such as +,=,-,?,'

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-564: --- Fix Version/s: 0.3.0 Parameter Substitution using -param option does not seem to work when

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721523#action_12721523 ] Milind Bhandarkar commented on PIG-832: --- Daniel, Hi, Milind, If a user wrote 10 UDFs, I

[jira] Updated: (PIG-627) PERFORMANCE: multi-query optimization

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-627: --- Fix Version/s: 0.3.0 PERFORMANCE: multi-query optimization -

[jira] Updated: (PIG-850) Dump produce wrong result while store into is ok

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-850: --- Fix Version/s: (was: 0.3.0) 0.4.0 Dump produce wrong result while store into is

[jira] Updated: (PIG-852) pig -version or pig -help returns exit code of 1

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-852: --- Fix Version/s: (was: 0.3.0) 0.4.0 pig -version or pig -help returns exit code

[jira] Updated: (PIG-849) Local engine loses records in splits

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-849: --- Fix Version/s: (was: 0.3.0) 0.4.0 Local engine loses records in splits

Build failed in Hudson: Pig-Patch-minerva.apache.org #92

2009-06-18 Thread Apache Hudson Server
See http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/92/ -- [...truncated 93989 lines...] [exec] [junit] 09/06/18 22:16:02 INFO dfs.DataNode: PacketResponder 1 for block blk_-3610909769110207607_1010 terminating [exec]

[jira] Commented: (PIG-734) Non-string keys in maps

2009-06-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721527#action_12721527 ] Hadoop QA commented on PIG-734: --- -1 overall. Here are the results of testing the latest

[jira] Updated: (PIG-781) Error reporting for failed MR jobs

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-781: --- Fix Version/s: 0.3.0 Error reporting for failed MR jobs --

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721528#action_12721528 ] Daniel Dai commented on PIG-832: yes, `cat myudflist` is a way to get around. However, in my

[jira] Updated: (PIG-734) Non-string keys in maps

2009-06-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-734: --- Fix Version/s: (was: 0.3.0) 0.4.0 Status: Patch Available (was: Open)

[jira] Updated: (PIG-734) Non-string keys in maps

2009-06-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-734: --- Attachment: PIG-734_3.patch Attaching a version of the file that fixes some of the introduced compiler

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721550#action_12721550 ] Milind Bhandarkar commented on PIG-832: --- Daniel, Pig streaming already uses backquotes

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721551#action_12721551 ] Olga Natkovich commented on PIG-832: You use a fully qualified name for the other one. I

[jira] Commented: (PIG-753) Provide support for UDFs without parameters

2009-06-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721559#action_12721559 ] Alan Gates commented on PIG-753: +1 I tested the patch, and the issue was just with the bzip

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721558#action_12721558 ] Olga Natkovich commented on PIG-856: The number of replicas can be set via dfs.replication

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721562#action_12721562 ] Milind Bhandarkar commented on PIG-832: --- Olga, As long the suggested improvements do

[jira] Commented: (PIG-832) Make import list configurable

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721563#action_12721563 ] Olga Natkovich commented on PIG-832: I don't believe this prevents future improvements

[jira] Commented: (PIG-753) Provide support for UDFs without parameters

2009-06-18 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721564#action_12721564 ] Santhosh Srinivasan commented on PIG-753: - +1 for the code changes. The license header

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721570#action_12721570 ] Olga Natkovich commented on PIG-856: Hi Milind, yes, these are very good points. I was

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721574#action_12721574 ] Milind Bhandarkar commented on PIG-856: --- +1 on seeing performance differences. But, is

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721577#action_12721577 ] Olga Natkovich commented on PIG-856: If a job fails, the store connected to this job will

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721581#action_12721581 ] Milind Bhandarkar commented on PIG-856: --- +1. I will file a separate Jira (if replication

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721590#action_12721590 ] Alan Gates commented on PIG-856: My $0.02, based on the assumption that we see a significant

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721593#action_12721593 ] Olga Natkovich commented on PIG-856: Yes, I agree - we should let users choose, I was

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721592#action_12721592 ] Santhosh Srinivasan commented on PIG-856: - Would that be through a configuration

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721594#action_12721594 ] Milind Bhandarkar commented on PIG-856: --- +1 to both Alan and Olga. Default should still

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721596#action_12721596 ] Santhosh Srinivasan commented on PIG-856: - Essentially, are we adding more knobs to

Build failed in Hudson: Pig-Patch-minerva.apache.org #93

2009-06-18 Thread Apache Hudson Server
See http://hudson.zones.apache.org/hudson/job/Pig-Patch-minerva.apache.org/93/ -- [...truncated 94294 lines...] [exec] [junit] 09/06/19 01:06:15 INFO dfs.StateChange: BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:49808 is added to

[jira] Commented: (PIG-734) Non-string keys in maps

2009-06-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721598#action_12721598 ] Hadoop QA commented on PIG-734: --- -1 overall. Here are the results of testing the latest

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721599#action_12721599 ] Milind Bhandarkar commented on PIG-856: --- +1 to Sathosh to documenting Knobs. Better to