Problem running Pig 0.60

2009-11-03 Thread Yiping Han
java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320) Is there any additional jar file that I need to include with Hadoop or pig? Thanks~ -- Yiping Han y...@yahoo-inc.com US phone: +1(408)349-4403 Beijing phone: +86(10)8215-9357

Re: COUNT, AVG and nulls

2009-07-06 Thread Yiping Han
nable case including local mode but I think it >> is worth the price to have consistent semantics. Also as we are working >> on SQL support, having SQL compliant semantics becomes very desirable. >> >> >> >> Please, let us know if you have any concerns. I am p

Re: Proposal to create a branch for contrib project Zebra

2009-08-17 Thread Yiping Han
I would like to create a branch called 'zebra-v2' with approval from PIG > > team. > > Thanks, > Raghu. -- Yiping Han F-3140 (408)349-4403 y...@yahoo-inc.com

[jira] Created: (PIG-601) Add finalize() interface to UDF

2009-01-07 Thread Yiping Han (JIRA)
Add finalize() interface to UDF --- Key: PIG-601 URL: https://issues.apache.org/jira/browse/PIG-601 Project: Pig Issue Type: New Feature Components: impl Reporter: Yiping Han I would like

[jira] Created: (PIG-602) Pass global configurations to UDF

2009-01-07 Thread Yiping Han (JIRA)
Pass global configurations to UDF - Key: PIG-602 URL: https://issues.apache.org/jira/browse/PIG-602 Project: Pig Issue Type: New Feature Components: impl Reporter: Yiping Han We are

[jira] Created: (PIG-603) Pig Server

2009-01-07 Thread Yiping Han (JIRA)
Pig Server -- Key: PIG-603 URL: https://issues.apache.org/jira/browse/PIG-603 Project: Pig Issue Type: New Feature Components: grunt Reporter: Yiping Han With a real Pig Server, when we lose the client, the

[jira] Created: (PIG-604) Kill the Pig job should kill all associated Hadoop Jobs

2009-01-07 Thread Yiping Han (JIRA)
Reporter: Yiping Han Current if we kill the pig job on the client machine, those hadoop jobs already launched still keep running. We have to kill these jobs manually. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue

[jira] Created: (PIG-605) Better explain and console output

2009-01-07 Thread Yiping Han (JIRA)
Better explain and console output - Key: PIG-605 URL: https://issues.apache.org/jira/browse/PIG-605 Project: Pig Issue Type: Improvement Components: grunt Reporter: Yiping Han It would

[jira] Created: (PIG-606) Setting replication factor in Pig

2009-01-07 Thread Yiping Han (JIRA)
Setting replication factor in Pig - Key: PIG-606 URL: https://issues.apache.org/jira/browse/PIG-606 Project: Pig Issue Type: New Feature Reporter: Yiping Han We would like the STORE clause to be

[jira] Created: (PIG-607) Utilize intermediate results instead of re-execution

2009-01-07 Thread Yiping Han (JIRA)
Utilize intermediate results instead of re-execution Key: PIG-607 URL: https://issues.apache.org/jira/browse/PIG-607 Project: Pig Issue Type: New Feature Reporter: Yiping Han

[jira] Created: (PIG-608) Compile or validate the whole script before execution

2009-01-07 Thread Yiping Han (JIRA)
Reporter: Yiping Han This is a very usual scenario: We are running a big pig job that contains several hadoop jobs. It has been running for long times and the first hadoop job sucess, then suddenly pig report it found a syntax error in the script after the first hadoop job...we have

[jira] Created: (PIG-609) PIG does not return the correct error code

2009-01-07 Thread Yiping Han (JIRA)
PIG does not return the correct error code -- Key: PIG-609 URL: https://issues.apache.org/jira/browse/PIG-609 Project: Pig Issue Type: Bug Reporter: Yiping Han Pig still does not always

[jira] Commented: (PIG-608) Compile or validate the whole script before execution

2009-01-07 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661714#action_12661714 ] Yiping Han commented on PIG-608: Alan, I think that's the problem. Everything up t

[jira] Created: (PIG-610) Pig appears to continue when an underlying mapred job fails

2009-01-07 Thread Yiping Han (JIRA)
: Yiping Han We observed sometimes, pig appears to continue when an underlying mapred job fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Created: (PIG-611) Better logging support

2009-01-07 Thread Yiping Han (JIRA)
Better logging support -- Key: PIG-611 URL: https://issues.apache.org/jira/browse/PIG-611 Project: Pig Issue Type: Improvement Components: tools Reporter: Yiping Han I started this ticket to

[jira] Updated: (PIG-604) Kill the Pig job should kill all associated Hadoop Jobs

2009-01-07 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiping Han updated PIG-604: --- Priority: Minor (was: Major) > Kill the Pig job should kill all associated Hadoop J

[jira] Updated: (PIG-609) PIG does not return the correct error code

2009-01-07 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiping Han updated PIG-609: --- Priority: Critical (was: Major) > PIG does not return the correct error c

[jira] Updated: (PIG-610) Pig appears to continue when an underlying mapred job fails

2009-01-07 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiping Han updated PIG-610: --- Priority: Critical (was: Major) > Pig appears to continue when an underlying mapred job fa

[jira] Commented: (PIG-610) Pig appears to continue when an underlying mapred job fails

2009-01-07 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661823#action_12661823 ] Yiping Han commented on PIG-610: Create a pig job with multiple mapred jobs. Let the sc

[jira] Commented: (PIG-610) Pig appears to continue when an underlying mapred job fails

2009-01-08 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662084#action_12662084 ] Yiping Han commented on PIG-610: We are on hadoop 0.18.2 and latest pig_types branch

[jira] Created: (PIG-625) Add global -explain, -illustrate, -describe mode to PIG

2009-01-16 Thread Yiping Han (JIRA)
: Yiping Han Currently PIG has the command EXPLAIN, ILLUSTRATE and DESCRIBE. But user need to manually add/remove these lines in the script when they want to debug or see details of the job. I think there should be a wait to enable these globally. What I suggest is, to add -explain, -illustrate

[jira] Commented: (PIG-664) Semantics of * is not consistent

2009-02-10 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12672372#action_12672372 ] Yiping Han commented on PIG-664: I would second Santhosh. In PIG 1.x, * in UDF parameter

[jira] Commented: (PIG-602) Pass global configurations to UDF

2009-02-10 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12672376#action_12672376 ] Yiping Han commented on PIG-602: Alan, this plan looks good for our requirements. &g

[jira] Commented: (PIG-282) Custom Partitioner

2009-02-10 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12672467#action_12672467 ] Yiping Han commented on PIG-282: Any concerns on this issue? > Custom Part

[jira] Commented: (PIG-734) Non-string keys in maps

2009-05-07 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12707110#action_12707110 ] Yiping Han commented on PIG-734: I don't get the serializing part. I would expect

[jira] Issue Comment Edited: (PIG-734) Non-string keys in maps

2009-05-07 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12707110#action_12707110 ] Yiping Han edited comment on PIG-734 at 5/7/09 2:10 PM: I don&#

[jira] Commented: (PIG-734) Non-string keys in maps

2009-05-07 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12707178#action_12707178 ] Yiping Han commented on PIG-734: Then why not just to restrict all the keys to be of the

[jira] Commented: (PIG-807) PERFORMANCE: Provide a way for UDFs to use read-once bags (backed by the Hadoop values iterator)

2009-05-12 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12708575#action_12708575 ] Yiping Han commented on PIG-807: I would say instead of annotating the UDF to indicate &q

[jira] Commented: (PIG-807) PERFORMANCE: Provide a way for UDFs to use read-once bags (backed by the Hadoop values iterator)

2009-05-19 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12710818#action_12710818 ] Yiping Han commented on PIG-807: David, the syntax: B = foreach A generate SUM(m)

[jira] Commented: (PIG-796) support conversion from numeric types to chararray

2009-05-29 Thread Yiping Han (JIRA)
[ https://issues.apache.org/jira/browse/PIG-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714526#action_12714526 ] Yiping Han commented on PIG-796: I have the same idea that Alan proposed. I agree the co

[jira] Created: (PIG-941) [zebra] Loading non-existing column generates error

2009-09-01 Thread Yiping Han (JIRA)
Reporter: Yiping Han Loading a column that does not exist generates the following error: 2009-09-01 21:29:15,161 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2999: Unexpected internal error. null Example is like this: STORE urls2 into '$output' using org.apache.pig.table.pig.T