[jira] [Commented] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041801#comment-14041801 ] Daniel Dai commented on PIG-4036: - [~rohini], POCombinerPackage also materialize the bag.

[jira] [Updated] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4036: Attachment: PIG-4036-0.patch Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

Re: [ANNOUNCE] Welcome new Pig Committer - Lorand Bendig

2014-06-24 Thread Lorand Bendig
Thank you for all of you! --Lorand On 06/23/2014 11:41 PM, Mark Wagner wrote: Congrats and welcome, Lorand! On Sun, Jun 22, 2014 at 6:39 PM, Koji Noguchi knogu...@yahoo-inc.com.invalid wrote: Congrats!!! On 6/22/14, 9:08 PM, Rohini Palaniswamy rohini.adi...@gmail.com wrote:

[jira] [Commented] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042043#comment-14042043 ] Rohini Palaniswamy commented on PIG-4036: - [~daijy], I can try the patch and

[jira] [Comment Edited] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042051#comment-14042051 ] Rohini Palaniswamy edited comment on PIG-4036 at 6/24/14 12:44 PM:

[jira] [Commented] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042051#comment-14042051 ] Rohini Palaniswamy commented on PIG-4036: - Was numInputs being set to 0 before?

Re: [ANNOUNCE] Welcome new Pig Committer - Lorand Bendig

2014-06-24 Thread Aniket Mokashi
Congrats On Tue, Jun 24, 2014 at 2:03 AM, Lorand Bendig lben...@gmail.com wrote: Thank you for all of you! --Lorand On 06/23/2014 11:41 PM, Mark Wagner wrote: Congrats and welcome, Lorand! On Sun, Jun 22, 2014 at 6:39 PM, Koji Noguchi knogu...@yahoo-inc.com.invalid wrote:

Re: [ANNOUNCE] Welcome new Pig Committer - Lorand Bendig

2014-06-24 Thread Mona Chitnis
Congrats Lorand!   Mona Chitnis Yahoo! On Tuesday, June 24, 2014 7:14 AM, Aniket Mokashi aniket...@gmail.com wrote: Congrats On Tue, Jun 24, 2014 at 2:03 AM, Lorand Bendig lben...@gmail.com wrote: Thank you for all of you! --Lorand On 06/23/2014 11:41 PM, Mark Wagner wrote:

[jira] [Commented] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042374#comment-14042374 ] Daniel Dai commented on PIG-4036: - Yes, bag count set to 0 in BigData_4. Fix e2e failures

[jira] [Commented] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042386#comment-14042386 ] Rohini Palaniswamy commented on PIG-4036: - Wouldn't that have caused divide by zero

Re: [ANNOUNCE] Welcome new Pig Committer - Lorand Bendig

2014-06-24 Thread Olga Natkovich
Congrats, Lorand! On Tuesday, June 24, 2014 9:04 AM, Mona Chitnis m...@apache.org wrote: Congrats Lorand!   Mona Chitnis Yahoo! On Tuesday, June 24, 2014 7:14 AM, Aniket Mokashi aniket...@gmail.com wrote: Congrats On Tue, Jun 24, 2014 at 2:03 AM, Lorand Bendig lben...@gmail.com

[jira] [Commented] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042456#comment-14042456 ] Daniel Dai commented on PIG-4036: - It doesn't in the float context, and we end up with a

Re: Questions about dependencies included in withouth-hadoop jar file and lib directory.

2014-06-24 Thread Daniel Dai
On Mon, Jun 23, 2014 at 8:13 PM, lulynn_2008 lulynn_2...@163.com wrote: Hi All, In build.xml in branch-0.13, 1. following jars are included into lib directory during packaging: copy todir=${tar.dist.dir}/lib fileset dir=${ivy.lib.dir} includes=jython-*.jar/

[jira] [Commented] (PIG-3866) Create ThreadLocal classloader per PigContext

2014-06-24 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042542#comment-14042542 ] Mona Chitnis commented on PIG-3866: --- Why the need to run multiple requests in same JVM -

[jira] [Assigned] (PIG-3938) Type cast doesn't work after flatten result of UDF

2014-06-24 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mona Chitnis reassigned PIG-3938: - Assignee: Mona Chitnis Type cast doesn't work after flatten result of UDF

[jira] [Commented] (PIG-3441) Allow Pig to use default resources from Configuration objects

2014-06-24 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042561#comment-14042561 ] Mona Chitnis commented on PIG-3441: --- I see TezLauncher is using the boolean

[jira] [Commented] (PIG-3365) Run as uber job if there is only one input split

2014-06-24 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042571#comment-14042571 ] Mona Chitnis commented on PIG-3365: --- Consider changing using strings directly e.g.

[jira] [Commented] (PIG-3931) DUMP should limit how much data it emits

2014-06-24 Thread Abhishek Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042572#comment-14042572 ] Abhishek Agarwal commented on PIG-3931: --- +1 for having DUMP take limit as an

[jira] [Updated] (PIG-4003) Error is thrown by JobStats.getOutputSize() when storing to a Hive table

2014-06-24 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4003: --- Status: Patch Available (was: Open) Error is thrown by JobStats.getOutputSize() when storing to a

[jira] [Updated] (PIG-4003) Error is thrown by JobStats.getOutputSize() when storing to a Hive table

2014-06-24 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4003: --- Attachment: PIG-4003-3.patch Discussed with Rohini offline. # We should keep

[jira] [Commented] (PIG-4005) depend on hbase-hadoop2-compat rather than hbase-hadoop1-compat when hbaseversion is 95

2014-06-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042611#comment-14042611 ] Rohini Palaniswamy commented on PIG-4005: - Test fails with class

[jira] [Created] (PIG-4037) TestHBaseStorage has failures with hadoopversion=23

2014-06-24 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-4037: --- Summary: TestHBaseStorage has failures with hadoopversion=23 Key: PIG-4037 URL: https://issues.apache.org/jira/browse/PIG-4037 Project: Pig Issue

[jira] [Commented] (PIG-4003) Error is thrown by JobStats.getOutputSize() when storing to a Hive table

2014-06-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042623#comment-14042623 ] Rohini Palaniswamy commented on PIG-4003: - Patch looks good. Can you add the

[jira] [Updated] (PIG-4003) Error is thrown by JobStats.getOutputSize() when storing to a Hive table

2014-06-24 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4003: --- Attachment: PIG-4003-4.patch Incorporated Rohini's comments. Error is thrown by

[jira] [Commented] (PIG-4003) Error is thrown by JobStats.getOutputSize() when storing to a Hive table

2014-06-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042663#comment-14042663 ] Rohini Palaniswamy commented on PIG-4003: - Can you add a unit test to

[jira] [Updated] (PIG-4003) Error is thrown by JobStats.getOutputSize() when storing to a Hive table

2014-06-24 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4003: --- Attachment: PIG-4003-5.patch Of course. Added a test case as suggested. Error is thrown by

[jira] [Commented] (PIG-4003) Error is thrown by JobStats.getOutputSize() when storing to a Hive table

2014-06-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042729#comment-14042729 ] Rohini Palaniswamy commented on PIG-4003: - Thanks Cheolsoo. +1 Error is thrown by

[jira] [Commented] (PIG-3365) Run as uber job if there is only one input split

2014-06-24 Thread Lorand Bendig (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042783#comment-14042783 ] Lorand Bendig commented on PIG-3365: [~chitnis], thanks for the suggestions. I'll modify

[jira] [Commented] (PIG-3365) Run as uber job if there is only one input split

2014-06-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042813#comment-14042813 ] Rohini Palaniswamy commented on PIG-3365: - Instead of this approach which goes about

[jira] Subscription: PIG patch available

2014-06-24 Thread jira
Issue Subscription Filter: PIG patch available (18 issues) Subscriber: pigdaily Key Summary PIG-4025TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK https://issues.apache.org/jira/browse/PIG-4025

[jira] [Updated] (PIG-4005) depend on hbase-hadoop2-compat rather than hbase-hadoop1-compat when hbaseversion is 95

2014-06-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4005: Attachment: PIG-4005-3.patch On trunk, it is still due to mixed mode in TestHBaseStorage. Attach a fix. On

[jira] [Commented] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042947#comment-14042947 ] Daniel Dai commented on PIG-4036: - Rohini also find MultiQueryPackager still using

[jira] [Updated] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4036: Attachment: PIG-4036-1.patch Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

Re:Re: Questions about dependencies included in withouth-hadoop jar file and lib directory.

2014-06-24 Thread lulynn_2008
Hi Deniel, Thanks for your detail. For your following reply: Yes, that's a better solution. However, those jars are also needed in the backend and we need to ship those jars into distributed cache. There will be some code change to make it happen. Just change pig script is not sufficient. To

Re: Re: Questions about dependencies included in withouth-hadoop jar file and lib directory.

2014-06-24 Thread Daniel Dai
Pig will not fail every time, but you will hit it depending on your script. Try the following script: a = load 'studenttab10k' as (name:chararray, age:int, gpa:double); b = filter a by name matches '.*or.*'; dump b; Thanks, Daniel On Tue, Jun 24, 2014 at 7:23 PM, lulynn_2008 lulynn_2...@163.com

[jira] [Updated] (PIG-4023) BigDec/Int sort is broken

2014-06-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4023: Resolution: Fixed Fix Version/s: 0.14.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14043069#comment-14043069 ] Daniel Dai commented on PIG-4025: - Patch looks good, one minor comment, can we put

[jira] [Updated] (PIG-4024) TestPigStreamingUDF and TestPigStreaming fail on IBM JDK.

2014-06-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4024: Resolution: Fixed Fix Version/s: 0.14.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (PIG-4037) TestHBaseStorage has failures with hadoopversion=23

2014-06-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4037: Attachment: PIG-4037-1.patch Move PIG-4005-3.patch to here. TestHBaseStorage has failures with

[jira] [Updated] (PIG-4037) TestHBaseStorage has failures with hadoopversion=23

2014-06-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4037: Fix Version/s: 0.14.0 0.13.0 Assignee: Daniel Dai TestHBaseStorage has failures