[jira] [Created] (PIG-4032) BloomFilter fails with s3 path in Hadoop 2.4

2014-06-22 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4032: -- Summary: BloomFilter fails with s3 path in Hadoop 2.4 Key: PIG-4032 URL: https://issues.apache.org/jira/browse/PIG-4032 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-4032) BloomFilter fails with s3 path in Hadoop 2.4

2014-06-22 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4032: --- Attachment: (was: PIG-4032-1.patch) BloomFilter fails with s3 path in Hadoop 2.4

[jira] [Updated] (PIG-4032) BloomFilter fails with s3 path in Hadoop 2.4

2014-06-22 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4032: --- Attachment: PIG-4032-1.patch BloomFilter fails with s3 path in Hadoop 2.4

[jira] [Updated] (PIG-4032) BloomFilter fails with s3 path in Hadoop 2.4

2014-06-22 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4032: --- Status: Patch Available (was: Open) BloomFilter fails with s3 path in Hadoop 2.4

Re: [ANNOUNCE] Welcome new Pig Committer - Lorand Bendig

2014-06-22 Thread Jarek Jarcec Cecho
Congratulations Lorand, well deserved! Jarcec On Sat, Jun 21, 2014 at 10:30:01PM -0700, Cheolsoo Park wrote: It is my pleasure to announce that Lorand Bendig became the newest addition to the Pig Committers! Lorand has been actively contributing to Pig for a year now. Please join me in

Re: [ANNOUNCE] Welcome new Pig Committer - Lorand Bendig

2014-06-22 Thread Daniel Dai
Congratulations! On Sun, Jun 22, 2014 at 7:00 AM, Jarek Jarcec Cecho jar...@apache.org wrote: Congratulations Lorand, well deserved! Jarcec On Sat, Jun 21, 2014 at 10:30:01PM -0700, Cheolsoo Park wrote: It is my pleasure to announce that Lorand Bendig became the newest addition to the Pig

[jira] [Commented] (PIG-4032) BloomFilter fails with s3 path in Hadoop 2.4

2014-06-22 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040224#comment-14040224 ] Daniel Dai commented on PIG-4032: - +1 BloomFilter fails with s3 path in Hadoop 2.4

[jira] [Updated] (PIG-4032) BloomFilter fails with s3 path in Hadoop 2.4

2014-06-22 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4032: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you

Re: [ANNOUNCE] Welcome new Pig Committer - Lorand Bendig

2014-06-22 Thread Xuefu Zhang
Many congrats, Lorand! --Xuefu On Sun, Jun 22, 2014 at 12:54 PM, Daniel Dai da...@hortonworks.com wrote: Congratulations! On Sun, Jun 22, 2014 at 7:00 AM, Jarek Jarcec Cecho jar...@apache.org wrote: Congratulations Lorand, well deserved! Jarcec On Sat, Jun 21, 2014 at 10:30:01PM

[jira] [Updated] (PIG-2122) Parameter Substitution doesn't work in the Grunt shell

2014-06-22 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2122: Status: Patch Available (was: Open) Parameter Substitution doesn't work in the Grunt shell

[jira] [Commented] (PIG-3478) Make StreamingUDF work for Hadoop 2

2014-06-22 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040285#comment-14040285 ] Daniel Dai commented on PIG-3478: - +1, PIG-3478-3.patch works for me. [~lbendig], would you

[jira] [Commented] (PIG-3478) Make StreamingUDF work for Hadoop 2

2014-06-22 Thread Lorand Bendig (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040297#comment-14040297 ] Lorand Bendig commented on PIG-3478: [~daijy], thanks for checking it. Sure I will, but

[jira] [Resolved] (PIG-3478) Make StreamingUDF work for Hadoop 2

2014-06-22 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-3478. - Resolution: Fixed Assignee: Lorand Bendig (was: Jeremy Karn) Hadoop Flags: Reviewed Ok, let

[jira] Subscription: PIG patch available

2014-06-22 Thread jira
Issue Subscription Filter: PIG patch available (15 issues) Subscriber: pigdaily Key Summary PIG-4008Pig code change to enable Tez Local mode https://issues.apache.org/jira/browse/PIG-4008 PIG-4004Upgrade the Pigmix queries from the (old) mapred API to mapreduce

Re: [ANNOUNCE] Welcome new Pig Committer - Lorand Bendig

2014-06-22 Thread Rohini Palaniswamy
Congratulations Lorand !!! On Sun, Jun 22, 2014 at 2:47 PM, Xuefu Zhang xzh...@cloudera.com wrote: Many congrats, Lorand! --Xuefu On Sun, Jun 22, 2014 at 12:54 PM, Daniel Dai da...@hortonworks.com wrote: Congratulations! On Sun, Jun 22, 2014 at 7:00 AM, Jarek Jarcec Cecho

Re: [ANNOUNCE] Welcome new Pig Committer - Lorand Bendig

2014-06-22 Thread Koji Noguchi
Congrats!!! On 6/22/14, 9:08 PM, Rohini Palaniswamy rohini.adi...@gmail.com wrote: Congratulations Lorand !!! On Sun, Jun 22, 2014 at 2:47 PM, Xuefu Zhang xzh...@cloudera.com wrote: Many congrats, Lorand! --Xuefu On Sun, Jun 22, 2014 at 12:54 PM, Daniel Dai da...@hortonworks.com wrote:

[jira] [Commented] (PIG-4002) Disable combiner when map-side aggregation is used

2014-06-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040350#comment-14040350 ] Rohini Palaniswamy commented on PIG-4002: - Tez has combiner working on both map and

[jira] [Created] (PIG-4033) Fix MergeSparseJoin e2e tests on tez

2014-06-22 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4033: --- Summary: Fix MergeSparseJoin e2e tests on tez Key: PIG-4033 URL: https://issues.apache.org/jira/browse/PIG-4033 Project: Pig Issue Type: Bug Components: tez

[jira] [Updated] (PIG-4033) Fix MergeSparseJoin e2e tests on tez

2014-06-22 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4033: Attachment: PIG-4033-1.patch Fix MergeSparseJoin e2e tests on tez

[jira] [Commented] (PIG-4002) Disable combiner when map-side aggregation is used

2014-06-22 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040352#comment-14040352 ] Daniel Dai commented on PIG-4002: - We'd better tez has an option to disable map side/reduce

Re:Re: what version will be the pig next release?

2014-06-22 Thread lulynn_2008
Thanks Cheolsoo. In git, I can find the branch-0.13. Is this the version which will be released? BTW, which version jdk are you using for this release? Thanks At 2014-06-20 00:13:13, Cheolsoo Park piaozhe...@gmail.com wrote: 0.13 will be released soon. We're fixing few test failures

Re: Re: what version will be the pig next release?

2014-06-22 Thread Cheolsoo Park
Yes. I am running 0.13 on jdk 7 in beta test at work. On Sun, Jun 22, 2014 at 7:51 PM, lulynn_2008 lulynn_2...@163.com wrote: Thanks Cheolsoo. In git, I can find the branch-0.13. Is this the version which will be released? BTW, which version jdk are you using for this release? Thanks

[jira] [Commented] (PIG-4033) Fix MergeSparseJoin e2e tests on tez

2014-06-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040364#comment-14040364 ] Rohini Palaniswamy commented on PIG-4033: - +1 Fix MergeSparseJoin e2e tests on tez

Re: Re: what version will be the pig next release?

2014-06-22 Thread Daniel Dai
I am using jdk 6 in my development. It should work with both jdk 6 and jdk 7. On Sun, Jun 22, 2014 at 7:56 PM, Cheolsoo Park piaozhe...@gmail.com wrote: Yes. I am running 0.13 on jdk 7 in beta test at work. On Sun, Jun 22, 2014 at 7:51 PM, lulynn_2008 lulynn_2...@163.com wrote: Thanks

Re:Re: Re: what version will be the pig next release?

2014-06-22 Thread lulynn_2008
Thanks Denial and Cheolsoo. What about jdk8? I am trying with this version jdk. Compile/package passed. Ut is going on. Could you give suggestion on how to know whether pig works with jdk8? At 2014-06-23 11:15:32, Daniel Dai da...@hortonworks.com wrote: I am using jdk 6 in my

Re: Re: Re: what version will be the pig next release?

2014-06-22 Thread Daniel Dai
We didn't do anything particular to make it work with jdk 8 yet. Major users are still on either jdk 6 or jdk 7 AFAIK. On Sun, Jun 22, 2014 at 8:31 PM, lulynn_2008 lulynn_2...@163.com wrote: Thanks Denial and Cheolsoo. What about jdk8? I am trying with this version jdk. Compile/package

[jira] [Updated] (PIG-4034) Exclude TestTezAutoParallelism when -Dhadoopversion=20

2014-06-22 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4034: --- Attachment: PIG-4034-1.patch Exclude TestTezAutoParallelism when -Dhadoopversion=20

[jira] [Updated] (PIG-4034) Exclude TestTezAutoParallelism when -Dhadoopversion=20

2014-06-22 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4034: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Exclude

[jira] [Updated] (PIG-4035) Fix CollectedGroup e2e tests for tez

2014-06-22 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4035: Attachment: PIG-4035-1.patch Fix CollectedGroup e2e tests for tez

[jira] [Created] (PIG-4035) Fix CollectedGroup e2e tests for tez

2014-06-22 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4035: --- Summary: Fix CollectedGroup e2e tests for tez Key: PIG-4035 URL: https://issues.apache.org/jira/browse/PIG-4035 Project: Pig Issue Type: Bug Components: tez

[jira] [Created] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-22 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-4036: --- Summary: Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4 Key: PIG-4036 URL: https://issues.apache.org/jira/browse/PIG-4036 Project: Pig

[jira] [Commented] (PIG-4035) Fix CollectedGroup e2e tests for tez

2014-06-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040417#comment-14040417 ] Rohini Palaniswamy commented on PIG-4035: - +1 Fix CollectedGroup e2e tests for tez

[jira] [Commented] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040418#comment-14040418 ] Rohini Palaniswamy commented on PIG-4036: - JobManagement_3, CmdErrors_3 fail with

[jira] [Resolved] (PIG-4035) Fix CollectedGroup e2e tests for tez

2014-06-22 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4035. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Rohini for review! Fix

[jira] [Commented] (PIG-3834) Implement mapside cogroup in Tez

2014-06-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040420#comment-14040420 ] Rohini Palaniswamy commented on PIG-3834: - PIG-4035 addresses the case of collected.

[jira] [Commented] (PIG-3984) PigServer.shutdown remove the tez resource folder

2014-06-22 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040427#comment-14040427 ] Daniel Dai commented on PIG-3984: - bump PigServer.shutdown remove the tez resource folder

[jira] [Commented] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040450#comment-14040450 ] Rohini Palaniswamy commented on PIG-4036: - BigData_4 stacktrace is below. {code}

[jira] [Updated] (PIG-4036) Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4

2014-06-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4036: Assignee: (was: Rohini Palaniswamy) Fix e2e failures - JobManagement_3, CmdErrors_3 and

Re: [VOTE] Release Pig 0.13.0 (candidate 0)

2014-06-22 Thread Rohini Palaniswamy
BigData_4 failed with OOM - This certainly needs investigation JobManagement_3, CmdErrors_3 failed with java.lang.NoClassDefFoundError: org/apache/zookeeper/Shell Created PIG-4036 for this. JobManagement_3, CmdErrors_3 is simple change. But BigData_4 requires some amount of work. I do not have

[jira] [Commented] (PIG-3984) PigServer.shutdown remove the tez resource folder

2014-06-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040452#comment-14040452 ] Rohini Palaniswamy commented on PIG-3984: - Shouldn't we clean the resource path up