[jira] Subscription: PIG patch available

2014-06-17 Thread jira
Issue Subscription Filter: PIG patch available (16 issues) Subscriber: pigdaily Key Summary PIG-4008Pig code change to enable Tez Local mode https://issues.apache.org/jira/browse/PIG-4008 PIG-4006Make the interval of DAGStatus report configurable https://i

[jira] [Updated] (PIG-3975) Multiple Scalar reference calls leading to missing records

2014-06-17 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3975: Attachment: pig-3975-v03.patch Committed pig-3975-v03.patch which has the above suggested cha

[jira] [Updated] (PIG-3619) Provide XPath function

2014-06-17 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3619: --- Fix Version/s: 0.13.0 Updating FixVersion. > Provide XPath function > -- > >

[jira] [Updated] (PIG-4017) NPE thrown from JobControlCompiler.shipToHdfs

2014-06-17 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4017: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to 0.13 and trunk. Thank y

[jira] [Commented] (PIG-4017) NPE thrown from JobControlCompiler.shipToHdfs

2014-06-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034562#comment-14034562 ] Daniel Dai commented on PIG-4017: - +1 > NPE thrown from JobControlCompiler.shipToHdfs > ---

[jira] [Commented] (PIG-3975) Multiple Scalar reference calls leading to missing records

2014-06-17 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034550#comment-14034550 ] Rohini Palaniswamy commented on PIG-3975: - [~knoguchi], I ran the full unit test

Re: Review Request 22535: PIG-3975: Multiple Scalar reference calls leading to missing records

2014-06-17 Thread Rohini Palaniswamy
> On June 15, 2014, 3:57 p.m., Rohini Palaniswamy wrote: > > test/org/apache/pig/test/Util.java, line 849 > > > > > > comp.aggregateScalarsFiles(); here? > > Koji Noguchi wrote: > I'm not familiar with the code, b

[jira] [Updated] (PIG-4017) NPE thrown from JobControlCompiler.shipToHdfs

2014-06-17 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4017: --- Fix Version/s: 0.14.0 Status: Patch Available (was: Open) > NPE thrown from JobControlCompi

[jira] [Updated] (PIG-4017) NPE thrown from JobControlCompiler.shipToHdfs

2014-06-17 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4017: --- Attachment: PIG-4701-1.patch Added a null check. > NPE thrown from JobControlCompiler.shipToHdfs > ---

[jira] [Commented] (PIG-4015) Provide a way to disable auto-parallism in tez

2014-06-17 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034508#comment-14034508 ] Rohini Palaniswamy commented on PIG-4015: - +1 > Provide a way to disable auto-paral

[jira] [Created] (PIG-4017) NPE thrown from JobControlCompiler.shipToHdfs

2014-06-17 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4017: -- Summary: NPE thrown from JobControlCompiler.shipToHdfs Key: PIG-4017 URL: https://issues.apache.org/jira/browse/PIG-4017 Project: Pig Issue Type: Bug

Re: [VOTE] Release Pig 0.13.0 (candidate 0)

2014-06-17 Thread Alan Gates
Apache policy is that jars cannot be in source releases. It’s impossible for PMC members voting on it and for users downloading it to determine the contents of the jar and thus whether they are willing to stand behind it or use it. Could we add an ant target that fetches these jars and puts the

Re: [VOTE] Release Pig 0.13.0 (candidate 0)

2014-06-17 Thread Daniel Dai
Oh, probably it is intentional. Alan, do you know if we shall include test jars into the source release? On Tue, Jun 17, 2014 at 2:56 PM, Cheolsoo Park wrote: > I just confirmed that pig-0.12.1.tar.gz has the same issue. I've never seen > this before since I always ran e2e with the repository. >

[jira] [Created] (PIG-4016) test/e2e/pig/lib/*.jar is missing in source tarball

2014-06-17 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4016: --- Summary: test/e2e/pig/lib/*.jar is missing in source tarball Key: PIG-4016 URL: https://issues.apache.org/jira/browse/PIG-4016 Project: Pig Issue Type: Bug C

Re: [VOTE] Release Pig 0.13.0 (candidate 0)

2014-06-17 Thread Daniel Dai
Those are missing even in 0.12.1 and before. Since we need to reroll the RC, I will create a Jira to put it in the source tarball. On Tue, Jun 17, 2014 at 2:48 PM, Cheolsoo Park wrote: > Regarding e2e Native tests, they only fail in source tarball. > > 1) The source tarball doesn't include the fo

Re: [VOTE] Release Pig 0.13.0 (candidate 0)

2014-06-17 Thread Cheolsoo Park
I just confirmed that pig-0.12.1.tar.gz has the same issue. I've never seen this before since I always ran e2e with the repository. But looking at the build.xml, it seems intentional? I guess we can just fix NPE. On Tue, Jun 17, 2014 at 2:48 PM, Cheolsoo Park wrote: > Regarding e2e Native t

Re: [VOTE] Release Pig 0.13.0 (candidate 0)

2014-06-17 Thread Cheolsoo Park
Regarding e2e Native tests, they only fail in source tarball. 1) The source tarball doesn't include the following jars- test/e2e/pig/lib/hadoop-0.23.0-streaming.jar test/e2e/pig/lib/hadoop-examples.jar test/e2e/pig/lib/hadoop-streaming.jar 2) Due to #1, the following line throws NPE- https://gi

[jira] [Commented] (PIG-4006) Make the interval of DAGStatus report configurable

2014-06-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034422#comment-14034422 ] Daniel Dai commented on PIG-4006: - +1 > Make the interval of DAGStatus report configurable

Re: [VOTE] Release Pig 0.13.0 (candidate 0)

2014-06-17 Thread Daniel Dai
I will take a look of TestHBaseStorage today. Also run e2e tests on Hadoop 2.0.3. All clear for me. On Tue, Jun 17, 2014 at 11:31 AM, Rohini Palaniswamy wrote: > I will look at the e2e test failures I reported. Can someone pick up > TestHBaseStorage? > > > On Mon, Jun 16, 2014 at 2:59 PM, Aniket

[jira] [Updated] (PIG-4015) Provide a way to disable auto-parallism in tez

2014-06-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4015: Attachment: PIG-4015-1.patch > Provide a way to disable auto-parallism in tez > -

Re: [VOTE] Release Pig 0.13.0 (candidate 0)

2014-06-17 Thread Rohini Palaniswamy
I will look at the e2e test failures I reported. Can someone pick up TestHBaseStorage? On Mon, Jun 16, 2014 at 2:59 PM, Aniket Mokashi wrote: > Any updates on this? Please let me know if you need me to look into any of > these. > > > On Fri, Jun 13, 2014 at 9:08 AM, Cheolsoo Park > wrote: > >

[jira] [Resolved] (PIG-4014) Fix Rank e2e test failures on tez

2014-06-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4014. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Rohini for review! > Fix R

[jira] [Resolved] (PIG-4013) Order by multiple column fail on Tez

2014-06-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4013. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Rohini for review! > Order

[jira] [Resolved] (PIG-3983) TestGrunt.testKeepGoigFailed fail on tez mode

2014-06-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-3983. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Rohini for review! > TestG

[jira] [Resolved] (PIG-3846) Implement automatic reducer parallelism

2014-06-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-3846. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Rohini for review. Review c

[jira] [Updated] (PIG-3846) Implement automatic reducer parallelism

2014-06-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3846: Attachment: PIG-3846-9.patch Attach the final patch. > Implement automatic reducer parallelism > ---

[jira] [Commented] (PIG-3983) TestGrunt.testKeepGoigFailed fail on tez mode

2014-06-17 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034057#comment-14034057 ] Rohini Palaniswamy commented on PIG-3983: - +1. I had this as part of PIG-3935 change

Re: Review Request 22535: PIG-3975: Multiple Scalar reference calls leading to missing records

2014-06-17 Thread Koji Noguchi
> On June 15, 2014, 3:57 p.m., Rohini Palaniswamy wrote: > > test/org/apache/pig/test/Util.java, line 849 > > > > > > comp.aggregateScalarsFiles(); here? I'm not familiar with the code, but it seems like test has two