[jira] [Updated] (PIG-4196) Auto ship udf jar is broken

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4196: Attachment: PIG-4196-2.patch Thanks, you are absolutely right! Revised patch. > Auto ship udf jar is broken >

[jira] [Updated] (PIG-4215) Fix unit test failure TestParamSubPreproc and TestMacroExpansion

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4215: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch commit

[jira] [Updated] (PIG-4175) PIG CROSS operation follow by STORE produces non-deterministic results each run

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4175: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch commit

[jira] [Updated] (PIG-4214) Fix unit test fail TestMRJobStats

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4214: Attachment: PIG-4214-2.patch Good catch! Attach revised patch. > Fix unit test fail TestMRJobStats >

[jira] [Commented] (PIG-4175) PIG CROSS operation follow by STORE produces non-deterministic results each run

2014-09-30 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14154285#comment-14154285 ] Rohini Palaniswamy commented on PIG-4175: - +1 > PIG CROSS operation follow by STORE

[jira] [Commented] (PIG-4212) Allow LIMIT of 0 for variableLimit (constant 0 is already allowed)

2014-09-30 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14154269#comment-14154269 ] Rohini Palaniswamy commented on PIG-4212: - Can you just add a newline before @Test b

[jira] [Commented] (PIG-4196) Auto ship udf jar is broken

2014-09-30 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14154261#comment-14154261 ] Rohini Palaniswamy commented on PIG-4196: - Shouldn't it be {code} String jar = JarM

[jira] [Commented] (PIG-4214) Fix unit test fail TestMRJobStats

2014-09-30 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14154256#comment-14154256 ] Rohini Palaniswamy commented on PIG-4214: - Can do java.util.Arrays.asList(mapTaskRep

[jira] [Created] (PIG-4216) Making use of Centralized Cache Management in HDFS

2014-09-30 Thread srinivas (JIRA)
srinivas created PIG-4216: - Summary: Making use of Centralized Cache Management in HDFS Key: PIG-4216 URL: https://issues.apache.org/jira/browse/PIG-4216 Project: Pig Issue Type: Improvement

[jira] [Commented] (PIG-4215) Fix unit test failure TestParamSubPreproc and TestMacroExpansion

2014-09-30 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14154040#comment-14154040 ] Rohini Palaniswamy commented on PIG-4215: - +1 > Fix unit test failure TestParamSubP

Re: Pig on Spark - Suggestions in handling code changes out of Spark

2014-09-30 Thread Rohini Palaniswamy
Do you want to submit all the changes in one single separate Jira? Will be easier for us to review. On Tue, Sep 30, 2014 at 7:01 AM, Praveen R wrote: > *Hi Everyone,* > > Earlier we have made some changes on > https://github.com/sigmoidanalytics/spork/tree/spork-pig-12 to achieve > complete e2e

[jira] [Updated] (PIG-4196) Auto ship udf jar is broken

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4196: Status: Patch Available (was: Open) > Auto ship udf jar is broken > --- > >

[jira] [Commented] (PIG-4213) CSVExcelStorage not quoting texts containing \r (CR) when storing

2014-09-30 Thread Alfonso Nishikawa (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153753#comment-14153753 ] Alfonso Nishikawa commented on PIG-4213: [~daijy], Sure! Working on it (on a suitab

[jira] [Updated] (PIG-4213) CSVExcelStorage not quoting texts containing \r (CR) when storing

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4213: Assignee: Alfonso Nishikawa > CSVExcelStorage not quoting texts containing \r (CR) when storing >

[jira] [Commented] (PIG-4213) CSVExcelStorage not quoting texts containing \r (CR) when storing

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153714#comment-14153714 ] Daniel Dai commented on PIG-4213: - Thanks Alfonso, but the patch break 3 tests in TestCSVExc

[jira] [Updated] (PIG-4215) Fix unit test failure TestParamSubPreproc and TestMacroExpansion

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4215: Status: Patch Available (was: Open) > Fix unit test failure TestParamSubPreproc and TestMacroExpansion >

[jira] [Updated] (PIG-4215) Fix unit test failure TestParamSubPreproc and TestMacroExpansion

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4215: Attachment: PIG-4215-1.patch > Fix unit test failure TestParamSubPreproc and TestMacroExpansion >

[jira] [Created] (PIG-4215) Fix unit test failure TestParamSubPreproc and TestMacroExpansion

2014-09-30 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4215: --- Summary: Fix unit test failure TestParamSubPreproc and TestMacroExpansion Key: PIG-4215 URL: https://issues.apache.org/jira/browse/PIG-4215 Project: Pig Issue Type: B

[jira] [Commented] (PIG-4173) Move to Spark 1.x

2014-09-30 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153705#comment-14153705 ] Richard Ding commented on PIG-4173: --- Sorry, I meant PIG-4168. > Move to Spark 1.x > -

[jira] [Commented] (PIG-4173) Move to Spark 1.x

2014-09-30 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153701#comment-14153701 ] Richard Ding commented on PIG-4173: --- Hi ~praveenr019, Since PIG-4186 hasn't been checked

[jira] [Updated] (PIG-4173) Move to Spark 1.x

2014-09-30 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding updated PIG-4173: -- Attachment: PIG-4173_3.patch Thanks for the review. The new patch incorporate the changes in the comments.

[jira] [Updated] (PIG-4214) Fix unit test fail TestMRJobStats

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4214: Status: Patch Available (was: Open) > Fix unit test fail TestMRJobStats > - >

[jira] [Created] (PIG-4214) Fix unit test fail TestMRJobStats

2014-09-30 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4214: --- Summary: Fix unit test fail TestMRJobStats Key: PIG-4214 URL: https://issues.apache.org/jira/browse/PIG-4214 Project: Pig Issue Type: Bug Components: impl

[jira] [Updated] (PIG-4214) Fix unit test fail TestMRJobStats

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4214: Attachment: PIG-4214-1.patch > Fix unit test fail TestMRJobStats > - > >

[jira] [Updated] (PIG-4213) CSVExcelStorage not quoting texts containing \r (CR) when storing

2014-09-30 Thread Alfonso Nishikawa (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alfonso Nishikawa updated PIG-4213: --- Description: Managing tweets information I found that someone wrote a multiline tweet in Mac OS

[jira] [Commented] (PIG-4213) CSVExcelStorage not quoting texts containing \r (CR) when storing

2014-09-30 Thread Alfonso Nishikawa (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153625#comment-14153625 ] Alfonso Nishikawa commented on PIG-4213: Errata from comment above: 'TestLoader' whe

[jira] [Updated] (PIG-4213) CSVExcelStorage not quoting texts containing \r (CR) when storing

2014-09-30 Thread Alfonso Nishikawa (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alfonso Nishikawa updated PIG-4213: --- Attachment: PIG-4213v1.patch I upload a proposal patch (PIG-4213v1.patch). Tests included (I tri

[jira] [Updated] (PIG-4084) Port TestPigRunner to Tez

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4084: Attachment: PIG-4084-1.patch > Port TestPigRunner to Tez > - > > Key:

[jira] [Updated] (PIG-4084) Port TestPigRunner to Tez

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4084: Status: Patch Available (was: Open) > Port TestPigRunner to Tez > - > >

[jira] [Commented] (PIG-4212) Allow LIMIT of 0 for variableLimit (constant 0 is already allowed)

2014-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153495#comment-14153495 ] Daniel Dai commented on PIG-4212: - +1 > Allow LIMIT of 0 for variableLimit (constant 0 is a

[jira] [Created] (PIG-4213) CSVExcelStorage not quoting texts containing \r (CR) when storing

2014-09-30 Thread Alfonso Nishikawa (JIRA)
Alfonso Nishikawa created PIG-4213: -- Summary: CSVExcelStorage not quoting texts containing \r (CR) when storing Key: PIG-4213 URL: https://issues.apache.org/jira/browse/PIG-4213 Project: Pig

[jira] [Updated] (PIG-4212) Allow LIMIT of 0 for variableLimit (constant 0 is already allowed)

2014-09-30 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-4212: -- Status: Patch Available (was: Open) > Allow LIMIT of 0 for variableLimit (constant 0 is already allowed)

[jira] [Updated] (PIG-4212) Allow LIMIT of 0 for variableLimit (constant 0 is already allowed)

2014-09-30 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-4212: -- Attachment: pig-4212-v1.patch Straightforward patch that accepts 0 variablelimit. > Allow LIMIT of 0 for

[jira] [Created] (PIG-4212) Allow LIMIT of 0 for variableLimit (constant 0 is already allowed)

2014-09-30 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-4212: - Summary: Allow LIMIT of 0 for variableLimit (constant 0 is already allowed) Key: PIG-4212 URL: https://issues.apache.org/jira/browse/PIG-4212 Project: Pig Issue T

[jira] [Commented] (PIG-4212) Allow LIMIT of 0 for variableLimit (constant 0 is already allowed)

2014-09-30 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153286#comment-14153286 ] Koji Noguchi commented on PIG-4212: --- One of our users has a logic in their script that req

Pig on Spark - Suggestions in handling code changes out of Spark

2014-09-30 Thread Praveen R
*Hi Everyone,* Earlier we have made some changes on https://github.com/sigmoidanalytics/spork/tree/spork-pig-12 to achieve complete e2e coverage but we couldn't restrict ourselves in making changes in pig codebase as we found it slightly easier to do. We are now working on merging these changes t

[jira] [Updated] (PIG-4173) Move to Spark 1.x

2014-09-30 Thread Praveen Rachabattuni (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Praveen Rachabattuni updated PIG-4173: -- Attachment: TEST-org.apache.pig.spark.TestSpark.txt Hi Richard, I just found some of unit

[jira] [Commented] (PIG-4174) e2e tests for Spark

2014-09-30 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152897#comment-14152897 ] liyunzhang_intel commented on PIG-4174: --- If have hadoop variable in shell env. #which

[jira] [Updated] (PIG-4174) e2e tests for Spark

2014-09-30 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4174: -- Attachment: PIG-4174_1.patch > e2e tests for Spark > --- > > Key: