[jira] [Commented] (PIG-3754) InputSizeReducerEstimator.getTotalInputFileSize reports incorrect size

2014-03-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923158#comment-13923158 ] Cheolsoo Park commented on PIG-3754: Looks good. Would you mind adding a test case

[jira] [Commented] (PIG-3731) Ability to specify local-mode specific configuration (useful for local/auto-local mode)

2014-03-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923177#comment-13923177 ] Cheolsoo Park commented on PIG-3731: +1. When you commit it, can you remove this line

[jira] [Commented] (PIG-3745) Document auto local mode for pig

2014-03-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923185#comment-13923185 ] Cheolsoo Park commented on PIG-3745: Just a reminder. Let's include local-mode specific

[jira] [Commented] (PIG-3765) Ability to disable Pig commands and operators

2014-03-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923347#comment-13923347 ] Cheolsoo Park commented on PIG-3765: +1 assuming unit tests pass. Ability to disable

[jira] [Commented] (PIG-3765) Ability to disable Pig commands and operators

2014-03-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923348#comment-13923348 ] Cheolsoo Park commented on PIG-3765: Please open a jira to document this feature. I

[jira] [Comment Edited] (PIG-3799) TestCustomPartitioner is broken in tez branch

2014-03-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13922937#comment-13922937 ] Cheolsoo Park edited comment on PIG-3799 at 3/7/14 1:10 AM

[jira] [Updated] (PIG-3800) Documentation for Pig whitelist and blacklist features

2014-03-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3800: --- Fix Version/s: 0.13.0 Setting FixVersion to 0.13 so we will do this before 0.13 release

Re: pig12 job stuck in infinite loop

2014-03-06 Thread Cheolsoo Park
Hi Suhas, No. The issue with PIG-3461 is that Pig hangs at the query compilation with a big filter expression before the job is submitted. In addition, the filter extractor was totally rewritten in 0.12. https://issues.apache.org/jira/browse/PIG-3461 Where exactly is your job hanging? Backend or

Re: pig12 job stuck in infinite loop

2014-03-06 Thread Cheolsoo Park
); continue; } Cheers, Suhas. On Thu, Mar 6, 2014 at 5:56 PM, Cheolsoo Park piaozhe...@gmail.com wrote: Hi Suhas, No. The issue with PIG-3461 is that Pig hangs at the query compilation with a big filter expression before the job is submitted. In addition

Re: Review Request 15881: PIG-3591: Refactor POPackage

2014-03-05 Thread Cheolsoo Park
) at org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:167) at org.apache.pig.PigServer.getExamples(PigServer.java:1275) - Cheolsoo Park On March 4, 2014, 9:40 p.m., Mark Wagner wrote: --- This is an automatically

[jira] [Commented] (PIG-3793) Provide info on number of LogicalRelationalOperator(s) used in the script through LogicalPlanData

2014-03-05 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13921091#comment-13921091 ] Cheolsoo Park commented on PIG-3793: +1. #1 [~prkommireddi], can you add the following

[jira] [Commented] (PIG-3765) Ability to disable Pig commands and operators

2014-03-05 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13921119#comment-13921119 ] Cheolsoo Park commented on PIG-3765: [~prkommireddi], do you mind uploading your patch

[jira] [Commented] (PIG-3786) POReservoirSample should handle endOfAllInput flag

2014-03-05 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13921404#comment-13921404 ] Cheolsoo Park commented on PIG-3786: +1. I will commit this shortly

[jira] [Updated] (PIG-3795) Parallelism specified by user is not honored if default parallelism is set to a higher value

2014-03-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3795: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to tez branch. Thank you

[jira] [Updated] (PIG-3787) Multiquery with FRJoin fail

2014-03-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3787: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to tez branch

Re: Review Request 15881: PIG-3591: Refactor POPackage

2014-03-04 Thread Cheolsoo Park
/test/TestJobSubmission.java https://reviews.apache.org/r/15881/#comment67144 Can you delete this dead code? This only makes it harder to merge branches. - Cheolsoo Park On March 4, 2014, 9:40 p.m., Mark Wagner wrote

[jira] [Updated] (PIG-3791) Port more mini cluster tests to Tez - part2

2014-03-03 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3791: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to tez branch. Thank you

[jira] [Created] (PIG-3795) Parallelism specified by user is not honored if default parallelism is set to a higher value

2014-03-03 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3795: -- Summary: Parallelism specified by user is not honored if default parallelism is set to a higher value Key: PIG-3795 URL: https://issues.apache.org/jira/browse/PIG-3795

[jira] [Updated] (PIG-3795) Parallelism specified by user is not honored if default parallelism is set to a higher value

2014-03-03 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3795: --- Attachment: PIG-3795-1.patch The attached patch changes two things- # Remove the parallelism overwrite

[jira] [Updated] (PIG-3795) Parallelism specified by user is not honored if default parallelism is set to a higher value

2014-03-03 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3795: --- Status: Patch Available (was: Open) Parallelism specified by user is not honored if default

Review Request 18660: PIG-3791 Port more mini cluster tests to Tez - part2

2014-03-01 Thread Cheolsoo Park
/TestBuiltin.java 1caa07c test/org/apache/pig/test/TestCharArrayToNumeric.java cece284 test/org/apache/pig/test/TestCompressedFiles.java f06efbd test/tez-tests 51f5d37 Diff: https://reviews.apache.org/r/18660/diff/ Testing --- The tests pass in both Tez and MR mode. Thanks, Cheolsoo Park

[jira] [Updated] (PIG-3791) Port more mini cluster tests to Tez - part2

2014-03-01 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3791: --- Status: Patch Available (was: Open) Port more mini cluster tests to Tez - part2

[jira] [Assigned] (PIG-3603) Add counters to TezStats

2014-02-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reassigned PIG-3603: -- Assignee: Cheolsoo Park Add counters to TezStats

Re: Review Request 18607: PIG-3784: Port more mini cluster tests to Tez

2014-02-28 Thread Cheolsoo Park
--- On Feb. 28, 2014, 4:07 a.m., Cheolsoo Park wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18607

[jira] [Created] (PIG-3791) Port more mini cluster tests to Tez - part2

2014-02-28 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3791: -- Summary: Port more mini cluster tests to Tez - part2 Key: PIG-3791 URL: https://issues.apache.org/jira/browse/PIG-3791 Project: Pig Issue Type: Sub-task

Re: Review Request 18607: PIG-3784: Port more mini cluster tests to Tez

2014-02-28 Thread Cheolsoo Park
/pig/test/TestSkewedJoin.java 0a7ba63 test/org/apache/pig/test/TestSplitStore.java 1855fe0 test/tez-tests 287a0b5 Diff: https://reviews.apache.org/r/18607/diff/ Testing --- All the tests pass in both tez and mr mode. Thanks, Cheolsoo Park

[jira] [Commented] (PIG-3785) TezResourceManager should not be a singleton

2014-02-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13916971#comment-13916971 ] Cheolsoo Park commented on PIG-3785: +1. Looks good! I will go ahead commit

[jira] [Updated] (PIG-3785) TezResourceManager should not be a singleton

2014-02-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3785: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to tez branch. Thank you

[jira] [Updated] (PIG-3784) Port more mini cluster tests to Tez

2014-02-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3784: --- Attachment: PIG-3784-2.patch Incorporated Rohini's comments and committed to tez branch. Port more

[jira] [Updated] (PIG-3784) Port more mini cluster tests to Tez

2014-02-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3784: --- Resolution: Fixed Status: Resolved (was: Patch Available) Port more mini cluster tests

[jira] [Created] (PIG-3784) Port more mini cluster tests to Tez

2014-02-27 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3784: -- Summary: Port more mini cluster tests to Tez Key: PIG-3784 URL: https://issues.apache.org/jira/browse/PIG-3784 Project: Pig Issue Type: Sub-task

Review Request 18607: PIG-3784: Port more mini cluster tests to Tez

2014-02-27 Thread Cheolsoo Park
/TestPigStorage.java b30fc00 test/org/apache/pig/test/TestSkewedJoin.java 0a7ba63 test/tez-tests 287a0b5 Diff: https://reviews.apache.org/r/18607/diff/ Testing --- All the tests pass in both tez and mr mode. Thanks, Cheolsoo Park

[jira] [Updated] (PIG-3784) Port more mini cluster tests to Tez

2014-02-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3784: --- Attachment: PIG-3784-1.patch RB link- https://reviews.apache.org/r/18607/ Port more mini cluster

[jira] [Updated] (PIG-3784) Port more mini cluster tests to Tez

2014-02-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3784: --- Status: Patch Available (was: Open) Port more mini cluster tests to Tez

Review Request 18525: PIG-3679: Fix regression of the STATUS_NULL clean-up

2014-02-26 Thread Cheolsoo Park
://reviews.apache.org/r/18525/diff/ Testing --- All e2e tests pass (except Warning_4 PIG-3739). Thanks, Cheolsoo Park

[jira] [Commented] (PIG-3679) e2e StreamingPythonUDFs_10 fails in trunk

2014-02-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13913261#comment-13913261 ] Cheolsoo Park commented on PIG-3679: RB link- https://reviews.apache.org/r/18525/ e2e

Re: Review Request 18525: PIG-3679: Fix regression of the STATUS_NULL clean-up

2014-02-26 Thread Cheolsoo Park
://reviews.apache.org/r/18525/#review35554 --- On Feb. 26, 2014, 6:15 p.m., Cheolsoo Park wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18525

[jira] [Updated] (PIG-3779) Assert constructs ConstantExpression with null when no comment is given

2014-02-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3779: --- Resolution: Fixed Fix Version/s: 0.12.1 Status: Resolved (was: Patch Available

Re: Review Request 18505: PIG-3780: Tez mini cluster tests run for a very long time with TezSession reuse on

2014-02-26 Thread Cheolsoo Park
, 2014, 2:13 a.m., Cheolsoo Park wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18505/ --- (Updated Feb. 26, 2014, 2:13 a.m

Re: Review Request 18505: PIG-3780: Tez mini cluster tests run for a very long time with TezSession reuse on

2014-02-26 Thread Cheolsoo Park
/TEZC4.gld 884f62d test/org/apache/pig/test/data/GoldenFiles/TEZC5.gld 73cc8fe test/org/apache/pig/test/data/GoldenFiles/TEZC6.gld e48b754 test/org/apache/pig/tez/TestTezCompiler.java a3f3bab Diff: https://reviews.apache.org/r/18505/diff/ Testing --- Thanks, Cheolsoo Park

[jira] [Updated] (PIG-3780) Tez mini cluster tests run for a very long time with TezSession reuse on

2014-02-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3780: --- Attachment: PIG-3780-2.patch Incorporate Rohini's comments. Tez mini cluster tests run for a very

[jira] [Updated] (PIG-3780) Tez mini cluster tests run for a very long time with TezSession reuse on

2014-02-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3780: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to tez branch. Thank you

Re: Review Request 18505: PIG-3780: Tez mini cluster tests run for a very long time with TezSession reuse on

2014-02-26 Thread Cheolsoo Park
., Cheolsoo Park wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18505/ --- (Updated Feb. 26, 2014, 9:43 p.m.) Review request

[jira] [Created] (PIG-3781) Fix TestTezCompiler#testReplicatedJoinInReducer

2014-02-26 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3781: -- Summary: Fix TestTezCompiler#testReplicatedJoinInReducer Key: PIG-3781 URL: https://issues.apache.org/jira/browse/PIG-3781 Project: Pig Issue Type: Sub-task

[jira] [Updated] (PIG-3781) Fix TestTezCompiler#testReplicatedJoinInReducer

2014-02-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3781: --- Attachment: PIG-3781-1.patch In the attached patch, I changed the condition in Tez CombinerOptimizer

[jira] [Commented] (PIG-3781) Fix TestTezCompiler#testReplicatedJoinInReducer

2014-02-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13913945#comment-13913945 ] Cheolsoo Park commented on PIG-3781: I am running nightly.conf to ensure my change

[jira] [Updated] (PIG-3781) Fix TestTezCompiler#testReplicatedJoinInReducer

2014-02-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3781: --- Status: Patch Available (was: Open) RB link- https://reviews.apache.org/r/18564/ Fix

[jira] [Updated] (PIG-3781) Fix TestTezCompiler#testReplicatedJoinInReducer

2014-02-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3781: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to tez branch. Thank you

[jira] [Updated] (PIG-3679) e2e StreamingPythonUDFs_10 fails in trunk

2014-02-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3679: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you

[jira] [Updated] (PIG-3679) e2e StreamingPythonUDFs_10 fails in trunk

2014-02-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3679: --- Attachment: PIG-3679-7.patch e2e StreamingPythonUDFs_10 fails in trunk

[jira] [Created] (PIG-3779) Assert constructs ConstantExpression with null when no comment is given

2014-02-25 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3779: -- Summary: Assert constructs ConstantExpression with null when no comment is given Key: PIG-3779 URL: https://issues.apache.org/jira/browse/PIG-3779 Project: Pig

[jira] [Updated] (PIG-3679) e2e StreamingPythonUDFs_10 fails in trunk

2014-02-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3679: --- Attachment: PIG-3679-6.patch I fixed one more minor issue in the latest patch (PIG-3679-6.patch

[jira] [Updated] (PIG-3679) e2e StreamingPythonUDFs_10 fails in trunk

2014-02-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3679: --- Status: Patch Available (was: Open) e2e StreamingPythonUDFs_10 fails in trunk

[jira] [Commented] (PIG-3779) Assert constructs ConstantExpression with null when no comment is given

2014-02-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13912187#comment-13912187 ] Cheolsoo Park commented on PIG-3779: +1. I will commit it tomorrow. Assert constructs

[jira] [Created] (PIG-3780) Tez mini cluster tests run for a very long time with TezSession reuse on

2014-02-25 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3780: -- Summary: Tez mini cluster tests run for a very long time with TezSession reuse on Key: PIG-3780 URL: https://issues.apache.org/jira/browse/PIG-3780 Project: Pig

[jira] [Updated] (PIG-3780) Tez mini cluster tests run for a very long time with TezSession reuse on

2014-02-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3780: --- Attachment: PIG-3780-1.patch In the attached patch, I am doing three things- # Set tez.session.reuse

Review Request 18505: PIG-3780: Tez mini cluster tests run for a very long time with TezSession reuse on

2014-02-25 Thread Cheolsoo Park
.gld 2c146cd test/org/apache/pig/tez/TestTezCompiler.java a3f3bab Diff: https://reviews.apache.org/r/18505/diff/ Testing --- Thanks, Cheolsoo Park

[jira] [Updated] (PIG-3780) Tez mini cluster tests run for a very long time with TezSession reuse on

2014-02-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3780: --- Status: Patch Available (was: Open) RB link- https://reviews.apache.org/r/18505/ Tez mini cluster

[jira] [Updated] (PIG-3679) e2e StreamingPythonUDFs_10 fails in trunk

2014-02-24 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3679: --- Attachment: PIG-3679-5.patch Here is yet another attempt to fix the issue. I confirmed that all

[jira] [Created] (PIG-3776) Conflicting versions of jline is present in trunk

2014-02-23 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3776: -- Summary: Conflicting versions of jline is present in trunk Key: PIG-3776 URL: https://issues.apache.org/jira/browse/PIG-3776 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-3776) Conflicting versions of jline is present in trunk

2014-02-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3776: --- Status: Patch Available (was: Open) Conflicting versions of jline is present in trunk

[jira] [Updated] (PIG-3776) Conflicting versions of jline is present in trunk

2014-02-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3776: --- Attachment: PIG-3776-1.patch In the attached patch, I am doing two things- # Bump jline.version to 1.0

[jira] [Updated] (PIG-3776) Conflicting versions of jline is present in trunk

2014-02-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3776: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you Josh

Re: Typos in wiki

2014-02-23 Thread Cheolsoo Park
Hi Kyungho, Thank you for reporting the typos. You're totally right, and we'll fix them. And I am not sure which is correct since I got errors when generating Javadoc What error do you get? I don't see any error in trunk. firefox build/docs/index.html firefox build/docs/api/index.html The

[jira] [Updated] (PIG-3740) Document direct fetch optimization

2014-02-19 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3740: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you

[jira] [Updated] (PIG-3642) Direct HDFS access for small jobs (fetch)

2014-02-19 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3642: --- Release Note: When the DUMP operator is used to execute Pig Latin statements, Pig can take

[jira] [Commented] (PIG-3769) Scripting UDF is broken after PIG-3629

2014-02-19 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13905870#comment-13905870 ] Cheolsoo Park commented on PIG-3769: +1. This certainly fixes my problem. Scripting

[jira] [Commented] (PIG-3761) Outer join fail on tez

2014-02-19 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13906413#comment-13906413 ] Cheolsoo Park commented on PIG-3761: +1. LGTM. Outer join fail on tez

[jira] [Created] (PIG-3768) TezCompiler.visitUnion() doesn't add compiled TezOp to phyToTezOpMap

2014-02-18 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3768: -- Summary: TezCompiler.visitUnion() doesn't add compiled TezOp to phyToTezOpMap Key: PIG-3768 URL: https://issues.apache.org/jira/browse/PIG-3768 Project: Pig

[jira] [Updated] (PIG-3768) TezCompiler.visitUnion() doesn't add compiled TezOp to phyToTezOpMap

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3768: --- Attachment: PIG-3768-1.patch A trivial fix- adding the compiled union operator to phyToTezOpMap

[jira] [Updated] (PIG-3768) TezCompiler.visitUnion() doesn't add compiled TezOp to phyToTezOpMap

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3768: --- Status: Patch Available (was: Open) TezCompiler.visitUnion() doesn't add compiled TezOp

Re: Review Request 18203: [PIG-3767] Work with TEZ-668 which allows starting and closing of inputs and outputs

2014-02-18 Thread Cheolsoo Park
and run Pig with Tez that is prior to TEZ-688? Due to the Guava conflict (TEZ-787), I cannot upgrade Tez to the head. So I'd like to avoid any incompatible changes before TEZ-787 is resolved. - Cheolsoo Park On Feb. 18, 2014, 8:28 a.m., Rohini Palaniswamy wrote

Re: Review Request 18203: [PIG-3767] Work with TEZ-668 which allows starting and closing of inputs and outputs

2014-02-18 Thread Cheolsoo Park
On Feb. 18, 2014, 12:21 p.m., Cheolsoo Park wrote: Can we hold on please? If we commit this, can I still compile and run Pig with Tez that is prior to TEZ-688? Due to the Guava conflict (TEZ-787), I cannot upgrade Tez to the head. So I'd like to avoid any incompatible changes

[jira] [Created] (PIG-3769) Scripting UDF is broken after PIG-3629

2014-02-18 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3769: -- Summary: Scripting UDF is broken after PIG-3629 Key: PIG-3769 URL: https://issues.apache.org/jira/browse/PIG-3769 Project: Pig Issue Type: Sub-task

[jira] [Commented] (PIG-3629) Implement STREAM in Tez

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13904017#comment-13904017 ] Cheolsoo Park commented on PIG-3629: I also ran into the issue while running a benchmark

[jira] [Updated] (PIG-3768) TezCompiler.visitUnion() doesn't add compiled TezOp to phyToTezOpMap

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3768: --- Attachment: PIG-3768-2.patch While running a benchmark, I also realized that union doesn't honor

[jira] [Updated] (PIG-3746) NPE is thrown if Pig fails before PigStats is intialized

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3746: --- Status: Patch Available (was: Open) NPE is thrown if Pig fails before PigStats is intialized

[jira] [Updated] (PIG-3746) NPE is thrown if Pig fails before PigStats is intialized

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3746: --- Attachment: PIG-3746-1.patch PigStats is not initialized means PigServer hasn't started yet. So

[jira] [Updated] (PIG-3747) Update skewed join documentation

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3747: --- Status: Patch Available (was: Open) Update skewed join documentation

[jira] [Updated] (PIG-3747) Update skewed join documentation

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3747: --- Attachment: PIG-3747-1.patch Uploading a patch. Update skewed join documentation

[jira] [Updated] (PIG-3648) Make the sample size for RandomSampleLoader configurable

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3648: --- Status: Patch Available (was: Open) Actually, this turned out to be helpful. Since I am not change

[jira] [Updated] (PIG-3747) Update skewed join documentation

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3747: --- Attachment: PIG-3747-2.patch Thanks Daniel. I changed the table names in the example query- {code

[jira] [Updated] (PIG-3648) Make the sample size for RandomSampleLoader configurable

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3648: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you

[jira] [Updated] (PIG-3747) Update skewed join documentation

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3747: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you

[jira] [Updated] (PIG-3746) NPE is thrown if Pig fails before PigStats is intialized

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3746: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thanks Daniel

Re: Review Request 18203: [PIG-3767] Work with TEZ-668 which allows starting and closing of inputs and outputs

2014-02-18 Thread Cheolsoo Park
On Feb. 18, 2014, 12:21 p.m., Cheolsoo Park wrote: Can we hold on please? If we commit this, can I still compile and run Pig with Tez that is prior to TEZ-688? Due to the Guava conflict (TEZ-787), I cannot upgrade Tez to the head. So I'd like to avoid any incompatible changes

[jira] [Updated] (PIG-3768) TezCompiler.visitUnion() doesn't add compiled TezOp to phyToTezOpMap

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3768: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to tez branch. Thanks

[jira] [Commented] (PIG-3657) New partition filter extractor fails with NPE

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13904461#comment-13904461 ] Cheolsoo Park commented on PIG-3657: I think we should also commit this into 0.12.1

[jira] [Updated] (PIG-3657) New partition filter extractor fails with NPE

2014-02-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3657: --- Fix Version/s: 0.12.1 Done. It's committed to 0.12.1 too. Thanks Aniket for the quick response. New

Re: Review Request 18181: [PIG-3766] Use ONE_TO_ONE edge and IdentityInOut in skewed join intermediate vertex

2014-02-17 Thread Cheolsoo Park
On Feb. 17, 2014, 7:54 a.m., Cheolsoo Park wrote: http://svn.apache.org/repos/asf/pig/branches/tez/src/org/apache/pig/backend/hadoop/executionengine/tez/TezCompiler.java, line 1464 https://reviews.apache.org/r/18181/diff/2/?file=490429#file490429line1464 Remove this comment since

[jira] [Commented] (PIG-3759) CombinerOptimizer should not optimize cogroup case in tez

2014-02-17 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13903047#comment-13903047 ] Cheolsoo Park commented on PIG-3759: +1. I have noticed this issue too

Re: Pig 0.13.0 release

2014-02-16 Thread Cheolsoo Park
or 0.12 first. Koji On Feb 6, 2014, at 4:25 PM, Cheolsoo Park piaozhe...@gmail.com wrote: +1 to 0.13 release. Why not if someone is volunteering? On Thu, Feb 6, 2014 at 4:06 PM, Julien Le Dem jul...@ledem.net wrote: To add to the discussion, I

Re: Review Request 18181: [PIG-3766] Use ONE_TO_ONE edge and IdentityInOut in skewed join intermediate vertex

2014-02-16 Thread Cheolsoo Park
, and thank you for fixing this! http://svn.apache.org/repos/asf/pig/branches/tez/src/org/apache/pig/backend/hadoop/executionengine/tez/TezCompiler.java https://reviews.apache.org/r/18181/#comment64815 Remove this comment since it's no longer applicable? - Cheolsoo Park On Feb. 17, 2014, 7:34 a.m

[jira] [Updated] (PIG-3755) auto local mode selection does not check lower bound for size

2014-02-07 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3755: --- Fix Version/s: 0.13.0 +1 auto local mode selection does not check lower bound for size

[jira] [Updated] (PIG-3456) Reduce threadlocal conf access in backend for each record

2014-02-07 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3456: --- Attachment: PIG-3456-1-no-whitespace.patch Looks like a good clean-up to me. I am uploading

[jira] [Updated] (PIG-3753) LOGenerate generates null schema

2014-02-07 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3753: --- Status: Patch Available (was: Open) LOGenerate generates null schema

[jira] [Commented] (PIG-3753) LOGenerate generates null schema

2014-02-07 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13895400#comment-13895400 ] Cheolsoo Park commented on PIG-3753: +1. Thank you Daniel for taking care

[jira] [Updated] (PIG-3615) Update the way that JsonLoader/JsonStorage deal with BigDecimal

2014-02-07 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3615: --- Status: Open (was: Patch Available) Canceling patch while waiting for answer. Update the way

[jira] [Updated] (PIG-3724) pig e2e tests dont have hadoop libs on classpath

2014-02-07 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3724: --- Status: Open (was: Patch Available) Rohini is right. I have no problem with running e2e tests

[jira] [Updated] (PIG-3670) Fix assert in Pig script

2014-02-07 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3670: --- Attachment: PIG-3670-2.patch +1. Thank you for fixing this. Your patch didn't apply cleanly to trunk

<    3   4   5   6   7   8   9   10   11   12   >