[jira] [Updated] (PIG-3645) Move FileLocalizer.setR() calls to unit tests

2013-12-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3645: --- Attachment: PIG-3645-3.patch Reset generate to false in TestMRCompiler in the new patch. Changes can

[jira] [Updated] (PIG-3639) TestRegisteredJarVisibility is broken in trunk

2013-12-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3639: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you

[jira] [Updated] (PIG-3645) Move FileLocalizer.setR() calls to unit tests

2013-12-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3645: --- Attachment: TEST-org.apache.pig.test.TestMRCompiler.txt I tried PigServer.resetScope() and

[jira] [Assigned] (PIG-3643) Nested Foreach with UDF and bincond is broken

2013-12-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reassigned PIG-3643: -- Assignee: Cheolsoo Park TestLogicalPlanGenerator is broken by this too. Let me fix this.

[jira] [Updated] (PIG-3645) Move FileLocalizer.setR() calls to unit tests

2013-12-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3645: --- Attachment: PIG-3645-4.patch As per discussion with Rohini, moved FiliLocalizer.setR() to setup. This

[jira] [Updated] (PIG-3643) Nested Foreach with UDF and bincond is broken

2013-12-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3643: --- Attachment: PIG-3643-1.patch Uploading a patch that fixes the regression. To summarize the issue- #

[jira] [Commented] (PIG-3581) Incorrect scope resolution with nested foreach

2013-12-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13857896#comment-13857896 ] Cheolsoo Park commented on PIG-3581: [~aniket486], I put up a fix in PIG-3643.

[jira] [Updated] (PIG-3643) Nested Foreach with UDF and bincond is broken

2013-12-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3643: --- Status: Patch Available (was: Open) Nested Foreach with UDF and bincond is broken

[jira] [Updated] (PIG-3636) Make accumulator UDF work in Tez

2013-12-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3636: --- Attachment: PIG-3636-2.patch Updating the patch. Make accumulator UDF work in Tez

[jira] [Updated] (PIG-3636) Make accumulator UDF work in Tez

2013-12-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3636: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to tez branch. Thank you

[jira] [Updated] (PIG-3636) Make accumulator UDF work in Tez

2013-12-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3636: --- Status: Patch Available (was: Open) Make accumulator UDF work in Tez

[jira] [Updated] (PIG-3636) Make accumulator UDF work in Tez

2013-12-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3636: --- Attachment: PIG-3636-1.patch Attaching a patch. RB link is here- https://reviews.apache.org/r/16463/

[jira] [Commented] (PIG-3581) Incorrect scope resolution with nested foreach

2013-12-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13855935#comment-13855935 ] Cheolsoo Park commented on PIG-3581: [~aniket486], I think this patch introduced a

[jira] [Updated] (PIG-3581) Incorrect scope resolution with nested foreach

2013-12-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3581: --- Fix Version/s: 0.13.0 Incorrect scope resolution with nested foreach

[jira] [Commented] (PIG-3581) Incorrect scope resolution with nested foreach

2013-12-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13855955#comment-13855955 ] Cheolsoo Park commented on PIG-3581: I am not saying it's a good thing to do. I was

[jira] [Commented] (PIG-3581) Incorrect scope resolution with nested foreach

2013-12-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13855959#comment-13855959 ] Cheolsoo Park commented on PIG-3581: {quote} It is going to store the word 'bar' in a

[jira] [Updated] (PIG-3609) ClassCastException when calling compareTo method on AvroBagWrapper 

2013-12-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3609: --- Resolution: Fixed Fix Version/s: 0.13.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (PIG-3640) Retain intermediate files for debugging purpose in batch mode

2013-12-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3640: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you

[jira] [Commented] (PIG-3629) Implement STREAM in Tez

2013-12-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13856157#comment-13856157 ] Cheolsoo Park commented on PIG-3629: I noticed that you overwrote join e2e test cases. I

[jira] [Updated] (PIG-3629) Implement STREAM in Tez

2013-12-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3629: --- Attachment: PIG-3629-4.patch Attaching the final patch committed to tez branch. Implement STREAM in

[jira] [Updated] (PIG-3629) Implement STREAM in Tez

2013-12-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3629: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to tez branch. Thank you

[jira] [Created] (PIG-3640) Retain intermediate files for debugging purpose in batch mode

2013-12-22 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3640: -- Summary: Retain intermediate files for debugging purpose in batch mode Key: PIG-3640 URL: https://issues.apache.org/jira/browse/PIG-3640 Project: Pig Issue

[jira] [Updated] (PIG-3640) Retain intermediate files for debugging purpose in batch mode

2013-12-22 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3640: --- Attachment: PIG-3640-1.patch Attaching a patch. Retain intermediate files for debugging purpose in

[jira] [Updated] (PIG-3640) Retain intermediate files for debugging purpose in batch mode

2013-12-22 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3640: --- Status: Patch Available (was: Open) Retain intermediate files for debugging purpose in batch mode

[jira] [Created] (PIG-3639) TestRegisteredJarVisibility is broken in trunk

2013-12-21 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3639: -- Summary: TestRegisteredJarVisibility is broken in trunk Key: PIG-3639 URL: https://issues.apache.org/jira/browse/PIG-3639 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-3639) TestRegisteredJarVisibility is broken in trunk

2013-12-21 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3639: --- Description: {code} [junit] Running org.apache.pig.test.TestRegisteredJarVisibility [junit]

[jira] [Updated] (PIG-3639) TestRegisteredJarVisibility is broken in trunk

2013-12-21 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3639: --- Status: Patch Available (was: Open) TestRegisteredJarVisibility is broken in trunk

[jira] [Updated] (PIG-3639) TestRegisteredJarVisibility is broken in trunk

2013-12-21 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3639: --- Attachment: PIG-3639-1.patch The patch excludes the jackson jars from avro dependencies. I confirmed

[jira] [Commented] (PIG-3269) In operator support

2013-12-21 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13855003#comment-13855003 ] Cheolsoo Park commented on PIG-3269: No, it doesn't. If you do, {{( tuple ) IN ( \{ bag

[jira] [Updated] (PIG-3584) AvroStorage does not correctly translate arrays of strings

2013-12-19 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3584: --- Fix Version/s: 0.13.0 Affects Version/s: 0.12.0 Status: Patch Available (was:

[jira] [Updated] (PIG-3584) AvroStorage does not correctly translate arrays of strings

2013-12-19 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3584: --- Resolution: Fixed Status: Resolved (was: Patch Available) AvroStorage does not correctly

[jira] [Updated] (PIG-3602) Tear down TezSessions when Pig exits

2013-12-19 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3602: --- Attachment: unit_test.txt [~rohini], not sure what's going on, but ant test-tez hangs after

[jira] [Commented] (PIG-3602) Tear down TezSessions when Pig exits

2013-12-19 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13853482#comment-13853482 ] Cheolsoo Park commented on PIG-3602: +1. Works like a charm. Thanks! One minor comment.

[jira] [Created] (PIG-3636) Make accumulator UDF work in Tez

2013-12-19 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3636: -- Summary: Make accumulator UDF work in Tez Key: PIG-3636 URL: https://issues.apache.org/jira/browse/PIG-3636 Project: Pig Issue Type: Sub-task

[jira] [Commented] (PIG-3633) AvroStorage tests are failing when running against Avro 1.7.5

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851986#comment-13851986 ] Cheolsoo Park commented on PIG-3633: +1. I can reproduce failures. I will commit it

[jira] [Updated] (PIG-3633) AvroStorage tests are failing when running against Avro 1.7.5

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3633: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you

[jira] [Updated] (PIG-3604) Implement replicated join in Tez

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3604: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to tez branch. Thank you

[jira] [Resolved] (PIG-3624) Fix intermittent test failure Join_1

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-3624. Resolution: Fixed Fixed as part of PIG-3604. Closing the jira. Fix intermittent test failure

[jira] [Commented] (PIG-3609) ClassCastException when calling compareTo method on AvroBagWrapper 

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852224#comment-13852224 ] Cheolsoo Park commented on PIG-3609: [~rding], I don't think the following is correct-

[jira] [Updated] (PIG-3609) ClassCastException when calling compareTo method on AvroBagWrapper 

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3609: --- Attachment: PIG-3609_3.patch I am attaching a patch that addresses my comments. I'll commit this if

[jira] [Commented] (PIG-3584) AvroStorage does not correctly translate arrays of strings

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852251#comment-13852251 ] Cheolsoo Park commented on PIG-3584: +1. I will commit this. AvroStorage does not

[jira] [Assigned] (PIG-3584) AvroStorage does not correctly translate arrays of strings

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reassigned PIG-3584: -- Assignee: Joseph Adler AvroStorage does not correctly translate arrays of strings

[jira] [Updated] (PIG-3587) add functionality for rolling over dates

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3587: --- Assignee: Rekha Joshi Status: Open (was: Patch Available) Canceling the patch while waiting for

[jira] [Updated] (PIG-3613) UDF for SimilarityMatching between strings with matching scores

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3613: --- Status: Open (was: Patch Available) [~rekhajoshm], thank you for the patch. But unfortunately, it

[jira] [Updated] (PIG-3621) Python Avro library can't read Avros made with builtin AvroStorage

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3621: --- Attachment: PIG-3631-2.patch Thank you for identifying the bug. I think using a more pig specific

[jira] [Updated] (PIG-3621) Python Avro library can't read Avros made with builtin AvroStorage

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3621: --- Attachment: PIG-3621-3.patch I thought that logic is redundant since 1) it is not possible to set

[jira] [Updated] (PIG-3621) Python Avro library can't read Avros made with builtin AvroStorage

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3621: --- Resolution: Fixed Assignee: Russell Jurney Status: Resolved (was: Patch Available)

[jira] [Commented] (PIG-3621) Python Avro library can't read Avros made with builtin AvroStorage

2013-12-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852550#comment-13852550 ] Cheolsoo Park commented on PIG-3621: Committed to 0.12.1 too. Python Avro library

[jira] [Commented] (PIG-3624) Fix intermittent test failure Join_1

2013-12-17 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13850966#comment-13850966 ] Cheolsoo Park commented on PIG-3624: [~daijy], I am doing what Rohini suggests here as

[jira] [Updated] (PIG-3604) Implement replicated join in Tez

2013-12-17 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3604: --- Attachment: PIG-3604-2.patch Uploading the 2nd patch. Implement replicated join in Tez

[jira] [Commented] (PIG-3627) Json storage : Doesn't work in cases , where other Store Functions (like PigStorage / AvroStorage) do work.

2013-12-16 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13849599#comment-13849599 ] Cheolsoo Park commented on PIG-3627: The problem is 'NULL' in your schema. 'NULL' is not

[jira] [Commented] (PIG-3627) Json storage : Doesn't work in cases , where other Store Functions (like PigStorage / AvroStorage) do work.

2013-12-16 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13849817#comment-13849817 ] Cheolsoo Park commented on PIG-3627: Thanks [~jayunit100] for sharing it. {quote} I

[jira] [Updated] (PIG-3604) Implement replicated join in Tez

2013-12-16 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3604: --- Status: Patch Available (was: Open) Implement replicated join in Tez

[jira] [Updated] (PIG-3604) Implement replicated join in Tez

2013-12-16 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3604: --- Attachment: PIG-3604-1.patch RB link- https://reviews.apache.org/r/16313/ Implement replicated join

[jira] [Commented] (PIG-3620) TezCompiler adds duplicate predecessors of blocking operators to TezPlan

2013-12-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13848716#comment-13848716 ] Cheolsoo Park commented on PIG-3620: +1. TezCompiler adds duplicate predecessors of

[jira] [Commented] (PIG-3624) Fix intermittent test failure Join_1

2013-12-13 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13847889#comment-13847889 ] Cheolsoo Park commented on PIG-3624: +1. Just a minor comment. Can we change

[jira] [Commented] (PIG-3624) Fix intermittent test failure Join_1

2013-12-13 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13847908#comment-13847908 ] Cheolsoo Park commented on PIG-3624: Sounds good to me. Fix intermittent test failure

[jira] [Created] (PIG-3620) TezCompiler adds duplicate predecessors of blocking operators to TezPlan

2013-12-12 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3620: -- Summary: TezCompiler adds duplicate predecessors of blocking operators to TezPlan Key: PIG-3620 URL: https://issues.apache.org/jira/browse/PIG-3620 Project: Pig

[jira] [Commented] (PIG-2778) Add 'matches' operator to predicate pushdown

2013-12-12 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13847038#comment-13847038 ] Cheolsoo Park commented on PIG-2778: [~rohini], no, I didn't have a particular load in

[jira] [Updated] (PIG-3618) Replace broadcast edges with scatter/gather edges in union

2013-12-11 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3618: --- Attachment: PIG-3618-1.patch https://reviews.apache.org/r/16165/ Replace broadcast edges with

[jira] [Updated] (PIG-3618) Replace broadcast edges with scatter/gather edges in union

2013-12-11 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3618: --- Status: Patch Available (was: Open) Replace broadcast edges with scatter/gather edges in union

[jira] [Updated] (PIG-3618) Replace broadcast edges with scatter/gather edges in union

2013-12-11 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3618: --- Attachment: PIG-3618-2.patch Uploading a new patch that addresses Daniel's comments in the RB.

[jira] [Updated] (PIG-3618) Replace broadcast edges with scatter/gather edges in union

2013-12-11 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3618: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to tez branch. Replace

[jira] [Commented] (PIG-3610) Fix e2e tests Operators_3, Operators_5, Join_1

2013-12-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13839513#comment-13839513 ] Cheolsoo Park commented on PIG-3610: +1. Join_1 is still fails intermittently, but

[jira] [Commented] (PIG-3611) Add order by string, descending order e2e tests

2013-12-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13839683#comment-13839683 ] Cheolsoo Park commented on PIG-3611: +1. Add order by string, descending order e2e

[jira] [Commented] (PIG-3565) Make split work with Tez

2013-12-03 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837955#comment-13837955 ] Cheolsoo Park commented on PIG-3565: I still see Operators_3, 5 fail, but we can fix

[jira] [Commented] (PIG-3565) Make split work with Tez

2013-12-03 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837970#comment-13837970 ] Cheolsoo Park commented on PIG-3565: So it looks like range partitioner is broken. Try

[jira] [Updated] (PIG-3565) Make split work with Tez

2013-12-02 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3565: --- Attachment: join.diff test_harnesss_1383612309 I see 3 abortions and 1 failures in

[jira] [Commented] (PIG-3565) Make split work with Tez

2013-12-02 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837313#comment-13837313 ] Cheolsoo Park commented on PIG-3565: It looks like ORDER BY is broken. Operators_3,4,5

[jira] [Updated] (PIG-3585) Make union work with tez

2013-12-01 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3585: --- Attachment: PIG-3585-2.patch One minor clean-up. I made getPackage() take multiple inputs as parameter

[jira] [Updated] (PIG-3585) Make union work with tez

2013-12-01 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3585: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to tez branch. Make

[jira] [Comment Edited] (PIG-3585) Make union work with tez

2013-12-01 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836138#comment-13836138 ] Cheolsoo Park edited comment on PIG-3585 at 12/1/13 11:13 PM: --

[jira] [Updated] (PIG-3585) Make union work with tez

2013-11-30 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3585: --- Attachment: PIG-3585-1.patch Attaching a patch. RB link- https://reviews.apache.org/r/15931/ Make

[jira] [Updated] (PIG-3585) Make union work with tez

2013-11-30 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3585: --- Status: Patch Available (was: Open) Make union work with tez

[jira] [Created] (PIG-3604) Implement replicated join in Tez

2013-11-30 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3604: -- Summary: Implement replicated join in Tez Key: PIG-3604 URL: https://issues.apache.org/jira/browse/PIG-3604 Project: Pig Issue Type: Sub-task

[jira] [Assigned] (PIG-3599) Fix e2e Operator_1, 5, Checkin_3, and Join_1

2013-11-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reassigned PIG-3599: -- Assignee: Cheolsoo Park Fix e2e Operator_1, 5, Checkin_3, and Join_1

[jira] [Updated] (PIG-3599) Fix e2e Operator_1, 5, Checkin_3, and Join_1

2013-11-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3599: --- Attachment: PIG-3599-1.patch Attached fixes Checkin_3, Operators_1 and 5. Join_1 is rather strange

[jira] [Updated] (PIG-3599) Fix e2e Operator_1, 5, Checkin_3, and Join_1

2013-11-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3599: --- Attachment: PIG-3599-2.patch After debugging further, I learned that Join_1 was failing because of

[jira] [Created] (PIG-3602) Tear down TezSessions when Pig exits

2013-11-29 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3602: -- Summary: Tear down TezSessions when Pig exits Key: PIG-3602 URL: https://issues.apache.org/jira/browse/PIG-3602 Project: Pig Issue Type: Sub-task

[jira] [Resolved] (PIG-3599) Fix e2e Operator_1, 5, Checkin_3, and Join_1

2013-11-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-3599. Resolution: Fixed Committed to tez branch Fix e2e Operator_1, 5, Checkin_3, and Join_1

[jira] [Assigned] (PIG-3600) Fix TestExampleGenerator

2013-11-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reassigned PIG-3600: -- Assignee: Mark Wagner Fix TestExampleGenerator Key:

[jira] [Updated] (PIG-3585) Make union work with tez

2013-11-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3585: --- Description: Unlike MR, union needs to be implemented as multiple vertices because Tez doesn't allow

[jira] [Updated] (PIG-3585) Make union work with tez

2013-11-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3585: --- Attachment: (was: PIG-3585-1.patch) Make union work with tez

[jira] [Issue Comment Deleted] (PIG-3585) Make union work with tez

2013-11-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3585: --- Comment: was deleted (was: Adds two test cases for sample and union.) Make union work with tez

[jira] [Created] (PIG-3603) Add counters to TezStats

2013-11-29 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3603: -- Summary: Add counters to TezStats Key: PIG-3603 URL: https://issues.apache.org/jira/browse/PIG-3603 Project: Pig Issue Type: Sub-task Components: tez

[jira] [Updated] (PIG-3595) Port Package refactoring to Tez branch

2013-11-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3595: --- Attachment: PIG-3595.2.patch Here is what I did- # Merged latest trunk changes into tez branch. #

[jira] [Resolved] (PIG-3595) Port Package refactoring to Tez branch

2013-11-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-3595. Resolution: Fixed Committed to tez branch. Thank you Mark! Port Package refactoring to Tez branch

[jira] [Updated] (PIG-3527) Allow PigProcessor to handle multiple inputs

2013-11-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3527: --- Attachment: PIG-3527.3.patch Here is a patch that is rebased to the current HEAD of tez branch. I will

[jira] [Resolved] (PIG-3527) Allow PigProcessor to handle multiple inputs

2013-11-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-3527. Resolution: Fixed Allow PigProcessor to handle multiple inputs

[jira] [Updated] (PIG-3527) Allow PigProcessor to handle multiple inputs

2013-11-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3527: --- Attachment: PIG-3527.4.patch Committed PIG-3527.4.patch into tez branch. Thank you Mark! Note that I

[jira] [Created] (PIG-3599) Fix e2e Operator_1, 5, Checkin_3, and Join_1

2013-11-28 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3599: -- Summary: Fix e2e Operator_1, 5, Checkin_3, and Join_1 Key: PIG-3599 URL: https://issues.apache.org/jira/browse/PIG-3599 Project: Pig Issue Type: Sub-task

[jira] [Updated] (PIG-3599) Fix e2e Operator_1, 5, Checkin_3, and Join_1

2013-11-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3599: --- Attachment: Operators_5.diff Operators_1.diff Join_1.diff

[jira] [Commented] (PIG-3585) Add e2e tests for SAMPLE and UNION

2013-11-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13835120#comment-13835120 ] Cheolsoo Park commented on PIG-3585: As for UNION, Tez doesn't allow multiple inputs for

[jira] [Updated] (PIG-3600) Fix TestExampleGenerator

2013-11-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3600: --- Attachment: TEST-org.apache.pig.test.TestExampleGenerator.txt Attaching the test log. Fix

[jira] [Created] (PIG-3600) Fix TestExampleGenerator

2013-11-28 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3600: -- Summary: Fix TestExampleGenerator Key: PIG-3600 URL: https://issues.apache.org/jira/browse/PIG-3600 Project: Pig Issue Type: Sub-task Components: tez

[jira] [Created] (PIG-3601) Move POSimpleTezLoad under tez package

2013-11-28 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3601: -- Summary: Move POSimpleTezLoad under tez package Key: PIG-3601 URL: https://issues.apache.org/jira/browse/PIG-3601 Project: Pig Issue Type: Sub-task

[jira] [Updated] (PIG-3601) Move POSimpleTezLoad under tez package

2013-11-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3601: --- Attachment: PIG-3601-1.patch Attaching a patch that fixes it. Move POSimpleTezLoad under tez package

[jira] [Resolved] (PIG-3601) Move POSimpleTezLoad under tez package

2013-11-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-3601. Resolution: Fixed Committed to tez branch. Move POSimpleTezLoad under tez package

[jira] [Commented] (PIG-3576) NPE due to PIG-3549 when job never gets submitted

2013-11-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834151#comment-13834151 ] Cheolsoo Park commented on PIG-3576: [~aniket486], no sir. Go ahead. NPE due to

[jira] [Updated] (PIG-2132) Piggybank: MIN and MAX functions should ignore nulls

2013-11-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-2132: --- Fix Version/s: 0.13.0 Piggybank: MIN and MAX functions should ignore nulls

<    4   5   6   7   8   9   10   11   12   13   >