[jira] [Commented] (PIG-3815) Hadoop bug causes to pig to fail silently with jar cache

2014-03-18 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13939815#comment-13939815 ] Rohini Palaniswamy commented on PIG-3815: - [~julienledem], It is being qualified

[jira] [Commented] (PIG-3807) Pig creates wrong schema after dereferencing nested tuple fields with sorts

2014-03-19 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13940824#comment-13940824 ] Rohini Palaniswamy commented on PIG-3807: - +1 Pig creates wrong schema after

[jira] [Commented] (PIG-3789) tuple in POStream binaryInputQueue keep changing

2014-03-19 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13940895#comment-13940895 ] Rohini Palaniswamy commented on PIG-3789: - Patch looks good. But a thought. If we

[jira] [Commented] (PIG-3819) e2e tests containing perl -e print $_; fails on Hadoop 2

2014-03-19 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13941053#comment-13941053 ] Rohini Palaniswamy commented on PIG-3819: - What interprets $ to last command

[jira] [Commented] (PIG-3820) TestAvroStorage fail on some OS

2014-03-19 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13941049#comment-13941049 ] Rohini Palaniswamy commented on PIG-3820: - +1 TestAvroStorage fail on some OS

[jira] [Commented] (PIG-3818) PIG-2499 is accidently reverted

2014-03-19 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13941063#comment-13941063 ] Rohini Palaniswamy commented on PIG-3818: - +1. Since this will fix the race

[jira] [Created] (PIG-3822) Remove reference to BroadcastKVReader as it is removed in TEZ-911

2014-03-19 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3822: --- Summary: Remove reference to BroadcastKVReader as it is removed in TEZ-911 Key: PIG-3822 URL: https://issues.apache.org/jira/browse/PIG-3822 Project: Pig

[jira] [Updated] (PIG-3822) Remove reference to BroadcastKVReader as it is removed in TEZ-911

2014-03-19 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3822: Attachment: PIG-3822-1.patch Remove reference to BroadcastKVReader as it is removed in

[jira] [Updated] (PIG-3822) Remove reference to BroadcastKVReader as it is removed in TEZ-911

2014-03-19 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3822: Status: Patch Available (was: Open) Remove reference to BroadcastKVReader as it is removed

[jira] [Commented] (PIG-3789) tuple in POStream binaryInputQueue keep changing

2014-03-19 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13941154#comment-13941154 ] Rohini Palaniswamy commented on PIG-3789: - Lets just commit this patch. I will

[jira] [Comment Edited] (PIG-3789) tuple in POStream binaryInputQueue keep changing

2014-03-19 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13941154#comment-13941154 ] Rohini Palaniswamy edited comment on PIG-3789 at 3/19/14 11:19 PM:

[jira] [Updated] (PIG-3822) Remove reference to BroadcastKVReader as it is removed in TEZ-911

2014-03-19 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3822: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Created] (PIG-3823) Use newTupleNoCopy instead of newTuple wherever possible to avoid object copy penalty

2014-03-19 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3823: --- Summary: Use newTupleNoCopy instead of newTuple wherever possible to avoid object copy penalty Key: PIG-3823 URL: https://issues.apache.org/jira/browse/PIG-3823

[jira] [Commented] (PIG-3790) Several changes in Tez e2e

2014-03-20 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13941636#comment-13941636 ] Rohini Palaniswamy commented on PIG-3790: - +1 Several changes in Tez e2e

[jira] [Commented] (PIG-3826) Outer join with PushDownForEachFlatten generates wrong result

2014-03-20 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13942740#comment-13942740 ] Rohini Palaniswamy commented on PIG-3826: - +1 Outer join with

[jira] [Commented] (PIG-3829) Make custom counter work

2014-03-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13945777#comment-13945777 ] Rohini Palaniswamy commented on PIG-3829: - Why use Singleton classes instead of just

[jira] [Created] (PIG-3832) Fix piggybank test compilation failure after PIG-3419

2014-03-24 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3832: --- Summary: Fix piggybank test compilation failure after PIG-3419 Key: PIG-3832 URL: https://issues.apache.org/jira/browse/PIG-3832 Project: Pig Issue

[jira] [Updated] (PIG-3832) Fix piggybank test compilation failure after PIG-3449

2014-03-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3832: Description: JobCreationException has moved from

[jira] [Updated] (PIG-3832) Fix piggybank test compilation failure after PIG-3449

2014-03-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3832: Affects Version/s: tez-branch Fix Version/s: (was: 0.13.0)

[jira] [Updated] (PIG-3832) Fix piggybank test compilation failure after PIG-3449

2014-03-25 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3832: Attachment: PIG-3832-1.patch Fixed a failure with TestMultiStorageCompression as well. Will

[jira] [Updated] (PIG-3832) Fix piggybank test compilation failure after PIG-3449

2014-03-25 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3832: Fix Version/s: (was: tez-branch) 0.13.0 Affects Version/s:

[jira] [Assigned] (PIG-3775) Use unsorted shuffle in Union, Orderby, Skewed Join to improve performance in Tez

2014-03-25 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy reassigned PIG-3775: --- Assignee: Rohini Palaniswamy Use unsorted shuffle in Union, Orderby, Skewed Join to

[jira] [Created] (PIG-3834) Implement mapside cogroup in Tez

2014-03-25 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3834: --- Summary: Implement mapside cogroup in Tez Key: PIG-3834 URL: https://issues.apache.org/jira/browse/PIG-3834 Project: Pig Issue Type: Sub-task

[jira] [Updated] (PIG-3832) Fix piggybank test compilation failure after PIG-3449

2014-03-25 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3832: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-25 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13947245#comment-13947245 ] Rohini Palaniswamy commented on PIG-3743: - +1 Use VertexGroup and Alias vertex for

[jira] [Commented] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-26 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13948023#comment-13948023 ] Rohini Palaniswamy commented on PIG-3743: - [~cheolsoo], POLocalRearrangeTez.java

[jira] [Comment Edited] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-26 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13948023#comment-13948023 ] Rohini Palaniswamy edited comment on PIG-3743 at 3/26/14 4:05 PM:

[jira] [Commented] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-26 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13948100#comment-13948100 ] Rohini Palaniswamy commented on PIG-3743: - bq. In addition, can we fix the skew

[jira] [Commented] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-26 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13948182#comment-13948182 ] Rohini Palaniswamy commented on PIG-3743: - bq. A simple alternative is to set value

[jira] [Commented] (PIG-3813) Rank column is assigned different uids everytime when schema is reset

2014-03-27 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13949651#comment-13949651 ] Rohini Palaniswamy commented on PIG-3813: - We should certainly backport this to

[jira] [Updated] (PIG-3814) Implement RANK in Tez

2014-03-27 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3814: Attachment: PIG-3814-2.patch PIG-3814-1.patch Review board link -

[jira] [Updated] (PIG-3814) Implement RANK in Tez

2014-03-27 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3814: Status: Patch Available (was: Open) Rank implementation in Tez is different from MR

[jira] [Created] (PIG-3838) Organize tez code into subpackages

2014-03-27 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3838: --- Summary: Organize tez code into subpackages Key: PIG-3838 URL: https://issues.apache.org/jira/browse/PIG-3838 Project: Pig Issue Type: Sub-task

[jira] [Updated] (PIG-3814) Implement RANK in Tez

2014-03-27 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3814: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Created] (PIG-3839) Umbrella jira for Pig on Tez Performance Improvements

2014-03-27 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3839: --- Summary: Umbrella jira for Pig on Tez Performance Improvements Key: PIG-3839 URL: https://issues.apache.org/jira/browse/PIG-3839 Project: Pig Issue

[jira] [Created] (PIG-3840) Umbrella jira for Pig on Tez Unit Test porting

2014-03-27 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3840: --- Summary: Umbrella jira for Pig on Tez Unit Test porting Key: PIG-3840 URL: https://issues.apache.org/jira/browse/PIG-3840 Project: Pig Issue Type:

[jira] [Updated] (PIG-3600) Fix TestExampleGenerator

2014-03-27 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3600: Parent Issue: PIG-3840 (was: PIG-3446) Fix TestExampleGenerator

[jira] [Updated] (PIG-3631) Improve performance of replicate-join

2014-03-27 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3631: Parent Issue: PIG-3839 (was: PIG-3446) Improve performance of replicate-join

[jira] [Updated] (PIG-3835) Improve performance of union

2014-03-27 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3835: Parent Issue: PIG-3839 (was: PIG-3446) Improve performance of union

[jira] [Updated] (PIG-3750) Fix unit tests for MultiQuery and add new ones for Tez

2014-03-27 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3750: Parent Issue: PIG-3840 (was: PIG-3446) Fix unit tests for MultiQuery and add new ones for

[jira] [Updated] (PIG-3775) Use unsorted shuffle in Union, Orderby, Skewed Join to improve performance in Tez

2014-03-27 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3775: Parent Issue: PIG-3839 (was: PIG-3446) Use unsorted shuffle in Union, Orderby, Skewed Join

[jira] [Created] (PIG-3841) Honor Mapreduce Distributed Cache settings and localize resources in Tez

2014-03-27 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3841: --- Summary: Honor Mapreduce Distributed Cache settings and localize resources in Tez Key: PIG-3841 URL: https://issues.apache.org/jira/browse/PIG-3841 Project:

[jira] [Created] (PIG-3842) Pig on tez job hangs when AM has a failure and DAG cannot be submitted

2014-03-27 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3842: --- Summary: Pig on tez job hangs when AM has a failure and DAG cannot be submitted Key: PIG-3842 URL: https://issues.apache.org/jira/browse/PIG-3842 Project: Pig

[jira] [Commented] (PIG-3842) Pig on tez job hangs when AM has a failure and DAG cannot be submitted

2014-03-27 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13949906#comment-13949906 ] Rohini Palaniswamy commented on PIG-3842: - It hangs at {code} main prio=5

[jira] [Created] (PIG-3843) Pig script encounters error with Tez MemoryDistributor

2014-03-27 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3843: --- Summary: Pig script encounters error with Tez MemoryDistributor Key: PIG-3843 URL: https://issues.apache.org/jira/browse/PIG-3843 Project: Pig Issue

[jira] [Created] (PIG-3845) Use shared edge with no multiquery

2014-03-27 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3845: --- Summary: Use shared edge with no multiquery Key: PIG-3845 URL: https://issues.apache.org/jira/browse/PIG-3845 Project: Pig Issue Type: Sub-task

[jira] [Created] (PIG-3846) Implement automatic reducer parallelism

2014-03-27 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3846: --- Summary: Implement automatic reducer parallelism Key: PIG-3846 URL: https://issues.apache.org/jira/browse/PIG-3846 Project: Pig Issue Type: Sub-task

[jira] [Commented] (PIG-3631) Improve performance of replicate-join

2014-03-27 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13950074#comment-13950074 ] Rohini Palaniswamy commented on PIG-3631: - bq. Verify no performance regression with

[jira] [Created] (PIG-3847) Sort avoidance for group by and join

2014-03-27 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3847: --- Summary: Sort avoidance for group by and join Key: PIG-3847 URL: https://issues.apache.org/jira/browse/PIG-3847 Project: Pig Issue Type: Sub-task

[jira] [Created] (PIG-3848) Dynamically switch to replicate join

2014-03-27 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3848: --- Summary: Dynamically switch to replicate join Key: PIG-3848 URL: https://issues.apache.org/jira/browse/PIG-3848 Project: Pig Issue Type: Sub-task

[jira] [Created] (PIG-3849) Optimize group by followed by join on the same key

2014-03-27 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3849: --- Summary: Optimize group by followed by join on the same key Key: PIG-3849 URL: https://issues.apache.org/jira/browse/PIG-3849 Project: Pig Issue Type:

[jira] [Created] (PIG-3850) Optimize join followed by order by using same key

2014-03-27 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3850: --- Summary: Optimize join followed by order by using same key Key: PIG-3850 URL: https://issues.apache.org/jira/browse/PIG-3850 Project: Pig Issue Type:

[jira] [Updated] (PIG-3850) Optimize join followed by order by using same key

2014-03-27 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3850: Description: Possible optimizations: 1) If it is a skewed join, then we can combine

[jira] [Created] (PIG-3852) Remove SecurityHelper class for Tez and use Tez helpers instead

2014-03-28 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3852: --- Summary: Remove SecurityHelper class for Tez and use Tez helpers instead Key: PIG-3852 URL: https://issues.apache.org/jira/browse/PIG-3852 Project: Pig

[jira] [Assigned] (PIG-3835) Improve performance of union

2014-03-30 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy reassigned PIG-3835: --- Assignee: Rohini Palaniswamy Improve performance of union

[jira] [Updated] (PIG-3835) Improve performance of union

2014-03-31 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3835: Attachment: PIG-3835-Initial-1.patch Changes done: - Changed POLocalRearrangeTez to

[jira] [Commented] (PIG-3835) Improve performance of union

2014-03-31 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13955445#comment-13955445 ] Rohini Palaniswamy commented on PIG-3835: - To give more details - Without the

[jira] [Created] (PIG-3854) Improve performance of Limit on Tez

2014-03-31 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3854: --- Summary: Improve performance of Limit on Tez Key: PIG-3854 URL: https://issues.apache.org/jira/browse/PIG-3854 Project: Pig Issue Type: Sub-task

[jira] [Created] (PIG-3855) Add new e2e tests for union

2014-03-31 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3855: --- Summary: Add new e2e tests for union Key: PIG-3855 URL: https://issues.apache.org/jira/browse/PIG-3855 Project: Pig Issue Type: Sub-task

[jira] [Created] (PIG-3856) UnionOptimizer in Tez should optimize the case of replicated join

2014-03-31 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3856: --- Summary: UnionOptimizer in Tez should optimize the case of replicated join Key: PIG-3856 URL: https://issues.apache.org/jira/browse/PIG-3856 Project: Pig

[jira] [Updated] (PIG-3835) Improve performance of union

2014-04-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3835: Attachment: PIG-3835-2.patch Turned of UnionOptimizer for now by default till TEZ-1003 is

[jira] [Updated] (PIG-3835) Improve performance of union

2014-04-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3835: Status: Patch Available (was: Open) Improve performance of union

[jira] [Updated] (PIG-3835) Improve performance of union

2014-04-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3835: Attachment: PIG-3835-3.patch Final patch. Changes : - return value to 0 in

[jira] [Updated] (PIG-3835) Improve performance of union

2014-04-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3835: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Updated] (PIG-3835) Improve performance of union

2014-04-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3835: Attachment: PIG-3835-addendum-1.patch Daniel found some issues when the UnionOptimizer is

[jira] [Reopened] (PIG-3835) Improve performance of union

2014-04-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy reopened PIG-3835: - Improve performance of union Key: PIG-3835

[jira] [Resolved] (PIG-3835) Improve performance of union

2014-04-02 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy resolved PIG-3835. - Resolution: Fixed Committed the additional patch to tez-branch. Thanks Daniel for the

[jira] [Commented] (PIG-3853) Pig does not kill all the jobs during shutdown for hadoop2

2014-04-02 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13958060#comment-13958060 ] Rohini Palaniswamy commented on PIG-3853: - RunningJob would also refer to jobs that

[jira] [Commented] (PIG-3819) e2e tests containing perl -e print $_; fails on Hadoop 2

2014-04-02 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13958163#comment-13958163 ] Rohini Palaniswamy commented on PIG-3819: - I find it failing with same error in my

[jira] [Updated] (PIG-3841) Honor Mapreduce Distributed Cache settings and localize resources in Tez

2014-04-02 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3841: Attachment: PIG-3841-1.patch Honor Mapreduce Distributed Cache settings and localize

[jira] [Updated] (PIG-3841) Honor Mapreduce Distributed Cache settings and localize resources in Tez

2014-04-02 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3841: Assignee: Rohini Palaniswamy Status: Patch Available (was: Open) Honor Mapreduce

[jira] [Commented] (PIG-3841) Honor Mapreduce Distributed Cache settings and localize resources in Tez

2014-04-02 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13958281#comment-13958281 ] Rohini Palaniswamy commented on PIG-3841: - For now calling methods in classes of

[jira] [Commented] (PIG-3819) e2e tests containing perl -e print $_; fails on Hadoop 2

2014-04-02 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13958289#comment-13958289 ] Rohini Palaniswamy commented on PIG-3819: - Daniel found the cause. It was working in

[jira] [Commented] (PIG-3862) e2e test Rank_9 fail

2014-04-03 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959074#comment-13959074 ] Rohini Palaniswamy commented on PIG-3862: - +1 e2e test Rank_9 fail

[jira] [Commented] (PIG-3863) e2e tests run all tests even execonly flag does not match

2014-04-03 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959072#comment-13959072 ] Rohini Palaniswamy commented on PIG-3863: - +1. Thanks for fixing the match condition

[jira] [Commented] (PIG-3861) duplicate jars get added to distributed cache

2014-04-03 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959140#comment-13959140 ] Rohini Palaniswamy commented on PIG-3861: - Few comments: - Please convert to Set

[jira] [Commented] (PIG-3862) e2e test Rank_9 fail

2014-04-03 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959285#comment-13959285 ] Rohini Palaniswamy commented on PIG-3862: - [~daijy], Your second patch will break

[jira] [Commented] (PIG-3862) e2e test Rank_9 fail

2014-04-03 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959445#comment-13959445 ] Rohini Palaniswamy commented on PIG-3862: - The tez specific PhysicalOperators are

[jira] [Commented] (PIG-3862) e2e test Rank_9 fail

2014-04-04 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13960146#comment-13960146 ] Rohini Palaniswamy commented on PIG-3862: - +1 e2e test Rank_9 fail

[jira] [Commented] (PIG-3871) Replace org.python.google.* with com.google.* in imports

2014-04-04 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13960148#comment-13960148 ] Rohini Palaniswamy commented on PIG-3871: - +1 Replace org.python.google.* with

[jira] [Updated] (PIG-3841) Honor Mapreduce Distributed Cache settings and localize resources in Tez

2014-04-06 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3841: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Resolved] (PIG-3843) Pig script encounters error with Tez MemoryDistributor

2014-04-08 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy resolved PIG-3843. - Resolution: Invalid This was a bug in a particular revision of Tez and long fixed. Pig

[jira] [Updated] (PIG-3842) Pig on tez job hangs when AM has a failure and Multiquery fixes

2014-04-08 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3842: Assignee: Rohini Palaniswamy Summary: Pig on tez job hangs when AM has a failure and

[jira] [Commented] (PIG-3842) Pig on tez job hangs when AM has a failure and Multiquery fixes

2014-04-08 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963823#comment-13963823 ] Rohini Palaniswamy commented on PIG-3842: - Reviewboard link -

[jira] [Commented] (PIG-3875) Fix MergeJoin_8 failure

2014-04-10 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13965204#comment-13965204 ] Rohini Palaniswamy commented on PIG-3875: - The patch returns EOP if right side is

[jira] [Commented] (PIG-3875) Fix MergeJoin_8 failure

2014-04-10 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13965207#comment-13965207 ] Rohini Palaniswamy commented on PIG-3875: - Patch is marked for tez-branch. The issue

[jira] [Commented] (PIG-2872) StoreFuncInterface.setStoreLocation get's a copy of a Configuration object

2014-04-10 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13965212#comment-13965212 ] Rohini Palaniswamy commented on PIG-2872: - PIG-2578 has been reverted and is not in

[jira] [Created] (PIG-3876) Handle two outputs from split going to same input in MultiQueryOptimizer

2014-04-10 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3876: --- Summary: Handle two outputs from split going to same input in MultiQueryOptimizer Key: PIG-3876 URL: https://issues.apache.org/jira/browse/PIG-3876 Project:

[jira] [Updated] (PIG-3876) Handle two outputs from split going to same input in MultiQueryOptimizer

2014-04-10 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3876: Description: MultiQueryOptimizerTez.java {code} // Detect diamond shape, we cannot merge it

[jira] [Created] (PIG-3878) Improve parallelism of union and join

2014-04-10 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3878: --- Summary: Improve parallelism of union and join Key: PIG-3878 URL: https://issues.apache.org/jira/browse/PIG-3878 Project: Pig Issue Type: Sub-task

[jira] [Commented] (PIG-2872) StoreFuncInterface.setStoreLocation get's a copy of a Configuration object

2014-04-10 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13965362#comment-13965362 ] Rohini Palaniswamy commented on PIG-2872: - Can you open a separate jira for this? If

[jira] [Comment Edited] (PIG-3835) Improve performance of union

2014-04-10 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13955445#comment-13955445 ] Rohini Palaniswamy edited comment on PIG-3835 at 4/10/14 7:35 PM:

[jira] [Updated] (PIG-3842) Pig on tez job hangs when AM has a failure and Multiquery fixes

2014-04-10 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3842: Attachment: PIG-3842-3.patch PIG-3842-2.patch

[jira] [Updated] (PIG-3842) Pig on tez job hangs when AM has a failure and Multiquery fixes

2014-04-10 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3842: Status: Patch Available (was: Open) Pig on tez job hangs when AM has a failure and

[jira] [Created] (PIG-3882) Multiquery off mode execution is not done in batch and very inefficient

2014-04-10 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3882: --- Summary: Multiquery off mode execution is not done in batch and very inefficient Key: PIG-3882 URL: https://issues.apache.org/jira/browse/PIG-3882 Project: Pig

[jira] [Updated] (PIG-3882) Multiquery off mode execution is not done in batch and very inefficient

2014-04-10 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3882: Attachment: PIG-3882-1.patch Multiquery off mode execution is not done in batch and very

[jira] [Updated] (PIG-3882) Multiquery off mode execution is not done in batch and very inefficient

2014-04-10 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3882: Status: Patch Available (was: Open) Multiquery off mode execution is not done in batch and

[jira] [Updated] (PIG-3868) Fix Iterator_1 e2e test on windows

2014-04-10 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3868: Hadoop Flags: Reviewed Fix Iterator_1 e2e test on windows

[jira] [Updated] (PIG-3868) Fix Iterator_1 e2e test on windows

2014-04-10 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3868: Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch

[jira] [Commented] (PIG-3875) Fix MergeJoin_8 failure

2014-04-11 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13966518#comment-13966518 ] Rohini Palaniswamy commented on PIG-3875: - +1 Fix MergeJoin_8 failure

<    3   4   5   6   7   8   9   10   11   12   >