[jira] [Updated] (PIG-3832) Fix piggybank test compilation failure after PIG-3449

2014-03-25 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3832: Attachment: PIG-3832-1.patch Fixed a failure with TestMultiStorageCompression as well. Will

[jira] [Updated] (PIG-3832) Fix piggybank test compilation failure after PIG-3449

2014-03-25 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3832: Fix Version/s: (was: tez-branch) 0.13.0 Affects Version/s:

[jira] [Assigned] (PIG-3775) Use unsorted shuffle in Union, Orderby, Skewed Join to improve performance in Tez

2014-03-25 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy reassigned PIG-3775: --- Assignee: Rohini Palaniswamy Use unsorted shuffle in Union, Orderby, Skewed Join to

[jira] [Updated] (PIG-3449) Move JobCreationException to org.apache.pig.backend.hadoop.executionengine

2014-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3449: --- Fix Version/s: 0.13.0 Committed to trunk too. Please see the discussion in PIG-3832. Move

[jira] [Commented] (PIG-3832) Fix piggybank test compilation failure after PIG-3449

2014-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13946749#comment-13946749 ] Cheolsoo Park commented on PIG-3832: +1. Please go ahead commit to trunk too. Thanks!

[jira] [Created] (PIG-3833) Relation loaded by AvroStorage with schema is projected incorrectly in foreach statement.

2014-03-25 Thread Jeongjin Ku (JIRA)
Jeongjin Ku created PIG-3833: Summary: Relation loaded by AvroStorage with schema is projected incorrectly in foreach statement. Key: PIG-3833 URL: https://issues.apache.org/jira/browse/PIG-3833 Project:

[jira] [Updated] (PIG-3833) Relation loaded by AvroStorage with schema is projected incorrectly in foreach statement.

2014-03-25 Thread Jeongjin Ku (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeongjin Ku updated PIG-3833: - Description: This example has a correct behavior. in = LOAD '$INFILE' USING AvroStorage('','-f

[jira] [Assigned] (PIG-3803) POPoissonSample should handle endOfAllInput flag

2014-03-25 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-3803: --- Assignee: Daniel Dai POPoissonSample should handle endOfAllInput flag

[jira] [Created] (PIG-3834) Implement mapside cogroup in Tez

2014-03-25 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3834: --- Summary: Implement mapside cogroup in Tez Key: PIG-3834 URL: https://issues.apache.org/jira/browse/PIG-3834 Project: Pig Issue Type: Sub-task

[jira] [Updated] (PIG-3832) Fix piggybank test compilation failure after PIG-3449

2014-03-25 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3832: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

Review Request 19633: PIG-3743: Use VertexGroup and Alias vertex for union

2014-03-25 Thread Cheolsoo Park
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19633/ --- Review request for pig, Daniel Dai and Rohini Palaniswamy. Bugs: PIG-3743

[jira] [Updated] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3743: --- Attachment: PIG-3743-1.patch First patch. The RB link- https://reviews.apache.org/r/19633/ Use

[jira] [Updated] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3743: --- Status: Patch Available (was: Open) Use VertexGroup and Alias vertex for union

Re: Review Request 19633: PIG-3743: Use VertexGroup and Alias vertex for union

2014-03-25 Thread Cheolsoo Park
On March 25, 2014, 9:27 p.m., Rohini Palaniswamy wrote: This will not handle union followed by store right? Can we create a separate jira for that? Correct. Like I said in the description, MROutput should be added directly to VertexGroup. I will file a jira. On March 25, 2014, 9:27

Re: Review Request 19633: PIG-3743: Use VertexGroup and Alias vertex for union

2014-03-25 Thread Cheolsoo Park
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19633/ --- (Updated March 25, 2014, 10 p.m.) Review request for pig, Daniel Dai and

[jira] [Updated] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3743: --- Attachment: PIG-3743-2.patch Second patch. Use VertexGroup and Alias vertex for union

[jira] [Commented] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-25 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13947245#comment-13947245 ] Rohini Palaniswamy commented on PIG-3743: - +1 Use VertexGroup and Alias vertex for

[jira] [Updated] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3743: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to tez branch. Thank you

[jira] [Created] (PIG-3835) Optimize union followed by store

2014-03-25 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-3835: -- Summary: Optimize union followed by store Key: PIG-3835 URL: https://issues.apache.org/jira/browse/PIG-3835 Project: Pig Issue Type: Sub-task

[jira] [Commented] (PIG-3742) Set MR runtime settings on tez runtime

2014-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13947273#comment-13947273 ] Cheolsoo Park commented on PIG-3742: Filed PIG-3835 for union followed by store. Set

[jira] [Updated] (PIG-3835) Optimize union followed by store

2014-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3835: --- Description: PIG-3743 implements union using VertexGroup. Currently, union is a blocking operator

[jira] [Issue Comment Deleted] (PIG-3742) Set MR runtime settings on tez runtime

2014-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3742: --- Comment: was deleted (was: Filed PIG-3835 for union followed by store.) Set MR runtime settings on

[jira] [Commented] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13947274#comment-13947274 ] Cheolsoo Park commented on PIG-3743: Filed PIG-3835 for union followed by store. Use

[jira] [Updated] (PIG-3749) PigPerformance - data in the map gets lost during parsing

2014-03-25 Thread Keren Ouaknine (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keren Ouaknine updated PIG-3749: Fix Version/s: 0.12.1 Release Note: Bug in PigPerformanceLoader when reading bytes, the loop

[jira] [Updated] (PIG-3833) Relation loaded by AvroStorage with schema is projected incorrectly in foreach statement.

2014-03-25 Thread Jeongjin Ku (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeongjin Ku updated PIG-3833: - Status: Patch Available (was: Open) Relation loaded by AvroStorage with schema is projected incorrectly

[jira] [Updated] (PIG-3833) Relation loaded by AvroStorage with schema is projected incorrectly in foreach statement.

2014-03-25 Thread Jeongjin Ku (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeongjin Ku updated PIG-3833: - Status: Open (was: Patch Available) Relation loaded by AvroStorage with schema is projected incorrectly

[jira] [Updated] (PIG-3749) PigPerformance - data in the map gets lost during parsing

2014-03-25 Thread Keren Ouaknine (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keren Ouaknine updated PIG-3749: Attachment: (was: patch.txt) PigPerformance - data in the map gets lost during parsing

[jira] [Updated] (PIG-3749) PigPerformance - data in the map gets lost during parsing

2014-03-25 Thread Keren Ouaknine (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keren Ouaknine updated PIG-3749: Attachment: PIG-3749.patch PigPerformance - data in the map gets lost during parsing

[jira] [Updated] (PIG-3749) PigPerformance - data in the map gets lost during parsing

2014-03-25 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3749: Assignee: Keren Ouaknine PigPerformance - data in the map gets lost during parsing

[jira] [Reopened] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reopened PIG-3743: Actually, I introduced a terrible skew to union in my previous patch. Since I am setting key to null,

[jira] [Updated] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3743: --- Attachment: PIG-3743-fix-skew.patch Use VertexGroup and Alias vertex for union

[jira] Subscription: PIG patch available

2014-03-25 Thread jira
Issue Subscription Filter: PIG patch available (14 issues) Subscriber: pigdaily Key Summary PIG-3829Make custom counter work https://issues.apache.org/jira/browse/PIG-3829 PIG-3825Stats collection needs to be changed for hadoop2 (with auto local mode)

[jira] [Updated] (PIG-3743) Use VertexGroup and Alias vertex for union

2014-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3743: --- Status: Patch Available (was: Reopened) Verified with a production script that union is distributed.

Re: Review Request 17376: PIG-3000 Nested Foreach optimization

2014-03-25 Thread Mona Chitnis
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17376/ --- (Updated March 26, 2014, 1:27 a.m.) Review request for pig and Rohini

[jira] [Commented] (PIG-3000) Optimize nested foreach

2014-03-25 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13947434#comment-13947434 ] Mona Chitnis commented on PIG-3000: --- [~daijy] Daniel Dai, can you please review the patch