[jira] [Commented] (PIG-1904) Default split destination

2014-01-22 Thread Hardik (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13879492#comment-13879492 ] Hardik commented on PIG-1904: - Hello, I got error while apply this. grunt> data = load 'atoz.c

[jira] [Commented] (PIG-2672) Optimize the use of DistributedCache

2014-01-22 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13879473#comment-13879473 ] Aniket Mokashi commented on PIG-2672: - Hadoop uses following code to get stagingDir {for

[jira] [Updated] (PIG-3677) ConfigurationUtil.getLocalFSProperties can return an inconsistent property set

2014-01-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3677: Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thanks

[jira] [Updated] (PIG-3511) Security: Pig temporary directories might have world readable permissions

2014-01-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3511: Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thanks

[jira] [Commented] (PIG-3682) mvn-inst target does not install pig-h2.jar into local .m2

2014-01-22 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13879469#comment-13879469 ] Aniket Mokashi commented on PIG-3682: - +1 > mvn-inst target does not install pig-h2.jar

[jira] [Updated] (PIG-3682) mvn-inst target does not install pig-h2.jar into local .m2

2014-01-22 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-3682: Assignee: Raja Aluri > mvn-inst target does not install pig-h2.jar into local .m2 > -

[jira] [Commented] (PIG-2672) Optimize the use of DistributedCache

2014-01-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13879468#comment-13879468 ] Rohini Palaniswamy commented on PIG-2672: - > JobSubmissionFiles.getStagingDir(jobCli

[jira] [Commented] (PIG-3677) ConfigurationUtil.getLocalFSProperties can return an inconsistent property set

2014-01-22 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13879465#comment-13879465 ] Aniket Mokashi commented on PIG-3677: - Good catch! +1. > ConfigurationUtil.getLocalFSPr

[jira] [Comment Edited] (PIG-2672) Optimize the use of DistributedCache

2014-01-22 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13879461#comment-13879461 ] Aniket Mokashi edited comment on PIG-2672 at 1/23/14 5:44 AM: --

[jira] [Commented] (PIG-2672) Optimize the use of DistributedCache

2014-01-22 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13879461#comment-13879461 ] Aniket Mokashi commented on PIG-2672: - Another proposal: We create /tmp/${user.name}/jar

[jira] [Commented] (PIG-3511) Security: Pig temporary directories might have world readable permissions

2014-01-22 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13879459#comment-13879459 ] Aniket Mokashi commented on PIG-3511: - +1. Thanks [~rohini]! > Security: Pig temporary

[jira] [Updated] (PIG-2207) Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-2207: Resolution: Fixed Status: Resolved (was: Patch Available) > Support custom counters for aggr

[jira] [Updated] (PIG-2207) Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-2207: Attachment: PIG-2207-5.patch > Support custom counters for aggregating warnings from different udfs >

[jira] [Commented] (PIG-2207) Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13879456#comment-13879456 ] Aniket Mokashi commented on PIG-2207: - Committed to trunk! Thanks [~daijy] for the revie

[jira] [Updated] (PIG-3626) Make combiners, custom partitioners and secondary key sort work for multiple outputs

2014-01-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3626: Attachment: PIG-3626-2.patch > Make combiners, custom partitioners and secondary key sort wor

[jira] [Resolved] (PIG-3626) Make combiners, custom partitioners and secondary key sort work for multiple outputs

2014-01-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy resolved PIG-3626. - Resolution: Fixed Committed to tez branch. Thanks Cheolsoo for the review > Make combiners

Re: Review Request 17191: [PIG-3626] Make combiners, custom partitioners and secondary key sort work for multiple outputs

2014-01-22 Thread Rohini Palaniswamy
> On Jan. 23, 2014, 12:09 a.m., Cheolsoo Park wrote: > > http://svn.apache.org/repos/asf/pig/branches/tez/src/org/apache/pig/backend/hadoop/executionengine/tez/TezDagBuilder.java, > > lines 757-760 > > > > > > Do we n

Re: Review Request 17087: PIG-2207 Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Daniel Dai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17087/#review32585 --- Ship it! Ship It! - Daniel Dai On Jan. 22, 2014, 11:54 p.m., Ani

Re: Review Request 17191: [PIG-3626] Make combiners, custom partitioners and secondary key sort work for multiple outputs

2014-01-22 Thread Cheolsoo Park
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17191/#review32581 --- Ship it! Looks good. I don't mind fixing NPE in Join 7,8 tests in a

Re: Review Request 17087: PIG-2207 Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Aniket Mokashi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17087/ --- (Updated Jan. 22, 2014, 11:54 p.m.) Review request for pig, Cheolsoo Park, Dani

Re: Review Request 17087: PIG-2207 Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Aniket Mokashi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17087/ --- (Updated Jan. 22, 2014, 11:53 p.m.) Review request for pig, Cheolsoo Park, Dani

Re: Review Request 17087: PIG-2207 Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Aniket Mokashi
What if I short-circuit them? public final void warn(String msg, Enum warningEnum) { PigHadoopLogger.getInstance().warn(this, msg, warningEnum); } On Wed, Jan 22, 2014 at 3:43 PM, Daniel Dai wrote: > > > > On Jan. 22, 2014, 9:43 p.m., Daniel Dai wrote: > > > > src/org/apache/pig/

Re: Review Request 17087: PIG-2207 Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Daniel Dai
> On Jan. 22, 2014, 9:43 p.m., Daniel Dai wrote: > > src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigHadoopLogger.java, > > line 68 > > > > > > New LoadFunc/StoreFunc might use it, right? > > Anike

Re: Review Request 17087: PIG-2207 Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Aniket Mokashi
> On Jan. 22, 2014, 9:43 p.m., Daniel Dai wrote: > > src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigHadoopLogger.java, > > line 68 > > > > > > New LoadFunc/StoreFunc might use it, right? > > Anike

Re: Review Request 17087: PIG-2207 Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Daniel Dai
> On Jan. 22, 2014, 9:43 p.m., Daniel Dai wrote: > > src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigHadoopLogger.java, > > line 68 > > > > > > New LoadFunc/StoreFunc might use it, right? > > Anike

Re: Review Request 17087: PIG-2207 Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Aniket Mokashi
> On Jan. 22, 2014, 9:43 p.m., Daniel Dai wrote: > > src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigHadoopLogger.java, > > line 68 > > > > > > New LoadFunc/StoreFunc might use it, right? I mean, L

Re: Review Request 17087: PIG-2207 Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Daniel Dai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17087/#review32558 --- src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/Pi

[jira] [Updated] (PIG-3682) mvn-inst target does not install pig-h2.jar into local .m2

2014-01-22 Thread Raja Aluri (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raja Aluri updated PIG-3682: Attachment: 0001-PIG-3682-mvn-inst-target-does-not-install-pig-h2.jar.patch > mvn-inst target does not instal

[jira] [Updated] (PIG-3682) mvn-inst target does not install pig-h2.jar into local .m2

2014-01-22 Thread Raja Aluri (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raja Aluri updated PIG-3682: Status: Patch Available (was: Open) > mvn-inst target does not install pig-h2.jar into local .m2 > -

[jira] [Created] (PIG-3682) mvn-inst target does not install pig-h2.jar into local .m2

2014-01-22 Thread Raja Aluri (JIRA)
Raja Aluri created PIG-3682: --- Summary: mvn-inst target does not install pig-h2.jar into local .m2 Key: PIG-3682 URL: https://issues.apache.org/jira/browse/PIG-3682 Project: Pig Issue Type: Bug

Re: Review Request 17087: PIG-2207 Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Aniket Mokashi
> On Jan. 22, 2014, 8:22 p.m., Daniel Dai wrote: > > src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigHadoopLogger.java, > > line 66 > > > > > > How about holding a classname + hashcode in map instea

Re: Review Request 17087: PIG-2207 Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Daniel Dai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17087/#review32528 --- src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/Pi

[jira] [Commented] (PIG-3677) ConfigurationUtil.getLocalFSProperties can return an inconsistent property set

2014-01-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13879077#comment-13879077 ] Rohini Palaniswamy commented on PIG-3677: - Note: If HADOOP-9725 gets fixed and if "f

[jira] [Updated] (PIG-3677) ConfigurationUtil.getLocalFSProperties can return an inconsistent property set

2014-01-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3677: Status: Patch Available (was: Open) > ConfigurationUtil.getLocalFSProperties can return an i

[jira] [Updated] (PIG-3677) ConfigurationUtil.getLocalFSProperties can return an inconsistent property set

2014-01-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3677: Attachment: PIG-3677-2.patch Changed to use set instead of unset which is more simple. > Con

Re: Review Request 17087: PIG-2207 Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Aniket Mokashi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17087/ --- (Updated Jan. 22, 2014, 7:24 p.m.) Review request for pig, Cheolsoo Park, Danie

Re: Review Request 17087: PIG-2207 Support custom counters for aggregating warnings from different udfs

2014-01-22 Thread Aniket Mokashi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17087/ --- (Updated Jan. 22, 2014, 7:24 p.m.) Review request for pig, Cheolsoo Park, Danie

[jira] [Updated] (PIG-3677) ConfigurationUtil.getLocalFSProperties can return an inconsistent property set

2014-01-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3677: Attachment: PIG-3677-1.patch Doing a unset which takes care of removing all aliased configura

[jira] [Updated] (PIG-3511) Security: Pig temporary directories might have world readable permissions

2014-01-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3511: Status: Patch Available (was: Open) > Security: Pig temporary directories might have world r

[jira] [Updated] (PIG-3511) Security: Pig temporary directories might have world readable permissions

2014-01-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3511: Attachment: PIG-3511-1.patch We cannot use job staging dir as the temporary location as usual

Re: Review Request 17191: [PIG-3626] Make combiners, custom partitioners and secondary key sort work for multiple outputs

2014-01-22 Thread Cheolsoo Park
> On Jan. 22, 2014, 6:43 p.m., Cheolsoo Park wrote: > > I am reviewing the patch now. > > > > Thank you so much for fixing skewed join e2e tests. I was struggling with > > them for few days! Talked to Rohini. I misunderstood her comment about skewed join e2e tests. She was referring to tez.co

[jira] [Updated] (PIG-3654) Add class cache to PigContext

2014-01-22 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3654: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) +1. Patch

Re: Review Request 17191: [PIG-3626] Make combiners, custom partitioners and secondary key sort work for multiple outputs

2014-01-22 Thread Cheolsoo Park
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17191/#review32513 --- I am reviewing the patch now. Thank you so much for fixing skewed j

[jira] [Updated] (PIG-3626) Make combiners, custom partitioners and secondary key sort work for multiple outputs

2014-01-22 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3626: Attachment: PIG-3626-1.patch https://reviews.apache.org/r/17191/ > Make combiners, custom pa

Review Request 17191: [PIG-3626] Make combiners, custom partitioners and secondary key sort work for multiple outputs

2014-01-22 Thread Rohini Palaniswamy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17191/ --- Review request for pig, Alex Bain, Cheolsoo Park, Daniel Dai, and Mark Wagner.

[jira] [Updated] (PIG-3654) Add class cache to PigContext

2014-01-22 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-3654: - Attachment: PIG-3654-2.patch New patch that removes enabmement flag (cache is always used) and remo

[jira] [Updated] (PIG-3654) Add class cache to PigContext

2014-01-22 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-3654: - Status: Patch Available (was: In Progress) > Add class cache to PigContext > -

[jira] [Updated] (PIG-3654) Add class cache to PigContext

2014-01-22 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-3654: - Status: In Progress (was: Patch Available) > Add class cache to PigContext > -

[jira] [Commented] (PIG-3463) Pig should use hadoop local mode for small jobs

2014-01-22 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13878416#comment-13878416 ] Aniket Mokashi commented on PIG-3463: - Committed to trunk. Thanks [~daijy] and [~cheolso

[jira] [Updated] (PIG-3463) Pig should use hadoop local mode for small jobs

2014-01-22 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-3463: Resolution: Fixed Status: Resolved (was: Patch Available) > Pig should use hadoop local mode

[jira] [Updated] (PIG-3463) Pig should use hadoop local mode for small jobs

2014-01-22 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-3463: Attachment: PIG-3463-6.patch > Pig should use hadoop local mode for small jobs >

Re: Review Request 16928: PIG-3463 Pig should use hadoop local mode for small jobs

2014-01-22 Thread Aniket Mokashi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16928/ --- (Updated Jan. 22, 2014, 8:49 a.m.) Review request for pig, Cheolsoo Park, Danie