Re: [VOTE] Release Pig 0.14.0 (candidate 0)

2014-11-14 Thread Thejas Nair
+1 Verified keys Checked LICENSE, README, RELEASE_NOTES, CHANGES files, rat report. Built the source Tried running queries both using local mode and cluster Two minor issues, that doesn’t need to block this RC 1. I think we should update README to indicate the choice of execution engine. 2. pig

Re: [VOTE] Drop support for Hadoop 0.20 from Pig 0.14

2014-09-22 Thread Thejas Nair
+1 On Thu, Sep 18, 2014 at 5:50 PM, Mona Chitnis mona.chit...@yahoo.in wrote: +1 (non-binding) Mona Chitnis Yahoo! On Thursday, September 18, 2014 8:48 AM, Ashutosh Chauhan hashut...@apache.org wrote: +1 On Wed, Sep 17, 2014 at 7:02 PM, Daniel Dai da...@hortonworks.com wrote:

Re: Review Request 24789: New logical optimizer rule: ConstantCalculator

2014-08-26 Thread Thejas Nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24789/#review51603 --- Ship it! Ship It! - Thejas Nair On Aug. 26, 2014, 10:35 p.m

Re: Review Request 24789: New logical optimizer rule: ConstantCalculator

2014-08-25 Thread Thejas Nair
happening. Is this variable needed ? trunk/src/org/apache/pig/newplan/logical/rules/ConstantCalculator.java https://reviews.apache.org/r/24789/#comment89755 does it make sense to do this setPlan in moveTree call itself? - Thejas Nair On Aug. 19, 2014, 5:41 p.m., Daniel Dai wrote

Re: [ANNOUNCE] Apache Pig 0.12.1 released

2014-04-15 Thread Thejas Nair
Thanks Prashant! On Tue, Apr 15, 2014 at 10:58 AM, Cheolsoo Park piaozhe...@gmail.com wrote: Thank you Prashant for your hard work! On Mon, Apr 14, 2014 at 5:37 PM, Daniel Dai da...@hortonworks.com wrote: Thanks Prashant! On Mon, Apr 14, 2014 at 5:30 PM, Prashant Kommireddi

Re: [VOTE] Release Pig 0.12.1 (Candidate 0)

2014-04-11 Thread Thejas Nair
Here is my late +1. Checked the md5 and asc keys. Checked release notes, CHANGES.txt. Build from source tar, tried some local queries. Checked output of version command (pig -version) The output of version command in binary is accurate. However, in case of source tar, when I build using just ant

Re: [VOTE] Release Pig 0.12.1 (Candidate 0)

2014-04-11 Thread Thejas Nair
, the version will be {next version}-SNAPSHOT.Thanks,Daniel* On Fri, Apr 11, 2014 at 10:45 AM, Thejas Nair the...@hortonworks.comwrote: Here is my late +1. Checked the md5 and asc keys. Checked release notes, CHANGES.txt. Build from source tar, tried some local queries. Checked output

Re: [ANNOUNCE] Congratulations to our new PMC members Rohini Palaniswamy and Cheolsoo Park

2013-09-13 Thread Thejas Nair
Congrats Rohini and Cheolsoo! On Thu, Sep 12, 2013 at 11:24 AM, Bill Graham billgra...@gmail.com wrote: Congrats guys! Well deserved indeed. On Wed, Sep 11, 2013 at 10:58 PM, Jarek Jarcec Cecho jar...@apache.orgwrote: Congratulations Rohini and Cheolsoo, awesome work! Jarcec On Wed, Sep

Re: Welcome new Pig Committer - Koji Noguchi

2013-09-13 Thread Thejas Nair
Congrats Koji! Very well deserved! On Wed, Sep 11, 2013 at 9:49 AM, Daniel Dai da...@hortonworks.com wrote: Congratulation! You are well deserved. On Wed, Sep 11, 2013 at 6:33 AM, Miguel Angel Martin junquera mianmarjun.mailingl...@gmail.com wrote: Congratulations K Miguel

Re: [VOTE] Release Pig 0.10.1 (candidate 3)

2013-01-03 Thread Thejas Nair
+1 Verified md5 checksums of src and binary tar.gz . Build the src tar.gz and ran queries against a hadoop 1.1 cluster, ran fs and sh commands. -Thejas On 1/3/13 12:11 PM, Rohini Palaniswamy wrote: +1. Downloaded the tar binary, checked signature, ran unit tests, piggybank unit tests,

Re: Review Request: Review for PIG-1314 - add datetime type in pig

2012-08-16 Thread Thejas Nair
/pig/trunk/test/org/apache/pig/test/TestTypeCheckingValidatorNewLP.java 1373741 http://svn.apache.org/repos/asf/pig/trunk/test/org/apache/pig/test/utils/GenRandomData.java 1373741 Diff: https://reviews.apache.org/r/5414/diff/ Testing --- Thanks, Thejas Nair

Re: Review Request: Review for PIG-1314 - add datetime type in pig

2012-08-14 Thread Thejas Nair
/repos/asf/pig/trunk/test/org/apache/pig/test/TestTypeCheckingValidatorNewLP.java 1371785 http://svn.apache.org/repos/asf/pig/trunk/test/org/apache/pig/test/utils/GenRandomData.java 1371785 Diff: https://reviews.apache.org/r/5414/diff/ Testing --- Thanks, Thejas Nair

Re: Breaking down big unit tests

2012-07-19 Thread Thejas Nair
We certainly need to look at ways to reduce the runtime of the 'unit' tests. Some of them should be migrated to the e2e tests. But what you want for being able to re-test easily seems to be a way to specify specific test case within a Test*.java file . I wonder if junit lets you do that.

Re: Review Request: Review for PIG-1314 - add datetime type in pig

2012-07-11 Thread Thejas Nair
here. - Thejas Nair On July 10, 2012, 5:41 p.m., Thejas Nair wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5414

Re: Review Request: Review for PIG-1314 - add datetime type in pig

2012-07-10 Thread Thejas Nair
/repos/asf/pig/trunk/test/org/apache/pig/test/TestConversions.java 1359212 http://svn.apache.org/repos/asf/pig/trunk/test/org/apache/pig/test/TestPOCast.java 1359212 Diff: https://reviews.apache.org/r/5414/diff/ Testing --- Thanks, Thejas Nair

Re: Are there any explanations of the implementation of illustrate?

2012-07-05 Thread Thejas Nair
Earlier implementation of illustrate used the pig local mode execution engine (which corresponds to the time when paper was published) . As part of illustrate reword in PIG-1712, Yan replaced the default Map and Reduce context objects with a IllustratorContext. Look for IllustratorContext and

Re: Possible bug in replicated join?

2012-06-21 Thread Thejas Nair
That certainly looks like a bug. The replicated join should not flatten the tuple. I didn't actually know that pig supported doing joins on tuples (i guess it does not allow that on maps and bags). -Thejas On 6/21/12 11:29 AM, Jonathan Coveney wrote: Am posting before making a ticket just

Re: [jira] [Resolved] (PIG-2650) Convenience mock Loader and Storer to simplify unit testing of Pig scripts

2012-04-26 Thread Thejas Nair
In my opinion, we should only commit changes to released branches that are either critical bug fixes, or very useful minor changes which are not likely to affect the stability of the branch. This change would fall into 2nd category. Thanks, Thejas On 4/26/12 2:32 PM, Bill Graham wrote:

Re: HCatalog scans all partition even after mentioning date filter

2012-04-25 Thread Thejas Nair
to the loader. But, that doesn't work in pig. (I can open a jira, but I havent done enough investigation at the code level). Thoughts? Thanks, Aniket On Tue, Apr 24, 2012 at 7:00 PM, Thejas Nair the...@hortonworks.com mailto:the...@hortonworks.com wrote: The issue was not specific to filter-union

Re: HCatalog scans all partition even after mentioning date filter

2012-04-25 Thread Thejas Nair
projection pushdown to work through Split operators. D On Wed, Apr 25, 2012 at 12:52 PM, Thejas Nair the...@hortonworks.com mailto:the...@hortonworks.com wrote: cc'ing dev@pig as this is a pig issue. Aniket, What you saw is not related to PIG-2339

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

2012-04-24 Thread Thejas Nair
+1 . Checked checksum and signatures of all 3 packages. Ran simple queries in MR and local modes using tar package on unsecure cluster, and rpm package on secure cluster. Thanks, Thejas On 4/20/12 12:39 AM, Daniel Dai wrote: Hi, I have created a candidate build for Pig 0.10.0. Keys used

piggybank on github (was Re: Apache Pig hackday @ Twitter (SF))

2012-04-19 Thread Thejas Nair
On 4/18/12 3:24 PM, Russell Jurney wrote: I'm in. I'm going to work on getting piggybank on github, including for Jython and JRuby UDFs. I think the major work involved there is to figure out how to lower the barrier to contribute and having independent release cycles for the udfs while

Re: Apache Pig hackday @ Twitter (SF)

2012-04-18 Thread Thejas Nair
Count me in -Thejas On 4/18/12 2:18 PM, Dmitriy Ryaboy wrote: Hi folks, The Analytics Infra team at Twitter will be hosting a Pig hackday on May 11. On the agenda: - get newcomers set up with the apache ticket process - review and commit a bunch of stuff that's not been getting love - hack on

Fw: GSoC 2012 mentor signup

2012-03-20 Thread Thejas Nair
fyi, For those who expressed interest in mentoring students for GSoC,  seem email below for instructions to register . Here is the apache mentoring guide - http://community.apache.org/guide-to-being-a-mentor.html - Forwarded Message - From: Ulrich Stärk u...@apache.org To:

Re: Where do we want to put non-java source files?

2012-03-15 Thread Thejas Nair
Sounds good to me. My thoughts on the costs of this change - - svn will still retain the history of the moved files. So that is not a problem. - build.xml would need some minor changes - some extra steps will be required to apply the patches generated against old directory structure. Thanks,

Re: How Logical Plan Generator works?

2012-01-30 Thread Thejas Nair
See initial sections in http://infolab.stanford.edu/~olston/publications/vldb09.pdf for overview of logical plan. LogicalPlanGenerator.g is a the place where logical plan is created from parse tree. You would need to look at antlr basics to understand that. (almost?) all pig relational

Re: [VOTE] Release Pig 0.9.2 (candidate 1)

2012-01-20 Thread Thejas Nair
+1 Checked the md5 checksums, keys of all 3 packages. Ran some simple queries using the rpm package on a secure and unsecure cluster. Checked the -version command. -Thejas On 1/18/12 11:21 AM, Daniel Dai wrote: For your information, I took a shortcut last night to refresh the candidate 1 to

problems with @hortonworks.com email and apache mailing lists?

2012-01-09 Thread Thejas Nair
This is the 2nd apache user group that has reported that emails to my @hortonworks.com address are bouncing. Is anybody else seeing this ? Any way to fix it ? I tried searching for a solution for this, but didn't find any. -Thejas Original Message Subject: warning from

Re: Next Pig release proposal

2011-10-25 Thread Thejas Nair
(3.3.3, 3.3.2, 3.2.2, 3.1.2, ...) Santhosh -Original Message- From: Thejas Nair [mailto:the...@hortonworks.com**] Sent: Friday, October 21, 2011 11:22 AM To: dev@pig.apache.org Subject: Re: Next Pig release proposal Santosh, I thought you meant API stability for hadoop across major

Re: Next Pig release proposal

2011-10-24 Thread Thejas Nair
On 10/24/11 12:43 PM, Dmitriy Ryaboy wrote: We are finding a fair number of issues trying to move from Pig 0.8.1 to 0.9, and I don't think those issues are fixed in 10, either.. not sure that this stabilization process has happened yet. D What kind of issues are these ? Are they related to

Re: Next Pig release proposal

2011-10-24 Thread Thejas Nair
(3.3.3, 3.3.2, 3.2.2, 3.1.2, ...) Santhosh -Original Message- From: Thejas Nair [mailto:the...@hortonworks.com] Sent: Friday, October 21, 2011 11:22 AM To: dev@pig.apache.org Subject: Re: Next Pig release proposal Santosh, I thought you meant API stability for hadoop across major versions

LogicalExpressionSimplifier rules

2011-10-10 Thread Thejas Nair
Sending this email for getting wider attention. I propose disabling LogicalExpressionSimplifier optimizer rule, because the complexity of that rule and number of bugs that seem to come from there does not justify the expected performance gains -

Re: Review Request: Using COR function in Piggybank results in ERROR 2018: Internal error. Unable to introduce the combiner for optimization

2011-09-20 Thread Thejas Nair
. To reply, visit: https://reviews.apache.org/r/1929/ --- (Updated 2011-09-16 18:11:08) Review request for pig and Thejas Nair. Summary --- See PIG-2286 This addresses bug PIG-2286. https://issues.apache.org/jira

Re: Review Request: PIG-2228: support partial aggregation in map task

2011-09-15 Thread Thejas Nair
:) cleaning that - Thejas --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1817/#review1868 --- On 2011-09-15 17:27:08, Thejas Nair wrote

Re: Review Request: PIG-2228: support partial aggregation in map task

2011-09-15 Thread Thejas Nair
/physicalLayer/relationalOperators/POPartialAgg.java https://reviews.apache.org/r/1817/#comment4397 removed the extra ; in the patch checked in. - Thejas On 2011-09-15 17:27:08, Thejas Nair wrote: --- This is an automatically generated e

going to request yourkit license for committers

2011-08-29 Thread Thejas Nair
FYI- Yourkit is very useful java profiling tool and they give license for free for use by open source projects. I am planning to request license for use by pig committers. But they need a reference from the web pages of the project to their website. -

Re: Review Request: Limit produce wrong number of records after foreach flatten

2011-08-24 Thread Thejas Nair
: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1627/ --- (Updated 2011-08-23 17:08:10) Review request for pig and Thejas Nair

Re: Review Request: NullPointerException while Accessing Empty Bag in FOREACH { FILTER }

2011-08-19 Thread Thejas Nair
: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1600/ --- (Updated 2011-08-19 20:36:09) Review request for pig and Thejas Nair

Re: Failing tests after parser change?

2011-08-11 Thread Thejas Nair
Dmitriy, You don't realize how lucky you are! ;) I have been trying hard to reproduce this problem, so that I can check if the patch in PIG-2055 actually fixes the issue. I ran build+ (small)test in a loop for 2000+ times, and this hasn't happened yet. If this is happening (almost)

Please welcome pig's newest committer -  Gianmarco De Francisci Morales

2011-08-05 Thread Thejas Nair
Dear pig community, Please welcome Gianmarco as the newest committer to apache pig project! He has been contributing to pig for more than a year. His contributions include the use of binary comparator in secondary sort , support for default output in split operator, use of scalar expression in

Re: [VOTE] Release Pig 0.9.0 (candidate 1)

2011-07-26 Thread Thejas Nair
+1 Ran queries in local mode on mac, test-commit, and verified md5 checksum. -Thejas On 7/22/11 4:24 PM, Alan Gates wrote: +1. Ran the test-commit, tutorial, and quick sanity test against a real cluster on Linux, ran a quick sanity test in local mode on Mac. Checked signature key and md5.

Re: Review Request: Project UDF output inside a non-foreach statement fail on 0.8

2011-07-18 Thread thejas . nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/767/#review1105 --- Ship it! +1 - thejas On 2011-05-19 22:26:01, Daniel Dai wrote:

Re: Cubing in Pig

2011-07-14 Thread Thejas Nair
+1 to what Gianmarco said about the place to do it. See sample_clause in LogicalPlanGenerator.g. I tried the expanded query (2 dimensions) with 0.8, it results only in 2 MR jobs, the 1st MR job has all the computation being done in a single MR job. The 2nd MR job just concats the outputs

Re: Cubing in Pig

2011-07-14 Thread Thejas Nair
On 7/14/11 3:03 PM, Dmitriy Ryaboy wrote: In the dw world, using a single table and using null as an all marker is the standard thing to do But I imagine that in the dw world, the cube results would get stored in such a way that you can efficiently retrieve results of specific group-bys

Re: Pig testing proposal

2011-07-14 Thread Thejas Nair
On 7/14/11 2:39 PM, Alan Gates wrote: I have posted a proposal for changes in Pig's testing that I would like to make. https://cwiki.apache.org/confluence/display/PIG/PigTestProposal Please take a look and provide feedback. Alan. +1 for the proposal. -Thejas

Re: Pig testing proposal

2011-07-14 Thread Thejas Nair
, and there is also the danger that the alternative script also has the same bug which results buggy benchmark data. -Thejas On 7/14/11 3:51 PM, Thejas Nair wrote: On 7/14/11 2:39 PM, Alan Gates wrote: I have posted a proposal for changes in Pig's testing that I would like to make. https

Re: Review Request: POProject.getNext(DataBag) does not handle null

2011-05-19 Thread thejas . nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/763/#review687 --- Ship it! +1 - thejas On 2011-05-19 17:46:48, Daniel Dai wrote:

Re: Review Request: complex type casting should return null on casting failure

2011-04-28 Thread thejas . nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/673/#review606 --- Ship it! +1 - thejas On 2011-04-28 20:56:30, Daniel Dai wrote:

Re: Review Request: incorrect schema shown when project-star is used with other projections

2011-04-19 Thread thejas . nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/624/#review499 ---

Re: Review Request: Secondary sort fail when dereferencing two fields inside foreach

2011-04-19 Thread thejas . nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/621/#review500 --- Ship it! +1 - thejas On 2011-04-19 00:37:31, Daniel Dai wrote:

Re: Review Request: New logical plan: Should not push up filter in front of Bincond

2011-04-04 Thread thejas . nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/544/#review382 --- Ship it! +1 - thejas On 2011-04-04 18:10:55, Daniel Dai wrote:

Re: Review Request: Dereference a bag within a tuple does not work

2011-04-01 Thread thejas . nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/524/#review375 --- Ship it! +1 - thejas On 2011-03-24 12:22:48, Daniel Dai wrote:

Re: Review Request: New logical plan fails when I have complex data types from udf

2011-03-28 Thread thejas . nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/526/#review354 --- Ship it! +1 - thejas On 2011-03-25 11:51:15, Daniel Dai wrote:

Re: Review Request: Switch to new parser generator technology

2011-03-02 Thread thejas . nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/459/#review282 ---

Re: Review Request: New logical plan: FilterLogicExpressionSimplifier fail to deal with UDF

2011-02-14 Thread thejas . nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/356/#review223 --- Ship it! - thejas On 2011-02-14 17:00:02, Daniel Dai wrote:

Re: Review Request: Disable converting bytes loading from BinStorage

2010-12-02 Thread thejas . nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/134/#review55 ---