[jira] Commented: (PIG-1661) Add alternative search-provider to Pig site

2010-10-02 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12917246#action_12917246 ] Santhosh Srinivasan commented on PIG-1661: -- Sure, worth a try. Add alternative

RE: [VOTE] Pig to become a top level Apache project

2010-08-18 Thread Santhosh Srinivasan
+1 Kudos to Alan and Olga for this amazing milestone. Santhosh -Original Message- From: Alan Gates [mailto:ga...@yahoo-inc.com] Sent: Wednesday, August 18, 2010 10:34 AM To: pig-dev@hadoop.apache.org Subject: [VOTE] Pig to become a top level Apache project Earlier this week I began a

RE: Restarting discussion on Pig as a TLP

2010-08-17 Thread Santhosh Srinivasan
+1 Very nice! I see that opinion has changed within a couple of quarters :) I am pasting references to my responses to Alan's initial proposal to make Pig a TLP. I am all for making Pig a TLP. References: 1.

RE: Begin a discussion about Pig as a top level project

2010-04-03 Thread Santhosh Srinivasan
I see this as a multi-part question. Looking back at some of the significant roadmap/existential questions asked in the last 12 months, I see the following: 1. With the introduction of SQL, what is the philosophy of Pig (I sent an email about this approximately 9 months ago) 2. What is the

[jira] Created: (PIG-1344) PigStorage should be able to read back complex data containing delimiters created by PigStorage

2010-03-30 Thread Santhosh Srinivasan (JIRA)
Project: Pig Issue Type: Bug Components: impl Affects Versions: 0.7.0 Reporter: Santhosh Srinivasan Assignee: Daniel Dai Fix For: 0.8.0 With Pig 0.7, the TextDataParser has been removed and the logic to parse complex data types

[jira] Commented: (PIG-1331) Owl Hadoop Table Management Service

2010-03-26 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12850342#action_12850342 ] Santhosh Srinivasan commented on PIG-1331: -- Jay, In PIG-823 there was a discussion

[jira] Commented: (PIG-1117) Pig reading hive columnar rc tables

2010-01-11 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12798917#action_12798917 ] Santhosh Srinivasan commented on PIG-1117: -- +1 on making it part of main piggybank

[jira] Commented: (PIG-1065) In-determinate behaviour of Union when there are 2 non-matching schema's

2009-11-10 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12775968#action_12775968 ] Santhosh Srinivasan commented on PIG-1065: -- The schema will then correspond

[jira] Commented: (PIG-1065) In-determinate behaviour of Union when there are 2 non-matching schema's

2009-11-10 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12776098#action_12776098 ] Santhosh Srinivasan commented on PIG-1065: -- bq. Aliasing inside foreach is hugely

RE: How to clone a logical plan ?

2009-11-05 Thread Santhosh Srinivasan
You have hit a bug. I think LOJoin has to be added to LogicalPlanCloneHelper.java. Can you file a jira? Thanks, Santhosh -Original Message- From: Ashutosh Chauhan [mailto:ashutosh.chau...@gmail.com] Sent: Thursday, November 05, 2009 3:28 PM To: pig-dev@hadoop.apache.org Subject: How to

RE: How to clone a logical plan ?

2009-11-05 Thread Santhosh Srinivasan
in your test cases, then you need to add code for cloning the LOLoad, LOStore, LOStream and LOJoin. Santhosh -Original Message- From: Santhosh Srinivasan [mailto:s...@yahoo-inc.com] Sent: Thursday, November 05, 2009 4:04 PM To: pig-dev@hadoop.apache.org Subject: RE: How to clone

[jira] Commented: (PIG-1073) LogicalPlanCloner can't clone plan containing LOJoin

2009-11-05 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12774147#action_12774147 ] Santhosh Srinivasan commented on PIG-1073: -- If my memory serves me correctly

[jira] Commented: (PIG-1065) In-determinate behaviour of Union when there are 2 non-matching schema's

2009-11-05 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12774153#action_12774153 ] Santhosh Srinivasan commented on PIG-1065: -- Answer to Question 1: Pig 1.0 had

RE: RequiredFields contents

2009-11-05 Thread Santhosh Srinivasan
The first element in the pair is the input number. Its mostly 0 for most operators. For multi-input operators like join and cogroup, it will range from 0 to (n - 1) where n is the number of inputs. Santhosh -Original Message- From: Dmitriy Ryaboy [mailto:dvrya...@gmail.com] Sent:

[jira] Commented: (PIG-1016) Reading in map data seems broken

2009-10-28 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771287#action_12771287 ] Santhosh Srinivasan commented on PIG-1016: -- I am summarizing my understanding

[jira] Commented: (PIG-1056) table can not be loaded after store

2009-10-27 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12770743#action_12770743 ] Santhosh Srinivasan commented on PIG-1056: -- Do you have the right load statement? I

[jira] Commented: (PIG-1012) FINDBUGS: SE_BAD_FIELD: Non-transient non-serializable instance field in serializable class

2009-10-21 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12768368#action_12768368 ] Santhosh Srinivasan commented on PIG-1012: -- I just looked at the first patch

[jira] Commented: (PIG-1014) Pig should convert COUNT(relation) to COUNT_STAR(relation) so that all records are counted without considering nullness of the fields in the records

2009-10-14 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12765779#action_12765779 ] Santhosh Srinivasan commented on PIG-1014: -- Another option is to change

[jira] Commented: (PIG-1014) Pig should convert COUNT(relation) to COUNT_STAR(relation) so that all records are counted without considering nullness of the fields in the records

2009-10-13 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12765194#action_12765194 ] Santhosh Srinivasan commented on PIG-1014: -- Essentially, Pradeep is pointing out

[jira] Commented: (PIG-1014) Pig should convert COUNT(relation) to COUNT_STAR(relation) so that all records are counted without considering nullness of the fields in the records

2009-10-13 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12765357#action_12765357 ] Santhosh Srinivasan commented on PIG-1014: -- After a discussion with Pradeep who also

[jira] Commented: (PIG-1014) Pig should convert COUNT(relation) to COUNT_STAR(relation) so that all records are counted without considering nullness of the fields in the records

2009-10-12 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12764771#action_12764771 ] Santhosh Srinivasan commented on PIG-1014: -- Is Pig trying to guess the user's intent

[jira] Commented: (PIG-1014) Pig should convert COUNT(relation) to COUNT_STAR(relation) so that all records are counted without considering nullness of the fields in the records

2009-10-12 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12764792#action_12764792 ] Santhosh Srinivasan commented on PIG-1014: -- If the user wants to count without nulls

[jira] Commented: (PIG-984) PERFORMANCE: Implement a map-side group operator to speed up processing of ordered data

2009-10-12 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12764846#action_12764846 ] Santhosh Srinivasan commented on PIG-984: - Very quick comment. The parser has

[jira] Commented: (PIG-1014) Pig should convert COUNT(relation) to COUNT_STAR(relation) so that all records are counted without considering nullness of the fields in the records

2009-10-10 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12764368#action_12764368 ] Santhosh Srinivasan commented on PIG-1014: -- When the semantics of COUNT was changed

[jira] Commented: (PIG-995) Limit Optimizer throw exception ERROR 2156: Error while fixing projections

2009-10-09 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12764119#action_12764119 ] Santhosh Srinivasan commented on PIG-995: - Review comments: The initialization code

[jira] Commented: (PIG-984) PERFORMANCE: Implement a map-side group operator to speed up processing of ordered data

2009-10-01 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12761270#action_12761270 ] Santhosh Srinivasan commented on PIG-984: - bq. But this is in line with what we've

[jira] Commented: (PIG-984) PERFORMANCE: Implement a map-side group operator to speed up processing of ordered data

2009-09-30 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12761028#action_12761028 ] Santhosh Srinivasan commented on PIG-984: - A couple of things: 1. I am concerned

[jira] Commented: (PIG-984) PERFORMANCE: Implement a map-side group operator to speed up processing of ordered data

2009-09-30 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12761073#action_12761073 ] Santhosh Srinivasan commented on PIG-984: - bq. This is something that can be inferred

RE: Revisit Pig Philosophy?

2009-09-21 Thread Santhosh Srinivasan
Hey Milind, Varaha is a boar and not a pig :) I agree with you on the point that Pig and Pig Latin have not been clearly defined and most times they are used interchangeably. Santhosh -Original Message- From: Milind A Bhandarkar [mailto:mili...@yahoo-inc.com] Sent: Friday, September

Revisit Pig Philosophy?

2009-09-18 Thread Santhosh Srinivasan
Pig Developers, I looked at the Pig philosophy page as it serves as a guideline for accepting changes to Pig. Is it time to revisit the overall philosophy? Reference: http://hadoop.apache.org/pig/philosophy.html Some items of interest: 1. SQL semantics and Pig With the recent addition of SQL

[jira] Commented: (PIG-955) Skewed join generates incorrect results

2009-09-11 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12754349#action_12754349 ] Santhosh Srinivasan commented on PIG-955: - Hi Ying, How are Fragment Replicate Join

[jira] Commented: (PIG-922) Logical optimizer: push up project

2009-08-25 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12747560#action_12747560 ] Santhosh Srinivasan commented on PIG-922: - For relational operators that require

RE: Proposal to create a branch for contrib project Zebra

2009-08-18 Thread Santhosh Srinivasan
I would recommend that zebra wait for Pig 0.4.0 (a couple of weeks?). A branch will be created for the 0.4.0 release and zebra will automatically benefit. Santhosh -Original Message- From: Raghu Angadi [mailto:rang...@yahoo-inc.com] Sent: Tuesday, August 18, 2009 9:49 AM To:

RE: Pig 0.4.0 release

2009-08-17 Thread Santhosh Srinivasan
I have a question: Will we be able to fix piggybank sources given that Zebra needs 0.20 and the rest of Pig requires 0.18? If the answer is yes then, +1 for the release. I agree with the plan of making 0.4.0 with Hadoop-0.18 and a later release (0.5.0) for Hadoop-0.20.1. Thanks, Santhosh

RE: Pig 0.4.0 release

2009-08-17 Thread Santhosh Srinivasan
, What do you mean by fixing piggybank? Olga -Original Message- From: Santhosh Srinivasan [mailto:s...@yahoo-inc.com] Sent: Monday, August 17, 2009 1:37 PM To: pig-dev@hadoop.apache.org Subject: RE: Pig 0.4.0 release I have a question: Will we be able to fix piggybank sources given

RE: Pig 0.4.0 release

2009-08-17 Thread Santhosh Srinivasan
Rephrasing my question: Till we release 0.5.0, will zebra's requirement on hadoop-0.20 prevent fixing of any bugs/issues with Piggybank? Santhosh -Original Message- From: Santhosh Srinivasan [mailto:s...@yahoo-inc.com] Sent: Monday, August 17, 2009 1:47 PM To: pig-dev

RE: Proposal to create a branch for contrib project Zebra

2009-08-17 Thread Santhosh Srinivasan
My vote is -1 -Original Message- From: Santhosh Srinivasan Sent: Monday, August 17, 2009 4:38 PM To: 'pig-dev@hadoop.apache.org' Subject: RE: Proposal to create a branch for contrib project Zebra Is there any precedence for such proposals? I am not comfortable with extending committer

RE: Proposal to create a branch for contrib project Zebra

2009-08-17 Thread Santhosh Srinivasan
Is there any precedence for such proposals? I am not comfortable with extending committer access to contrib teams. I would suggest that Zebra be made a sub-project of Hadoop and have a life of its own. Santhosh -Original Message- From: Raghu Angadi [mailto:rang...@yahoo-inc.com] Sent:

[jira] Resolved: (PIG-561) Need to generate empty tuples and bags as a part of Pig Syntax

2009-08-09 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan resolved PIG-561. - Resolution: Duplicate Duplicate of PIG-773 Need to generate empty tuples and bags

[jira] Commented: (PIG-912) Rename/Add 'string' as a type in place of chararray - and deprecate (and probably eventually remove) the use of 'chararray'

2009-08-06 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12740357#action_12740357 ] Santhosh Srinivasan commented on PIG-912: - +1 Rename/Add 'string' as a type in place

[jira] Commented: (PIG-908) Need a way to correlate MR jobs with Pig statements

2009-08-04 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12739147#action_12739147 ] Santhosh Srinivasan commented on PIG-908: - +1 This approach has been discussed

[jira] Updated: (PIG-697) Proposed improvements to pig's optimizer

2009-07-31 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-697: Status: In Progress (was: Patch Available) Proposed improvements to pig's optimizer

[jira] Updated: (PIG-697) Proposed improvements to pig's optimizer

2009-07-31 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-697: Status: Patch Available (was: In Progress) Proposed improvements to pig's optimizer

[jira] Updated: (PIG-880) Order by is borken with complex fields

2009-07-30 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-880: Status: Open (was: Patch Available) Order by is borken with complex fields

[jira] Work started: (PIG-880) Order by is borken with complex fields

2009-07-30 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on PIG-880 started by Santhosh Srinivasan. Order by is borken with complex fields -- Key: PIG-880

[jira] Updated: (PIG-880) Order by is borken with complex fields

2009-07-30 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-880: Status: Patch Available (was: In Progress) Order by is borken with complex fields

[jira] Commented: (PIG-898) TextDataParser does not handle delimiters from one complex type in another

2009-07-30 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12737319#action_12737319 ] Santhosh Srinivasan commented on PIG-898: - In addition, empty bags, tuples

[jira] Updated: (PIG-880) Order by is borken with complex fields

2009-07-30 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-880: Attachment: (was: PIG-880.patch) Order by is borken with complex fields

[jira] Updated: (PIG-880) Order by is borken with complex fields

2009-07-30 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-880: Status: Patch Available (was: In Progress) Order by is borken with complex fields

[jira] Commented: (PIG-889) Pig can not access reporter of PigHadoopLog in Load Func

2009-07-29 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12736990#action_12736990 ] Santhosh Srinivasan commented on PIG-889: - PigHadoopLogger implements the PigLogger

[jira] Created: (PIG-897) Pig should support counters

2009-07-29 Thread Santhosh Srinivasan (JIRA)
: Santhosh Srinivasan Fix For: 0.4.0 Pig should support the use of counters. The use of the counters can possibly be via the script or via Java APIs. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Assigned: (PIG-880) Order by is borken with complex fields

2009-07-29 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan reassigned PIG-880: --- Assignee: Santhosh Srinivasan Order by is borken with complex fields

[jira] Updated: (PIG-880) Order by is borken with complex fields

2009-07-29 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-880: Status: Patch Available (was: Open) Order by is borken with complex fields

[jira] Commented: (PIG-660) Integration with Hadoop 0.20

2009-07-28 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12736283#action_12736283 ] Santhosh Srinivasan commented on PIG-660: - The build.xml in the patch(es) have

[jira] Commented: (PIG-882) log level not propogated to loggers

2009-07-28 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12736359#action_12736359 ] Santhosh Srinivasan commented on PIG-882: - Minor comment: Index: src/org/apache/pig

[jira] Commented: (PIG-889) Pig can not access reporter of PigHadoopLog in Load Func

2009-07-24 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12735129#action_12735129 ] Santhosh Srinivasan commented on PIG-889: - The issue here is the lack of support

[jira] Commented: (PIG-892) Make COUNT and AVG deal with nulls accordingly with SQL standar

2009-07-23 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12734806#action_12734806 ] Santhosh Srinivasan commented on PIG-892: - 1. Index: src/org/apache/pig/builtin

[jira] Commented: (PIG-773) Empty complex constants (empty bag, empty tuple and empty map) should be supported

2009-07-23 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12734810#action_12734810 ] Santhosh Srinivasan commented on PIG-773: - + 1 for the changes. Empty complex

[jira] Updated: (PIG-773) Empty complex constants (empty bag, empty tuple and empty map) should be supported

2009-07-23 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-773: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch

[jira] Commented: (PIG-892) Make COUNT and AVG deal with nulls accordingly with SQL standar

2009-07-22 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12734417#action_12734417 ] Santhosh Srinivasan commented on PIG-892: - I am reviewing the patch. Make COUNT

[jira] Updated: (PIG-695) Pig should not fail when error logs cannot be created

2009-07-21 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-695: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch

[jira] Updated: (PIG-695) Pig should not fail when error logs cannot be created

2009-07-21 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-695: Fix Version/s: 0.4.0 Pig should not fail when error logs cannot be created

[jira] Commented: (PIG-893) support cast of chararray to other simple types

2009-07-21 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733773#action_12733773 ] Santhosh Srinivasan commented on PIG-893: - What are the semantics of chararray (string

[jira] Commented: (PIG-889) Pig can not access reporter of PigHadoopLog in Load Func

2009-07-21 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733825#action_12733825 ] Santhosh Srinivasan commented on PIG-889: - Comments: The reporter inside the logger

[jira] Updated: (PIG-695) Pig should not fail when error logs cannot be created

2009-07-17 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-695: Attachment: PIG-695.patch Attached patch ensures that Pig does not error out when the error

[jira] Work stopped: (PIG-695) Pig should not fail when error logs cannot be created

2009-07-17 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on PIG-695 stopped by Santhosh Srinivasan. Pig should not fail when error logs cannot be created

[jira] Updated: (PIG-695) Pig should not fail when error logs cannot be created

2009-07-17 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-695: Status: Patch Available (was: Open) Pig should not fail when error logs cannot be created

[jira] Updated: (PIG-728) All backend error messages must be logged to preserve the original error messages

2009-07-16 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-728: Status: In Progress (was: Patch Available) All backend error messages must be logged

[jira] Updated: (PIG-728) All backend error messages must be logged to preserve the original error messages

2009-07-16 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-728: Attachment: PIG-728_1.patch Attaching a new patch that fixes the findbugs issue. All

[jira] Updated: (PIG-728) All backend error messages must be logged to preserve the original error messages

2009-07-15 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-728: Attachment: PIG-728.patch The attached patch logs all backend error messages before Pig tries

[jira] Updated: (PIG-728) All backend error messages must be logged to preserve the original error messages

2009-07-15 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-728: Fix Version/s: (was: 0.2.1) 0.4.0 Affects Version/s

[jira] Commented: (PIG-877) Push up filter does not account for added columns in foreach

2009-07-13 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12730525#action_12730525 ] Santhosh Srinivasan commented on PIG-877: - Its at Optimization time. Push up filter

[jira] Commented: (PIG-877) Push up filter does not account for added columns in foreach

2009-07-13 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12730595#action_12730595 ] Santhosh Srinivasan commented on PIG-877: - Patch has been committed. Push up filter

[jira] Created: (PIG-877) Push up filter does not account for added columns in foreach

2009-07-09 Thread Santhosh Srinivasan (JIRA)
: 0.3.1 Reporter: Santhosh Srinivasan Fix For: 0.3.1 If a filter follows a foreach that produces an added column then push up filter fails with a null pointer exception. {code} ... x = foreach w generate $0, COUNT($1); y = filter x by $1 10; {code} In the above example

[jira] Assigned: (PIG-877) Push up filter does not account for added columns in foreach

2009-07-09 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan reassigned PIG-877: --- Assignee: Santhosh Srinivasan Push up filter does not account for added columns

[jira] Updated: (PIG-877) Push up filter does not account for added columns in foreach

2009-07-09 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-877: Status: Patch Available (was: Open) Push up filter does not account for added columns

[jira] Updated: (PIG-877) Push up filter does not account for added columns in foreach

2009-07-09 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-877: Attachment: PIG-877.patch Attached patch fixes the NPE. Push up filter does not account

[jira] Created: (PIG-873) Optimizer should allow search for global patterns

2009-07-07 Thread Santhosh Srinivasan (JIRA)
Reporter: Santhosh Srinivasan Fix For: 0.4.0 Currently, the optimizer works on the following mechanism: 1. Specify the pattern to be searched 2. For each occurrence of the pattern, check and then apply a transformation With this approach, the search for a pattern is localized

[jira] Created: (PIG-874) Problems in pushing down foreach with flatten

2009-07-07 Thread Santhosh Srinivasan (JIRA)
: Santhosh Srinivasan Fix For: 0.4.0 If the graph contains more than one foreach connected to an operator, pushing down foreach with flatten is not possible with the current optimizer pattern matching algorithm and current implementation of rewire. The following mechanism of pushing

[jira] Commented: (PIG-697) Proposed improvements to pig's optimizer

2009-07-02 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12726566#action_12726566 ] Santhosh Srinivasan commented on PIG-697: - 1. Removing added fields from the flattened

[jira] Commented: (PIG-697) Proposed improvements to pig's optimizer

2009-07-02 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12726601#action_12726601 ] Santhosh Srinivasan commented on PIG-697: - -1 javac. The applied patch generated 250

[jira] Commented: (PIG-697) Proposed improvements to pig's optimizer

2009-07-02 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12726684#action_12726684 ] Santhosh Srinivasan commented on PIG-697: - Phase 4 part 2 patch has been committed

[jira] Updated: (PIG-792) PERFORMANCE: Support skewed join in pig

2009-07-02 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-792: Status: Patch Available (was: Open) PERFORMANCE: Support skewed join in pig

[jira] Commented: (PIG-697) Proposed improvements to pig's optimizer

2009-06-29 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12725261#action_12725261 ] Santhosh Srinivasan commented on PIG-697: - Phase 4 part 1 patch has been committed

[jira] Commented: (PIG-773) Empty complex constants (empty bag, empty tuple and empty map) should be supported

2009-06-29 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12725279#action_12725279 ] Santhosh Srinivasan commented on PIG-773: - Review comments: 1. In addition

[jira] Created: (PIG-866) Pig should support ability to query unique column name when there is no ambiguity

2009-06-29 Thread Santhosh Srinivasan (JIRA)
Issue Type: Improvement Components: impl Affects Versions: 0.4.0 Reporter: Santhosh Srinivasan Fix For: 0.4.0 Currently, the default alias of a column following a flatten contains the disambiguator ::. For columns that have a unique name

[jira] Commented: (PIG-866) Pig should support ability to query unique column name when there is no ambiguity

2009-06-29 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12725303#action_12725303 ] Santhosh Srinivasan commented on PIG-866: - This support has to be extended

[jira] Updated: (PIG-697) Proposed improvements to pig's optimizer

2009-06-26 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-697: Status: Patch Available (was: In Progress) Proposed improvements to pig's optimizer

[jira] Commented: (PIG-697) Proposed improvements to pig's optimizer

2009-06-26 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12724704#action_12724704 ] Santhosh Srinivasan commented on PIG-697: - The find bug warnings are harmless

RE: requirements for Pig 1.0?

2009-06-23 Thread Santhosh Srinivasan
To add to Alan's list: 1. Ability to handle unknown types in Pig's schema model. 2. Load/Store interfaces are not set in stone. 3. Nice to have: Make PigServer thread safe. Thanks, Santhosh -Original Message- From: Alan Gates [mailto:ga...@yahoo-inc.com] Sent: Tuesday, June 23, 2009

[jira] Updated: (PIG-697) Proposed improvements to pig's optimizer

2009-06-23 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-697: Status: In Progress (was: Patch Available) Proposed improvements to pig's optimizer

[jira] Commented: (PIG-773) Empty complex constants (empty bag, empty tuple and empty map) should be supported

2009-06-22 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12722701#action_12722701 ] Santhosh Srinivasan commented on PIG-773: - Comments: 1. Minor comment - the comment

[jira] Updated: (PIG-851) Map type used as return type in UDFs not recognized at all times

2009-06-22 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-851: Status: In Progress (was: Patch Available) Map type used as return type in UDFs

[jira] Updated: (PIG-851) Map type used as return type in UDFs not recognized at all times

2009-06-22 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-851: Patch Info: [Patch Available] Map type used as return type in UDFs not recognized at all

[jira] Commented: (PIG-697) Proposed improvements to pig's optimizer

2009-06-19 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721975#action_12721975 ] Santhosh Srinivasan commented on PIG-697: - 1. Some operators do not have any internal

[jira] Commented: (PIG-697) Proposed improvements to pig's optimizer

2009-06-19 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12722075#action_12722075 ] Santhosh Srinivasan commented on PIG-697: - OptimizerPhase3_part2_3.patch has been

[jira] Commented: (PIG-753) Provide support for UDFs without parameters

2009-06-18 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721564#action_12721564 ] Santhosh Srinivasan commented on PIG-753: - +1 for the code changes. The license header

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721592#action_12721592 ] Santhosh Srinivasan commented on PIG-856: - Would that be through a configuration

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721596#action_12721596 ] Santhosh Srinivasan commented on PIG-856: - Essentially, are we adding more knobs

[jira] Updated: (PIG-697) Proposed improvements to pig's optimizer

2009-06-17 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-697: Attachment: (was: OptimizerPhase3_part2_2.patch) Proposed improvements to pig's

  1   2   3   >