[jira] Commented: (PIG-915) Load row names in HBase loader

2010-03-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849230#action_12849230 ] Jeff Zhang commented on PIG-915: Olga, sorry for reply you late. This feature has been include

[jira] Commented: (PIG-282) Custom Partitioner

2010-03-24 Thread David Ciemiewicz (JIRA)
[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849279#action_12849279 ] David Ciemiewicz commented on PIG-282: -- How will the custom partitioner be used in Pig?

[jira] Commented: (PIG-282) Custom Partitioner

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849280#action_12849280 ] Alan Gates commented on PIG-282: This JIRA refers to map->reduce partitioning. Output partiti

[jira] Commented: (PIG-282) Custom Partitioner

2010-03-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849289#action_12849289 ] Dmitriy V. Ryaboy commented on PIG-282: --- David, take a look at https://issues.apache.org

[jira] Updated: (PIG-915) Load row names in HBase loader

2010-03-24 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-915: --- Resolution: Duplicate Status: Resolved (was: Patch Available) This is duplicate of PIG-1205 >

[jira] Commented: (PIG-1295) Binary comparator for secondary sort

2010-03-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849315#action_12849315 ] Daniel Dai commented on PIG-1295: - Hi, Gianmarco, Thank you for your interest. Avro is one th

[jira] Updated: (PIG-1317) LOLoad should cache results of LoadMetadata.getSchema() for use in subsequent calls to LOLoad.getSchema() or LOLoad.determineSchema()

2010-03-24 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-1317: Attachment: PIG-1316.patch Attached patch implements the change to cache the results of LoadMetadata

[jira] Updated: (PIG-1317) LOLoad should cache results of LoadMetadata.getSchema() for use in subsequent calls to LOLoad.getSchema() or LOLoad.determineSchema()

2010-03-24 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-1317: Status: Open (was: Patch Available) Attached wrong patch file > LOLoad should cache results of Load

[jira] Updated: (PIG-1317) LOLoad should cache results of LoadMetadata.getSchema() for use in subsequent calls to LOLoad.getSchema() or LOLoad.determineSchema()

2010-03-24 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-1317: Status: Patch Available (was: Open) > LOLoad should cache results of LoadMetadata.getSchema() for us

[jira] Updated: (PIG-1317) LOLoad should cache results of LoadMetadata.getSchema() for use in subsequent calls to LOLoad.getSchema() or LOLoad.determineSchema()

2010-03-24 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-1317: Attachment: (was: PIG-1316.patch) > LOLoad should cache results of LoadMetadata.getSchema() for u

[jira] Updated: (PIG-1317) LOLoad should cache results of LoadMetadata.getSchema() for use in subsequent calls to LOLoad.getSchema() or LOLoad.determineSchema()

2010-03-24 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-1317: Status: Patch Available (was: Open) > LOLoad should cache results of LoadMetadata.getSchema() for us

[jira] Updated: (PIG-1317) LOLoad should cache results of LoadMetadata.getSchema() for use in subsequent calls to LOLoad.getSchema() or LOLoad.determineSchema()

2010-03-24 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-1317: Attachment: PIG-1317.patch Attached correct patch file now. > LOLoad should cache results of LoadMet

[jira] Updated: (PIG-1316) TextLoader should use Bzip2TextInputFormat for bzip files so that bzip files can be efficiently processed by splitting the files

2010-03-24 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-1316: Status: Patch Available (was: Open) > TextLoader should use Bzip2TextInputFormat for bzip files so t

[jira] Updated: (PIG-1316) TextLoader should use Bzip2TextInputFormat for bzip files so that bzip files can be efficiently processed by splitting the files

2010-03-24 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-1316: Attachment: PIG-1316.patch Attached patch makes the required changes in TextLoader to use BZip2TextI

[jira] Commented: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849434#action_12849434 ] Alan Gates commented on PIG-1310: - Since Pig plans to support SQL soon and since many Pig Lat

[jira] Commented: (PIG-1313) PigServer leaks memory over time

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849453#action_12849453 ] Alan Gates commented on PIG-1313: - I'm not sure I understand all the pros and cons of Daniel'

[jira] Updated: (PIG-1309) Map-side Cogroup

2010-03-24 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1309: -- Attachment: pig-1309.patch Did offline review with Alan. Found a subtle bug in POMergeCogroup#get

TypeCheckingVisitor and casting to less precise numeric types

2010-03-24 Thread Anil Chawla
Hi, I know that Pig has logic for casting inputs to the expected data types when invoking a UDF and I understand that this logic resides in the TypeCheckingVisitor class. I am curious to know why certain casts have been omitted from the "castLookup" map. Specifically, I do not see any entries for

[jira] Updated: (PIG-1315) [Zebra] Implementing OrderedLoadFunc interface for Zebra TableLoader

2010-03-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-1315: - Attachment: zebra.0324 > [Zebra] Implementing OrderedLoadFunc interface for Zebra TableLoader > ---

[jira] Updated: (PIG-1315) [Zebra] Implementing OrderedLoadFunc interface for Zebra TableLoader

2010-03-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-1315: - Fix Version/s: (was: 0.7.0) 0.8.0 Status: Patch Available (was: Open) >

[jira] Updated: (PIG-1268) [Zebra] Need an ant target that runs all pig-related tests in Zebra

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1268: Fix Version/s: 0.7.0 > [Zebra] Need an ant target that runs all pig-related tests in Zebra >

[jira] Updated: (PIG-1214) Pig/Zebra 0.6 patch - docs

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1214: Fix Version/s: 0.6.0 > Pig/Zebra 0.6 patch - docs > -- > > Key: PIG-1

[jira] Updated: (PIG-1148) Move splitable logic from pig latin to InputFormat

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1148: Fix Version/s: 0.7.0 > Move splitable logic from pig latin to InputFormat > -

[jira] Updated: (PIG-1088) change merge join and merge join indexer to work with new LoadFunc interface

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1088: Fix Version/s: 0.7.0 > change merge join and merge join indexer to work with new LoadFunc interface > ---

[jira] Updated: (PIG-1115) [zebra] temp files are not cleaned.

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1115: Fix Version/s: 0.7.0 > [zebra] temp files are not cleaned. > --- > >

[jira] Updated: (PIG-1141) Make streaming work with the new load-store interfaces

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1141: Fix Version/s: 0.7.0 > Make streaming work with the new load-store interfaces >

[jira] Updated: (PIG-1110) Handle compressed file formats -- Gz, BZip with the new proposal

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1110: Fix Version/s: 0.7.0 > Handle compressed file formats -- Gz, BZip with the new proposal > ---

[jira] Updated: (PIG-1059) FINDBUGS: remaining Bad practice + Multithreaded correctness Warning

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1059: Fix Version/s: 0.6.0 > FINDBUGS: remaining Bad practice + Multithreaded correctness Warning > ---

[jira] Updated: (PIG-1072) ReversibleLoadStoreFunc interface should be removed to enable different load and store implementation classes to be used in a reversible manner

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1072: Fix Version/s: 0.7.0 > ReversibleLoadStoreFunc interface should be removed to enable different load > and st

[jira] Updated: (PIG-1052) FINDBUGS: remaining performance warnings

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1052: Fix Version/s: 0.6.0 > FINDBUGS: remaining performance warnings > >

[jira] Updated: (PIG-1058) FINDBUGS: remaining "Correctness Warnings"

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1058: Fix Version/s: 0.6.0 > FINDBUGS: remaining "Correctness Warnings" > -

[jira] Updated: (PIG-1055) FINDBUGS: remaining "Dodgy Warnings"

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1055: Fix Version/s: 0.6.0 > FINDBUGS: remaining "Dodgy Warnings" > > >

[jira] Updated: (PIG-1051) FINFBUGS: NP_NULL_ON_SOME_PATH_FROM_RETURN_VALUE: Possible null pointer dereference due to return value of called method

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1051: Fix Version/s: 0.6.0 > FINFBUGS: NP_NULL_ON_SOME_PATH_FROM_RETURN_VALUE: Possible null pointer > dereference

[jira] Commented: (PIG-1313) PigServer leaks memory over time

2010-03-24 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849501#action_12849501 ] Bill Graham commented on PIG-1313: -- You summed it up well Alan. My ThreadLocal suggestion wa

[jira] Updated: (PIG-964) Handling null in skewed join

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-964: --- Fix Version/s: 0.4.0 > Handling null in skewed join > - > > Key: PI

[jira] Updated: (PIG-822) Flatten semantics are unknown

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-822: --- Fix Version/s: 0.4.0 > Flatten semantics are unknown > - > > Key: PI

[jira] Updated: (PIG-458) Type branch integration with hadoop 18

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-458: --- Fix Version/s: 0.2.0 > Type branch integration with hadoop 18 > -- > >

[jira] Commented: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-24 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849528#action_12849528 ] Russell Jurney commented on PIG-1310: - Thanks, Alan, I'll add all those changes tonight.

[jira] Updated: (PIG-336) NULL checks are not in place in the types branch

2010-03-24 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-336: --- Fix Version/s: 0.2.0 > NULL checks are not in place in the types branch > --

[jira] Updated: (PIG-1306) [zebra] Support of locally sorted input splits

2010-03-24 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Zhou updated PIG-1306: -- Attachment: PIG-1306.patch > [zebra] Support of locally sorted input splits > ---

[jira] Updated: (PIG-1306) [zebra] Support of locally sorted input splits

2010-03-24 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Zhou updated PIG-1306: -- Status: Patch Available (was: Open) > [zebra] Support of locally sorted input splits > -

JIRA Fix Version

2010-03-24 Thread Alan Gates
A reminder to Pig committers: When closing a JIRA issue as Resolved/ Fixed please make sure to set the Fix Version field. This helps our users know what versions they need to use to get fixes for their issues. And it helps release managers when they build releases to know what is and isn'

[jira] Commented: (PIG-1317) LOLoad should cache results of LoadMetadata.getSchema() for use in subsequent calls to LOLoad.getSchema() or LOLoad.determineSchema()

2010-03-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849568#action_12849568 ] Hadoop QA commented on PIG-1317: +1 overall. Here are the results of testing the latest atta