Hi Parth, Definitely it looks like a bug to me. I wrote a small test and it fails too. Will try to provide a patch for this.
Ravi On Tue, Feb 16, 2016 at 5:37 PM, Parth Sawant <[email protected]> wrote: > Update: The same method doesn't work for writing into SMALLINT columns in > a Phoenix table, ie a 'bytearray' field in Pig can be written into a > TINYINT column in Phoenix table but not into a SMALLINT column. > > On Tue, Feb 16, 2016 at 3:51 PM, Parth Sawant <[email protected]> > wrote: > >> Hi >> We are using the Pig-Phoenix Bulkload integration to load data into a >> table. We realize that Pig does not support TINYINT and SMALLINT datatypes. >> So we are declaring those fields as INT in Pig but trying to write them >> into a Phoenix TINYINT datatype. I suppose we're looking to write/cast an >> INT in PIG to a TINYINT/SMALLINT in Phoenix. The only way we found around >> this was to declare the Pig fields with the type BYTEARRAY and then write >> them into TINYINT columns in a Phoenix table. Is there a more refined way >> of doing this? >> >> On Sat, Feb 13, 2016 at 10:10 AM, anil gupta <[email protected]> >> wrote: >> >>> I think, Ravi answered my question. One of my team mate was working on >>> Pig-Phoenix loader so i'll share this with him. We will update once we try >>> this out. >>> Thanks Guys. >>> >>> On Sat, Feb 13, 2016 at 10:01 AM, James Taylor <[email protected]> >>> wrote: >>> >>>> I think the question Anil is asking is "Does Pig have support for >>>> TinyInt (byte) and SmallInt (short)?" I don't know the answer. >>>> >>>> On Sat, Feb 13, 2016 at 9:46 AM, Ravi Kiran <[email protected]> >>>> wrote: >>>> >>>>> Hi Anil, >>>>> >>>>> We do a mapping of PTintInt and PSmallInt to Pig DataType.INTEGER . >>>>> https://github.com/apache/phoenix/blob/master/phoenix-pig/src/main/java/org/apache/phoenix/pig/util/TypeUtil.java#L94 >>>>> . Can you please share the error you are seeing. >>>>> >>>>> HTH >>>>> >>>>> Ravi. >>>>> >>>>> On Sat, Feb 13, 2016 at 3:16 AM, anil gupta <[email protected]> >>>>> wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> We are using Pig-Phoenix loader to load data into a table. Initially, >>>>>> we created some columns as TinyInt and SmallInt in our Phoenix table. >>>>>> But, >>>>>> Pig does not have TinyInt and SmallInt datatypes, so we were forced to >>>>>> convert all TinyInt and SmallInt columns into INTEGER. >>>>>> Is there a way/trick we can still use TinyInt and SmallInt in Phoenix >>>>>> table while using Pig-Phoenix loader? >>>>>> >>>>>> If currently there is no way to do it, can we enhance Pig-Phoenix >>>>>> loader to support TinyInt and SmallInt? >>>>>> >>>>>> -- >>>>>> Thanks & Regards, >>>>>> Anil Gupta >>>>>> >>>>> >>>>> >>>> >>> >>> >>> -- >>> Thanks & Regards, >>> Anil Gupta >>> >> >> >
